2024-09-21T07:43:29.555 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T07:43:29.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T07:43:29.674 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7913120 branch: squid description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7913120' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - osds down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 9344 sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 sleep_before_teardown: 0 subset: 56/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 targets: smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE1zvKK4PUDjCtHb1UErhtqrUkKx0kd+13PZhI7SA4B3r8hwLQSGGr03kiYmNxYpchCtOjV5PUNozbku2m8dXDc= smithi129.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGjY9cbF2BymKkXE5e+2zX8JD29Kgq2sR7vyGcIrUF3aot2ql8FGe28oT6O9BPL9u6UWev62IZw3oCXueDTCNX8= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_21:08:02 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-21T07:43:29.674 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa; will attempt to use it 2024-09-21T07:43:29.724 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa/tasks 2024-09-21T07:43:29.724 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T07:43:29.726 INFO:teuthology.task.internal:Checking packages... 2024-09-21T07:43:29.746 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '9e2ac70bb7aea67d34f0d50002344abbe7803736' 2024-09-21T07:43:29.746 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T07:43:29.746 INFO:teuthology.packaging:ref: None 2024-09-21T07:43:29.746 INFO:teuthology.packaging:tag: None 2024-09-21T07:43:29.746 INFO:teuthology.packaging:branch: squid 2024-09-21T07:43:29.746 INFO:teuthology.packaging:sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T07:43:29.746 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T07:43:29.963 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-373.g4e45e6b4 2024-09-21T07:43:29.966 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T07:43:29.972 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T07:43:29.972 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T07:43:29.986 INFO:teuthology.task.internal:Saving configuration 2024-09-21T07:43:30.006 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T07:43:30.018 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T07:43:30.045 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7913120', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 07:38:21.421574', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE1zvKK4PUDjCtHb1UErhtqrUkKx0kd+13PZhI7SA4B3r8hwLQSGGr03kiYmNxYpchCtOjV5PUNozbku2m8dXDc='} 2024-09-21T07:43:30.066 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7913120', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 07:38:21.423491', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGjY9cbF2BymKkXE5e+2zX8JD29Kgq2sR7vyGcIrUF3aot2ql8FGe28oT6O9BPL9u6UWev62IZw3oCXueDTCNX8='} 2024-09-21T07:43:30.066 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T07:43:30.074 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-21T07:43:30.075 INFO:teuthology.task.internal:roles: ubuntu@smithi129.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-21T07:43:30.075 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T07:43:30.141 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f327cb48160>, signals=[15]) 2024-09-21T07:43:30.141 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T07:43:30.149 INFO:teuthology.task.internal:Opening connections... 2024-09-21T07:43:30.149 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-09-21T07:43:30.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:43:30.229 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi129.front.sepia.ceph.com 2024-09-21T07:43:30.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:43:30.302 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T07:43:30.311 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-09-21T07:43:30.330 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-09-21T07:43:30.330 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-09-21T07:43:30.389 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-09-21T07:43:30.389 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2024-09-21T07:43:30.390 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-09-21T07:43:30.390 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-09-21T07:43:30.390 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2024-09-21T07:43:30.390 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2024-09-21T07:43:30.390 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T07:43:30.390 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-09-21T07:43:30.390 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2024-09-21T07:43:30.390 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T07:43:30.390 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-09-21T07:43:30.390 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T07:43:30.390 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T07:43:30.390 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T07:43:30.391 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-09-21T07:43:30.408 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2024-09-21T07:43:30.427 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2024-09-21T07:43:30.427 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-09-21T07:43:30.485 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2024-09-21T07:43:30.485 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2024-09-21T07:43:30.485 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2024-09-21T07:43:30.485 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2024-09-21T07:43:30.485 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2024-09-21T07:43:30.485 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2024-09-21T07:43:30.486 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T07:43:30.486 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2024-09-21T07:43:30.486 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2024-09-21T07:43:30.486 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T07:43:30.486 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2024-09-21T07:43:30.486 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T07:43:30.486 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T07:43:30.486 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T07:43:30.486 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-09-21T07:43:30.533 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T07:43:30.544 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T07:43:30.597 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T07:43:30.597 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-09-21T07:43:30.599 DEBUG:teuthology.orchestra.run.smithi129:> test '!' -e /home/ubuntu/cephtest 2024-09-21T07:43:30.616 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T07:43:30.626 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T07:43:30.627 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-09-21T07:43:30.657 DEBUG:teuthology.orchestra.run.smithi129:> test -z $(ls -A /var/lib/ceph) 2024-09-21T07:43:30.682 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T07:43:30.739 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T07:43:30.754 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T07:43:30.754 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T07:43:30.755 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T07:43:30.755 DEBUG:teuthology.orchestra.run.smithi129:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T07:43:30.772 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:43:30.772 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-09-21T07:43:30.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:43:30.773 DEBUG:teuthology.orchestra.run.smithi129:> uname -r 2024-09-21T07:43:30.830 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-503.el9.x86_64 2024-09-21T07:43:30.830 INFO:teuthology.task.kernel:Running kernel on smithi107: 5.14.0-503.el9.x86_64 2024-09-21T07:43:30.831 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum install -y kernel 2024-09-21T07:43:30.832 INFO:teuthology.orchestra.run.smithi129.stdout:5.14.0-503.el9.x86_64 2024-09-21T07:43:30.832 INFO:teuthology.task.kernel:Running kernel on smithi129: 5.14.0-503.el9.x86_64 2024-09-21T07:43:30.832 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum install -y kernel 2024-09-21T07:43:33.497 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.3 MB 00:00 2024-09-21T07:43:34.181 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.3 MB 00:01 2024-09-21T07:43:35.173 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 34 MB/s | 20 MB 00:00 2024-09-21T07:43:35.840 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - AppStream 37 MB/s | 20 MB 00:00 2024-09-21T07:43:39.407 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-21T07:43:41.191 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 19 kB 00:00 2024-09-21T07:43:41.349 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-21T07:43:42.078 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-21T07:43:43.100 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 19 kB 00:00 2024-09-21T07:43:43.871 INFO:teuthology.orchestra.run.smithi129.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-21T07:43:47.467 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T07:43:49.251 INFO:teuthology.orchestra.run.smithi129.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-21T07:43:49.323 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T07:43:49.323 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T07:43:49.408 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:43:49.414 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:43:49.414 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2024-09-21T07:43:49.414 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:43:49.415 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-21T07:43:49.415 INFO:teuthology.orchestra.run.smithi107.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T07:43:49.415 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-21T07:43:49.415 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T07:43:49.415 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T07:43:49.415 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T07:43:49.415 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:43:49.415 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-21T07:43:49.415 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:43:49.415 INFO:teuthology.orchestra.run.smithi107.stdout:Install 4 Packages 2024-09-21T07:43:49.415 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:43:49.416 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 79 M 2024-09-21T07:43:49.416 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 126 M 2024-09-21T07:43:49.416 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-21T07:43:49.768 INFO:teuthology.orchestra.run.smithi107.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 481 kB/s | 36 kB 00:00 2024-09-21T07:43:51.141 INFO:teuthology.orchestra.run.smithi129.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T07:43:51.141 INFO:teuthology.orchestra.run.smithi129.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T07:43:51.243 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:43:51.252 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:43:51.252 INFO:teuthology.orchestra.run.smithi129.stdout: Package Architecture Version Repository Size 2024-09-21T07:43:51.252 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:43:51.252 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-21T07:43:51.252 INFO:teuthology.orchestra.run.smithi129.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T07:43:51.252 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-09-21T07:43:51.252 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T07:43:51.253 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T07:43:51.253 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T07:43:51.253 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:43:51.253 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-21T07:43:51.253 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:43:51.253 INFO:teuthology.orchestra.run.smithi129.stdout:Install 4 Packages 2024-09-21T07:43:51.253 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:43:51.253 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 79 M 2024-09-21T07:43:51.254 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 126 M 2024-09-21T07:43:51.254 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-21T07:43:51.503 INFO:teuthology.orchestra.run.smithi129.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 351 kB/s | 36 kB 00:00 2024-09-21T07:43:51.768 INFO:teuthology.orchestra.run.smithi107.stdout:(2/4): kernel-modules-core-5.14.0-508.el9.x86_6 14 MB/s | 29 MB 00:01 2024-09-21T07:43:51.778 INFO:teuthology.orchestra.run.smithi129.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-09-21T07:43:52.128 INFO:teuthology.orchestra.run.smithi129.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 47 MB/s | 35 MB 00:00 2024-09-21T07:43:52.445 INFO:teuthology.orchestra.run.smithi129.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 30 MB/s | 29 MB 00:00 2024-09-21T07:43:52.446 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:43:52.446 INFO:teuthology.orchestra.run.smithi129.stdout:Total 66 MB/s | 79 MB 00:01 2024-09-21T07:43:53.110 INFO:teuthology.orchestra.run.smithi107.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 10 MB/s | 35 MB 00:03 2024-09-21T07:43:53.127 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-21T07:43:53.475 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-21T07:43:53.476 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-21T07:43:53.652 INFO:teuthology.orchestra.run.smithi107.stdout:(4/4): kernel-core-5.14.0-508.el9.x86_64.rpm 4.0 MB/s | 16 MB 00:03 2024-09-21T07:43:53.652 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:43:53.652 INFO:teuthology.orchestra.run.smithi107.stdout:Total 19 MB/s | 79 MB 00:04 2024-09-21T07:43:54.333 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-21T07:43:54.447 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-21T07:43:54.448 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-21T07:43:54.681 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-21T07:43:54.681 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-21T07:43:55.655 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-21T07:43:55.656 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-21T07:43:56.887 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-21T07:43:57.564 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T07:43:57.645 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:43:58.078 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-21T07:43:58.715 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T07:43:58.810 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:44:00.403 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:44:00.546 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:44:01.571 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:44:01.703 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:44:05.395 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:44:05.438 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:44:06.545 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:44:06.587 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:44:10.257 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:44:11.437 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:44:48.317 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:44:48.357 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:44:48.648 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:44:48.648 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T07:44:48.648 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:44:48.648 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:44:49.504 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:44:49.504 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:44:49.504 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-21T07:44:49.504 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T07:44:49.504 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T07:44:49.504 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T07:44:49.504 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T07:44:49.504 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:44:49.504 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:44:49.635 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:44:49.676 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:44:49.862 DEBUG:teuthology.orchestra.run.smithi129:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T07:44:49.948 INFO:teuthology.orchestra.run.smithi129.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T07:44:49.948 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T07:44:49.948 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T07:44:49.949 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T07:44:49.949 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T07:44:49.949 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-21T07:44:49.949 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi129.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T07:44:49.949 DEBUG:teuthology.orchestra.run.smithi129:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T07:44:50.007 INFO:teuthology.orchestra.run.smithi129.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T07:44:50.007 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T07:44:50.008 DEBUG:teuthology.orchestra.run.smithi129:> sudo rpm -qi grub2-tools 2024-09-21T07:44:50.008 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:44:50.009 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T07:44:50.009 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:44:50.009 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:44:50.040 INFO:teuthology.orchestra.run.smithi129.stdout:Name : grub2-tools 2024-09-21T07:44:50.040 INFO:teuthology.orchestra.run.smithi129.stdout:Epoch : 1 2024-09-21T07:44:50.040 INFO:teuthology.orchestra.run.smithi129.stdout:Version : 2.06 2024-09-21T07:44:50.040 INFO:teuthology.orchestra.run.smithi129.stdout:Release : 82.el9 2024-09-21T07:44:50.040 INFO:teuthology.orchestra.run.smithi129.stdout:Architecture: x86_64 2024-09-21T07:44:50.040 INFO:teuthology.orchestra.run.smithi129.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T07:44:50.040 INFO:teuthology.orchestra.run.smithi129.stdout:Group : Unspecified 2024-09-21T07:44:50.041 INFO:teuthology.orchestra.run.smithi129.stdout:Size : 8274670 2024-09-21T07:44:50.041 INFO:teuthology.orchestra.run.smithi129.stdout:License : GPLv3+ 2024-09-21T07:44:50.041 INFO:teuthology.orchestra.run.smithi129.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T07:44:50.041 INFO:teuthology.orchestra.run.smithi129.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T07:44:50.041 INFO:teuthology.orchestra.run.smithi129.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T07:44:50.041 INFO:teuthology.orchestra.run.smithi129.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T07:44:50.041 INFO:teuthology.orchestra.run.smithi129.stdout:Packager : builder@centos.org 2024-09-21T07:44:50.041 INFO:teuthology.orchestra.run.smithi129.stdout:Vendor : CentOS 2024-09-21T07:44:50.041 INFO:teuthology.orchestra.run.smithi129.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T07:44:50.041 INFO:teuthology.orchestra.run.smithi129.stdout:Summary : Support tools for GRUB. 2024-09-21T07:44:50.041 INFO:teuthology.orchestra.run.smithi129.stdout:Description : 2024-09-21T07:44:50.041 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:44:50.041 INFO:teuthology.orchestra.run.smithi129.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T07:44:50.041 INFO:teuthology.orchestra.run.smithi129.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T07:44:50.041 INFO:teuthology.orchestra.run.smithi129.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T07:44:50.041 INFO:teuthology.orchestra.run.smithi129.stdout:hardware devices. 2024-09-21T07:44:50.042 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:44:50.042 INFO:teuthology.orchestra.run.smithi129.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T07:44:50.042 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T07:44:50.042 INFO:teuthology.task.kernel:Updating grub on smithi129 to boot 5.14.0-508.el9.x86_64 2024-09-21T07:44:50.043 DEBUG:teuthology.orchestra.run.smithi129:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T07:44:50.666 INFO:teuthology.orchestra.run.smithi129.stderr:Generating grub configuration file ... 2024-09-21T07:44:50.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:44:50.826 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:44:50.826 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-21T07:44:50.826 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T07:44:50.826 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T07:44:50.826 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T07:44:50.826 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T07:44:50.826 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:44:50.826 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:44:51.204 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T07:44:51.295 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T07:44:51.295 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T07:44:51.296 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T07:44:51.296 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T07:44:51.296 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T07:44:51.296 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-21T07:44:51.296 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi107.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T07:44:51.296 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T07:44:51.354 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T07:44:51.354 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T07:44:51.355 DEBUG:teuthology.orchestra.run.smithi107:> sudo rpm -qi grub2-tools 2024-09-21T07:44:51.387 INFO:teuthology.orchestra.run.smithi107.stdout:Name : grub2-tools 2024-09-21T07:44:51.387 INFO:teuthology.orchestra.run.smithi107.stdout:Epoch : 1 2024-09-21T07:44:51.387 INFO:teuthology.orchestra.run.smithi107.stdout:Version : 2.06 2024-09-21T07:44:51.387 INFO:teuthology.orchestra.run.smithi107.stdout:Release : 82.el9 2024-09-21T07:44:51.387 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: x86_64 2024-09-21T07:44:51.387 INFO:teuthology.orchestra.run.smithi107.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T07:44:51.387 INFO:teuthology.orchestra.run.smithi107.stdout:Group : Unspecified 2024-09-21T07:44:51.387 INFO:teuthology.orchestra.run.smithi107.stdout:Size : 8274670 2024-09-21T07:44:51.387 INFO:teuthology.orchestra.run.smithi107.stdout:License : GPLv3+ 2024-09-21T07:44:51.387 INFO:teuthology.orchestra.run.smithi107.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T07:44:51.388 INFO:teuthology.orchestra.run.smithi107.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T07:44:51.388 INFO:teuthology.orchestra.run.smithi107.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T07:44:51.388 INFO:teuthology.orchestra.run.smithi107.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T07:44:51.388 INFO:teuthology.orchestra.run.smithi107.stdout:Packager : builder@centos.org 2024-09-21T07:44:51.388 INFO:teuthology.orchestra.run.smithi107.stdout:Vendor : CentOS 2024-09-21T07:44:51.388 INFO:teuthology.orchestra.run.smithi107.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T07:44:51.388 INFO:teuthology.orchestra.run.smithi107.stdout:Summary : Support tools for GRUB. 2024-09-21T07:44:51.388 INFO:teuthology.orchestra.run.smithi107.stdout:Description : 2024-09-21T07:44:51.388 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:44:51.388 INFO:teuthology.orchestra.run.smithi107.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T07:44:51.388 INFO:teuthology.orchestra.run.smithi107.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T07:44:51.388 INFO:teuthology.orchestra.run.smithi107.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T07:44:51.388 INFO:teuthology.orchestra.run.smithi107.stdout:hardware devices. 2024-09-21T07:44:51.388 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:44:51.388 INFO:teuthology.orchestra.run.smithi107.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T07:44:51.389 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T07:44:51.389 INFO:teuthology.task.kernel:Updating grub on smithi107 to boot 5.14.0-508.el9.x86_64 2024-09-21T07:44:51.389 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T07:44:52.006 INFO:teuthology.orchestra.run.smithi129.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T07:44:52.041 INFO:teuthology.orchestra.run.smithi129.stderr:done 2024-09-21T07:44:52.043 DEBUG:teuthology.orchestra.run.smithi129:> mktemp 2024-09-21T07:44:52.058 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.LXMMldgMPO 2024-09-21T07:44:52.058 DEBUG:teuthology.orchestra.run.smithi129:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.LXMMldgMPO 2024-09-21T07:44:52.063 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2024-09-21T07:44:52.131 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.LXMMldgMPO 2024-09-21T07:44:52.263 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.LXMMldgMPO is 6KB 2024-09-21T07:44:52.283 DEBUG:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.LXMMldgMPO 2024-09-21T07:44:52.298 DEBUG:teuthology.orchestra.run.smithi129:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T07:44:52.365 INFO:teuthology.orchestra.run.smithi129.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T07:44:52.365 INFO:teuthology.orchestra.run.smithi129.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T07:44:52.365 INFO:teuthology.orchestra.run.smithi129.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T07:44:52.365 INFO:teuthology.orchestra.run.smithi129.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T07:44:52.366 DEBUG:teuthology.orchestra.run.smithi129:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T07:44:52.515 DEBUG:teuthology.orchestra.run.smithi129:> sudo shutdown -r now 2024-09-21T07:44:53.405 INFO:teuthology.orchestra.run.smithi107.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T07:44:53.433 INFO:teuthology.orchestra.run.smithi107.stderr:done 2024-09-21T07:44:53.435 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-09-21T07:44:53.450 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.dp9QTueQHZ 2024-09-21T07:44:53.450 DEBUG:teuthology.orchestra.run.smithi107:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dp9QTueQHZ 2024-09-21T07:44:53.518 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.dp9QTueQHZ 2024-09-21T07:44:53.666 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.dp9QTueQHZ is 6KB 2024-09-21T07:44:53.715 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.dp9QTueQHZ 2024-09-21T07:44:53.730 DEBUG:teuthology.orchestra.run.smithi107:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T07:44:53.793 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T07:44:53.793 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T07:44:53.793 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T07:44:53.793 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T07:44:53.794 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T07:44:53.951 DEBUG:teuthology.orchestra.run.smithi107:> sudo shutdown -r now 2024-09-21T07:45:22.527 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-21T07:45:22.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-21T07:45:22.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:45:23.954 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-21T07:45:23.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-21T07:45:23.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:45:56.975 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-09-21T07:45:58.514 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-09-21T07:46:05.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-21T07:46:05.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:46:07.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-21T07:46:07.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:46:24.371 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-09-21T07:46:25.907 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-09-21T07:46:36.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-21T07:46:36.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:46:36.740 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-09-21T07:46:37.109 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-21T07:46:37.109 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-21T07:46:37.110 DEBUG:teuthology.orchestra.run.smithi129:> uname -r 2024-09-21T07:46:37.125 INFO:teuthology.orchestra.run.smithi129.stdout:5.14.0-508.el9.x86_64 2024-09-21T07:46:37.125 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T07:46:37.125 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T07:46:37.125 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T07:46:37.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-21T07:46:37.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:46:38.126 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-21T07:46:38.126 DEBUG:teuthology.orchestra.run.smithi129:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T07:46:38.187 INFO:teuthology.orchestra.run.smithi129.stdout:ttyS1 2024-09-21T07:46:38.227 DEBUG:teuthology.parallel:result is None 2024-09-21T07:46:38.351 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-09-21T07:46:38.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-21T07:46:38.737 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-21T07:46:38.737 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-09-21T07:46:38.753 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-508.el9.x86_64 2024-09-21T07:46:38.753 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T07:46:38.753 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T07:46:38.753 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T07:46:39.754 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-21T07:46:39.754 DEBUG:teuthology.orchestra.run.smithi107:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T07:46:39.831 INFO:teuthology.orchestra.run.smithi107.stdout:ttyS1 2024-09-21T07:46:39.852 DEBUG:teuthology.parallel:result is None 2024-09-21T07:46:39.852 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T07:46:39.868 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T07:46:39.868 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T07:46:39.870 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T07:46:39.886 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T07:46:39.904 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T07:46:39.917 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T07:46:39.917 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T07:46:39.923 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T07:46:39.949 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T07:46:39.957 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T07:46:39.957 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T07:46:39.976 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T07:46:40.004 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:46:40.012 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:46:40.014 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:46:40.022 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:46:40.024 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T07:46:40.030 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T07:46:40.031 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T07:46:40.055 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T07:46:40.088 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T07:46:40.097 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T07:46:40.097 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T07:46:40.117 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T07:46:40.144 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:46:40.209 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:46:40.252 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:46:40.330 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:46:40.368 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-21T07:46:40.368 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T07:46:40.430 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:46:40.473 DEBUG:teuthology.orchestra.run.smithi129:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:46:40.521 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:46:40.599 DEBUG:teuthology.orchestra.run.smithi129:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:46:40.643 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T07:46:40.643 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T07:46:40.707 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-09-21T07:46:40.710 DEBUG:teuthology.orchestra.run.smithi129:> sudo service rsyslog restart 2024-09-21T07:46:40.770 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:46:40.814 INFO:teuthology.orchestra.run.smithi129.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:46:41.326 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T07:46:41.334 INFO:teuthology.task.internal:Starting timer... 2024-09-21T07:46:41.334 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T07:46:41.379 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T07:46:41.390 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-21T07:46:41.390 DEBUG:teuthology.orchestra.run.smithi107:> sudo service auditd rotate 2024-09-21T07:46:41.476 INFO:teuthology.orchestra.run.smithi107.stdout:Rotating logs: 2024-09-21T07:46:41.478 DEBUG:teuthology.orchestra.run.smithi129:> sudo service auditd rotate 2024-09-21T07:46:41.586 INFO:teuthology.orchestra.run.smithi129.stdout:Rotating logs: 2024-09-21T07:46:41.590 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T07:46:41.590 DEBUG:teuthology.orchestra.run.smithi107:> /usr/sbin/getenforce 2024-09-21T07:46:41.610 INFO:teuthology.orchestra.run.smithi107.stdout:Permissive 2024-09-21T07:46:41.610 DEBUG:teuthology.orchestra.run.smithi129:> /usr/sbin/getenforce 2024-09-21T07:46:41.665 INFO:teuthology.orchestra.run.smithi129.stdout:Permissive 2024-09-21T07:46:41.666 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi107.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi129.front.sepia.ceph.com': 'permissive'} 2024-09-21T07:46:41.666 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T07:46:41.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:46:41.691 DEBUG:teuthology.orchestra.run.smithi129:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T07:46:41.776 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:46:41.777 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T07:46:41.777 DEBUG:teuthology.orchestra.run.smithi107:> sudo /usr/sbin/setenforce permissive 2024-09-21T07:46:41.805 DEBUG:teuthology.orchestra.run.smithi129:> sudo /usr/sbin/setenforce permissive 2024-09-21T07:46:41.886 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T07:46:41.896 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T07:46:41.899 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T07:46:42.040 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T07:46:42.050 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T07:46:42.050 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi107.front.sepia.ceph.com,smithi129.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T07:50:29.257 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi107.front.sepia.ceph.com'), Remote(name='ubuntu@smithi129.front.sepia.ceph.com')] 2024-09-21T07:50:29.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-21T07:50:29.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:50:29.333 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-09-21T07:50:29.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-21T07:50:29.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-21T07:50:29.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:50:29.477 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-09-21T07:50:29.557 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-21T07:50:29.557 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T07:50:29.574 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T07:50:29.574 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T07:50:29.574 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:50:29.576 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T07:50:29.576 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:50:29.604 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T07:50:29.618 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T07:50:29.625 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T07:50:29.639 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T07:50:29.643 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: ntpd: command not found 2024-09-21T07:50:29.653 INFO:teuthology.orchestra.run.smithi107.stdout:506 Cannot talk to daemon 2024-09-21T07:50:29.663 INFO:teuthology.orchestra.run.smithi129.stderr:sudo: ntpd: command not found 2024-09-21T07:50:29.668 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T07:50:29.674 INFO:teuthology.orchestra.run.smithi129.stdout:506 Cannot talk to daemon 2024-09-21T07:50:29.682 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T07:50:29.688 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T07:50:29.702 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T07:50:29.735 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:50:29.739 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:50:29.739 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-09-21T07:50:29.739 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:50:29.739 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:50:29.739 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:50:29.739 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:50:29.757 INFO:teuthology.orchestra.run.smithi129.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:50:29.761 INFO:teuthology.orchestra.run.smithi129.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:50:29.761 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================== 2024-09-21T07:50:29.761 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:50:29.761 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:50:29.761 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:50:29.761 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:50:29.762 INFO:teuthology.run_tasks:Running task install... 2024-09-21T07:50:29.769 DEBUG:teuthology.task.install:project ceph 2024-09-21T07:50:29.769 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}} 2024-09-21T07:50:29.769 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'} 2024-09-21T07:50:29.770 INFO:teuthology.task.install:Using flavor: default 2024-09-21T07:50:30.527 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T07:50:30.527 INFO:teuthology.task.install:extra packages: [] 2024-09-21T07:50:30.528 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736', 'tag': None, 'wait_for_package': False} 2024-09-21T07:50:30.528 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T07:50:30.528 INFO:teuthology.packaging:ref: None 2024-09-21T07:50:30.528 INFO:teuthology.packaging:tag: None 2024-09-21T07:50:30.528 INFO:teuthology.packaging:branch: quincy 2024-09-21T07:50:30.528 INFO:teuthology.packaging:sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T07:50:30.528 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-21T07:50:30.530 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736', 'tag': None, 'wait_for_package': False} 2024-09-21T07:50:30.530 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T07:50:30.530 INFO:teuthology.packaging:ref: None 2024-09-21T07:50:30.530 INFO:teuthology.packaging:tag: None 2024-09-21T07:50:30.530 INFO:teuthology.packaging:branch: quincy 2024-09-21T07:50:30.530 INFO:teuthology.packaging:sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T07:50:30.530 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-21T07:50:30.736 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/fbd1a6ab0448f011c60f6376195d5c078b0cf20b/centos/9/flavors/default/ 2024-09-21T07:50:30.736 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1649.gfbd1a6ab 2024-09-21T07:50:30.755 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/fbd1a6ab0448f011c60f6376195d5c078b0cf20b/centos/9/flavors/default/ 2024-09-21T07:50:30.755 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1649.gfbd1a6ab 2024-09-21T07:50:30.844 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/fbd1a6ab0448f011c60f6376195d5c078b0cf20b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/fbd1a6ab0448f011c60f6376195d5c078b0cf20b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/fbd1a6ab0448f011c60f6376195d5c078b0cf20b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T07:50:30.844 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T07:50:30.844 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T07:50:30.859 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/fbd1a6ab0448f011c60f6376195d5c078b0cf20b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/fbd1a6ab0448f011c60f6376195d5c078b0cf20b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/fbd1a6ab0448f011c60f6376195d5c078b0cf20b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T07:50:30.859 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-21T07:50:30.860 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T07:50:30.874 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T07:50:30.874 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T07:50:30.874 INFO:teuthology.packaging:ref: None 2024-09-21T07:50:30.874 INFO:teuthology.packaging:tag: None 2024-09-21T07:50:30.875 INFO:teuthology.packaging:branch: quincy 2024-09-21T07:50:30.875 INFO:teuthology.packaging:sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T07:50:30.875 DEBUG:teuthology.orchestra.run.smithi129:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T07:50:30.890 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T07:50:30.890 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T07:50:30.890 INFO:teuthology.packaging:ref: None 2024-09-21T07:50:30.890 INFO:teuthology.packaging:tag: None 2024-09-21T07:50:30.891 INFO:teuthology.packaging:branch: quincy 2024-09-21T07:50:30.891 INFO:teuthology.packaging:sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T07:50:30.891 DEBUG:teuthology.orchestra.run.smithi107:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T07:50:30.944 DEBUG:teuthology.orchestra.run.smithi129:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T07:50:30.959 DEBUG:teuthology.orchestra.run.smithi107:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T07:50:31.023 DEBUG:teuthology.orchestra.run.smithi129:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T07:50:31.037 DEBUG:teuthology.orchestra.run.smithi107:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T07:50:31.089 INFO:teuthology.orchestra.run.smithi129.stdout:check_obsoletes = 1 2024-09-21T07:50:31.091 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum clean all 2024-09-21T07:50:31.103 INFO:teuthology.orchestra.run.smithi107.stdout:check_obsoletes = 1 2024-09-21T07:50:31.105 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum clean all 2024-09-21T07:50:31.322 INFO:teuthology.orchestra.run.smithi129.stdout:45 files removed 2024-09-21T07:50:31.343 INFO:teuthology.orchestra.run.smithi107.stdout:45 files removed 2024-09-21T07:50:31.348 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-radosgw 2024-09-21T07:50:31.369 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-radosgw 2024-09-21T07:50:31.912 INFO:teuthology.orchestra.run.smithi129.stdout:ceph packages for x86_64 278 kB/s | 77 kB 00:00 2024-09-21T07:50:31.928 INFO:teuthology.orchestra.run.smithi107.stdout:ceph packages for x86_64 279 kB/s | 77 kB 00:00 2024-09-21T07:50:32.187 INFO:teuthology.orchestra.run.smithi129.stdout:ceph noarch packages 46 kB/s | 11 kB 00:00 2024-09-21T07:50:32.211 INFO:teuthology.orchestra.run.smithi107.stdout:ceph noarch packages 45 kB/s | 11 kB 00:00 2024-09-21T07:50:32.455 INFO:teuthology.orchestra.run.smithi129.stdout:ceph source packages 7.7 kB/s | 1.8 kB 00:00 2024-09-21T07:50:32.487 INFO:teuthology.orchestra.run.smithi107.stdout:ceph source packages 7.4 kB/s | 1.8 kB 00:00 2024-09-21T07:50:33.028 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-21T07:50:35.188 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.3 MB 00:02 2024-09-21T07:50:35.579 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 14 MB/s | 20 MB 00:01 2024-09-21T07:50:38.881 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - AppStream 7.7 MB/s | 20 MB 00:02 2024-09-21T07:50:40.055 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.5 MB 00:00 2024-09-21T07:50:41.514 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 88 kB/s | 19 kB 00:00 2024-09-21T07:50:42.309 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-21T07:50:43.165 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-21T07:50:44.666 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 19 kB 00:00 2024-09-21T07:50:45.536 INFO:teuthology.orchestra.run.smithi129.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-21T07:50:47.749 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2024-09-21T07:50:50.081 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:50:50.089 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:50:50.089 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-21T07:50:50.089 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:50:50.089 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-21T07:50:50.089 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 14 M 2024-09-21T07:50:50.089 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2024-09-21T07:50:50.090 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 3.1 M 2024-09-21T07:50:50.090 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1 x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 2.9 M 2024-09-21T07:50:50.090 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-21T07:50:50.090 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 5.0 M 2024-09-21T07:50:50.090 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 22 M 2024-09-21T07:50:50.090 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 25 k 2024-09-21T07:50:50.090 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T07:50:50.090 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2 x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 636 k 2024-09-21T07:50:50.090 INFO:teuthology.orchestra.run.smithi107.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T07:50:50.090 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T07:50:50.090 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T07:50:50.090 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 457 k 2024-09-21T07:50:50.090 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T07:50:50.091 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2 x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 4.9 M 2024-09-21T07:50:50.091 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T07:50:50.091 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T07:50:50.091 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 45 k 2024-09-21T07:50:50.091 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 120 k 2024-09-21T07:50:50.091 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 156 k 2024-09-21T07:50:50.091 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T07:50:50.091 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 320 k 2024-09-21T07:50:50.091 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 295 k 2024-09-21T07:50:50.091 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 99 k 2024-09-21T07:50:50.091 INFO:teuthology.orchestra.run.smithi107.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T07:50:50.091 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:50:50.091 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-21T07:50:50.091 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:50:50.091 INFO:teuthology.orchestra.run.smithi107.stdout:Install 22 Packages 2024-09-21T07:50:50.091 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 2 Packages 2024-09-21T07:50:50.092 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:50:50.092 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 58 M 2024-09-21T07:50:50.092 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-21T07:50:50.591 INFO:teuthology.orchestra.run.smithi107.stdout:(1/24): ceph-base-17.2.7-1649.gfbd1a6ab.el9.x86 12 MB/s | 5.0 MB 00:00 2024-09-21T07:50:50.649 INFO:teuthology.orchestra.run.smithi107.stdout:(2/24): ceph-selinux-17.2.7-1649.gfbd1a6ab.el9. 433 kB/s | 25 kB 00:00 2024-09-21T07:50:50.741 INFO:teuthology.orchestra.run.smithi107.stdout:(3/24): libcephfs2-17.2.7-1649.gfbd1a6ab.el9.x8 6.8 MB/s | 636 kB 00:00 2024-09-21T07:50:50.825 INFO:teuthology.orchestra.run.smithi107.stdout:(4/24): libradosstriper1-17.2.7-1649.gfbd1a6ab. 5.4 MB/s | 457 kB 00:00 2024-09-21T07:50:51.158 INFO:teuthology.orchestra.run.smithi107.stdout:(5/24): librgw2-17.2.7-1649.gfbd1a6ab.el9.x86_6 15 MB/s | 4.9 MB 00:00 2024-09-21T07:50:51.384 INFO:teuthology.orchestra.run.smithi107.stdout:(6/24): ceph-common-17.2.7-1649.gfbd1a6ab.el9.x 19 MB/s | 22 MB 00:01 2024-09-21T07:50:51.400 INFO:teuthology.orchestra.run.smithi107.stdout:(7/24): python3-ceph-argparse-17.2.7-1649.gfbd1 186 kB/s | 45 kB 00:00 2024-09-21T07:50:51.426 INFO:teuthology.orchestra.run.smithi107.stdout:(8/24): python3-ceph-common-17.2.7-1649.gfbd1a6 2.8 MB/s | 120 kB 00:00 2024-09-21T07:50:51.451 INFO:teuthology.orchestra.run.smithi107.stdout:(9/24): python3-cephfs-17.2.7-1649.gfbd1a6ab.el 3.0 MB/s | 156 kB 00:00 2024-09-21T07:50:51.467 INFO:teuthology.orchestra.run.smithi129.stdout:lab-extras 3.1 kB/s | 1.7 kB 00:00 2024-09-21T07:50:51.476 INFO:teuthology.orchestra.run.smithi107.stdout:(10/24): python3-rados-17.2.7-1649.gfbd1a6ab.el 6.3 MB/s | 320 kB 00:00 2024-09-21T07:50:51.502 INFO:teuthology.orchestra.run.smithi107.stdout:(11/24): python3-rbd-17.2.7-1649.gfbd1a6ab.el9. 5.7 MB/s | 295 kB 00:00 2024-09-21T07:50:51.527 INFO:teuthology.orchestra.run.smithi107.stdout:(12/24): python3-rgw-17.2.7-1649.gfbd1a6ab.el9. 1.9 MB/s | 99 kB 00:00 2024-09-21T07:50:51.669 INFO:teuthology.orchestra.run.smithi107.stdout:(13/24): ceph-radosgw-17.2.7-1649.gfbd1a6ab.el9 9.6 MB/s | 14 MB 00:01 2024-09-21T07:50:51.744 INFO:teuthology.orchestra.run.smithi107.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 209 kB/s | 45 kB 00:00 2024-09-21T07:50:51.778 INFO:teuthology.orchestra.run.smithi107.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 581 kB/s | 160 kB 00:00 2024-09-21T07:50:51.820 INFO:teuthology.orchestra.run.smithi107.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-21T07:50:51.845 INFO:teuthology.orchestra.run.smithi107.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-21T07:50:51.887 INFO:teuthology.orchestra.run.smithi107.stdout:(18/24): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-09-21T07:50:51.929 INFO:teuthology.orchestra.run.smithi107.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 580 kB/s | 49 kB 00:00 2024-09-21T07:50:51.954 INFO:teuthology.orchestra.run.smithi107.stdout:(20/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.2 MB/s | 308 kB 00:00 2024-09-21T07:50:51.980 INFO:teuthology.orchestra.run.smithi107.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 744 kB/s | 67 kB 00:00 2024-09-21T07:50:52.030 INFO:teuthology.orchestra.run.smithi107.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T07:50:52.155 INFO:teuthology.orchestra.run.smithi107.stdout:(23/24): librados2-17.2.7-1649.gfbd1a6ab.el9.x8 15 MB/s | 3.1 MB 00:00 2024-09-21T07:50:52.221 INFO:teuthology.orchestra.run.smithi107.stdout:(24/24): librbd1-17.2.7-1649.gfbd1a6ab.el9.x86_ 12 MB/s | 2.9 MB 00:00 2024-09-21T07:50:52.227 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:50:52.227 INFO:teuthology.orchestra.run.smithi107.stdout:Total 27 MB/s | 58 MB 00:02 2024-09-21T07:50:52.288 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-21T07:50:52.320 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-21T07:50:52.320 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-21T07:50:52.952 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-21T07:50:52.952 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-21T07:50:53.668 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:50:53.678 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:50:53.678 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-09-21T07:50:53.678 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:50:53.678 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-21T07:50:53.678 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-radosgw x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 14 M 2024-09-21T07:50:53.678 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrading: 2024-09-21T07:50:53.679 INFO:teuthology.orchestra.run.smithi129.stdout: librados2 x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 3.1 M 2024-09-21T07:50:53.679 INFO:teuthology.orchestra.run.smithi129.stdout: librbd1 x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 2.9 M 2024-09-21T07:50:53.679 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-09-21T07:50:53.679 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 5.0 M 2024-09-21T07:50:53.679 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-common x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 22 M 2024-09-21T07:50:53.679 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-selinux x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 25 k 2024-09-21T07:50:53.679 INFO:teuthology.orchestra.run.smithi129.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T07:50:53.679 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs2 x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 636 k 2024-09-21T07:50:53.679 INFO:teuthology.orchestra.run.smithi129.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T07:50:53.679 INFO:teuthology.orchestra.run.smithi129.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T07:50:53.679 INFO:teuthology.orchestra.run.smithi129.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T07:50:53.679 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1 x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 457 k 2024-09-21T07:50:53.679 INFO:teuthology.orchestra.run.smithi129.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T07:50:53.680 INFO:teuthology.orchestra.run.smithi129.stdout: librgw2 x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 4.9 M 2024-09-21T07:50:53.680 INFO:teuthology.orchestra.run.smithi129.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T07:50:53.680 INFO:teuthology.orchestra.run.smithi129.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T07:50:53.680 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 45 k 2024-09-21T07:50:53.680 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 120 k 2024-09-21T07:50:53.680 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cephfs x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 156 k 2024-09-21T07:50:53.680 INFO:teuthology.orchestra.run.smithi129.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T07:50:53.680 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rados x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 320 k 2024-09-21T07:50:53.680 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rbd x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 295 k 2024-09-21T07:50:53.680 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rgw x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 99 k 2024-09-21T07:50:53.680 INFO:teuthology.orchestra.run.smithi129.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T07:50:53.680 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:50:53.680 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-21T07:50:53.681 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:50:53.681 INFO:teuthology.orchestra.run.smithi129.stdout:Install 22 Packages 2024-09-21T07:50:53.681 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrade 2 Packages 2024-09-21T07:50:53.681 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:50:53.681 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 58 M 2024-09-21T07:50:53.681 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-21T07:50:54.192 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-21T07:50:54.452 INFO:teuthology.orchestra.run.smithi129.stdout:(1/24): ceph-base-17.2.7-1649.gfbd1a6ab.el9.x86 10 MB/s | 5.0 MB 00:00 2024-09-21T07:50:54.502 INFO:teuthology.orchestra.run.smithi129.stdout:(2/24): ceph-selinux-17.2.7-1649.gfbd1a6ab.el9. 504 kB/s | 25 kB 00:00 2024-09-21T07:50:54.563 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-21T07:50:54.594 INFO:teuthology.orchestra.run.smithi129.stdout:(3/24): libcephfs2-17.2.7-1649.gfbd1a6ab.el9.x8 6.8 MB/s | 636 kB 00:00 2024-09-21T07:50:54.632 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librados2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2/26 2024-09-21T07:50:54.696 INFO:teuthology.orchestra.run.smithi129.stdout:(4/24): libradosstriper1-17.2.7-1649.gfbd1a6ab. 4.4 MB/s | 457 kB 00:00 2024-09-21T07:50:54.724 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2/26 2024-09-21T07:50:54.810 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 3/26 2024-09-21T07:50:54.842 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 4/26 2024-09-21T07:50:54.929 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 4/26 2024-09-21T07:50:54.984 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-21T07:50:54.997 INFO:teuthology.orchestra.run.smithi129.stdout:(5/24): librgw2-17.2.7-1649.gfbd1a6ab.el9.x86_6 16 MB/s | 4.9 MB 00:00 2024-09-21T07:50:55.021 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-21T07:50:55.147 INFO:teuthology.orchestra.run.smithi129.stdout:(6/24): ceph-radosgw-17.2.7-1649.gfbd1a6ab.el9. 12 MB/s | 14 MB 00:01 2024-09-21T07:50:55.172 INFO:teuthology.orchestra.run.smithi129.stdout:(7/24): python3-ceph-argparse-17.2.7-1649.gfbd1 257 kB/s | 45 kB 00:00 2024-09-21T07:50:55.197 INFO:teuthology.orchestra.run.smithi129.stdout:(8/24): python3-ceph-common-17.2.7-1649.gfbd1a6 2.3 MB/s | 120 kB 00:00 2024-09-21T07:50:55.223 INFO:teuthology.orchestra.run.smithi129.stdout:(9/24): python3-cephfs-17.2.7-1649.gfbd1a6ab.el 3.0 MB/s | 156 kB 00:00 2024-09-21T07:50:55.248 INFO:teuthology.orchestra.run.smithi129.stdout:(10/24): python3-rados-17.2.7-1649.gfbd1a6ab.el 6.2 MB/s | 320 kB 00:00 2024-09-21T07:50:55.273 INFO:teuthology.orchestra.run.smithi129.stdout:(11/24): python3-rbd-17.2.7-1649.gfbd1a6ab.el9. 5.7 MB/s | 295 kB 00:00 2024-09-21T07:50:55.299 INFO:teuthology.orchestra.run.smithi129.stdout:(12/24): python3-rgw-17.2.7-1649.gfbd1a6ab.el9. 1.9 MB/s | 99 kB 00:00 2024-09-21T07:50:55.456 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-21T07:50:55.486 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librgw2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 8/26 2024-09-21T07:50:55.532 INFO:teuthology.orchestra.run.smithi129.stdout:(13/24): ceph-common-17.2.7-1649.gfbd1a6ab.el9. 14 MB/s | 22 MB 00:01 2024-09-21T07:50:55.557 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librgw2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 8/26 2024-09-21T07:50:55.583 INFO:teuthology.orchestra.run.smithi129.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 518 kB/s | 160 kB 00:00 2024-09-21T07:50:55.594 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-21T07:50:55.608 INFO:teuthology.orchestra.run.smithi129.stdout:(15/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 146 kB/s | 45 kB 00:00 2024-09-21T07:50:55.637 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-argparse-2:17.2.7-1649.gfbd1a6ab.el9. 10/26 2024-09-21T07:50:55.674 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 11/26 2024-09-21T07:50:55.675 INFO:teuthology.orchestra.run.smithi129.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 635 kB/s | 42 kB 00:00 2024-09-21T07:50:55.702 INFO:teuthology.orchestra.run.smithi129.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-21T07:50:55.734 INFO:teuthology.orchestra.run.smithi129.stdout:(18/24): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-09-21T07:50:55.735 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 12/26 2024-09-21T07:50:55.764 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libradosstriper1-2:17.2.7-1649.gfbd1a6ab.el9.x86_6 13/26 2024-09-21T07:50:55.776 INFO:teuthology.orchestra.run.smithi129.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 715 kB/s | 49 kB 00:00 2024-09-21T07:50:55.801 INFO:teuthology.orchestra.run.smithi129.stdout:(20/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.4 MB/s | 308 kB 00:00 2024-09-21T07:50:55.827 INFO:teuthology.orchestra.run.smithi129.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 810 kB/s | 67 kB 00:00 2024-09-21T07:50:55.829 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1649.gfbd1a6ab.el9.x86_6 13/26 2024-09-21T07:50:55.869 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-21T07:50:55.877 INFO:teuthology.orchestra.run.smithi129.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T07:50:55.906 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-21T07:50:55.956 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-21T07:50:56.065 INFO:teuthology.orchestra.run.smithi129.stdout:(23/24): librbd1-17.2.7-1649.gfbd1a6ab.el9.x86_ 12 MB/s | 2.9 MB 00:00 2024-09-21T07:50:56.111 INFO:teuthology.orchestra.run.smithi129.stdout:(24/24): librados2-17.2.7-1649.gfbd1a6ab.el9.x8 10 MB/s | 3.1 MB 00:00 2024-09-21T07:50:56.116 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:50:56.116 INFO:teuthology.orchestra.run.smithi129.stdout:Total 24 MB/s | 58 MB 00:02 2024-09-21T07:50:56.179 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-21T07:50:56.213 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-21T07:50:56.213 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-21T07:50:56.248 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-21T07:50:56.284 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librbd1-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 18/26 2024-09-21T07:50:56.374 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 18/26 2024-09-21T07:50:56.447 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 19/26 2024-09-21T07:50:56.478 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-common-2:17.2.7-1649.gfbd1a6ab.el9.x8 20/26 2024-09-21T07:50:56.849 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-21T07:50:56.850 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-21T07:50:58.084 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-21T07:50:58.491 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-21T07:50:58.555 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : librados2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2/26 2024-09-21T07:50:58.647 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2/26 2024-09-21T07:50:58.727 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rados-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 3/26 2024-09-21T07:50:58.748 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephfs2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 4/26 2024-09-21T07:50:58.835 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephfs2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 4/26 2024-09-21T07:50:58.859 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 21/26 2024-09-21T07:50:58.882 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-21T07:50:58.891 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 21/26 2024-09-21T07:50:58.911 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-21T07:50:59.359 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-21T07:50:59.384 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librgw2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 8/26 2024-09-21T07:50:59.432 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 21/26 2024-09-21T07:50:59.448 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librgw2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 8/26 2024-09-21T07:50:59.477 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 22/26 2024-09-21T07:50:59.484 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-21T07:50:59.528 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ceph-argparse-2:17.2.7-1649.gfbd1a6ab.el9. 10/26 2024-09-21T07:50:59.564 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cephfs-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 11/26 2024-09-21T07:50:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-base-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 22/26 2024-09-21T07:50:59.571 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T07:50:59.571 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T07:50:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:50:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-selinux-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 23/26 2024-09-21T07:50:59.627 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rgw-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 12/26 2024-09-21T07:50:59.654 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libradosstriper1-2:17.2.7-1649.gfbd1a6ab.el9.x86_6 13/26 2024-09-21T07:50:59.728 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1649.gfbd1a6ab.el9.x86_6 13/26 2024-09-21T07:50:59.785 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-21T07:50:59.821 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-21T07:50:59.854 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-21T07:51:00.180 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-21T07:51:00.225 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : librbd1-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 18/26 2024-09-21T07:51:00.315 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librbd1-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 18/26 2024-09-21T07:51:00.389 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rbd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 19/26 2024-09-21T07:51:00.419 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ceph-common-2:17.2.7-1649.gfbd1a6ab.el9.x8 20/26 2024-09-21T07:51:02.922 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-common-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 21/26 2024-09-21T07:51:02.966 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-common-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 21/26 2024-09-21T07:51:03.524 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-common-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 21/26 2024-09-21T07:51:03.561 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-base-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 22/26 2024-09-21T07:51:03.668 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-base-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 22/26 2024-09-21T07:51:03.704 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T07:51:03.704 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T07:51:03.704 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:03.705 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-selinux-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 23/26 2024-09-21T07:51:09.603 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 23/26 2024-09-21T07:51:09.603 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /sys 2024-09-21T07:51:09.603 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /proc 2024-09-21T07:51:09.603 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /mnt 2024-09-21T07:51:09.603 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /var/tmp 2024-09-21T07:51:09.604 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /home 2024-09-21T07:51:09.604 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /root 2024-09-21T07:51:09.604 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /tmp 2024-09-21T07:51:09.604 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:10.920 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 24/26 2024-09-21T07:51:11.006 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 24/26 2024-09-21T07:51:11.006 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:51:11.006 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T07:51:11.006 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:51:11.006 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:51:11.006 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:11.008 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-21T07:51:11.106 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-21T07:51:11.106 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-21T07:51:12.301 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-21T07:51:12.301 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/26 2024-09-21T07:51:12.301 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2/26 2024-09-21T07:51:12.301 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 3/26 2024-09-21T07:51:12.301 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-selinux-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 4/26 2024-09-21T07:51:12.301 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 5/26 2024-09-21T07:51:12.301 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libradosstriper1-2:17.2.7-1649.gfbd1a6ab.el9.x86_6 6/26 2024-09-21T07:51:12.301 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librgw2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 7/26 2024-09-21T07:51:12.301 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1649.gfbd1a6ab.el9. 8/26 2024-09-21T07:51:12.301 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-common-2:17.2.7-1649.gfbd1a6ab.el9.x8 9/26 2024-09-21T07:51:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 10/26 2024-09-21T07:51:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 11/26 2024-09-21T07:51:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 12/26 2024-09-21T07:51:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 13/26 2024-09-21T07:51:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-21T07:51:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-21T07:51:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-21T07:51:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-21T07:51:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-21T07:51:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-21T07:51:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-21T07:51:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-21T07:51:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-21T07:51:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 23/26 2024-09-21T07:51:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-21T07:51:12.303 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 25/26 2024-09-21T07:51:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-21T07:51:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:13.184 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2024-09-21T07:51:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:13.184 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-21T07:51:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T07:51:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T07:51:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T07:51:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T07:51:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T07:51:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T07:51:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T07:51:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T07:51:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T07:51:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:13.186 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:51:13.576 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 23/26 2024-09-21T07:51:13.576 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /sys 2024-09-21T07:51:13.576 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /proc 2024-09-21T07:51:13.576 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /mnt 2024-09-21T07:51:13.576 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /var/tmp 2024-09-21T07:51:13.576 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /home 2024-09-21T07:51:13.576 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /root 2024-09-21T07:51:13.576 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /tmp 2024-09-21T07:51:13.576 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:13.595 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-test 2024-09-21T07:51:14.179 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:27 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:51:14.314 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:51:14.315 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:51:14.315 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-21T07:51:14.315 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:51:14.315 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-21T07:51:14.315 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 48 M 2024-09-21T07:51:14.315 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-21T07:51:14.315 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 163 k 2024-09-21T07:51:14.315 INFO:teuthology.orchestra.run.smithi107.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T07:51:14.315 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T07:51:14.315 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:14.315 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-21T07:51:14.316 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:51:14.316 INFO:teuthology.orchestra.run.smithi107.stdout:Install 4 Packages 2024-09-21T07:51:14.316 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:14.316 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 48 M 2024-09-21T07:51:14.316 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 193 M 2024-09-21T07:51:14.316 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-21T07:51:14.545 INFO:teuthology.orchestra.run.smithi107.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-21T07:51:14.570 INFO:teuthology.orchestra.run.smithi107.stdout:(2/4): libcephsqlite-17.2.7-1649.gfbd1a6ab.el9. 703 kB/s | 163 kB 00:00 2024-09-21T07:51:14.595 INFO:teuthology.orchestra.run.smithi107.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T07:51:14.954 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-radosgw-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 24/26 2024-09-21T07:51:15.032 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 24/26 2024-09-21T07:51:15.032 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:51:15.032 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T07:51:15.032 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:51:15.032 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:51:15.033 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:15.034 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-21T07:51:15.124 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-21T07:51:15.124 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-21T07:51:15.879 INFO:teuthology.orchestra.run.smithi107.stdout:(4/4): ceph-test-17.2.7-1649.gfbd1a6ab.el9.x86_ 31 MB/s | 48 MB 00:01 2024-09-21T07:51:15.882 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:51:15.882 INFO:teuthology.orchestra.run.smithi107.stdout:Total 31 MB/s | 48 MB 00:01 2024-09-21T07:51:15.910 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-21T07:51:15.929 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-21T07:51:15.929 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-21T07:51:16.293 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-21T07:51:16.293 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-21T07:51:16.411 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-21T07:51:16.412 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-base-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/26 2024-09-21T07:51:16.412 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-common-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2/26 2024-09-21T07:51:16.412 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-radosgw-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 3/26 2024-09-21T07:51:16.412 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-selinux-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 4/26 2024-09-21T07:51:16.412 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephfs2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 5/26 2024-09-21T07:51:16.412 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libradosstriper1-2:17.2.7-1649.gfbd1a6ab.el9.x86_6 6/26 2024-09-21T07:51:16.412 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librgw2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 7/26 2024-09-21T07:51:16.412 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1649.gfbd1a6ab.el9. 8/26 2024-09-21T07:51:16.412 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ceph-common-2:17.2.7-1649.gfbd1a6ab.el9.x8 9/26 2024-09-21T07:51:16.412 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cephfs-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 10/26 2024-09-21T07:51:16.412 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rados-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 11/26 2024-09-21T07:51:16.412 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rbd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 12/26 2024-09-21T07:51:16.412 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rgw-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 13/26 2024-09-21T07:51:16.413 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-21T07:51:16.413 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-21T07:51:16.413 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-21T07:51:16.413 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-21T07:51:16.413 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-21T07:51:16.413 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-21T07:51:16.413 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-21T07:51:16.413 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-21T07:51:16.413 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-21T07:51:16.413 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 23/26 2024-09-21T07:51:16.413 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-21T07:51:16.413 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librbd1-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 25/26 2024-09-21T07:51:16.811 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-21T07:51:16.889 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T07:51:16.937 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T07:51:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephsqlite-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 3/4 2024-09-21T07:51:17.330 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-21T07:51:17.330 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:17.330 INFO:teuthology.orchestra.run.smithi129.stdout:Upgraded: 2024-09-21T07:51:17.330 INFO:teuthology.orchestra.run.smithi129.stdout: librados2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:17.330 INFO:teuthology.orchestra.run.smithi129.stdout: librbd1-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:17.330 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-21T07:51:17.330 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:17.330 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-common-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:17.331 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-radosgw-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:17.331 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-selinux-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:17.331 INFO:teuthology.orchestra.run.smithi129.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T07:51:17.331 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:17.331 INFO:teuthology.orchestra.run.smithi129.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T07:51:17.331 INFO:teuthology.orchestra.run.smithi129.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T07:51:17.331 INFO:teuthology.orchestra.run.smithi129.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T07:51:17.331 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:17.331 INFO:teuthology.orchestra.run.smithi129.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T07:51:17.331 INFO:teuthology.orchestra.run.smithi129.stdout: librgw2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:17.331 INFO:teuthology.orchestra.run.smithi129.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T07:51:17.331 INFO:teuthology.orchestra.run.smithi129.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T07:51:17.331 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:17.331 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:17.332 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cephfs-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:17.332 INFO:teuthology.orchestra.run.smithi129.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T07:51:17.332 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rados-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:17.332 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rbd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:17.332 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rgw-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:17.332 INFO:teuthology.orchestra.run.smithi129.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T07:51:17.332 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:17.332 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:51:17.714 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-test 2024-09-21T07:51:18.294 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:27 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:51:18.432 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:51:18.433 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:51:18.433 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-09-21T07:51:18.433 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:51:18.433 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-21T07:51:18.433 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-test x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 48 M 2024-09-21T07:51:18.433 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-09-21T07:51:18.433 INFO:teuthology.orchestra.run.smithi129.stdout: libcephsqlite x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 163 k 2024-09-21T07:51:18.433 INFO:teuthology.orchestra.run.smithi129.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T07:51:18.433 INFO:teuthology.orchestra.run.smithi129.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T07:51:18.433 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:18.433 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-21T07:51:18.434 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:51:18.434 INFO:teuthology.orchestra.run.smithi129.stdout:Install 4 Packages 2024-09-21T07:51:18.434 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:18.434 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 48 M 2024-09-21T07:51:18.434 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 193 M 2024-09-21T07:51:18.434 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-21T07:51:18.680 INFO:teuthology.orchestra.run.smithi129.stdout:(1/4): libcephsqlite-17.2.7-1649.gfbd1a6ab.el9. 734 kB/s | 163 kB 00:00 2024-09-21T07:51:19.055 INFO:teuthology.orchestra.run.smithi129.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 170 kB/s | 64 kB 00:00 2024-09-21T07:51:19.122 INFO:teuthology.orchestra.run.smithi129.stdout:(3/4): socat-1.7.4.1-6.el9.x86_64.rpm 458 kB/s | 304 kB 00:00 2024-09-21T07:51:19.972 INFO:teuthology.orchestra.run.smithi129.stdout:(4/4): ceph-test-17.2.7-1649.gfbd1a6ab.el9.x86_ 32 MB/s | 48 MB 00:01 2024-09-21T07:51:19.974 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:51:19.975 INFO:teuthology.orchestra.run.smithi129.stdout:Total 31 MB/s | 48 MB 00:01 2024-09-21T07:51:20.001 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-21T07:51:20.019 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-21T07:51:20.020 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-21T07:51:20.383 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-21T07:51:20.383 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-21T07:51:20.902 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-21T07:51:20.983 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T07:51:21.021 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T07:51:21.049 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephsqlite-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 3/4 2024-09-21T07:51:21.331 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 3/4 2024-09-21T07:51:21.412 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 4/4 2024-09-21T07:51:23.655 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-test-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 4/4 2024-09-21T07:51:23.655 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/4 2024-09-21T07:51:23.655 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephsqlite-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2/4 2024-09-21T07:51:23.655 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T07:51:23.943 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T07:51:23.943 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:23.943 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-21T07:51:23.943 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:23.943 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:23.943 INFO:teuthology.orchestra.run.smithi107.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T07:51:23.943 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T07:51:23.944 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:23.944 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:51:24.247 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph 2024-09-21T07:51:24.824 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:37 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:51:24.965 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:51:24.967 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:51:24.967 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-21T07:51:24.967 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:51:24.968 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-21T07:51:24.968 INFO:teuthology.orchestra.run.smithi107.stdout: ceph x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 6.5 k 2024-09-21T07:51:24.968 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-21T07:51:24.968 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 2.1 M 2024-09-21T07:51:24.968 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 1.4 M 2024-09-21T07:51:24.968 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1649.gfbd1a6ab.el9 ceph-noarch 240 k 2024-09-21T07:51:24.968 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 3.9 M 2024-09-21T07:51:24.968 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 15 M 2024-09-21T07:51:24.968 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T07:51:24.968 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T07:51:24.968 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T07:51:24.968 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T07:51:24.968 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T07:51:24.968 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T07:51:24.969 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T07:51:24.969 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections 2024-09-21T07:51:24.969 INFO:teuthology.orchestra.run.smithi107.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-21T07:51:24.969 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T07:51:24.969 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T07:51:24.969 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T07:51:24.969 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T07:51:24.969 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T07:51:24.969 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T07:51:24.969 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T07:51:24.969 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T07:51:24.969 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T07:51:24.969 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T07:51:24.969 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T07:51:24.970 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T07:51:24.970 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T07:51:24.970 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T07:51:24.970 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T07:51:24.970 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T07:51:24.970 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T07:51:24.970 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T07:51:24.970 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T07:51:24.970 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T07:51:24.970 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:24.970 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-21T07:51:24.970 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:51:24.971 INFO:teuthology.orchestra.run.smithi107.stdout:Install 34 Packages 2024-09-21T07:51:24.971 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:24.971 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 27 M 2024-09-21T07:51:24.971 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 96 M 2024-09-21T07:51:24.972 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-21T07:51:25.458 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 3/4 2024-09-21T07:51:25.530 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-test-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 4/4 2024-09-21T07:51:25.605 INFO:teuthology.orchestra.run.smithi107.stdout:(1/34): ceph-17.2.7-1649.gfbd1a6ab.el9.x86_64.r 31 kB/s | 6.5 kB 00:00 2024-09-21T07:51:26.031 INFO:teuthology.orchestra.run.smithi107.stdout:(2/34): ceph-mgr-17.2.7-1649.gfbd1a6ab.el9.x86_ 2.2 MB/s | 1.4 MB 00:00 2024-09-21T07:51:26.190 INFO:teuthology.orchestra.run.smithi107.stdout:(3/34): ceph-mds-17.2.7-1649.gfbd1a6ab.el9.x86_ 2.6 MB/s | 2.1 MB 00:00 2024-09-21T07:51:26.256 INFO:teuthology.orchestra.run.smithi107.stdout:(4/34): ceph-mgr-modules-core-17.2.7-1649.gfbd1 3.5 MB/s | 240 kB 00:00 2024-09-21T07:51:26.432 INFO:teuthology.orchestra.run.smithi107.stdout:(5/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-09-21T07:51:26.548 INFO:teuthology.orchestra.run.smithi107.stdout:(6/34): python3-cryptography-36.0.1-4.el9.x86_6 11 MB/s | 1.2 MB 00:00 2024-09-21T07:51:26.599 INFO:teuthology.orchestra.run.smithi107.stdout:(7/34): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T07:51:26.678 INFO:teuthology.orchestra.run.smithi107.stdout:(8/34): python3-pycparser-2.20-6.el9.noarch.rpm 1.7 MB/s | 135 kB 00:00 2024-09-21T07:51:26.716 INFO:teuthology.orchestra.run.smithi107.stdout:(9/34): python3-requests-2.25.1-8.el9.noarch.rp 3.2 MB/s | 125 kB 00:00 2024-09-21T07:51:26.767 INFO:teuthology.orchestra.run.smithi107.stdout:(10/34): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-21T07:51:26.825 INFO:teuthology.orchestra.run.smithi107.stdout:(11/34): ceph-mon-17.2.7-1649.gfbd1a6ab.el9.x86 3.2 MB/s | 3.9 MB 00:01 2024-09-21T07:51:26.942 INFO:teuthology.orchestra.run.smithi107.stdout:(12/34): python3-markupsafe-1.1.1-12.el9.x86_64 298 kB/s | 35 kB 00:00 2024-09-21T07:51:27.042 INFO:teuthology.orchestra.run.smithi107.stdout:(13/34): python3-mako-1.1.4-6.el9.noarch.rpm 625 kB/s | 172 kB 00:00 2024-09-21T07:51:27.067 INFO:teuthology.orchestra.run.smithi107.stdout:(14/34): python3-packaging-20.9-5.el9.noarch.rp 615 kB/s | 77 kB 00:00 2024-09-21T07:51:27.093 INFO:teuthology.orchestra.run.smithi107.stdout:(15/34): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T07:51:27.126 INFO:teuthology.orchestra.run.smithi107.stdout:(16/34): python3-toml-0.10.2-6.el9.noarch.rpm 711 kB/s | 42 kB 00:00 2024-09-21T07:51:27.152 INFO:teuthology.orchestra.run.smithi107.stdout:(17/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 740 kB/s | 43 kB 00:00 2024-09-21T07:51:27.185 INFO:teuthology.orchestra.run.smithi107.stdout:(18/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.0 MB/s | 172 kB 00:00 2024-09-21T07:51:27.211 INFO:teuthology.orchestra.run.smithi107.stdout:(19/34): python3-cherrypy-18.6.1-2.el9.noarch.r 6.2 MB/s | 358 kB 00:00 2024-09-21T07:51:27.228 INFO:teuthology.orchestra.run.smithi107.stdout:(20/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 253 kB/s | 11 kB 00:00 2024-09-21T07:51:27.253 INFO:teuthology.orchestra.run.smithi107.stdout:(21/34): python3-jaraco-classes-3.2.1-5.el9.noa 421 kB/s | 18 kB 00:00 2024-09-21T07:51:27.278 INFO:teuthology.orchestra.run.smithi107.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 459 kB/s | 23 kB 00:00 2024-09-21T07:51:27.304 INFO:teuthology.orchestra.run.smithi107.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-21T07:51:27.329 INFO:teuthology.orchestra.run.smithi107.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-21T07:51:27.354 INFO:teuthology.orchestra.run.smithi107.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 921 kB/s | 46 kB 00:00 2024-09-21T07:51:27.380 INFO:teuthology.orchestra.run.smithi107.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-21T07:51:27.405 INFO:teuthology.orchestra.run.smithi107.stdout:(27/34): python3-portend-3.1.0-2.el9.noarch.rpm 660 kB/s | 16 kB 00:00 2024-09-21T07:51:27.431 INFO:teuthology.orchestra.run.smithi107.stdout:(28/34): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-21T07:51:27.456 INFO:teuthology.orchestra.run.smithi107.stdout:(29/34): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-21T07:51:27.481 INFO:teuthology.orchestra.run.smithi107.stdout:(30/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-21T07:51:27.506 INFO:teuthology.orchestra.run.smithi107.stdout:(31/34): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-21T07:51:27.532 INFO:teuthology.orchestra.run.smithi107.stdout:(32/34): python3-zc-lockfile-2.0-10.el9.noarch. 798 kB/s | 20 kB 00:00 2024-09-21T07:51:27.557 INFO:teuthology.orchestra.run.smithi107.stdout:(33/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-21T07:51:27.724 INFO:teuthology.orchestra.run.smithi107.stdout:(34/34): ceph-osd-17.2.7-1649.gfbd1a6ab.el9.x86 9.1 MB/s | 15 MB 00:01 2024-09-21T07:51:27.729 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:51:27.729 INFO:teuthology.orchestra.run.smithi107.stdout:Total 9.9 MB/s | 27 MB 00:02 2024-09-21T07:51:27.811 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-test-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 4/4 2024-09-21T07:51:27.811 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-test-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/4 2024-09-21T07:51:27.811 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephsqlite-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2/4 2024-09-21T07:51:27.811 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T07:51:27.860 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-21T07:51:27.896 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-21T07:51:27.896 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-21T07:51:28.124 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T07:51:28.124 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:28.124 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-21T07:51:28.124 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-test-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:28.124 INFO:teuthology.orchestra.run.smithi129.stdout: libcephsqlite-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:28.124 INFO:teuthology.orchestra.run.smithi129.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T07:51:28.124 INFO:teuthology.orchestra.run.smithi129.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T07:51:28.124 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:28.124 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:51:28.286 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-21T07:51:28.286 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-21T07:51:28.424 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph 2024-09-21T07:51:29.016 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:38 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:51:29.150 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:51:29.152 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:51:29.152 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-09-21T07:51:29.152 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:51:29.152 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-21T07:51:29.152 INFO:teuthology.orchestra.run.smithi129.stdout: ceph x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 6.5 k 2024-09-21T07:51:29.153 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-09-21T07:51:29.153 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mds x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 2.1 M 2024-09-21T07:51:29.153 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 1.4 M 2024-09-21T07:51:29.153 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1649.gfbd1a6ab.el9 ceph-noarch 240 k 2024-09-21T07:51:29.153 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mon x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 3.9 M 2024-09-21T07:51:29.153 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-osd x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 15 M 2024-09-21T07:51:29.153 INFO:teuthology.orchestra.run.smithi129.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T07:51:29.153 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T07:51:29.153 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T07:51:29.153 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T07:51:29.153 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T07:51:29.153 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T07:51:29.153 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T07:51:29.153 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-collections 2024-09-21T07:51:29.154 INFO:teuthology.orchestra.run.smithi129.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-21T07:51:29.154 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T07:51:29.154 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T07:51:29.154 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T07:51:29.154 INFO:teuthology.orchestra.run.smithi129.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T07:51:29.154 INFO:teuthology.orchestra.run.smithi129.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T07:51:29.154 INFO:teuthology.orchestra.run.smithi129.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T07:51:29.154 INFO:teuthology.orchestra.run.smithi129.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T07:51:29.154 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T07:51:29.154 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T07:51:29.154 INFO:teuthology.orchestra.run.smithi129.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T07:51:29.154 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T07:51:29.155 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T07:51:29.155 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T07:51:29.155 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T07:51:29.155 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T07:51:29.155 INFO:teuthology.orchestra.run.smithi129.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T07:51:29.155 INFO:teuthology.orchestra.run.smithi129.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T07:51:29.155 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T07:51:29.155 INFO:teuthology.orchestra.run.smithi129.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T07:51:29.155 INFO:teuthology.orchestra.run.smithi129.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T07:51:29.155 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:29.155 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-21T07:51:29.155 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:51:29.155 INFO:teuthology.orchestra.run.smithi129.stdout:Install 34 Packages 2024-09-21T07:51:29.155 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:29.156 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 27 M 2024-09-21T07:51:29.156 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 96 M 2024-09-21T07:51:29.156 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-21T07:51:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-21T07:51:29.594 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-21T07:51:29.626 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-21T07:51:29.659 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-21T07:51:29.754 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-21T07:51:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-21T07:51:29.887 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-21T07:51:29.922 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-21T07:51:29.952 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-21T07:51:29.987 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-21T07:51:30.023 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-21T07:51:30.064 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-21T07:51:30.091 INFO:teuthology.orchestra.run.smithi129.stdout:(1/34): ceph-17.2.7-1649.gfbd1a6ab.el9.x86_64.r 22 kB/s | 6.5 kB 00:00 2024-09-21T07:51:30.107 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-21T07:51:30.142 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-21T07:51:30.190 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-21T07:51:30.223 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-21T07:51:30.296 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-21T07:51:30.366 INFO:teuthology.orchestra.run.smithi129.stdout:(2/34): ceph-mgr-17.2.7-1649.gfbd1a6ab.el9.x86_ 2.5 MB/s | 1.4 MB 00:00 2024-09-21T07:51:30.408 INFO:teuthology.orchestra.run.smithi129.stdout:(3/34): ceph-mds-17.2.7-1649.gfbd1a6ab.el9.x86_ 3.4 MB/s | 2.1 MB 00:00 2024-09-21T07:51:30.436 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-21T07:51:30.508 INFO:teuthology.orchestra.run.smithi129.stdout:(4/34): ceph-mgr-modules-core-17.2.7-1649.gfbd1 2.3 MB/s | 240 kB 00:00 2024-09-21T07:51:30.523 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-21T07:51:30.575 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-21T07:51:30.614 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-21T07:51:30.671 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-21T07:51:30.700 INFO:teuthology.orchestra.run.smithi129.stdout:(5/34): ceph-mon-17.2.7-1649.gfbd1a6ab.el9.x86_ 6.4 MB/s | 3.9 MB 00:00 2024-09-21T07:51:30.725 INFO:teuthology.orchestra.run.smithi129.stdout:(6/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-21T07:51:30.726 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-21T07:51:30.776 INFO:teuthology.orchestra.run.smithi129.stdout:(7/34): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T07:51:30.826 INFO:teuthology.orchestra.run.smithi129.stdout:(8/34): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-09-21T07:51:30.901 INFO:teuthology.orchestra.run.smithi129.stdout:(9/34): python3-requests-2.25.1-8.el9.noarch.rp 1.6 MB/s | 125 kB 00:00 2024-09-21T07:51:30.911 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-21T07:51:30.960 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-21T07:51:31.038 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-21T07:51:31.068 INFO:teuthology.orchestra.run.smithi129.stdout:(10/34): ceph-osd-17.2.7-1649.gfbd1a6ab.el9.x86 22 MB/s | 15 MB 00:00 2024-09-21T07:51:31.094 INFO:teuthology.orchestra.run.smithi129.stdout:(11/34): python3-urllib3-1.26.5-6.el9.noarch.rp 1.1 MB/s | 215 kB 00:00 2024-09-21T07:51:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-21T07:51:31.136 INFO:teuthology.orchestra.run.smithi129.stdout:(12/34): python3-cryptography-36.0.1-4.el9.x86_ 2.8 MB/s | 1.2 MB 00:00 2024-09-21T07:51:31.159 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-21T07:51:31.211 INFO:teuthology.orchestra.run.smithi129.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 297 kB/s | 35 kB 00:00 2024-09-21T07:51:31.236 INFO:teuthology.orchestra.run.smithi129.stdout:(14/34): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-09-21T07:51:31.262 INFO:teuthology.orchestra.run.smithi129.stdout:(15/34): python3-packaging-20.9-5.el9.noarch.rp 615 kB/s | 77 kB 00:00 2024-09-21T07:51:31.274 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-21T07:51:31.287 INFO:teuthology.orchestra.run.smithi129.stdout:(16/34): python3-pytz-2021.1-5.el9.noarch.rpm 674 kB/s | 51 kB 00:00 2024-09-21T07:51:31.304 INFO:teuthology.orchestra.run.smithi129.stdout:(17/34): python3-toml-0.10.2-6.el9.noarch.rpm 621 kB/s | 42 kB 00:00 2024-09-21T07:51:31.346 INFO:teuthology.orchestra.run.smithi129.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 517 kB/s | 43 kB 00:00 2024-09-21T07:51:31.363 INFO:teuthology.orchestra.run.smithi129.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 715 kB/s | 11 kB 00:00 2024-09-21T07:51:31.380 INFO:teuthology.orchestra.run.smithi129.stdout:(20/34): python3-jaraco-classes-3.2.1-5.el9.noa 1.0 MB/s | 18 kB 00:00 2024-09-21T07:51:31.405 INFO:teuthology.orchestra.run.smithi129.stdout:(21/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-21T07:51:31.430 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1649.gfbd1a6ab.el9. 29/34 2024-09-21T07:51:31.431 INFO:teuthology.orchestra.run.smithi129.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-21T07:51:31.453 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 30/34 2024-09-21T07:51:31.456 INFO:teuthology.orchestra.run.smithi129.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-21T07:51:31.480 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 30/34 2024-09-21T07:51:31.480 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:51:31.480 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T07:51:31.480 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:51:31.480 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:51:31.480 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:31.481 INFO:teuthology.orchestra.run.smithi129.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 390 kB/s | 20 kB 00:00 2024-09-21T07:51:31.506 INFO:teuthology.orchestra.run.smithi129.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-09-21T07:51:31.532 INFO:teuthology.orchestra.run.smithi129.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-21T07:51:31.565 INFO:teuthology.orchestra.run.smithi129.stdout:(27/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-09-21T07:51:31.591 INFO:teuthology.orchestra.run.smithi129.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 280 kB/s | 16 kB 00:00 2024-09-21T07:51:31.616 INFO:teuthology.orchestra.run.smithi129.stdout:(29/34): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-21T07:51:31.641 INFO:teuthology.orchestra.run.smithi129.stdout:(30/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-21T07:51:31.666 INFO:teuthology.orchestra.run.smithi129.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-21T07:51:31.692 INFO:teuthology.orchestra.run.smithi129.stdout:(32/34): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T07:51:31.717 INFO:teuthology.orchestra.run.smithi129.stdout:(33/34): python3-zc-lockfile-2.0-10.el9.noarch. 397 kB/s | 20 kB 00:00 2024-09-21T07:51:31.742 INFO:teuthology.orchestra.run.smithi129.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-21T07:51:31.748 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:51:31.748 INFO:teuthology.orchestra.run.smithi129.stdout:Total 10 MB/s | 27 MB 00:02 2024-09-21T07:51:31.880 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-21T07:51:31.918 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-21T07:51:31.918 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-21T07:51:32.299 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-21T07:51:32.300 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-21T07:51:32.787 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 31/34 2024-09-21T07:51:32.815 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-osd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 31/34 2024-09-21T07:51:32.815 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:51:32.815 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T07:51:32.815 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:51:32.815 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:51:32.815 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:33.193 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 32/34 2024-09-21T07:51:33.216 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mon-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 32/34 2024-09-21T07:51:33.216 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:51:33.216 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T07:51:33.216 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:51:33.216 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:51:33.216 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:33.418 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 33/34 2024-09-21T07:51:33.442 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mds-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 33/34 2024-09-21T07:51:33.442 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:51:33.442 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T07:51:33.442 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:51:33.442 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:51:33.442 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:33.506 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 34/34 2024-09-21T07:51:33.558 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-21T07:51:33.620 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-21T07:51:33.652 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-21T07:51:33.685 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-21T07:51:33.776 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-21T07:51:33.864 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-21T07:51:33.908 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-21T07:51:33.943 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-21T07:51:33.973 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-21T07:51:34.008 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-21T07:51:34.041 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-21T07:51:34.073 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-21T07:51:34.108 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-21T07:51:34.143 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-21T07:51:34.191 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-21T07:51:34.223 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-21T07:51:34.296 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-21T07:51:34.442 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-21T07:51:34.514 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-21T07:51:34.568 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-21T07:51:34.607 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-21T07:51:34.655 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-21T07:51:34.710 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-21T07:51:34.896 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-21T07:51:34.944 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-21T07:51:35.021 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-21T07:51:35.110 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-21T07:51:35.163 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 34/34 2024-09-21T07:51:35.163 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/34 2024-09-21T07:51:35.163 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2/34 2024-09-21T07:51:35.164 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 3/34 2024-09-21T07:51:35.164 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 4/34 2024-09-21T07:51:35.164 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 5/34 2024-09-21T07:51:35.164 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1649.gfbd1a6ab.el9. 6/34 2024-09-21T07:51:35.164 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-21T07:51:35.164 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-21T07:51:35.164 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-21T07:51:35.165 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-21T07:51:35.165 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-21T07:51:35.165 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-21T07:51:35.165 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-21T07:51:35.165 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-21T07:51:35.165 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-21T07:51:35.165 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-21T07:51:35.166 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-21T07:51:35.166 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-21T07:51:35.166 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-21T07:51:35.166 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-21T07:51:35.166 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-21T07:51:35.166 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-21T07:51:35.166 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-21T07:51:35.166 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-21T07:51:35.167 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-21T07:51:35.167 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-21T07:51:35.167 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-21T07:51:35.167 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-21T07:51:35.167 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-21T07:51:35.167 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-21T07:51:35.167 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-21T07:51:35.167 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-21T07:51:35.167 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-21T07:51:35.168 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-21T07:51:35.273 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-21T07:51:35.422 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1649.gfbd1a6ab.el9. 29/34 2024-09-21T07:51:35.446 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 30/34 2024-09-21T07:51:35.471 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 30/34 2024-09-21T07:51:35.471 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:51:35.471 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T07:51:35.471 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:51:35.471 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:51:35.471 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:36.254 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-21T07:51:36.254 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:36.254 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-21T07:51:36.254 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:36.255 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:36.255 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:36.255 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core-2:17.2.7-1649.gfbd1a6ab.el9.noarch 2024-09-21T07:51:36.255 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:36.255 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:36.255 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T07:51:36.255 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T07:51:36.255 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T07:51:36.255 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T07:51:36.255 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T07:51:36.255 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T07:51:36.255 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T07:51:36.255 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T07:51:36.256 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T07:51:36.256 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T07:51:36.256 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T07:51:36.256 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T07:51:36.256 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T07:51:36.256 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T07:51:36.256 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T07:51:36.256 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T07:51:36.256 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T07:51:36.256 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T07:51:36.256 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T07:51:36.256 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T07:51:36.257 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T07:51:36.257 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T07:51:36.257 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T07:51:36.257 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T07:51:36.257 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T07:51:36.257 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T07:51:36.257 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T07:51:36.257 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T07:51:36.257 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:36.257 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:51:36.643 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-base 2024-09-21T07:51:36.844 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-osd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 31/34 2024-09-21T07:51:36.873 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-osd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 31/34 2024-09-21T07:51:36.873 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:51:36.873 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T07:51:36.873 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:51:36.873 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:51:36.873 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:37.243 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:50 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:51:37.253 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mon-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 32/34 2024-09-21T07:51:37.277 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mon-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 32/34 2024-09-21T07:51:37.277 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:51:37.277 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T07:51:37.277 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:51:37.277 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:51:37.277 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:37.332 INFO:teuthology.orchestra.run.smithi107.stdout:Package ceph-base-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 is already installed. 2024-09-21T07:51:37.373 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:51:37.375 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-09-21T07:51:37.375 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:51:37.450 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install cephadm 2024-09-21T07:51:37.479 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mds-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 33/34 2024-09-21T07:51:37.503 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mds-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 33/34 2024-09-21T07:51:37.503 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:51:37.503 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T07:51:37.503 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:51:37.503 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:51:37.503 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:37.567 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 34/34 2024-09-21T07:51:38.027 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:51 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:51:38.157 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:51:38.158 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:51:38.158 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-21T07:51:38.158 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:51:38.158 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-21T07:51:38.158 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm noarch 2:17.2.7-1649.gfbd1a6ab.el9 ceph-noarch 83 k 2024-09-21T07:51:38.158 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:38.158 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-21T07:51:38.158 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:51:38.158 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-09-21T07:51:38.158 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:38.159 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 83 k 2024-09-21T07:51:38.159 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 375 k 2024-09-21T07:51:38.159 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-21T07:51:38.377 INFO:teuthology.orchestra.run.smithi107.stdout:cephadm-17.2.7-1649.gfbd1a6ab.el9.noarch.rpm 378 kB/s | 83 kB 00:00 2024-09-21T07:51:38.378 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:51:38.378 INFO:teuthology.orchestra.run.smithi107.stdout:Total 376 kB/s | 83 kB 00:00 2024-09-21T07:51:38.378 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-21T07:51:38.383 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-21T07:51:38.383 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-21T07:51:38.385 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-21T07:51:38.386 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-21T07:51:38.455 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-21T07:51:38.909 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:17.2.7-1649.gfbd1a6ab.el9.noarch 1/1 2024-09-21T07:51:39.006 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephadm-2:17.2.7-1649.gfbd1a6ab.el9.noarch 1/1 2024-09-21T07:51:39.241 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 34/34 2024-09-21T07:51:39.241 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/34 2024-09-21T07:51:39.241 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mds-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2/34 2024-09-21T07:51:39.241 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 3/34 2024-09-21T07:51:39.241 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mon-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 4/34 2024-09-21T07:51:39.241 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-osd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 5/34 2024-09-21T07:51:39.241 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1649.gfbd1a6ab.el9. 6/34 2024-09-21T07:51:39.241 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-21T07:51:39.241 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-21T07:51:39.241 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-21T07:51:39.241 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-21T07:51:39.241 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-21T07:51:39.242 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-21T07:51:39.242 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-21T07:51:39.242 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-21T07:51:39.242 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-21T07:51:39.242 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-21T07:51:39.242 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-21T07:51:39.242 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-21T07:51:39.242 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-21T07:51:39.242 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-21T07:51:39.242 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-21T07:51:39.242 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-21T07:51:39.242 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-21T07:51:39.242 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-21T07:51:39.242 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-21T07:51:39.243 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-21T07:51:39.243 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-21T07:51:39.243 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-21T07:51:39.243 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-21T07:51:39.243 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-21T07:51:39.243 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-21T07:51:39.243 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-21T07:51:39.243 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-21T07:51:39.338 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:17.2.7-1649.gfbd1a6ab.el9.noarch 1/1 2024-09-21T07:51:39.599 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephadm-2:17.2.7-1649.gfbd1a6ab.el9.noarch 1/1 2024-09-21T07:51:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:39.600 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-21T07:51:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm-2:17.2.7-1649.gfbd1a6ab.el9.noarch 2024-09-21T07:51:39.600 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:39.600 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:51:39.805 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T07:51:40.272 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-21T07:51:40.272 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:40.272 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-21T07:51:40.272 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:40.272 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mds-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:40.272 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:40.272 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-modules-core-2:17.2.7-1649.gfbd1a6ab.el9.noarch 2024-09-21T07:51:40.272 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mon-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:40.272 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-osd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:40.272 INFO:teuthology.orchestra.run.smithi129.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T07:51:40.272 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T07:51:40.273 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T07:51:40.273 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T07:51:40.273 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T07:51:40.273 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T07:51:40.273 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T07:51:40.273 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T07:51:40.273 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T07:51:40.273 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T07:51:40.273 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T07:51:40.273 INFO:teuthology.orchestra.run.smithi129.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T07:51:40.273 INFO:teuthology.orchestra.run.smithi129.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T07:51:40.273 INFO:teuthology.orchestra.run.smithi129.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T07:51:40.273 INFO:teuthology.orchestra.run.smithi129.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T07:51:40.273 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T07:51:40.273 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T07:51:40.274 INFO:teuthology.orchestra.run.smithi129.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T07:51:40.274 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T07:51:40.274 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T07:51:40.274 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T07:51:40.274 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T07:51:40.274 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T07:51:40.274 INFO:teuthology.orchestra.run.smithi129.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T07:51:40.274 INFO:teuthology.orchestra.run.smithi129.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T07:51:40.274 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T07:51:40.274 INFO:teuthology.orchestra.run.smithi129.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T07:51:40.274 INFO:teuthology.orchestra.run.smithi129.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T07:51:40.274 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:40.274 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:51:40.401 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:53 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:51:40.535 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:51:40.535 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:51:40.536 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repo Size 2024-09-21T07:51:40.536 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:51:40.536 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-21T07:51:40.536 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 137 k 2024-09-21T07:51:40.536 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:40.536 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-21T07:51:40.536 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:51:40.536 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-09-21T07:51:40.536 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:40.537 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 137 k 2024-09-21T07:51:40.537 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 379 k 2024-09-21T07:51:40.537 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-21T07:51:40.640 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-base 2024-09-21T07:51:40.742 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-immutable-object-cache-17.2.7-1649.gfbd1a6 669 kB/s | 137 kB 00:00 2024-09-21T07:51:40.743 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:51:40.743 INFO:teuthology.orchestra.run.smithi107.stdout:Total 663 kB/s | 137 kB 00:00 2024-09-21T07:51:40.744 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-21T07:51:40.751 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-21T07:51:40.751 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-21T07:51:40.808 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-21T07:51:40.809 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-21T07:51:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-21T07:51:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1649.gfbd1a6ab. 1/1 2024-09-21T07:51:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1649.gfbd1a6ab. 1/1 2024-09-21T07:51:41.052 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:51:41.052 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T07:51:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:41.222 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:50 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:51:41.310 INFO:teuthology.orchestra.run.smithi129.stdout:Package ceph-base-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 is already installed. 2024-09-21T07:51:41.352 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:51:41.353 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-09-21T07:51:41.353 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:51:41.434 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install cephadm 2024-09-21T07:51:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1649.gfbd1a6ab. 1/1 2024-09-21T07:51:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:41.966 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-21T07:51:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:41.966 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:51:42.012 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:51 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:51:42.143 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:51:42.144 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:51:42.144 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-09-21T07:51:42.144 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:51:42.144 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-21T07:51:42.144 INFO:teuthology.orchestra.run.smithi129.stdout: cephadm noarch 2:17.2.7-1649.gfbd1a6ab.el9 ceph-noarch 83 k 2024-09-21T07:51:42.144 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:42.144 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-21T07:51:42.144 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:51:42.144 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-09-21T07:51:42.144 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:42.145 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 83 k 2024-09-21T07:51:42.145 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 375 k 2024-09-21T07:51:42.145 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-21T07:51:42.178 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-mgr 2024-09-21T07:51:42.337 INFO:teuthology.orchestra.run.smithi129.stdout:cephadm-17.2.7-1649.gfbd1a6ab.el9.noarch.rpm 430 kB/s | 83 kB 00:00 2024-09-21T07:51:42.338 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:51:42.338 INFO:teuthology.orchestra.run.smithi129.stdout:Total 426 kB/s | 83 kB 00:00 2024-09-21T07:51:42.338 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-21T07:51:42.343 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-21T07:51:42.343 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-21T07:51:42.345 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-21T07:51:42.345 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-21T07:51:42.425 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-21T07:51:42.770 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:55 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:51:42.860 INFO:teuthology.orchestra.run.smithi107.stdout:Package ceph-mgr-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 is already installed. 2024-09-21T07:51:42.903 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:51:42.904 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-09-21T07:51:42.904 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:51:42.937 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: cephadm-2:17.2.7-1649.gfbd1a6ab.el9.noarch 1/1 2024-09-21T07:51:42.983 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T07:51:43.017 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : cephadm-2:17.2.7-1649.gfbd1a6ab.el9.noarch 1/1 2024-09-21T07:51:43.343 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: cephadm-2:17.2.7-1649.gfbd1a6ab.el9.noarch 1/1 2024-09-21T07:51:43.562 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:56 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:51:43.583 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : cephadm-2:17.2.7-1649.gfbd1a6ab.el9.noarch 1/1 2024-09-21T07:51:43.583 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:43.583 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-21T07:51:43.583 INFO:teuthology.orchestra.run.smithi129.stdout: cephadm-2:17.2.7-1649.gfbd1a6ab.el9.noarch 2024-09-21T07:51:43.583 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:43.583 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:51:43.692 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:51:43.693 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:51:43.693 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-21T07:51:43.694 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:51:43.694 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-21T07:51:43.694 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1649.gfbd1a6ab.el9 ceph-noarch 3.4 M 2024-09-21T07:51:43.694 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-21T07:51:43.694 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1649.gfbd1a6ab.el9 ceph-noarch 24 k 2024-09-21T07:51:43.694 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1649.gfbd1a6ab.el9 ceph-noarch 15 k 2024-09-21T07:51:43.694 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-21T07:51:43.695 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T07:51:43.695 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T07:51:43.695 INFO:teuthology.orchestra.run.smithi107.stdout:Installing weak dependencies: 2024-09-21T07:51:43.695 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-21T07:51:43.695 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:43.695 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-21T07:51:43.695 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:51:43.695 INFO:teuthology.orchestra.run.smithi107.stdout:Install 7 Packages 2024-09-21T07:51:43.695 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:43.696 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 3.7 M 2024-09-21T07:51:43.696 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 80 M 2024-09-21T07:51:43.696 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-21T07:51:43.782 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T07:51:43.922 INFO:teuthology.orchestra.run.smithi107.stdout:(1/7): ceph-prometheus-alerts-17.2.7-1649.gfbd1 88 kB/s | 15 kB 00:00 2024-09-21T07:51:43.947 INFO:teuthology.orchestra.run.smithi107.stdout:(2/7): ceph-grafana-dashboards-17.2.7-1649.gfbd 127 kB/s | 24 kB 00:00 2024-09-21T07:51:43.989 INFO:teuthology.orchestra.run.smithi107.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-09-21T07:51:44.014 INFO:teuthology.orchestra.run.smithi107.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-21T07:51:44.039 INFO:teuthology.orchestra.run.smithi107.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 443 kB/s | 41 kB 00:00 2024-09-21T07:51:44.065 INFO:teuthology.orchestra.run.smithi107.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-21T07:51:44.148 INFO:teuthology.orchestra.run.smithi107.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1649.gfbd1a6ab 8.5 MB/s | 3.4 MB 00:00 2024-09-21T07:51:44.152 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:51:44.152 INFO:teuthology.orchestra.run.smithi107.stdout:Total 8.0 MB/s | 3.7 MB 00:00 2024-09-21T07:51:44.153 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-21T07:51:44.161 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-21T07:51:44.161 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-21T07:51:44.254 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-21T07:51:44.254 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-21T07:51:44.367 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:53 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:51:44.498 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:51:44.498 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:51:44.498 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repo Size 2024-09-21T07:51:44.498 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:51:44.498 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-21T07:51:44.498 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 137 k 2024-09-21T07:51:44.499 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:44.499 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-21T07:51:44.499 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:51:44.499 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-09-21T07:51:44.499 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:44.499 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 137 k 2024-09-21T07:51:44.499 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 379 k 2024-09-21T07:51:44.499 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-21T07:51:44.559 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-21T07:51:44.636 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-21T07:51:44.667 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-21T07:51:44.713 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-21T07:51:44.746 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-21T07:51:44.761 INFO:teuthology.orchestra.run.smithi129.stdout:ceph-immutable-object-cache-17.2.7-1649.gfbd1a6 525 kB/s | 137 kB 00:00 2024-09-21T07:51:44.762 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:51:44.762 INFO:teuthology.orchestra.run.smithi129.stdout:Total 522 kB/s | 137 kB 00:00 2024-09-21T07:51:44.763 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-21T07:51:44.770 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-21T07:51:44.770 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-21T07:51:44.783 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1649.gfbd1a6ab.el9.n 5/7 2024-09-21T07:51:44.827 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-21T07:51:44.828 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-21T07:51:44.981 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-21T07:51:45.079 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1649.gfbd1a6ab. 1/1 2024-09-21T07:51:45.104 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1649.gfbd1a6ab. 1/1 2024-09-21T07:51:45.104 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:51:45.104 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T07:51:45.104 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:45.782 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1649.gfbd1a6ab.el9. 6/7 2024-09-21T07:51:45.820 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1649.gfbd1a6ab.el9.noarc 7/7 2024-09-21T07:51:46.043 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1649.gfbd1a6ab. 1/1 2024-09-21T07:51:46.043 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:46.043 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-21T07:51:46.043 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-immutable-object-cache-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:51:46.043 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:46.043 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:51:46.247 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-mgr 2024-09-21T07:51:46.850 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:55 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:51:46.852 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1649.gfbd1a6ab.el9.noarc 7/7 2024-09-21T07:51:46.852 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1649.gfbd1a6ab.el9. 1/7 2024-09-21T07:51:46.852 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1649.gfbd1a6ab.el9.noarc 2/7 2024-09-21T07:51:46.852 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1649.gfbd1a6ab.el9.n 3/7 2024-09-21T07:51:46.852 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-21T07:51:46.852 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-21T07:51:46.852 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-21T07:51:46.943 INFO:teuthology.orchestra.run.smithi129.stdout:Package ceph-mgr-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 is already installed. 2024-09-21T07:51:46.985 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:51:46.986 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-09-21T07:51:46.986 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:51:47.062 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T07:51:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-21T07:51:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:47.131 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-21T07:51:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards-2:17.2.7-1649.gfbd1a6ab.el9.noarch 2024-09-21T07:51:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard-2:17.2.7-1649.gfbd1a6ab.el9.noarch 2024-09-21T07:51:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts-2:17.2.7-1649.gfbd1a6ab.el9.noarch 2024-09-21T07:51:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-21T07:51:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-21T07:51:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T07:51:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T07:51:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:47.132 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:51:47.364 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T07:51:47.639 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:56 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:51:47.770 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:51:47.771 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:51:47.771 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-09-21T07:51:47.771 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:51:47.771 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-21T07:51:47.772 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1649.gfbd1a6ab.el9 ceph-noarch 3.4 M 2024-09-21T07:51:47.772 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-09-21T07:51:47.772 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1649.gfbd1a6ab.el9 ceph-noarch 24 k 2024-09-21T07:51:47.772 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1649.gfbd1a6ab.el9 ceph-noarch 15 k 2024-09-21T07:51:47.772 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-21T07:51:47.772 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T07:51:47.772 INFO:teuthology.orchestra.run.smithi129.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T07:51:47.772 INFO:teuthology.orchestra.run.smithi129.stdout:Installing weak dependencies: 2024-09-21T07:51:47.772 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-21T07:51:47.772 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:47.772 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-21T07:51:47.772 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:51:47.772 INFO:teuthology.orchestra.run.smithi129.stdout:Install 7 Packages 2024-09-21T07:51:47.773 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:47.773 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 3.7 M 2024-09-21T07:51:47.773 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 80 M 2024-09-21T07:51:47.773 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-21T07:51:47.935 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:00 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:51:47.976 INFO:teuthology.orchestra.run.smithi129.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1649.gfbd 175 kB/s | 24 kB 00:00 2024-09-21T07:51:48.002 INFO:teuthology.orchestra.run.smithi129.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1649.gfbd1 89 kB/s | 15 kB 00:00 2024-09-21T07:51:48.044 INFO:teuthology.orchestra.run.smithi129.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-09-21T07:51:48.068 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:51:48.069 INFO:teuthology.orchestra.run.smithi129.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-21T07:51:48.069 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-09-21T07:51:48.069 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-21T07:51:48.069 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-09-21T07:51:48.069 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-21T07:51:48.070 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1649.gfbd1a6ab.el9 ceph-noarch 7.4 M 2024-09-21T07:51:48.070 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-21T07:51:48.070 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T07:51:48.070 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T07:51:48.070 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T07:51:48.070 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T07:51:48.070 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T07:51:48.070 INFO:teuthology.orchestra.run.smithi107.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T07:51:48.070 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T07:51:48.070 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T07:51:48.070 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T07:51:48.070 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T07:51:48.070 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T07:51:48.071 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:48.071 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-21T07:51:48.071 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-09-21T07:51:48.071 INFO:teuthology.orchestra.run.smithi107.stdout:Install 12 Packages 2024-09-21T07:51:48.071 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:51:48.071 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 38 M 2024-09-21T07:51:48.071 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 212 M 2024-09-21T07:51:48.071 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-21T07:51:48.094 INFO:teuthology.orchestra.run.smithi129.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 442 kB/s | 41 kB 00:00 2024-09-21T07:51:48.120 INFO:teuthology.orchestra.run.smithi129.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-21T07:51:48.295 INFO:teuthology.orchestra.run.smithi129.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1649.gfbd1a6ab 7.3 MB/s | 3.4 MB 00:00 2024-09-21T07:51:48.298 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:51:48.299 INFO:teuthology.orchestra.run.smithi129.stdout:Total 6.9 MB/s | 3.7 MB 00:00 2024-09-21T07:51:48.299 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-21T07:51:48.306 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-21T07:51:48.307 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-21T07:51:48.395 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-21T07:51:48.395 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-21T07:51:48.716 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-21T07:51:48.788 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-21T07:51:48.821 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-21T07:51:48.868 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-21T07:51:48.900 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-21T07:51:48.924 INFO:teuthology.orchestra.run.smithi107.stdout:(1/12): ceph-mgr-diskprediction-local-17.2.7-16 13 MB/s | 7.4 MB 00:00 2024-09-21T07:51:48.929 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1649.gfbd1a6ab.el9.n 5/7 2024-09-21T07:51:48.990 INFO:teuthology.orchestra.run.smithi107.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 493 kB/s | 33 kB 00:00 2024-09-21T07:51:49.157 INFO:teuthology.orchestra.run.smithi107.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 242 kB/s | 191 kB 00:00 2024-09-21T07:51:49.216 INFO:teuthology.orchestra.run.smithi107.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 314 kB/s | 18 kB 00:00 2024-09-21T07:51:49.258 INFO:teuthology.orchestra.run.smithi107.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 924 kB/s | 38 kB 00:00 2024-09-21T07:51:49.458 INFO:teuthology.orchestra.run.smithi107.stdout:(6/12): libgfortran-11.5.0-2.el9.x86_64.rpm 735 kB/s | 801 kB 00:01 2024-09-21T07:51:49.575 INFO:teuthology.orchestra.run.smithi107.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.1 MB/s | 245 kB 00:00 2024-09-21T07:51:49.742 INFO:teuthology.orchestra.run.smithi107.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.0 MB/s | 3.0 MB 00:00 2024-09-21T07:51:49.826 INFO:teuthology.orchestra.run.smithi107.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-21T07:51:49.910 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1649.gfbd1a6ab.el9. 6/7 2024-09-21T07:51:49.950 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1649.gfbd1a6ab.el9.noarc 7/7 2024-09-21T07:51:50.451 INFO:teuthology.orchestra.run.smithi107.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 4.1 MB/s | 4.9 MB 00:01 2024-09-21T07:51:50.818 INFO:teuthology.orchestra.run.smithi107.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.1 MB/s | 5.1 MB 00:01 2024-09-21T07:51:50.922 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1649.gfbd1a6ab.el9.noarc 7/7 2024-09-21T07:51:50.922 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1649.gfbd1a6ab.el9. 1/7 2024-09-21T07:51:50.922 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1649.gfbd1a6ab.el9.noarc 2/7 2024-09-21T07:51:50.922 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1649.gfbd1a6ab.el9.n 3/7 2024-09-21T07:51:50.922 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-21T07:51:50.922 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-21T07:51:50.922 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-21T07:51:51.196 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-21T07:51:51.196 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:51.196 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-21T07:51:51.196 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-grafana-dashboards-2:17.2.7-1649.gfbd1a6ab.el9.noarch 2024-09-21T07:51:51.196 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-dashboard-2:17.2.7-1649.gfbd1a6ab.el9.noarch 2024-09-21T07:51:51.196 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-prometheus-alerts-2:17.2.7-1649.gfbd1a6ab.el9.noarch 2024-09-21T07:51:51.196 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-21T07:51:51.197 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-21T07:51:51.197 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T07:51:51.197 INFO:teuthology.orchestra.run.smithi129.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T07:51:51.197 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:51.197 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:51:51.430 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T07:51:52.012 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:01 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:51:52.146 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:51:52.147 INFO:teuthology.orchestra.run.smithi129.stdout:======================================================================================= 2024-09-21T07:51:52.147 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-09-21T07:51:52.147 INFO:teuthology.orchestra.run.smithi129.stdout:======================================================================================= 2024-09-21T07:51:52.148 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-21T07:51:52.148 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1649.gfbd1a6ab.el9 ceph-noarch 7.4 M 2024-09-21T07:51:52.148 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-09-21T07:51:52.148 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T07:51:52.148 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T07:51:52.148 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T07:51:52.148 INFO:teuthology.orchestra.run.smithi129.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T07:51:52.148 INFO:teuthology.orchestra.run.smithi129.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T07:51:52.148 INFO:teuthology.orchestra.run.smithi129.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T07:51:52.148 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T07:51:52.148 INFO:teuthology.orchestra.run.smithi129.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T07:51:52.148 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T07:51:52.148 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T07:51:52.149 INFO:teuthology.orchestra.run.smithi129.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T07:51:52.149 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:52.149 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-21T07:51:52.149 INFO:teuthology.orchestra.run.smithi129.stdout:======================================================================================= 2024-09-21T07:51:52.149 INFO:teuthology.orchestra.run.smithi129.stdout:Install 12 Packages 2024-09-21T07:51:52.149 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:51:52.149 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 38 M 2024-09-21T07:51:52.150 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 212 M 2024-09-21T07:51:52.150 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-21T07:51:52.679 INFO:teuthology.orchestra.run.smithi129.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-21T07:51:52.737 INFO:teuthology.orchestra.run.smithi129.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.2 MB/s | 801 kB 00:00 2024-09-21T07:51:53.129 INFO:teuthology.orchestra.run.smithi129.stdout:(3/12): ceph-mgr-diskprediction-local-17.2.7-16 13 MB/s | 7.4 MB 00:00 2024-09-21T07:51:53.338 INFO:teuthology.orchestra.run.smithi129.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 50 kB/s | 33 kB 00:00 2024-09-21T07:51:53.763 INFO:teuthology.orchestra.run.smithi129.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 29 kB/s | 18 kB 00:00 2024-09-21T07:51:53.905 INFO:teuthology.orchestra.run.smithi129.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.6 MB/s | 3.0 MB 00:01 2024-09-21T07:51:53.930 INFO:teuthology.orchestra.run.smithi129.stdout:(7/12): openblas-0.3.26-2.el9.x86_64.rpm 65 kB/s | 38 kB 00:00 2024-09-21T07:51:54.067 INFO:teuthology.orchestra.run.smithi107.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-21T07:51:54.068 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:51:54.069 INFO:teuthology.orchestra.run.smithi107.stdout:Total 6.4 MB/s | 38 MB 00:05 2024-09-21T07:51:54.426 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-21T07:51:54.452 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-21T07:51:54.452 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-21T07:51:54.731 INFO:teuthology.orchestra.run.smithi129.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 297 kB/s | 245 kB 00:00 2024-09-21T07:51:54.960 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-21T07:51:54.960 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-21T07:51:55.006 INFO:teuthology.orchestra.run.smithi129.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 4.0 MB/s | 4.9 MB 00:01 2024-09-21T07:51:55.106 INFO:teuthology.orchestra.run.smithi129.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.3 MB/s | 5.1 MB 00:01 2024-09-21T07:51:55.573 INFO:teuthology.orchestra.run.smithi129.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 298 kB/s | 250 kB 00:00 2024-09-21T07:51:55.723 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-21T07:51:55.803 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T07:51:55.851 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T07:51:55.962 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T07:51:56.011 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T07:51:56.194 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T07:51:56.226 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T07:51:56.309 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T07:51:56.448 INFO:teuthology.orchestra.run.smithi129.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-21T07:51:56.450 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:51:56.450 INFO:teuthology.orchestra.run.smithi129.stdout:Total 8.9 MB/s | 38 MB 00:04 2024-09-21T07:51:56.813 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-21T07:51:56.839 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-21T07:51:56.839 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-21T07:51:56.982 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T07:51:57.099 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T07:51:57.328 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-21T07:51:57.329 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-21T07:51:58.086 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-21T07:51:58.180 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T07:51:58.222 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T07:51:58.321 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T07:51:58.365 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T07:51:58.378 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T07:51:58.550 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T07:51:58.588 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T07:51:58.666 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T07:51:59.340 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T07:51:59.426 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T07:51:59.453 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T07:51:59.459 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1649.gfbd1a 12/12 2024-09-21T07:52:00.697 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T07:52:01.726 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T07:52:01.764 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1649.gfbd1a 12/12 2024-09-21T07:52:01.993 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1649.gfbd1a 12/12 2024-09-21T07:52:01.993 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1649.gfbd1a 1/12 2024-09-21T07:52:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T07:52:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T07:52:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T07:52:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T07:52:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T07:52:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T07:52:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T07:52:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T07:52:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T07:52:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T07:52:02.455 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T07:52:02.455 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:02.455 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-21T07:52:02.455 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1649.gfbd1a6ab.el9.noarch 2024-09-21T07:52:02.456 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T07:52:02.456 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T07:52:02.456 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T07:52:02.456 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T07:52:02.456 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T07:52:02.456 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T07:52:02.456 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T07:52:02.456 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T07:52:02.456 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T07:52:02.456 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T07:52:02.456 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T07:52:02.456 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:02.456 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:52:02.880 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-mgr-rook 2024-09-21T07:52:03.475 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:16 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:52:03.607 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:52:03.608 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:03.608 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-21T07:52:03.608 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:03.609 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-21T07:52:03.609 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook noarch 2:17.2.7-1649.gfbd1a6ab.el9 ceph-noarch 47 k 2024-09-21T07:52:03.609 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-21T07:52:03.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T07:52:03.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T07:52:03.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T07:52:03.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T07:52:03.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T07:52:03.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T07:52:03.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T07:52:03.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T07:52:03.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T07:52:03.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T07:52:03.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T07:52:03.610 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T07:52:03.610 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:03.610 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-21T07:52:03.610 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:03.610 INFO:teuthology.orchestra.run.smithi107.stdout:Install 13 Packages 2024-09-21T07:52:03.610 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:03.610 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 2.2 M 2024-09-21T07:52:03.610 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 26 M 2024-09-21T07:52:03.611 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-21T07:52:03.819 INFO:teuthology.orchestra.run.smithi107.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 196 kB/s | 26 kB 00:00 2024-09-21T07:52:03.844 INFO:teuthology.orchestra.run.smithi107.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 123 kB/s | 19 kB 00:00 2024-09-21T07:52:03.870 INFO:teuthology.orchestra.run.smithi107.stdout:(3/13): ceph-mgr-rook-17.2.7-1649.gfbd1a6ab.el9 263 kB/s | 47 kB 00:00 2024-09-21T07:52:03.995 INFO:teuthology.orchestra.run.smithi107.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-21T07:52:04.020 INFO:teuthology.orchestra.run.smithi107.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 904 kB/s | 159 kB 00:00 2024-09-21T07:52:04.054 INFO:teuthology.orchestra.run.smithi107.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 917 kB/s | 54 kB 00:00 2024-09-21T07:52:04.079 INFO:teuthology.orchestra.run.smithi107.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.3 MB/s | 279 kB 00:00 2024-09-21T07:52:04.113 INFO:teuthology.orchestra.run.smithi107.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 349 kB/s | 32 kB 00:00 2024-09-21T07:52:04.146 INFO:teuthology.orchestra.run.smithi107.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 156 kB/s | 14 kB 00:00 2024-09-21T07:52:04.172 INFO:teuthology.orchestra.run.smithi107.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.5 MB/s | 59 kB 00:00 2024-09-21T07:52:04.197 INFO:teuthology.orchestra.run.smithi107.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.5 MB/s | 90 kB 00:00 2024-09-21T07:52:04.222 INFO:teuthology.orchestra.run.smithi107.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 1.6 MB/s | 220 kB 00:00 2024-09-21T07:52:04.256 INFO:teuthology.orchestra.run.smithi107.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.6 MB/s | 1.0 MB 00:00 2024-09-21T07:52:04.258 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:52:04.258 INFO:teuthology.orchestra.run.smithi107.stdout:Total 3.4 MB/s | 2.2 MB 00:00 2024-09-21T07:52:04.322 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-21T07:52:04.337 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-21T07:52:04.337 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-21T07:52:04.426 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1649.gfbd1a 12/12 2024-09-21T07:52:04.426 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1649.gfbd1a 1/12 2024-09-21T07:52:04.427 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T07:52:04.427 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T07:52:04.427 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T07:52:04.427 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T07:52:04.427 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T07:52:04.427 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T07:52:04.427 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T07:52:04.427 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T07:52:04.427 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T07:52:04.427 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T07:52:04.428 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-21T07:52:04.428 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-21T07:52:04.836 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T07:52:04.836 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:04.836 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-21T07:52:04.836 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1649.gfbd1a6ab.el9.noarch 2024-09-21T07:52:04.836 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T07:52:04.836 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T07:52:04.836 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T07:52:04.837 INFO:teuthology.orchestra.run.smithi129.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T07:52:04.837 INFO:teuthology.orchestra.run.smithi129.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T07:52:04.837 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T07:52:04.837 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T07:52:04.837 INFO:teuthology.orchestra.run.smithi129.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T07:52:04.837 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T07:52:04.837 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T07:52:04.837 INFO:teuthology.orchestra.run.smithi129.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T07:52:04.837 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:04.837 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:52:04.921 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-21T07:52:05.093 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T07:52:05.148 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T07:52:05.203 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T07:52:05.228 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-mgr-rook 2024-09-21T07:52:05.233 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T07:52:05.265 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T07:52:05.367 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T07:52:05.468 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T07:52:05.518 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T07:52:05.825 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:14 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:52:05.964 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:52:05.966 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:05.966 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-09-21T07:52:05.966 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:05.966 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-21T07:52:05.966 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-rook noarch 2:17.2.7-1649.gfbd1a6ab.el9 ceph-noarch 47 k 2024-09-21T07:52:05.966 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-09-21T07:52:05.966 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T07:52:05.966 INFO:teuthology.orchestra.run.smithi129.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T07:52:05.966 INFO:teuthology.orchestra.run.smithi129.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T07:52:05.966 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T07:52:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T07:52:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T07:52:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T07:52:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T07:52:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T07:52:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T07:52:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T07:52:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T07:52:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:05.967 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-21T07:52:05.967 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:05.967 INFO:teuthology.orchestra.run.smithi129.stdout:Install 13 Packages 2024-09-21T07:52:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:05.968 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 2.2 M 2024-09-21T07:52:05.968 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 26 M 2024-09-21T07:52:05.968 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-21T07:52:06.141 INFO:teuthology.orchestra.run.smithi129.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 204 kB/s | 19 kB 00:00 2024-09-21T07:52:06.166 INFO:teuthology.orchestra.run.smithi129.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 215 kB/s | 26 kB 00:00 2024-09-21T07:52:06.223 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T07:52:06.225 INFO:teuthology.orchestra.run.smithi129.stdout:(3/13): ceph-mgr-rook-17.2.7-1649.gfbd1a6ab.el9 267 kB/s | 47 kB 00:00 2024-09-21T07:52:06.267 INFO:teuthology.orchestra.run.smithi129.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.7 MB/s | 222 kB 00:00 2024-09-21T07:52:06.282 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T07:52:06.292 INFO:teuthology.orchestra.run.smithi129.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-21T07:52:06.316 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T07:52:06.317 INFO:teuthology.orchestra.run.smithi129.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-21T07:52:06.359 INFO:teuthology.orchestra.run.smithi129.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-21T07:52:06.361 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T07:52:06.384 INFO:teuthology.orchestra.run.smithi129.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 211 kB/s | 14 kB 00:00 2024-09-21T07:52:06.394 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-rook-2:17.2.7-1649.gfbd1a6ab.el9.noarch 13/13 2024-09-21T07:52:06.410 INFO:teuthology.orchestra.run.smithi129.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 4.4 MB/s | 220 kB 00:00 2024-09-21T07:52:06.435 INFO:teuthology.orchestra.run.smithi129.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.3 MB/s | 279 kB 00:00 2024-09-21T07:52:06.460 INFO:teuthology.orchestra.run.smithi129.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-21T07:52:06.502 INFO:teuthology.orchestra.run.smithi129.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 8.7 MB/s | 1.0 MB 00:00 2024-09-21T07:52:06.527 INFO:teuthology.orchestra.run.smithi129.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 974 kB/s | 90 kB 00:00 2024-09-21T07:52:06.530 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:52:06.531 INFO:teuthology.orchestra.run.smithi129.stdout:Total 3.9 MB/s | 2.2 MB 00:00 2024-09-21T07:52:06.595 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-21T07:52:06.609 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-21T07:52:06.610 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-21T07:52:06.706 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-21T07:52:06.707 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-21T07:52:07.208 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-21T07:52:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1649.gfbd1a6ab.el9.noarch 13/13 2024-09-21T07:52:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1649.gfbd1a6ab.el9.noarch 1/13 2024-09-21T07:52:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T07:52:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T07:52:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T07:52:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T07:52:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T07:52:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T07:52:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T07:52:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T07:52:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T07:52:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T07:52:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T07:52:07.384 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T07:52:07.438 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T07:52:07.501 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T07:52:07.538 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T07:52:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T07:52:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:07.569 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-21T07:52:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook-2:17.2.7-1649.gfbd1a6ab.el9.noarch 2024-09-21T07:52:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T07:52:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T07:52:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T07:52:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T07:52:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T07:52:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T07:52:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T07:52:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T07:52:07.570 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T07:52:07.570 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T07:52:07.570 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T07:52:07.570 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T07:52:07.570 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:07.570 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:52:07.588 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T07:52:07.690 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T07:52:07.800 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T07:52:07.815 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T07:52:07.848 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T07:52:08.400 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:21 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:52:08.532 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:52:08.533 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:08.533 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-21T07:52:08.533 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:08.533 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-21T07:52:08.534 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1649.gfbd1a6ab.el9 ceph-noarch 124 k 2024-09-21T07:52:08.534 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-21T07:52:08.534 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T07:52:08.534 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T07:52:08.534 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T07:52:08.534 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T07:52:08.534 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T07:52:08.534 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:08.534 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-21T07:52:08.534 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:08.534 INFO:teuthology.orchestra.run.smithi107.stdout:Install 6 Packages 2024-09-21T07:52:08.534 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:08.535 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 7.0 M 2024-09-21T07:52:08.535 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 33 M 2024-09-21T07:52:08.535 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-21T07:52:08.556 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T07:52:08.613 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T07:52:08.646 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T07:52:08.709 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T07:52:08.733 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-rook-2:17.2.7-1649.gfbd1a6ab.el9.noarch 13/13 2024-09-21T07:52:08.934 INFO:teuthology.orchestra.run.smithi107.stdout:(1/6): ceph-mgr-cephadm-17.2.7-1649.gfbd1a6ab.e 682 kB/s | 124 kB 00:00 2024-09-21T07:52:08.976 INFO:teuthology.orchestra.run.smithi107.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-21T07:52:09.010 INFO:teuthology.orchestra.run.smithi107.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-09-21T07:52:09.035 INFO:teuthology.orchestra.run.smithi107.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 3.1 MB/s | 74 kB 00:00 2024-09-21T07:52:09.052 INFO:teuthology.orchestra.run.smithi107.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 762 kB/s | 58 kB 00:00 2024-09-21T07:52:09.510 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1649.gfbd1a6ab.el9.noarch 13/13 2024-09-21T07:52:09.510 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1649.gfbd1a6ab.el9.noarch 1/13 2024-09-21T07:52:09.510 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T07:52:09.510 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T07:52:09.510 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T07:52:09.511 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T07:52:09.511 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T07:52:09.511 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T07:52:09.511 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T07:52:09.511 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T07:52:09.511 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T07:52:09.511 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T07:52:09.511 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T07:52:09.860 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T07:52:09.861 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:09.861 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-21T07:52:09.861 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-rook-2:17.2.7-1649.gfbd1a6ab.el9.noarch 2024-09-21T07:52:09.861 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T07:52:09.861 INFO:teuthology.orchestra.run.smithi129.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T07:52:09.861 INFO:teuthology.orchestra.run.smithi129.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T07:52:09.861 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T07:52:09.861 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T07:52:09.861 INFO:teuthology.orchestra.run.smithi129.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T07:52:09.861 INFO:teuthology.orchestra.run.smithi129.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T07:52:09.861 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T07:52:09.861 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T07:52:09.861 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T07:52:09.861 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T07:52:09.862 INFO:teuthology.orchestra.run.smithi129.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T07:52:09.862 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:09.862 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:52:10.119 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T07:52:10.544 INFO:teuthology.orchestra.run.smithi107.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.3 MB/s | 6.0 MB 00:01 2024-09-21T07:52:10.546 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:52:10.546 INFO:teuthology.orchestra.run.smithi107.stdout:Total 3.5 MB/s | 7.0 MB 00:02 2024-09-21T07:52:10.618 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-21T07:52:10.629 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-21T07:52:10.629 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-21T07:52:10.704 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:19 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:52:10.728 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-21T07:52:10.728 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-21T07:52:10.842 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:52:10.843 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:10.843 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-09-21T07:52:10.843 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:10.843 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-21T07:52:10.843 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1649.gfbd1a6ab.el9 ceph-noarch 124 k 2024-09-21T07:52:10.843 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-09-21T07:52:10.844 INFO:teuthology.orchestra.run.smithi129.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T07:52:10.844 INFO:teuthology.orchestra.run.smithi129.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T07:52:10.844 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T07:52:10.844 INFO:teuthology.orchestra.run.smithi129.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T07:52:10.844 INFO:teuthology.orchestra.run.smithi129.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T07:52:10.844 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:10.844 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-21T07:52:10.844 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:10.844 INFO:teuthology.orchestra.run.smithi129.stdout:Install 6 Packages 2024-09-21T07:52:10.844 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:10.845 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 7.0 M 2024-09-21T07:52:10.845 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 33 M 2024-09-21T07:52:10.845 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-21T07:52:11.039 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-21T07:52:11.203 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T07:52:11.231 INFO:teuthology.orchestra.run.smithi129.stdout:(1/6): ceph-mgr-cephadm-17.2.7-1649.gfbd1a6ab.e 568 kB/s | 124 kB 00:00 2024-09-21T07:52:11.253 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T07:52:11.299 INFO:teuthology.orchestra.run.smithi129.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 8.9 MB/s | 548 kB 00:00 2024-09-21T07:52:11.324 INFO:teuthology.orchestra.run.smithi129.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2024-09-21T07:52:11.350 INFO:teuthology.orchestra.run.smithi129.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 3.0 MB/s | 74 kB 00:00 2024-09-21T07:52:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T07:52:11.864 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T07:52:11.866 INFO:teuthology.orchestra.run.smithi129.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 291 kB/s | 248 kB 00:00 2024-09-21T07:52:11.920 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T07:52:11.950 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1649.gfbd1a6ab.el9.noarch 6/6 2024-09-21T07:52:12.733 INFO:teuthology.orchestra.run.smithi129.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.5 MB/s | 6.0 MB 00:01 2024-09-21T07:52:12.735 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:52:12.736 INFO:teuthology.orchestra.run.smithi129.stdout:Total 3.7 MB/s | 7.0 MB 00:01 2024-09-21T07:52:12.748 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1649.gfbd1a6ab.el9.noarch 6/6 2024-09-21T07:52:12.748 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1649.gfbd1a6ab.el9.noarch 1/6 2024-09-21T07:52:12.748 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T07:52:12.748 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T07:52:12.748 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T07:52:12.748 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T07:52:12.809 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-21T07:52:12.821 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-21T07:52:12.821 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-21T07:52:12.921 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-21T07:52:12.921 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-21T07:52:13.018 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T07:52:13.019 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:13.019 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-21T07:52:13.019 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm-2:17.2.7-1649.gfbd1a6ab.el9.noarch 2024-09-21T07:52:13.019 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T07:52:13.019 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T07:52:13.019 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T07:52:13.019 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T07:52:13.019 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T07:52:13.019 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:13.019 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:52:13.226 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-21T07:52:13.288 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-fuse 2024-09-21T07:52:13.407 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T07:52:13.468 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T07:52:13.876 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:26 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:52:13.998 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T07:52:14.009 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:52:14.009 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:14.010 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-21T07:52:14.010 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:14.010 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-21T07:52:14.010 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 813 k 2024-09-21T07:52:14.010 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-21T07:52:14.010 INFO:teuthology.orchestra.run.smithi107.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T07:52:14.010 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:14.010 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-21T07:52:14.010 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:14.010 INFO:teuthology.orchestra.run.smithi107.stdout:Install 2 Packages 2024-09-21T07:52:14.011 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:14.011 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 893 k 2024-09-21T07:52:14.011 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 2.6 M 2024-09-21T07:52:14.011 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-21T07:52:14.080 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T07:52:14.135 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T07:52:14.164 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1649.gfbd1a6ab.el9.noarch 6/6 2024-09-21T07:52:14.229 INFO:teuthology.orchestra.run.smithi107.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 821 kB/s | 80 kB 00:00 2024-09-21T07:52:14.413 INFO:teuthology.orchestra.run.smithi107.stdout:(2/2): ceph-fuse-17.2.7-1649.gfbd1a6ab.el9.x86_ 2.8 MB/s | 813 kB 00:00 2024-09-21T07:52:14.413 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:52:14.413 INFO:teuthology.orchestra.run.smithi107.stdout:Total 2.2 MB/s | 893 kB 00:00 2024-09-21T07:52:14.425 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-21T07:52:14.446 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-21T07:52:14.446 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-21T07:52:14.526 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-21T07:52:14.526 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-21T07:52:14.712 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-21T07:52:14.853 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T07:52:14.927 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2/2 2024-09-21T07:52:14.936 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1649.gfbd1a6ab.el9.noarch 6/6 2024-09-21T07:52:14.936 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1649.gfbd1a6ab.el9.noarch 1/6 2024-09-21T07:52:14.936 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T07:52:14.936 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T07:52:14.936 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T07:52:14.936 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T07:52:15.201 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T07:52:15.201 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:15.201 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-21T07:52:15.201 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-cephadm-2:17.2.7-1649.gfbd1a6ab.el9.noarch 2024-09-21T07:52:15.201 INFO:teuthology.orchestra.run.smithi129.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T07:52:15.202 INFO:teuthology.orchestra.run.smithi129.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T07:52:15.202 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T07:52:15.202 INFO:teuthology.orchestra.run.smithi129.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T07:52:15.202 INFO:teuthology.orchestra.run.smithi129.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T07:52:15.202 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:15.202 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:52:15.465 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-fuse 2024-09-21T07:52:15.623 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2/2 2024-09-21T07:52:15.623 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/2 2024-09-21T07:52:15.885 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T07:52:15.885 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:15.885 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-21T07:52:15.885 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T07:52:15.885 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:15.885 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:52:16.044 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:25 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:52:16.149 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install librados-devel 2024-09-21T07:52:16.176 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:52:16.177 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:16.177 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-09-21T07:52:16.177 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:16.177 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-21T07:52:16.178 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-fuse x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 813 k 2024-09-21T07:52:16.178 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-09-21T07:52:16.178 INFO:teuthology.orchestra.run.smithi129.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T07:52:16.178 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:16.178 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-21T07:52:16.178 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:16.178 INFO:teuthology.orchestra.run.smithi129.stdout:Install 2 Packages 2024-09-21T07:52:16.178 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:16.179 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 893 k 2024-09-21T07:52:16.179 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 2.6 M 2024-09-21T07:52:16.179 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-21T07:52:16.477 INFO:teuthology.orchestra.run.smithi129.stdout:(1/2): ceph-fuse-17.2.7-1649.gfbd1a6ab.el9.x86_ 3.2 MB/s | 813 kB 00:00 2024-09-21T07:52:16.686 INFO:teuthology.orchestra.run.smithi129.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 173 kB/s | 80 kB 00:00 2024-09-21T07:52:16.687 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:52:16.687 INFO:teuthology.orchestra.run.smithi129.stdout:Total 1.7 MB/s | 893 kB 00:00 2024-09-21T07:52:16.698 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-21T07:52:16.720 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-21T07:52:16.720 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-21T07:52:16.739 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:29 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:52:16.802 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-21T07:52:16.803 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-21T07:52:16.874 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:52:16.874 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:16.875 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repo Size 2024-09-21T07:52:16.875 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:16.875 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-21T07:52:16.875 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 126 k 2024-09-21T07:52:16.875 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:16.875 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-21T07:52:16.875 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:16.875 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-09-21T07:52:16.875 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:16.876 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 126 k 2024-09-21T07:52:16.876 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 448 k 2024-09-21T07:52:16.876 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-21T07:52:16.985 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-21T07:52:17.094 INFO:teuthology.orchestra.run.smithi107.stdout:librados-devel-17.2.7-1649.gfbd1a6ab.el9.x86_64 579 kB/s | 126 kB 00:00 2024-09-21T07:52:17.095 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:52:17.095 INFO:teuthology.orchestra.run.smithi107.stdout:Total 575 kB/s | 126 kB 00:00 2024-09-21T07:52:17.095 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-21T07:52:17.100 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-21T07:52:17.100 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-21T07:52:17.128 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T07:52:17.162 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-21T07:52:17.162 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-21T07:52:17.192 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-fuse-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2/2 2024-09-21T07:52:17.311 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-21T07:52:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados-devel-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:17.871 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2/2 2024-09-21T07:52:17.871 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-fuse-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/2 2024-09-21T07:52:18.083 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:18.083 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:18.083 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-21T07:52:18.083 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:52:18.083 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:18.084 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:52:18.123 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T07:52:18.123 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:18.123 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-21T07:52:18.123 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-fuse-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T07:52:18.123 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:18.123 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:52:18.327 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install libcephfs2 2024-09-21T07:52:18.380 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install librados-devel 2024-09-21T07:52:18.929 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:31 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:52:19.013 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:28 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:52:19.019 INFO:teuthology.orchestra.run.smithi107.stdout:Package libcephfs2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 is already installed. 2024-09-21T07:52:19.065 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:52:19.066 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-09-21T07:52:19.066 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:52:19.127 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install libcephfs-devel 2024-09-21T07:52:19.145 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:52:19.146 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:19.146 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repo Size 2024-09-21T07:52:19.146 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:19.146 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-21T07:52:19.146 INFO:teuthology.orchestra.run.smithi129.stdout: librados-devel x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 126 k 2024-09-21T07:52:19.146 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:19.146 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-21T07:52:19.146 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:19.146 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-09-21T07:52:19.147 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:19.147 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 126 k 2024-09-21T07:52:19.147 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 448 k 2024-09-21T07:52:19.147 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-21T07:52:19.333 INFO:teuthology.orchestra.run.smithi129.stdout:librados-devel-17.2.7-1649.gfbd1a6ab.el9.x86_64 677 kB/s | 126 kB 00:00 2024-09-21T07:52:19.334 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:52:19.334 INFO:teuthology.orchestra.run.smithi129.stdout:Total 671 kB/s | 126 kB 00:00 2024-09-21T07:52:19.334 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-21T07:52:19.339 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-21T07:52:19.339 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-21T07:52:19.404 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-21T07:52:19.405 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-21T07:52:19.567 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-21T07:52:19.680 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librados-devel-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:19.709 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:32 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:52:19.841 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:52:19.841 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:19.841 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repo Size 2024-09-21T07:52:19.841 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:19.842 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-21T07:52:19.842 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 25 k 2024-09-21T07:52:19.842 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:19.842 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-21T07:52:19.842 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:19.842 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-09-21T07:52:19.842 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:19.843 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 25 k 2024-09-21T07:52:19.843 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 110 k 2024-09-21T07:52:19.843 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-21T07:52:19.980 INFO:teuthology.orchestra.run.smithi107.stdout:libcephfs-devel-17.2.7-1649.gfbd1a6ab.el9.x86_6 181 kB/s | 25 kB 00:00 2024-09-21T07:52:19.981 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:52:19.981 INFO:teuthology.orchestra.run.smithi107.stdout:Total 179 kB/s | 25 kB 00:00 2024-09-21T07:52:19.982 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-21T07:52:19.985 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-21T07:52:19.985 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-21T07:52:19.986 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-21T07:52:19.987 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-21T07:52:20.073 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-21T07:52:20.089 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados-devel-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:20.169 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs-devel-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:20.351 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados-devel-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:20.351 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:20.351 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-21T07:52:20.351 INFO:teuthology.orchestra.run.smithi129.stdout: librados-devel-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:52:20.352 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:20.352 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:52:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:20.610 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install libcephfs2 2024-09-21T07:52:20.739 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs-devel-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:20.739 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:20.739 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-21T07:52:20.739 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:52:20.739 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:20.739 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:52:20.919 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install librados2 2024-09-21T07:52:21.199 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:30 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:52:21.290 INFO:teuthology.orchestra.run.smithi129.stdout:Package libcephfs2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 is already installed. 2024-09-21T07:52:21.333 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:52:21.334 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-09-21T07:52:21.334 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:52:21.424 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install libcephfs-devel 2024-09-21T07:52:21.499 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:34 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:52:21.588 INFO:teuthology.orchestra.run.smithi107.stdout:Package librados2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 is already installed. 2024-09-21T07:52:21.630 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:52:21.631 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-09-21T07:52:21.631 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:52:21.695 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install librbd1 2024-09-21T07:52:22.002 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:31 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:52:22.135 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:52:22.136 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:22.136 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repo Size 2024-09-21T07:52:22.136 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:22.136 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-21T07:52:22.136 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs-devel x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 25 k 2024-09-21T07:52:22.136 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:22.136 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-21T07:52:22.136 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:22.136 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-09-21T07:52:22.136 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:22.137 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 25 k 2024-09-21T07:52:22.137 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 110 k 2024-09-21T07:52:22.137 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-21T07:52:22.277 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:35 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:52:22.287 INFO:teuthology.orchestra.run.smithi129.stdout:libcephfs-devel-17.2.7-1649.gfbd1a6ab.el9.x86_6 166 kB/s | 25 kB 00:00 2024-09-21T07:52:22.287 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:52:22.288 INFO:teuthology.orchestra.run.smithi129.stdout:Total 165 kB/s | 25 kB 00:00 2024-09-21T07:52:22.288 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-21T07:52:22.291 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-21T07:52:22.291 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-21T07:52:22.293 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-21T07:52:22.293 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-21T07:52:22.365 INFO:teuthology.orchestra.run.smithi107.stdout:Package librbd1-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 is already installed. 2024-09-21T07:52:22.379 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-21T07:52:22.408 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:52:22.409 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-09-21T07:52:22.409 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:52:22.481 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install python3-rados 2024-09-21T07:52:22.500 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephfs-devel-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:22.835 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:23.061 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:36 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:52:23.074 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephfs-devel-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:23.074 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:23.074 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-21T07:52:23.074 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs-devel-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:52:23.075 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:23.075 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:52:23.150 INFO:teuthology.orchestra.run.smithi107.stdout:Package python3-rados-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 is already installed. 2024-09-21T07:52:23.192 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:52:23.193 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-09-21T07:52:23.194 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:52:23.261 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install python3-rgw 2024-09-21T07:52:23.271 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install librados2 2024-09-21T07:52:23.843 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:36 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:52:23.856 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:32 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:52:23.931 INFO:teuthology.orchestra.run.smithi107.stdout:Package python3-rgw-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 is already installed. 2024-09-21T07:52:23.946 INFO:teuthology.orchestra.run.smithi129.stdout:Package librados2-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 is already installed. 2024-09-21T07:52:23.973 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:52:23.975 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-09-21T07:52:23.975 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:52:23.989 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:52:23.990 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-09-21T07:52:23.990 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:52:24.044 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install python3-cephfs 2024-09-21T07:52:24.082 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install librbd1 2024-09-21T07:52:24.625 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:37 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:52:24.668 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:33 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:52:24.714 INFO:teuthology.orchestra.run.smithi107.stdout:Package python3-cephfs-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 is already installed. 2024-09-21T07:52:24.757 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:52:24.758 INFO:teuthology.orchestra.run.smithi129.stdout:Package librbd1-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 is already installed. 2024-09-21T07:52:24.759 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-09-21T07:52:24.759 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:52:24.800 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:52:24.801 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-09-21T07:52:24.801 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:52:24.831 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install python3-rbd 2024-09-21T07:52:24.878 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install python3-rados 2024-09-21T07:52:25.410 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:38 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:52:25.455 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:34 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:52:25.500 INFO:teuthology.orchestra.run.smithi107.stdout:Package python3-rbd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 is already installed. 2024-09-21T07:52:25.543 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:52:25.544 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-09-21T07:52:25.544 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:52:25.544 INFO:teuthology.orchestra.run.smithi129.stdout:Package python3-rados-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 is already installed. 2024-09-21T07:52:25.586 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:52:25.587 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-09-21T07:52:25.587 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:52:25.612 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install rbd-fuse 2024-09-21T07:52:25.665 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install python3-rgw 2024-09-21T07:52:26.195 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:52:26.237 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:35 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:52:26.326 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:52:26.327 INFO:teuthology.orchestra.run.smithi129.stdout:Package python3-rgw-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 is already installed. 2024-09-21T07:52:26.327 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:26.327 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2024-09-21T07:52:26.327 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:26.327 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-21T07:52:26.327 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 82 k 2024-09-21T07:52:26.327 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:26.327 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-21T07:52:26.327 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:26.328 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-09-21T07:52:26.328 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:26.328 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 82 k 2024-09-21T07:52:26.328 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 222 k 2024-09-21T07:52:26.328 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-21T07:52:26.369 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:52:26.370 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-09-21T07:52:26.370 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:52:26.439 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install python3-cephfs 2024-09-21T07:52:26.525 INFO:teuthology.orchestra.run.smithi107.stdout:rbd-fuse-17.2.7-1649.gfbd1a6ab.el9.x86_64.rpm 415 kB/s | 82 kB 00:00 2024-09-21T07:52:26.526 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:52:26.526 INFO:teuthology.orchestra.run.smithi107.stdout:Total 412 kB/s | 82 kB 00:00 2024-09-21T07:52:26.526 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-21T07:52:26.532 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-21T07:52:26.532 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-21T07:52:26.594 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-21T07:52:26.594 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-21T07:52:26.735 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-21T07:52:26.847 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:27.016 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:36 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:52:27.105 INFO:teuthology.orchestra.run.smithi129.stdout:Package python3-cephfs-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 is already installed. 2024-09-21T07:52:27.147 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:52:27.148 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-09-21T07:52:27.148 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:52:27.229 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install python3-rbd 2024-09-21T07:52:27.250 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:27.503 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:27.503 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:27.503 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-21T07:52:27.503 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:52:27.503 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:27.503 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:52:27.733 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install rbd-mirror 2024-09-21T07:52:27.811 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:36 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:52:27.901 INFO:teuthology.orchestra.run.smithi129.stdout:Package python3-rbd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 is already installed. 2024-09-21T07:52:27.944 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:52:27.945 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-09-21T07:52:27.945 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:52:28.022 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install rbd-fuse 2024-09-21T07:52:28.325 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:41 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:52:28.459 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:52:28.460 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:28.460 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repo Size 2024-09-21T07:52:28.460 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:28.460 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-21T07:52:28.460 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 2.9 M 2024-09-21T07:52:28.460 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:28.460 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-21T07:52:28.461 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:28.461 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-09-21T07:52:28.461 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:28.461 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 2.9 M 2024-09-21T07:52:28.461 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 12 M 2024-09-21T07:52:28.461 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-21T07:52:28.605 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:37 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:52:28.737 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:52:28.738 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:28.738 INFO:teuthology.orchestra.run.smithi129.stdout: Package Architecture Version Repository Size 2024-09-21T07:52:28.738 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:28.738 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-21T07:52:28.738 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-fuse x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 82 k 2024-09-21T07:52:28.738 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:28.738 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-21T07:52:28.738 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:28.738 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-09-21T07:52:28.739 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:28.739 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 82 k 2024-09-21T07:52:28.739 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 222 k 2024-09-21T07:52:28.739 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-21T07:52:28.820 INFO:teuthology.orchestra.run.smithi107.stdout:rbd-mirror-17.2.7-1649.gfbd1a6ab.el9.x86_64.rpm 8.2 MB/s | 2.9 MB 00:00 2024-09-21T07:52:28.821 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:52:28.821 INFO:teuthology.orchestra.run.smithi107.stdout:Total 8.1 MB/s | 2.9 MB 00:00 2024-09-21T07:52:28.822 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-21T07:52:28.830 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-21T07:52:28.830 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-21T07:52:28.909 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-21T07:52:28.909 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-21T07:52:28.924 INFO:teuthology.orchestra.run.smithi129.stdout:rbd-fuse-17.2.7-1649.gfbd1a6ab.el9.x86_64.rpm 442 kB/s | 82 kB 00:00 2024-09-21T07:52:28.924 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:52:28.924 INFO:teuthology.orchestra.run.smithi129.stdout:Total 439 kB/s | 82 kB 00:00 2024-09-21T07:52:28.925 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-21T07:52:28.931 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-21T07:52:28.931 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-21T07:52:28.993 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-21T07:52:28.994 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-21T07:52:29.136 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-21T07:52:29.229 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-fuse-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:29.329 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-21T07:52:29.388 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:29.412 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:29.412 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:52:29.412 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T07:52:29.412 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:52:29.412 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:52:29.412 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:29.578 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:29.846 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-fuse-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:29.846 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:29.846 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-21T07:52:29.846 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-fuse-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:52:29.846 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:29.846 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:52:30.072 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install rbd-mirror 2024-09-21T07:52:30.455 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:30.456 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:30.456 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-21T07:52:30.456 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:52:30.456 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:30.456 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:52:30.663 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:52:30.697 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install rbd-nbd 2024-09-21T07:52:30.802 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:52:30.803 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:30.803 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repo Size 2024-09-21T07:52:30.803 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:30.803 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-21T07:52:30.803 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-mirror x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 2.9 M 2024-09-21T07:52:30.804 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:30.804 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-21T07:52:30.804 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:30.804 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-09-21T07:52:30.804 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:30.804 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 2.9 M 2024-09-21T07:52:30.804 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 12 M 2024-09-21T07:52:30.804 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-21T07:52:31.161 INFO:teuthology.orchestra.run.smithi129.stdout:rbd-mirror-17.2.7-1649.gfbd1a6ab.el9.x86_64.rpm 8.2 MB/s | 2.9 MB 00:00 2024-09-21T07:52:31.162 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:52:31.162 INFO:teuthology.orchestra.run.smithi129.stdout:Total 8.2 MB/s | 2.9 MB 00:00 2024-09-21T07:52:31.162 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-21T07:52:31.171 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-21T07:52:31.171 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-21T07:52:31.250 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-21T07:52:31.250 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-21T07:52:31.287 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:44 ago on Sat 21 Sep 2024 07:50:47 AM UTC. 2024-09-21T07:52:31.427 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-21T07:52:31.428 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:31.428 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2024-09-21T07:52:31.428 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:31.428 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-21T07:52:31.428 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 165 k 2024-09-21T07:52:31.428 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:31.428 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-21T07:52:31.429 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-21T07:52:31.429 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-09-21T07:52:31.429 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:31.429 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 165 k 2024-09-21T07:52:31.429 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 477 k 2024-09-21T07:52:31.429 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-21T07:52:31.642 INFO:teuthology.orchestra.run.smithi107.stdout:rbd-nbd-17.2.7-1649.gfbd1a6ab.el9.x86_64.rpm 776 kB/s | 165 kB 00:00 2024-09-21T07:52:31.643 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:52:31.643 INFO:teuthology.orchestra.run.smithi107.stdout:Total 769 kB/s | 165 kB 00:00 2024-09-21T07:52:31.643 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-21T07:52:31.655 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-21T07:52:31.655 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-21T07:52:31.670 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-21T07:52:31.721 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-21T07:52:31.722 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-21T07:52:31.737 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-mirror-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:31.762 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:31.762 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:52:31.763 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T07:52:31.763 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:52:31.763 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:52:31.763 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:31.874 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-21T07:52:31.974 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:32.420 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:32.648 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:32.648 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:32.648 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-21T07:52:32.648 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:52:32.648 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:52:32.648 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-21T07:52:32.824 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-mirror-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:32.825 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:32.825 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-21T07:52:32.825 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-mirror-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:52:32.825 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:32.825 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:52:32.880 DEBUG:teuthology.parallel:result is None 2024-09-21T07:52:33.082 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install rbd-nbd 2024-09-21T07:52:33.677 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:42 ago on Sat 21 Sep 2024 07:50:51 AM UTC. 2024-09-21T07:52:33.812 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T07:52:33.813 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:33.813 INFO:teuthology.orchestra.run.smithi129.stdout: Package Architecture Version Repository Size 2024-09-21T07:52:33.813 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:33.813 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-21T07:52:33.813 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-nbd x86_64 2:17.2.7-1649.gfbd1a6ab.el9 ceph 165 k 2024-09-21T07:52:33.813 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:33.813 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-21T07:52:33.813 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-21T07:52:33.813 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-09-21T07:52:33.813 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:33.813 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 165 k 2024-09-21T07:52:33.813 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 477 k 2024-09-21T07:52:33.813 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-21T07:52:34.024 INFO:teuthology.orchestra.run.smithi129.stdout:rbd-nbd-17.2.7-1649.gfbd1a6ab.el9.x86_64.rpm 785 kB/s | 165 kB 00:00 2024-09-21T07:52:34.024 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:52:34.025 INFO:teuthology.orchestra.run.smithi129.stdout:Total 779 kB/s | 165 kB 00:00 2024-09-21T07:52:34.025 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-21T07:52:34.032 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-21T07:52:34.032 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-21T07:52:34.096 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-21T07:52:34.096 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-21T07:52:34.252 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-21T07:52:34.345 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-nbd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:34.735 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:34.991 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-nbd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 1/1 2024-09-21T07:52:34.991 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:34.991 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-21T07:52:34.991 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-nbd-2:17.2.7-1649.gfbd1a6ab.el9.x86_64 2024-09-21T07:52:34.991 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:52:34.991 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T07:52:35.228 DEBUG:teuthology.parallel:result is None 2024-09-21T07:52:35.228 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T07:52:35.228 INFO:teuthology.packaging:ref: None 2024-09-21T07:52:35.228 INFO:teuthology.packaging:tag: None 2024-09-21T07:52:35.229 INFO:teuthology.packaging:branch: quincy 2024-09-21T07:52:35.229 INFO:teuthology.packaging:sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T07:52:35.229 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-21T07:52:35.461 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T07:52:35.486 INFO:teuthology.orchestra.run.smithi107.stdout:17.2.7-1649.gfbd1a6ab.el9 2024-09-21T07:52:35.487 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1649.gfbd1a6ab.el9 2024-09-21T07:52:35.487 INFO:teuthology.task.install:The correct ceph version 17.2.7-1649.gfbd1a6ab is installed. 2024-09-21T07:52:35.489 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T07:52:35.489 INFO:teuthology.packaging:ref: None 2024-09-21T07:52:35.489 INFO:teuthology.packaging:tag: None 2024-09-21T07:52:35.489 INFO:teuthology.packaging:branch: quincy 2024-09-21T07:52:35.489 INFO:teuthology.packaging:sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T07:52:35.489 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-21T07:52:35.709 DEBUG:teuthology.orchestra.run.smithi129:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T07:52:35.731 INFO:teuthology.orchestra.run.smithi129.stdout:17.2.7-1649.gfbd1a6ab.el9 2024-09-21T07:52:35.731 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1649.gfbd1a6ab.el9 2024-09-21T07:52:35.731 INFO:teuthology.task.install:The correct ceph version 17.2.7-1649.gfbd1a6ab is installed. 2024-09-21T07:52:35.733 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T07:52:35.733 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-21T07:52:35.733 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T07:52:36.782 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T07:52:36.782 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T07:52:36.808 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T07:52:36.808 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-21T07:52:36.808 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T07:52:36.851 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T07:52:36.920 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T07:52:36.920 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T07:52:36.945 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T07:52:37.009 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T07:52:37.010 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-21T07:52:37.010 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T07:52:37.037 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T07:52:37.104 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T07:52:37.104 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T07:52:37.128 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T07:52:37.193 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T07:52:37.193 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-21T07:52:37.193 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T07:52:37.219 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T07:52:37.285 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T07:52:37.285 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T07:52:37.309 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T07:52:37.373 INFO:teuthology.run_tasks:Running task print... 2024-09-21T07:52:37.381 INFO:teuthology.task.print:**** done install task... 2024-09-21T07:52:37.382 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T07:52:37.812 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'osds down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'} 2024-09-21T07:52:37.812 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-09-21T07:52:37.812 INFO:tasks.cephadm:Cluster fsid is 786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T07:52:37.812 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T07:52:37.812 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-21T07:52:37.813 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi107': '172.21.15.107', 'mon.smithi129': '172.21.15.129'} 2024-09-21T07:52:37.813 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T07:52:37.813 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname $(hostname -s) 2024-09-21T07:52:37.843 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname $(hostname -s) 2024-09-21T07:52:37.868 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-09-21T07:52:37.869 DEBUG:teuthology.orchestra.run.smithi107:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T07:52:38.102 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 21 07:52 /home/ubuntu/cephtest/cephadm 2024-09-21T07:52:38.103 DEBUG:teuthology.orchestra.run.smithi129:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T07:52:38.227 INFO:teuthology.orchestra.run.smithi129.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 21 07:52 /home/ubuntu/cephtest/cephadm 2024-09-21T07:52:38.227 DEBUG:teuthology.orchestra.run.smithi107:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T07:52:38.247 DEBUG:teuthology.orchestra.run.smithi129:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T07:52:38.271 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-09-21T07:52:38.271 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-21T07:52:38.290 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-21T07:52:39.806 INFO:teuthology.orchestra.run.smithi107.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-21T07:52:39.856 INFO:teuthology.orchestra.run.smithi129.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-21T07:53:09.713 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-21T07:53:09.713 INFO:teuthology.orchestra.run.smithi129.stdout: "ceph_version": "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)", 2024-09-21T07:53:09.713 INFO:teuthology.orchestra.run.smithi129.stdout: "image_id": "fc3ec4a4f6be575045de0fd8a2fe84939e888152c447bdedb90add7841f7bef9", 2024-09-21T07:53:09.713 INFO:teuthology.orchestra.run.smithi129.stdout: "repo_digests": [ 2024-09-21T07:53:09.713 INFO:teuthology.orchestra.run.smithi129.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2" 2024-09-21T07:53:09.713 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-21T07:53:09.713 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-21T07:53:12.038 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T07:53:12.038 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_version": "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)", 2024-09-21T07:53:12.038 INFO:teuthology.orchestra.run.smithi107.stdout: "image_id": "fc3ec4a4f6be575045de0fd8a2fe84939e888152c447bdedb90add7841f7bef9", 2024-09-21T07:53:12.038 INFO:teuthology.orchestra.run.smithi107.stdout: "repo_digests": [ 2024-09-21T07:53:12.038 INFO:teuthology.orchestra.run.smithi107.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2" 2024-09-21T07:53:12.038 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-21T07:53:12.038 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T07:53:12.057 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph 2024-09-21T07:53:12.120 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /etc/ceph 2024-09-21T07:53:12.153 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /etc/ceph 2024-09-21T07:53:12.177 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 777 /etc/ceph 2024-09-21T07:53:12.221 INFO:tasks.cephadm:Writing seed config... 2024-09-21T07:53:13.908 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-21T07:53:13.908 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-21T07:53:13.908 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-21T07:53:13.908 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-21T07:53:13.908 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-21T07:53:13.908 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T07:53:13.908 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T07:53:13.909 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-21T07:53:13.909 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-21T07:53:13.909 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T07:53:13.909 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T07:53:13.909 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-21T07:53:13.909 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T07:53:13.909 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T07:53:13.909 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T07:53:13.909 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T07:53:13.909 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T07:53:13.909 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-21T07:53:13.909 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-21T07:53:13.909 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-21T07:53:13.909 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-21T07:53:13.910 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-21T07:53:13.910 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-21T07:53:13.910 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-21T07:53:13.910 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-21T07:53:13.910 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-21T07:53:13.910 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-21T07:53:13.910 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-21T07:53:13.910 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-21T07:53:13.910 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-21T07:53:13.910 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-21T07:53:13.910 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-21T07:53:13.910 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-21T07:53:13.910 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-21T07:53:13.910 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-21T07:53:13.910 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T07:53:13.911 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T07:53:13.911 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T07:53:13.911 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T07:53:13.911 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T07:53:13.911 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T07:53:13.911 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-21T07:53:13.911 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-21T07:53:13.912 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-21T07:53:13.912 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T07:53:13.931 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 786d4f32-77ee-11ef-baf6-efdc52797490 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-21T07:53:13.931 DEBUG:teuthology.orchestra.run.smithi107:mon.smithi107> sudo journalctl -f -n 0 -u ceph-786d4f32-77ee-11ef-baf6-efdc52797490@mon.smithi107.service 2024-09-21T07:53:13.974 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T07:53:13.974 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.107 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:53:14.181 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:53:14.182 INFO:teuthology.orchestra.run.smithi107.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '786d4f32-77ee-11ef-baf6-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.107', '--skip-admin-label'] 2024-09-21T07:53:14.206 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stdout 5.2.2 2024-09-21T07:53:14.206 INFO:teuthology.orchestra.run.smithi107.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T07:53:14.206 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying podman|docker is present... 2024-09-21T07:53:14.228 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stdout 5.2.2 2024-09-21T07:53:14.229 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying lvm2 is present... 2024-09-21T07:53:14.229 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying time synchronization is in place... 2024-09-21T07:53:14.236 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T07:53:14.237 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T07:53:14.243 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T07:53:14.243 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout inactive 2024-09-21T07:53:14.250 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout enabled 2024-09-21T07:53:14.256 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout active 2024-09-21T07:53:14.257 INFO:teuthology.orchestra.run.smithi107.stdout:Unit chronyd.service is enabled and running 2024-09-21T07:53:14.257 INFO:teuthology.orchestra.run.smithi107.stdout:Repeating the final host check... 2024-09-21T07:53:14.279 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stdout 5.2.2 2024-09-21T07:53:14.279 INFO:teuthology.orchestra.run.smithi107.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T07:53:14.279 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl is present 2024-09-21T07:53:14.279 INFO:teuthology.orchestra.run.smithi107.stdout:lvcreate is present 2024-09-21T07:53:14.286 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T07:53:14.286 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T07:53:14.292 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T07:53:14.292 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout inactive 2024-09-21T07:53:14.299 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout enabled 2024-09-21T07:53:14.306 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout active 2024-09-21T07:53:14.306 INFO:teuthology.orchestra.run.smithi107.stdout:Unit chronyd.service is enabled and running 2024-09-21T07:53:14.306 INFO:teuthology.orchestra.run.smithi107.stdout:Host looks OK 2024-09-21T07:53:14.306 INFO:teuthology.orchestra.run.smithi107.stdout:Cluster fsid: 786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T07:53:14.306 INFO:teuthology.orchestra.run.smithi107.stdout:Acquiring lock 140177467842912 on /run/cephadm/786d4f32-77ee-11ef-baf6-efdc52797490.lock 2024-09-21T07:53:14.307 INFO:teuthology.orchestra.run.smithi107.stdout:Lock 140177467842912 acquired on /run/cephadm/786d4f32-77ee-11ef-baf6-efdc52797490.lock 2024-09-21T07:53:14.307 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying IP 172.21.15.107 port 3300 ... 2024-09-21T07:53:14.307 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying IP 172.21.15.107 port 6789 ... 2024-09-21T07:53:14.307 INFO:teuthology.orchestra.run.smithi107.stdout:Base mon IP(s) is [172.21.15.107:3300, 172.21.15.107:6789], mon addrv is [v2:172.21.15.107:3300,v1:172.21.15.107:6789] 2024-09-21T07:53:14.311 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.107 metric 100 2024-09-21T07:53:14.311 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.107 metric 100 2024-09-21T07:53:14.314 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T07:53:14.314 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-21T07:53:14.314 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-21T07:53:14.316 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T07:53:14.316 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T07:53:14.317 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T07:53:14.317 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-21T07:53:14.317 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link noprefixroute 2024-09-21T07:53:14.317 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T07:53:14.317 INFO:teuthology.orchestra.run.smithi107.stdout:Mon IP `172.21.15.107` is in CIDR network `172.21.0.0/20` 2024-09-21T07:53:14.317 INFO:teuthology.orchestra.run.smithi107.stdout:Mon IP `172.21.15.107` is in CIDR network `172.21.0.0/20` 2024-09-21T07:53:14.318 INFO:teuthology.orchestra.run.smithi107.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T07:53:14.318 INFO:teuthology.orchestra.run.smithi107.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T07:53:14.318 INFO:teuthology.orchestra.run.smithi107.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-21T07:53:14.913 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stdout fc3ec4a4f6be575045de0fd8a2fe84939e888152c447bdedb90add7841f7bef9 2024-09-21T07:53:14.913 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-21T07:53:14.913 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T07:53:14.913 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stderr Copying blob sha256:3ba00a516579693832719224d909a7cd5333511394d4f35f95e899e50f0bfaeb 2024-09-21T07:53:14.913 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T07:53:14.913 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stderr Copying config sha256:fc3ec4a4f6be575045de0fd8a2fe84939e888152c447bdedb90add7841f7bef9 2024-09-21T07:53:14.913 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T07:53:15.808 INFO:teuthology.orchestra.run.smithi107.stdout:ceph: stdout ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable) 2024-09-21T07:53:15.808 INFO:teuthology.orchestra.run.smithi107.stdout:Ceph version: ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable) 2024-09-21T07:53:15.809 INFO:teuthology.orchestra.run.smithi107.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T07:53:16.597 INFO:teuthology.orchestra.run.smithi107.stdout:stat: stdout 167 167 2024-09-21T07:53:16.597 INFO:teuthology.orchestra.run.smithi107.stdout:Creating initial keys... 2024-09-21T07:53:17.591 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph-authtool: stdout AQBse+5mUJWkNxAAPyBxaLokOX0Fk4ttfwTKJw== 2024-09-21T07:53:18.507 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph-authtool: stdout AQBte+5mgUL8NhAAVn2MQvbZec1WhLi+xoFtVw== 2024-09-21T07:53:19.371 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph-authtool: stdout AQBue+5m//1XLxAAvgIurChOnbyyw895xWSjoA== 2024-09-21T07:53:19.371 INFO:teuthology.orchestra.run.smithi107.stdout:Creating initial monmap... 2024-09-21T07:53:20.310 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T07:53:20.310 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-09-21T07:53:20.310 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T07:53:20.310 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T07:53:20.310 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool for smithi107 [v2:172.21.15.107:3300,v1:172.21.15.107:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T07:53:20.310 INFO:teuthology.orchestra.run.smithi107.stdout:setting min_mon_release = octopus 2024-09-21T07:53:20.311 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/monmaptool: set fsid to 786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T07:53:20.311 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T07:53:20.311 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:53:20.311 INFO:teuthology.orchestra.run.smithi107.stdout:Creating mon... 2024-09-21T07:53:21.181 INFO:teuthology.orchestra.run.smithi107.stdout:create mon.smithi107 on 2024-09-21T07:53:21.396 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T07:53:21.536 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T07:53:21.683 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-786d4f32-77ee-11ef-baf6-efdc52797490.target → /etc/systemd/system/ceph-786d4f32-77ee-11ef-baf6-efdc52797490.target. 2024-09-21T07:53:21.683 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-786d4f32-77ee-11ef-baf6-efdc52797490.target → /etc/systemd/system/ceph-786d4f32-77ee-11ef-baf6-efdc52797490.target. 2024-09-21T07:53:21.850 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-786d4f32-77ee-11ef-baf6-efdc52797490@mon.smithi107 2024-09-21T07:53:21.850 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Failed to reset failed state of unit ceph-786d4f32-77ee-11ef-baf6-efdc52797490@mon.smithi107.service: Unit ceph-786d4f32-77ee-11ef-baf6-efdc52797490@mon.smithi107.service not loaded. 2024-09-21T07:53:22.085 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-786d4f32-77ee-11ef-baf6-efdc52797490.target.wants/ceph-786d4f32-77ee-11ef-baf6-efdc52797490@mon.smithi107.service → /etc/systemd/system/ceph-786d4f32-77ee-11ef-baf6-efdc52797490@.service. 2024-09-21T07:53:25.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:25 smithi107 ceph-mon[27256]: mon.smithi107 is new leader, mons smithi107 in quorum (ranks 0) 2024-09-21T07:53:26.257 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:53:26.257 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout disabled 2024-09-21T07:53:26.266 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:53:26.266 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout inactive 2024-09-21T07:53:26.266 INFO:teuthology.orchestra.run.smithi107.stdout:firewalld.service is not enabled 2024-09-21T07:53:26.266 INFO:teuthology.orchestra.run.smithi107.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T07:53:26.267 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for mon to start... 2024-09-21T07:53:26.267 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for mon... 2024-09-21T07:53:26.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:26 smithi107 bash[27226]: bd96219fab9f9a892e5658f3fc50116abe7af999ab6c0ae919b96b7b5aac16da 2024-09-21T07:53:26.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:26 smithi107 systemd[1]: Started Ceph mon.smithi107 for 786d4f32-77ee-11ef-baf6-efdc52797490. 2024-09-21T07:53:26.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:26 smithi107 ceph-mon[27256]: mon.smithi107 is new leader, mons smithi107 in quorum (ranks 0) 2024-09-21T07:53:26.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:26 smithi107 ceph-mon[27256]: monmap e1: 1 mons at {smithi107=[v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-21T07:53:26.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:26 smithi107 ceph-mon[27256]: fsmap 2024-09-21T07:53:26.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:26 smithi107 ceph-mon[27256]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T07:53:26.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:26 smithi107 ceph-mon[27256]: mgrmap e1: no daemons active 2024-09-21T07:53:29.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:29 smithi107 ceph-mon[27256]: from='client.? 172.21.15.107:0/2927407796' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-21T07:53:34.594 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T07:53:34.594 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout id: 786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T07:53:34.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T07:53:34.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-09-21T07:53:34.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout services: 2024-09-21T07:53:34.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi107 (age 4s) 2024-09-21T07:53:34.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T07:53:34.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T07:53:34.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-09-21T07:53:34.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout data: 2024-09-21T07:53:34.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T07:53:34.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T07:53:34.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T07:53:34.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T07:53:34.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-09-21T07:53:34.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.339+0000 7f3428d70640 1 Processor -- start 2024-09-21T07:53:34.596 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.339+0000 7f3428d70640 1 -- start start 2024-09-21T07:53:34.596 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.339+0000 7f3428d70640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3424102070 0x7f3424102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.596 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.339+0000 7f3428d70640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34241029c0 con 0x7f3424102070 2024-09-21T07:53:34.596 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.340+0000 7f342259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3424102070 0x7f3424102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.596 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.340+0000 7f342259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3424102070 0x7f3424102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37628/0 (socket says 172.21.15.107:37628) 2024-09-21T07:53:34.596 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.340+0000 7f342259c640 1 -- 172.21.15.107:0/3899698201 learned_addr learned my addr 172.21.15.107:0/3899698201 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:34.596 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.340+0000 7f342259c640 1 -- 172.21.15.107:0/3899698201 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3424102b00 con 0x7f3424102070 2024-09-21T07:53:34.596 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.342+0000 7f342259c640 1 --2- 172.21.15.107:0/3899698201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3424102070 0x7f3424102480 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3414009840 tx=0x7f34140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef972eb69e9eac26 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:34.596 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.342+0000 7f3421d9b640 1 -- 172.21.15.107:0/3899698201 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3414032440 con 0x7f3424102070 2024-09-21T07:53:34.596 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.342+0000 7f3421d9b640 1 -- 172.21.15.107:0/3899698201 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34140325a0 con 0x7f3424102070 2024-09-21T07:53:34.596 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.342+0000 7f3421d9b640 1 -- 172.21.15.107:0/3899698201 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3414032890 con 0x7f3424102070 2024-09-21T07:53:34.596 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.343+0000 7f3428d70640 1 -- 172.21.15.107:0/3899698201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3424102070 msgr2=0x7f3424102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:34.596 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.343+0000 7f3428d70640 1 --2- 172.21.15.107:0/3899698201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3424102070 0x7f3424102480 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3414009840 tx=0x7f34140091d0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.596 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.343+0000 7f3428d70640 1 -- 172.21.15.107:0/3899698201 shutdown_connections 2024-09-21T07:53:34.597 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.343+0000 7f3428d70640 1 --2- 172.21.15.107:0/3899698201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3424102070 0x7f3424102480 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.597 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.343+0000 7f3428d70640 1 -- 172.21.15.107:0/3899698201 >> 172.21.15.107:0/3899698201 conn(0x7f34240fd850 msgr2=0x7f34240ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:34.597 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.343+0000 7f3428d70640 1 -- 172.21.15.107:0/3899698201 shutdown_connections 2024-09-21T07:53:34.597 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.343+0000 7f3428d70640 1 -- 172.21.15.107:0/3899698201 wait complete. 2024-09-21T07:53:34.597 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.343+0000 7f3428d70640 1 Processor -- start 2024-09-21T07:53:34.597 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.343+0000 7f3428d70640 1 -- start start 2024-09-21T07:53:34.597 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.344+0000 7f3428d70640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3424102070 0x7f3424110540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.597 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.344+0000 7f3428d70640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3424110a80 con 0x7f3424102070 2024-09-21T07:53:34.597 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.344+0000 7f342259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3424102070 0x7f3424110540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.597 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.344+0000 7f342259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3424102070 0x7f3424110540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37638/0 (socket says 172.21.15.107:37638) 2024-09-21T07:53:34.597 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.344+0000 7f342259c640 1 -- 172.21.15.107:0/2927407796 learned_addr learned my addr 172.21.15.107:0/2927407796 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:34.597 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.344+0000 7f342259c640 1 -- 172.21.15.107:0/2927407796 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3414009450 con 0x7f3424102070 2024-09-21T07:53:34.597 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.344+0000 7f342259c640 1 --2- 172.21.15.107:0/2927407796 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3424102070 0x7f3424110540 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f341402a790 tx=0x7f3414032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:34.597 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.344+0000 7f341affd640 1 -- 172.21.15.107:0/2927407796 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3414031be0 con 0x7f3424102070 2024-09-21T07:53:34.598 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.344+0000 7f341affd640 1 -- 172.21.15.107:0/2927407796 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3414031d40 con 0x7f3424102070 2024-09-21T07:53:34.598 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.344+0000 7f3428d70640 1 -- 172.21.15.107:0/2927407796 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3424110c80 con 0x7f3424102070 2024-09-21T07:53:34.598 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.344+0000 7f341affd640 1 -- 172.21.15.107:0/2927407796 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f341403b5a0 con 0x7f3424102070 2024-09-21T07:53:34.598 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.345+0000 7f3428d70640 1 -- 172.21.15.107:0/2927407796 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3424111090 con 0x7f3424102070 2024-09-21T07:53:34.598 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.345+0000 7f341affd640 1 -- 172.21.15.107:0/2927407796 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f3414039040 con 0x7f3424102070 2024-09-21T07:53:34.598 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.345+0000 7f341affd640 1 -- 172.21.15.107:0/2927407796 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3414041030 con 0x7f3424102070 2024-09-21T07:53:34.598 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.345+0000 7f3428d70640 1 -- 172.21.15.107:0/2927407796 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342404b720 con 0x7f3424102070 2024-09-21T07:53:34.598 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.348+0000 7f341affd640 1 -- 172.21.15.107:0/2927407796 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f341402ae60 con 0x7f3424102070 2024-09-21T07:53:34.598 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.406+0000 7f3428d70640 1 -- 172.21.15.107:0/2927407796 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f3424109d00 con 0x7f3424102070 2024-09-21T07:53:34.598 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.407+0000 7f341affd640 1 -- 172.21.15.107:0/2927407796 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+318 (secure 0 0 0) 0x7f3414037070 con 0x7f3424102070 2024-09-21T07:53:34.598 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.407+0000 7f3428d70640 1 -- 172.21.15.107:0/2927407796 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3424102070 msgr2=0x7f3424110540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:34.598 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.407+0000 7f3428d70640 1 --2- 172.21.15.107:0/2927407796 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3424102070 0x7f3424110540 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f341402a790 tx=0x7f3414032000 comp rx=0 tx=0).stop 2024-09-21T07:53:34.598 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.407+0000 7f3428d70640 1 -- 172.21.15.107:0/2927407796 shutdown_connections 2024-09-21T07:53:34.598 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.407+0000 7f3428d70640 1 --2- 172.21.15.107:0/2927407796 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3424102070 0x7f3424110540 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.599 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.407+0000 7f3428d70640 1 -- 172.21.15.107:0/2927407796 >> 172.21.15.107:0/2927407796 conn(0x7f34240fd850 msgr2=0x7f3424107460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:34.599 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.407+0000 7f3428d70640 1 -- 172.21.15.107:0/2927407796 shutdown_connections 2024-09-21T07:53:34.599 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:29.407+0000 7f3428d70640 1 -- 172.21.15.107:0/2927407796 wait complete. 2024-09-21T07:53:34.599 INFO:teuthology.orchestra.run.smithi107.stdout:mon is available 2024-09-21T07:53:34.599 INFO:teuthology.orchestra.run.smithi107.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T07:53:35.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:35 smithi107 ceph-mon[27256]: from='client.? 172.21.15.107:0/761740310' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-21T07:53:35.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:35 smithi107 ceph-mon[27256]: from='client.? 172.21.15.107:0/761740310' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T07:53:35.700 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-09-21T07:53:35.700 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T07:53:35.700 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout fsid = 786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T07:53:35.700 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T07:53:35.700 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.107:3300,v1:172.21.15.107:6789] 2024-09-21T07:53:35.700 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T07:53:35.700 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T07:53:35.700 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T07:53:35.700 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T07:53:35.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-09-21T07:53:35.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T07:53:35.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T07:53:35.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-09-21T07:53:35.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T07:53:35.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T07:53:35.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T07:53:35.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T07:53:35.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T07:53:35.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T07:53:35.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.007+0000 7fa5ff4a1640 1 Processor -- start 2024-09-21T07:53:35.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.007+0000 7fa5ff4a1640 1 -- start start 2024-09-21T07:53:35.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.007+0000 7fa5ff4a1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5f8102430 0x7fa5f8102840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:35.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.007+0000 7fa5ff4a1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f8102d80 con 0x7fa5f8102430 2024-09-21T07:53:35.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.007+0000 7fa5fd23d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5f8102430 0x7fa5f8102840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:35.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.007+0000 7fa5fd23d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5f8102430 0x7fa5f8102840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59084/0 (socket says 172.21.15.107:59084) 2024-09-21T07:53:35.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.007+0000 7fa5fd23d640 1 -- 172.21.15.107:0/1847987383 learned_addr learned my addr 172.21.15.107:0/1847987383 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:35.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.008+0000 7fa5fd23d640 1 -- 172.21.15.107:0/1847987383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f8102ec0 con 0x7fa5f8102430 2024-09-21T07:53:35.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.008+0000 7fa5fd23d640 1 --2- 172.21.15.107:0/1847987383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5f8102430 0x7fa5f8102840 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4009840 tx=0x7fa5f40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ddc4cfa5d13d6c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:35.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.008+0000 7fa5effff640 1 -- 172.21.15.107:0/1847987383 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5f4032440 con 0x7fa5f8102430 2024-09-21T07:53:35.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.009+0000 7fa5effff640 1 -- 172.21.15.107:0/1847987383 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f40325a0 con 0x7fa5f8102430 2024-09-21T07:53:35.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.009+0000 7fa5effff640 1 -- 172.21.15.107:0/1847987383 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5f40328d0 con 0x7fa5f8102430 2024-09-21T07:53:35.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.009+0000 7fa5ff4a1640 1 -- 172.21.15.107:0/1847987383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5f8102430 msgr2=0x7fa5f8102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:35.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.009+0000 7fa5ff4a1640 1 --2- 172.21.15.107:0/1847987383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5f8102430 0x7fa5f8102840 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4009840 tx=0x7fa5f40091d0 comp rx=0 tx=0).stop 2024-09-21T07:53:35.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.009+0000 7fa5ff4a1640 1 -- 172.21.15.107:0/1847987383 shutdown_connections 2024-09-21T07:53:35.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.009+0000 7fa5ff4a1640 1 --2- 172.21.15.107:0/1847987383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5f8102430 0x7fa5f8102840 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:35.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.009+0000 7fa5ff4a1640 1 -- 172.21.15.107:0/1847987383 >> 172.21.15.107:0/1847987383 conn(0x7fa5f80fbdd0 msgr2=0x7fa5f80fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:35.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.009+0000 7fa5ff4a1640 1 -- 172.21.15.107:0/1847987383 shutdown_connections 2024-09-21T07:53:35.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.009+0000 7fa5ff4a1640 1 -- 172.21.15.107:0/1847987383 wait complete. 2024-09-21T07:53:35.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.010+0000 7fa5ff4a1640 1 Processor -- start 2024-09-21T07:53:35.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.010+0000 7fa5ff4a1640 1 -- start start 2024-09-21T07:53:35.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.010+0000 7fa5ff4a1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5f8102430 0x7fa5f8104ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:35.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.010+0000 7fa5ff4a1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f8105530 con 0x7fa5f8102430 2024-09-21T07:53:35.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.010+0000 7fa5fd23d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5f8102430 0x7fa5f8104ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:35.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.010+0000 7fa5fd23d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5f8102430 0x7fa5f8104ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59100/0 (socket says 172.21.15.107:59100) 2024-09-21T07:53:35.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.010+0000 7fa5fd23d640 1 -- 172.21.15.107:0/761740310 learned_addr learned my addr 172.21.15.107:0/761740310 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:35.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.010+0000 7fa5fd23d640 1 -- 172.21.15.107:0/761740310 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f4009450 con 0x7fa5f8102430 2024-09-21T07:53:35.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.011+0000 7fa5fd23d640 1 --2- 172.21.15.107:0/761740310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5f8102430 0x7fa5f8104ff0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fa5f402a700 tx=0x7fa5f4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:35.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.011+0000 7fa5edffb640 1 -- 172.21.15.107:0/761740310 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5f4031be0 con 0x7fa5f8102430 2024-09-21T07:53:35.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.011+0000 7fa5edffb640 1 -- 172.21.15.107:0/761740310 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f4031d40 con 0x7fa5f8102430 2024-09-21T07:53:35.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.011+0000 7fa5edffb640 1 -- 172.21.15.107:0/761740310 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5f403b5a0 con 0x7fa5f8102430 2024-09-21T07:53:35.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.011+0000 7fa5ff4a1640 1 -- 172.21.15.107:0/761740310 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f81035c0 con 0x7fa5f8102430 2024-09-21T07:53:35.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.011+0000 7fa5ff4a1640 1 -- 172.21.15.107:0/761740310 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f81039d0 con 0x7fa5f8102430 2024-09-21T07:53:35.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.011+0000 7fa5edffb640 1 -- 172.21.15.107:0/761740310 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fa5f4039040 con 0x7fa5f8102430 2024-09-21T07:53:35.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.011+0000 7fa5edffb640 1 -- 172.21.15.107:0/761740310 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa5f4041030 con 0x7fa5f8102430 2024-09-21T07:53:35.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.012+0000 7fa5ff4a1640 1 -- 172.21.15.107:0/761740310 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f804b720 con 0x7fa5f8102430 2024-09-21T07:53:35.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.014+0000 7fa5edffb640 1 -- 172.21.15.107:0/761740310 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fa5f4037070 con 0x7fa5f8102430 2024-09-21T07:53:35.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.069+0000 7fa5ff4a1640 1 -- 172.21.15.107:0/761740310 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fa5f81043d0 con 0x7fa5f8102430 2024-09-21T07:53:35.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.073+0000 7fa5edffb640 1 -- 172.21.15.107:0/761740310 <== mon.0 v2:172.21.15.107:3300/0 7 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa5f4046cd0 con 0x7fa5f8102430 2024-09-21T07:53:35.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.073+0000 7fa5edffb640 1 -- 172.21.15.107:0/761740310 <== mon.0 v2:172.21.15.107:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+467 (secure 0 0 0) 0x7fa5f404ebd0 con 0x7fa5f8102430 2024-09-21T07:53:35.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.074+0000 7fa5ff4a1640 1 -- 172.21.15.107:0/761740310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5f8102430 msgr2=0x7fa5f8104ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:35.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.074+0000 7fa5ff4a1640 1 --2- 172.21.15.107:0/761740310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5f8102430 0x7fa5f8104ff0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fa5f402a700 tx=0x7fa5f4032000 comp rx=0 tx=0).stop 2024-09-21T07:53:35.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.074+0000 7fa5ff4a1640 1 -- 172.21.15.107:0/761740310 shutdown_connections 2024-09-21T07:53:35.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.074+0000 7fa5ff4a1640 1 --2- 172.21.15.107:0/761740310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5f8102430 0x7fa5f8104ff0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:35.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.074+0000 7fa5ff4a1640 1 -- 172.21.15.107:0/761740310 >> 172.21.15.107:0/761740310 conn(0x7fa5f80fbdd0 msgr2=0x7fa5f8100560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:35.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.074+0000 7fa5ff4a1640 1 -- 172.21.15.107:0/761740310 shutdown_connections 2024-09-21T07:53:35.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:35.074+0000 7fa5ff4a1640 1 -- 172.21.15.107:0/761740310 wait complete. 2024-09-21T07:53:35.704 INFO:teuthology.orchestra.run.smithi107.stdout:Generating new minimal ceph.conf... 2024-09-21T07:53:36.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:36 smithi107 ceph-mon[27256]: from='client.? 172.21.15.107:0/1066827606' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:53:36.671 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.083+0000 7fdfe433e640 1 Processor -- start 2024-09-21T07:53:36.671 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.083+0000 7fdfe433e640 1 -- start start 2024-09-21T07:53:36.671 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.084+0000 7fdfe433e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfdc102090 0x7fdfdc1024a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:36.671 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.084+0000 7fdfe433e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc1029e0 con 0x7fdfdc102090 2024-09-21T07:53:36.671 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.084+0000 7fdfe20da640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfdc102090 0x7fdfdc1024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:36.671 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.084+0000 7fdfe20da640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfdc102090 0x7fdfdc1024a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59114/0 (socket says 172.21.15.107:59114) 2024-09-21T07:53:36.671 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.084+0000 7fdfe20da640 1 -- 172.21.15.107:0/4128130155 learned_addr learned my addr 172.21.15.107:0/4128130155 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:36.671 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.084+0000 7fdfe20da640 1 -- 172.21.15.107:0/4128130155 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc102b20 con 0x7fdfdc102090 2024-09-21T07:53:36.671 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.085+0000 7fdfe20da640 1 --2- 172.21.15.107:0/4128130155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfdc102090 0x7fdfdc1024a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009840 tx=0x7fdfd40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc22c992cf5dd36 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:36.671 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.085+0000 7fdfe10d8640 1 -- 172.21.15.107:0/4128130155 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdfd4032440 con 0x7fdfdc102090 2024-09-21T07:53:36.672 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.085+0000 7fdfe10d8640 1 -- 172.21.15.107:0/4128130155 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fdfd4032a00 con 0x7fdfdc102090 2024-09-21T07:53:36.672 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.085+0000 7fdfe10d8640 1 -- 172.21.15.107:0/4128130155 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdfd4031a10 con 0x7fdfdc102090 2024-09-21T07:53:36.672 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.085+0000 7fdfe433e640 1 -- 172.21.15.107:0/4128130155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfdc102090 msgr2=0x7fdfdc1024a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:36.672 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.085+0000 7fdfe433e640 1 --2- 172.21.15.107:0/4128130155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfdc102090 0x7fdfdc1024a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009840 tx=0x7fdfd40091d0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.672 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.086+0000 7fdfe433e640 1 -- 172.21.15.107:0/4128130155 shutdown_connections 2024-09-21T07:53:36.672 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.086+0000 7fdfe433e640 1 --2- 172.21.15.107:0/4128130155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfdc102090 0x7fdfdc1024a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.672 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.086+0000 7fdfe433e640 1 -- 172.21.15.107:0/4128130155 >> 172.21.15.107:0/4128130155 conn(0x7fdfdc0fd850 msgr2=0x7fdfdc0ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:36.672 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.086+0000 7fdfe433e640 1 -- 172.21.15.107:0/4128130155 shutdown_connections 2024-09-21T07:53:36.672 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.086+0000 7fdfe433e640 1 -- 172.21.15.107:0/4128130155 wait complete. 2024-09-21T07:53:36.672 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.086+0000 7fdfe433e640 1 Processor -- start 2024-09-21T07:53:36.672 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.086+0000 7fdfe433e640 1 -- start start 2024-09-21T07:53:36.672 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.086+0000 7fdfe433e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfdc102090 0x7fdfdc110dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:36.672 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.086+0000 7fdfe433e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc111310 con 0x7fdfdc102090 2024-09-21T07:53:36.672 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.086+0000 7fdfe20da640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfdc102090 0x7fdfdc110dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:36.673 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.086+0000 7fdfe20da640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfdc102090 0x7fdfdc110dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59118/0 (socket says 172.21.15.107:59118) 2024-09-21T07:53:36.673 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.086+0000 7fdfe20da640 1 -- 172.21.15.107:0/1066827606 learned_addr learned my addr 172.21.15.107:0/1066827606 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:36.673 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.087+0000 7fdfe20da640 1 -- 172.21.15.107:0/1066827606 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd4009450 con 0x7fdfdc102090 2024-09-21T07:53:36.673 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.087+0000 7fdfe20da640 1 --2- 172.21.15.107:0/1066827606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfdc102090 0x7fdfdc110dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4006a70 tx=0x7fdfd402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:36.673 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.087+0000 7fdfd2ffd640 1 -- 172.21.15.107:0/1066827606 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdfd4031d10 con 0x7fdfdc102090 2024-09-21T07:53:36.673 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.087+0000 7fdfd2ffd640 1 -- 172.21.15.107:0/1066827606 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fdfd4031e70 con 0x7fdfdc102090 2024-09-21T07:53:36.673 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.087+0000 7fdfe433e640 1 -- 172.21.15.107:0/1066827606 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfdc111510 con 0x7fdfdc102090 2024-09-21T07:53:36.673 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.087+0000 7fdfd2ffd640 1 -- 172.21.15.107:0/1066827606 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdfd403b6f0 con 0x7fdfdc102090 2024-09-21T07:53:36.673 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.087+0000 7fdfe433e640 1 -- 172.21.15.107:0/1066827606 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfdc111f60 con 0x7fdfdc102090 2024-09-21T07:53:36.673 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.087+0000 7fdfd2ffd640 1 -- 172.21.15.107:0/1066827606 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fdfd4039070 con 0x7fdfdc102090 2024-09-21T07:53:36.673 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.087+0000 7fdfd2ffd640 1 -- 172.21.15.107:0/1066827606 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fdfd40477b0 con 0x7fdfdc102090 2024-09-21T07:53:36.673 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.088+0000 7fdfe433e640 1 -- 172.21.15.107:0/1066827606 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfdc1014f0 con 0x7fdfdc102090 2024-09-21T07:53:36.673 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.090+0000 7fdfd2ffd640 1 -- 172.21.15.107:0/1066827606 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fdfd4037070 con 0x7fdfdc102090 2024-09-21T07:53:36.673 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.145+0000 7fdfe433e640 1 -- 172.21.15.107:0/1066827606 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fdfdc103d10 con 0x7fdfdc102090 2024-09-21T07:53:36.673 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.145+0000 7fdfd2ffd640 1 -- 172.21.15.107:0/1066827606 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7fdfd403dad0 con 0x7fdfdc102090 2024-09-21T07:53:36.674 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.146+0000 7fdfe433e640 1 -- 172.21.15.107:0/1066827606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfdc102090 msgr2=0x7fdfdc110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:36.674 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.146+0000 7fdfe433e640 1 --2- 172.21.15.107:0/1066827606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfdc102090 0x7fdfdc110dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4006a70 tx=0x7fdfd402c040 comp rx=0 tx=0).stop 2024-09-21T07:53:36.674 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.146+0000 7fdfe433e640 1 -- 172.21.15.107:0/1066827606 shutdown_connections 2024-09-21T07:53:36.674 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.146+0000 7fdfe433e640 1 --2- 172.21.15.107:0/1066827606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfdc102090 0x7fdfdc110dd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.674 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.146+0000 7fdfe433e640 1 -- 172.21.15.107:0/1066827606 >> 172.21.15.107:0/1066827606 conn(0x7fdfdc0fd850 msgr2=0x7fdfdc0fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:36.674 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.146+0000 7fdfe433e640 1 -- 172.21.15.107:0/1066827606 shutdown_connections 2024-09-21T07:53:36.674 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:36.146+0000 7fdfe433e640 1 -- 172.21.15.107:0/1066827606 wait complete. 2024-09-21T07:53:36.674 INFO:teuthology.orchestra.run.smithi107.stdout:Restarting the monitor... 2024-09-21T07:53:36.926 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:36 smithi107 systemd[1]: Stopping Ceph mon.smithi107 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T07:53:37.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:36 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107[27252]: 2024-09-21T07:53:36.924+0000 7fdb517ee640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi107 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:53:37.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:36 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107[27252]: 2024-09-21T07:53:36.924+0000 7fdb517ee640 -1 mon.smithi107@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T07:53:37.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:37 smithi107 podman[27498]: 2024-09-21 07:53:37.160557716 +0000 UTC m=+0.321838259 container died bd96219fab9f9a892e5658f3fc50116abe7af999ab6c0ae919b96b7b5aac16da (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-fbd1a6a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2) 2024-09-21T07:53:37.794 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:37 smithi107 podman[27498]: 2024-09-21 07:53:37.49920609 +0000 UTC m=+0.660486632 container cleanup bd96219fab9f9a892e5658f3fc50116abe7af999ab6c0ae919b96b7b5aac16da (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107, GIT_BRANCH=HEAD, RELEASE=quincy-fbd1a6a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T07:53:37.794 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:37 smithi107 bash[27498]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107 2024-09-21T07:53:37.794 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:37 smithi107 podman[27511]: 2024-09-21 07:53:37.674937136 +0000 UTC m=+0.512175053 container remove bd96219fab9f9a892e5658f3fc50116abe7af999ab6c0ae919b96b7b5aac16da (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=quincy-fbd1a6a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T07:53:38.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:37 smithi107 systemd[1]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490@mon.smithi107.service: Deactivated successfully. 2024-09-21T07:53:38.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:37 smithi107 systemd[1]: Stopped Ceph mon.smithi107 for 786d4f32-77ee-11ef-baf6-efdc52797490. 2024-09-21T07:53:38.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:37 smithi107 systemd[1]: Starting Ceph mon.smithi107 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T07:53:38.383 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 podman[27604]: 2024-09-21 07:53:38.031327433 +0000 UTC m=+0.016090379 image pull fc3ec4a4f6be575045de0fd8a2fe84939e888152c447bdedb90add7841f7bef9 quay.ceph.io/ceph-ci/ceph:quincy 2024-09-21T07:53:38.383 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 podman[27604]: 2024-09-21 07:53:38.150843764 +0000 UTC m=+0.135606710 container create 7702e48722c8f04d2809df9bac4dacb54849beb2f19ddcccbf94f118eb7f2a67 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=quincy-fbd1a6a, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T07:53:38.383 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 podman[27604]: 2024-09-21 07:53:38.361244595 +0000 UTC m=+0.346007549 container init 7702e48722c8f04d2809df9bac4dacb54849beb2f19ddcccbf94f118eb7f2a67 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=quincy-fbd1a6a, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T07:53:38.383 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 podman[27604]: 2024-09-21 07:53:38.364215152 +0000 UTC m=+0.348978101 container start 7702e48722c8f04d2809df9bac4dacb54849beb2f19ddcccbf94f118eb7f2a67 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-fbd1a6a, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T07:53:38.467 INFO:teuthology.orchestra.run.smithi107.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T07:53:38.673 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T07:53:38.673 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable), process ceph-mon, pid 2 2024-09-21T07:53:38.673 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: pidfile_write: ignore empty --pid-file 2024-09-21T07:53:38.673 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: load: jerasure load: lrc 2024-09-21T07:53:38.673 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: RocksDB version: 6.15.5 2024-09-21T07:53:38.673 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-21T07:53:38.673 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Compile date Sep 20 2024 2024-09-21T07:53:38.674 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: DB SUMMARY 2024-09-21T07:53:38.674 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: DB Session ID: SIZ39N5Z8KR9NPSYMV4F 2024-09-21T07:53:38.674 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: CURRENT file: CURRENT 2024-09-21T07:53:38.674 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T07:53:38.674 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-09-21T07:53:38.674 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi107/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T07:53:38.674 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi107/store.db: 000010.log size: 98444 ; 2024-09-21T07:53:38.674 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.error_if_exists: 0 2024-09-21T07:53:38.674 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.create_if_missing: 0 2024-09-21T07:53:38.674 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.paranoid_checks: 1 2024-09-21T07:53:38.674 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T07:53:38.674 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.env: 0x55749fa4f440 2024-09-21T07:53:38.674 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.fs: Posix File System 2024-09-21T07:53:38.674 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.info_log: 0x5574a07210c0 2024-09-21T07:53:38.674 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T07:53:38.675 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.statistics: (nil) 2024-09-21T07:53:38.675 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.use_fsync: 0 2024-09-21T07:53:38.675 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_log_file_size: 0 2024-09-21T07:53:38.675 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T07:53:38.675 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T07:53:38.675 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T07:53:38.675 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T07:53:38.675 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.allow_fallocate: 1 2024-09-21T07:53:38.675 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T07:53:38.675 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T07:53:38.675 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.use_direct_reads: 0 2024-09-21T07:53:38.675 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T07:53:38.675 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T07:53:38.675 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.db_log_dir: 2024-09-21T07:53:38.675 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi107/store.db 2024-09-21T07:53:38.676 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T07:53:38.676 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T07:53:38.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T07:53:38.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T07:53:38.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T07:53:38.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T07:53:38.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T07:53:38.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T07:53:38.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.write_buffer_manager: 0x5574a07de810 2024-09-21T07:53:38.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T07:53:38.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-21T07:53:38.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T07:53:38.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T07:53:38.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T07:53:38.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T07:53:38.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T07:53:38.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T07:53:38.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T07:53:38.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.unordered_write: 0 2024-09-21T07:53:38.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T07:53:38.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T07:53:38.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T07:53:38.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T07:53:38.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.row_cache: None 2024-09-21T07:53:38.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.wal_filter: None 2024-09-21T07:53:38.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T07:53:38.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T07:53:38.679 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.preserve_deletes: 0 2024-09-21T07:53:38.679 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.two_write_queues: 0 2024-09-21T07:53:38.679 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T07:53:38.679 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.atomic_flush: 0 2024-09-21T07:53:38.679 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T07:53:38.679 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T07:53:38.679 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T07:53:38.679 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.log_readahead_size: 0 2024-09-21T07:53:38.679 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T07:53:38.679 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T07:53:38.679 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T07:53:38.679 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T07:53:38.679 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T07:53:38.679 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T07:53:38.680 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_background_jobs: 2 2024-09-21T07:53:38.680 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_background_compactions: -1 2024-09-21T07:53:38.680 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_subcompactions: 1 2024-09-21T07:53:38.680 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T07:53:38.680 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T07:53:38.680 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T07:53:38.680 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T07:53:38.680 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T07:53:38.680 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T07:53:38.680 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T07:53:38.680 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T07:53:38.680 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_open_files: -1 2024-09-21T07:53:38.680 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T07:53:38.680 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T07:53:38.680 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T07:53:38.681 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T07:53:38.681 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_background_flushes: -1 2024-09-21T07:53:38.681 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Compression algorithms supported: 2024-09-21T07:53:38.681 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: kZSTD supported: 0 2024-09-21T07:53:38.681 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: kXpressCompression supported: 0 2024-09-21T07:53:38.681 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: kBZip2Compression supported: 0 2024-09-21T07:53:38.681 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T07:53:38.681 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: kLZ4Compression supported: 1 2024-09-21T07:53:38.681 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: kZlibCompression supported: 1 2024-09-21T07:53:38.681 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T07:53:38.681 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: kSnappyCompression supported: 1 2024-09-21T07:53:38.681 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T07:53:38.681 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi107/store.db/MANIFEST-000009 2024-09-21T07:53:38.681 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-09-21T07:53:38.681 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T07:53:38.682 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.merge_operator: 2024-09-21T07:53:38.682 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compaction_filter: None 2024-09-21T07:53:38.682 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T07:53:38.682 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T07:53:38.682 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T07:53:38.682 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T07:53:38.682 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5574a06c7a38) 2024-09-21T07:53:38.682 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: cache_index_and_filter_blocks: 1 2024-09-21T07:53:38.682 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T07:53:38.682 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T07:53:38.683 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: pin_top_level_index_and_filter: 1 2024-09-21T07:53:38.683 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: index_type: 0 2024-09-21T07:53:38.683 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: data_block_index_type: 0 2024-09-21T07:53:38.683 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: index_shortening: 1 2024-09-21T07:53:38.683 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T07:53:38.683 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: hash_index_allow_collision: 1 2024-09-21T07:53:38.683 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: checksum: 1 2024-09-21T07:53:38.683 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: no_block_cache: 0 2024-09-21T07:53:38.683 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_cache: 0x5574a06fd1f0 2024-09-21T07:53:38.683 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_cache_name: BinnedLRUCache 2024-09-21T07:53:38.683 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_cache_options: 2024-09-21T07:53:38.683 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: capacity : 536870912 2024-09-21T07:53:38.683 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: num_shard_bits : 4 2024-09-21T07:53:38.683 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: strict_capacity_limit : 0 2024-09-21T07:53:38.683 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: high_pri_pool_ratio: 0.000 2024-09-21T07:53:38.684 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_cache_compressed: (nil) 2024-09-21T07:53:38.684 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: persistent_cache: (nil) 2024-09-21T07:53:38.684 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_size: 4096 2024-09-21T07:53:38.684 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_size_deviation: 10 2024-09-21T07:53:38.684 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_restart_interval: 16 2024-09-21T07:53:38.684 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: index_block_restart_interval: 1 2024-09-21T07:53:38.684 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: metadata_block_size: 4096 2024-09-21T07:53:38.684 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: partition_filters: 0 2024-09-21T07:53:38.684 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: use_delta_encoding: 1 2024-09-21T07:53:38.684 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-21T07:53:38.684 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: whole_key_filtering: 1 2024-09-21T07:53:38.684 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: verify_compression: 0 2024-09-21T07:53:38.684 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: read_amp_bytes_per_bit: 0 2024-09-21T07:53:38.684 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: format_version: 4 2024-09-21T07:53:38.684 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: enable_index_compression: 1 2024-09-21T07:53:38.685 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_align: 0 2024-09-21T07:53:38.685 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T07:53:38.685 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T07:53:38.685 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compression: NoCompression 2024-09-21T07:53:38.685 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T07:53:38.685 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T07:53:38.685 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T07:53:38.685 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.num_levels: 7 2024-09-21T07:53:38.685 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T07:53:38.685 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T07:53:38.685 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T07:53:38.685 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T07:53:38.685 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T07:53:38.685 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T07:53:38.685 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T07:53:38.685 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T07:53:38.686 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T07:53:38.686 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T07:53:38.686 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T07:53:38.686 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T07:53:38.686 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T07:53:38.686 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T07:53:38.686 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T07:53:38.686 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T07:53:38.686 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T07:53:38.686 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T07:53:38.686 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T07:53:38.686 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T07:53:38.686 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T07:53:38.686 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T07:53:38.687 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T07:53:38.687 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T07:53:38.687 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T07:53:38.687 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T07:53:38.687 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T07:53:38.687 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T07:53:38.687 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T07:53:38.687 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T07:53:38.687 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T07:53:38.687 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T07:53:38.687 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T07:53:38.687 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T07:53:38.687 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.arena_block_size: 4194304 2024-09-21T07:53:38.687 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T07:53:38.687 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T07:53:38.688 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-21T07:53:38.688 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T07:53:38.688 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T07:53:38.688 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T07:53:38.688 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T07:53:38.688 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T07:53:38.688 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T07:53:38.688 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T07:53:38.688 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T07:53:38.688 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T07:53:38.688 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T07:53:38.688 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T07:53:38.688 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T07:53:38.688 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.inplace_update_support: 0 2024-09-21T07:53:38.688 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T07:53:38.688 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T07:53:38.689 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T07:53:38.689 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T07:53:38.689 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.bloom_locality: 0 2024-09-21T07:53:38.689 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.max_successive_merges: 0 2024-09-21T07:53:38.689 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T07:53:38.689 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T07:53:38.689 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T07:53:38.689 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T07:53:38.689 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.ttl: 2592000 2024-09-21T07:53:38.689 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T07:53:38.689 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.enable_blob_files: false 2024-09-21T07:53:38.689 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.min_blob_size: 0 2024-09-21T07:53:38.689 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T07:53:38.689 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T07:53:38.689 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T07:53:38.690 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T07:53:38.690 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi107/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T07:53:38.690 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-09-21T07:53:38.690 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-09-21T07:53:38.690 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726905218388007, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-09-21T07:53:38.690 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-09-21T07:53:38.690 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-21T07:53:38.690 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726905218389213, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93521, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91601, "index_size": 254, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13594, "raw_average_key_size": 49, "raw_value_size": 84157, "raw_average_value_size": 306, "num_data_blocks": 11, "num_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726905218, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "c2375a6a-0b86-40c7-beb9-02b6ed44ba50", "db_session_id": "SIZ39N5Z8KR9NPSYMV4F"}} 2024-09-21T07:53:38.690 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-09-21T07:53:38.690 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726905218389645, "job": 1, "event": "recovery_finished"} 2024-09-21T07:53:38.690 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi107/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T07:53:38.690 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x5574a0730700 2024-09-21T07:53:38.690 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: DB pointer 0x5574a0700000 2024-09-21T07:53:38.690 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-09-21T07:53:38.690 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-21T07:53:38.691 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ** DB Stats ** 2024-09-21T07:53:38.691 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T07:53:38.691 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T07:53:38.691 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T07:53:38.691 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T07:53:38.691 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T07:53:38.691 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-21T07:53:38.691 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T07:53:38.691 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-21T07:53:38.691 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ** Compaction Stats [default] ** 2024-09-21T07:53:38.691 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-21T07:53:38.691 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T07:53:38.691 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: L0 2/0 93.15 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 111.2 0.00 0.00 1 0.001 0 0 2024-09-21T07:53:38.691 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Sum 2/0 93.15 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 111.2 0.00 0.00 1 0.001 0 0 2024-09-21T07:53:38.691 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 111.2 0.00 0.00 1 0.001 0 0 2024-09-21T07:53:38.692 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-21T07:53:38.692 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ** Compaction Stats [default] ** 2024-09-21T07:53:38.692 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-21T07:53:38.692 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T07:53:38.692 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 111.2 0.00 0.00 1 0.001 0 0 2024-09-21T07:53:38.692 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T07:53:38.692 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T07:53:38.692 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T07:53:38.692 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T07:53:38.692 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T07:53:38.692 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T07:53:38.692 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Cumulative compaction: 0.00 GB write, 20.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T07:53:38.692 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Interval compaction: 0.00 GB write, 20.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T07:53:38.692 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T07:53:38.693 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-21T07:53:38.693 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T07:53:38.693 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-21T07:53:38.693 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ** Compaction Stats [default] ** 2024-09-21T07:53:38.693 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-21T07:53:38.693 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T07:53:38.693 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: L0 2/0 93.15 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 111.2 0.00 0.00 1 0.001 0 0 2024-09-21T07:53:38.693 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Sum 2/0 93.15 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 111.2 0.00 0.00 1 0.001 0 0 2024-09-21T07:53:38.693 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-21T07:53:38.693 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-21T07:53:38.693 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ** Compaction Stats [default] ** 2024-09-21T07:53:38.693 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-21T07:53:38.693 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T07:53:38.693 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 111.2 0.00 0.00 1 0.001 0 0 2024-09-21T07:53:38.693 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T07:53:38.693 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T07:53:38.694 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T07:53:38.694 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T07:53:38.694 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T07:53:38.694 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T07:53:38.694 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Cumulative compaction: 0.00 GB write, 20.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T07:53:38.694 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T07:53:38.694 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T07:53:38.694 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-21T07:53:38.694 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T07:53:38.694 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: starting mon.smithi107 rank 0 at public addrs [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] at bind addrs [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi107 fsid 786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T07:53:38.694 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: mon.smithi107@-1(???) e1 preinit fsid 786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T07:53:38.694 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: mon.smithi107@-1(???).mds e1 new map 2024-09-21T07:53:38.694 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: mon.smithi107@-1(???).mds e1 print_map 2024-09-21T07:53:38.694 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: e1 2024-09-21T07:53:38.694 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T07:53:38.695 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T07:53:38.695 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: legacy client fscid: -1 2024-09-21T07:53:38.695 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-21T07:53:38.695 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: No filesystems configured 2024-09-21T07:53:38.695 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: mon.smithi107@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T07:53:38.695 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: mon.smithi107@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:53:38.695 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: mon.smithi107@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:53:38.695 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: mon.smithi107@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:53:38.695 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: mon.smithi107@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T07:53:38.695 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: mon.smithi107 is new leader, mons smithi107 in quorum (ranks 0) 2024-09-21T07:53:38.695 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: monmap e1: 1 mons at {smithi107=[v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-21T07:53:38.695 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: fsmap 2024-09-21T07:53:38.695 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T07:53:38.695 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 ceph-mon[27622]: mgrmap e1: no daemons active 2024-09-21T07:53:38.695 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 bash[27604]: 7702e48722c8f04d2809df9bac4dacb54849beb2f19ddcccbf94f118eb7f2a67 2024-09-21T07:53:38.696 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:38 smithi107 systemd[1]: Started Ceph mon.smithi107 for 786d4f32-77ee-11ef-baf6-efdc52797490. 2024-09-21T07:53:39.449 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.857+0000 7faa16338640 1 Processor -- start 2024-09-21T07:53:39.449 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.858+0000 7faa16338640 1 -- start start 2024-09-21T07:53:39.449 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.858+0000 7faa16338640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa10102070 0x7faa10102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:39.450 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.858+0000 7faa16338640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa101029c0 con 0x7faa10102070 2024-09-21T07:53:39.450 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.858+0000 7faa0ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa10102070 0x7faa10102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:39.450 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.858+0000 7faa0ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa10102070 0x7faa10102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59120/0 (socket says 172.21.15.107:59120) 2024-09-21T07:53:39.450 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.858+0000 7faa0ffff640 1 -- 172.21.15.107:0/2259593056 learned_addr learned my addr 172.21.15.107:0/2259593056 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:39.450 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.858+0000 7faa0ffff640 1 -- 172.21.15.107:0/2259593056 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa10102b00 con 0x7faa10102070 2024-09-21T07:53:39.450 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.860+0000 7faa0ffff640 1 --2- 172.21.15.107:0/2259593056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa10102070 0x7faa10102480 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faa00009840 tx=0x7faa000091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df583d6db6f48162 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:39.450 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.860+0000 7faa0effd640 1 -- 172.21.15.107:0/2259593056 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa00032440 con 0x7faa10102070 2024-09-21T07:53:39.450 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.861+0000 7faa0effd640 1 -- 172.21.15.107:0/2259593056 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7faa00032a00 con 0x7faa10102070 2024-09-21T07:53:39.450 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.861+0000 7faa0effd640 1 -- 172.21.15.107:0/2259593056 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa00031a10 con 0x7faa10102070 2024-09-21T07:53:39.450 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.861+0000 7faa16338640 1 -- 172.21.15.107:0/2259593056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa10102070 msgr2=0x7faa10102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:39.450 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.861+0000 7faa16338640 1 --2- 172.21.15.107:0/2259593056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa10102070 0x7faa10102480 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faa00009840 tx=0x7faa000091d0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.450 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.861+0000 7faa16338640 1 -- 172.21.15.107:0/2259593056 shutdown_connections 2024-09-21T07:53:39.450 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.861+0000 7faa16338640 1 --2- 172.21.15.107:0/2259593056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa10102070 0x7faa10102480 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.451 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.861+0000 7faa16338640 1 -- 172.21.15.107:0/2259593056 >> 172.21.15.107:0/2259593056 conn(0x7faa100fd850 msgr2=0x7faa100ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:39.451 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.861+0000 7faa16338640 1 -- 172.21.15.107:0/2259593056 shutdown_connections 2024-09-21T07:53:39.451 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.861+0000 7faa16338640 1 -- 172.21.15.107:0/2259593056 wait complete. 2024-09-21T07:53:39.451 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.862+0000 7faa16338640 1 Processor -- start 2024-09-21T07:53:39.451 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.862+0000 7faa16338640 1 -- start start 2024-09-21T07:53:39.451 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.862+0000 7faa16338640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa10102070 0x7faa10110cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:39.451 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.862+0000 7faa16338640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa10111230 con 0x7faa10102070 2024-09-21T07:53:39.451 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.862+0000 7faa0ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa10102070 0x7faa10110cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:39.451 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.862+0000 7faa0ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa10102070 0x7faa10110cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59132/0 (socket says 172.21.15.107:59132) 2024-09-21T07:53:39.451 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.862+0000 7faa0ffff640 1 -- 172.21.15.107:0/1663140030 learned_addr learned my addr 172.21.15.107:0/1663140030 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:39.451 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.862+0000 7faa0ffff640 1 -- 172.21.15.107:0/1663140030 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa00009450 con 0x7faa10102070 2024-09-21T07:53:39.451 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.862+0000 7faa0ffff640 1 --2- 172.21.15.107:0/1663140030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa10102070 0x7faa10110cf0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7faa000098a0 tx=0x7faa0002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:39.451 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.863+0000 7faa0cff9640 1 -- 172.21.15.107:0/1663140030 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa000327b0 con 0x7faa10102070 2024-09-21T07:53:39.451 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.863+0000 7faa0cff9640 1 -- 172.21.15.107:0/1663140030 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7faa0003b870 con 0x7faa10102070 2024-09-21T07:53:39.452 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.863+0000 7faa16338640 1 -- 172.21.15.107:0/1663140030 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa10111430 con 0x7faa10102070 2024-09-21T07:53:39.452 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.863+0000 7faa0cff9640 1 -- 172.21.15.107:0/1663140030 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa0003a550 con 0x7faa10102070 2024-09-21T07:53:39.452 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.863+0000 7faa16338640 1 -- 172.21.15.107:0/1663140030 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa101118a0 con 0x7faa10102070 2024-09-21T07:53:39.452 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.863+0000 7faa0cff9640 1 -- 172.21.15.107:0/1663140030 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7faa00039040 con 0x7faa10102070 2024-09-21T07:53:39.452 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.863+0000 7faa0cff9640 1 -- 172.21.15.107:0/1663140030 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7faa00044950 con 0x7faa10102070 2024-09-21T07:53:39.452 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.864+0000 7faa16338640 1 -- 172.21.15.107:0/1663140030 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1004b720 con 0x7faa10102070 2024-09-21T07:53:39.452 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.866+0000 7faa0cff9640 1 -- 172.21.15.107:0/1663140030 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7faa101118a0 con 0x7faa10102070 2024-09-21T07:53:39.452 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.921+0000 7faa16338640 1 -- 172.21.15.107:0/1663140030 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7faa10103cf0 con 0x7faa10102070 2024-09-21T07:53:39.452 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.924+0000 7faa0cff9640 1 -- 172.21.15.107:0/1663140030 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7faa00049060 con 0x7faa10102070 2024-09-21T07:53:39.452 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.924+0000 7faa16338640 1 -- 172.21.15.107:0/1663140030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa10102070 msgr2=0x7faa10110cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:39.452 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.924+0000 7faa16338640 1 --2- 172.21.15.107:0/1663140030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa10102070 0x7faa10110cf0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7faa000098a0 tx=0x7faa0002c040 comp rx=0 tx=0).stop 2024-09-21T07:53:39.452 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.924+0000 7faa16338640 1 -- 172.21.15.107:0/1663140030 shutdown_connections 2024-09-21T07:53:39.452 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.924+0000 7faa16338640 1 --2- 172.21.15.107:0/1663140030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa10102070 0x7faa10110cf0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.452 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.924+0000 7faa16338640 1 -- 172.21.15.107:0/1663140030 >> 172.21.15.107:0/1663140030 conn(0x7faa100fd850 msgr2=0x7faa100fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:39.453 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.924+0000 7faa16338640 1 -- 172.21.15.107:0/1663140030 shutdown_connections 2024-09-21T07:53:39.453 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:38.924+0000 7faa16338640 1 -- 172.21.15.107:0/1663140030 wait complete. 2024-09-21T07:53:39.453 INFO:teuthology.orchestra.run.smithi107.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T07:53:39.453 INFO:teuthology.orchestra.run.smithi107.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:53:39.453 INFO:teuthology.orchestra.run.smithi107.stdout:Creating mgr... 2024-09-21T07:53:39.453 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T07:53:39.453 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T07:53:39.453 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-21T07:53:39.626 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-786d4f32-77ee-11ef-baf6-efdc52797490@mgr.smithi107.wzulxb 2024-09-21T07:53:39.626 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Failed to reset failed state of unit ceph-786d4f32-77ee-11ef-baf6-efdc52797490@mgr.smithi107.wzulxb.service: Unit ceph-786d4f32-77ee-11ef-baf6-efdc52797490@mgr.smithi107.wzulxb.service not loaded. 2024-09-21T07:53:39.774 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-786d4f32-77ee-11ef-baf6-efdc52797490.target.wants/ceph-786d4f32-77ee-11ef-baf6-efdc52797490@mgr.smithi107.wzulxb.service → /etc/systemd/system/ceph-786d4f32-77ee-11ef-baf6-efdc52797490@.service. 2024-09-21T07:53:40.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:39 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1663140030' entity='client.admin' 2024-09-21T07:53:41.625 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:53:41.625 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout disabled 2024-09-21T07:53:41.633 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:53:41.633 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout inactive 2024-09-21T07:53:41.633 INFO:teuthology.orchestra.run.smithi107.stdout:firewalld.service is not enabled 2024-09-21T07:53:41.633 INFO:teuthology.orchestra.run.smithi107.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T07:53:41.643 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:53:41.643 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout disabled 2024-09-21T07:53:41.652 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:53:41.652 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout inactive 2024-09-21T07:53:41.652 INFO:teuthology.orchestra.run.smithi107.stdout:firewalld.service is not enabled 2024-09-21T07:53:41.652 INFO:teuthology.orchestra.run.smithi107.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-21T07:53:41.652 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for mgr to start... 2024-09-21T07:53:41.652 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for mgr... 2024-09-21T07:53:42.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:42 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1939384962' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T07:53:42.787 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-09-21T07:53:42.787 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:53:42.788 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "fsid": "786d4f32-77ee-11ef-baf6-efdc52797490", 2024-09-21T07:53:42.788 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T07:53:42.788 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T07:53:42.788 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T07:53:42.788 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T07:53:42.788 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:42.788 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T07:53:42.788 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T07:53:42.788 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 0 2024-09-21T07:53:42.788 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:53:42.788 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T07:53:42.788 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "smithi107" 2024-09-21T07:53:42.788 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:53:42.788 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-21T07:53:42.788 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T07:53:42.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:53:42.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-21T07:53:42.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T07:53:42.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:42.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T07:53:42.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:53:42.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T07:53:42.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T07:53:42.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T07:53:42.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T07:53:42.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T07:53:42.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T07:53:42.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:42.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T07:53:42.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T07:53:42.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T07:53:42.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T07:53:42.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T07:53:42.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T07:53:42.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T07:53:42.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T07:53:42.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T07:53:42.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:42.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T07:53:42.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:53:42.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T07:53:42.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T07:53:42.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:42.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T07:53:42.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T07:53:42.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T07:53:42.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T07:53:42.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T07:53:42.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T07:53:42.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T07:53:42.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:53:42.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:53:42.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:42.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T07:53:42.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:53:42.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T07:53:25.338306+0000", 2024-09-21T07:53:42.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:53:42.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:42.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T07:53:42.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:53:42.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.088+0000 7f536f197640 1 Processor -- start 2024-09-21T07:53:42.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.088+0000 7f536f197640 1 -- start start 2024-09-21T07:53:42.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.088+0000 7f536f197640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5368100e90 0x7f53681012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:42.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.088+0000 7f536f197640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53681017e0 con 0x7f5368100e90 2024-09-21T07:53:42.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.089+0000 7f536cf33640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5368100e90 0x7f53681012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:42.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.089+0000 7f536cf33640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5368100e90 0x7f53681012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50394/0 (socket says 172.21.15.107:50394) 2024-09-21T07:53:42.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.089+0000 7f536cf33640 1 -- 172.21.15.107:0/2504396921 learned_addr learned my addr 172.21.15.107:0/2504396921 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:42.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.089+0000 7f536cf33640 1 -- 172.21.15.107:0/2504396921 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5368101920 con 0x7f5368100e90 2024-09-21T07:53:42.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.090+0000 7f536cf33640 1 --2- 172.21.15.107:0/2504396921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5368100e90 0x7f53681012a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f535c009840 tx=0x7f535c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af266fe1cc5fbe2e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:42.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.090+0000 7f53677fe640 1 -- 172.21.15.107:0/2504396921 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f535c032440 con 0x7f5368100e90 2024-09-21T07:53:42.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.091+0000 7f53677fe640 1 -- 172.21.15.107:0/2504396921 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f535c032a00 con 0x7f5368100e90 2024-09-21T07:53:42.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.091+0000 7f53677fe640 1 -- 172.21.15.107:0/2504396921 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f535c031a10 con 0x7f5368100e90 2024-09-21T07:53:42.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.091+0000 7f536f197640 1 -- 172.21.15.107:0/2504396921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5368100e90 msgr2=0x7f53681012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:42.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.091+0000 7f536f197640 1 --2- 172.21.15.107:0/2504396921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5368100e90 0x7f53681012a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f535c009840 tx=0x7f535c0091d0 comp rx=0 tx=0).stop 2024-09-21T07:53:42.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.091+0000 7f536f197640 1 -- 172.21.15.107:0/2504396921 shutdown_connections 2024-09-21T07:53:42.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.091+0000 7f536f197640 1 --2- 172.21.15.107:0/2504396921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5368100e90 0x7f53681012a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:42.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.091+0000 7f536f197640 1 -- 172.21.15.107:0/2504396921 >> 172.21.15.107:0/2504396921 conn(0x7f53680fc6d0 msgr2=0x7f53680feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:42.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.091+0000 7f536f197640 1 -- 172.21.15.107:0/2504396921 shutdown_connections 2024-09-21T07:53:42.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.092+0000 7f536f197640 1 -- 172.21.15.107:0/2504396921 wait complete. 2024-09-21T07:53:42.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.092+0000 7f536f197640 1 Processor -- start 2024-09-21T07:53:42.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.092+0000 7f536f197640 1 -- start start 2024-09-21T07:53:42.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.092+0000 7f536f197640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5368100e90 0x7f5368076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:42.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.092+0000 7f536f197640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5368113a80 con 0x7f5368100e90 2024-09-21T07:53:42.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.093+0000 7f536cf33640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5368100e90 0x7f5368076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:42.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.093+0000 7f536cf33640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5368100e90 0x7f5368076ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50408/0 (socket says 172.21.15.107:50408) 2024-09-21T07:53:42.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.093+0000 7f536cf33640 1 -- 172.21.15.107:0/1939384962 learned_addr learned my addr 172.21.15.107:0/1939384962 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:42.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.093+0000 7f536cf33640 1 -- 172.21.15.107:0/1939384962 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c009450 con 0x7f5368100e90 2024-09-21T07:53:42.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.093+0000 7f536cf33640 1 --2- 172.21.15.107:0/1939384962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5368100e90 0x7f5368076ae0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f535c006a70 tx=0x7f535c02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:42.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.093+0000 7f53657fa640 1 -- 172.21.15.107:0/1939384962 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f535c031d10 con 0x7f5368100e90 2024-09-21T07:53:42.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.093+0000 7f536f197640 1 -- 172.21.15.107:0/1939384962 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5368113bc0 con 0x7f5368100e90 2024-09-21T07:53:42.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.093+0000 7f53657fa640 1 -- 172.21.15.107:0/1939384962 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f535c031e70 con 0x7f5368100e90 2024-09-21T07:53:42.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.093+0000 7f53657fa640 1 -- 172.21.15.107:0/1939384962 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f535c03b6f0 con 0x7f5368100e90 2024-09-21T07:53:42.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.093+0000 7f536f197640 1 -- 172.21.15.107:0/1939384962 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5368113fd0 con 0x7f5368100e90 2024-09-21T07:53:42.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.094+0000 7f53657fa640 1 -- 172.21.15.107:0/1939384962 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f535c039070 con 0x7f5368100e90 2024-09-21T07:53:42.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.094+0000 7f53657fa640 1 -- 172.21.15.107:0/1939384962 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f535c047800 con 0x7f5368100e90 2024-09-21T07:53:42.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.094+0000 7f536f197640 1 -- 172.21.15.107:0/1939384962 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f536804b720 con 0x7f5368100e90 2024-09-21T07:53:42.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.096+0000 7f53657fa640 1 -- 172.21.15.107:0/1939384962 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f535c037070 con 0x7f5368100e90 2024-09-21T07:53:42.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.156+0000 7f536f197640 1 -- 172.21.15.107:0/1939384962 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f5368102b10 con 0x7f5368100e90 2024-09-21T07:53:42.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.156+0000 7f53657fa640 1 -- 172.21.15.107:0/1939384962 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f535c03bd80 con 0x7f5368100e90 2024-09-21T07:53:42.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.158+0000 7f536f197640 1 -- 172.21.15.107:0/1939384962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5368100e90 msgr2=0x7f5368076ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:42.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.158+0000 7f536f197640 1 --2- 172.21.15.107:0/1939384962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5368100e90 0x7f5368076ae0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f535c006a70 tx=0x7f535c02c040 comp rx=0 tx=0).stop 2024-09-21T07:53:42.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.158+0000 7f536f197640 1 -- 172.21.15.107:0/1939384962 shutdown_connections 2024-09-21T07:53:42.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.158+0000 7f536f197640 1 --2- 172.21.15.107:0/1939384962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5368100e90 0x7f5368076ae0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:42.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.158+0000 7f536f197640 1 -- 172.21.15.107:0/1939384962 >> 172.21.15.107:0/1939384962 conn(0x7f53680fc6d0 msgr2=0x7f53680fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:42.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.158+0000 7f536f197640 1 -- 172.21.15.107:0/1939384962 shutdown_connections 2024-09-21T07:53:42.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:42.158+0000 7f536f197640 1 -- 172.21.15.107:0/1939384962 wait complete. 2024-09-21T07:53:42.795 INFO:teuthology.orchestra.run.smithi107.stdout:mgr not available, waiting (1/15)... 2024-09-21T07:53:45.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:45 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/3786441785' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T07:53:45.991 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-09-21T07:53:45.991 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:53:45.991 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "fsid": "786d4f32-77ee-11ef-baf6-efdc52797490", 2024-09-21T07:53:45.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T07:53:45.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T07:53:45.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T07:53:45.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T07:53:45.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:45.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T07:53:45.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T07:53:45.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 0 2024-09-21T07:53:45.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:53:45.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T07:53:45.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "smithi107" 2024-09-21T07:53:45.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:53:45.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-21T07:53:45.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T07:53:45.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:53:45.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-21T07:53:45.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T07:53:45.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:45.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T07:53:45.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:53:45.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T07:53:45.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T07:53:45.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T07:53:45.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T07:53:45.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T07:53:45.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T07:53:45.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:45.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T07:53:45.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T07:53:45.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T07:53:45.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T07:53:45.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T07:53:45.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T07:53:45.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T07:53:45.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T07:53:45.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T07:53:45.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:45.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T07:53:45.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:53:45.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T07:53:45.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T07:53:45.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:45.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T07:53:45.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T07:53:45.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T07:53:45.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T07:53:45.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T07:53:45.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T07:53:45.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T07:53:45.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:53:45.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:53:45.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:45.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T07:53:45.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:53:45.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T07:53:25.338306+0000", 2024-09-21T07:53:45.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:53:45.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:45.996 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T07:53:45.996 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:53:45.996 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.258+0000 7fa17c375640 1 Processor -- start 2024-09-21T07:53:45.996 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.258+0000 7fa17c375640 1 -- start start 2024-09-21T07:53:45.996 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.259+0000 7fa17c375640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa174101f80 0x7fa174102390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:45.996 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.259+0000 7fa17c375640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1741028d0 con 0x7fa174101f80 2024-09-21T07:53:45.996 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.259+0000 7fa17a111640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa174101f80 0x7fa174102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:45.996 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.259+0000 7fa17a111640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa174101f80 0x7fa174102390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50422/0 (socket says 172.21.15.107:50422) 2024-09-21T07:53:45.996 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.259+0000 7fa17a111640 1 -- 172.21.15.107:0/673799589 learned_addr learned my addr 172.21.15.107:0/673799589 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:45.996 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.259+0000 7fa17a111640 1 -- 172.21.15.107:0/673799589 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa174102a10 con 0x7fa174101f80 2024-09-21T07:53:45.996 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.260+0000 7fa17a111640 1 --2- 172.21.15.107:0/673799589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa174101f80 0x7fa174102390 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa170009840 tx=0x7fa1700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3201563329044 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:45.996 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.260+0000 7fa17910f640 1 -- 172.21.15.107:0/673799589 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa170032440 con 0x7fa174101f80 2024-09-21T07:53:45.996 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.260+0000 7fa17910f640 1 -- 172.21.15.107:0/673799589 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa170032a00 con 0x7fa174101f80 2024-09-21T07:53:45.996 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.260+0000 7fa17910f640 1 -- 172.21.15.107:0/673799589 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1700319e0 con 0x7fa174101f80 2024-09-21T07:53:45.996 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.261+0000 7fa17c375640 1 -- 172.21.15.107:0/673799589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa174101f80 msgr2=0x7fa174102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:45.997 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.261+0000 7fa17c375640 1 --2- 172.21.15.107:0/673799589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa174101f80 0x7fa174102390 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa170009840 tx=0x7fa1700091d0 comp rx=0 tx=0).stop 2024-09-21T07:53:45.997 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.261+0000 7fa17c375640 1 -- 172.21.15.107:0/673799589 shutdown_connections 2024-09-21T07:53:45.997 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.261+0000 7fa17c375640 1 --2- 172.21.15.107:0/673799589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa174101f80 0x7fa174102390 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:45.997 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.261+0000 7fa17c375640 1 -- 172.21.15.107:0/673799589 >> 172.21.15.107:0/673799589 conn(0x7fa1740fd7a0 msgr2=0x7fa1740ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:45.997 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.261+0000 7fa17c375640 1 -- 172.21.15.107:0/673799589 shutdown_connections 2024-09-21T07:53:45.997 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.261+0000 7fa17c375640 1 -- 172.21.15.107:0/673799589 wait complete. 2024-09-21T07:53:45.997 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.262+0000 7fa17c375640 1 Processor -- start 2024-09-21T07:53:45.997 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.262+0000 7fa17c375640 1 -- start start 2024-09-21T07:53:45.997 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.262+0000 7fa17c375640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa174101f80 0x7fa174110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:45.997 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.262+0000 7fa17c375640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa174111370 con 0x7fa174101f80 2024-09-21T07:53:45.997 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.262+0000 7fa17a111640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa174101f80 0x7fa174110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:45.997 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.262+0000 7fa17a111640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa174101f80 0x7fa174110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50424/0 (socket says 172.21.15.107:50424) 2024-09-21T07:53:45.997 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.262+0000 7fa17a111640 1 -- 172.21.15.107:0/3786441785 learned_addr learned my addr 172.21.15.107:0/3786441785 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:45.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.262+0000 7fa17a111640 1 -- 172.21.15.107:0/3786441785 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa170009450 con 0x7fa174101f80 2024-09-21T07:53:45.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.262+0000 7fa17a111640 1 --2- 172.21.15.107:0/3786441785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa174101f80 0x7fa174110e30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa170000c00 tx=0x7fa170008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:45.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.263+0000 7fa16affd640 1 -- 172.21.15.107:0/3786441785 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa17003d450 con 0x7fa174101f80 2024-09-21T07:53:45.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.263+0000 7fa16affd640 1 -- 172.21.15.107:0/3786441785 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa17003da10 con 0x7fa174101f80 2024-09-21T07:53:45.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.263+0000 7fa17c375640 1 -- 172.21.15.107:0/3786441785 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa174111570 con 0x7fa174101f80 2024-09-21T07:53:45.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.263+0000 7fa16affd640 1 -- 172.21.15.107:0/3786441785 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa17003b880 con 0x7fa174101f80 2024-09-21T07:53:45.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.263+0000 7fa17c375640 1 -- 172.21.15.107:0/3786441785 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa174111fc0 con 0x7fa174101f80 2024-09-21T07:53:45.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.263+0000 7fa16affd640 1 -- 172.21.15.107:0/3786441785 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fa170039070 con 0x7fa174101f80 2024-09-21T07:53:45.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.263+0000 7fa16affd640 1 -- 172.21.15.107:0/3786441785 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa1700466c0 con 0x7fa174101f80 2024-09-21T07:53:45.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.264+0000 7fa17c375640 1 -- 172.21.15.107:0/3786441785 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1741013e0 con 0x7fa174101f80 2024-09-21T07:53:45.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.266+0000 7fa16affd640 1 -- 172.21.15.107:0/3786441785 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fa1700657a0 con 0x7fa174101f80 2024-09-21T07:53:45.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.324+0000 7fa17c375640 1 -- 172.21.15.107:0/3786441785 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fa174103ce0 con 0x7fa174101f80 2024-09-21T07:53:45.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.325+0000 7fa16affd640 1 -- 172.21.15.107:0/3786441785 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fa170054020 con 0x7fa174101f80 2024-09-21T07:53:45.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.326+0000 7fa17c375640 1 -- 172.21.15.107:0/3786441785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa174101f80 msgr2=0x7fa174110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:45.999 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.326+0000 7fa17c375640 1 --2- 172.21.15.107:0/3786441785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa174101f80 0x7fa174110e30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa170000c00 tx=0x7fa170008040 comp rx=0 tx=0).stop 2024-09-21T07:53:45.999 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.326+0000 7fa17c375640 1 -- 172.21.15.107:0/3786441785 shutdown_connections 2024-09-21T07:53:45.999 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.326+0000 7fa17c375640 1 --2- 172.21.15.107:0/3786441785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa174101f80 0x7fa174110e30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:45.999 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.326+0000 7fa17c375640 1 -- 172.21.15.107:0/3786441785 >> 172.21.15.107:0/3786441785 conn(0x7fa1740fd7a0 msgr2=0x7fa1740fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:45.999 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.326+0000 7fa17c375640 1 -- 172.21.15.107:0/3786441785 shutdown_connections 2024-09-21T07:53:45.999 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:45.326+0000 7fa17c375640 1 -- 172.21.15.107:0/3786441785 wait complete. 2024-09-21T07:53:45.999 INFO:teuthology.orchestra.run.smithi107.stdout:mgr not available, waiting (2/15)... 2024-09-21T07:53:46.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:46 smithi107 ceph-mon[27622]: Activating manager daemon smithi107.wzulxb 2024-09-21T07:53:46.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:46 smithi107 ceph-mon[27622]: mgrmap e2: smithi107.wzulxb(active, starting, since 0.00312278s) 2024-09-21T07:53:46.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:46 smithi107 ceph-mon[27622]: from='mgr.14100 172.21.15.107:0/3303967900' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T07:53:46.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:46 smithi107 ceph-mon[27622]: from='mgr.14100 172.21.15.107:0/3303967900' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T07:53:46.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:46 smithi107 ceph-mon[27622]: from='mgr.14100 172.21.15.107:0/3303967900' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T07:53:46.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:46 smithi107 ceph-mon[27622]: from='mgr.14100 172.21.15.107:0/3303967900' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-21T07:53:46.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:46 smithi107 ceph-mon[27622]: from='mgr.14100 172.21.15.107:0/3303967900' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr metadata", "who": "smithi107.wzulxb", "id": "smithi107.wzulxb"}]: dispatch 2024-09-21T07:53:46.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:46 smithi107 ceph-mon[27622]: Manager daemon smithi107.wzulxb is now available 2024-09-21T07:53:46.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:46 smithi107 ceph-mon[27622]: from='mgr.14100 172.21.15.107:0/3303967900' entity='mgr.smithi107.wzulxb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.wzulxb/mirror_snapshot_schedule"}]: dispatch 2024-09-21T07:53:46.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:46 smithi107 ceph-mon[27622]: from='mgr.14100 172.21.15.107:0/3303967900' entity='mgr.smithi107.wzulxb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.wzulxb/trash_purge_schedule"}]: dispatch 2024-09-21T07:53:46.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:46 smithi107 ceph-mon[27622]: from='mgr.14100 172.21.15.107:0/3303967900' entity='mgr.smithi107.wzulxb' 2024-09-21T07:53:46.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:46 smithi107 ceph-mon[27622]: from='mgr.14100 172.21.15.107:0/3303967900' entity='mgr.smithi107.wzulxb' 2024-09-21T07:53:46.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:46 smithi107 ceph-mon[27622]: from='mgr.14100 172.21.15.107:0/3303967900' entity='mgr.smithi107.wzulxb' 2024-09-21T07:53:48.215 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:47 smithi107 ceph-mon[27622]: mgrmap e3: smithi107.wzulxb(active, since 1.00678s) 2024-09-21T07:53:49.228 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:48 smithi107 ceph-mon[27622]: mgrmap e4: smithi107.wzulxb(active, since 2s) 2024-09-21T07:53:49.228 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:48 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/830479316' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T07:53:49.239 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-09-21T07:53:49.239 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:53:49.240 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "fsid": "786d4f32-77ee-11ef-baf6-efdc52797490", 2024-09-21T07:53:49.240 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T07:53:49.240 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T07:53:49.240 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T07:53:49.240 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T07:53:49.240 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:49.240 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T07:53:49.240 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T07:53:49.240 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 0 2024-09-21T07:53:49.240 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:53:49.240 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T07:53:49.240 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "smithi107" 2024-09-21T07:53:49.240 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:53:49.240 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-21T07:53:49.240 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T07:53:49.241 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:53:49.241 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-21T07:53:49.241 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T07:53:49.241 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:49.241 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T07:53:49.241 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:53:49.241 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T07:53:49.241 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T07:53:49.241 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T07:53:49.241 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T07:53:49.241 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T07:53:49.241 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T07:53:49.241 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:49.241 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T07:53:49.241 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T07:53:49.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T07:53:49.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T07:53:49.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T07:53:49.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T07:53:49.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T07:53:49.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T07:53:49.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T07:53:49.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:49.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T07:53:49.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:53:49.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T07:53:49.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T07:53:49.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:49.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T07:53:49.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T07:53:49.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T07:53:49.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T07:53:49.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T07:53:49.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T07:53:49.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T07:53:49.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:53:49.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:53:49.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:49.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T07:53:49.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:53:49.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T07:53:25.338306+0000", 2024-09-21T07:53:49.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:53:49.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:53:49.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T07:53:49.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:53:49.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.410+0000 7f208f055640 1 Processor -- start 2024-09-21T07:53:49.244 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.410+0000 7f208f055640 1 -- start start 2024-09-21T07:53:49.244 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.411+0000 7f208f055640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2088102070 0x7f2088102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:49.244 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.411+0000 7f208f055640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20881029c0 con 0x7f2088102070 2024-09-21T07:53:49.244 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.411+0000 7f208cdf1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2088102070 0x7f2088102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:49.244 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.411+0000 7f208cdf1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2088102070 0x7f2088102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50492/0 (socket says 172.21.15.107:50492) 2024-09-21T07:53:49.244 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.411+0000 7f208cdf1640 1 -- 172.21.15.107:0/1616117166 learned_addr learned my addr 172.21.15.107:0/1616117166 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:49.244 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.411+0000 7f208cdf1640 1 -- 172.21.15.107:0/1616117166 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2088102b00 con 0x7f2088102070 2024-09-21T07:53:49.244 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.412+0000 7f208cdf1640 1 --2- 172.21.15.107:0/1616117166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2088102070 0x7f2088102480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f207c009840 tx=0x7f207c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da8480dcf84b02e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:49.244 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.412+0000 7f20877fe640 1 -- 172.21.15.107:0/1616117166 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f207c032440 con 0x7f2088102070 2024-09-21T07:53:49.244 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.412+0000 7f20877fe640 1 -- 172.21.15.107:0/1616117166 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f207c032a00 con 0x7f2088102070 2024-09-21T07:53:49.244 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.412+0000 7f20877fe640 1 -- 172.21.15.107:0/1616117166 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f207c031a10 con 0x7f2088102070 2024-09-21T07:53:49.244 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.413+0000 7f208f055640 1 -- 172.21.15.107:0/1616117166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2088102070 msgr2=0x7f2088102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:49.244 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.413+0000 7f208f055640 1 --2- 172.21.15.107:0/1616117166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2088102070 0x7f2088102480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f207c009840 tx=0x7f207c0091d0 comp rx=0 tx=0).stop 2024-09-21T07:53:49.244 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.413+0000 7f208f055640 1 -- 172.21.15.107:0/1616117166 shutdown_connections 2024-09-21T07:53:49.245 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.413+0000 7f208f055640 1 --2- 172.21.15.107:0/1616117166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2088102070 0x7f2088102480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:49.245 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.413+0000 7f208f055640 1 -- 172.21.15.107:0/1616117166 >> 172.21.15.107:0/1616117166 conn(0x7f20880fd850 msgr2=0x7f20880ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:49.245 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.413+0000 7f208f055640 1 -- 172.21.15.107:0/1616117166 shutdown_connections 2024-09-21T07:53:49.245 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.413+0000 7f208f055640 1 -- 172.21.15.107:0/1616117166 wait complete. 2024-09-21T07:53:49.245 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.413+0000 7f208f055640 1 Processor -- start 2024-09-21T07:53:49.245 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.414+0000 7f208f055640 1 -- start start 2024-09-21T07:53:49.245 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.414+0000 7f208f055640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2088102070 0x7f2088110cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:49.245 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.414+0000 7f208f055640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2088111230 con 0x7f2088102070 2024-09-21T07:53:49.245 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.414+0000 7f208cdf1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2088102070 0x7f2088110cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:49.245 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.414+0000 7f208cdf1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2088102070 0x7f2088110cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50502/0 (socket says 172.21.15.107:50502) 2024-09-21T07:53:49.245 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.414+0000 7f208cdf1640 1 -- 172.21.15.107:0/830479316 learned_addr learned my addr 172.21.15.107:0/830479316 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:49.245 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.414+0000 7f208cdf1640 1 -- 172.21.15.107:0/830479316 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c009450 con 0x7f2088102070 2024-09-21T07:53:49.245 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.414+0000 7f208cdf1640 1 --2- 172.21.15.107:0/830479316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2088102070 0x7f2088110cf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f207c0098a0 tx=0x7f207c02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:49.245 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.415+0000 7f20857fa640 1 -- 172.21.15.107:0/830479316 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f207c0327b0 con 0x7f2088102070 2024-09-21T07:53:49.245 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.415+0000 7f208f055640 1 -- 172.21.15.107:0/830479316 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2088111430 con 0x7f2088102070 2024-09-21T07:53:49.246 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.415+0000 7f20857fa640 1 -- 172.21.15.107:0/830479316 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f207c03b870 con 0x7f2088102070 2024-09-21T07:53:49.246 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.415+0000 7f20857fa640 1 -- 172.21.15.107:0/830479316 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f207c03a550 con 0x7f2088102070 2024-09-21T07:53:49.246 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.415+0000 7f208f055640 1 -- 172.21.15.107:0/830479316 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20881118a0 con 0x7f2088102070 2024-09-21T07:53:49.246 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.415+0000 7f20857fa640 1 -- 172.21.15.107:0/830479316 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f207c039040 con 0x7f2088102070 2024-09-21T07:53:49.246 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.416+0000 7f20857fa640 1 --2- 172.21.15.107:0/830479316 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f2078039450 0x7f207803b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:49.246 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.416+0000 7f208f055640 1 -- 172.21.15.107:0/830479316 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208804b720 con 0x7f2088102070 2024-09-21T07:53:49.246 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.416+0000 7f20857fa640 1 -- 172.21.15.107:0/830479316 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f207c06c850 con 0x7f2088102070 2024-09-21T07:53:49.246 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.416+0000 7f2087fff640 1 --2- 172.21.15.107:0/830479316 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f2078039450 0x7f207803b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:49.246 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.416+0000 7f2087fff640 1 --2- 172.21.15.107:0/830479316 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f2078039450 0x7f207803b900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2074006fd0 tx=0x7f2074006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:49.246 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.420+0000 7f20857fa640 1 -- 172.21.15.107:0/830479316 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f207c04b300 con 0x7f2088102070 2024-09-21T07:53:49.246 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.634+0000 7f208f055640 1 -- 172.21.15.107:0/830479316 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f2088103cf0 con 0x7f2088102070 2024-09-21T07:53:49.246 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.635+0000 7f20857fa640 1 -- 172.21.15.107:0/830479316 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f207c043ed0 con 0x7f2088102070 2024-09-21T07:53:49.246 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.637+0000 7f208f055640 1 -- 172.21.15.107:0/830479316 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f2078039450 msgr2=0x7f207803b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:49.246 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.637+0000 7f208f055640 1 --2- 172.21.15.107:0/830479316 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f2078039450 0x7f207803b900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2074006fd0 tx=0x7f2074006db0 comp rx=0 tx=0).stop 2024-09-21T07:53:49.246 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.637+0000 7f208f055640 1 -- 172.21.15.107:0/830479316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2088102070 msgr2=0x7f2088110cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:49.247 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.637+0000 7f208f055640 1 --2- 172.21.15.107:0/830479316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2088102070 0x7f2088110cf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f207c0098a0 tx=0x7f207c02c040 comp rx=0 tx=0).stop 2024-09-21T07:53:49.247 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.637+0000 7f208f055640 1 -- 172.21.15.107:0/830479316 shutdown_connections 2024-09-21T07:53:49.247 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.637+0000 7f208f055640 1 --2- 172.21.15.107:0/830479316 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f2078039450 0x7f207803b900 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:49.247 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.637+0000 7f208f055640 1 --2- 172.21.15.107:0/830479316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2088102070 0x7f2088110cf0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:49.247 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.637+0000 7f208f055640 1 -- 172.21.15.107:0/830479316 >> 172.21.15.107:0/830479316 conn(0x7f20880fd850 msgr2=0x7f20880fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:49.247 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.637+0000 7f208f055640 1 -- 172.21.15.107:0/830479316 shutdown_connections 2024-09-21T07:53:49.247 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:48.637+0000 7f208f055640 1 -- 172.21.15.107:0/830479316 wait complete. 2024-09-21T07:53:49.247 INFO:teuthology.orchestra.run.smithi107.stdout:mgr is available 2024-09-21T07:53:50.176 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:49 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/3535217218' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-21T07:53:50.426 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-09-21T07:53:50.427 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T07:53:50.427 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout fsid = 786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T07:53:50.427 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T07:53:50.427 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T07:53:50.427 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T07:53:50.427 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T07:53:50.427 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T07:53:50.427 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-09-21T07:53:50.427 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T07:53:50.427 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T07:53:50.427 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-09-21T07:53:50.427 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T07:53:50.428 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T07:53:50.428 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T07:53:50.428 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T07:53:50.428 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T07:53:50.428 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T07:53:50.428 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.660+0000 7f11d1ca4640 1 Processor -- start 2024-09-21T07:53:50.428 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.660+0000 7f11d1ca4640 1 -- start start 2024-09-21T07:53:50.428 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.660+0000 7f11d1ca4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11cc102070 0x7f11cc102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:50.428 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.660+0000 7f11d1ca4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc1029c0 con 0x7f11cc102070 2024-09-21T07:53:50.428 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.661+0000 7f11cb7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11cc102070 0x7f11cc102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:50.429 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.661+0000 7f11cb7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11cc102070 0x7f11cc102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50504/0 (socket says 172.21.15.107:50504) 2024-09-21T07:53:50.429 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.661+0000 7f11cb7fe640 1 -- 172.21.15.107:0/1177779203 learned_addr learned my addr 172.21.15.107:0/1177779203 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:50.429 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.661+0000 7f11cb7fe640 1 -- 172.21.15.107:0/1177779203 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11cc102b00 con 0x7f11cc102070 2024-09-21T07:53:50.429 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.661+0000 7f11cb7fe640 1 --2- 172.21.15.107:0/1177779203 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11cc102070 0x7f11cc102480 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f11bc009840 tx=0x7f11bc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c0c27bb73f0b6e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:50.429 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.662+0000 7f11caffd640 1 -- 172.21.15.107:0/1177779203 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11bc032440 con 0x7f11cc102070 2024-09-21T07:53:50.429 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.662+0000 7f11caffd640 1 -- 172.21.15.107:0/1177779203 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f11bc032a00 con 0x7f11cc102070 2024-09-21T07:53:50.429 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.662+0000 7f11caffd640 1 -- 172.21.15.107:0/1177779203 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11bc031a10 con 0x7f11cc102070 2024-09-21T07:53:50.429 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.662+0000 7f11d1ca4640 1 -- 172.21.15.107:0/1177779203 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11cc102070 msgr2=0x7f11cc102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:50.429 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.662+0000 7f11d1ca4640 1 --2- 172.21.15.107:0/1177779203 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11cc102070 0x7f11cc102480 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f11bc009840 tx=0x7f11bc0091d0 comp rx=0 tx=0).stop 2024-09-21T07:53:50.429 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.662+0000 7f11d1ca4640 1 -- 172.21.15.107:0/1177779203 shutdown_connections 2024-09-21T07:53:50.429 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.662+0000 7f11d1ca4640 1 --2- 172.21.15.107:0/1177779203 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11cc102070 0x7f11cc102480 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:50.429 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.662+0000 7f11d1ca4640 1 -- 172.21.15.107:0/1177779203 >> 172.21.15.107:0/1177779203 conn(0x7f11cc0fd850 msgr2=0x7f11cc0ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:50.429 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.662+0000 7f11d1ca4640 1 -- 172.21.15.107:0/1177779203 shutdown_connections 2024-09-21T07:53:50.430 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.662+0000 7f11d1ca4640 1 -- 172.21.15.107:0/1177779203 wait complete. 2024-09-21T07:53:50.430 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.663+0000 7f11d1ca4640 1 Processor -- start 2024-09-21T07:53:50.430 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.663+0000 7f11d1ca4640 1 -- start start 2024-09-21T07:53:50.430 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.663+0000 7f11d1ca4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11cc102070 0x7f11cc078c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:50.430 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.663+0000 7f11d1ca4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc079140 con 0x7f11cc102070 2024-09-21T07:53:50.430 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.663+0000 7f11cb7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11cc102070 0x7f11cc078c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:50.430 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.663+0000 7f11cb7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11cc102070 0x7f11cc078c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50520/0 (socket says 172.21.15.107:50520) 2024-09-21T07:53:50.430 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.663+0000 7f11cb7fe640 1 -- 172.21.15.107:0/3535217218 learned_addr learned my addr 172.21.15.107:0/3535217218 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:50.430 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.664+0000 7f11cb7fe640 1 -- 172.21.15.107:0/3535217218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc009450 con 0x7f11cc102070 2024-09-21T07:53:50.430 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.664+0000 7f11cb7fe640 1 --2- 172.21.15.107:0/3535217218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11cc102070 0x7f11cc078c00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0098a0 tx=0x7f11bc02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:50.430 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.664+0000 7f11c8ff9640 1 -- 172.21.15.107:0/3535217218 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11bc0327b0 con 0x7f11cc102070 2024-09-21T07:53:50.430 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.664+0000 7f11d1ca4640 1 -- 172.21.15.107:0/3535217218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11cc0771d0 con 0x7f11cc102070 2024-09-21T07:53:50.430 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.664+0000 7f11c8ff9640 1 -- 172.21.15.107:0/3535217218 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f11bc03b870 con 0x7f11cc102070 2024-09-21T07:53:50.431 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.664+0000 7f11c8ff9640 1 -- 172.21.15.107:0/3535217218 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11bc03a550 con 0x7f11cc102070 2024-09-21T07:53:50.431 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.664+0000 7f11d1ca4640 1 -- 172.21.15.107:0/3535217218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11cc077640 con 0x7f11cc102070 2024-09-21T07:53:50.431 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.665+0000 7f11c8ff9640 1 -- 172.21.15.107:0/3535217218 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f11bc039040 con 0x7f11cc102070 2024-09-21T07:53:50.431 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.665+0000 7f11c8ff9640 1 --2- 172.21.15.107:0/3535217218 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f11b8039450 0x7f11b803b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:50.431 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.665+0000 7f11c8ff9640 1 -- 172.21.15.107:0/3535217218 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f11bc06c840 con 0x7f11cc102070 2024-09-21T07:53:50.431 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.665+0000 7f11d1ca4640 1 -- 172.21.15.107:0/3535217218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11cc04b720 con 0x7f11cc102070 2024-09-21T07:53:50.431 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.665+0000 7f11c2ffd640 1 --2- 172.21.15.107:0/3535217218 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f11b8039450 0x7f11b803b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:50.431 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.666+0000 7f11c2ffd640 1 --2- 172.21.15.107:0/3535217218 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f11b8039450 0x7f11b803b900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f11b4006fd0 tx=0x7f11b4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:50.431 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.670+0000 7f11c8ff9640 1 -- 172.21.15.107:0/3535217218 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f11bc03f080 con 0x7f11cc102070 2024-09-21T07:53:50.431 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.826+0000 7f11d1ca4640 1 -- 172.21.15.107:0/3535217218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f11cc103cf0 con 0x7f11cc102070 2024-09-21T07:53:50.431 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.827+0000 7f11c8ff9640 1 -- 172.21.15.107:0/3535217218 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+409 (secure 0 0 0) 0x7f11bc037070 con 0x7f11cc102070 2024-09-21T07:53:50.431 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.828+0000 7f11d1ca4640 1 -- 172.21.15.107:0/3535217218 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f11b8039450 msgr2=0x7f11b803b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:50.431 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.828+0000 7f11d1ca4640 1 --2- 172.21.15.107:0/3535217218 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f11b8039450 0x7f11b803b900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f11b4006fd0 tx=0x7f11b4006db0 comp rx=0 tx=0).stop 2024-09-21T07:53:50.431 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.828+0000 7f11d1ca4640 1 -- 172.21.15.107:0/3535217218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11cc102070 msgr2=0x7f11cc078c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:50.432 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.828+0000 7f11d1ca4640 1 --2- 172.21.15.107:0/3535217218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11cc102070 0x7f11cc078c00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0098a0 tx=0x7f11bc02c040 comp rx=0 tx=0).stop 2024-09-21T07:53:50.432 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.829+0000 7f11d1ca4640 1 -- 172.21.15.107:0/3535217218 shutdown_connections 2024-09-21T07:53:50.432 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.829+0000 7f11d1ca4640 1 --2- 172.21.15.107:0/3535217218 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f11b8039450 0x7f11b803b900 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:50.432 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.829+0000 7f11d1ca4640 1 --2- 172.21.15.107:0/3535217218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11cc102070 0x7f11cc078c00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:50.432 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.829+0000 7f11d1ca4640 1 -- 172.21.15.107:0/3535217218 >> 172.21.15.107:0/3535217218 conn(0x7f11cc0fd850 msgr2=0x7f11cc0fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:50.432 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.829+0000 7f11d1ca4640 1 -- 172.21.15.107:0/3535217218 shutdown_connections 2024-09-21T07:53:50.432 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:49.829+0000 7f11d1ca4640 1 -- 172.21.15.107:0/3535217218 wait complete. 2024-09-21T07:53:50.432 INFO:teuthology.orchestra.run.smithi107.stdout:Enabling cephadm module... 2024-09-21T07:53:51.428 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:51 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/2323016793' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-21T07:53:51.665 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.802+0000 7fcd5aad2640 1 Processor -- start 2024-09-21T07:53:51.665 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.802+0000 7fcd5aad2640 1 -- start start 2024-09-21T07:53:51.665 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.802+0000 7fcd5aad2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd541035d0 0x7fcd541039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:51.665 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.802+0000 7fcd5aad2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd54070e30 con 0x7fcd541035d0 2024-09-21T07:53:51.665 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.802+0000 7fcd5886e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd541035d0 0x7fcd541039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:51.665 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.802+0000 7fcd5886e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd541035d0 0x7fcd541039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50528/0 (socket says 172.21.15.107:50528) 2024-09-21T07:53:51.665 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.802+0000 7fcd5886e640 1 -- 172.21.15.107:0/2818771217 learned_addr learned my addr 172.21.15.107:0/2818771217 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:51.665 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.803+0000 7fcd5886e640 1 -- 172.21.15.107:0/2818771217 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd54103f20 con 0x7fcd541035d0 2024-09-21T07:53:51.665 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.803+0000 7fcd5886e640 1 --2- 172.21.15.107:0/2818771217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd541035d0 0x7fcd541039e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009840 tx=0x7fcd480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2f1307fc5d322 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:51.665 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.803+0000 7fcd537fe640 1 -- 172.21.15.107:0/2818771217 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd48032440 con 0x7fcd541035d0 2024-09-21T07:53:51.665 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.804+0000 7fcd537fe640 1 -- 172.21.15.107:0/2818771217 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fcd48032a00 con 0x7fcd541035d0 2024-09-21T07:53:51.665 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.804+0000 7fcd537fe640 1 -- 172.21.15.107:0/2818771217 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd480319e0 con 0x7fcd541035d0 2024-09-21T07:53:51.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.804+0000 7fcd5aad2640 1 -- 172.21.15.107:0/2818771217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd541035d0 msgr2=0x7fcd541039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:51.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.804+0000 7fcd5aad2640 1 --2- 172.21.15.107:0/2818771217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd541035d0 0x7fcd541039e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009840 tx=0x7fcd480091d0 comp rx=0 tx=0).stop 2024-09-21T07:53:51.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.804+0000 7fcd5aad2640 1 -- 172.21.15.107:0/2818771217 shutdown_connections 2024-09-21T07:53:51.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.804+0000 7fcd5aad2640 1 --2- 172.21.15.107:0/2818771217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd541035d0 0x7fcd541039e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:51.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.804+0000 7fcd5aad2640 1 -- 172.21.15.107:0/2818771217 >> 172.21.15.107:0/2818771217 conn(0x7fcd540fbdd0 msgr2=0x7fcd540fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:51.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.804+0000 7fcd5aad2640 1 -- 172.21.15.107:0/2818771217 shutdown_connections 2024-09-21T07:53:51.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.804+0000 7fcd5aad2640 1 -- 172.21.15.107:0/2818771217 wait complete. 2024-09-21T07:53:51.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.805+0000 7fcd5aad2640 1 Processor -- start 2024-09-21T07:53:51.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.805+0000 7fcd5aad2640 1 -- start start 2024-09-21T07:53:51.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.805+0000 7fcd5aad2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd541035d0 0x7fcd54110e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:51.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.805+0000 7fcd5aad2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd54111350 con 0x7fcd541035d0 2024-09-21T07:53:51.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.805+0000 7fcd5886e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd541035d0 0x7fcd54110e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:51.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.805+0000 7fcd5886e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd541035d0 0x7fcd54110e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50544/0 (socket says 172.21.15.107:50544) 2024-09-21T07:53:51.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.805+0000 7fcd5886e640 1 -- 172.21.15.107:0/2323016793 learned_addr learned my addr 172.21.15.107:0/2323016793 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:51.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.805+0000 7fcd5886e640 1 -- 172.21.15.107:0/2323016793 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd48009450 con 0x7fcd541035d0 2024-09-21T07:53:51.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.806+0000 7fcd5886e640 1 --2- 172.21.15.107:0/2323016793 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd541035d0 0x7fcd54110e10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcd480098a0 tx=0x7fcd48008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:51.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.806+0000 7fcd517fa640 1 -- 172.21.15.107:0/2323016793 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd48032880 con 0x7fcd541035d0 2024-09-21T07:53:51.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.806+0000 7fcd517fa640 1 -- 172.21.15.107:0/2323016793 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fcd4803d8b0 con 0x7fcd541035d0 2024-09-21T07:53:51.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.806+0000 7fcd5aad2640 1 -- 172.21.15.107:0/2323016793 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd54111550 con 0x7fcd541035d0 2024-09-21T07:53:51.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.806+0000 7fcd517fa640 1 -- 172.21.15.107:0/2323016793 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd4803b910 con 0x7fcd541035d0 2024-09-21T07:53:51.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.806+0000 7fcd5aad2640 1 -- 172.21.15.107:0/2323016793 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd54111fa0 con 0x7fcd541035d0 2024-09-21T07:53:51.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.807+0000 7fcd517fa640 1 -- 172.21.15.107:0/2323016793 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7fcd48039070 con 0x7fcd541035d0 2024-09-21T07:53:51.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.807+0000 7fcd5aad2640 1 -- 172.21.15.107:0/2323016793 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd540ffa70 con 0x7fcd541035d0 2024-09-21T07:53:51.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.807+0000 7fcd517fa640 1 --2- 172.21.15.107:0/2323016793 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7fcd44039450 0x7fcd4403b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:51.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.807+0000 7fcd517fa640 1 -- 172.21.15.107:0/2323016793 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fcd4806cf00 con 0x7fcd541035d0 2024-09-21T07:53:51.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.807+0000 7fcd53fff640 1 --2- 172.21.15.107:0/2323016793 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7fcd44039450 0x7fcd4403b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:51.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.807+0000 7fcd53fff640 1 --2- 172.21.15.107:0/2323016793 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7fcd44039450 0x7fcd4403b900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcd40006fd0 tx=0x7fcd40006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:51.668 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:50.812+0000 7fcd517fa640 1 -- 172.21.15.107:0/2323016793 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcd4804e7c0 con 0x7fcd541035d0 2024-09-21T07:53:51.668 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:51.005+0000 7fcd5aad2640 1 -- 172.21.15.107:0/2323016793 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fcd5404b720 con 0x7fcd541035d0 2024-09-21T07:53:51.668 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:51.058+0000 7fcd517fa640 1 -- 172.21.15.107:0/2323016793 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fcd4804e9a0 con 0x7fcd541035d0 2024-09-21T07:53:51.668 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:51.059+0000 7fcd517fa640 1 -- 172.21.15.107:0/2323016793 <== mon.0 v2:172.21.15.107:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fcd4803a560 con 0x7fcd541035d0 2024-09-21T07:53:51.668 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:51.062+0000 7fcd5aad2640 1 -- 172.21.15.107:0/2323016793 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7fcd44039450 msgr2=0x7fcd4403b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:51.668 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:51.062+0000 7fcd5aad2640 1 --2- 172.21.15.107:0/2323016793 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7fcd44039450 0x7fcd4403b900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcd40006fd0 tx=0x7fcd40006db0 comp rx=0 tx=0).stop 2024-09-21T07:53:51.668 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:51.062+0000 7fcd5aad2640 1 -- 172.21.15.107:0/2323016793 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd541035d0 msgr2=0x7fcd54110e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:51.668 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:51.062+0000 7fcd5aad2640 1 --2- 172.21.15.107:0/2323016793 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd541035d0 0x7fcd54110e10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcd480098a0 tx=0x7fcd48008040 comp rx=0 tx=0).stop 2024-09-21T07:53:51.668 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:51.062+0000 7fcd5aad2640 1 -- 172.21.15.107:0/2323016793 shutdown_connections 2024-09-21T07:53:51.668 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:51.062+0000 7fcd5aad2640 1 --2- 172.21.15.107:0/2323016793 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7fcd44039450 0x7fcd4403b900 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:51.668 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:51.062+0000 7fcd5aad2640 1 --2- 172.21.15.107:0/2323016793 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd541035d0 0x7fcd54110e10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:51.668 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:51.062+0000 7fcd5aad2640 1 -- 172.21.15.107:0/2323016793 >> 172.21.15.107:0/2323016793 conn(0x7fcd540fbdd0 msgr2=0x7fcd540fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:51.668 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:51.062+0000 7fcd5aad2640 1 -- 172.21.15.107:0/2323016793 shutdown_connections 2024-09-21T07:53:51.669 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:51.062+0000 7fcd5aad2640 1 -- 172.21.15.107:0/2323016793 wait complete. 2024-09-21T07:53:52.300 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:52 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/2323016793' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T07:53:52.301 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:52 smithi107 ceph-mon[27622]: mgrmap e5: smithi107.wzulxb(active, since 5s) 2024-09-21T07:53:52.938 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:53:52.938 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T07:53:52.938 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T07:53:52.938 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "active_name": "smithi107.wzulxb", 2024-09-21T07:53:52.938 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T07:53:52.938 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:53:52.939 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.040+0000 7ffb26703640 1 Processor -- start 2024-09-21T07:53:52.939 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.041+0000 7ffb26703640 1 -- start start 2024-09-21T07:53:52.939 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.041+0000 7ffb26703640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb20076b30 0x7ffb20104bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:52.939 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.041+0000 7ffb26703640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb20076f40 con 0x7ffb20076b30 2024-09-21T07:53:52.939 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.041+0000 7ffb1ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb20076b30 0x7ffb20104bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:52.939 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.041+0000 7ffb1ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb20076b30 0x7ffb20104bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51586/0 (socket says 172.21.15.107:51586) 2024-09-21T07:53:52.939 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.041+0000 7ffb1ffff640 1 -- 172.21.15.107:0/2171986452 learned_addr learned my addr 172.21.15.107:0/2171986452 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:52.939 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.041+0000 7ffb1ffff640 1 -- 172.21.15.107:0/2171986452 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb20105100 con 0x7ffb20076b30 2024-09-21T07:53:52.939 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.042+0000 7ffb1ffff640 1 --2- 172.21.15.107:0/2171986452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb20076b30 0x7ffb20104bc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009840 tx=0x7ffb100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=252f78b58a7e6e68 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:52.939 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.042+0000 7ffb1f7fe640 1 -- 172.21.15.107:0/2171986452 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb10032440 con 0x7ffb20076b30 2024-09-21T07:53:52.939 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.042+0000 7ffb1f7fe640 1 -- 172.21.15.107:0/2171986452 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ffb10032a00 con 0x7ffb20076b30 2024-09-21T07:53:52.939 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.042+0000 7ffb1f7fe640 1 -- 172.21.15.107:0/2171986452 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb10031a10 con 0x7ffb20076b30 2024-09-21T07:53:52.939 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.043+0000 7ffb26703640 1 -- 172.21.15.107:0/2171986452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb20076b30 msgr2=0x7ffb20104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:52.940 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.043+0000 7ffb26703640 1 --2- 172.21.15.107:0/2171986452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb20076b30 0x7ffb20104bc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009840 tx=0x7ffb100091d0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.940 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.043+0000 7ffb26703640 1 -- 172.21.15.107:0/2171986452 shutdown_connections 2024-09-21T07:53:52.940 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.043+0000 7ffb26703640 1 --2- 172.21.15.107:0/2171986452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb20076b30 0x7ffb20104bc0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.940 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.043+0000 7ffb26703640 1 -- 172.21.15.107:0/2171986452 >> 172.21.15.107:0/2171986452 conn(0x7ffb200fc6d0 msgr2=0x7ffb200feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:52.940 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.043+0000 7ffb26703640 1 -- 172.21.15.107:0/2171986452 shutdown_connections 2024-09-21T07:53:52.940 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.043+0000 7ffb26703640 1 -- 172.21.15.107:0/2171986452 wait complete. 2024-09-21T07:53:52.940 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.044+0000 7ffb26703640 1 Processor -- start 2024-09-21T07:53:52.940 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.044+0000 7ffb26703640 1 -- start start 2024-09-21T07:53:52.940 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.044+0000 7ffb26703640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb20076b30 0x7ffb20110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:52.940 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.044+0000 7ffb26703640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb20111340 con 0x7ffb20076b30 2024-09-21T07:53:52.940 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.044+0000 7ffb1ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb20076b30 0x7ffb20110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:52.940 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.044+0000 7ffb1ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb20076b30 0x7ffb20110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51590/0 (socket says 172.21.15.107:51590) 2024-09-21T07:53:52.940 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.044+0000 7ffb1ffff640 1 -- 172.21.15.107:0/763422770 learned_addr learned my addr 172.21.15.107:0/763422770 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:52.941 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.044+0000 7ffb1ffff640 1 -- 172.21.15.107:0/763422770 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb10009450 con 0x7ffb20076b30 2024-09-21T07:53:52.941 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.044+0000 7ffb1ffff640 1 --2- 172.21.15.107:0/763422770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb20076b30 0x7ffb20110e00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffb10006a70 tx=0x7ffb1002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:52.941 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.044+0000 7ffb1d7fa640 1 -- 172.21.15.107:0/763422770 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb10031d10 con 0x7ffb20076b30 2024-09-21T07:53:52.941 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.045+0000 7ffb1d7fa640 1 -- 172.21.15.107:0/763422770 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ffb10031e70 con 0x7ffb20076b30 2024-09-21T07:53:52.941 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.045+0000 7ffb26703640 1 -- 172.21.15.107:0/763422770 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb20111540 con 0x7ffb20076b30 2024-09-21T07:53:52.941 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.045+0000 7ffb1d7fa640 1 -- 172.21.15.107:0/763422770 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb1003b6f0 con 0x7ffb20076b30 2024-09-21T07:53:52.941 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.045+0000 7ffb26703640 1 -- 172.21.15.107:0/763422770 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb20111f90 con 0x7ffb20076b30 2024-09-21T07:53:52.941 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.045+0000 7ffb1d7fa640 1 -- 172.21.15.107:0/763422770 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7ffb10039070 con 0x7ffb20076b30 2024-09-21T07:53:52.941 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.046+0000 7ffb1d7fa640 1 --2- 172.21.15.107:0/763422770 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7ffb0c039490 0x7ffb0c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:52.941 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.046+0000 7ffb1d7fa640 1 -- 172.21.15.107:0/763422770 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ffb1006ca80 con 0x7ffb20076b30 2024-09-21T07:53:52.941 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.046+0000 7ffb17fff640 1 -- 172.21.15.107:0/763422770 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7ffb0c039490 msgr2=0x7ffb0c03b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/287926342 2024-09-21T07:53:52.941 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.046+0000 7ffb17fff640 1 --2- 172.21.15.107:0/763422770 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7ffb0c039490 0x7ffb0c03b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T07:53:52.941 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.046+0000 7ffb26703640 1 -- 172.21.15.107:0/763422770 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb201002f0 con 0x7ffb20076b30 2024-09-21T07:53:52.941 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.050+0000 7ffb1d7fa640 1 -- 172.21.15.107:0/763422770 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ffb10037030 con 0x7ffb20076b30 2024-09-21T07:53:52.941 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.247+0000 7ffb17fff640 1 -- 172.21.15.107:0/763422770 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7ffb0c039490 msgr2=0x7ffb0c03b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/287926342 2024-09-21T07:53:52.942 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.247+0000 7ffb17fff640 1 --2- 172.21.15.107:0/763422770 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7ffb0c039490 0x7ffb0c03b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-21T07:53:52.942 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.299+0000 7ffb26703640 1 -- 172.21.15.107:0/763422770 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ffb20112270 con 0x7ffb20076b30 2024-09-21T07:53:52.942 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.299+0000 7ffb1d7fa640 1 -- 172.21.15.107:0/763422770 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7ffb10047460 con 0x7ffb20076b30 2024-09-21T07:53:52.942 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.301+0000 7ffb26703640 1 -- 172.21.15.107:0/763422770 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7ffb0c039490 msgr2=0x7ffb0c03b940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:53:52.942 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.301+0000 7ffb26703640 1 --2- 172.21.15.107:0/763422770 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7ffb0c039490 0x7ffb0c03b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.942 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.301+0000 7ffb26703640 1 -- 172.21.15.107:0/763422770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb20076b30 msgr2=0x7ffb20110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:52.942 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.301+0000 7ffb26703640 1 --2- 172.21.15.107:0/763422770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb20076b30 0x7ffb20110e00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffb10006a70 tx=0x7ffb1002c040 comp rx=0 tx=0).stop 2024-09-21T07:53:52.942 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.301+0000 7ffb26703640 1 -- 172.21.15.107:0/763422770 shutdown_connections 2024-09-21T07:53:52.942 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.301+0000 7ffb26703640 1 --2- 172.21.15.107:0/763422770 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7ffb0c039490 0x7ffb0c03b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.942 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.301+0000 7ffb26703640 1 --2- 172.21.15.107:0/763422770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb20076b30 0x7ffb20110e00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.942 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.301+0000 7ffb26703640 1 -- 172.21.15.107:0/763422770 >> 172.21.15.107:0/763422770 conn(0x7ffb200fc6d0 msgr2=0x7ffb200fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:52.942 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.301+0000 7ffb26703640 1 -- 172.21.15.107:0/763422770 shutdown_connections 2024-09-21T07:53:52.942 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:52.302+0000 7ffb26703640 1 -- 172.21.15.107:0/763422770 wait complete. 2024-09-21T07:53:52.942 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for the mgr to restart... 2024-09-21T07:53:52.942 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for mgr epoch 5... 2024-09-21T07:53:53.183 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:53 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/763422770' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-21T07:53:55.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:55 smithi107 ceph-mon[27622]: Active manager daemon smithi107.wzulxb restarted 2024-09-21T07:53:55.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:55 smithi107 ceph-mon[27622]: Activating manager daemon smithi107.wzulxb 2024-09-21T07:53:55.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:55 smithi107 ceph-mon[27622]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T07:53:55.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:55 smithi107 ceph-mon[27622]: mgrmap e6: smithi107.wzulxb(active, starting, since 0.0036185s) 2024-09-21T07:53:55.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:55 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-21T07:53:55.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:55 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr metadata", "who": "smithi107.wzulxb", "id": "smithi107.wzulxb"}]: dispatch 2024-09-21T07:53:55.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:55 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T07:53:55.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:55 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T07:53:55.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:55 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T07:53:55.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:55 smithi107 ceph-mon[27622]: Manager daemon smithi107.wzulxb is now available 2024-09-21T07:53:55.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:55 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' 2024-09-21T07:53:55.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:55 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' 2024-09-21T07:53:55.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:55 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:53:55.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:55 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:53:55.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:55 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.wzulxb/mirror_snapshot_schedule"}]: dispatch 2024-09-21T07:53:55.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:55 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.wzulxb/trash_purge_schedule"}]: dispatch 2024-09-21T07:53:56.743 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:56 smithi107 ceph-mon[27622]: Found migration_current of "None". Setting to last migration. 2024-09-21T07:53:56.743 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:56 smithi107 ceph-mon[27622]: mgrmap e7: smithi107.wzulxb(active, since 1.00527s) 2024-09-21T07:53:57.027 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:53:57.027 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T07:53:57.027 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T07:53:57.028 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:53:57.028 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.356+0000 7f8851c51640 1 Processor -- start 2024-09-21T07:53:57.028 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.356+0000 7f8851c51640 1 -- start start 2024-09-21T07:53:57.028 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.356+0000 7f8851c51640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f884c078c10 0x7f884c077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:57.028 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.356+0000 7f8851c51640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c079020 con 0x7f884c078c10 2024-09-21T07:53:57.028 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.356+0000 7f884b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f884c078c10 0x7f884c077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:57.028 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.356+0000 7f884b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f884c078c10 0x7f884c077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51592/0 (socket says 172.21.15.107:51592) 2024-09-21T07:53:57.028 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.356+0000 7f884b7fe640 1 -- 172.21.15.107:0/1488708469 learned_addr learned my addr 172.21.15.107:0/1488708469 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:57.028 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.356+0000 7f884b7fe640 1 -- 172.21.15.107:0/1488708469 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c077770 con 0x7f884c078c10 2024-09-21T07:53:57.028 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.357+0000 7f884b7fe640 1 --2- 172.21.15.107:0/1488708469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f884c078c10 0x7f884c077230 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f883c009840 tx=0x7f883c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d338cd4e1f7dabb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:57.028 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.357+0000 7f884a7fc640 1 -- 172.21.15.107:0/1488708469 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f883c032440 con 0x7f884c078c10 2024-09-21T07:53:57.028 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.357+0000 7f884a7fc640 1 -- 172.21.15.107:0/1488708469 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f883c032a00 con 0x7f884c078c10 2024-09-21T07:53:57.028 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.357+0000 7f884a7fc640 1 -- 172.21.15.107:0/1488708469 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f883c0319e0 con 0x7f884c078c10 2024-09-21T07:53:57.028 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.358+0000 7f8851c51640 1 -- 172.21.15.107:0/1488708469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f884c078c10 msgr2=0x7f884c077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:57.028 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.358+0000 7f8851c51640 1 --2- 172.21.15.107:0/1488708469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f884c078c10 0x7f884c077230 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f883c009840 tx=0x7f883c0091d0 comp rx=0 tx=0).stop 2024-09-21T07:53:57.028 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.358+0000 7f8851c51640 1 -- 172.21.15.107:0/1488708469 shutdown_connections 2024-09-21T07:53:57.029 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.358+0000 7f8851c51640 1 --2- 172.21.15.107:0/1488708469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f884c078c10 0x7f884c077230 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:57.029 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.358+0000 7f8851c51640 1 -- 172.21.15.107:0/1488708469 >> 172.21.15.107:0/1488708469 conn(0x7f884c0fd790 msgr2=0x7f884c0ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:57.029 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.358+0000 7f8851c51640 1 -- 172.21.15.107:0/1488708469 shutdown_connections 2024-09-21T07:53:57.029 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.358+0000 7f8851c51640 1 -- 172.21.15.107:0/1488708469 wait complete. 2024-09-21T07:53:57.029 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.359+0000 7f8851c51640 1 Processor -- start 2024-09-21T07:53:57.029 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.359+0000 7f8851c51640 1 -- start start 2024-09-21T07:53:57.029 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.359+0000 7f8851c51640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f884c078c10 0x7f884c112fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:57.029 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.359+0000 7f8851c51640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c113510 con 0x7f884c078c10 2024-09-21T07:53:57.029 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.359+0000 7f884b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f884c078c10 0x7f884c112fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:57.029 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.359+0000 7f884b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f884c078c10 0x7f884c112fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51604/0 (socket says 172.21.15.107:51604) 2024-09-21T07:53:57.029 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.359+0000 7f884b7fe640 1 -- 172.21.15.107:0/2279685089 learned_addr learned my addr 172.21.15.107:0/2279685089 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:57.029 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.359+0000 7f884b7fe640 1 -- 172.21.15.107:0/2279685089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c009450 con 0x7f884c078c10 2024-09-21T07:53:57.029 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.360+0000 7f884b7fe640 1 --2- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f884c078c10 0x7f884c112fd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f883c0098a0 tx=0x7f883c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:57.029 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.360+0000 7f8833fff640 1 -- 172.21.15.107:0/2279685089 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f883c032880 con 0x7f884c078c10 2024-09-21T07:53:57.029 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.360+0000 7f8833fff640 1 -- 172.21.15.107:0/2279685089 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f883c03d8b0 con 0x7f884c078c10 2024-09-21T07:53:57.029 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.360+0000 7f8851c51640 1 -- 172.21.15.107:0/2279685089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884c113710 con 0x7f884c078c10 2024-09-21T07:53:57.029 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.360+0000 7f8851c51640 1 -- 172.21.15.107:0/2279685089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884c113b80 con 0x7f884c078c10 2024-09-21T07:53:57.030 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.360+0000 7f8833fff640 1 -- 172.21.15.107:0/2279685089 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f883c03b8e0 con 0x7f884c078c10 2024-09-21T07:53:57.030 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.361+0000 7f8833fff640 1 -- 172.21.15.107:0/2279685089 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f883c039070 con 0x7f884c078c10 2024-09-21T07:53:57.030 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.361+0000 7f8833fff640 1 --2- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f88340394e0 0x7f883403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:57.030 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.361+0000 7f8833fff640 1 -- 172.21.15.107:0/2279685089 --> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f883403c0a0 con 0x7f88340394e0 2024-09-21T07:53:57.030 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.361+0000 7f8833fff640 1 -- 172.21.15.107:0/2279685089 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f883c06ccd0 con 0x7f884c078c10 2024-09-21T07:53:57.030 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.361+0000 7f884affd640 1 -- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f88340394e0 msgr2=0x7f883403b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/287926342 2024-09-21T07:53:57.030 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.361+0000 7f884affd640 1 --2- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f88340394e0 0x7f883403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T07:53:57.030 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.562+0000 7f884affd640 1 -- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f88340394e0 msgr2=0x7f883403b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/287926342 2024-09-21T07:53:57.030 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.562+0000 7f884affd640 1 --2- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f88340394e0 0x7f883403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-21T07:53:57.030 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.963+0000 7f884affd640 1 -- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f88340394e0 msgr2=0x7f883403b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/287926342 2024-09-21T07:53:57.030 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:53.963+0000 7f884affd640 1 --2- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f88340394e0 0x7f883403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-21T07:53:57.030 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:54.764+0000 7f884affd640 1 -- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f88340394e0 msgr2=0x7f883403b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/287926342 2024-09-21T07:53:57.030 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:54.764+0000 7f884affd640 1 --2- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f88340394e0 0x7f883403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-21T07:53:57.030 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:55.455+0000 7f8833fff640 1 -- 172.21.15.107:0/2279685089 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mgrmap(e 6) v1 ==== 45274+0+0 (secure 0 0 0) 0x7f883c06c1d0 con 0x7f884c078c10 2024-09-21T07:53:57.030 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:55.455+0000 7f8833fff640 1 -- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f88340394e0 msgr2=0x7f883403b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:53:57.031 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:55.455+0000 7f8833fff640 1 --2- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f88340394e0 0x7f883403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:57.031 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:56.455+0000 7f8833fff640 1 -- 172.21.15.107:0/2279685089 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 7) v1 ==== 45401+0+0 (secure 0 0 0) 0x7f883c03ac80 con 0x7f884c078c10 2024-09-21T07:53:57.031 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:56.455+0000 7f8833fff640 1 --2- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f883403cdf0 0x7f883403f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:57.031 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:56.455+0000 7f8833fff640 1 -- 172.21.15.107:0/2279685089 --> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f883403c0a0 con 0x7f883403cdf0 2024-09-21T07:53:57.031 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:56.456+0000 7f884affd640 1 --2- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f883403cdf0 0x7f883403f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:57.031 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:56.457+0000 7f884affd640 1 --2- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f883403cdf0 0x7f883403f1d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8840003940 tx=0x7f8840009350 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:57.031 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:56.457+0000 7f8833fff640 1 -- 172.21.15.107:0/2279685089 <== mgr.14118 v2:172.21.15.107:6800/2912640406 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f883403c0a0 con 0x7f883403cdf0 2024-09-21T07:53:57.031 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:56.462+0000 7f8851c51640 1 -- 172.21.15.107:0/2279685089 --> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f884c113b80 con 0x7f883403cdf0 2024-09-21T07:53:57.031 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:56.462+0000 7f8833fff640 1 -- 172.21.15.107:0/2279685089 <== mgr.14118 v2:172.21.15.107:6800/2912640406 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f884c113b80 con 0x7f883403cdf0 2024-09-21T07:53:57.031 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:56.462+0000 7f8851c51640 1 -- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f883403cdf0 msgr2=0x7f883403f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:57.031 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:56.462+0000 7f8851c51640 1 --2- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f883403cdf0 0x7f883403f1d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8840003940 tx=0x7f8840009350 comp rx=0 tx=0).stop 2024-09-21T07:53:57.031 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:56.462+0000 7f8851c51640 1 -- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f884c078c10 msgr2=0x7f884c112fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:57.031 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:56.462+0000 7f8851c51640 1 --2- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f884c078c10 0x7f884c112fd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f883c0098a0 tx=0x7f883c008040 comp rx=0 tx=0).stop 2024-09-21T07:53:57.031 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:56.462+0000 7f8851c51640 1 -- 172.21.15.107:0/2279685089 shutdown_connections 2024-09-21T07:53:57.031 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:56.462+0000 7f8851c51640 1 --2- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f883403cdf0 0x7f883403f1d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:57.031 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:56.462+0000 7f8851c51640 1 --2- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:6800/287926342,v1:172.21.15.107:6801/287926342] conn(0x7f88340394e0 0x7f883403b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:57.032 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:56.463+0000 7f8851c51640 1 --2- 172.21.15.107:0/2279685089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f884c078c10 0x7f884c112fd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:57.032 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:56.463+0000 7f8851c51640 1 -- 172.21.15.107:0/2279685089 >> 172.21.15.107:0/2279685089 conn(0x7f884c0fd790 msgr2=0x7f884c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:57.032 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:56.463+0000 7f8851c51640 1 -- 172.21.15.107:0/2279685089 shutdown_connections 2024-09-21T07:53:57.032 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:56.463+0000 7f8851c51640 1 -- 172.21.15.107:0/2279685089 wait complete. 2024-09-21T07:53:57.032 INFO:teuthology.orchestra.run.smithi107.stdout:mgr epoch 5 is available 2024-09-21T07:53:57.032 INFO:teuthology.orchestra.run.smithi107.stdout:Setting orchestrator backend to cephadm... 2024-09-21T07:53:58.125 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:58 smithi107 ceph-mon[27622]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T07:53:58.125 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:58 smithi107 ceph-mon[27622]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T07:53:58.125 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:58 smithi107 ceph-mon[27622]: [21/Sep/2024:07:53:56] ENGINE Bus STARTING 2024-09-21T07:53:58.125 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:58 smithi107 ceph-mon[27622]: [21/Sep/2024:07:53:57] ENGINE Serving on https://172.21.15.107:7150 2024-09-21T07:53:58.125 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:58 smithi107 ceph-mon[27622]: [21/Sep/2024:07:53:57] ENGINE Bus STARTED 2024-09-21T07:53:58.125 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:58 smithi107 ceph-mon[27622]: [21/Sep/2024:07:53:57] ENGINE Error in HTTPServer.serve 2024-09-21T07:53:58.125 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Traceback (most recent call last): 2024-09-21T07:53:58.125 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:53:58.125 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._connections.run(self.expiration_interval) 2024-09-21T07:53:58.126 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:53:58.126 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._run(expiration_interval) 2024-09-21T07:53:58.126 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:53:58.126 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:53:58.126 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:53:58.126 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:53:58.126 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:53:58.126 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: s = self.context.wrap_socket( 2024-09-21T07:53:58.126 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:53:58.126 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: return self.sslsocket_class._create( 2024-09-21T07:53:58.126 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:53:58.126 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self.do_handshake() 2024-09-21T07:53:58.127 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:53:58.127 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._sslobj.do_handshake() 2024-09-21T07:53:58.127 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:53:58.127 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:58 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' 2024-09-21T07:53:58.127 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:58 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:53:58.127 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:58 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' 2024-09-21T07:53:58.127 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:58 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:53:58.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.376+0000 7fd8f7ed5640 1 Processor -- start 2024-09-21T07:53:58.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.376+0000 7fd8f7ed5640 1 -- start start 2024-09-21T07:53:58.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.376+0000 7fd8f7ed5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f0078ab0 0x7fd8f0077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:58.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.376+0000 7fd8f7ed5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f0078f50 con 0x7fd8f0078ab0 2024-09-21T07:53:58.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.377+0000 7fd8f5c71640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f0078ab0 0x7fd8f0077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:58.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.377+0000 7fd8f5c71640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f0078ab0 0x7fd8f0077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51666/0 (socket says 172.21.15.107:51666) 2024-09-21T07:53:58.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.377+0000 7fd8f5c71640 1 -- 172.21.15.107:0/2010300013 learned_addr learned my addr 172.21.15.107:0/2010300013 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:58.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.377+0000 7fd8f5c71640 1 -- 172.21.15.107:0/2010300013 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f0079090 con 0x7fd8f0078ab0 2024-09-21T07:53:58.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.377+0000 7fd8f5c71640 1 --2- 172.21.15.107:0/2010300013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f0078ab0 0x7fd8f0077210 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009840 tx=0x7fd8ec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96057f7e2e02107 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:58.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.378+0000 7fd8f4c6f640 1 -- 172.21.15.107:0/2010300013 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8ec032440 con 0x7fd8f0078ab0 2024-09-21T07:53:58.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.378+0000 7fd8f4c6f640 1 -- 172.21.15.107:0/2010300013 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fd8ec032a00 con 0x7fd8f0078ab0 2024-09-21T07:53:58.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.378+0000 7fd8f4c6f640 1 -- 172.21.15.107:0/2010300013 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8ec0319e0 con 0x7fd8f0078ab0 2024-09-21T07:53:58.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.378+0000 7fd8f7ed5640 1 -- 172.21.15.107:0/2010300013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f0078ab0 msgr2=0x7fd8f0077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:58.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.378+0000 7fd8f7ed5640 1 --2- 172.21.15.107:0/2010300013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f0078ab0 0x7fd8f0077210 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009840 tx=0x7fd8ec0091d0 comp rx=0 tx=0).stop 2024-09-21T07:53:58.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.378+0000 7fd8f7ed5640 1 -- 172.21.15.107:0/2010300013 shutdown_connections 2024-09-21T07:53:58.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.378+0000 7fd8f7ed5640 1 --2- 172.21.15.107:0/2010300013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f0078ab0 0x7fd8f0077210 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:58.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.378+0000 7fd8f7ed5640 1 -- 172.21.15.107:0/2010300013 >> 172.21.15.107:0/2010300013 conn(0x7fd8f00fd8b0 msgr2=0x7fd8f00ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:58.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.378+0000 7fd8f7ed5640 1 -- 172.21.15.107:0/2010300013 shutdown_connections 2024-09-21T07:53:58.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.378+0000 7fd8f7ed5640 1 -- 172.21.15.107:0/2010300013 wait complete. 2024-09-21T07:53:58.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.379+0000 7fd8f7ed5640 1 Processor -- start 2024-09-21T07:53:58.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.379+0000 7fd8f7ed5640 1 -- start start 2024-09-21T07:53:58.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.379+0000 7fd8f7ed5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f0078ab0 0x7fd8f0112f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:58.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.379+0000 7fd8f7ed5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f01134b0 con 0x7fd8f0078ab0 2024-09-21T07:53:58.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.379+0000 7fd8f5c71640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f0078ab0 0x7fd8f0112f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:58.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.379+0000 7fd8f5c71640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f0078ab0 0x7fd8f0112f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51676/0 (socket says 172.21.15.107:51676) 2024-09-21T07:53:58.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.379+0000 7fd8f5c71640 1 -- 172.21.15.107:0/934624095 learned_addr learned my addr 172.21.15.107:0/934624095 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:58.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.379+0000 7fd8f5c71640 1 -- 172.21.15.107:0/934624095 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec009450 con 0x7fd8f0078ab0 2024-09-21T07:53:58.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.379+0000 7fd8f5c71640 1 --2- 172.21.15.107:0/934624095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f0078ab0 0x7fd8f0112f70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec006f00 tx=0x7fd8ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:58.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.380+0000 7fd8e67fc640 1 -- 172.21.15.107:0/934624095 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8ec03b470 con 0x7fd8f0078ab0 2024-09-21T07:53:58.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.380+0000 7fd8e67fc640 1 -- 172.21.15.107:0/934624095 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fd8ec03ba30 con 0x7fd8f0078ab0 2024-09-21T07:53:58.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.380+0000 7fd8f7ed5640 1 -- 172.21.15.107:0/934624095 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f01136b0 con 0x7fd8f0078ab0 2024-09-21T07:53:58.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.380+0000 7fd8e67fc640 1 -- 172.21.15.107:0/934624095 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8ec03a820 con 0x7fd8f0078ab0 2024-09-21T07:53:58.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.380+0000 7fd8f7ed5640 1 -- 172.21.15.107:0/934624095 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f0113b20 con 0x7fd8f0078ab0 2024-09-21T07:53:58.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.380+0000 7fd8e67fc640 1 -- 172.21.15.107:0/934624095 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 45401+0+0 (secure 0 0 0) 0x7fd8ec03aa50 con 0x7fd8f0078ab0 2024-09-21T07:53:58.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.381+0000 7fd8e67fc640 1 --2- 172.21.15.107:0/934624095 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7fd8dc0393d0 0x7fd8dc03b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:58.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.381+0000 7fd8f7ed5640 1 -- 172.21.15.107:0/934624095 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f004b720 con 0x7fd8f0078ab0 2024-09-21T07:53:58.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.381+0000 7fd8e67fc640 1 -- 172.21.15.107:0/934624095 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd8ec06c8a0 con 0x7fd8f0078ab0 2024-09-21T07:53:58.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.381+0000 7fd8f5470640 1 --2- 172.21.15.107:0/934624095 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7fd8dc0393d0 0x7fd8dc03b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:58.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.381+0000 7fd8f5470640 1 --2- 172.21.15.107:0/934624095 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7fd8dc0393d0 0x7fd8dc03b880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0006fd0 tx=0x7fd8e0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:58.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.385+0000 7fd8e67fc640 1 -- 172.21.15.107:0/934624095 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd8ec030520 con 0x7fd8f0078ab0 2024-09-21T07:53:58.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.550+0000 7fd8f7ed5640 1 -- 172.21.15.107:0/934624095 --> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8f0113b20 con 0x7fd8dc0393d0 2024-09-21T07:53:58.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.557+0000 7fd8e67fc640 1 -- 172.21.15.107:0/934624095 <== mgr.14118 v2:172.21.15.107:6800/2912640406 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd8f0113b20 con 0x7fd8dc0393d0 2024-09-21T07:53:58.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.560+0000 7fd8f7ed5640 1 -- 172.21.15.107:0/934624095 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7fd8dc0393d0 msgr2=0x7fd8dc03b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:58.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.560+0000 7fd8f7ed5640 1 --2- 172.21.15.107:0/934624095 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7fd8dc0393d0 0x7fd8dc03b880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0006fd0 tx=0x7fd8e0006db0 comp rx=0 tx=0).stop 2024-09-21T07:53:58.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.560+0000 7fd8f7ed5640 1 -- 172.21.15.107:0/934624095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f0078ab0 msgr2=0x7fd8f0112f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:58.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.560+0000 7fd8f7ed5640 1 --2- 172.21.15.107:0/934624095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f0078ab0 0x7fd8f0112f70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec006f00 tx=0x7fd8ec008040 comp rx=0 tx=0).stop 2024-09-21T07:53:58.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.560+0000 7fd8f7ed5640 1 -- 172.21.15.107:0/934624095 shutdown_connections 2024-09-21T07:53:58.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.560+0000 7fd8f7ed5640 1 --2- 172.21.15.107:0/934624095 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7fd8dc0393d0 0x7fd8dc03b880 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:58.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.560+0000 7fd8f7ed5640 1 --2- 172.21.15.107:0/934624095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f0078ab0 0x7fd8f0112f70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:58.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.560+0000 7fd8f7ed5640 1 -- 172.21.15.107:0/934624095 >> 172.21.15.107:0/934624095 conn(0x7fd8f00fd8b0 msgr2=0x7fd8f00fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:58.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.560+0000 7fd8f7ed5640 1 -- 172.21.15.107:0/934624095 shutdown_connections 2024-09-21T07:53:58.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:57.560+0000 7fd8f7ed5640 1 -- 172.21.15.107:0/934624095 wait complete. 2024-09-21T07:53:59.297 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:59 smithi107 ceph-mon[27622]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:53:59.297 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:53:59 smithi107 ceph-mon[27622]: mgrmap e8: smithi107.wzulxb(active, since 2s) 2024-09-21T07:53:59.304 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T07:53:59.304 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.514+0000 7f7fb0d68640 1 Processor -- start 2024-09-21T07:53:59.305 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.514+0000 7f7fb0d68640 1 -- start start 2024-09-21T07:53:59.305 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.514+0000 7f7fb0d68640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fac076a00 0x7f7fac106fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:59.305 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.514+0000 7f7fb0d68640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac076e10 con 0x7f7fac076a00 2024-09-21T07:53:59.305 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.515+0000 7f7faa59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fac076a00 0x7f7fac106fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:59.305 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.515+0000 7f7faa59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fac076a00 0x7f7fac106fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51690/0 (socket says 172.21.15.107:51690) 2024-09-21T07:53:59.305 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.515+0000 7f7faa59c640 1 -- 172.21.15.107:0/3213864025 learned_addr learned my addr 172.21.15.107:0/3213864025 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:59.305 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.515+0000 7f7faa59c640 1 -- 172.21.15.107:0/3213864025 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac107520 con 0x7f7fac076a00 2024-09-21T07:53:59.305 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.516+0000 7f7faa59c640 1 --2- 172.21.15.107:0/3213864025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fac076a00 0x7f7fac106fe0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009e50 tx=0x7f7f9c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ba234313db28e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:59.305 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.516+0000 7f7fa959a640 1 -- 172.21.15.107:0/3213864025 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f9c031560 con 0x7f7fac076a00 2024-09-21T07:53:59.305 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.516+0000 7f7fa959a640 1 -- 172.21.15.107:0/3213864025 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f7f9c02d050 con 0x7f7fac076a00 2024-09-21T07:53:59.305 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.516+0000 7f7fa959a640 1 -- 172.21.15.107:0/3213864025 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f9c0079b0 con 0x7f7fac076a00 2024-09-21T07:53:59.305 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.516+0000 7f7fb0d68640 1 -- 172.21.15.107:0/3213864025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fac076a00 msgr2=0x7f7fac106fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:59.305 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.516+0000 7f7fb0d68640 1 --2- 172.21.15.107:0/3213864025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fac076a00 0x7f7fac106fe0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009e50 tx=0x7f7f9c009840 comp rx=0 tx=0).stop 2024-09-21T07:53:59.305 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.516+0000 7f7fb0d68640 1 -- 172.21.15.107:0/3213864025 shutdown_connections 2024-09-21T07:53:59.306 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.516+0000 7f7fb0d68640 1 --2- 172.21.15.107:0/3213864025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fac076a00 0x7f7fac106fe0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:59.306 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.516+0000 7f7fb0d68640 1 -- 172.21.15.107:0/3213864025 >> 172.21.15.107:0/3213864025 conn(0x7f7fac0fc6d0 msgr2=0x7f7fac0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:59.306 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.516+0000 7f7fb0d68640 1 -- 172.21.15.107:0/3213864025 shutdown_connections 2024-09-21T07:53:59.306 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.516+0000 7f7fb0d68640 1 -- 172.21.15.107:0/3213864025 wait complete. 2024-09-21T07:53:59.306 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.517+0000 7f7fb0d68640 1 Processor -- start 2024-09-21T07:53:59.306 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.517+0000 7f7fb0d68640 1 -- start start 2024-09-21T07:53:59.306 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.517+0000 7f7fb0d68640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fac076a00 0x7f7fac112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:59.306 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.517+0000 7f7fb0d68640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac113490 con 0x7f7fac076a00 2024-09-21T07:53:59.306 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.517+0000 7f7faa59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fac076a00 0x7f7fac112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:59.306 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.517+0000 7f7faa59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fac076a00 0x7f7fac112f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51694/0 (socket says 172.21.15.107:51694) 2024-09-21T07:53:59.306 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.517+0000 7f7faa59c640 1 -- 172.21.15.107:0/2316555113 learned_addr learned my addr 172.21.15.107:0/2316555113 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:53:59.306 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.517+0000 7f7faa59c640 1 -- 172.21.15.107:0/2316555113 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9c009ae0 con 0x7f7fac076a00 2024-09-21T07:53:59.306 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.518+0000 7f7faa59c640 1 --2- 172.21.15.107:0/2316555113 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fac076a00 0x7f7fac112f50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c007690 tx=0x7f7f9c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:59.307 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.518+0000 7f7f9affd640 1 -- 172.21.15.107:0/2316555113 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f9c031b70 con 0x7f7fac076a00 2024-09-21T07:53:59.307 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.518+0000 7f7f9affd640 1 -- 172.21.15.107:0/2316555113 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f7f9c031cd0 con 0x7f7fac076a00 2024-09-21T07:53:59.307 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.518+0000 7f7fb0d68640 1 -- 172.21.15.107:0/2316555113 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fac113690 con 0x7f7fac076a00 2024-09-21T07:53:59.307 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.518+0000 7f7f9affd640 1 -- 172.21.15.107:0/2316555113 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f9c0445a0 con 0x7f7fac076a00 2024-09-21T07:53:59.307 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.518+0000 7f7fb0d68640 1 -- 172.21.15.107:0/2316555113 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac113b00 con 0x7f7fac076a00 2024-09-21T07:53:59.307 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.519+0000 7f7f9affd640 1 -- 172.21.15.107:0/2316555113 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f7f9c038040 con 0x7f7fac076a00 2024-09-21T07:53:59.307 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.519+0000 7f7fb0d68640 1 -- 172.21.15.107:0/2316555113 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fac04b720 con 0x7f7fac076a00 2024-09-21T07:53:59.307 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.519+0000 7f7f9affd640 1 --2- 172.21.15.107:0/2316555113 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f7f940394e0 0x7f7f9403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:59.307 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.519+0000 7f7f9affd640 1 -- 172.21.15.107:0/2316555113 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f7f9c040030 con 0x7f7fac076a00 2024-09-21T07:53:59.307 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.519+0000 7f7fa9d9b640 1 --2- 172.21.15.107:0/2316555113 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f7f940394e0 0x7f7f9403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:59.307 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.519+0000 7f7fa9d9b640 1 --2- 172.21.15.107:0/2316555113 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f7f940394e0 0x7f7f9403b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0006fd0 tx=0x7f7fa0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:59.307 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.523+0000 7f7f9affd640 1 -- 172.21.15.107:0/2316555113 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7f9c03a8f0 con 0x7f7fac076a00 2024-09-21T07:53:59.307 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.681+0000 7f7fb0d68640 1 -- 172.21.15.107:0/2316555113 --> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fac113b00 con 0x7f7f940394e0 2024-09-21T07:53:59.307 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.681+0000 7f7f9affd640 1 -- 172.21.15.107:0/2316555113 <== mgr.14118 v2:172.21.15.107:6800/2912640406 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f7fac113b00 con 0x7f7f940394e0 2024-09-21T07:53:59.307 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.683+0000 7f7fb0d68640 1 -- 172.21.15.107:0/2316555113 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f7f940394e0 msgr2=0x7f7f9403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:59.308 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.683+0000 7f7fb0d68640 1 --2- 172.21.15.107:0/2316555113 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f7f940394e0 0x7f7f9403b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0006fd0 tx=0x7f7fa0006db0 comp rx=0 tx=0).stop 2024-09-21T07:53:59.308 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.683+0000 7f7fb0d68640 1 -- 172.21.15.107:0/2316555113 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fac076a00 msgr2=0x7f7fac112f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:59.308 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.683+0000 7f7fb0d68640 1 --2- 172.21.15.107:0/2316555113 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fac076a00 0x7f7fac112f50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c007690 tx=0x7f7f9c009840 comp rx=0 tx=0).stop 2024-09-21T07:53:59.308 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.683+0000 7f7fb0d68640 1 -- 172.21.15.107:0/2316555113 shutdown_connections 2024-09-21T07:53:59.308 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.683+0000 7f7fb0d68640 1 --2- 172.21.15.107:0/2316555113 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f7f940394e0 0x7f7f9403b990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:59.308 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.683+0000 7f7fb0d68640 1 --2- 172.21.15.107:0/2316555113 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fac076a00 0x7f7fac112f50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:59.308 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.683+0000 7f7fb0d68640 1 -- 172.21.15.107:0/2316555113 >> 172.21.15.107:0/2316555113 conn(0x7f7fac0fc6d0 msgr2=0x7f7fac0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:59.308 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.683+0000 7f7fb0d68640 1 -- 172.21.15.107:0/2316555113 shutdown_connections 2024-09-21T07:53:59.308 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:58.683+0000 7f7fb0d68640 1 -- 172.21.15.107:0/2316555113 wait complete. 2024-09-21T07:53:59.308 INFO:teuthology.orchestra.run.smithi107.stdout:Generating ssh key... 2024-09-21T07:54:00.253 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:00 smithi107 ceph-mon[27622]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:00.253 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:00 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:00.253 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:00 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:00.564 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.652+0000 7f2978c07640 1 Processor -- start 2024-09-21T07:54:00.565 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.652+0000 7f2978c07640 1 -- start start 2024-09-21T07:54:00.565 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.652+0000 7f2978c07640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2974078ab0 0x7f2974077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:00.565 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.652+0000 7f2978c07640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2974078f50 con 0x7f2974078ab0 2024-09-21T07:54:00.565 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.652+0000 7f297259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2974078ab0 0x7f2974077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:00.565 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.652+0000 7f297259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2974078ab0 0x7f2974077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51706/0 (socket says 172.21.15.107:51706) 2024-09-21T07:54:00.565 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.652+0000 7f297259c640 1 -- 172.21.15.107:0/532520170 learned_addr learned my addr 172.21.15.107:0/532520170 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:00.565 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.653+0000 7f297259c640 1 -- 172.21.15.107:0/532520170 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2974079090 con 0x7f2974078ab0 2024-09-21T07:54:00.566 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.653+0000 7f297259c640 1 --2- 172.21.15.107:0/532520170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2974078ab0 0x7f2974077210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2964009840 tx=0x7f29640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e52d6d647e29052 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:00.566 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.654+0000 7f297159a640 1 -- 172.21.15.107:0/532520170 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2964032440 con 0x7f2974078ab0 2024-09-21T07:54:00.566 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.654+0000 7f297159a640 1 -- 172.21.15.107:0/532520170 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f2964032a00 con 0x7f2974078ab0 2024-09-21T07:54:00.566 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.654+0000 7f297159a640 1 -- 172.21.15.107:0/532520170 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f29640319e0 con 0x7f2974078ab0 2024-09-21T07:54:00.566 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.654+0000 7f2978c07640 1 -- 172.21.15.107:0/532520170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2974078ab0 msgr2=0x7f2974077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:00.567 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.654+0000 7f2978c07640 1 --2- 172.21.15.107:0/532520170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2974078ab0 0x7f2974077210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2964009840 tx=0x7f29640091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:00.567 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.654+0000 7f2978c07640 1 -- 172.21.15.107:0/532520170 shutdown_connections 2024-09-21T07:54:00.567 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.654+0000 7f2978c07640 1 --2- 172.21.15.107:0/532520170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2974078ab0 0x7f2974077210 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:00.567 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.654+0000 7f2978c07640 1 -- 172.21.15.107:0/532520170 >> 172.21.15.107:0/532520170 conn(0x7f29740fd8b0 msgr2=0x7f29740ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:00.567 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.654+0000 7f2978c07640 1 -- 172.21.15.107:0/532520170 shutdown_connections 2024-09-21T07:54:00.567 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.654+0000 7f2978c07640 1 -- 172.21.15.107:0/532520170 wait complete. 2024-09-21T07:54:00.567 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.655+0000 7f2978c07640 1 Processor -- start 2024-09-21T07:54:00.568 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.655+0000 7f2978c07640 1 -- start start 2024-09-21T07:54:00.568 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.655+0000 7f2978c07640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2974078ab0 0x7f2974112f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:00.568 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.655+0000 7f2978c07640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29741134d0 con 0x7f2974078ab0 2024-09-21T07:54:00.568 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.655+0000 7f297259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2974078ab0 0x7f2974112f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:00.568 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.655+0000 7f297259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2974078ab0 0x7f2974112f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51716/0 (socket says 172.21.15.107:51716) 2024-09-21T07:54:00.568 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.655+0000 7f297259c640 1 -- 172.21.15.107:0/1825741758 learned_addr learned my addr 172.21.15.107:0/1825741758 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:00.568 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.655+0000 7f297259c640 1 -- 172.21.15.107:0/1825741758 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2964009450 con 0x7f2974078ab0 2024-09-21T07:54:00.569 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.656+0000 7f297259c640 1 --2- 172.21.15.107:0/1825741758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2974078ab0 0x7f2974112f90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2964006f00 tx=0x7f2964008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:00.569 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.656+0000 7f2962ffd640 1 -- 172.21.15.107:0/1825741758 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f296403b470 con 0x7f2974078ab0 2024-09-21T07:54:00.569 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.656+0000 7f2962ffd640 1 -- 172.21.15.107:0/1825741758 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f296403ba30 con 0x7f2974078ab0 2024-09-21T07:54:00.569 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.656+0000 7f2978c07640 1 -- 172.21.15.107:0/1825741758 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29741136d0 con 0x7f2974078ab0 2024-09-21T07:54:00.569 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.656+0000 7f2962ffd640 1 -- 172.21.15.107:0/1825741758 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f296403a820 con 0x7f2974078ab0 2024-09-21T07:54:00.569 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.656+0000 7f2978c07640 1 -- 172.21.15.107:0/1825741758 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2974113b40 con 0x7f2974078ab0 2024-09-21T07:54:00.570 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.657+0000 7f2962ffd640 1 -- 172.21.15.107:0/1825741758 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f296403bba0 con 0x7f2974078ab0 2024-09-21T07:54:00.570 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.657+0000 7f2978c07640 1 -- 172.21.15.107:0/1825741758 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297404b720 con 0x7f2974078ab0 2024-09-21T07:54:00.570 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.657+0000 7f2962ffd640 1 --2- 172.21.15.107:0/1825741758 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f295c0394e0 0x7f295c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:00.570 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.657+0000 7f2962ffd640 1 -- 172.21.15.107:0/1825741758 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f296406c980 con 0x7f2974078ab0 2024-09-21T07:54:00.570 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.657+0000 7f2971d9b640 1 --2- 172.21.15.107:0/1825741758 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f295c0394e0 0x7f295c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:00.570 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.657+0000 7f2971d9b640 1 --2- 172.21.15.107:0/1825741758 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f295c0394e0 0x7f295c03b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2968006fd0 tx=0x7f2968006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:00.571 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.661+0000 7f2962ffd640 1 -- 172.21.15.107:0/1825741758 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f296403b5d0 con 0x7f2974078ab0 2024-09-21T07:54:00.571 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.819+0000 7f2978c07640 1 -- 172.21.15.107:0/1825741758 --> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f2974113b40 con 0x7f295c0394e0 2024-09-21T07:54:00.571 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.903+0000 7f2962ffd640 1 -- 172.21.15.107:0/1825741758 <== mgr.14118 v2:172.21.15.107:6800/2912640406 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2974113b40 con 0x7f295c0394e0 2024-09-21T07:54:00.571 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.905+0000 7f2978c07640 1 -- 172.21.15.107:0/1825741758 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f295c0394e0 msgr2=0x7f295c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:00.571 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.905+0000 7f2978c07640 1 --2- 172.21.15.107:0/1825741758 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f295c0394e0 0x7f295c03b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2968006fd0 tx=0x7f2968006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:00.571 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.905+0000 7f2978c07640 1 -- 172.21.15.107:0/1825741758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2974078ab0 msgr2=0x7f2974112f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:00.572 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.905+0000 7f2978c07640 1 --2- 172.21.15.107:0/1825741758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2974078ab0 0x7f2974112f90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2964006f00 tx=0x7f2964008040 comp rx=0 tx=0).stop 2024-09-21T07:54:00.572 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.905+0000 7f2978c07640 1 -- 172.21.15.107:0/1825741758 shutdown_connections 2024-09-21T07:54:00.572 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.905+0000 7f2978c07640 1 --2- 172.21.15.107:0/1825741758 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f295c0394e0 0x7f295c03b990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:00.572 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.905+0000 7f2978c07640 1 --2- 172.21.15.107:0/1825741758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2974078ab0 0x7f2974112f90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:00.572 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.905+0000 7f2978c07640 1 -- 172.21.15.107:0/1825741758 >> 172.21.15.107:0/1825741758 conn(0x7f29740fd8b0 msgr2=0x7f29740fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:00.572 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.905+0000 7f2978c07640 1 -- 172.21.15.107:0/1825741758 shutdown_connections 2024-09-21T07:54:00.572 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:53:59.905+0000 7f2978c07640 1 -- 172.21.15.107:0/1825741758 wait complete. 2024-09-21T07:54:01.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:01 smithi107 ceph-mon[27622]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:01.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:01 smithi107 ceph-mon[27622]: Generating ssh key... 2024-09-21T07:54:01.592 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQClRCqoTj4Sb3c/9KAA6Tn0E5CC0Z49F1LnUKL8AzQCNx/i0ucH0eIIhnNQE3yZ2Nqh9/RQKKHY3tfCQots928mRmRAGa3z4UR1WsolZuR0P5T+d9IFJ7MW0KM8I7Trnij7R1gHBxrfHd3ciZahYkcuzBfx6Guj5AHIbm3to7GFueCtX4oeyZ+WcvBw1tsSRbHKaz3fts+PqUcKvAz7aDPGiMqmmh/oZbOmIGc+T/eBiuQNDoeWlX3W+qTCokwnF3HV7zeu9qpluW6zP9pOxLUs77fu9cuWQHbxlWmJKGhV8uhdNPaXnvKoEjTMQ3RNTDswleTcj260Qm3GUzJkA59C/D6gekyofRYmIWVpv990qNnrFbOLTybMtj/PgX9rFKCOIJ95D/6Nn0rTu3Avf0jIb18xbKwsgBf+YoOuIfkZeh3sBNQCwPbSpYOmkMRn+v/hFr9OTOHQD9J1949CPLdP/vHSgkjw2vFXEUaabfexaTb372HMkr3p7vj/Taw0mR0= ceph-786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T07:54:01.592 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.934+0000 7f0f060b3640 1 Processor -- start 2024-09-21T07:54:01.592 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.934+0000 7f0f060b3640 1 -- start start 2024-09-21T07:54:01.592 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.934+0000 7f0f060b3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f00078b70 0x7f0f00077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:01.592 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.934+0000 7f0f060b3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f00078f80 con 0x7f0f00078b70 2024-09-21T07:54:01.592 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.934+0000 7f0eff7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f00078b70 0x7f0f00077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:01.592 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.934+0000 7f0eff7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f00078b70 0x7f0f00077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51720/0 (socket says 172.21.15.107:51720) 2024-09-21T07:54:01.593 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.934+0000 7f0eff7fe640 1 -- 172.21.15.107:0/1928971753 learned_addr learned my addr 172.21.15.107:0/1928971753 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:01.593 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.934+0000 7f0eff7fe640 1 -- 172.21.15.107:0/1928971753 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f000790c0 con 0x7f0f00078b70 2024-09-21T07:54:01.593 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.935+0000 7f0eff7fe640 1 --2- 172.21.15.107:0/1928971753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f00078b70 0x7f0f00077230 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009840 tx=0x7f0ef00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9e85048fe4803a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:01.593 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.935+0000 7f0efe7fc640 1 -- 172.21.15.107:0/1928971753 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ef0032440 con 0x7f0f00078b70 2024-09-21T07:54:01.593 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.935+0000 7f0efe7fc640 1 -- 172.21.15.107:0/1928971753 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f0ef0032a00 con 0x7f0f00078b70 2024-09-21T07:54:01.593 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.935+0000 7f0efe7fc640 1 -- 172.21.15.107:0/1928971753 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ef0031a10 con 0x7f0f00078b70 2024-09-21T07:54:01.593 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.936+0000 7f0f060b3640 1 -- 172.21.15.107:0/1928971753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f00078b70 msgr2=0x7f0f00077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:01.593 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.936+0000 7f0f060b3640 1 --2- 172.21.15.107:0/1928971753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f00078b70 0x7f0f00077230 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009840 tx=0x7f0ef00091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:01.593 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.936+0000 7f0f060b3640 1 -- 172.21.15.107:0/1928971753 shutdown_connections 2024-09-21T07:54:01.593 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.936+0000 7f0f060b3640 1 --2- 172.21.15.107:0/1928971753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f00078b70 0x7f0f00077230 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:01.593 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.936+0000 7f0f060b3640 1 -- 172.21.15.107:0/1928971753 >> 172.21.15.107:0/1928971753 conn(0x7f0f000fd850 msgr2=0x7f0f000ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:01.593 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.936+0000 7f0f060b3640 1 -- 172.21.15.107:0/1928971753 shutdown_connections 2024-09-21T07:54:01.593 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.936+0000 7f0f060b3640 1 -- 172.21.15.107:0/1928971753 wait complete. 2024-09-21T07:54:01.593 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.936+0000 7f0f060b3640 1 Processor -- start 2024-09-21T07:54:01.594 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.937+0000 7f0f060b3640 1 -- start start 2024-09-21T07:54:01.594 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.937+0000 7f0f060b3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f00078b70 0x7f0f00112ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:01.594 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.937+0000 7f0f060b3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f00113420 con 0x7f0f00078b70 2024-09-21T07:54:01.594 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.937+0000 7f0eff7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f00078b70 0x7f0f00112ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:01.594 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.937+0000 7f0eff7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f00078b70 0x7f0f00112ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51724/0 (socket says 172.21.15.107:51724) 2024-09-21T07:54:01.594 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.937+0000 7f0eff7fe640 1 -- 172.21.15.107:0/3359194586 learned_addr learned my addr 172.21.15.107:0/3359194586 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:01.594 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.937+0000 7f0eff7fe640 1 -- 172.21.15.107:0/3359194586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef0009450 con 0x7f0f00078b70 2024-09-21T07:54:01.594 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.937+0000 7f0eff7fe640 1 --2- 172.21.15.107:0/3359194586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f00078b70 0x7f0f00112ee0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00098a0 tx=0x7f0ef002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:01.594 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.937+0000 7f0ee7fff640 1 -- 172.21.15.107:0/3359194586 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ef00327b0 con 0x7f0f00078b70 2024-09-21T07:54:01.594 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.937+0000 7f0ee7fff640 1 -- 172.21.15.107:0/3359194586 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f0ef003b870 con 0x7f0f00078b70 2024-09-21T07:54:01.594 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.937+0000 7f0f060b3640 1 -- 172.21.15.107:0/3359194586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f00113620 con 0x7f0f00078b70 2024-09-21T07:54:01.594 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.938+0000 7f0ee7fff640 1 -- 172.21.15.107:0/3359194586 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ef003a550 con 0x7f0f00078b70 2024-09-21T07:54:01.594 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.938+0000 7f0f060b3640 1 -- 172.21.15.107:0/3359194586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f001141b0 con 0x7f0f00078b70 2024-09-21T07:54:01.594 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.938+0000 7f0ee7fff640 1 -- 172.21.15.107:0/3359194586 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f0ef0039040 con 0x7f0f00078b70 2024-09-21T07:54:01.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.938+0000 7f0f060b3640 1 -- 172.21.15.107:0/3359194586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f001014d0 con 0x7f0f00078b70 2024-09-21T07:54:01.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.939+0000 7f0ee7fff640 1 --2- 172.21.15.107:0/3359194586 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f0ee8039450 0x7f0ee803b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:01.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.939+0000 7f0ee7fff640 1 -- 172.21.15.107:0/3359194586 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0ef006c910 con 0x7f0f00078b70 2024-09-21T07:54:01.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.939+0000 7f0efeffd640 1 --2- 172.21.15.107:0/3359194586 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f0ee8039450 0x7f0ee803b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:01.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.939+0000 7f0efeffd640 1 --2- 172.21.15.107:0/3359194586 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f0ee8039450 0x7f0ee803b900 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4006fd0 tx=0x7f0ef4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:01.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:00.943+0000 7f0ee7fff640 1 -- 172.21.15.107:0/3359194586 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0ef004b900 con 0x7f0f00078b70 2024-09-21T07:54:01.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:01.100+0000 7f0f060b3640 1 -- 172.21.15.107:0/3359194586 --> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f000feb80 con 0x7f0ee8039450 2024-09-21T07:54:01.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:01.101+0000 7f0ee7fff640 1 -- 172.21.15.107:0/3359194586 <== mgr.14118 v2:172.21.15.107:6800/2912640406 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f0f000feb80 con 0x7f0ee8039450 2024-09-21T07:54:01.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:01.102+0000 7f0f060b3640 1 -- 172.21.15.107:0/3359194586 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f0ee8039450 msgr2=0x7f0ee803b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:01.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:01.102+0000 7f0f060b3640 1 --2- 172.21.15.107:0/3359194586 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f0ee8039450 0x7f0ee803b900 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4006fd0 tx=0x7f0ef4006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:01.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:01.103+0000 7f0f060b3640 1 -- 172.21.15.107:0/3359194586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f00078b70 msgr2=0x7f0f00112ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:01.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:01.103+0000 7f0f060b3640 1 --2- 172.21.15.107:0/3359194586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f00078b70 0x7f0f00112ee0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00098a0 tx=0x7f0ef002c040 comp rx=0 tx=0).stop 2024-09-21T07:54:01.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:01.103+0000 7f0f060b3640 1 -- 172.21.15.107:0/3359194586 shutdown_connections 2024-09-21T07:54:01.595 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:01.103+0000 7f0f060b3640 1 --2- 172.21.15.107:0/3359194586 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f0ee8039450 0x7f0ee803b900 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:01.596 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:01.103+0000 7f0f060b3640 1 --2- 172.21.15.107:0/3359194586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f00078b70 0x7f0f00112ee0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:01.596 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:01.103+0000 7f0f060b3640 1 -- 172.21.15.107:0/3359194586 >> 172.21.15.107:0/3359194586 conn(0x7f0f000fd850 msgr2=0x7f0f000fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:01.596 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:01.103+0000 7f0f060b3640 1 -- 172.21.15.107:0/3359194586 shutdown_connections 2024-09-21T07:54:01.596 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:01.103+0000 7f0f060b3640 1 -- 172.21.15.107:0/3359194586 wait complete. 2024-09-21T07:54:01.596 INFO:teuthology.orchestra.run.smithi107.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T07:54:01.596 INFO:teuthology.orchestra.run.smithi107.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T07:54:01.598 INFO:teuthology.orchestra.run.smithi107.stdout:Adding host smithi107... 2024-09-21T07:54:02.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:02 smithi107 ceph-mon[27622]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:03.286 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:03 smithi107 ceph-mon[27622]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi107", "addr": "172.21.15.107", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:04.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:04 smithi107 ceph-mon[27622]: Deploying cephadm binary to smithi107 2024-09-21T07:54:05.502 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout Added host 'smithi107' with addr '172.21.15.107' 2024-09-21T07:54:05.507 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.086+0000 7f7b0f25e640 1 Processor -- start 2024-09-21T07:54:05.507 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.086+0000 7f7b0f25e640 1 -- start start 2024-09-21T07:54:05.507 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.086+0000 7f7b0f25e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b08078c40 0x7f7b08077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:05.507 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.086+0000 7f7b0f25e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b08079050 con 0x7f7b08078c40 2024-09-21T07:54:05.507 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.086+0000 7f7b0cffa640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b08078c40 0x7f7b08077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:05.507 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.086+0000 7f7b0cffa640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b08078c40 0x7f7b08077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45860/0 (socket says 172.21.15.107:45860) 2024-09-21T07:54:05.507 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.086+0000 7f7b0cffa640 1 -- 172.21.15.107:0/3480284153 learned_addr learned my addr 172.21.15.107:0/3480284153 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:05.508 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.087+0000 7f7b0cffa640 1 -- 172.21.15.107:0/3480284153 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b08077750 con 0x7f7b08078c40 2024-09-21T07:54:05.508 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.087+0000 7f7b0cffa640 1 --2- 172.21.15.107:0/3480284153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b08078c40 0x7f7b08077210 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7afc009840 tx=0x7f7afc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11bf59120c28c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:05.508 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.087+0000 7f7b077fe640 1 -- 172.21.15.107:0/3480284153 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7afc032440 con 0x7f7b08078c40 2024-09-21T07:54:05.508 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.088+0000 7f7b077fe640 1 -- 172.21.15.107:0/3480284153 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f7afc032a00 con 0x7f7b08078c40 2024-09-21T07:54:05.508 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.088+0000 7f7b077fe640 1 -- 172.21.15.107:0/3480284153 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7afc0319e0 con 0x7f7b08078c40 2024-09-21T07:54:05.508 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.088+0000 7f7b0f25e640 1 -- 172.21.15.107:0/3480284153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b08078c40 msgr2=0x7f7b08077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:05.508 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.088+0000 7f7b0f25e640 1 --2- 172.21.15.107:0/3480284153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b08078c40 0x7f7b08077210 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7afc009840 tx=0x7f7afc0091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:05.508 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.088+0000 7f7b0f25e640 1 -- 172.21.15.107:0/3480284153 shutdown_connections 2024-09-21T07:54:05.508 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.088+0000 7f7b0f25e640 1 --2- 172.21.15.107:0/3480284153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b08078c40 0x7f7b08077210 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:05.508 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.088+0000 7f7b0f25e640 1 -- 172.21.15.107:0/3480284153 >> 172.21.15.107:0/3480284153 conn(0x7f7b080fd770 msgr2=0x7f7b080ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:05.508 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.088+0000 7f7b0f25e640 1 -- 172.21.15.107:0/3480284153 shutdown_connections 2024-09-21T07:54:05.508 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.088+0000 7f7b0f25e640 1 -- 172.21.15.107:0/3480284153 wait complete. 2024-09-21T07:54:05.508 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.089+0000 7f7b0f25e640 1 Processor -- start 2024-09-21T07:54:05.508 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.089+0000 7f7b0f25e640 1 -- start start 2024-09-21T07:54:05.509 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.089+0000 7f7b0f25e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b08078c40 0x7f7b08112fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:05.509 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.089+0000 7f7b0f25e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b08113510 con 0x7f7b08078c40 2024-09-21T07:54:05.509 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.089+0000 7f7b0cffa640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b08078c40 0x7f7b08112fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:05.509 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.089+0000 7f7b0cffa640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b08078c40 0x7f7b08112fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45862/0 (socket says 172.21.15.107:45862) 2024-09-21T07:54:05.509 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.089+0000 7f7b0cffa640 1 -- 172.21.15.107:0/3153786031 learned_addr learned my addr 172.21.15.107:0/3153786031 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:05.509 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.090+0000 7f7b0cffa640 1 -- 172.21.15.107:0/3153786031 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7afc009450 con 0x7f7b08078c40 2024-09-21T07:54:05.509 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.090+0000 7f7b0cffa640 1 --2- 172.21.15.107:0/3153786031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b08078c40 0x7f7b08112fd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7afc006f00 tx=0x7f7afc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:05.509 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.090+0000 7f7b057fa640 1 -- 172.21.15.107:0/3153786031 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7afc031d30 con 0x7f7b08078c40 2024-09-21T07:54:05.509 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.090+0000 7f7b057fa640 1 -- 172.21.15.107:0/3153786031 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f7afc031e90 con 0x7f7b08078c40 2024-09-21T07:54:05.509 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.090+0000 7f7b0f25e640 1 -- 172.21.15.107:0/3153786031 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b08113710 con 0x7f7b08078c40 2024-09-21T07:54:05.509 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.090+0000 7f7b057fa640 1 -- 172.21.15.107:0/3153786031 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7afc03b790 con 0x7f7b08078c40 2024-09-21T07:54:05.509 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.090+0000 7f7b0f25e640 1 -- 172.21.15.107:0/3153786031 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b08113b80 con 0x7f7b08078c40 2024-09-21T07:54:05.509 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.091+0000 7f7b057fa640 1 -- 172.21.15.107:0/3153786031 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f7afc039070 con 0x7f7b08078c40 2024-09-21T07:54:05.509 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.091+0000 7f7b057fa640 1 --2- 172.21.15.107:0/3153786031 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f7af8039490 0x7f7af803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:05.510 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.091+0000 7f7b0f25e640 1 -- 172.21.15.107:0/3153786031 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b0804b720 con 0x7f7b08078c40 2024-09-21T07:54:05.510 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.091+0000 7f7b057fa640 1 -- 172.21.15.107:0/3153786031 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f7afc06d0e0 con 0x7f7b08078c40 2024-09-21T07:54:05.510 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.091+0000 7f7b07fff640 1 --2- 172.21.15.107:0/3153786031 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f7af8039490 0x7f7af803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:05.510 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.092+0000 7f7b07fff640 1 --2- 172.21.15.107:0/3153786031 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f7af8039490 0x7f7af803b940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7af4006fd0 tx=0x7f7af4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:05.510 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.096+0000 7f7b057fa640 1 -- 172.21.15.107:0/3153786031 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7afc041070 con 0x7f7b08078c40 2024-09-21T07:54:05.510 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:02.257+0000 7f7b0f25e640 1 -- 172.21.15.107:0/3153786031 --> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi107", "addr": "172.21.15.107", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b080fec40 con 0x7f7af8039490 2024-09-21T07:54:05.510 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:04.923+0000 7f7b057fa640 1 -- 172.21.15.107:0/3153786031 <== mgr.14118 v2:172.21.15.107:6800/2912640406 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f7b080fec40 con 0x7f7af8039490 2024-09-21T07:54:05.510 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:04.925+0000 7f7b0f25e640 1 -- 172.21.15.107:0/3153786031 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f7af8039490 msgr2=0x7f7af803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:05.510 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:04.925+0000 7f7b0f25e640 1 --2- 172.21.15.107:0/3153786031 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f7af8039490 0x7f7af803b940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7af4006fd0 tx=0x7f7af4006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:05.510 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:04.925+0000 7f7b0f25e640 1 -- 172.21.15.107:0/3153786031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b08078c40 msgr2=0x7f7b08112fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:05.510 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:04.925+0000 7f7b0f25e640 1 --2- 172.21.15.107:0/3153786031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b08078c40 0x7f7b08112fd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7afc006f00 tx=0x7f7afc008040 comp rx=0 tx=0).stop 2024-09-21T07:54:05.510 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:04.925+0000 7f7b0f25e640 1 -- 172.21.15.107:0/3153786031 shutdown_connections 2024-09-21T07:54:05.510 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:04.925+0000 7f7b0f25e640 1 --2- 172.21.15.107:0/3153786031 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f7af8039490 0x7f7af803b940 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:05.511 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:04.925+0000 7f7b0f25e640 1 --2- 172.21.15.107:0/3153786031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b08078c40 0x7f7b08112fd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:05.511 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:04.925+0000 7f7b0f25e640 1 -- 172.21.15.107:0/3153786031 >> 172.21.15.107:0/3153786031 conn(0x7f7b080fd770 msgr2=0x7f7b080fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:05.511 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:04.925+0000 7f7b0f25e640 1 -- 172.21.15.107:0/3153786031 shutdown_connections 2024-09-21T07:54:05.511 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:04.925+0000 7f7b0f25e640 1 -- 172.21.15.107:0/3153786031 wait complete. 2024-09-21T07:54:05.511 INFO:teuthology.orchestra.run.smithi107.stdout:Deploying mon service with default placement... 2024-09-21T07:54:06.116 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:05 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:06.116 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:05 smithi107 ceph-mon[27622]: Added host smithi107 2024-09-21T07:54:06.116 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:05 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:54:06.965 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T07:54:06.965 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.926+0000 7fa3abfc7640 1 Processor -- start 2024-09-21T07:54:06.965 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.927+0000 7fa3abfc7640 1 -- start start 2024-09-21T07:54:06.965 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.927+0000 7fa3abfc7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3a4100e90 0x7fa3a41012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.966 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.927+0000 7fa3abfc7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a41017e0 con 0x7fa3a4100e90 2024-09-21T07:54:06.966 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.927+0000 7fa3a9d63640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3a4100e90 0x7fa3a41012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:06.966 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.927+0000 7fa3a9d63640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3a4100e90 0x7fa3a41012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45876/0 (socket says 172.21.15.107:45876) 2024-09-21T07:54:06.966 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.927+0000 7fa3a9d63640 1 -- 172.21.15.107:0/4185196848 learned_addr learned my addr 172.21.15.107:0/4185196848 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:06.966 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.927+0000 7fa3a9d63640 1 -- 172.21.15.107:0/4185196848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a4101920 con 0x7fa3a4100e90 2024-09-21T07:54:06.966 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.928+0000 7fa3a9d63640 1 --2- 172.21.15.107:0/4185196848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3a4100e90 0x7fa3a41012a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009840 tx=0x7fa39c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9bc7ce7047c46c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:06.966 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.928+0000 7fa3a8d61640 1 -- 172.21.15.107:0/4185196848 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa39c032440 con 0x7fa3a4100e90 2024-09-21T07:54:06.966 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.928+0000 7fa3a8d61640 1 -- 172.21.15.107:0/4185196848 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa39c032a00 con 0x7fa3a4100e90 2024-09-21T07:54:06.966 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.928+0000 7fa3a8d61640 1 -- 172.21.15.107:0/4185196848 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa39c031a10 con 0x7fa3a4100e90 2024-09-21T07:54:06.966 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.929+0000 7fa3abfc7640 1 -- 172.21.15.107:0/4185196848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3a4100e90 msgr2=0x7fa3a41012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:06.966 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.929+0000 7fa3abfc7640 1 --2- 172.21.15.107:0/4185196848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3a4100e90 0x7fa3a41012a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009840 tx=0x7fa39c0091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.966 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.929+0000 7fa3abfc7640 1 -- 172.21.15.107:0/4185196848 shutdown_connections 2024-09-21T07:54:06.966 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.929+0000 7fa3abfc7640 1 --2- 172.21.15.107:0/4185196848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3a4100e90 0x7fa3a41012a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.967 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.929+0000 7fa3abfc7640 1 -- 172.21.15.107:0/4185196848 >> 172.21.15.107:0/4185196848 conn(0x7fa3a40fc6d0 msgr2=0x7fa3a40feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:06.967 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.929+0000 7fa3abfc7640 1 -- 172.21.15.107:0/4185196848 shutdown_connections 2024-09-21T07:54:06.967 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.929+0000 7fa3abfc7640 1 -- 172.21.15.107:0/4185196848 wait complete. 2024-09-21T07:54:06.967 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.929+0000 7fa3abfc7640 1 Processor -- start 2024-09-21T07:54:06.967 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.929+0000 7fa3abfc7640 1 -- start start 2024-09-21T07:54:06.967 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.930+0000 7fa3abfc7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3a4100e90 0x7fa3a410fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.967 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.930+0000 7fa3abfc7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a4110180 con 0x7fa3a4100e90 2024-09-21T07:54:06.967 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.930+0000 7fa3a9d63640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3a4100e90 0x7fa3a410fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:06.967 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.930+0000 7fa3a9d63640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3a4100e90 0x7fa3a410fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45890/0 (socket says 172.21.15.107:45890) 2024-09-21T07:54:06.967 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.930+0000 7fa3a9d63640 1 -- 172.21.15.107:0/3158989175 learned_addr learned my addr 172.21.15.107:0/3158989175 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:06.967 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.930+0000 7fa3a9d63640 1 -- 172.21.15.107:0/3158989175 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c009450 con 0x7fa3a4100e90 2024-09-21T07:54:06.967 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.930+0000 7fa3a9d63640 1 --2- 172.21.15.107:0/3158989175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3a4100e90 0x7fa3a410fc40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0098a0 tx=0x7fa39c02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:06.967 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.930+0000 7fa3967fc640 1 -- 172.21.15.107:0/3158989175 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa39c0327b0 con 0x7fa3a4100e90 2024-09-21T07:54:06.967 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.930+0000 7fa3967fc640 1 -- 172.21.15.107:0/3158989175 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa39c03b870 con 0x7fa3a4100e90 2024-09-21T07:54:06.967 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.930+0000 7fa3abfc7640 1 -- 172.21.15.107:0/3158989175 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a4110380 con 0x7fa3a4100e90 2024-09-21T07:54:06.968 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.930+0000 7fa3967fc640 1 -- 172.21.15.107:0/3158989175 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa39c03a550 con 0x7fa3a4100e90 2024-09-21T07:54:06.968 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.930+0000 7fa3abfc7640 1 -- 172.21.15.107:0/3158989175 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a41107f0 con 0x7fa3a4100e90 2024-09-21T07:54:06.968 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.931+0000 7fa3967fc640 1 -- 172.21.15.107:0/3158989175 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fa39c039040 con 0x7fa3a4100e90 2024-09-21T07:54:06.968 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.931+0000 7fa3967fc640 1 --2- 172.21.15.107:0/3158989175 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7fa390039490 0x7fa39003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.968 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.931+0000 7fa3967fc640 1 -- 172.21.15.107:0/3158989175 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa39c06c720 con 0x7fa3a4100e90 2024-09-21T07:54:06.968 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.931+0000 7fa3a9562640 1 --2- 172.21.15.107:0/3158989175 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7fa390039490 0x7fa39003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:06.968 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.931+0000 7fa3abfc7640 1 -- 172.21.15.107:0/3158989175 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a41002f0 con 0x7fa3a4100e90 2024-09-21T07:54:06.968 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.932+0000 7fa3a9562640 1 --2- 172.21.15.107:0/3158989175 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7fa390039490 0x7fa39003b940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa398006fd0 tx=0x7fa398006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:06.968 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:05.936+0000 7fa3967fc640 1 -- 172.21.15.107:0/3158989175 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa39c03f080 con 0x7fa3a4100e90 2024-09-21T07:54:06.968 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:06.114+0000 7fa3abfc7640 1 -- 172.21.15.107:0/3158989175 --> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3a40fda90 con 0x7fa390039490 2024-09-21T07:54:06.968 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:06.118+0000 7fa3967fc640 1 -- 172.21.15.107:0/3158989175 <== mgr.14118 v2:172.21.15.107:6800/2912640406 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fa3a40fda90 con 0x7fa390039490 2024-09-21T07:54:06.968 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:06.120+0000 7fa3abfc7640 1 -- 172.21.15.107:0/3158989175 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7fa390039490 msgr2=0x7fa39003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:06.968 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:06.120+0000 7fa3abfc7640 1 --2- 172.21.15.107:0/3158989175 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7fa390039490 0x7fa39003b940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa398006fd0 tx=0x7fa398006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.968 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:06.120+0000 7fa3abfc7640 1 -- 172.21.15.107:0/3158989175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3a4100e90 msgr2=0x7fa3a410fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:06.969 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:06.120+0000 7fa3abfc7640 1 --2- 172.21.15.107:0/3158989175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3a4100e90 0x7fa3a410fc40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0098a0 tx=0x7fa39c02c040 comp rx=0 tx=0).stop 2024-09-21T07:54:06.969 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:06.120+0000 7fa3abfc7640 1 -- 172.21.15.107:0/3158989175 shutdown_connections 2024-09-21T07:54:06.969 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:06.120+0000 7fa3abfc7640 1 --2- 172.21.15.107:0/3158989175 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7fa390039490 0x7fa39003b940 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.969 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:06.120+0000 7fa3abfc7640 1 --2- 172.21.15.107:0/3158989175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3a4100e90 0x7fa3a410fc40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.969 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:06.120+0000 7fa3abfc7640 1 -- 172.21.15.107:0/3158989175 >> 172.21.15.107:0/3158989175 conn(0x7fa3a40fc6d0 msgr2=0x7fa3a40fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:06.969 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:06.121+0000 7fa3abfc7640 1 -- 172.21.15.107:0/3158989175 shutdown_connections 2024-09-21T07:54:06.969 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:06.121+0000 7fa3abfc7640 1 -- 172.21.15.107:0/3158989175 wait complete. 2024-09-21T07:54:06.969 INFO:teuthology.orchestra.run.smithi107.stdout:Deploying mgr service with default placement... 2024-09-21T07:54:07.210 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:07 smithi107 ceph-mon[27622]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:07.210 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:07 smithi107 ceph-mon[27622]: Saving service mon spec with placement count:5 2024-09-21T07:54:07.210 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:07 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:08.693 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:08 smithi107 ceph-mon[27622]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:08.693 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:08 smithi107 ceph-mon[27622]: Saving service mgr spec with placement count:2 2024-09-21T07:54:08.693 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:08 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:09.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T07:54:09.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.384+0000 7f6ca70f3640 1 Processor -- start 2024-09-21T07:54:09.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.384+0000 7f6ca70f3640 1 -- start start 2024-09-21T07:54:09.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.384+0000 7f6ca70f3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca0076ab0 0x7f6ca0104c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:09.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.384+0000 7f6ca70f3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0076ec0 con 0x7f6ca0076ab0 2024-09-21T07:54:09.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.384+0000 7f6ca4e8f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca0076ab0 0x7f6ca0104c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:09.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.384+0000 7f6ca4e8f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca0076ab0 0x7f6ca0104c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45894/0 (socket says 172.21.15.107:45894) 2024-09-21T07:54:09.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.384+0000 7f6ca4e8f640 1 -- 172.21.15.107:0/3368495568 learned_addr learned my addr 172.21.15.107:0/3368495568 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:09.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.385+0000 7f6ca4e8f640 1 -- 172.21.15.107:0/3368495568 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca0105180 con 0x7f6ca0076ab0 2024-09-21T07:54:09.083 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.385+0000 7f6ca4e8f640 1 --2- 172.21.15.107:0/3368495568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca0076ab0 0x7f6ca0104c40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6c94009840 tx=0x7f6c940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1805f6c47f003c98 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:09.088 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.385+0000 7f6c9f7fe640 1 -- 172.21.15.107:0/3368495568 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c94032440 con 0x7f6ca0076ab0 2024-09-21T07:54:09.088 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.385+0000 7f6c9f7fe640 1 -- 172.21.15.107:0/3368495568 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6c94032a00 con 0x7f6ca0076ab0 2024-09-21T07:54:09.089 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.385+0000 7f6c9f7fe640 1 -- 172.21.15.107:0/3368495568 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c94031a10 con 0x7f6ca0076ab0 2024-09-21T07:54:09.089 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.386+0000 7f6ca70f3640 1 -- 172.21.15.107:0/3368495568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca0076ab0 msgr2=0x7f6ca0104c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:09.089 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.386+0000 7f6ca70f3640 1 --2- 172.21.15.107:0/3368495568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca0076ab0 0x7f6ca0104c40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6c94009840 tx=0x7f6c940091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:09.089 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.386+0000 7f6ca70f3640 1 -- 172.21.15.107:0/3368495568 shutdown_connections 2024-09-21T07:54:09.089 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.386+0000 7f6ca70f3640 1 --2- 172.21.15.107:0/3368495568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca0076ab0 0x7f6ca0104c40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:09.089 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.386+0000 7f6ca70f3640 1 -- 172.21.15.107:0/3368495568 >> 172.21.15.107:0/3368495568 conn(0x7f6ca00fc6d0 msgr2=0x7f6ca00feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:09.089 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.386+0000 7f6ca70f3640 1 -- 172.21.15.107:0/3368495568 shutdown_connections 2024-09-21T07:54:09.089 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.386+0000 7f6ca70f3640 1 -- 172.21.15.107:0/3368495568 wait complete. 2024-09-21T07:54:09.089 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.387+0000 7f6ca70f3640 1 Processor -- start 2024-09-21T07:54:09.089 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.387+0000 7f6ca70f3640 1 -- start start 2024-09-21T07:54:09.089 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.387+0000 7f6ca70f3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca0076ab0 0x7f6ca0110de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:09.089 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.387+0000 7f6ca70f3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0111320 con 0x7f6ca0076ab0 2024-09-21T07:54:09.089 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.387+0000 7f6ca4e8f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca0076ab0 0x7f6ca0110de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:09.089 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.387+0000 7f6ca4e8f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca0076ab0 0x7f6ca0110de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45896/0 (socket says 172.21.15.107:45896) 2024-09-21T07:54:09.090 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.387+0000 7f6ca4e8f640 1 -- 172.21.15.107:0/1440582365 learned_addr learned my addr 172.21.15.107:0/1440582365 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:09.090 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.387+0000 7f6ca4e8f640 1 -- 172.21.15.107:0/1440582365 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c94009450 con 0x7f6ca0076ab0 2024-09-21T07:54:09.090 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.387+0000 7f6ca4e8f640 1 --2- 172.21.15.107:0/1440582365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca0076ab0 0x7f6ca0110de0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6c940098a0 tx=0x7f6c9402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:09.090 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.388+0000 7f6c9d7fa640 1 -- 172.21.15.107:0/1440582365 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c940327b0 con 0x7f6ca0076ab0 2024-09-21T07:54:09.090 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.388+0000 7f6c9d7fa640 1 -- 172.21.15.107:0/1440582365 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6c9403b870 con 0x7f6ca0076ab0 2024-09-21T07:54:09.090 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.388+0000 7f6ca70f3640 1 -- 172.21.15.107:0/1440582365 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca0111520 con 0x7f6ca0076ab0 2024-09-21T07:54:09.090 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.388+0000 7f6c9d7fa640 1 -- 172.21.15.107:0/1440582365 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c9403a550 con 0x7f6ca0076ab0 2024-09-21T07:54:09.090 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.388+0000 7f6ca70f3640 1 -- 172.21.15.107:0/1440582365 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca0111f70 con 0x7f6ca0076ab0 2024-09-21T07:54:09.090 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.388+0000 7f6c9d7fa640 1 -- 172.21.15.107:0/1440582365 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f6c94039040 con 0x7f6ca0076ab0 2024-09-21T07:54:09.090 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.389+0000 7f6ca70f3640 1 -- 172.21.15.107:0/1440582365 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca01002f0 con 0x7f6ca0076ab0 2024-09-21T07:54:09.090 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.389+0000 7f6c9d7fa640 1 --2- 172.21.15.107:0/1440582365 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f6c900394e0 0x7f6c9003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:09.091 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.389+0000 7f6c9d7fa640 1 -- 172.21.15.107:0/1440582365 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6c9406c9f0 con 0x7f6ca0076ab0 2024-09-21T07:54:09.091 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.389+0000 7f6c9ffff640 1 --2- 172.21.15.107:0/1440582365 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f6c900394e0 0x7f6c9003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:09.091 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.389+0000 7f6c9ffff640 1 --2- 172.21.15.107:0/1440582365 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f6c900394e0 0x7f6c9003b990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c006fd0 tx=0x7f6c8c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:09.091 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.393+0000 7f6c9d7fa640 1 -- 172.21.15.107:0/1440582365 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6c9404c350 con 0x7f6ca0076ab0 2024-09-21T07:54:09.091 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.564+0000 7f6ca70f3640 1 -- 172.21.15.107:0/1440582365 --> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ca00fdb70 con 0x7f6c900394e0 2024-09-21T07:54:09.091 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.571+0000 7f6c9d7fa640 1 -- 172.21.15.107:0/1440582365 <== mgr.14118 v2:172.21.15.107:6800/2912640406 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f6ca00fdb70 con 0x7f6c900394e0 2024-09-21T07:54:09.092 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.573+0000 7f6ca70f3640 1 -- 172.21.15.107:0/1440582365 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f6c900394e0 msgr2=0x7f6c9003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:09.092 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.573+0000 7f6ca70f3640 1 --2- 172.21.15.107:0/1440582365 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f6c900394e0 0x7f6c9003b990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c006fd0 tx=0x7f6c8c006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:09.092 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.573+0000 7f6ca70f3640 1 -- 172.21.15.107:0/1440582365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca0076ab0 msgr2=0x7f6ca0110de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:09.092 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.573+0000 7f6ca70f3640 1 --2- 172.21.15.107:0/1440582365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca0076ab0 0x7f6ca0110de0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6c940098a0 tx=0x7f6c9402c040 comp rx=0 tx=0).stop 2024-09-21T07:54:09.092 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.573+0000 7f6ca70f3640 1 -- 172.21.15.107:0/1440582365 shutdown_connections 2024-09-21T07:54:09.092 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.573+0000 7f6ca70f3640 1 --2- 172.21.15.107:0/1440582365 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f6c900394e0 0x7f6c9003b990 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:09.092 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.573+0000 7f6ca70f3640 1 --2- 172.21.15.107:0/1440582365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca0076ab0 0x7f6ca0110de0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:09.092 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.573+0000 7f6ca70f3640 1 -- 172.21.15.107:0/1440582365 >> 172.21.15.107:0/1440582365 conn(0x7f6ca00fc6d0 msgr2=0x7f6ca00fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:09.092 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.574+0000 7f6ca70f3640 1 -- 172.21.15.107:0/1440582365 shutdown_connections 2024-09-21T07:54:09.092 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:07.574+0000 7f6ca70f3640 1 -- 172.21.15.107:0/1440582365 wait complete. 2024-09-21T07:54:09.092 INFO:teuthology.orchestra.run.smithi107.stdout:Deploying crash service with default placement... 2024-09-21T07:54:10.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:09 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:10.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:09 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:10.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:09 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:10.903 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-21T07:54:10.903 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.504+0000 7f2abab84640 1 Processor -- start 2024-09-21T07:54:10.903 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.504+0000 7f2abab84640 1 -- start start 2024-09-21T07:54:10.904 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.505+0000 7f2abab84640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab4076b10 0x7f2ab4104be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:10.904 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.505+0000 7f2abab84640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab4076f20 con 0x7f2ab4076b10 2024-09-21T07:54:10.904 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.505+0000 7f2ab8920640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab4076b10 0x7f2ab4104be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:10.904 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.505+0000 7f2ab8920640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab4076b10 0x7f2ab4104be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45908/0 (socket says 172.21.15.107:45908) 2024-09-21T07:54:10.904 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.505+0000 7f2ab8920640 1 -- 172.21.15.107:0/15769982 learned_addr learned my addr 172.21.15.107:0/15769982 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:10.904 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.505+0000 7f2ab8920640 1 -- 172.21.15.107:0/15769982 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab4105120 con 0x7f2ab4076b10 2024-09-21T07:54:10.904 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.506+0000 7f2ab8920640 1 --2- 172.21.15.107:0/15769982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab4076b10 0x7f2ab4104be0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009840 tx=0x7f2aa80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65944e75c1067ee7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:10.904 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.506+0000 7f2ab37fe640 1 -- 172.21.15.107:0/15769982 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2aa8032440 con 0x7f2ab4076b10 2024-09-21T07:54:10.904 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.506+0000 7f2ab37fe640 1 -- 172.21.15.107:0/15769982 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2aa8032a40 con 0x7f2ab4076b10 2024-09-21T07:54:10.904 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.506+0000 7f2ab37fe640 1 -- 172.21.15.107:0/15769982 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2aa8031aa0 con 0x7f2ab4076b10 2024-09-21T07:54:10.904 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.506+0000 7f2abab84640 1 -- 172.21.15.107:0/15769982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab4076b10 msgr2=0x7f2ab4104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:10.904 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.506+0000 7f2abab84640 1 --2- 172.21.15.107:0/15769982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab4076b10 0x7f2ab4104be0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009840 tx=0x7f2aa80091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:10.904 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.506+0000 7f2abab84640 1 -- 172.21.15.107:0/15769982 shutdown_connections 2024-09-21T07:54:10.905 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.506+0000 7f2abab84640 1 --2- 172.21.15.107:0/15769982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab4076b10 0x7f2ab4104be0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:10.905 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.506+0000 7f2abab84640 1 -- 172.21.15.107:0/15769982 >> 172.21.15.107:0/15769982 conn(0x7f2ab40fc6d0 msgr2=0x7f2ab40feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:10.905 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.507+0000 7f2abab84640 1 -- 172.21.15.107:0/15769982 shutdown_connections 2024-09-21T07:54:10.905 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.507+0000 7f2abab84640 1 -- 172.21.15.107:0/15769982 wait complete. 2024-09-21T07:54:10.905 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.507+0000 7f2abab84640 1 Processor -- start 2024-09-21T07:54:10.905 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.507+0000 7f2abab84640 1 -- start start 2024-09-21T07:54:10.905 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.507+0000 7f2abab84640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab4076b10 0x7f2ab4102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:10.905 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.507+0000 7f2abab84640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab4102a50 con 0x7f2ab4076b10 2024-09-21T07:54:10.905 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.507+0000 7f2ab8920640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab4076b10 0x7f2ab4102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:10.905 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.507+0000 7f2ab8920640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab4076b10 0x7f2ab4102510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45924/0 (socket says 172.21.15.107:45924) 2024-09-21T07:54:10.905 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.507+0000 7f2ab8920640 1 -- 172.21.15.107:0/1662295492 learned_addr learned my addr 172.21.15.107:0/1662295492 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:10.905 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.508+0000 7f2ab8920640 1 -- 172.21.15.107:0/1662295492 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa8009450 con 0x7f2ab4076b10 2024-09-21T07:54:10.905 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.508+0000 7f2ab8920640 1 --2- 172.21.15.107:0/1662295492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab4076b10 0x7f2ab4102510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009810 tx=0x7f2aa80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:10.906 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.508+0000 7f2ab17fa640 1 -- 172.21.15.107:0/1662295492 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2aa80327b0 con 0x7f2ab4076b10 2024-09-21T07:54:10.906 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.508+0000 7f2ab17fa640 1 -- 172.21.15.107:0/1662295492 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2aa803b8d0 con 0x7f2ab4076b10 2024-09-21T07:54:10.906 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.508+0000 7f2abab84640 1 -- 172.21.15.107:0/1662295492 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab4100ae0 con 0x7f2ab4076b10 2024-09-21T07:54:10.906 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.508+0000 7f2ab17fa640 1 -- 172.21.15.107:0/1662295492 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2aa803a6f0 con 0x7f2ab4076b10 2024-09-21T07:54:10.906 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.508+0000 7f2abab84640 1 -- 172.21.15.107:0/1662295492 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab4100f50 con 0x7f2ab4076b10 2024-09-21T07:54:10.906 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.509+0000 7f2ab17fa640 1 -- 172.21.15.107:0/1662295492 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f2aa8039040 con 0x7f2ab4076b10 2024-09-21T07:54:10.906 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.509+0000 7f2abab84640 1 -- 172.21.15.107:0/1662295492 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab404b720 con 0x7f2ab4076b10 2024-09-21T07:54:10.906 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.509+0000 7f2ab17fa640 1 --2- 172.21.15.107:0/1662295492 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f2aa40394e0 0x7f2aa403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:10.906 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.509+0000 7f2ab17fa640 1 -- 172.21.15.107:0/1662295492 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f2aa806cb90 con 0x7f2ab4076b10 2024-09-21T07:54:10.906 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.509+0000 7f2ab3fff640 1 --2- 172.21.15.107:0/1662295492 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f2aa40394e0 0x7f2aa403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:10.906 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.510+0000 7f2ab3fff640 1 --2- 172.21.15.107:0/1662295492 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f2aa40394e0 0x7f2aa403b990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0006fd0 tx=0x7f2aa0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:10.906 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.514+0000 7f2ab17fa640 1 -- 172.21.15.107:0/1662295492 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2aa804bae0 con 0x7f2ab4076b10 2024-09-21T07:54:10.906 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.698+0000 7f2abab84640 1 -- 172.21.15.107:0/1662295492 --> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ab4101700 con 0x7f2aa40394e0 2024-09-21T07:54:10.907 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.703+0000 7f2ab17fa640 1 -- 172.21.15.107:0/1662295492 <== mgr.14118 v2:172.21.15.107:6800/2912640406 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f2ab4101700 con 0x7f2aa40394e0 2024-09-21T07:54:10.907 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.705+0000 7f2abab84640 1 -- 172.21.15.107:0/1662295492 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f2aa40394e0 msgr2=0x7f2aa403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:10.907 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.705+0000 7f2abab84640 1 --2- 172.21.15.107:0/1662295492 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f2aa40394e0 0x7f2aa403b990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0006fd0 tx=0x7f2aa0006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:10.907 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.705+0000 7f2abab84640 1 -- 172.21.15.107:0/1662295492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab4076b10 msgr2=0x7f2ab4102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:10.907 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.705+0000 7f2abab84640 1 --2- 172.21.15.107:0/1662295492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab4076b10 0x7f2ab4102510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009810 tx=0x7f2aa80091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:10.907 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.705+0000 7f2abab84640 1 -- 172.21.15.107:0/1662295492 shutdown_connections 2024-09-21T07:54:10.907 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.705+0000 7f2abab84640 1 --2- 172.21.15.107:0/1662295492 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f2aa40394e0 0x7f2aa403b990 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:10.907 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.705+0000 7f2abab84640 1 --2- 172.21.15.107:0/1662295492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab4076b10 0x7f2ab4102510 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:10.907 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.705+0000 7f2abab84640 1 -- 172.21.15.107:0/1662295492 >> 172.21.15.107:0/1662295492 conn(0x7f2ab40fc6d0 msgr2=0x7f2ab40fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:10.907 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.705+0000 7f2abab84640 1 -- 172.21.15.107:0/1662295492 shutdown_connections 2024-09-21T07:54:10.907 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:09.705+0000 7f2abab84640 1 -- 172.21.15.107:0/1662295492 wait complete. 2024-09-21T07:54:10.907 INFO:teuthology.orchestra.run.smithi107.stdout:Deploying prometheus service with default placement... 2024-09-21T07:54:10.997 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:10 smithi107 ceph-mon[27622]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:10.997 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:10 smithi107 ceph-mon[27622]: Saving service crash spec with placement * 2024-09-21T07:54:10.997 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:10 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:12.079 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-21T07:54:12.079 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.247+0000 7f1e3141b640 1 Processor -- start 2024-09-21T07:54:12.079 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.247+0000 7f1e3141b640 1 -- start start 2024-09-21T07:54:12.079 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.248+0000 7f1e3141b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e2c076c20 0x7f1e2c106f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:12.079 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.248+0000 7f1e3141b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c102980 con 0x7f1e2c076c20 2024-09-21T07:54:12.079 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.248+0000 7f1e2affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e2c076c20 0x7f1e2c106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:12.079 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.248+0000 7f1e2affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e2c076c20 0x7f1e2c106f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56172/0 (socket says 172.21.15.107:56172) 2024-09-21T07:54:12.079 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.248+0000 7f1e2affd640 1 -- 172.21.15.107:0/696524439 learned_addr learned my addr 172.21.15.107:0/696524439 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:12.079 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.248+0000 7f1e2affd640 1 -- 172.21.15.107:0/696524439 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c1074d0 con 0x7f1e2c076c20 2024-09-21T07:54:12.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.249+0000 7f1e2affd640 1 --2- 172.21.15.107:0/696524439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e2c076c20 0x7f1e2c106f90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c009840 tx=0x7f1e1c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0013beb623e66b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:12.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.249+0000 7f1e2a7fc640 1 -- 172.21.15.107:0/696524439 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e1c032440 con 0x7f1e2c076c20 2024-09-21T07:54:12.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.249+0000 7f1e2a7fc640 1 -- 172.21.15.107:0/696524439 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1e1c032a40 con 0x7f1e2c076c20 2024-09-21T07:54:12.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.249+0000 7f1e2a7fc640 1 -- 172.21.15.107:0/696524439 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e1c031a70 con 0x7f1e2c076c20 2024-09-21T07:54:12.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.250+0000 7f1e3141b640 1 -- 172.21.15.107:0/696524439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e2c076c20 msgr2=0x7f1e2c106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:12.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.250+0000 7f1e3141b640 1 --2- 172.21.15.107:0/696524439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e2c076c20 0x7f1e2c106f90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c009840 tx=0x7f1e1c0091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:12.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.250+0000 7f1e3141b640 1 -- 172.21.15.107:0/696524439 shutdown_connections 2024-09-21T07:54:12.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.250+0000 7f1e3141b640 1 --2- 172.21.15.107:0/696524439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e2c076c20 0x7f1e2c106f90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:12.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.251+0000 7f1e3141b640 1 -- 172.21.15.107:0/696524439 >> 172.21.15.107:0/696524439 conn(0x7f1e2c0fc620 msgr2=0x7f1e2c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:12.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.251+0000 7f1e3141b640 1 -- 172.21.15.107:0/696524439 shutdown_connections 2024-09-21T07:54:12.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.251+0000 7f1e3141b640 1 -- 172.21.15.107:0/696524439 wait complete. 2024-09-21T07:54:12.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.251+0000 7f1e3141b640 1 Processor -- start 2024-09-21T07:54:12.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.251+0000 7f1e3141b640 1 -- start start 2024-09-21T07:54:12.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.251+0000 7f1e3141b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e2c076c20 0x7f1e2c112fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:12.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.251+0000 7f1e3141b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c1134f0 con 0x7f1e2c076c20 2024-09-21T07:54:12.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.252+0000 7f1e2affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e2c076c20 0x7f1e2c112fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:12.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.252+0000 7f1e2affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e2c076c20 0x7f1e2c112fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56174/0 (socket says 172.21.15.107:56174) 2024-09-21T07:54:12.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.252+0000 7f1e2affd640 1 -- 172.21.15.107:0/696730839 learned_addr learned my addr 172.21.15.107:0/696730839 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:12.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.252+0000 7f1e2affd640 1 -- 172.21.15.107:0/696730839 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c009450 con 0x7f1e2c076c20 2024-09-21T07:54:12.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.252+0000 7f1e2affd640 1 --2- 172.21.15.107:0/696730839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e2c076c20 0x7f1e2c112fb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c031750 tx=0x7f1e1c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:12.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.252+0000 7f1e23fff640 1 -- 172.21.15.107:0/696730839 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e1c03c400 con 0x7f1e2c076c20 2024-09-21T07:54:12.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.252+0000 7f1e23fff640 1 -- 172.21.15.107:0/696730839 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1e1c03ca00 con 0x7f1e2c076c20 2024-09-21T07:54:12.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.252+0000 7f1e23fff640 1 -- 172.21.15.107:0/696730839 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e1c03a880 con 0x7f1e2c076c20 2024-09-21T07:54:12.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.252+0000 7f1e3141b640 1 -- 172.21.15.107:0/696730839 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2c1136f0 con 0x7f1e2c076c20 2024-09-21T07:54:12.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.252+0000 7f1e3141b640 1 -- 172.21.15.107:0/696730839 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2c113b00 con 0x7f1e2c076c20 2024-09-21T07:54:12.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.253+0000 7f1e23fff640 1 -- 172.21.15.107:0/696730839 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f1e1c03aaf0 con 0x7f1e2c076c20 2024-09-21T07:54:12.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.254+0000 7f1e3141b640 1 -- 172.21.15.107:0/696730839 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2c04b720 con 0x7f1e2c076c20 2024-09-21T07:54:12.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.254+0000 7f1e23fff640 1 --2- 172.21.15.107:0/696730839 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f1e18039490 0x7f1e1803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:12.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.254+0000 7f1e23fff640 1 -- 172.21.15.107:0/696730839 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1e1c06d140 con 0x7f1e2c076c20 2024-09-21T07:54:12.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.254+0000 7f1e227fc640 1 --2- 172.21.15.107:0/696730839 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f1e18039490 0x7f1e1803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:12.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.254+0000 7f1e227fc640 1 --2- 172.21.15.107:0/696730839 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f1e18039490 0x7f1e1803b940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1e14006fd0 tx=0x7f1e14006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:12.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.258+0000 7f1e23fff640 1 -- 172.21.15.107:0/696730839 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1e1c030570 con 0x7f1e2c076c20 2024-09-21T07:54:12.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.463+0000 7f1e3141b640 1 -- 172.21.15.107:0/696730839 --> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e2c0fd9a0 con 0x7f1e18039490 2024-09-21T07:54:12.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.467+0000 7f1e23fff640 1 -- 172.21.15.107:0/696730839 <== mgr.14118 v2:172.21.15.107:6800/2912640406 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f1e2c0fd9a0 con 0x7f1e18039490 2024-09-21T07:54:12.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.469+0000 7f1e3141b640 1 -- 172.21.15.107:0/696730839 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f1e18039490 msgr2=0x7f1e1803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:12.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.469+0000 7f1e3141b640 1 --2- 172.21.15.107:0/696730839 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f1e18039490 0x7f1e1803b940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1e14006fd0 tx=0x7f1e14006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:12.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.469+0000 7f1e3141b640 1 -- 172.21.15.107:0/696730839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e2c076c20 msgr2=0x7f1e2c112fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:12.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.469+0000 7f1e3141b640 1 --2- 172.21.15.107:0/696730839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e2c076c20 0x7f1e2c112fb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c031750 tx=0x7f1e1c0091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:12.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.469+0000 7f1e3141b640 1 -- 172.21.15.107:0/696730839 shutdown_connections 2024-09-21T07:54:12.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.469+0000 7f1e3141b640 1 --2- 172.21.15.107:0/696730839 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f1e18039490 0x7f1e1803b940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:12.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.469+0000 7f1e3141b640 1 --2- 172.21.15.107:0/696730839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e2c076c20 0x7f1e2c112fb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:12.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.469+0000 7f1e3141b640 1 -- 172.21.15.107:0/696730839 >> 172.21.15.107:0/696730839 conn(0x7f1e2c0fc620 msgr2=0x7f1e2c0fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:12.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.469+0000 7f1e3141b640 1 -- 172.21.15.107:0/696730839 shutdown_connections 2024-09-21T07:54:12.083 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:11.469+0000 7f1e3141b640 1 -- 172.21.15.107:0/696730839 wait complete. 2024-09-21T07:54:12.083 INFO:teuthology.orchestra.run.smithi107.stdout:Deploying grafana service with default placement... 2024-09-21T07:54:12.779 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:12 smithi107 ceph-mon[27622]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:12.780 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:12 smithi107 ceph-mon[27622]: Saving service prometheus spec with placement count:1 2024-09-21T07:54:12.780 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:12 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:12.780 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:12 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:13.640 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:13 smithi107 ceph-mon[27622]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:13.640 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:13 smithi107 ceph-mon[27622]: Saving service grafana spec with placement count:1 2024-09-21T07:54:13.640 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:13 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:14.016 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-21T07:54:14.016 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.407+0000 7f7808cd2640 1 Processor -- start 2024-09-21T07:54:14.016 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.407+0000 7f7808cd2640 1 -- start start 2024-09-21T07:54:14.016 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.407+0000 7f7808cd2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7804078cf0 0x7f7804077270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:14.016 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.407+0000 7f7808cd2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7804079100 con 0x7f7804078cf0 2024-09-21T07:54:14.017 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.408+0000 7f780259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7804078cf0 0x7f7804077270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:14.017 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.408+0000 7f780259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7804078cf0 0x7f7804077270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56188/0 (socket says 172.21.15.107:56188) 2024-09-21T07:54:14.017 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.408+0000 7f780259c640 1 -- 172.21.15.107:0/4135118069 learned_addr learned my addr 172.21.15.107:0/4135118069 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:14.017 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.408+0000 7f780259c640 1 -- 172.21.15.107:0/4135118069 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78040777b0 con 0x7f7804078cf0 2024-09-21T07:54:14.017 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.409+0000 7f780259c640 1 --2- 172.21.15.107:0/4135118069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7804078cf0 0x7f7804077270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f77f4009840 tx=0x7f77f40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5528323e2f8bfb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:14.017 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.409+0000 7f780159a640 1 -- 172.21.15.107:0/4135118069 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77f4032440 con 0x7f7804078cf0 2024-09-21T07:54:14.017 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.409+0000 7f780159a640 1 -- 172.21.15.107:0/4135118069 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f77f4032a40 con 0x7f7804078cf0 2024-09-21T07:54:14.017 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.409+0000 7f780159a640 1 -- 172.21.15.107:0/4135118069 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77f4031a70 con 0x7f7804078cf0 2024-09-21T07:54:14.017 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.409+0000 7f7808cd2640 1 -- 172.21.15.107:0/4135118069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7804078cf0 msgr2=0x7f7804077270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:14.018 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.409+0000 7f7808cd2640 1 --2- 172.21.15.107:0/4135118069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7804078cf0 0x7f7804077270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f77f4009840 tx=0x7f77f40091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:14.018 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.410+0000 7f7808cd2640 1 -- 172.21.15.107:0/4135118069 shutdown_connections 2024-09-21T07:54:14.018 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.410+0000 7f7808cd2640 1 --2- 172.21.15.107:0/4135118069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7804078cf0 0x7f7804077270 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:14.018 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.410+0000 7f7808cd2640 1 -- 172.21.15.107:0/4135118069 >> 172.21.15.107:0/4135118069 conn(0x7f78040fd730 msgr2=0x7f78040ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:14.018 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.410+0000 7f7808cd2640 1 -- 172.21.15.107:0/4135118069 shutdown_connections 2024-09-21T07:54:14.018 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.410+0000 7f7808cd2640 1 -- 172.21.15.107:0/4135118069 wait complete. 2024-09-21T07:54:14.018 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.410+0000 7f7808cd2640 1 Processor -- start 2024-09-21T07:54:14.018 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.410+0000 7f7808cd2640 1 -- start start 2024-09-21T07:54:14.018 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.410+0000 7f7808cd2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7804078cf0 0x7f7804112fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:14.018 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.410+0000 7f7808cd2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7804113500 con 0x7f7804078cf0 2024-09-21T07:54:14.018 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.410+0000 7f780259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7804078cf0 0x7f7804112fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:14.018 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.410+0000 7f780259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7804078cf0 0x7f7804112fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56202/0 (socket says 172.21.15.107:56202) 2024-09-21T07:54:14.018 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.411+0000 7f780259c640 1 -- 172.21.15.107:0/3284769724 learned_addr learned my addr 172.21.15.107:0/3284769724 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:14.019 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.411+0000 7f780259c640 1 -- 172.21.15.107:0/3284769724 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f4009450 con 0x7f7804078cf0 2024-09-21T07:54:14.019 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.411+0000 7f780259c640 1 --2- 172.21.15.107:0/3284769724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7804078cf0 0x7f7804112fc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f77f4031750 tx=0x7f77f40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:14.019 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.411+0000 7f77f2ffd640 1 -- 172.21.15.107:0/3284769724 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77f403c400 con 0x7f7804078cf0 2024-09-21T07:54:14.019 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.411+0000 7f77f2ffd640 1 -- 172.21.15.107:0/3284769724 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f77f403ca00 con 0x7f7804078cf0 2024-09-21T07:54:14.019 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.411+0000 7f7808cd2640 1 -- 172.21.15.107:0/3284769724 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7804113700 con 0x7f7804078cf0 2024-09-21T07:54:14.019 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.411+0000 7f77f2ffd640 1 -- 172.21.15.107:0/3284769724 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77f403a880 con 0x7f7804078cf0 2024-09-21T07:54:14.019 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.411+0000 7f7808cd2640 1 -- 172.21.15.107:0/3284769724 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7804113b10 con 0x7f7804078cf0 2024-09-21T07:54:14.019 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.412+0000 7f77f2ffd640 1 -- 172.21.15.107:0/3284769724 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f77f403a9e0 con 0x7f7804078cf0 2024-09-21T07:54:14.019 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.412+0000 7f77f2ffd640 1 --2- 172.21.15.107:0/3284769724 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f77ec0394e0 0x7f77ec03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:14.019 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.412+0000 7f77f2ffd640 1 -- 172.21.15.107:0/3284769724 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f77f406cfb0 con 0x7f7804078cf0 2024-09-21T07:54:14.019 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.412+0000 7f7801d9b640 1 --2- 172.21.15.107:0/3284769724 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f77ec0394e0 0x7f77ec03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:14.019 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.412+0000 7f7808cd2640 1 -- 172.21.15.107:0/3284769724 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780404b720 con 0x7f7804078cf0 2024-09-21T07:54:14.019 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.413+0000 7f7801d9b640 1 --2- 172.21.15.107:0/3284769724 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f77ec0394e0 0x7f77ec03b990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f77f8006fd0 tx=0x7f77f8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:14.019 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.417+0000 7f77f2ffd640 1 -- 172.21.15.107:0/3284769724 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f77f4037030 con 0x7f7804078cf0 2024-09-21T07:54:14.020 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.631+0000 7f7808cd2640 1 -- 172.21.15.107:0/3284769724 --> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f78040fea70 con 0x7f77ec0394e0 2024-09-21T07:54:14.020 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.638+0000 7f77f2ffd640 1 -- 172.21.15.107:0/3284769724 <== mgr.14118 v2:172.21.15.107:6800/2912640406 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f78040fea70 con 0x7f77ec0394e0 2024-09-21T07:54:14.020 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.640+0000 7f7808cd2640 1 -- 172.21.15.107:0/3284769724 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f77ec0394e0 msgr2=0x7f77ec03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:14.020 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.640+0000 7f7808cd2640 1 --2- 172.21.15.107:0/3284769724 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f77ec0394e0 0x7f77ec03b990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f77f8006fd0 tx=0x7f77f8006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:14.020 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.640+0000 7f7808cd2640 1 -- 172.21.15.107:0/3284769724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7804078cf0 msgr2=0x7f7804112fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:14.020 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.640+0000 7f7808cd2640 1 --2- 172.21.15.107:0/3284769724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7804078cf0 0x7f7804112fc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f77f4031750 tx=0x7f77f40091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:14.020 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.640+0000 7f7808cd2640 1 -- 172.21.15.107:0/3284769724 shutdown_connections 2024-09-21T07:54:14.020 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.640+0000 7f7808cd2640 1 --2- 172.21.15.107:0/3284769724 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f77ec0394e0 0x7f77ec03b990 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:14.020 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.640+0000 7f7808cd2640 1 --2- 172.21.15.107:0/3284769724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7804078cf0 0x7f7804112fc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:14.020 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.640+0000 7f7808cd2640 1 -- 172.21.15.107:0/3284769724 >> 172.21.15.107:0/3284769724 conn(0x7f78040fd730 msgr2=0x7f78040fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:14.020 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.640+0000 7f7808cd2640 1 -- 172.21.15.107:0/3284769724 shutdown_connections 2024-09-21T07:54:14.020 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:12.640+0000 7f7808cd2640 1 -- 172.21.15.107:0/3284769724 wait complete. 2024-09-21T07:54:14.020 INFO:teuthology.orchestra.run.smithi107.stdout:Deploying node-exporter service with default placement... 2024-09-21T07:54:15.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-21T07:54:15.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.401+0000 7f22ab2c1640 1 Processor -- start 2024-09-21T07:54:15.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.401+0000 7f22ab2c1640 1 -- start start 2024-09-21T07:54:15.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.401+0000 7f22ab2c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22a4078c80 0x7f22a4077250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.401+0000 7f22ab2c1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a4079090 con 0x7f22a4078c80 2024-09-21T07:54:15.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.401+0000 7f22a905d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22a4078c80 0x7f22a4077250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:15.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.401+0000 7f22a905d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22a4078c80 0x7f22a4077250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56216/0 (socket says 172.21.15.107:56216) 2024-09-21T07:54:15.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.401+0000 7f22a905d640 1 -- 172.21.15.107:0/2410926200 learned_addr learned my addr 172.21.15.107:0/2410926200 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:15.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.401+0000 7f22a905d640 1 -- 172.21.15.107:0/2410926200 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a4077790 con 0x7f22a4078c80 2024-09-21T07:54:15.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.402+0000 7f22a905d640 1 --2- 172.21.15.107:0/2410926200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22a4078c80 0x7f22a4077250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f22a0009840 tx=0x7f22a00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621cbcf110ff9d8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:15.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.402+0000 7f229bfff640 1 -- 172.21.15.107:0/2410926200 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22a0032440 con 0x7f22a4078c80 2024-09-21T07:54:15.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.402+0000 7f229bfff640 1 -- 172.21.15.107:0/2410926200 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f22a0032a40 con 0x7f22a4078c80 2024-09-21T07:54:15.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.402+0000 7f229bfff640 1 -- 172.21.15.107:0/2410926200 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22a0031a70 con 0x7f22a4078c80 2024-09-21T07:54:15.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.403+0000 7f22ab2c1640 1 -- 172.21.15.107:0/2410926200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22a4078c80 msgr2=0x7f22a4077250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:15.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.403+0000 7f22ab2c1640 1 --2- 172.21.15.107:0/2410926200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22a4078c80 0x7f22a4077250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f22a0009840 tx=0x7f22a00091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.403+0000 7f22ab2c1640 1 -- 172.21.15.107:0/2410926200 shutdown_connections 2024-09-21T07:54:15.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.403+0000 7f22ab2c1640 1 --2- 172.21.15.107:0/2410926200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22a4078c80 0x7f22a4077250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.403+0000 7f22ab2c1640 1 -- 172.21.15.107:0/2410926200 >> 172.21.15.107:0/2410926200 conn(0x7f22a40fd710 msgr2=0x7f22a40ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:15.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.403+0000 7f22ab2c1640 1 -- 172.21.15.107:0/2410926200 shutdown_connections 2024-09-21T07:54:15.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.403+0000 7f22ab2c1640 1 -- 172.21.15.107:0/2410926200 wait complete. 2024-09-21T07:54:15.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.404+0000 7f22ab2c1640 1 Processor -- start 2024-09-21T07:54:15.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.404+0000 7f22ab2c1640 1 -- start start 2024-09-21T07:54:15.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.404+0000 7f22ab2c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22a4078c80 0x7f22a4112fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.404+0000 7f22ab2c1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a41134f0 con 0x7f22a4078c80 2024-09-21T07:54:15.150 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.404+0000 7f22a905d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22a4078c80 0x7f22a4112fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:15.150 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.404+0000 7f22a905d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22a4078c80 0x7f22a4112fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56220/0 (socket says 172.21.15.107:56220) 2024-09-21T07:54:15.150 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.404+0000 7f22a905d640 1 -- 172.21.15.107:0/3400312508 learned_addr learned my addr 172.21.15.107:0/3400312508 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:15.150 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.404+0000 7f22a905d640 1 -- 172.21.15.107:0/3400312508 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a0009450 con 0x7f22a4078c80 2024-09-21T07:54:15.150 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.404+0000 7f22a905d640 1 --2- 172.21.15.107:0/3400312508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22a4078c80 0x7f22a4112fb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f22a0031750 tx=0x7f22a00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:15.150 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.404+0000 7f2299ffb640 1 -- 172.21.15.107:0/3400312508 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22a003c400 con 0x7f22a4078c80 2024-09-21T07:54:15.150 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.404+0000 7f2299ffb640 1 -- 172.21.15.107:0/3400312508 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f22a003ca00 con 0x7f22a4078c80 2024-09-21T07:54:15.150 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.404+0000 7f22ab2c1640 1 -- 172.21.15.107:0/3400312508 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a41136f0 con 0x7f22a4078c80 2024-09-21T07:54:15.150 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.405+0000 7f2299ffb640 1 -- 172.21.15.107:0/3400312508 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22a003a7f0 con 0x7f22a4078c80 2024-09-21T07:54:15.150 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.405+0000 7f22ab2c1640 1 -- 172.21.15.107:0/3400312508 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a4113b60 con 0x7f22a4078c80 2024-09-21T07:54:15.150 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.405+0000 7f2299ffb640 1 -- 172.21.15.107:0/3400312508 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f22a003a950 con 0x7f22a4078c80 2024-09-21T07:54:15.150 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.406+0000 7f2299ffb640 1 --2- 172.21.15.107:0/3400312508 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f22900394e0 0x7f229003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.150 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.406+0000 7f2299ffb640 1 -- 172.21.15.107:0/3400312508 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f22a006cc40 con 0x7f22a4078c80 2024-09-21T07:54:15.150 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.406+0000 7f22ab2c1640 1 -- 172.21.15.107:0/3400312508 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a41013f0 con 0x7f22a4078c80 2024-09-21T07:54:15.151 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.406+0000 7f22a885c640 1 --2- 172.21.15.107:0/3400312508 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f22900394e0 0x7f229003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:15.151 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.406+0000 7f22a885c640 1 --2- 172.21.15.107:0/3400312508 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f22900394e0 0x7f229003b990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2294006fd0 tx=0x7f2294006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:15.151 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.410+0000 7f2299ffb640 1 -- 172.21.15.107:0/3400312508 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f22a0037070 con 0x7f22a4078c80 2024-09-21T07:54:15.151 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.574+0000 7f22ab2c1640 1 -- 172.21.15.107:0/3400312508 --> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f22a40fea30 con 0x7f22900394e0 2024-09-21T07:54:15.151 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.578+0000 7f2299ffb640 1 -- 172.21.15.107:0/3400312508 <== mgr.14118 v2:172.21.15.107:6800/2912640406 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f22a40fea30 con 0x7f22900394e0 2024-09-21T07:54:15.151 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.580+0000 7f22ab2c1640 1 -- 172.21.15.107:0/3400312508 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f22900394e0 msgr2=0x7f229003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:15.151 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.580+0000 7f22ab2c1640 1 --2- 172.21.15.107:0/3400312508 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f22900394e0 0x7f229003b990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2294006fd0 tx=0x7f2294006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.151 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.580+0000 7f22ab2c1640 1 -- 172.21.15.107:0/3400312508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22a4078c80 msgr2=0x7f22a4112fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:15.151 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.580+0000 7f22ab2c1640 1 --2- 172.21.15.107:0/3400312508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22a4078c80 0x7f22a4112fb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f22a0031750 tx=0x7f22a00091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.151 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.580+0000 7f22ab2c1640 1 -- 172.21.15.107:0/3400312508 shutdown_connections 2024-09-21T07:54:15.151 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.580+0000 7f22ab2c1640 1 --2- 172.21.15.107:0/3400312508 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f22900394e0 0x7f229003b990 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.151 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.580+0000 7f22ab2c1640 1 --2- 172.21.15.107:0/3400312508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22a4078c80 0x7f22a4112fb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.151 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.580+0000 7f22ab2c1640 1 -- 172.21.15.107:0/3400312508 >> 172.21.15.107:0/3400312508 conn(0x7f22a40fd710 msgr2=0x7f22a40fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:15.152 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.580+0000 7f22ab2c1640 1 -- 172.21.15.107:0/3400312508 shutdown_connections 2024-09-21T07:54:15.152 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:14.580+0000 7f22ab2c1640 1 -- 172.21.15.107:0/3400312508 wait complete. 2024-09-21T07:54:15.152 INFO:teuthology.orchestra.run.smithi107.stdout:Deploying alertmanager service with default placement... 2024-09-21T07:54:15.720 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:15 smithi107 ceph-mon[27622]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:15.720 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:15 smithi107 ceph-mon[27622]: Saving service node-exporter spec with placement * 2024-09-21T07:54:15.720 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:15 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:16.228 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-21T07:54:16.229 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.540+0000 7ff3468c0640 1 Processor -- start 2024-09-21T07:54:16.229 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.540+0000 7ff3468c0640 1 -- start start 2024-09-21T07:54:16.229 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.540+0000 7ff3468c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff340076b30 0x7ff340104c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.229 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.540+0000 7ff3468c0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff340076f40 con 0x7ff340076b30 2024-09-21T07:54:16.229 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.540+0000 7ff33ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff340076b30 0x7ff340104c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:16.229 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.540+0000 7ff33ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff340076b30 0x7ff340104c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56230/0 (socket says 172.21.15.107:56230) 2024-09-21T07:54:16.229 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.540+0000 7ff33ffff640 1 -- 172.21.15.107:0/1883015667 learned_addr learned my addr 172.21.15.107:0/1883015667 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:16.229 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.540+0000 7ff33ffff640 1 -- 172.21.15.107:0/1883015667 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff340105180 con 0x7ff340076b30 2024-09-21T07:54:16.229 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.541+0000 7ff33ffff640 1 --2- 172.21.15.107:0/1883015667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff340076b30 0x7ff340104c40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff330009840 tx=0x7ff3300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53976fbda7f5a19e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:16.229 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.541+0000 7ff33effd640 1 -- 172.21.15.107:0/1883015667 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff330032440 con 0x7ff340076b30 2024-09-21T07:54:16.229 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.541+0000 7ff33effd640 1 -- 172.21.15.107:0/1883015667 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff330032a40 con 0x7ff340076b30 2024-09-21T07:54:16.230 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.541+0000 7ff33effd640 1 -- 172.21.15.107:0/1883015667 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff330031a70 con 0x7ff340076b30 2024-09-21T07:54:16.230 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.542+0000 7ff3468c0640 1 -- 172.21.15.107:0/1883015667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff340076b30 msgr2=0x7ff340104c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:16.230 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.542+0000 7ff3468c0640 1 --2- 172.21.15.107:0/1883015667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff340076b30 0x7ff340104c40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff330009840 tx=0x7ff3300091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.230 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.542+0000 7ff3468c0640 1 -- 172.21.15.107:0/1883015667 shutdown_connections 2024-09-21T07:54:16.230 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.542+0000 7ff3468c0640 1 --2- 172.21.15.107:0/1883015667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff340076b30 0x7ff340104c40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.230 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.542+0000 7ff3468c0640 1 -- 172.21.15.107:0/1883015667 >> 172.21.15.107:0/1883015667 conn(0x7ff3400fc710 msgr2=0x7ff3400feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:16.230 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.542+0000 7ff3468c0640 1 -- 172.21.15.107:0/1883015667 shutdown_connections 2024-09-21T07:54:16.230 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.542+0000 7ff3468c0640 1 -- 172.21.15.107:0/1883015667 wait complete. 2024-09-21T07:54:16.230 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.542+0000 7ff3468c0640 1 Processor -- start 2024-09-21T07:54:16.230 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.543+0000 7ff3468c0640 1 -- start start 2024-09-21T07:54:16.230 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.543+0000 7ff3468c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff340076b30 0x7ff340102570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.230 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.543+0000 7ff3468c0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff340102ab0 con 0x7ff340076b30 2024-09-21T07:54:16.230 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.543+0000 7ff33ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff340076b30 0x7ff340102570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.543+0000 7ff33ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff340076b30 0x7ff340102570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56244/0 (socket says 172.21.15.107:56244) 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.543+0000 7ff33ffff640 1 -- 172.21.15.107:0/393753767 learned_addr learned my addr 172.21.15.107:0/393753767 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.543+0000 7ff33ffff640 1 -- 172.21.15.107:0/393753767 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff330009450 con 0x7ff340076b30 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.543+0000 7ff33ffff640 1 --2- 172.21.15.107:0/393753767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff340076b30 0x7ff340102570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff330009420 tx=0x7ff3300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.543+0000 7ff33cff9640 1 -- 172.21.15.107:0/393753767 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff33003c400 con 0x7ff340076b30 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.543+0000 7ff33cff9640 1 -- 172.21.15.107:0/393753767 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff33003ca00 con 0x7ff340076b30 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.543+0000 7ff33cff9640 1 -- 172.21.15.107:0/393753767 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff33003a920 con 0x7ff340076b30 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.543+0000 7ff3468c0640 1 -- 172.21.15.107:0/393753767 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff340100b40 con 0x7ff340076b30 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.544+0000 7ff3468c0640 1 -- 172.21.15.107:0/393753767 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff340100fb0 con 0x7ff340076b30 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.545+0000 7ff33cff9640 1 -- 172.21.15.107:0/393753767 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7ff33003c560 con 0x7ff340076b30 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.545+0000 7ff3468c0640 1 -- 172.21.15.107:0/393753767 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff340105f70 con 0x7ff340076b30 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.545+0000 7ff33cff9640 1 --2- 172.21.15.107:0/393753767 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7ff3280394e0 0x7ff32803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.545+0000 7ff33cff9640 1 -- 172.21.15.107:0/393753767 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff33006ce20 con 0x7ff340076b30 2024-09-21T07:54:16.232 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.545+0000 7ff33f7fe640 1 --2- 172.21.15.107:0/393753767 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7ff3280394e0 0x7ff32803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:16.232 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.545+0000 7ff33f7fe640 1 --2- 172.21.15.107:0/393753767 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7ff3280394e0 0x7ff32803b990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff334006fd0 tx=0x7ff334006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:16.232 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.549+0000 7ff33cff9640 1 -- 172.21.15.107:0/393753767 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff33003aa80 con 0x7ff340076b30 2024-09-21T07:54:16.232 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.713+0000 7ff3468c0640 1 -- 172.21.15.107:0/393753767 --> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3400fdad0 con 0x7ff3280394e0 2024-09-21T07:54:16.232 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.718+0000 7ff33cff9640 1 -- 172.21.15.107:0/393753767 <== mgr.14118 v2:172.21.15.107:6800/2912640406 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7ff3400fdad0 con 0x7ff3280394e0 2024-09-21T07:54:16.232 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.720+0000 7ff3468c0640 1 -- 172.21.15.107:0/393753767 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7ff3280394e0 msgr2=0x7ff32803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:16.232 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.720+0000 7ff3468c0640 1 --2- 172.21.15.107:0/393753767 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7ff3280394e0 0x7ff32803b990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff334006fd0 tx=0x7ff334006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.232 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.720+0000 7ff3468c0640 1 -- 172.21.15.107:0/393753767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff340076b30 msgr2=0x7ff340102570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:16.232 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.720+0000 7ff3468c0640 1 --2- 172.21.15.107:0/393753767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff340076b30 0x7ff340102570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff330009420 tx=0x7ff3300091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.232 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.720+0000 7ff3468c0640 1 -- 172.21.15.107:0/393753767 shutdown_connections 2024-09-21T07:54:16.232 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.720+0000 7ff3468c0640 1 --2- 172.21.15.107:0/393753767 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7ff3280394e0 0x7ff32803b990 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.232 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.720+0000 7ff3468c0640 1 --2- 172.21.15.107:0/393753767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff340076b30 0x7ff340102570 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.232 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.720+0000 7ff3468c0640 1 -- 172.21.15.107:0/393753767 >> 172.21.15.107:0/393753767 conn(0x7ff3400fc710 msgr2=0x7ff3400fd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:16.232 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.720+0000 7ff3468c0640 1 -- 172.21.15.107:0/393753767 shutdown_connections 2024-09-21T07:54:16.233 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:15.720+0000 7ff3468c0640 1 -- 172.21.15.107:0/393753767 wait complete. 2024-09-21T07:54:16.792 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:16 smithi107 ceph-mon[27622]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:54:16.792 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:16 smithi107 ceph-mon[27622]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:16.793 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:16 smithi107 ceph-mon[27622]: Saving service alertmanager spec with placement count:1 2024-09-21T07:54:16.793 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:16 smithi107 ceph-mon[27622]: from='mgr.14118 172.21.15.107:0/2822709879' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:17.351 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.615+0000 7f588bc46640 1 Processor -- start 2024-09-21T07:54:17.351 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.616+0000 7f588bc46640 1 -- start start 2024-09-21T07:54:17.351 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.616+0000 7f588bc46640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5884076af0 0x7f5884104c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:17.351 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.616+0000 7f588bc46640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5884076f00 con 0x7f5884076af0 2024-09-21T07:54:17.351 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.616+0000 7f58899e2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5884076af0 0x7f5884104c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:17.351 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.616+0000 7f58899e2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5884076af0 0x7f5884104c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56254/0 (socket says 172.21.15.107:56254) 2024-09-21T07:54:17.351 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.616+0000 7f58899e2640 1 -- 172.21.15.107:0/160513877 learned_addr learned my addr 172.21.15.107:0/160513877 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:17.351 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.616+0000 7f58899e2640 1 -- 172.21.15.107:0/160513877 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58841051c0 con 0x7f5884076af0 2024-09-21T07:54:17.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.617+0000 7f58899e2640 1 --2- 172.21.15.107:0/160513877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5884076af0 0x7f5884104c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5880009840 tx=0x7f58800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3eb93deeef1227 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:17.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.617+0000 7f58889e0640 1 -- 172.21.15.107:0/160513877 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5880032440 con 0x7f5884076af0 2024-09-21T07:54:17.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.617+0000 7f58889e0640 1 -- 172.21.15.107:0/160513877 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5880032a40 con 0x7f5884076af0 2024-09-21T07:54:17.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.617+0000 7f58889e0640 1 -- 172.21.15.107:0/160513877 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5880031aa0 con 0x7f5884076af0 2024-09-21T07:54:17.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.618+0000 7f588bc46640 1 -- 172.21.15.107:0/160513877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5884076af0 msgr2=0x7f5884104c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:17.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.618+0000 7f588bc46640 1 --2- 172.21.15.107:0/160513877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5884076af0 0x7f5884104c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5880009840 tx=0x7f58800091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:17.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.618+0000 7f588bc46640 1 -- 172.21.15.107:0/160513877 shutdown_connections 2024-09-21T07:54:17.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.618+0000 7f588bc46640 1 --2- 172.21.15.107:0/160513877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5884076af0 0x7f5884104c80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:17.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.618+0000 7f588bc46640 1 -- 172.21.15.107:0/160513877 >> 172.21.15.107:0/160513877 conn(0x7f58840fc790 msgr2=0x7f58840feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:17.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.618+0000 7f588bc46640 1 -- 172.21.15.107:0/160513877 shutdown_connections 2024-09-21T07:54:17.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.618+0000 7f588bc46640 1 -- 172.21.15.107:0/160513877 wait complete. 2024-09-21T07:54:17.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.618+0000 7f588bc46640 1 Processor -- start 2024-09-21T07:54:17.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.618+0000 7f588bc46640 1 -- start start 2024-09-21T07:54:17.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.619+0000 7f588bc46640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5884076af0 0x7f5884110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:17.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.619+0000 7f588bc46640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5884111340 con 0x7f5884076af0 2024-09-21T07:54:17.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.619+0000 7f58899e2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5884076af0 0x7f5884110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:17.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.619+0000 7f58899e2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5884076af0 0x7f5884110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56268/0 (socket says 172.21.15.107:56268) 2024-09-21T07:54:17.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.619+0000 7f58899e2640 1 -- 172.21.15.107:0/458975240 learned_addr learned my addr 172.21.15.107:0/458975240 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:17.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.619+0000 7f58899e2640 1 -- 172.21.15.107:0/458975240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5880009450 con 0x7f5884076af0 2024-09-21T07:54:17.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.619+0000 7f58899e2640 1 --2- 172.21.15.107:0/458975240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5884076af0 0x7f5884110e00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5880031780 tx=0x7f58800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:17.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.619+0000 7f587a7fc640 1 -- 172.21.15.107:0/458975240 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58800327b0 con 0x7f5884076af0 2024-09-21T07:54:17.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.619+0000 7f587a7fc640 1 -- 172.21.15.107:0/458975240 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f588003b8d0 con 0x7f5884076af0 2024-09-21T07:54:17.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.619+0000 7f588bc46640 1 -- 172.21.15.107:0/458975240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58841115a0 con 0x7f5884076af0 2024-09-21T07:54:17.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.619+0000 7f587a7fc640 1 -- 172.21.15.107:0/458975240 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f588003a790 con 0x7f5884076af0 2024-09-21T07:54:17.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.619+0000 7f588bc46640 1 -- 172.21.15.107:0/458975240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5884111f90 con 0x7f5884076af0 2024-09-21T07:54:17.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.620+0000 7f587a7fc640 1 -- 172.21.15.107:0/458975240 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f5880039040 con 0x7f5884076af0 2024-09-21T07:54:17.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.620+0000 7f587a7fc640 1 --2- 172.21.15.107:0/458975240 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f5870039490 0x7f587003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:17.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.620+0000 7f587a7fc640 1 -- 172.21.15.107:0/458975240 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f588006cb40 con 0x7f5884076af0 2024-09-21T07:54:17.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.620+0000 7f588bc46640 1 -- 172.21.15.107:0/458975240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588404b720 con 0x7f5884076af0 2024-09-21T07:54:17.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.620+0000 7f58891e1640 1 --2- 172.21.15.107:0/458975240 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f5870039490 0x7f587003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:17.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.621+0000 7f58891e1640 1 --2- 172.21.15.107:0/458975240 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f5870039490 0x7f587003b940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5874006fd0 tx=0x7f5874006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:17.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.625+0000 7f587a7fc640 1 -- 172.21.15.107:0/458975240 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f588003f020 con 0x7f5884076af0 2024-09-21T07:54:17.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.785+0000 7f588bc46640 1 -- 172.21.15.107:0/458975240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f5884112360 con 0x7f5884076af0 2024-09-21T07:54:17.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.788+0000 7f587a7fc640 1 -- 172.21.15.107:0/458975240 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f5880037070 con 0x7f5884076af0 2024-09-21T07:54:17.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.790+0000 7f588bc46640 1 -- 172.21.15.107:0/458975240 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f5870039490 msgr2=0x7f587003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:17.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.791+0000 7f588bc46640 1 --2- 172.21.15.107:0/458975240 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f5870039490 0x7f587003b940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5874006fd0 tx=0x7f5874006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:17.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.791+0000 7f588bc46640 1 -- 172.21.15.107:0/458975240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5884076af0 msgr2=0x7f5884110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:17.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.791+0000 7f588bc46640 1 --2- 172.21.15.107:0/458975240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5884076af0 0x7f5884110e00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5880031780 tx=0x7f58800091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:17.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.791+0000 7f588bc46640 1 -- 172.21.15.107:0/458975240 shutdown_connections 2024-09-21T07:54:17.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.791+0000 7f588bc46640 1 --2- 172.21.15.107:0/458975240 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f5870039490 0x7f587003b940 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:17.355 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.791+0000 7f588bc46640 1 --2- 172.21.15.107:0/458975240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5884076af0 0x7f5884110e00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:17.355 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.791+0000 7f588bc46640 1 -- 172.21.15.107:0/458975240 >> 172.21.15.107:0/458975240 conn(0x7f58840fc790 msgr2=0x7f58840fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:17.355 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.791+0000 7f588bc46640 1 -- 172.21.15.107:0/458975240 shutdown_connections 2024-09-21T07:54:17.355 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:16.791+0000 7f588bc46640 1 -- 172.21.15.107:0/458975240 wait complete. 2024-09-21T07:54:18.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:17 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/458975240' entity='client.admin' 2024-09-21T07:54:18.457 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.746+0000 7f34fb54c640 1 Processor -- start 2024-09-21T07:54:18.457 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.746+0000 7f34fb54c640 1 -- start start 2024-09-21T07:54:18.457 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.747+0000 7f34fb54c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34f4100f70 0x7f34f4101380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:18.457 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.747+0000 7f34fb54c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f41018c0 con 0x7f34f4100f70 2024-09-21T07:54:18.457 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.747+0000 7f34f92e8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34f4100f70 0x7f34f4101380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:18.457 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.747+0000 7f34f92e8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34f4100f70 0x7f34f4101380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56280/0 (socket says 172.21.15.107:56280) 2024-09-21T07:54:18.457 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.747+0000 7f34f92e8640 1 -- 172.21.15.107:0/21883208 learned_addr learned my addr 172.21.15.107:0/21883208 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:18.458 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.747+0000 7f34f92e8640 1 -- 172.21.15.107:0/21883208 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f4101a00 con 0x7f34f4100f70 2024-09-21T07:54:18.458 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.748+0000 7f34f92e8640 1 --2- 172.21.15.107:0/21883208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34f4100f70 0x7f34f4101380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009840 tx=0x7f34f00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d01615f973aa528 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:18.458 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.748+0000 7f34ebfff640 1 -- 172.21.15.107:0/21883208 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34f0032440 con 0x7f34f4100f70 2024-09-21T07:54:18.458 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.748+0000 7f34ebfff640 1 -- 172.21.15.107:0/21883208 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f34f0032a40 con 0x7f34f4100f70 2024-09-21T07:54:18.458 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.748+0000 7f34ebfff640 1 -- 172.21.15.107:0/21883208 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34f0031aa0 con 0x7f34f4100f70 2024-09-21T07:54:18.458 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.748+0000 7f34fb54c640 1 -- 172.21.15.107:0/21883208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34f4100f70 msgr2=0x7f34f4101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:18.458 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.748+0000 7f34fb54c640 1 --2- 172.21.15.107:0/21883208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34f4100f70 0x7f34f4101380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009840 tx=0x7f34f00091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:18.458 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.748+0000 7f34fb54c640 1 -- 172.21.15.107:0/21883208 shutdown_connections 2024-09-21T07:54:18.458 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.748+0000 7f34fb54c640 1 --2- 172.21.15.107:0/21883208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34f4100f70 0x7f34f4101380 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:18.458 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.748+0000 7f34fb54c640 1 -- 172.21.15.107:0/21883208 >> 172.21.15.107:0/21883208 conn(0x7f34f40fc730 msgr2=0x7f34f40feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:18.458 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.749+0000 7f34fb54c640 1 -- 172.21.15.107:0/21883208 shutdown_connections 2024-09-21T07:54:18.458 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.749+0000 7f34fb54c640 1 -- 172.21.15.107:0/21883208 wait complete. 2024-09-21T07:54:18.458 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.749+0000 7f34fb54c640 1 Processor -- start 2024-09-21T07:54:18.458 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.749+0000 7f34fb54c640 1 -- start start 2024-09-21T07:54:18.458 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.749+0000 7f34fb54c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34f4100f70 0x7f34f4076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:18.459 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.749+0000 7f34fb54c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f41118d0 con 0x7f34f4100f70 2024-09-21T07:54:18.459 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.749+0000 7f34f92e8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34f4100f70 0x7f34f4076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:18.459 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.749+0000 7f34f92e8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34f4100f70 0x7f34f4076ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56286/0 (socket says 172.21.15.107:56286) 2024-09-21T07:54:18.459 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.749+0000 7f34f92e8640 1 -- 172.21.15.107:0/1403325421 learned_addr learned my addr 172.21.15.107:0/1403325421 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:18.459 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.750+0000 7f34f92e8640 1 -- 172.21.15.107:0/1403325421 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f0009450 con 0x7f34f4100f70 2024-09-21T07:54:18.459 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.750+0000 7f34f92e8640 1 --2- 172.21.15.107:0/1403325421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34f4100f70 0x7f34f4076ae0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f34f0006a70 tx=0x7f34f00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:18.459 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.750+0000 7f34e9ffb640 1 -- 172.21.15.107:0/1403325421 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34f0031d20 con 0x7f34f4100f70 2024-09-21T07:54:18.459 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.750+0000 7f34e9ffb640 1 -- 172.21.15.107:0/1403325421 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f34f0031e80 con 0x7f34f4100f70 2024-09-21T07:54:18.459 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.750+0000 7f34fb54c640 1 -- 172.21.15.107:0/1403325421 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f4115ee0 con 0x7f34f4100f70 2024-09-21T07:54:18.459 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.750+0000 7f34e9ffb640 1 -- 172.21.15.107:0/1403325421 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34f003a750 con 0x7f34f4100f70 2024-09-21T07:54:18.459 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.750+0000 7f34fb54c640 1 -- 172.21.15.107:0/1403325421 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f4116210 con 0x7f34f4100f70 2024-09-21T07:54:18.460 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.751+0000 7f34e9ffb640 1 -- 172.21.15.107:0/1403325421 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f34f0039040 con 0x7f34f4100f70 2024-09-21T07:54:18.460 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.751+0000 7f34fb54c640 1 -- 172.21.15.107:0/1403325421 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f404b720 con 0x7f34f4100f70 2024-09-21T07:54:18.460 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.751+0000 7f34e9ffb640 1 --2- 172.21.15.107:0/1403325421 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f34e0039490 0x7f34e003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:18.460 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.751+0000 7f34e9ffb640 1 -- 172.21.15.107:0/1403325421 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f34f006cb20 con 0x7f34f4100f70 2024-09-21T07:54:18.460 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.751+0000 7f34f8ae7640 1 --2- 172.21.15.107:0/1403325421 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f34e0039490 0x7f34e003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:18.460 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.752+0000 7f34f8ae7640 1 --2- 172.21.15.107:0/1403325421 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f34e0039490 0x7f34e003b940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f34e4006fd0 tx=0x7f34e4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:18.460 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.756+0000 7f34e9ffb640 1 -- 172.21.15.107:0/1403325421 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f34f003a8b0 con 0x7f34f4100f70 2024-09-21T07:54:18.460 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.913+0000 7f34fb54c640 1 -- 172.21.15.107:0/1403325421 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f34f4102c60 con 0x7f34f4100f70 2024-09-21T07:54:18.460 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.917+0000 7f34e9ffb640 1 -- 172.21.15.107:0/1403325421 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f34f003f020 con 0x7f34f4100f70 2024-09-21T07:54:18.460 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.919+0000 7f34fb54c640 1 -- 172.21.15.107:0/1403325421 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f34e0039490 msgr2=0x7f34e003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:18.460 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.919+0000 7f34fb54c640 1 --2- 172.21.15.107:0/1403325421 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f34e0039490 0x7f34e003b940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f34e4006fd0 tx=0x7f34e4006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:18.460 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.919+0000 7f34fb54c640 1 -- 172.21.15.107:0/1403325421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34f4100f70 msgr2=0x7f34f4076ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:18.461 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.919+0000 7f34fb54c640 1 --2- 172.21.15.107:0/1403325421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34f4100f70 0x7f34f4076ae0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f34f0006a70 tx=0x7f34f00091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:18.461 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.919+0000 7f34fb54c640 1 -- 172.21.15.107:0/1403325421 shutdown_connections 2024-09-21T07:54:18.461 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.919+0000 7f34fb54c640 1 --2- 172.21.15.107:0/1403325421 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f34e0039490 0x7f34e003b940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:18.461 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.919+0000 7f34fb54c640 1 --2- 172.21.15.107:0/1403325421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34f4100f70 0x7f34f4076ae0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:18.461 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.919+0000 7f34fb54c640 1 -- 172.21.15.107:0/1403325421 >> 172.21.15.107:0/1403325421 conn(0x7f34f40fc730 msgr2=0x7f34f40fd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:18.461 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.919+0000 7f34fb54c640 1 -- 172.21.15.107:0/1403325421 shutdown_connections 2024-09-21T07:54:18.461 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:17.919+0000 7f34fb54c640 1 -- 172.21.15.107:0/1403325421 wait complete. 2024-09-21T07:54:18.461 INFO:teuthology.orchestra.run.smithi107.stdout:Enabling the dashboard module... 2024-09-21T07:54:19.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:18 smithi107 ceph-mon[27622]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:54:19.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:18 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1403325421' entity='client.admin' 2024-09-21T07:54:20.188 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:19 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/389986531' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-21T07:54:20.515 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.877+0000 7f6c21214640 1 Processor -- start 2024-09-21T07:54:20.515 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.877+0000 7f6c21214640 1 -- start start 2024-09-21T07:54:20.516 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.877+0000 7f6c21214640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c1c076b30 0x7f6c1c104bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.516 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.877+0000 7f6c21214640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c076f40 con 0x7f6c1c076b30 2024-09-21T07:54:20.516 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.877+0000 7f6c1ad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c1c076b30 0x7f6c1c104bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:20.516 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.877+0000 7f6c1ad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c1c076b30 0x7f6c1c104bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56302/0 (socket says 172.21.15.107:56302) 2024-09-21T07:54:20.516 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.877+0000 7f6c1ad9d640 1 -- 172.21.15.107:0/1696284560 learned_addr learned my addr 172.21.15.107:0/1696284560 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:20.516 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.878+0000 7f6c1ad9d640 1 -- 172.21.15.107:0/1696284560 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c105110 con 0x7f6c1c076b30 2024-09-21T07:54:20.516 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.878+0000 7f6c1ad9d640 1 --2- 172.21.15.107:0/1696284560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c1c076b30 0x7f6c1c104bd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009840 tx=0x7f6c0c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23882ea6f53d9905 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:20.516 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.878+0000 7f6c1a59c640 1 -- 172.21.15.107:0/1696284560 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c0c032440 con 0x7f6c1c076b30 2024-09-21T07:54:20.516 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.878+0000 7f6c1a59c640 1 -- 172.21.15.107:0/1696284560 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6c0c032a40 con 0x7f6c1c076b30 2024-09-21T07:54:20.516 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.878+0000 7f6c1a59c640 1 -- 172.21.15.107:0/1696284560 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c0c031aa0 con 0x7f6c1c076b30 2024-09-21T07:54:20.516 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.879+0000 7f6c21214640 1 -- 172.21.15.107:0/1696284560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c1c076b30 msgr2=0x7f6c1c104bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:20.516 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.879+0000 7f6c21214640 1 --2- 172.21.15.107:0/1696284560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c1c076b30 0x7f6c1c104bd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009840 tx=0x7f6c0c0091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.516 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.879+0000 7f6c21214640 1 -- 172.21.15.107:0/1696284560 shutdown_connections 2024-09-21T07:54:20.516 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.879+0000 7f6c21214640 1 --2- 172.21.15.107:0/1696284560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c1c076b30 0x7f6c1c104bd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.517 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.879+0000 7f6c21214640 1 -- 172.21.15.107:0/1696284560 >> 172.21.15.107:0/1696284560 conn(0x7f6c1c0fc700 msgr2=0x7f6c1c0feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:20.517 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.879+0000 7f6c21214640 1 -- 172.21.15.107:0/1696284560 shutdown_connections 2024-09-21T07:54:20.517 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.879+0000 7f6c21214640 1 -- 172.21.15.107:0/1696284560 wait complete. 2024-09-21T07:54:20.517 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.879+0000 7f6c21214640 1 Processor -- start 2024-09-21T07:54:20.517 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.880+0000 7f6c21214640 1 -- start start 2024-09-21T07:54:20.517 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.880+0000 7f6c21214640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c1c076b30 0x7f6c1c110e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.517 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.880+0000 7f6c21214640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c111390 con 0x7f6c1c076b30 2024-09-21T07:54:20.517 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.880+0000 7f6c1ad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c1c076b30 0x7f6c1c110e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:20.517 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.880+0000 7f6c1ad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c1c076b30 0x7f6c1c110e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56318/0 (socket says 172.21.15.107:56318) 2024-09-21T07:54:20.517 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.880+0000 7f6c1ad9d640 1 -- 172.21.15.107:0/389986531 learned_addr learned my addr 172.21.15.107:0/389986531 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:20.517 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.880+0000 7f6c1ad9d640 1 -- 172.21.15.107:0/389986531 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c009450 con 0x7f6c1c076b30 2024-09-21T07:54:20.517 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.880+0000 7f6c1ad9d640 1 --2- 172.21.15.107:0/389986531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c1c076b30 0x7f6c1c110e50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009420 tx=0x7f6c0c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:20.517 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.880+0000 7f6c13fff640 1 -- 172.21.15.107:0/389986531 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c0c031d20 con 0x7f6c1c076b30 2024-09-21T07:54:20.518 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.881+0000 7f6c21214640 1 -- 172.21.15.107:0/389986531 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c1c111590 con 0x7f6c1c076b30 2024-09-21T07:54:20.518 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.881+0000 7f6c13fff640 1 -- 172.21.15.107:0/389986531 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6c0c031e80 con 0x7f6c1c076b30 2024-09-21T07:54:20.518 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.881+0000 7f6c13fff640 1 -- 172.21.15.107:0/389986531 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c0c03a670 con 0x7f6c1c076b30 2024-09-21T07:54:20.518 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.881+0000 7f6c21214640 1 -- 172.21.15.107:0/389986531 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c1c112070 con 0x7f6c1c076b30 2024-09-21T07:54:20.518 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.881+0000 7f6c13fff640 1 -- 172.21.15.107:0/389986531 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f6c0c039040 con 0x7f6c1c076b30 2024-09-21T07:54:20.518 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.882+0000 7f6c21214640 1 -- 172.21.15.107:0/389986531 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1c100300 con 0x7f6c1c076b30 2024-09-21T07:54:20.518 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.882+0000 7f6c13fff640 1 --2- 172.21.15.107:0/389986531 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f6c08039490 0x7f6c0803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.518 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.882+0000 7f6c13fff640 1 -- 172.21.15.107:0/389986531 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6c0c06cb90 con 0x7f6c1c076b30 2024-09-21T07:54:20.518 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.882+0000 7f6c1259c640 1 --2- 172.21.15.107:0/389986531 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f6c08039490 0x7f6c0803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:20.518 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.882+0000 7f6c1259c640 1 --2- 172.21.15.107:0/389986531 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f6c08039490 0x7f6c0803b940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6c04006fd0 tx=0x7f6c04006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:20.518 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:18.886+0000 7f6c13fff640 1 -- 172.21.15.107:0/389986531 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6c0c04b4e0 con 0x7f6c1c076b30 2024-09-21T07:54:20.518 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:19.081+0000 7f6c21214640 1 -- 172.21.15.107:0/389986531 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f6c1c04b720 con 0x7f6c1c076b30 2024-09-21T07:54:20.518 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:19.921+0000 7f6c13fff640 1 -- 172.21.15.107:0/389986531 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f6c0c03bbf0 con 0x7f6c1c076b30 2024-09-21T07:54:20.519 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:19.923+0000 7f6c13fff640 1 -- 172.21.15.107:0/389986531 <== mon.0 v2:172.21.15.107:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f6c0c04c7c0 con 0x7f6c1c076b30 2024-09-21T07:54:20.519 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:19.925+0000 7f6c21214640 1 -- 172.21.15.107:0/389986531 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f6c08039490 msgr2=0x7f6c0803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:20.519 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:19.925+0000 7f6c21214640 1 --2- 172.21.15.107:0/389986531 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f6c08039490 0x7f6c0803b940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6c04006fd0 tx=0x7f6c04006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.519 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:19.925+0000 7f6c21214640 1 -- 172.21.15.107:0/389986531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c1c076b30 msgr2=0x7f6c1c110e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:20.519 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:19.925+0000 7f6c21214640 1 --2- 172.21.15.107:0/389986531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c1c076b30 0x7f6c1c110e50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009420 tx=0x7f6c0c0091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.519 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:19.925+0000 7f6c21214640 1 -- 172.21.15.107:0/389986531 shutdown_connections 2024-09-21T07:54:20.519 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:19.925+0000 7f6c21214640 1 --2- 172.21.15.107:0/389986531 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f6c08039490 0x7f6c0803b940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.519 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:19.925+0000 7f6c21214640 1 --2- 172.21.15.107:0/389986531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c1c076b30 0x7f6c1c110e50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.519 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:19.925+0000 7f6c21214640 1 -- 172.21.15.107:0/389986531 >> 172.21.15.107:0/389986531 conn(0x7f6c1c0fc700 msgr2=0x7f6c1c0fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:20.520 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:19.926+0000 7f6c21214640 1 -- 172.21.15.107:0/389986531 shutdown_connections 2024-09-21T07:54:20.520 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:19.926+0000 7f6c21214640 1 -- 172.21.15.107:0/389986531 wait complete. 2024-09-21T07:54:21.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:20 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/389986531' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T07:54:21.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:20 smithi107 ceph-mon[27622]: mgrmap e9: smithi107.wzulxb(active, since 24s) 2024-09-21T07:54:21.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:54:21.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T07:54:21.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T07:54:21.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "active_name": "smithi107.wzulxb", 2024-09-21T07:54:21.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T07:54:21.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:54:21.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.942+0000 7f809157c640 1 Processor -- start 2024-09-21T07:54:21.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.942+0000 7f809157c640 1 -- start start 2024-09-21T07:54:21.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.942+0000 7f809157c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f808c076c80 0x7f808c104b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.942+0000 7f809157c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c105070 con 0x7f808c076c80 2024-09-21T07:54:21.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.942+0000 7f808affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f808c076c80 0x7f808c104b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:21.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.942+0000 7f808affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f808c076c80 0x7f808c104b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56328/0 (socket says 172.21.15.107:56328) 2024-09-21T07:54:21.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.942+0000 7f808affd640 1 -- 172.21.15.107:0/2422074317 learned_addr learned my addr 172.21.15.107:0/2422074317 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:21.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.942+0000 7f808affd640 1 -- 172.21.15.107:0/2422074317 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c1051b0 con 0x7f808c076c80 2024-09-21T07:54:21.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.943+0000 7f808affd640 1 --2- 172.21.15.107:0/2422074317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f808c076c80 0x7f808c104b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f807c009840 tx=0x7f807c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3b3b46ac75ef31 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:21.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.943+0000 7f8089ffb640 1 -- 172.21.15.107:0/2422074317 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f807c032440 con 0x7f808c076c80 2024-09-21T07:54:21.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.943+0000 7f8089ffb640 1 -- 172.21.15.107:0/2422074317 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f807c032a40 con 0x7f808c076c80 2024-09-21T07:54:21.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.943+0000 7f8089ffb640 1 -- 172.21.15.107:0/2422074317 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f807c031a70 con 0x7f808c076c80 2024-09-21T07:54:21.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.944+0000 7f809157c640 1 -- 172.21.15.107:0/2422074317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f808c076c80 msgr2=0x7f808c104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:21.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.944+0000 7f809157c640 1 --2- 172.21.15.107:0/2422074317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f808c076c80 0x7f808c104b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f807c009840 tx=0x7f807c0091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.944+0000 7f809157c640 1 -- 172.21.15.107:0/2422074317 shutdown_connections 2024-09-21T07:54:21.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.944+0000 7f809157c640 1 --2- 172.21.15.107:0/2422074317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f808c076c80 0x7f808c104b30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.944+0000 7f809157c640 1 -- 172.21.15.107:0/2422074317 >> 172.21.15.107:0/2422074317 conn(0x7f808c0fc620 msgr2=0x7f808c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:21.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.944+0000 7f809157c640 1 -- 172.21.15.107:0/2422074317 shutdown_connections 2024-09-21T07:54:21.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.944+0000 7f809157c640 1 -- 172.21.15.107:0/2422074317 wait complete. 2024-09-21T07:54:21.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.945+0000 7f809157c640 1 Processor -- start 2024-09-21T07:54:21.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.945+0000 7f809157c640 1 -- start start 2024-09-21T07:54:21.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.945+0000 7f809157c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f808c076c80 0x7f808c110e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.945+0000 7f809157c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c111390 con 0x7f808c076c80 2024-09-21T07:54:21.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.945+0000 7f808affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f808c076c80 0x7f808c110e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:21.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.945+0000 7f808affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f808c076c80 0x7f808c110e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56340/0 (socket says 172.21.15.107:56340) 2024-09-21T07:54:21.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.945+0000 7f808affd640 1 -- 172.21.15.107:0/2359280371 learned_addr learned my addr 172.21.15.107:0/2359280371 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:21.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.945+0000 7f808affd640 1 -- 172.21.15.107:0/2359280371 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807c009450 con 0x7f808c076c80 2024-09-21T07:54:21.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.946+0000 7f808affd640 1 --2- 172.21.15.107:0/2359280371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f808c076c80 0x7f808c110e50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f807c031750 tx=0x7f807c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:21.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.946+0000 7f80737fe640 1 -- 172.21.15.107:0/2359280371 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f807c03c400 con 0x7f808c076c80 2024-09-21T07:54:21.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.946+0000 7f80737fe640 1 -- 172.21.15.107:0/2359280371 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f807c03ca00 con 0x7f808c076c80 2024-09-21T07:54:21.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.946+0000 7f809157c640 1 -- 172.21.15.107:0/2359280371 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808c111590 con 0x7f808c076c80 2024-09-21T07:54:21.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.946+0000 7f80737fe640 1 -- 172.21.15.107:0/2359280371 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f807c03a880 con 0x7f808c076c80 2024-09-21T07:54:21.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.946+0000 7f809157c640 1 -- 172.21.15.107:0/2359280371 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808c111fe0 con 0x7f808c076c80 2024-09-21T07:54:21.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.947+0000 7f80737fe640 1 -- 172.21.15.107:0/2359280371 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f807c03a9e0 con 0x7f808c076c80 2024-09-21T07:54:21.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.947+0000 7f809157c640 1 -- 172.21.15.107:0/2359280371 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808c1002a0 con 0x7f808c076c80 2024-09-21T07:54:21.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.947+0000 7f80737fe640 1 --2- 172.21.15.107:0/2359280371 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f8074039530 0x7f807403b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.947+0000 7f80737fe640 1 -- 172.21.15.107:0/2359280371 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f807c06ce50 con 0x7f808c076c80 2024-09-21T07:54:21.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.947+0000 7f808a7fc640 1 -- 172.21.15.107:0/2359280371 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f8074039530 msgr2=0x7f807403b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/2912640406 2024-09-21T07:54:21.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.947+0000 7f808a7fc640 1 --2- 172.21.15.107:0/2359280371 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f8074039530 0x7f807403b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T07:54:21.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:20.951+0000 7f80737fe640 1 -- 172.21.15.107:0/2359280371 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f807c030570 con 0x7f808c076c80 2024-09-21T07:54:21.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:21.148+0000 7f808a7fc640 1 -- 172.21.15.107:0/2359280371 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f8074039530 msgr2=0x7f807403b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/2912640406 2024-09-21T07:54:21.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:21.148+0000 7f808a7fc640 1 --2- 172.21.15.107:0/2359280371 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f8074039530 0x7f807403b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-21T07:54:21.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:21.151+0000 7f809157c640 1 -- 172.21.15.107:0/2359280371 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f808c112450 con 0x7f808c076c80 2024-09-21T07:54:21.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:21.151+0000 7f80737fe640 1 -- 172.21.15.107:0/2359280371 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f807c037030 con 0x7f808c076c80 2024-09-21T07:54:21.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:21.154+0000 7f809157c640 1 -- 172.21.15.107:0/2359280371 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f8074039530 msgr2=0x7f807403b9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:54:21.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:21.154+0000 7f809157c640 1 --2- 172.21.15.107:0/2359280371 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f8074039530 0x7f807403b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:21.154+0000 7f809157c640 1 -- 172.21.15.107:0/2359280371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f808c076c80 msgr2=0x7f808c110e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:21.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:21.154+0000 7f809157c640 1 --2- 172.21.15.107:0/2359280371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f808c076c80 0x7f808c110e50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f807c031750 tx=0x7f807c0091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:21.154+0000 7f809157c640 1 -- 172.21.15.107:0/2359280371 shutdown_connections 2024-09-21T07:54:21.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:21.154+0000 7f809157c640 1 --2- 172.21.15.107:0/2359280371 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f8074039530 0x7f807403b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:21.154+0000 7f809157c640 1 --2- 172.21.15.107:0/2359280371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f808c076c80 0x7f808c110e50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.796 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:21.154+0000 7f809157c640 1 -- 172.21.15.107:0/2359280371 >> 172.21.15.107:0/2359280371 conn(0x7f808c0fc620 msgr2=0x7f808c0fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:21.796 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:21.154+0000 7f809157c640 1 -- 172.21.15.107:0/2359280371 shutdown_connections 2024-09-21T07:54:21.796 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:21.154+0000 7f809157c640 1 -- 172.21.15.107:0/2359280371 wait complete. 2024-09-21T07:54:21.796 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for the mgr to restart... 2024-09-21T07:54:21.796 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for mgr epoch 9... 2024-09-21T07:54:22.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:21 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/2359280371' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-21T07:54:24.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:24 smithi107 ceph-mon[27622]: Active manager daemon smithi107.wzulxb restarted 2024-09-21T07:54:24.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:24 smithi107 ceph-mon[27622]: Activating manager daemon smithi107.wzulxb 2024-09-21T07:54:24.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:24 smithi107 ceph-mon[27622]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T07:54:24.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:24 smithi107 ceph-mon[27622]: mgrmap e10: smithi107.wzulxb(active, starting, since 0.0032544s) 2024-09-21T07:54:24.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:24 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-21T07:54:24.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:24 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr metadata", "who": "smithi107.wzulxb", "id": "smithi107.wzulxb"}]: dispatch 2024-09-21T07:54:24.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:24 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T07:54:24.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:24 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T07:54:24.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:24 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T07:54:24.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:24 smithi107 ceph-mon[27622]: Manager daemon smithi107.wzulxb is now available 2024-09-21T07:54:24.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:24 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:54:24.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:24 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.wzulxb/mirror_snapshot_schedule"}]: dispatch 2024-09-21T07:54:24.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:24 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.wzulxb/trash_purge_schedule"}]: dispatch 2024-09-21T07:54:25.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:54:25.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T07:54:25.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T07:54:25.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:54:25.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.207+0000 7f78a2b76640 1 Processor -- start 2024-09-21T07:54:25.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.207+0000 7f78a2b76640 1 -- start start 2024-09-21T07:54:25.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.207+0000 7f78a2b76640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f789c076b30 0x7f789c104bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:25.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.207+0000 7f78a2b76640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c076f40 con 0x7f789c076b30 2024-09-21T07:54:25.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.207+0000 7f78a0912640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f789c076b30 0x7f789c104bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:25.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.207+0000 7f78a0912640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f789c076b30 0x7f789c104bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57516/0 (socket says 172.21.15.107:57516) 2024-09-21T07:54:25.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.207+0000 7f78a0912640 1 -- 172.21.15.107:0/1468663379 learned_addr learned my addr 172.21.15.107:0/1468663379 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:25.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.208+0000 7f78a0912640 1 -- 172.21.15.107:0/1468663379 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c105100 con 0x7f789c076b30 2024-09-21T07:54:25.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.208+0000 7f78a0912640 1 --2- 172.21.15.107:0/1468663379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f789c076b30 0x7f789c104bc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7890009840 tx=0x7f78900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b516557f4637bc4c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:25.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.208+0000 7f789b7fe640 1 -- 172.21.15.107:0/1468663379 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7890032440 con 0x7f789c076b30 2024-09-21T07:54:25.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.208+0000 7f789b7fe640 1 -- 172.21.15.107:0/1468663379 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7890032a40 con 0x7f789c076b30 2024-09-21T07:54:25.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.208+0000 7f789b7fe640 1 -- 172.21.15.107:0/1468663379 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7890031aa0 con 0x7f789c076b30 2024-09-21T07:54:25.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.209+0000 7f78a2b76640 1 -- 172.21.15.107:0/1468663379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f789c076b30 msgr2=0x7f789c104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:25.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.209+0000 7f78a2b76640 1 --2- 172.21.15.107:0/1468663379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f789c076b30 0x7f789c104bc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7890009840 tx=0x7f78900091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:25.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.209+0000 7f78a2b76640 1 -- 172.21.15.107:0/1468663379 shutdown_connections 2024-09-21T07:54:25.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.209+0000 7f78a2b76640 1 --2- 172.21.15.107:0/1468663379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f789c076b30 0x7f789c104bc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:25.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.209+0000 7f78a2b76640 1 -- 172.21.15.107:0/1468663379 >> 172.21.15.107:0/1468663379 conn(0x7f789c0fc6d0 msgr2=0x7f789c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:25.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.209+0000 7f78a2b76640 1 -- 172.21.15.107:0/1468663379 shutdown_connections 2024-09-21T07:54:25.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.209+0000 7f78a2b76640 1 -- 172.21.15.107:0/1468663379 wait complete. 2024-09-21T07:54:25.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.210+0000 7f78a2b76640 1 Processor -- start 2024-09-21T07:54:25.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.210+0000 7f78a2b76640 1 -- start start 2024-09-21T07:54:25.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.210+0000 7f78a2b76640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f789c076b30 0x7f789c110e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:25.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.210+0000 7f78a2b76640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c111360 con 0x7f789c076b30 2024-09-21T07:54:25.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.210+0000 7f78a0912640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f789c076b30 0x7f789c110e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:25.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.210+0000 7f78a0912640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f789c076b30 0x7f789c110e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57528/0 (socket says 172.21.15.107:57528) 2024-09-21T07:54:25.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.210+0000 7f78a0912640 1 -- 172.21.15.107:0/2701130815 learned_addr learned my addr 172.21.15.107:0/2701130815 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:25.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.211+0000 7f78a0912640 1 -- 172.21.15.107:0/2701130815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7890009450 con 0x7f789c076b30 2024-09-21T07:54:25.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.211+0000 7f78a0912640 1 --2- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f789c076b30 0x7f789c110e20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7890006a70 tx=0x7f78900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:25.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.211+0000 7f78997fa640 1 -- 172.21.15.107:0/2701130815 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7890031d20 con 0x7f789c076b30 2024-09-21T07:54:25.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.211+0000 7f78997fa640 1 -- 172.21.15.107:0/2701130815 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7890031e80 con 0x7f789c076b30 2024-09-21T07:54:25.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.211+0000 7f78a2b76640 1 -- 172.21.15.107:0/2701130815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f789c111560 con 0x7f789c076b30 2024-09-21T07:54:25.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.211+0000 7f78997fa640 1 -- 172.21.15.107:0/2701130815 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f789003a750 con 0x7f789c076b30 2024-09-21T07:54:25.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.211+0000 7f78a2b76640 1 -- 172.21.15.107:0/2701130815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f789c111fb0 con 0x7f789c076b30 2024-09-21T07:54:25.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.212+0000 7f78997fa640 1 -- 172.21.15.107:0/2701130815 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f7890039040 con 0x7f789c076b30 2024-09-21T07:54:25.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.212+0000 7f78997fa640 1 --2- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f788c0394e0 0x7f788c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:25.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.212+0000 7f78a2b76640 1 -- 172.21.15.107:0/2701130815 --> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f789c1002f0 con 0x7f788c0394e0 2024-09-21T07:54:25.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.212+0000 7f78997fa640 1 -- 172.21.15.107:0/2701130815 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f789006cb40 con 0x7f789c076b30 2024-09-21T07:54:25.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.212+0000 7f789bfff640 1 -- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f788c0394e0 msgr2=0x7f788c03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/2912640406 2024-09-21T07:54:25.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.212+0000 7f789bfff640 1 --2- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f788c0394e0 0x7f788c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T07:54:25.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.413+0000 7f789bfff640 1 -- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f788c0394e0 msgr2=0x7f788c03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/2912640406 2024-09-21T07:54:25.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.413+0000 7f789bfff640 1 --2- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f788c0394e0 0x7f788c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-21T07:54:25.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.814+0000 7f789bfff640 1 -- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f788c0394e0 msgr2=0x7f788c03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/2912640406 2024-09-21T07:54:25.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:22.814+0000 7f789bfff640 1 --2- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f788c0394e0 0x7f788c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-21T07:54:25.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:23.615+0000 7f789bfff640 1 -- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f788c0394e0 msgr2=0x7f788c03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/2912640406 2024-09-21T07:54:25.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:23.615+0000 7f789bfff640 1 --2- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f788c0394e0 0x7f788c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-21T07:54:25.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:24.298+0000 7f78997fa640 1 -- 172.21.15.107:0/2701130815 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mgrmap(e 10) v1 ==== 45287+0+0 (secure 0 0 0) 0x7f7890040d70 con 0x7f789c076b30 2024-09-21T07:54:25.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:24.298+0000 7f78997fa640 1 -- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f788c0394e0 msgr2=0x7f788c03b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:54:25.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:24.298+0000 7f78997fa640 1 --2- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f788c0394e0 0x7f788c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:25.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:25.299+0000 7f78997fa640 1 -- 172.21.15.107:0/2701130815 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7f789003bc80 con 0x7f789c076b30 2024-09-21T07:54:25.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:25.300+0000 7f78997fa640 1 --2- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f788c03cdd0 0x7f788c03f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:25.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:25.300+0000 7f78997fa640 1 -- 172.21.15.107:0/2701130815 --> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f789c1002f0 con 0x7f788c03cdd0 2024-09-21T07:54:25.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:25.300+0000 7f789bfff640 1 --2- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f788c03cdd0 0x7f788c03f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:25.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:25.300+0000 7f789bfff640 1 --2- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f788c03cdd0 0x7f788c03f1b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7888003940 tx=0x7f7888009350 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:25.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:25.301+0000 7f78997fa640 1 -- 172.21.15.107:0/2701130815 <== mgr.14160 v2:172.21.15.107:6800/2850161381 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f789c1002f0 con 0x7f788c03cdd0 2024-09-21T07:54:25.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:25.306+0000 7f78a2b76640 1 -- 172.21.15.107:0/2701130815 --> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f789c04b720 con 0x7f788c03cdd0 2024-09-21T07:54:25.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:25.307+0000 7f78997fa640 1 -- 172.21.15.107:0/2701130815 <== mgr.14160 v2:172.21.15.107:6800/2850161381 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f789c04b720 con 0x7f788c03cdd0 2024-09-21T07:54:25.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:25.307+0000 7f78a2b76640 1 -- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f788c03cdd0 msgr2=0x7f788c03f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:25.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:25.307+0000 7f78a2b76640 1 --2- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f788c03cdd0 0x7f788c03f1b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7888003940 tx=0x7f7888009350 comp rx=0 tx=0).stop 2024-09-21T07:54:25.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:25.307+0000 7f78a2b76640 1 -- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f789c076b30 msgr2=0x7f789c110e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:25.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:25.307+0000 7f78a2b76640 1 --2- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f789c076b30 0x7f789c110e20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7890006a70 tx=0x7f78900091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:25.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:25.307+0000 7f78a2b76640 1 -- 172.21.15.107:0/2701130815 shutdown_connections 2024-09-21T07:54:25.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:25.307+0000 7f78a2b76640 1 --2- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f788c03cdd0 0x7f788c03f1b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:25.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:25.307+0000 7f78a2b76640 1 --2- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:6800/2912640406,v1:172.21.15.107:6801/2912640406] conn(0x7f788c0394e0 0x7f788c03b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:25.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:25.307+0000 7f78a2b76640 1 --2- 172.21.15.107:0/2701130815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f789c076b30 0x7f789c110e20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:25.937 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:25.307+0000 7f78a2b76640 1 -- 172.21.15.107:0/2701130815 >> 172.21.15.107:0/2701130815 conn(0x7f789c0fc6d0 msgr2=0x7f789c0fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:25.937 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:25.307+0000 7f78a2b76640 1 -- 172.21.15.107:0/2701130815 shutdown_connections 2024-09-21T07:54:25.937 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:25.307+0000 7f78a2b76640 1 -- 172.21.15.107:0/2701130815 wait complete. 2024-09-21T07:54:25.937 INFO:teuthology.orchestra.run.smithi107.stdout:mgr epoch 9 is available 2024-09-21T07:54:25.937 INFO:teuthology.orchestra.run.smithi107.stdout:Generating a dashboard self-signed certificate... 2024-09-21T07:54:26.516 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:26 smithi107 ceph-mon[27622]: mgrmap e11: smithi107.wzulxb(active, since 1.00565s) 2024-09-21T07:54:26.516 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:26 smithi107 ceph-mon[27622]: [21/Sep/2024:07:54:25] ENGINE Bus STARTING 2024-09-21T07:54:26.517 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:26 smithi107 ceph-mon[27622]: [21/Sep/2024:07:54:25] ENGINE Serving on https://172.21.15.107:7150 2024-09-21T07:54:26.517 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:26 smithi107 ceph-mon[27622]: [21/Sep/2024:07:54:25] ENGINE Bus STARTED 2024-09-21T07:54:26.517 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:26 smithi107 ceph-mon[27622]: [21/Sep/2024:07:54:25] ENGINE Error in HTTPServer.serve 2024-09-21T07:54:26.517 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Traceback (most recent call last): 2024-09-21T07:54:26.517 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:54:26.517 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._connections.run(self.expiration_interval) 2024-09-21T07:54:26.517 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:54:26.517 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._run(expiration_interval) 2024-09-21T07:54:26.517 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:54:26.517 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:54:26.517 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:54:26.517 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:54:26.517 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:54:26.517 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: s = self.context.wrap_socket( 2024-09-21T07:54:26.518 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:54:26.518 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: return self.sslsocket_class._create( 2024-09-21T07:54:26.518 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:54:26.518 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self.do_handshake() 2024-09-21T07:54:26.518 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:54:26.518 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._sslobj.do_handshake() 2024-09-21T07:54:26.518 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:54:26.518 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:26 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:27.220 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-21T07:54:27.220 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.340+0000 7f15ecdd8640 1 Processor -- start 2024-09-21T07:54:27.220 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.340+0000 7f15ecdd8640 1 -- start start 2024-09-21T07:54:27.220 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.340+0000 7f15ecdd8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15e8076af0 0x7f15e8104c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:27.220 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.340+0000 7f15ecdd8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e8076f00 con 0x7f15e8076af0 2024-09-21T07:54:27.220 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.340+0000 7f15e659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15e8076af0 0x7f15e8104c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:27.221 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.340+0000 7f15e659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15e8076af0 0x7f15e8104c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57626/0 (socket says 172.21.15.107:57626) 2024-09-21T07:54:27.221 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.340+0000 7f15e659c640 1 -- 172.21.15.107:0/2009904736 learned_addr learned my addr 172.21.15.107:0/2009904736 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:27.221 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.341+0000 7f15e659c640 1 -- 172.21.15.107:0/2009904736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e81051c0 con 0x7f15e8076af0 2024-09-21T07:54:27.221 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.341+0000 7f15e659c640 1 --2- 172.21.15.107:0/2009904736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15e8076af0 0x7f15e8104c80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009840 tx=0x7f15d80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b991bb70b70dcd34 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:27.221 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.341+0000 7f15e559a640 1 -- 172.21.15.107:0/2009904736 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15d8032440 con 0x7f15e8076af0 2024-09-21T07:54:27.221 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.341+0000 7f15e559a640 1 -- 172.21.15.107:0/2009904736 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f15d8032a40 con 0x7f15e8076af0 2024-09-21T07:54:27.221 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.341+0000 7f15e559a640 1 -- 172.21.15.107:0/2009904736 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15d8031aa0 con 0x7f15e8076af0 2024-09-21T07:54:27.221 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.342+0000 7f15ecdd8640 1 -- 172.21.15.107:0/2009904736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15e8076af0 msgr2=0x7f15e8104c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:27.221 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.342+0000 7f15ecdd8640 1 --2- 172.21.15.107:0/2009904736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15e8076af0 0x7f15e8104c80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009840 tx=0x7f15d80091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:27.221 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.342+0000 7f15ecdd8640 1 -- 172.21.15.107:0/2009904736 shutdown_connections 2024-09-21T07:54:27.221 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.342+0000 7f15ecdd8640 1 --2- 172.21.15.107:0/2009904736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15e8076af0 0x7f15e8104c80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:27.221 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.342+0000 7f15ecdd8640 1 -- 172.21.15.107:0/2009904736 >> 172.21.15.107:0/2009904736 conn(0x7f15e80fc750 msgr2=0x7f15e80feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:27.221 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.342+0000 7f15ecdd8640 1 -- 172.21.15.107:0/2009904736 shutdown_connections 2024-09-21T07:54:27.221 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.342+0000 7f15ecdd8640 1 -- 172.21.15.107:0/2009904736 wait complete. 2024-09-21T07:54:27.221 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.343+0000 7f15ecdd8640 1 Processor -- start 2024-09-21T07:54:27.222 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.343+0000 7f15ecdd8640 1 -- start start 2024-09-21T07:54:27.222 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.343+0000 7f15ecdd8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15e8076af0 0x7f15e81025b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:27.222 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.343+0000 7f15ecdd8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e8102af0 con 0x7f15e8076af0 2024-09-21T07:54:27.222 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.343+0000 7f15e659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15e8076af0 0x7f15e81025b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:27.222 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.343+0000 7f15e659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15e8076af0 0x7f15e81025b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57638/0 (socket says 172.21.15.107:57638) 2024-09-21T07:54:27.222 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.343+0000 7f15e659c640 1 -- 172.21.15.107:0/2250839228 learned_addr learned my addr 172.21.15.107:0/2250839228 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:27.222 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.343+0000 7f15e659c640 1 -- 172.21.15.107:0/2250839228 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d8009450 con 0x7f15e8076af0 2024-09-21T07:54:27.222 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.343+0000 7f15e659c640 1 --2- 172.21.15.107:0/2250839228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15e8076af0 0x7f15e81025b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f15d8031780 tx=0x7f15d80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:27.222 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.343+0000 7f15d6ffd640 1 -- 172.21.15.107:0/2250839228 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15d80327b0 con 0x7f15e8076af0 2024-09-21T07:54:27.222 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.343+0000 7f15d6ffd640 1 -- 172.21.15.107:0/2250839228 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f15d803b8d0 con 0x7f15e8076af0 2024-09-21T07:54:27.222 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.343+0000 7f15ecdd8640 1 -- 172.21.15.107:0/2250839228 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e8100be0 con 0x7f15e8076af0 2024-09-21T07:54:27.223 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.343+0000 7f15d6ffd640 1 -- 172.21.15.107:0/2250839228 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15d803a790 con 0x7f15e8076af0 2024-09-21T07:54:27.223 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.343+0000 7f15ecdd8640 1 -- 172.21.15.107:0/2250839228 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e81010b0 con 0x7f15e8076af0 2024-09-21T07:54:27.223 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.344+0000 7f15d6ffd640 1 -- 172.21.15.107:0/2250839228 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7f15d8039040 con 0x7f15e8076af0 2024-09-21T07:54:27.223 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.344+0000 7f15d6ffd640 1 --2- 172.21.15.107:0/2250839228 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f15d00393d0 0x7f15d003b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:27.223 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.344+0000 7f15d6ffd640 1 -- 172.21.15.107:0/2250839228 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f15d806ca90 con 0x7f15e8076af0 2024-09-21T07:54:27.223 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.344+0000 7f15ecdd8640 1 -- 172.21.15.107:0/2250839228 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e804b720 con 0x7f15e8076af0 2024-09-21T07:54:27.223 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.344+0000 7f15e5d9b640 1 --2- 172.21.15.107:0/2250839228 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f15d00393d0 0x7f15d003b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:27.223 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.345+0000 7f15e5d9b640 1 --2- 172.21.15.107:0/2250839228 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f15d00393d0 0x7f15d003b880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f15dc006fd0 tx=0x7f15dc006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:27.223 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.349+0000 7f15d6ffd640 1 -- 172.21.15.107:0/2250839228 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f15d803f020 con 0x7f15e8076af0 2024-09-21T07:54:27.223 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.514+0000 7f15ecdd8640 1 -- 172.21.15.107:0/2250839228 --> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f15e8101550 con 0x7f15d00393d0 2024-09-21T07:54:27.223 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.555+0000 7f15d6ffd640 1 -- 172.21.15.107:0/2250839228 <== mgr.14160 v2:172.21.15.107:6800/2850161381 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f15e8101550 con 0x7f15d00393d0 2024-09-21T07:54:27.223 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.558+0000 7f15ecdd8640 1 -- 172.21.15.107:0/2250839228 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f15d00393d0 msgr2=0x7f15d003b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:27.223 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.558+0000 7f15ecdd8640 1 --2- 172.21.15.107:0/2250839228 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f15d00393d0 0x7f15d003b880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f15dc006fd0 tx=0x7f15dc006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:27.223 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.558+0000 7f15ecdd8640 1 -- 172.21.15.107:0/2250839228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15e8076af0 msgr2=0x7f15e81025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:27.224 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.558+0000 7f15ecdd8640 1 --2- 172.21.15.107:0/2250839228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15e8076af0 0x7f15e81025b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f15d8031780 tx=0x7f15d80091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:27.224 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.558+0000 7f15ecdd8640 1 -- 172.21.15.107:0/2250839228 shutdown_connections 2024-09-21T07:54:27.224 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.558+0000 7f15ecdd8640 1 --2- 172.21.15.107:0/2250839228 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f15d00393d0 0x7f15d003b880 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:27.224 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.558+0000 7f15ecdd8640 1 --2- 172.21.15.107:0/2250839228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15e8076af0 0x7f15e81025b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:27.224 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.558+0000 7f15ecdd8640 1 -- 172.21.15.107:0/2250839228 >> 172.21.15.107:0/2250839228 conn(0x7f15e80fc750 msgr2=0x7f15e80fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:27.224 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.558+0000 7f15ecdd8640 1 -- 172.21.15.107:0/2250839228 shutdown_connections 2024-09-21T07:54:27.224 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:26.558+0000 7f15ecdd8640 1 -- 172.21.15.107:0/2250839228 wait complete. 2024-09-21T07:54:27.224 INFO:teuthology.orchestra.run.smithi107.stdout:Creating initial admin user... 2024-09-21T07:54:27.626 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:27 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:27.626 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:27 smithi107 ceph-mon[27622]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:27.626 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:27 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:27.626 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:27 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:27.626 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:27 smithi107 ceph-mon[27622]: mgrmap e12: smithi107.wzulxb(active, since 2s) 2024-09-21T07:54:27.626 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:27 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:28.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:28 smithi107 ceph-mon[27622]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:28.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:28 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:29.333 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$CBXZsRAoo9.SVXqL4qo9WeOqYzMtZ6ClhAGEzGbVjwypWHwpm3UFC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726905268, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T07:54:29.333 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.624+0000 7f49585bb640 1 Processor -- start 2024-09-21T07:54:29.334 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.624+0000 7f49585bb640 1 -- start start 2024-09-21T07:54:29.334 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.624+0000 7f49585bb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4950102070 0x7f4950102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:29.334 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.624+0000 7f49585bb640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49501029c0 con 0x7f4950102070 2024-09-21T07:54:29.334 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.625+0000 7f4956357640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4950102070 0x7f4950102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:29.334 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.625+0000 7f4956357640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4950102070 0x7f4950102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57650/0 (socket says 172.21.15.107:57650) 2024-09-21T07:54:29.334 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.625+0000 7f4956357640 1 -- 172.21.15.107:0/458648805 learned_addr learned my addr 172.21.15.107:0/458648805 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:29.334 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.625+0000 7f4956357640 1 -- 172.21.15.107:0/458648805 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4950102b00 con 0x7f4950102070 2024-09-21T07:54:29.334 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.626+0000 7f4956357640 1 --2- 172.21.15.107:0/458648805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4950102070 0x7f4950102480 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4948009e50 tx=0x7f4948009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d1f27785c6ff05 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:29.334 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.626+0000 7f4955355640 1 -- 172.21.15.107:0/458648805 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4948031560 con 0x7f4950102070 2024-09-21T07:54:29.334 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.626+0000 7f4955355640 1 -- 172.21.15.107:0/458648805 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f494802d050 con 0x7f4950102070 2024-09-21T07:54:29.334 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.626+0000 7f4955355640 1 -- 172.21.15.107:0/458648805 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4948007a60 con 0x7f4950102070 2024-09-21T07:54:29.334 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.626+0000 7f49585bb640 1 -- 172.21.15.107:0/458648805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4950102070 msgr2=0x7f4950102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:29.335 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.626+0000 7f49585bb640 1 --2- 172.21.15.107:0/458648805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4950102070 0x7f4950102480 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4948009e50 tx=0x7f4948009840 comp rx=0 tx=0).stop 2024-09-21T07:54:29.335 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.627+0000 7f49585bb640 1 -- 172.21.15.107:0/458648805 shutdown_connections 2024-09-21T07:54:29.335 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.627+0000 7f49585bb640 1 --2- 172.21.15.107:0/458648805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4950102070 0x7f4950102480 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:29.335 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.627+0000 7f49585bb640 1 -- 172.21.15.107:0/458648805 >> 172.21.15.107:0/458648805 conn(0x7f49500fd850 msgr2=0x7f49500ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:29.335 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.627+0000 7f49585bb640 1 -- 172.21.15.107:0/458648805 shutdown_connections 2024-09-21T07:54:29.335 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.627+0000 7f49585bb640 1 -- 172.21.15.107:0/458648805 wait complete. 2024-09-21T07:54:29.335 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.627+0000 7f49585bb640 1 Processor -- start 2024-09-21T07:54:29.335 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.627+0000 7f49585bb640 1 -- start start 2024-09-21T07:54:29.335 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.627+0000 7f49585bb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4950102070 0x7f4950110de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:29.335 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.627+0000 7f49585bb640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4950111320 con 0x7f4950102070 2024-09-21T07:54:29.335 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.627+0000 7f4956357640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4950102070 0x7f4950110de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:29.335 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.627+0000 7f4956357640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4950102070 0x7f4950110de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57664/0 (socket says 172.21.15.107:57664) 2024-09-21T07:54:29.335 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.627+0000 7f4956357640 1 -- 172.21.15.107:0/1213717653 learned_addr learned my addr 172.21.15.107:0/1213717653 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:29.335 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.628+0000 7f4956357640 1 -- 172.21.15.107:0/1213717653 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4948009ae0 con 0x7f4950102070 2024-09-21T07:54:29.335 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.628+0000 7f4956357640 1 --2- 172.21.15.107:0/1213717653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4950102070 0x7f4950110de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f494802ac70 tx=0x7f4948009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:29.336 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.628+0000 7f4946ffd640 1 -- 172.21.15.107:0/1213717653 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4948031bc0 con 0x7f4950102070 2024-09-21T07:54:29.336 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.628+0000 7f4946ffd640 1 -- 172.21.15.107:0/1213717653 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4948031d20 con 0x7f4950102070 2024-09-21T07:54:29.336 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.628+0000 7f49585bb640 1 -- 172.21.15.107:0/1213717653 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4950111520 con 0x7f4950102070 2024-09-21T07:54:29.336 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.628+0000 7f4946ffd640 1 -- 172.21.15.107:0/1213717653 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4948045570 con 0x7f4950102070 2024-09-21T07:54:29.336 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.628+0000 7f49585bb640 1 -- 172.21.15.107:0/1213717653 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4950111f70 con 0x7f4950102070 2024-09-21T07:54:29.336 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.629+0000 7f4946ffd640 1 -- 172.21.15.107:0/1213717653 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f4948038050 con 0x7f4950102070 2024-09-21T07:54:29.336 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.629+0000 7f4946ffd640 1 --2- 172.21.15.107:0/1213717653 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f493c039530 0x7f493c03b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:29.336 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.629+0000 7f4946ffd640 1 -- 172.21.15.107:0/1213717653 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f494806cdc0 con 0x7f4950102070 2024-09-21T07:54:29.336 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.629+0000 7f4955b56640 1 --2- 172.21.15.107:0/1213717653 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f493c039530 0x7f493c03b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:29.336 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.629+0000 7f49585bb640 1 -- 172.21.15.107:0/1213717653 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49501014d0 con 0x7f4950102070 2024-09-21T07:54:29.336 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.629+0000 7f4955b56640 1 --2- 172.21.15.107:0/1213717653 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f493c039530 0x7f493c03b9e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4940006fd0 tx=0x7f4940006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:29.336 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.635+0000 7f4946ffd640 1 -- 172.21.15.107:0/1213717653 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4948041020 con 0x7f4950102070 2024-09-21T07:54:29.336 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:27.810+0000 7f49585bb640 1 -- 172.21.15.107:0/1213717653 --> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f495005eb60 con 0x7f493c039530 2024-09-21T07:54:29.336 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:28.035+0000 7f4946ffd640 1 -- 172.21.15.107:0/1213717653 <== mgr.14160 v2:172.21.15.107:6800/2850161381 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f495005eb60 con 0x7f493c039530 2024-09-21T07:54:29.336 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:28.037+0000 7f49585bb640 1 -- 172.21.15.107:0/1213717653 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f493c039530 msgr2=0x7f493c03b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:29.337 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:28.037+0000 7f49585bb640 1 --2- 172.21.15.107:0/1213717653 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f493c039530 0x7f493c03b9e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4940006fd0 tx=0x7f4940006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:29.337 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:28.037+0000 7f49585bb640 1 -- 172.21.15.107:0/1213717653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4950102070 msgr2=0x7f4950110de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:29.337 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:28.037+0000 7f49585bb640 1 --2- 172.21.15.107:0/1213717653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4950102070 0x7f4950110de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f494802ac70 tx=0x7f4948009840 comp rx=0 tx=0).stop 2024-09-21T07:54:29.337 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:28.037+0000 7f49585bb640 1 -- 172.21.15.107:0/1213717653 shutdown_connections 2024-09-21T07:54:29.337 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:28.037+0000 7f49585bb640 1 --2- 172.21.15.107:0/1213717653 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f493c039530 0x7f493c03b9e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:29.337 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:28.037+0000 7f49585bb640 1 --2- 172.21.15.107:0/1213717653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4950102070 0x7f4950110de0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:29.337 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:28.037+0000 7f49585bb640 1 -- 172.21.15.107:0/1213717653 >> 172.21.15.107:0/1213717653 conn(0x7f49500fd850 msgr2=0x7f49500fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:29.337 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:28.037+0000 7f49585bb640 1 -- 172.21.15.107:0/1213717653 shutdown_connections 2024-09-21T07:54:29.337 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:28.037+0000 7f49585bb640 1 -- 172.21.15.107:0/1213717653 wait complete. 2024-09-21T07:54:29.337 INFO:teuthology.orchestra.run.smithi107.stdout:Fetching dashboard port number... 2024-09-21T07:54:30.256 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:30 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/3687180089' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-21T07:54:30.531 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T07:54:30.531 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.792+0000 7f6cff27f640 1 Processor -- start 2024-09-21T07:54:30.531 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.793+0000 7f6cff27f640 1 -- start start 2024-09-21T07:54:30.531 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.793+0000 7f6cff27f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf81035f0 0x7f6cf8103a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.532 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.793+0000 7f6cff27f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf8070e20 con 0x7f6cf81035f0 2024-09-21T07:54:30.532 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.793+0000 7f6cfd01b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf81035f0 0x7f6cf8103a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:30.532 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.793+0000 7f6cfd01b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf81035f0 0x7f6cf8103a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57674/0 (socket says 172.21.15.107:57674) 2024-09-21T07:54:30.532 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.793+0000 7f6cfd01b640 1 -- 172.21.15.107:0/2145331637 learned_addr learned my addr 172.21.15.107:0/2145331637 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:30.532 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.793+0000 7f6cfd01b640 1 -- 172.21.15.107:0/2145331637 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf8103f40 con 0x7f6cf81035f0 2024-09-21T07:54:30.532 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.794+0000 7f6cfd01b640 1 --2- 172.21.15.107:0/2145331637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf81035f0 0x7f6cf8103a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009840 tx=0x7f6cf40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3955217ca2bf633e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:30.532 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.794+0000 7f6ceffff640 1 -- 172.21.15.107:0/2145331637 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6cf4032440 con 0x7f6cf81035f0 2024-09-21T07:54:30.532 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.794+0000 7f6ceffff640 1 -- 172.21.15.107:0/2145331637 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6cf4032a40 con 0x7f6cf81035f0 2024-09-21T07:54:30.532 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.794+0000 7f6ceffff640 1 -- 172.21.15.107:0/2145331637 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6cf4031a70 con 0x7f6cf81035f0 2024-09-21T07:54:30.532 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.795+0000 7f6cff27f640 1 -- 172.21.15.107:0/2145331637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf81035f0 msgr2=0x7f6cf8103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:30.532 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.795+0000 7f6cff27f640 1 --2- 172.21.15.107:0/2145331637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf81035f0 0x7f6cf8103a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009840 tx=0x7f6cf40091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.532 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.795+0000 7f6cff27f640 1 -- 172.21.15.107:0/2145331637 shutdown_connections 2024-09-21T07:54:30.532 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.795+0000 7f6cff27f640 1 --2- 172.21.15.107:0/2145331637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf81035f0 0x7f6cf8103a00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.532 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.795+0000 7f6cff27f640 1 -- 172.21.15.107:0/2145331637 >> 172.21.15.107:0/2145331637 conn(0x7f6cf80fbdd0 msgr2=0x7f6cf80fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:30.532 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.795+0000 7f6cff27f640 1 -- 172.21.15.107:0/2145331637 shutdown_connections 2024-09-21T07:54:30.533 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.795+0000 7f6cff27f640 1 -- 172.21.15.107:0/2145331637 wait complete. 2024-09-21T07:54:30.533 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.795+0000 7f6cff27f640 1 Processor -- start 2024-09-21T07:54:30.533 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.795+0000 7f6cff27f640 1 -- start start 2024-09-21T07:54:30.533 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.795+0000 7f6cff27f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf81035f0 0x7f6cf8102d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.533 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.795+0000 7f6cff27f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf8103240 con 0x7f6cf81035f0 2024-09-21T07:54:30.533 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.796+0000 7f6cfd01b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf81035f0 0x7f6cf8102d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:30.533 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.796+0000 7f6cfd01b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf81035f0 0x7f6cf8102d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57688/0 (socket says 172.21.15.107:57688) 2024-09-21T07:54:30.533 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.796+0000 7f6cfd01b640 1 -- 172.21.15.107:0/3687180089 learned_addr learned my addr 172.21.15.107:0/3687180089 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:30.533 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.796+0000 7f6cfd01b640 1 -- 172.21.15.107:0/3687180089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf4009450 con 0x7f6cf81035f0 2024-09-21T07:54:30.533 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.796+0000 7f6cfd01b640 1 --2- 172.21.15.107:0/3687180089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf81035f0 0x7f6cf8102d00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009810 tx=0x7f6cf40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:30.533 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.796+0000 7f6cedffb640 1 -- 172.21.15.107:0/3687180089 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6cf403c400 con 0x7f6cf81035f0 2024-09-21T07:54:30.533 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.796+0000 7f6cedffb640 1 -- 172.21.15.107:0/3687180089 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6cf403ca00 con 0x7f6cf81035f0 2024-09-21T07:54:30.533 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.796+0000 7f6cff27f640 1 -- 172.21.15.107:0/3687180089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf81012d0 con 0x7f6cf81035f0 2024-09-21T07:54:30.533 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.796+0000 7f6cedffb640 1 -- 172.21.15.107:0/3687180089 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6cf403a870 con 0x7f6cf81035f0 2024-09-21T07:54:30.534 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.796+0000 7f6cff27f640 1 -- 172.21.15.107:0/3687180089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf8101740 con 0x7f6cf81035f0 2024-09-21T07:54:30.534 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.797+0000 7f6cedffb640 1 -- 172.21.15.107:0/3687180089 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f6cf403cb70 con 0x7f6cf81035f0 2024-09-21T07:54:30.534 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.797+0000 7f6cedffb640 1 --2- 172.21.15.107:0/3687180089 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f6ce40394e0 0x7f6ce403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.534 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.797+0000 7f6cff27f640 1 -- 172.21.15.107:0/3687180089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf8100a60 con 0x7f6cf81035f0 2024-09-21T07:54:30.534 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.797+0000 7f6cedffb640 1 -- 172.21.15.107:0/3687180089 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6cf406cf50 con 0x7f6cf81035f0 2024-09-21T07:54:30.534 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.797+0000 7f6cfc81a640 1 --2- 172.21.15.107:0/3687180089 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f6ce40394e0 0x7f6ce403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:30.534 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.798+0000 7f6cfc81a640 1 --2- 172.21.15.107:0/3687180089 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f6ce40394e0 0x7f6ce403b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8006fd0 tx=0x7f6ce8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:30.534 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.802+0000 7f6cedffb640 1 -- 172.21.15.107:0/3687180089 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6cf403b8b0 con 0x7f6cf81035f0 2024-09-21T07:54:30.534 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.957+0000 7f6cff27f640 1 -- 172.21.15.107:0/3687180089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f6cf8101eb0 con 0x7f6cf81035f0 2024-09-21T07:54:30.534 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.958+0000 7f6cedffb640 1 -- 172.21.15.107:0/3687180089 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f6cf40650b0 con 0x7f6cf81035f0 2024-09-21T07:54:30.534 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.960+0000 7f6cff27f640 1 -- 172.21.15.107:0/3687180089 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f6ce40394e0 msgr2=0x7f6ce403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:30.534 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.960+0000 7f6cff27f640 1 --2- 172.21.15.107:0/3687180089 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f6ce40394e0 0x7f6ce403b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8006fd0 tx=0x7f6ce8006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.534 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.960+0000 7f6cff27f640 1 -- 172.21.15.107:0/3687180089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf81035f0 msgr2=0x7f6cf8102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:30.535 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.960+0000 7f6cff27f640 1 --2- 172.21.15.107:0/3687180089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf81035f0 0x7f6cf8102d00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009810 tx=0x7f6cf40091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.535 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.960+0000 7f6cff27f640 1 -- 172.21.15.107:0/3687180089 shutdown_connections 2024-09-21T07:54:30.535 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.960+0000 7f6cff27f640 1 --2- 172.21.15.107:0/3687180089 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f6ce40394e0 0x7f6ce403b990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.535 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.960+0000 7f6cff27f640 1 --2- 172.21.15.107:0/3687180089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf81035f0 0x7f6cf8102d00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.535 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.960+0000 7f6cff27f640 1 -- 172.21.15.107:0/3687180089 >> 172.21.15.107:0/3687180089 conn(0x7f6cf80fbdd0 msgr2=0x7f6cf80fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:30.535 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.960+0000 7f6cff27f640 1 -- 172.21.15.107:0/3687180089 shutdown_connections 2024-09-21T07:54:30.535 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:29.960+0000 7f6cff27f640 1 -- 172.21.15.107:0/3687180089 wait complete. 2024-09-21T07:54:30.539 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:54:30.539 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout disabled 2024-09-21T07:54:30.546 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:54:30.546 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout inactive 2024-09-21T07:54:30.547 INFO:teuthology.orchestra.run.smithi107.stdout:firewalld.service is not enabled 2024-09-21T07:54:30.547 INFO:teuthology.orchestra.run.smithi107.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T07:54:30.548 INFO:teuthology.orchestra.run.smithi107.stdout:Ceph Dashboard is now available at: 2024-09-21T07:54:30.549 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:54:30.549 INFO:teuthology.orchestra.run.smithi107.stdout: URL: https://smithi107.front.sepia.ceph.com:8443/ 2024-09-21T07:54:30.549 INFO:teuthology.orchestra.run.smithi107.stdout: User: admin 2024-09-21T07:54:30.549 INFO:teuthology.orchestra.run.smithi107.stdout: Password: s7euabplam 2024-09-21T07:54:30.549 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:54:30.549 INFO:teuthology.orchestra.run.smithi107.stdout:Saving cluster configuration to /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config directory 2024-09-21T07:54:30.549 INFO:teuthology.orchestra.run.smithi107.stdout:Enabling autotune for osd_memory_target 2024-09-21T07:54:31.686 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.892+0000 7f35dbaa3640 1 Processor -- start 2024-09-21T07:54:31.687 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.893+0000 7f35dbaa3640 1 -- start start 2024-09-21T07:54:31.687 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.893+0000 7f35dbaa3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35d41005d0 0x7f35d41009e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:31.687 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.893+0000 7f35dbaa3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d4100f20 con 0x7f35d41005d0 2024-09-21T07:54:31.687 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.893+0000 7f35d983f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35d41005d0 0x7f35d41009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:31.687 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.893+0000 7f35d983f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35d41005d0 0x7f35d41009e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57700/0 (socket says 172.21.15.107:57700) 2024-09-21T07:54:31.687 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.893+0000 7f35d983f640 1 -- 172.21.15.107:0/3263230570 learned_addr learned my addr 172.21.15.107:0/3263230570 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:31.687 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.893+0000 7f35d983f640 1 -- 172.21.15.107:0/3263230570 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d4101060 con 0x7f35d41005d0 2024-09-21T07:54:31.687 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.894+0000 7f35d983f640 1 --2- 172.21.15.107:0/3263230570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35d41005d0 0x7f35d41009e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f35c800a9f0 tx=0x7f35c800a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44a1abb891c72d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:31.687 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.894+0000 7f35d883d640 1 -- 172.21.15.107:0/3263230570 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35c8030670 con 0x7f35d41005d0 2024-09-21T07:54:31.687 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.894+0000 7f35d883d640 1 -- 172.21.15.107:0/3263230570 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f35c802e050 con 0x7f35d41005d0 2024-09-21T07:54:31.687 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.894+0000 7f35d883d640 1 -- 172.21.15.107:0/3263230570 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35c8032c20 con 0x7f35d41005d0 2024-09-21T07:54:31.687 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.895+0000 7f35dbaa3640 1 -- 172.21.15.107:0/3263230570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35d41005d0 msgr2=0x7f35d41009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:31.687 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.895+0000 7f35dbaa3640 1 --2- 172.21.15.107:0/3263230570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35d41005d0 0x7f35d41009e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f35c800a9f0 tx=0x7f35c800a360 comp rx=0 tx=0).stop 2024-09-21T07:54:31.688 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.895+0000 7f35dbaa3640 1 -- 172.21.15.107:0/3263230570 shutdown_connections 2024-09-21T07:54:31.688 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.895+0000 7f35dbaa3640 1 --2- 172.21.15.107:0/3263230570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35d41005d0 0x7f35d41009e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:31.688 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.895+0000 7f35dbaa3640 1 -- 172.21.15.107:0/3263230570 >> 172.21.15.107:0/3263230570 conn(0x7f35d40fbdd0 msgr2=0x7f35d40fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:31.688 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.895+0000 7f35dbaa3640 1 -- 172.21.15.107:0/3263230570 shutdown_connections 2024-09-21T07:54:31.688 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.895+0000 7f35dbaa3640 1 -- 172.21.15.107:0/3263230570 wait complete. 2024-09-21T07:54:31.688 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.895+0000 7f35dbaa3640 1 Processor -- start 2024-09-21T07:54:31.688 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.895+0000 7f35dbaa3640 1 -- start start 2024-09-21T07:54:31.688 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.895+0000 7f35dbaa3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35d41005d0 0x7f35d4104800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:31.688 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.895+0000 7f35dbaa3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d4104d40 con 0x7f35d41005d0 2024-09-21T07:54:31.688 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.896+0000 7f35d983f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35d41005d0 0x7f35d4104800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:31.688 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.896+0000 7f35d983f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35d41005d0 0x7f35d4104800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57706/0 (socket says 172.21.15.107:57706) 2024-09-21T07:54:31.688 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.896+0000 7f35d983f640 1 -- 172.21.15.107:0/2055998018 learned_addr learned my addr 172.21.15.107:0/2055998018 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:31.688 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.896+0000 7f35d983f640 1 -- 172.21.15.107:0/2055998018 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c800a600 con 0x7f35d41005d0 2024-09-21T07:54:31.688 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.896+0000 7f35d983f640 1 --2- 172.21.15.107:0/2055998018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35d41005d0 0x7f35d4104800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f35c8030ac0 tx=0x7f35c800a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:31.688 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.896+0000 7f35c67fc640 1 -- 172.21.15.107:0/2055998018 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35c803b590 con 0x7f35d41005d0 2024-09-21T07:54:31.689 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.896+0000 7f35c67fc640 1 -- 172.21.15.107:0/2055998018 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f35c803bb90 con 0x7f35d41005d0 2024-09-21T07:54:31.689 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.896+0000 7f35dbaa3640 1 -- 172.21.15.107:0/2055998018 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d4102dd0 con 0x7f35d41005d0 2024-09-21T07:54:31.689 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.896+0000 7f35c67fc640 1 -- 172.21.15.107:0/2055998018 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35c803a970 con 0x7f35d41005d0 2024-09-21T07:54:31.689 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.896+0000 7f35dbaa3640 1 -- 172.21.15.107:0/2055998018 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d41031c0 con 0x7f35d41005d0 2024-09-21T07:54:31.689 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.897+0000 7f35c67fc640 1 -- 172.21.15.107:0/2055998018 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f35c803abf0 con 0x7f35d41005d0 2024-09-21T07:54:31.689 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.897+0000 7f35dbaa3640 1 -- 172.21.15.107:0/2055998018 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d404b720 con 0x7f35d41005d0 2024-09-21T07:54:31.689 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.897+0000 7f35c67fc640 1 --2- 172.21.15.107:0/2055998018 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f35c00394e0 0x7f35c003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:31.689 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.897+0000 7f35c67fc640 1 -- 172.21.15.107:0/2055998018 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f35c806d270 con 0x7f35d41005d0 2024-09-21T07:54:31.689 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.897+0000 7f35d903e640 1 --2- 172.21.15.107:0/2055998018 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f35c00394e0 0x7f35c003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:31.689 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.898+0000 7f35d903e640 1 --2- 172.21.15.107:0/2055998018 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f35c00394e0 0x7f35c003b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f35d0006fd0 tx=0x7f35d0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:31.689 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:30.902+0000 7f35c67fc640 1 -- 172.21.15.107:0/2055998018 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f35c8039d10 con 0x7f35d41005d0 2024-09-21T07:54:31.689 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:31.011+0000 7f35c67fc640 1 -- 172.21.15.107:0/2055998018 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f35c803bd00 con 0x7f35d41005d0 2024-09-21T07:54:31.689 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:31.057+0000 7f35dbaa3640 1 -- 172.21.15.107:0/2055998018 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f35d4103bc0 con 0x7f35d41005d0 2024-09-21T07:54:31.689 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:31.058+0000 7f35c67fc640 1 -- 172.21.15.107:0/2055998018 <== mon.0 v2:172.21.15.107:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f35c8039320 con 0x7f35d41005d0 2024-09-21T07:54:31.689 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:31.060+0000 7f35dbaa3640 1 -- 172.21.15.107:0/2055998018 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f35c00394e0 msgr2=0x7f35c003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:31.690 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:31.060+0000 7f35dbaa3640 1 --2- 172.21.15.107:0/2055998018 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f35c00394e0 0x7f35c003b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f35d0006fd0 tx=0x7f35d0006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:31.690 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:31.060+0000 7f35dbaa3640 1 -- 172.21.15.107:0/2055998018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35d41005d0 msgr2=0x7f35d4104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:31.690 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:31.060+0000 7f35dbaa3640 1 --2- 172.21.15.107:0/2055998018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35d41005d0 0x7f35d4104800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f35c8030ac0 tx=0x7f35c800a360 comp rx=0 tx=0).stop 2024-09-21T07:54:31.690 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:31.060+0000 7f35dbaa3640 1 -- 172.21.15.107:0/2055998018 shutdown_connections 2024-09-21T07:54:31.690 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:31.060+0000 7f35dbaa3640 1 --2- 172.21.15.107:0/2055998018 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f35c00394e0 0x7f35c003b990 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:31.690 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:31.060+0000 7f35dbaa3640 1 --2- 172.21.15.107:0/2055998018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35d41005d0 0x7f35d4104800 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:31.690 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:31.060+0000 7f35dbaa3640 1 -- 172.21.15.107:0/2055998018 >> 172.21.15.107:0/2055998018 conn(0x7f35d40fbdd0 msgr2=0x7f35d4105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:31.690 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:31.060+0000 7f35dbaa3640 1 -- 172.21.15.107:0/2055998018 shutdown_connections 2024-09-21T07:54:31.690 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:31.060+0000 7f35dbaa3640 1 -- 172.21.15.107:0/2055998018 wait complete. 2024-09-21T07:54:32.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:32 smithi107 ceph-mon[27622]: mgrmap e13: smithi107.wzulxb(active, since 6s) 2024-09-21T07:54:32.943 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.106+0000 7fe1bc071640 1 Processor -- start 2024-09-21T07:54:32.943 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.107+0000 7fe1bc071640 1 -- start start 2024-09-21T07:54:32.944 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.107+0000 7fe1bc071640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1b4078cb0 0x7fe1b4077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:32.944 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.107+0000 7fe1bc071640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b40790c0 con 0x7fe1b4078cb0 2024-09-21T07:54:32.944 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.107+0000 7fe1b9e0d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1b4078cb0 0x7fe1b4077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:32.944 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.107+0000 7fe1b9e0d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1b4078cb0 0x7fe1b4077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37088/0 (socket says 172.21.15.107:37088) 2024-09-21T07:54:32.944 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.107+0000 7fe1b9e0d640 1 -- 172.21.15.107:0/1925087022 learned_addr learned my addr 172.21.15.107:0/1925087022 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:32.944 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.107+0000 7fe1b9e0d640 1 -- 172.21.15.107:0/1925087022 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b4077770 con 0x7fe1b4078cb0 2024-09-21T07:54:32.944 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.108+0000 7fe1b9e0d640 1 --2- 172.21.15.107:0/1925087022 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1b4078cb0 0x7fe1b4077230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009840 tx=0x7fe1b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad4d0f4c8744098 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:32.944 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.108+0000 7fe1b8e0b640 1 -- 172.21.15.107:0/1925087022 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe1b0032440 con 0x7fe1b4078cb0 2024-09-21T07:54:32.944 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.108+0000 7fe1b8e0b640 1 -- 172.21.15.107:0/1925087022 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe1b0032a40 con 0x7fe1b4078cb0 2024-09-21T07:54:32.944 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.108+0000 7fe1b8e0b640 1 -- 172.21.15.107:0/1925087022 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe1b0031a70 con 0x7fe1b4078cb0 2024-09-21T07:54:32.944 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.108+0000 7fe1bc071640 1 -- 172.21.15.107:0/1925087022 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1b4078cb0 msgr2=0x7fe1b4077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:32.944 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.108+0000 7fe1bc071640 1 --2- 172.21.15.107:0/1925087022 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1b4078cb0 0x7fe1b4077230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009840 tx=0x7fe1b00091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:32.944 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.109+0000 7fe1bc071640 1 -- 172.21.15.107:0/1925087022 shutdown_connections 2024-09-21T07:54:32.944 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.109+0000 7fe1bc071640 1 --2- 172.21.15.107:0/1925087022 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1b4078cb0 0x7fe1b4077230 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:32.945 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.109+0000 7fe1bc071640 1 -- 172.21.15.107:0/1925087022 >> 172.21.15.107:0/1925087022 conn(0x7fe1b40fd770 msgr2=0x7fe1b40ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:32.945 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.109+0000 7fe1bc071640 1 -- 172.21.15.107:0/1925087022 shutdown_connections 2024-09-21T07:54:32.945 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.109+0000 7fe1bc071640 1 -- 172.21.15.107:0/1925087022 wait complete. 2024-09-21T07:54:32.945 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.109+0000 7fe1bc071640 1 Processor -- start 2024-09-21T07:54:32.945 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.109+0000 7fe1bc071640 1 -- start start 2024-09-21T07:54:32.945 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.109+0000 7fe1bc071640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1b4078cb0 0x7fe1b4112f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:32.945 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.109+0000 7fe1bc071640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b41134b0 con 0x7fe1b4078cb0 2024-09-21T07:54:32.945 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.109+0000 7fe1b9e0d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1b4078cb0 0x7fe1b4112f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:32.945 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.109+0000 7fe1b9e0d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1b4078cb0 0x7fe1b4112f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37098/0 (socket says 172.21.15.107:37098) 2024-09-21T07:54:32.945 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.109+0000 7fe1b9e0d640 1 -- 172.21.15.107:0/429772632 learned_addr learned my addr 172.21.15.107:0/429772632 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:32.945 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.110+0000 7fe1b9e0d640 1 -- 172.21.15.107:0/429772632 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b0009450 con 0x7fe1b4078cb0 2024-09-21T07:54:32.945 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.110+0000 7fe1b9e0d640 1 --2- 172.21.15.107:0/429772632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1b4078cb0 0x7fe1b4112f70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0031750 tx=0x7fe1b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:32.945 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.110+0000 7fe1aa7fc640 1 -- 172.21.15.107:0/429772632 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe1b003c400 con 0x7fe1b4078cb0 2024-09-21T07:54:32.945 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.110+0000 7fe1aa7fc640 1 -- 172.21.15.107:0/429772632 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe1b003ca00 con 0x7fe1b4078cb0 2024-09-21T07:54:32.945 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.110+0000 7fe1bc071640 1 -- 172.21.15.107:0/429772632 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b41136b0 con 0x7fe1b4078cb0 2024-09-21T07:54:32.946 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.110+0000 7fe1aa7fc640 1 -- 172.21.15.107:0/429772632 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe1b003a880 con 0x7fe1b4078cb0 2024-09-21T07:54:32.946 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.110+0000 7fe1bc071640 1 -- 172.21.15.107:0/429772632 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b4113ac0 con 0x7fe1b4078cb0 2024-09-21T07:54:32.946 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.111+0000 7fe1aa7fc640 1 -- 172.21.15.107:0/429772632 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fe1b003c560 con 0x7fe1b4078cb0 2024-09-21T07:54:32.946 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.111+0000 7fe1bc071640 1 -- 172.21.15.107:0/429772632 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b404b720 con 0x7fe1b4078cb0 2024-09-21T07:54:32.946 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.111+0000 7fe1aa7fc640 1 --2- 172.21.15.107:0/429772632 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fe1a00395d0 0x7fe1a003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:32.946 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.111+0000 7fe1aa7fc640 1 -- 172.21.15.107:0/429772632 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe1b006cff0 con 0x7fe1b4078cb0 2024-09-21T07:54:32.946 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.111+0000 7fe1b960c640 1 --2- 172.21.15.107:0/429772632 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fe1a00395d0 0x7fe1a003ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:32.946 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.112+0000 7fe1b960c640 1 --2- 172.21.15.107:0/429772632 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fe1a00395d0 0x7fe1a003ba80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4006fd0 tx=0x7fe1a4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:32.946 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.115+0000 7fe1aa7fc640 1 -- 172.21.15.107:0/429772632 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe1b0046460 con 0x7fe1b4078cb0 2024-09-21T07:54:32.946 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.352+0000 7fe1bc071640 1 -- 172.21.15.107:0/429772632 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fe1b4114480 con 0x7fe1b4078cb0 2024-09-21T07:54:32.946 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.355+0000 7fe1aa7fc640 1 -- 172.21.15.107:0/429772632 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7fe1b0037030 con 0x7fe1b4078cb0 2024-09-21T07:54:32.946 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T07:54:32.946 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.357+0000 7fe1bc071640 1 -- 172.21.15.107:0/429772632 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fe1a00395d0 msgr2=0x7fe1a003ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:32.946 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.357+0000 7fe1bc071640 1 --2- 172.21.15.107:0/429772632 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fe1a00395d0 0x7fe1a003ba80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4006fd0 tx=0x7fe1a4006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:32.947 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.357+0000 7fe1bc071640 1 -- 172.21.15.107:0/429772632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1b4078cb0 msgr2=0x7fe1b4112f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:32.947 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.357+0000 7fe1bc071640 1 --2- 172.21.15.107:0/429772632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1b4078cb0 0x7fe1b4112f70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0031750 tx=0x7fe1b00091d0 comp rx=0 tx=0).stop 2024-09-21T07:54:32.947 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.357+0000 7fe1bc071640 1 -- 172.21.15.107:0/429772632 shutdown_connections 2024-09-21T07:54:32.947 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.357+0000 7fe1bc071640 1 --2- 172.21.15.107:0/429772632 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fe1a00395d0 0x7fe1a003ba80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:32.947 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.357+0000 7fe1bc071640 1 --2- 172.21.15.107:0/429772632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1b4078cb0 0x7fe1b4112f70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:32.947 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.357+0000 7fe1bc071640 1 -- 172.21.15.107:0/429772632 >> 172.21.15.107:0/429772632 conn(0x7fe1b40fd770 msgr2=0x7fe1b40fe310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:32.947 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.357+0000 7fe1bc071640 1 -- 172.21.15.107:0/429772632 shutdown_connections 2024-09-21T07:54:32.947 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-09-21T07:54:32.357+0000 7fe1bc071640 1 -- 172.21.15.107:0/429772632 wait complete. 2024-09-21T07:54:32.947 INFO:teuthology.orchestra.run.smithi107.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T07:54:32.947 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:54:32.947 INFO:teuthology.orchestra.run.smithi107.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:54:32.947 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:54:32.947 INFO:teuthology.orchestra.run.smithi107.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T07:54:32.947 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:54:32.948 INFO:teuthology.orchestra.run.smithi107.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T07:54:32.948 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:54:32.948 INFO:teuthology.orchestra.run.smithi107.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T07:54:32.948 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:54:32.948 INFO:teuthology.orchestra.run.smithi107.stdout: ceph telemetry on 2024-09-21T07:54:32.948 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:54:32.948 INFO:teuthology.orchestra.run.smithi107.stdout:For more information see: 2024-09-21T07:54:32.948 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:54:32.948 INFO:teuthology.orchestra.run.smithi107.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-09-21T07:54:32.948 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:54:32.948 INFO:teuthology.orchestra.run.smithi107.stdout:Bootstrap complete. 2024-09-21T07:54:32.975 INFO:tasks.cephadm:Fetching config... 2024-09-21T07:54:32.976 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-21T07:54:32.976 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T07:54:32.991 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T07:54:32.991 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-21T07:54:32.991 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T07:54:33.047 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T07:54:33.048 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-21T07:54:33.048 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/keyring of=/dev/stdout 2024-09-21T07:54:33.112 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T07:54:33.112 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-21T07:54:33.112 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T07:54:33.168 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T07:54:33.168 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQClRCqoTj4Sb3c/9KAA6Tn0E5CC0Z49F1LnUKL8AzQCNx/i0ucH0eIIhnNQE3yZ2Nqh9/RQKKHY3tfCQots928mRmRAGa3z4UR1WsolZuR0P5T+d9IFJ7MW0KM8I7Trnij7R1gHBxrfHd3ciZahYkcuzBfx6Guj5AHIbm3to7GFueCtX4oeyZ+WcvBw1tsSRbHKaz3fts+PqUcKvAz7aDPGiMqmmh/oZbOmIGc+T/eBiuQNDoeWlX3W+qTCokwnF3HV7zeu9qpluW6zP9pOxLUs77fu9cuWQHbxlWmJKGhV8uhdNPaXnvKoEjTMQ3RNTDswleTcj260Qm3GUzJkA59C/D6gekyofRYmIWVpv990qNnrFbOLTybMtj/PgX9rFKCOIJ95D/6Nn0rTu3Avf0jIb18xbKwsgBf+YoOuIfkZeh3sBNQCwPbSpYOmkMRn+v/hFr9OTOHQD9J1949CPLdP/vHSgkjw2vFXEUaabfexaTb372HMkr3p7vj/Taw0mR0= ceph-786d4f32-77ee-11ef-baf6-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T07:54:33.243 INFO:teuthology.orchestra.run.smithi107.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQClRCqoTj4Sb3c/9KAA6Tn0E5CC0Z49F1LnUKL8AzQCNx/i0ucH0eIIhnNQE3yZ2Nqh9/RQKKHY3tfCQots928mRmRAGa3z4UR1WsolZuR0P5T+d9IFJ7MW0KM8I7Trnij7R1gHBxrfHd3ciZahYkcuzBfx6Guj5AHIbm3to7GFueCtX4oeyZ+WcvBw1tsSRbHKaz3fts+PqUcKvAz7aDPGiMqmmh/oZbOmIGc+T/eBiuQNDoeWlX3W+qTCokwnF3HV7zeu9qpluW6zP9pOxLUs77fu9cuWQHbxlWmJKGhV8uhdNPaXnvKoEjTMQ3RNTDswleTcj260Qm3GUzJkA59C/D6gekyofRYmIWVpv990qNnrFbOLTybMtj/PgX9rFKCOIJ95D/6Nn0rTu3Avf0jIb18xbKwsgBf+YoOuIfkZeh3sBNQCwPbSpYOmkMRn+v/hFr9OTOHQD9J1949CPLdP/vHSgkjw2vFXEUaabfexaTb372HMkr3p7vj/Taw0mR0= ceph-786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T07:54:33.255 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQClRCqoTj4Sb3c/9KAA6Tn0E5CC0Z49F1LnUKL8AzQCNx/i0ucH0eIIhnNQE3yZ2Nqh9/RQKKHY3tfCQots928mRmRAGa3z4UR1WsolZuR0P5T+d9IFJ7MW0KM8I7Trnij7R1gHBxrfHd3ciZahYkcuzBfx6Guj5AHIbm3to7GFueCtX4oeyZ+WcvBw1tsSRbHKaz3fts+PqUcKvAz7aDPGiMqmmh/oZbOmIGc+T/eBiuQNDoeWlX3W+qTCokwnF3HV7zeu9qpluW6zP9pOxLUs77fu9cuWQHbxlWmJKGhV8uhdNPaXnvKoEjTMQ3RNTDswleTcj260Qm3GUzJkA59C/D6gekyofRYmIWVpv990qNnrFbOLTybMtj/PgX9rFKCOIJ95D/6Nn0rTu3Avf0jIb18xbKwsgBf+YoOuIfkZeh3sBNQCwPbSpYOmkMRn+v/hFr9OTOHQD9J1949CPLdP/vHSgkjw2vFXEUaabfexaTb372HMkr3p7vj/Taw0mR0= ceph-786d4f32-77ee-11ef-baf6-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T07:54:33.389 INFO:teuthology.orchestra.run.smithi129.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQClRCqoTj4Sb3c/9KAA6Tn0E5CC0Z49F1LnUKL8AzQCNx/i0ucH0eIIhnNQE3yZ2Nqh9/RQKKHY3tfCQots928mRmRAGa3z4UR1WsolZuR0P5T+d9IFJ7MW0KM8I7Trnij7R1gHBxrfHd3ciZahYkcuzBfx6Guj5AHIbm3to7GFueCtX4oeyZ+WcvBw1tsSRbHKaz3fts+PqUcKvAz7aDPGiMqmmh/oZbOmIGc+T/eBiuQNDoeWlX3W+qTCokwnF3HV7zeu9qpluW6zP9pOxLUs77fu9cuWQHbxlWmJKGhV8uhdNPaXnvKoEjTMQ3RNTDswleTcj260Qm3GUzJkA59C/D6gekyofRYmIWVpv990qNnrFbOLTybMtj/PgX9rFKCOIJ95D/6Nn0rTu3Avf0jIb18xbKwsgBf+YoOuIfkZeh3sBNQCwPbSpYOmkMRn+v/hFr9OTOHQD9J1949CPLdP/vHSgkjw2vFXEUaabfexaTb372HMkr3p7vj/Taw0mR0= ceph-786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T07:54:33.402 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T07:54:33.498 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:33 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/429772632' entity='client.admin' 2024-09-21T07:54:33.661 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:54:36.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.226+0000 7fd1faef9640 1 -- 172.21.15.107:0/600158674 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f40fc1f0 msgr2=0x7fd1f40fc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:36.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.226+0000 7fd1faef9640 1 --2- 172.21.15.107:0/600158674 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f40fc1f0 0x7fd1f40fc600 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8004850 tx=0x7fd1e8009da0 comp rx=0 tx=0).stop 2024-09-21T07:54:36.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.226+0000 7fd1faef9640 1 -- 172.21.15.107:0/600158674 shutdown_connections 2024-09-21T07:54:36.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.226+0000 7fd1faef9640 1 --2- 172.21.15.107:0/600158674 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f40fc1f0 0x7fd1f40fc600 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:36.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.226+0000 7fd1faef9640 1 -- 172.21.15.107:0/600158674 >> 172.21.15.107:0/600158674 conn(0x7fd1f40f79b0 msgr2=0x7fd1f40f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:36.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.226+0000 7fd1faef9640 1 -- 172.21.15.107:0/600158674 shutdown_connections 2024-09-21T07:54:36.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.226+0000 7fd1faef9640 1 -- 172.21.15.107:0/600158674 wait complete. 2024-09-21T07:54:36.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.227+0000 7fd1faef9640 1 Processor -- start 2024-09-21T07:54:36.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.227+0000 7fd1faef9640 1 -- start start 2024-09-21T07:54:36.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.227+0000 7fd1faef9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f40fc1f0 0x7fd1f410c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:36.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.227+0000 7fd1faef9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f410cc70 con 0x7fd1f40fc1f0 2024-09-21T07:54:36.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.227+0000 7fd1f8c95640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f40fc1f0 0x7fd1f410c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:36.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.227+0000 7fd1f8c95640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f40fc1f0 0x7fd1f410c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37120/0 (socket says 172.21.15.107:37120) 2024-09-21T07:54:36.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.227+0000 7fd1f8c95640 1 -- 172.21.15.107:0/3178938490 learned_addr learned my addr 172.21.15.107:0/3178938490 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:36.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.227+0000 7fd1f8c95640 1 -- 172.21.15.107:0/3178938490 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e8005040 con 0x7fd1f40fc1f0 2024-09-21T07:54:36.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.228+0000 7fd1f8c95640 1 --2- 172.21.15.107:0/3178938490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f40fc1f0 0x7fd1f410c730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009920 tx=0x7fd1e8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:36.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.228+0000 7fd1f17fa640 1 -- 172.21.15.107:0/3178938490 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1e8033630 con 0x7fd1f40fc1f0 2024-09-21T07:54:36.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.228+0000 7fd1f17fa640 1 -- 172.21.15.107:0/3178938490 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd1e8033c30 con 0x7fd1f40fc1f0 2024-09-21T07:54:36.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.228+0000 7fd1faef9640 1 -- 172.21.15.107:0/3178938490 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f410ce70 con 0x7fd1f40fc1f0 2024-09-21T07:54:36.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.228+0000 7fd1f17fa640 1 -- 172.21.15.107:0/3178938490 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1e803dc40 con 0x7fd1f40fc1f0 2024-09-21T07:54:36.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.228+0000 7fd1faef9640 1 -- 172.21.15.107:0/3178938490 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f410d2e0 con 0x7fd1f40fc1f0 2024-09-21T07:54:36.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.229+0000 7fd1f17fa640 1 -- 172.21.15.107:0/3178938490 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fd1e8030020 con 0x7fd1f40fc1f0 2024-09-21T07:54:36.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.229+0000 7fd1faef9640 1 -- 172.21.15.107:0/3178938490 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f405ed70 con 0x7fd1f40fc1f0 2024-09-21T07:54:36.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.229+0000 7fd1f17fa640 1 --2- 172.21.15.107:0/3178938490 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fd1e4039580 0x7fd1e403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:36.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.229+0000 7fd1f17fa640 1 -- 172.21.15.107:0/3178938490 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd1e806c930 con 0x7fd1f40fc1f0 2024-09-21T07:54:36.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.229+0000 7fd1f3fff640 1 --2- 172.21.15.107:0/3178938490 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fd1e4039580 0x7fd1e403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:36.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.230+0000 7fd1f3fff640 1 --2- 172.21.15.107:0/3178938490 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fd1e4039580 0x7fd1e403ba30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0006fd0 tx=0x7fd1e0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:36.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.234+0000 7fd1f17fa640 1 -- 172.21.15.107:0/3178938490 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd1e803bb50 con 0x7fd1f40fc1f0 2024-09-21T07:54:36.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.404+0000 7fd1faef9640 1 -- 172.21.15.107:0/3178938490 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fd1f410d2e0 con 0x7fd1f40fc1f0 2024-09-21T07:54:36.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.407+0000 7fd1f17fa640 1 -- 172.21.15.107:0/3178938490 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fd1e8042210 con 0x7fd1f40fc1f0 2024-09-21T07:54:36.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.409+0000 7fd1faef9640 1 -- 172.21.15.107:0/3178938490 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fd1e4039580 msgr2=0x7fd1e403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:36.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.409+0000 7fd1faef9640 1 --2- 172.21.15.107:0/3178938490 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fd1e4039580 0x7fd1e403ba30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0006fd0 tx=0x7fd1e0006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:36.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.409+0000 7fd1faef9640 1 -- 172.21.15.107:0/3178938490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f40fc1f0 msgr2=0x7fd1f410c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:36.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.409+0000 7fd1faef9640 1 --2- 172.21.15.107:0/3178938490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f40fc1f0 0x7fd1f410c730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009920 tx=0x7fd1e8009da0 comp rx=0 tx=0).stop 2024-09-21T07:54:36.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.409+0000 7fd1faef9640 1 -- 172.21.15.107:0/3178938490 shutdown_connections 2024-09-21T07:54:36.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.409+0000 7fd1faef9640 1 --2- 172.21.15.107:0/3178938490 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fd1e4039580 0x7fd1e403ba30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:36.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.409+0000 7fd1faef9640 1 --2- 172.21.15.107:0/3178938490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f40fc1f0 0x7fd1f410c730 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:36.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.409+0000 7fd1faef9640 1 -- 172.21.15.107:0/3178938490 >> 172.21.15.107:0/3178938490 conn(0x7fd1f40f79b0 msgr2=0x7fd1f40f8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:36.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.409+0000 7fd1faef9640 1 -- 172.21.15.107:0/3178938490 shutdown_connections 2024-09-21T07:54:36.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:36.409+0000 7fd1faef9640 1 -- 172.21.15.107:0/3178938490 wait complete. 2024-09-21T07:54:37.061 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T07:54:37.062 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T07:54:37.536 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:54:37.662 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:37 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/3178938490' entity='client.admin' 2024-09-21T07:54:38.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:38 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:38.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:38 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:38.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:38 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd/host:smithi107", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:54:38.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:38 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:38.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:38 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi107", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T07:54:38.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:38 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi107", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-21T07:54:38.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:38 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:54:38.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:38 smithi107 ceph-mon[27622]: Deploying daemon crash.smithi107 on smithi107 2024-09-21T07:54:39.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.672+0000 7fb07cb2f640 1 -- 172.21.15.107:0/1230893165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb078065650 msgr2=0x7fb0780feff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:39.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.672+0000 7fb07cb2f640 1 --2- 172.21.15.107:0/1230893165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb078065650 0x7fb0780feff0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb068009bd0 tx=0x7fb068004d10 comp rx=0 tx=0).stop 2024-09-21T07:54:39.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.672+0000 7fb07cb2f640 1 -- 172.21.15.107:0/1230893165 shutdown_connections 2024-09-21T07:54:39.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.672+0000 7fb07cb2f640 1 --2- 172.21.15.107:0/1230893165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb078065650 0x7fb0780feff0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:39.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.672+0000 7fb07cb2f640 1 -- 172.21.15.107:0/1230893165 >> 172.21.15.107:0/1230893165 conn(0x7fb0780f6ac0 msgr2=0x7fb0780f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:39.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.672+0000 7fb07cb2f640 1 -- 172.21.15.107:0/1230893165 shutdown_connections 2024-09-21T07:54:39.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.672+0000 7fb07cb2f640 1 -- 172.21.15.107:0/1230893165 wait complete. 2024-09-21T07:54:39.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.672+0000 7fb07cb2f640 1 Processor -- start 2024-09-21T07:54:39.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.672+0000 7fb07cb2f640 1 -- start start 2024-09-21T07:54:39.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.673+0000 7fb07cb2f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb078065650 0x7fb07810c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:39.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.673+0000 7fb07cb2f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07810ce80 con 0x7fb078065650 2024-09-21T07:54:39.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.673+0000 7fb07659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb078065650 0x7fb07810c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:39.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.673+0000 7fb07659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb078065650 0x7fb07810c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37144/0 (socket says 172.21.15.107:37144) 2024-09-21T07:54:39.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.673+0000 7fb07659c640 1 -- 172.21.15.107:0/4015725623 learned_addr learned my addr 172.21.15.107:0/4015725623 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:39.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.673+0000 7fb07659c640 1 -- 172.21.15.107:0/4015725623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0680098b0 con 0x7fb078065650 2024-09-21T07:54:39.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.673+0000 7fb07659c640 1 --2- 172.21.15.107:0/4015725623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb078065650 0x7fb07810c940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb068004a30 tx=0x7fb068004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:39.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.673+0000 7fb06effd640 1 -- 172.21.15.107:0/4015725623 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb068032910 con 0x7fb078065650 2024-09-21T07:54:39.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.673+0000 7fb06effd640 1 -- 172.21.15.107:0/4015725623 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb06803d420 con 0x7fb078065650 2024-09-21T07:54:39.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.673+0000 7fb07cb2f640 1 -- 172.21.15.107:0/4015725623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07810d080 con 0x7fb078065650 2024-09-21T07:54:39.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.673+0000 7fb06effd640 1 -- 172.21.15.107:0/4015725623 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb068031590 con 0x7fb078065650 2024-09-21T07:54:39.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.673+0000 7fb07cb2f640 1 -- 172.21.15.107:0/4015725623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07810dc10 con 0x7fb078065650 2024-09-21T07:54:39.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.674+0000 7fb06effd640 1 -- 172.21.15.107:0/4015725623 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fb06802f030 con 0x7fb078065650 2024-09-21T07:54:39.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.674+0000 7fb07cb2f640 1 -- 172.21.15.107:0/4015725623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb078102800 con 0x7fb078065650 2024-09-21T07:54:39.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.674+0000 7fb06effd640 1 --2- 172.21.15.107:0/4015725623 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fb0640395d0 0x7fb06403ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:39.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.674+0000 7fb06effd640 1 -- 172.21.15.107:0/4015725623 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb06806d1c0 con 0x7fb078065650 2024-09-21T07:54:39.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.674+0000 7fb075d9b640 1 --2- 172.21.15.107:0/4015725623 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fb0640395d0 0x7fb06403ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:39.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.675+0000 7fb075d9b640 1 --2- 172.21.15.107:0/4015725623 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fb0640395d0 0x7fb06403ba80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb060006fd0 tx=0x7fb060006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:39.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.679+0000 7fb06effd640 1 -- 172.21.15.107:0/4015725623 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb0680316f0 con 0x7fb078065650 2024-09-21T07:54:39.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.842+0000 7fb07cb2f640 1 -- 172.21.15.107:0/4015725623 --> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0780008d0 con 0x7fb0640395d0 2024-09-21T07:54:39.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.845+0000 7fb06effd640 1 -- 172.21.15.107:0/4015725623 <== mgr.14160 v2:172.21.15.107:6800/2850161381 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb0780008d0 con 0x7fb0640395d0 2024-09-21T07:54:39.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.847+0000 7fb07cb2f640 1 -- 172.21.15.107:0/4015725623 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fb0640395d0 msgr2=0x7fb06403ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:39.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.847+0000 7fb07cb2f640 1 --2- 172.21.15.107:0/4015725623 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fb0640395d0 0x7fb06403ba80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb060006fd0 tx=0x7fb060006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:39.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.847+0000 7fb07cb2f640 1 -- 172.21.15.107:0/4015725623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb078065650 msgr2=0x7fb07810c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:39.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.847+0000 7fb07cb2f640 1 --2- 172.21.15.107:0/4015725623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb078065650 0x7fb07810c940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb068004a30 tx=0x7fb068004d10 comp rx=0 tx=0).stop 2024-09-21T07:54:39.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.847+0000 7fb07cb2f640 1 -- 172.21.15.107:0/4015725623 shutdown_connections 2024-09-21T07:54:39.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.847+0000 7fb07cb2f640 1 --2- 172.21.15.107:0/4015725623 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fb0640395d0 0x7fb06403ba80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:39.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.847+0000 7fb07cb2f640 1 --2- 172.21.15.107:0/4015725623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb078065650 0x7fb07810c940 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:39.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.847+0000 7fb07cb2f640 1 -- 172.21.15.107:0/4015725623 >> 172.21.15.107:0/4015725623 conn(0x7fb0780f6ac0 msgr2=0x7fb0780f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:39.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.847+0000 7fb07cb2f640 1 -- 172.21.15.107:0/4015725623 shutdown_connections 2024-09-21T07:54:39.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:39.847+0000 7fb07cb2f640 1 -- 172.21.15.107:0/4015725623 wait complete. 2024-09-21T07:54:40.823 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi129 2024-09-21T07:54:40.824 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T07:54:40.824 DEBUG:teuthology.orchestra.run.smithi129:> dd of=/etc/ceph/ceph.conf 2024-09-21T07:54:40.842 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T07:54:40.843 DEBUG:teuthology.orchestra.run.smithi129:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:54:40.901 INFO:tasks.cephadm:Adding host smithi129 to orchestrator... 2024-09-21T07:54:40.901 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph orch host add smithi129 2024-09-21T07:54:41.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:40 smithi107 ceph-mon[27622]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:41.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:40 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:41.426 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:54:42.484 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:42 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:42.484 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:42 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:42.484 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:42 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:42.484 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:42 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:42.484 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:42 smithi107 ceph-mon[27622]: Deploying daemon node-exporter.smithi107 on smithi107 2024-09-21T07:54:43.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.115+0000 7f9900817640 1 -- 172.21.15.107:0/3085070890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98fc0fc1d0 msgr2=0x7f98fc0fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:43.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.115+0000 7f9900817640 1 --2- 172.21.15.107:0/3085070890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98fc0fc1d0 0x7f98fc0fc5e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f98ec004850 tx=0x7f98ec009da0 comp rx=0 tx=0).stop 2024-09-21T07:54:43.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.115+0000 7f9900817640 1 -- 172.21.15.107:0/3085070890 shutdown_connections 2024-09-21T07:54:43.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.115+0000 7f9900817640 1 --2- 172.21.15.107:0/3085070890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98fc0fc1d0 0x7f98fc0fc5e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:43.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.115+0000 7f9900817640 1 -- 172.21.15.107:0/3085070890 >> 172.21.15.107:0/3085070890 conn(0x7f98fc0f79b0 msgr2=0x7f98fc0f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:43.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.115+0000 7f9900817640 1 -- 172.21.15.107:0/3085070890 shutdown_connections 2024-09-21T07:54:43.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.115+0000 7f9900817640 1 -- 172.21.15.107:0/3085070890 wait complete. 2024-09-21T07:54:43.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.116+0000 7f9900817640 1 Processor -- start 2024-09-21T07:54:43.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.116+0000 7f9900817640 1 -- start start 2024-09-21T07:54:43.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.116+0000 7f9900817640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98fc0fc1d0 0x7f98fc071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:43.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.116+0000 7f9900817640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc0719d0 con 0x7f98fc0fc1d0 2024-09-21T07:54:43.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.116+0000 7f98fa59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98fc0fc1d0 0x7f98fc071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:43.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.116+0000 7f98fa59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98fc0fc1d0 0x7f98fc071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54436/0 (socket says 172.21.15.107:54436) 2024-09-21T07:54:43.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.116+0000 7f98fa59c640 1 -- 172.21.15.107:0/3888119269 learned_addr learned my addr 172.21.15.107:0/3888119269 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:43.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.116+0000 7f98fa59c640 1 -- 172.21.15.107:0/3888119269 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec005040 con 0x7f98fc0fc1d0 2024-09-21T07:54:43.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.116+0000 7f98fa59c640 1 --2- 172.21.15.107:0/3888119269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98fc0fc1d0 0x7f98fc071490 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f98ec02a6d0 tx=0x7f98ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:43.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.117+0000 7f98f37fe640 1 -- 172.21.15.107:0/3888119269 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98ec033630 con 0x7f98fc0fc1d0 2024-09-21T07:54:43.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.117+0000 7f98f37fe640 1 -- 172.21.15.107:0/3888119269 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f98ec033c30 con 0x7f98fc0fc1d0 2024-09-21T07:54:43.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.117+0000 7f9900817640 1 -- 172.21.15.107:0/3888119269 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98fc06fa60 con 0x7f98fc0fc1d0 2024-09-21T07:54:43.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.117+0000 7f98f37fe640 1 -- 172.21.15.107:0/3888119269 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98ec03dc00 con 0x7f98fc0fc1d0 2024-09-21T07:54:43.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.117+0000 7f9900817640 1 -- 172.21.15.107:0/3888119269 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98fc06fed0 con 0x7f98fc0fc1d0 2024-09-21T07:54:43.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.117+0000 7f98f37fe640 1 -- 172.21.15.107:0/3888119269 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f98ec030020 con 0x7f98fc0fc1d0 2024-09-21T07:54:43.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.118+0000 7f98f37fe640 1 --2- 172.21.15.107:0/3888119269 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f98e8039580 0x7f98e803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:43.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.118+0000 7f98f37fe640 1 -- 172.21.15.107:0/3888119269 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f98ec06ca50 con 0x7f98fc0fc1d0 2024-09-21T07:54:43.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.118+0000 7f9900817640 1 -- 172.21.15.107:0/3888119269 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98fc05ed70 con 0x7f98fc0fc1d0 2024-09-21T07:54:43.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.118+0000 7f98f1d9b640 1 --2- 172.21.15.107:0/3888119269 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f98e8039580 0x7f98e803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:43.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.118+0000 7f98f1d9b640 1 --2- 172.21.15.107:0/3888119269 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f98e8039580 0x7f98e803ba30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f98e4006fd0 tx=0x7f98e4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:43.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.122+0000 7f98f37fe640 1 -- 172.21.15.107:0/3888119269 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f98ec03bdb0 con 0x7f98fc0fc1d0 2024-09-21T07:54:43.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:43.326+0000 7f9900817640 1 -- 172.21.15.107:0/3888119269 --> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi129", "target": ["mon-mgr", ""]}) v1 -- 0x7f98fc1063a0 con 0x7f98e8039580 2024-09-21T07:54:44.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:44 smithi107 ceph-mon[27622]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi129", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:45.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:45 smithi107 ceph-mon[27622]: Deploying cephadm binary to smithi129 2024-09-21T07:54:45.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:45 smithi107 ceph-mon[27622]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:54:45.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:45 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:46.022 INFO:teuthology.orchestra.run.smithi107.stdout:Added host 'smithi129' with addr '172.21.15.129' 2024-09-21T07:54:46.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:46.019+0000 7f98f37fe640 1 -- 172.21.15.107:0/3888119269 <== mgr.14160 v2:172.21.15.107:6800/2850161381 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f98fc1063a0 con 0x7f98e8039580 2024-09-21T07:54:46.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:46.022+0000 7f9900817640 1 -- 172.21.15.107:0/3888119269 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f98e8039580 msgr2=0x7f98e803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:46.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:46.022+0000 7f9900817640 1 --2- 172.21.15.107:0/3888119269 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f98e8039580 0x7f98e803ba30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f98e4006fd0 tx=0x7f98e4006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:46.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:46.022+0000 7f9900817640 1 -- 172.21.15.107:0/3888119269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98fc0fc1d0 msgr2=0x7f98fc071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:46.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:46.022+0000 7f9900817640 1 --2- 172.21.15.107:0/3888119269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98fc0fc1d0 0x7f98fc071490 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f98ec02a6d0 tx=0x7f98ec009da0 comp rx=0 tx=0).stop 2024-09-21T07:54:46.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:46.022+0000 7f9900817640 1 -- 172.21.15.107:0/3888119269 shutdown_connections 2024-09-21T07:54:46.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:46.022+0000 7f9900817640 1 --2- 172.21.15.107:0/3888119269 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f98e8039580 0x7f98e803ba30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:46.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:46.022+0000 7f9900817640 1 --2- 172.21.15.107:0/3888119269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98fc0fc1d0 0x7f98fc071490 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:46.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:46.022+0000 7f9900817640 1 -- 172.21.15.107:0/3888119269 >> 172.21.15.107:0/3888119269 conn(0x7f98fc0f79b0 msgr2=0x7f98fc0f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:46.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:46.022+0000 7f9900817640 1 -- 172.21.15.107:0/3888119269 shutdown_connections 2024-09-21T07:54:46.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:46.022+0000 7f9900817640 1 -- 172.21.15.107:0/3888119269 wait complete. 2024-09-21T07:54:46.644 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T07:54:46.890 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:54:47.262 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:47 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:47.262 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:47 smithi107 ceph-mon[27622]: Added host smithi129 2024-09-21T07:54:47.262 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:47 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:47.262 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:47 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:47.262 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:47 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:47.262 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:47 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:47.262 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:47 smithi107 ceph-mon[27622]: Deploying daemon alertmanager.smithi107 on smithi107 2024-09-21T07:54:47.262 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:47 smithi107 ceph-mon[27622]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:54:49.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.945+0000 7fb3a6f6c640 1 -- 172.21.15.107:0/893055449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a0065650 msgr2=0x7fb3a00feff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:49.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.945+0000 7fb3a6f6c640 1 --2- 172.21.15.107:0/893055449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a0065650 0x7fb3a00feff0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb394004850 tx=0x7fb394009da0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.945+0000 7fb3a6f6c640 1 -- 172.21.15.107:0/893055449 shutdown_connections 2024-09-21T07:54:49.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.945+0000 7fb3a6f6c640 1 --2- 172.21.15.107:0/893055449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a0065650 0x7fb3a00feff0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.945+0000 7fb3a6f6c640 1 -- 172.21.15.107:0/893055449 >> 172.21.15.107:0/893055449 conn(0x7fb3a00f6ac0 msgr2=0x7fb3a00f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:49.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.945+0000 7fb3a6f6c640 1 -- 172.21.15.107:0/893055449 shutdown_connections 2024-09-21T07:54:49.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.945+0000 7fb3a6f6c640 1 -- 172.21.15.107:0/893055449 wait complete. 2024-09-21T07:54:49.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.946+0000 7fb3a6f6c640 1 Processor -- start 2024-09-21T07:54:49.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.946+0000 7fb3a6f6c640 1 -- start start 2024-09-21T07:54:49.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.946+0000 7fb3a6f6c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a0065650 0x7fb3a010c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:49.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.946+0000 7fb3a6f6c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a010ce60 con 0x7fb3a0065650 2024-09-21T07:54:49.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.946+0000 7fb3a4d08640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a0065650 0x7fb3a010c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:49.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.946+0000 7fb3a4d08640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a0065650 0x7fb3a010c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54458/0 (socket says 172.21.15.107:54458) 2024-09-21T07:54:49.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.946+0000 7fb3a4d08640 1 -- 172.21.15.107:0/1077281856 learned_addr learned my addr 172.21.15.107:0/1077281856 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:49.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.946+0000 7fb3a4d08640 1 -- 172.21.15.107:0/1077281856 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb394005040 con 0x7fb3a0065650 2024-09-21T07:54:49.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.947+0000 7fb3a4d08640 1 --2- 172.21.15.107:0/1077281856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a0065650 0x7fb3a010c920 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb39402a6d0 tx=0x7fb394009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:49.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.947+0000 7fb39d7fa640 1 -- 172.21.15.107:0/1077281856 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb394033630 con 0x7fb3a0065650 2024-09-21T07:54:49.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.947+0000 7fb39d7fa640 1 -- 172.21.15.107:0/1077281856 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb394033c30 con 0x7fb3a0065650 2024-09-21T07:54:49.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.947+0000 7fb3a6f6c640 1 -- 172.21.15.107:0/1077281856 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a010d060 con 0x7fb3a0065650 2024-09-21T07:54:49.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.947+0000 7fb39d7fa640 1 -- 172.21.15.107:0/1077281856 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb39403dc30 con 0x7fb3a0065650 2024-09-21T07:54:49.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.947+0000 7fb3a6f6c640 1 -- 172.21.15.107:0/1077281856 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a010d4d0 con 0x7fb3a0065650 2024-09-21T07:54:49.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.948+0000 7fb39d7fa640 1 -- 172.21.15.107:0/1077281856 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fb394030020 con 0x7fb3a0065650 2024-09-21T07:54:49.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.948+0000 7fb3a6f6c640 1 -- 172.21.15.107:0/1077281856 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a005ed70 con 0x7fb3a0065650 2024-09-21T07:54:49.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.948+0000 7fb39d7fa640 1 --2- 172.21.15.107:0/1077281856 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fb390039580 0x7fb39003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:49.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.948+0000 7fb39d7fa640 1 -- 172.21.15.107:0/1077281856 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb39406cb90 con 0x7fb3a0065650 2024-09-21T07:54:49.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.948+0000 7fb39ffff640 1 --2- 172.21.15.107:0/1077281856 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fb390039580 0x7fb39003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:49.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.949+0000 7fb39ffff640 1 --2- 172.21.15.107:0/1077281856 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fb390039580 0x7fb39003ba30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb38c006fd0 tx=0x7fb38c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:49.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:48.953+0000 7fb39d7fa640 1 -- 172.21.15.107:0/1077281856 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb39403bb50 con 0x7fb3a0065650 2024-09-21T07:54:49.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:49.119+0000 7fb3a6f6c640 1 -- 172.21.15.107:0/1077281856 --> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3a010d4d0 con 0x7fb390039580 2024-09-21T07:54:49.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:49.121+0000 7fb39d7fa640 1 -- 172.21.15.107:0/1077281856 <== mgr.14160 v2:172.21.15.107:6800/2850161381 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7fb3a010d4d0 con 0x7fb390039580 2024-09-21T07:54:49.122 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:54:49.122 INFO:teuthology.orchestra.run.smithi107.stdout:[{"addr": "172.21.15.107", "hostname": "smithi107", "labels": [], "status": ""}, {"addr": "172.21.15.129", "hostname": "smithi129", "labels": [], "status": ""}] 2024-09-21T07:54:49.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:49.123+0000 7fb3a6f6c640 1 -- 172.21.15.107:0/1077281856 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fb390039580 msgr2=0x7fb39003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:49.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:49.123+0000 7fb3a6f6c640 1 --2- 172.21.15.107:0/1077281856 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fb390039580 0x7fb39003ba30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb38c006fd0 tx=0x7fb38c006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:49.123+0000 7fb3a6f6c640 1 -- 172.21.15.107:0/1077281856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a0065650 msgr2=0x7fb3a010c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:49.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:49.123+0000 7fb3a6f6c640 1 --2- 172.21.15.107:0/1077281856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a0065650 0x7fb3a010c920 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb39402a6d0 tx=0x7fb394009da0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:49.123+0000 7fb3a6f6c640 1 -- 172.21.15.107:0/1077281856 shutdown_connections 2024-09-21T07:54:49.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:49.123+0000 7fb3a6f6c640 1 --2- 172.21.15.107:0/1077281856 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fb390039580 0x7fb39003ba30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:49.123+0000 7fb3a6f6c640 1 --2- 172.21.15.107:0/1077281856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a0065650 0x7fb3a010c920 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:49.123+0000 7fb3a6f6c640 1 -- 172.21.15.107:0/1077281856 >> 172.21.15.107:0/1077281856 conn(0x7fb3a00f6ac0 msgr2=0x7fb3a00f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:49.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:49.123+0000 7fb3a6f6c640 1 -- 172.21.15.107:0/1077281856 shutdown_connections 2024-09-21T07:54:49.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:49.123+0000 7fb3a6f6c640 1 -- 172.21.15.107:0/1077281856 wait complete. 2024-09-21T07:54:49.727 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:49 smithi107 ceph-mon[27622]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:54:49.728 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:49 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:50.107 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T07:54:50.108 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph osd crush tunables default 2024-09-21T07:54:50.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:50 smithi107 ceph-mon[27622]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:54:50.863 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:54:51.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:51 smithi107 ceph-mon[27622]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:54:53.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.429+0000 7f765ef07640 1 -- 172.21.15.107:0/3549739244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76580655d0 msgr2=0x7f76580ff070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:53.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.429+0000 7f765ef07640 1 --2- 172.21.15.107:0/3549739244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76580655d0 0x7f76580ff070 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7648004850 tx=0x7f7648009da0 comp rx=0 tx=0).stop 2024-09-21T07:54:53.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.429+0000 7f765ef07640 1 -- 172.21.15.107:0/3549739244 shutdown_connections 2024-09-21T07:54:53.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.429+0000 7f765ef07640 1 --2- 172.21.15.107:0/3549739244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76580655d0 0x7f76580ff070 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:53.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.429+0000 7f765ef07640 1 -- 172.21.15.107:0/3549739244 >> 172.21.15.107:0/3549739244 conn(0x7f76580f6ac0 msgr2=0x7f76580f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:53.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.430+0000 7f765ef07640 1 -- 172.21.15.107:0/3549739244 shutdown_connections 2024-09-21T07:54:53.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.430+0000 7f765ef07640 1 -- 172.21.15.107:0/3549739244 wait complete. 2024-09-21T07:54:53.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.430+0000 7f765ef07640 1 Processor -- start 2024-09-21T07:54:53.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.430+0000 7f765ef07640 1 -- start start 2024-09-21T07:54:53.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.430+0000 7f765ef07640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76580655d0 0x7f76580fc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:53.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.430+0000 7f765ef07640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76580fcee0 con 0x7f76580655d0 2024-09-21T07:54:53.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.430+0000 7f765cca3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76580655d0 0x7f76580fc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:53.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.430+0000 7f765cca3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76580655d0 0x7f76580fc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47690/0 (socket says 172.21.15.107:47690) 2024-09-21T07:54:53.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.430+0000 7f765cca3640 1 -- 172.21.15.107:0/1941663886 learned_addr learned my addr 172.21.15.107:0/1941663886 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:54:53.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.431+0000 7f765cca3640 1 -- 172.21.15.107:0/1941663886 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7648005040 con 0x7f76580655d0 2024-09-21T07:54:53.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.431+0000 7f765cca3640 1 --2- 172.21.15.107:0/1941663886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76580655d0 0x7f76580fc9a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f764802a6d0 tx=0x7f7648009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:53.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.431+0000 7f76557fa640 1 -- 172.21.15.107:0/1941663886 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7648033630 con 0x7f76580655d0 2024-09-21T07:54:53.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.431+0000 7f765ef07640 1 -- 172.21.15.107:0/1941663886 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76580faf70 con 0x7f76580655d0 2024-09-21T07:54:53.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.431+0000 7f76557fa640 1 -- 172.21.15.107:0/1941663886 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7648033c30 con 0x7f76580655d0 2024-09-21T07:54:53.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.431+0000 7f76557fa640 1 -- 172.21.15.107:0/1941663886 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f764803dc30 con 0x7f76580655d0 2024-09-21T07:54:53.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.431+0000 7f765ef07640 1 -- 172.21.15.107:0/1941663886 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76580fb3e0 con 0x7f76580655d0 2024-09-21T07:54:53.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.432+0000 7f76557fa640 1 -- 172.21.15.107:0/1941663886 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f7648030020 con 0x7f76580655d0 2024-09-21T07:54:53.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.432+0000 7f76557fa640 1 --2- 172.21.15.107:0/1941663886 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f7640039580 0x7f764003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:53.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.432+0000 7f765ef07640 1 -- 172.21.15.107:0/1941663886 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7658102810 con 0x7f76580655d0 2024-09-21T07:54:53.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.432+0000 7f76557fa640 1 -- 172.21.15.107:0/1941663886 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f764806caa0 con 0x7f76580655d0 2024-09-21T07:54:53.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.432+0000 7f7657fff640 1 --2- 172.21.15.107:0/1941663886 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f7640039580 0x7f764003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:53.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.432+0000 7f7657fff640 1 --2- 172.21.15.107:0/1941663886 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f7640039580 0x7f764003ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f764c006fd0 tx=0x7f764c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:53.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.437+0000 7f76557fa640 1 -- 172.21.15.107:0/1941663886 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7648033790 con 0x7f76580655d0 2024-09-21T07:54:53.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:53.601+0000 7f765ef07640 1 -- 172.21.15.107:0/1941663886 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f765805ed70 con 0x7f76580655d0 2024-09-21T07:54:53.603 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:53 smithi107 ceph-mon[27622]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:54:54.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:54.379+0000 7f76557fa640 1 -- 172.21.15.107:0/1941663886 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7648031330 con 0x7f76580655d0 2024-09-21T07:54:54.382 INFO:teuthology.orchestra.run.smithi107.stderr:adjusted tunables profile to default 2024-09-21T07:54:54.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:54.381+0000 7f765ef07640 1 -- 172.21.15.107:0/1941663886 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f7640039580 msgr2=0x7f764003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:54.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:54.381+0000 7f765ef07640 1 --2- 172.21.15.107:0/1941663886 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f7640039580 0x7f764003ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f764c006fd0 tx=0x7f764c006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:54.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:54.382+0000 7f765ef07640 1 -- 172.21.15.107:0/1941663886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76580655d0 msgr2=0x7f76580fc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:54.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:54.382+0000 7f765ef07640 1 --2- 172.21.15.107:0/1941663886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76580655d0 0x7f76580fc9a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f764802a6d0 tx=0x7f7648009da0 comp rx=0 tx=0).stop 2024-09-21T07:54:54.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:54.382+0000 7f765ef07640 1 -- 172.21.15.107:0/1941663886 shutdown_connections 2024-09-21T07:54:54.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:54.382+0000 7f765ef07640 1 --2- 172.21.15.107:0/1941663886 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f7640039580 0x7f764003ba30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:54.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:54.382+0000 7f765ef07640 1 --2- 172.21.15.107:0/1941663886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76580655d0 0x7f76580fc9a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:54.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:54.382+0000 7f765ef07640 1 -- 172.21.15.107:0/1941663886 >> 172.21.15.107:0/1941663886 conn(0x7f76580f6ac0 msgr2=0x7f76580f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:54.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:54.382+0000 7f765ef07640 1 -- 172.21.15.107:0/1941663886 shutdown_connections 2024-09-21T07:54:54.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:54:54.382+0000 7f765ef07640 1 -- 172.21.15.107:0/1941663886 wait complete. 2024-09-21T07:54:54.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:54 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1941663886' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-21T07:54:55.699 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:55 smithi107 ceph-mon[27622]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:54:55.699 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:55 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1941663886' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T07:54:55.699 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:55 smithi107 ceph-mon[27622]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:54:55.945 INFO:tasks.cephadm:Adding mon.smithi107 on smithi107 2024-09-21T07:54:55.945 INFO:tasks.cephadm:Adding mon.smithi129 on smithi129 2024-09-21T07:54:55.945 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph orch apply mon '2;smithi107:172.21.15.107=smithi107;smithi129:172.21.15.129=smithi129' 2024-09-21T07:54:56.296 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:54:56.341 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:54:57.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.819+0000 7f9fe2291640 1 -- 172.21.15.129:0/3617462625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fdc0fc1d0 msgr2=0x7f9fdc0fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:57.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.819+0000 7f9fe2291640 1 --2- 172.21.15.129:0/3617462625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fdc0fc1d0 0x7f9fdc0fc5e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc004850 tx=0x7f9fcc009da0 comp rx=0 tx=0).stop 2024-09-21T07:54:57.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.819+0000 7f9fe2291640 1 -- 172.21.15.129:0/3617462625 shutdown_connections 2024-09-21T07:54:57.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.819+0000 7f9fe2291640 1 --2- 172.21.15.129:0/3617462625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fdc0fc1d0 0x7f9fdc0fc5e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:57.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.819+0000 7f9fe2291640 1 -- 172.21.15.129:0/3617462625 >> 172.21.15.129:0/3617462625 conn(0x7f9fdc0f79b0 msgr2=0x7f9fdc0f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:57.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.819+0000 7f9fe2291640 1 -- 172.21.15.129:0/3617462625 shutdown_connections 2024-09-21T07:54:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.819+0000 7f9fe2291640 1 -- 172.21.15.129:0/3617462625 wait complete. 2024-09-21T07:54:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.820+0000 7f9fe2291640 1 Processor -- start 2024-09-21T07:54:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.820+0000 7f9fe2291640 1 -- start start 2024-09-21T07:54:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.820+0000 7f9fe2291640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fdc0fc1d0 0x7f9fdc071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.820+0000 7f9fe2291640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc0719d0 con 0x7f9fdc0fc1d0 2024-09-21T07:54:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.820+0000 7f9fdbfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fdc0fc1d0 0x7f9fdc071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.820+0000 7f9fdbfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fdc0fc1d0 0x7f9fdc071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.129:51508/0 (socket says 172.21.15.129:51508) 2024-09-21T07:54:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.820+0000 7f9fdbfff640 1 -- 172.21.15.129:0/649794773 learned_addr learned my addr 172.21.15.129:0/649794773 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:54:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.821+0000 7f9fdbfff640 1 -- 172.21.15.129:0/649794773 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc005040 con 0x7f9fdc0fc1d0 2024-09-21T07:54:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.821+0000 7f9fdbfff640 1 --2- 172.21.15.129:0/649794773 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fdc0fc1d0 0x7f9fdc071490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc02a6d0 tx=0x7f9fcc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.821+0000 7f9fd97fa640 1 -- 172.21.15.129:0/649794773 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9fcc033630 con 0x7f9fdc0fc1d0 2024-09-21T07:54:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.821+0000 7f9fd97fa640 1 -- 172.21.15.129:0/649794773 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9fcc033c30 con 0x7f9fdc0fc1d0 2024-09-21T07:54:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.821+0000 7f9fe2291640 1 -- 172.21.15.129:0/649794773 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fdc06fa60 con 0x7f9fdc0fc1d0 2024-09-21T07:54:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.821+0000 7f9fd97fa640 1 -- 172.21.15.129:0/649794773 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9fcc03dc00 con 0x7f9fdc0fc1d0 2024-09-21T07:54:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.821+0000 7f9fe2291640 1 -- 172.21.15.129:0/649794773 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fdc06fed0 con 0x7f9fdc0fc1d0 2024-09-21T07:54:57.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.822+0000 7f9fd97fa640 1 -- 172.21.15.129:0/649794773 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f9fcc030020 con 0x7f9fdc0fc1d0 2024-09-21T07:54:57.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.822+0000 7f9fe2291640 1 -- 172.21.15.129:0/649794773 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fdc1025f0 con 0x7f9fdc0fc1d0 2024-09-21T07:54:57.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.822+0000 7f9fd97fa640 1 --2- 172.21.15.129:0/649794773 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f9fc8039580 0x7f9fc803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:57.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.822+0000 7f9fd97fa640 1 -- 172.21.15.129:0/649794773 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9fcc06cb30 con 0x7f9fdc0fc1d0 2024-09-21T07:54:57.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.824+0000 7f9fd3fff640 1 --2- 172.21.15.129:0/649794773 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f9fc8039580 0x7f9fc803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:57.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.826+0000 7f9fd3fff640 1 --2- 172.21.15.129:0/649794773 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f9fc8039580 0x7f9fc803ba30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4006fd0 tx=0x7f9fc4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:57.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.827+0000 7f9fd97fa640 1 -- 172.21.15.129:0/649794773 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9fcc045800 con 0x7f9fdc0fc1d0 2024-09-21T07:54:57.990 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.989+0000 7f9fe2291640 1 -- 172.21.15.129:0/649794773 --> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi107:172.21.15.107=smithi107;smithi129:172.21.15.129=smithi129", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fdc0701c0 con 0x7f9fc8039580 2024-09-21T07:54:57.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.996+0000 7f9fd97fa640 1 -- 172.21.15.129:0/649794773 <== mgr.14160 v2:172.21.15.107:6800/2850161381 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9fdc0701c0 con 0x7f9fc8039580 2024-09-21T07:54:57.998 INFO:teuthology.orchestra.run.smithi129.stdout:Scheduled mon update... 2024-09-21T07:54:58.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.998+0000 7f9fe2291640 1 -- 172.21.15.129:0/649794773 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f9fc8039580 msgr2=0x7f9fc803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:58.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.998+0000 7f9fe2291640 1 --2- 172.21.15.129:0/649794773 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f9fc8039580 0x7f9fc803ba30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4006fd0 tx=0x7f9fc4006db0 comp rx=0 tx=0).stop 2024-09-21T07:54:58.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.998+0000 7f9fe2291640 1 -- 172.21.15.129:0/649794773 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fdc0fc1d0 msgr2=0x7f9fdc071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:58.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.998+0000 7f9fe2291640 1 --2- 172.21.15.129:0/649794773 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fdc0fc1d0 0x7f9fdc071490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc02a6d0 tx=0x7f9fcc009da0 comp rx=0 tx=0).stop 2024-09-21T07:54:58.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.998+0000 7f9fe2291640 1 -- 172.21.15.129:0/649794773 shutdown_connections 2024-09-21T07:54:58.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.998+0000 7f9fe2291640 1 --2- 172.21.15.129:0/649794773 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f9fc8039580 0x7f9fc803ba30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:58.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.998+0000 7f9fe2291640 1 --2- 172.21.15.129:0/649794773 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fdc0fc1d0 0x7f9fdc071490 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:58.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.998+0000 7f9fe2291640 1 -- 172.21.15.129:0/649794773 >> 172.21.15.129:0/649794773 conn(0x7f9fdc0f79b0 msgr2=0x7f9fdc0f8610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:58.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.998+0000 7f9fe2291640 1 -- 172.21.15.129:0/649794773 shutdown_connections 2024-09-21T07:54:58.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:54:57.998+0000 7f9fe2291640 1 -- 172.21.15.129:0/649794773 wait complete. 2024-09-21T07:54:58.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:57 smithi107 ceph-mon[27622]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:54:58.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:57 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:58.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:57 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:58.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:57 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:58.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:57 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:58.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:57 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:58.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:57 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:58.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:57 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T07:54:58.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:57 smithi107 ceph-mon[27622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T07:54:58.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:57 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:58.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:57 smithi107 ceph-mon[27622]: Deploying daemon grafana.smithi107 on smithi107 2024-09-21T07:54:58.600 DEBUG:teuthology.orchestra.run.smithi129:mon.smithi129> sudo journalctl -f -n 0 -u ceph-786d4f32-77ee-11ef-baf6-efdc52797490@mon.smithi129.service 2024-09-21T07:54:58.603 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T07:54:58.603 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:54:58.869 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:54:58.913 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:54:59.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:59 smithi107 ceph-mon[27622]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi107:172.21.15.107=smithi107;smithi129:172.21.15.129=smithi129", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:59.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:59 smithi107 ceph-mon[27622]: Saving service mon spec with placement smithi107:172.21.15.107=smithi107;smithi129:172.21.15.129=smithi129;count:2 2024-09-21T07:54:59.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:59 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:54:59.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:54:59 smithi107 ceph-mon[27622]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:00.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.371+0000 7f2b7a9bc640 1 -- 172.21.15.129:0/4067336699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b740fd820 msgr2=0x7f2b740fdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:00.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.371+0000 7f2b7a9bc640 1 --2- 172.21.15.129:0/4067336699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b740fd820 0x7f2b740fdc30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2b64004850 tx=0x7f2b64009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:00.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.371+0000 7f2b7a9bc640 1 -- 172.21.15.129:0/4067336699 shutdown_connections 2024-09-21T07:55:00.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.371+0000 7f2b7a9bc640 1 --2- 172.21.15.129:0/4067336699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b740fd820 0x7f2b740fdc30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:00.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.371+0000 7f2b7a9bc640 1 -- 172.21.15.129:0/4067336699 >> 172.21.15.129:0/4067336699 conn(0x7f2b740f6040 msgr2=0x7f2b740f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:00.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.371+0000 7f2b7a9bc640 1 -- 172.21.15.129:0/4067336699 shutdown_connections 2024-09-21T07:55:00.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.371+0000 7f2b7a9bc640 1 -- 172.21.15.129:0/4067336699 wait complete. 2024-09-21T07:55:00.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.371+0000 7f2b7a9bc640 1 Processor -- start 2024-09-21T07:55:00.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.372+0000 7f2b7a9bc640 1 -- start start 2024-09-21T07:55:00.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.372+0000 7f2b7a9bc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b740fd820 0x7f2b7410c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:00.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.372+0000 7f2b7a9bc640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7410cc20 con 0x7f2b740fd820 2024-09-21T07:55:00.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.373+0000 7f2b73fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b740fd820 0x7f2b7410c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:00.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.373+0000 7f2b73fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b740fd820 0x7f2b7410c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.129:56858/0 (socket says 172.21.15.129:56858) 2024-09-21T07:55:00.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.373+0000 7f2b73fff640 1 -- 172.21.15.129:0/1362236125 learned_addr learned my addr 172.21.15.129:0/1362236125 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:55:00.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.373+0000 7f2b73fff640 1 -- 172.21.15.129:0/1362236125 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b64005040 con 0x7f2b740fd820 2024-09-21T07:55:00.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.374+0000 7f2b73fff640 1 --2- 172.21.15.129:0/1362236125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b740fd820 0x7f2b7410c6e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009920 tx=0x7f2b64009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:00.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.374+0000 7f2b70ff9640 1 -- 172.21.15.129:0/1362236125 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b64033630 con 0x7f2b740fd820 2024-09-21T07:55:00.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.374+0000 7f2b70ff9640 1 -- 172.21.15.129:0/1362236125 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2b64033c30 con 0x7f2b740fd820 2024-09-21T07:55:00.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.374+0000 7f2b7a9bc640 1 -- 172.21.15.129:0/1362236125 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7410ce20 con 0x7f2b740fd820 2024-09-21T07:55:00.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.374+0000 7f2b70ff9640 1 -- 172.21.15.129:0/1362236125 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b6403dc40 con 0x7f2b740fd820 2024-09-21T07:55:00.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.374+0000 7f2b7a9bc640 1 -- 172.21.15.129:0/1362236125 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7410d290 con 0x7f2b740fd820 2024-09-21T07:55:00.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.375+0000 7f2b7a9bc640 1 -- 172.21.15.129:0/1362236125 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7405ed70 con 0x7f2b740fd820 2024-09-21T07:55:00.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.376+0000 7f2b70ff9640 1 -- 172.21.15.129:0/1362236125 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f2b64030020 con 0x7f2b740fd820 2024-09-21T07:55:00.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.376+0000 7f2b70ff9640 1 --2- 172.21.15.129:0/1362236125 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f2b5c0395d0 0x7f2b5c03ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:00.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.376+0000 7f2b70ff9640 1 -- 172.21.15.129:0/1362236125 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2b6406cad0 con 0x7f2b740fd820 2024-09-21T07:55:00.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.378+0000 7f2b737fe640 1 --2- 172.21.15.129:0/1362236125 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f2b5c0395d0 0x7f2b5c03ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:00.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.380+0000 7f2b737fe640 1 --2- 172.21.15.129:0/1362236125 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f2b5c0395d0 0x7f2b5c03ba80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2b68006fd0 tx=0x7f2b68006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:00.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.382+0000 7f2b70ff9640 1 -- 172.21.15.129:0/1362236125 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2b64033790 con 0x7f2b740fd820 2024-09-21T07:55:00.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.598+0000 7f2b7a9bc640 1 -- 172.21.15.129:0/1362236125 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2b7404b720 con 0x7f2b740fd820 2024-09-21T07:55:00.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.599+0000 7f2b70ff9640 1 -- 172.21.15.129:0/1362236125 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f2b64039270 con 0x7f2b740fd820 2024-09-21T07:55:00.601 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:55:00.601 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":1,"fsid":"786d4f32-77ee-11ef-baf6-efdc52797490","modified":"2024-09-21T07:53:19.696564Z","created":"2024-09-21T07:53:19.696564Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi107","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T07:55:00.601 INFO:teuthology.orchestra.run.smithi129.stderr:dumped monmap epoch 1 2024-09-21T07:55:00.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.601+0000 7f2b7a9bc640 1 -- 172.21.15.129:0/1362236125 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f2b5c0395d0 msgr2=0x7f2b5c03ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:00.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.601+0000 7f2b7a9bc640 1 --2- 172.21.15.129:0/1362236125 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f2b5c0395d0 0x7f2b5c03ba80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2b68006fd0 tx=0x7f2b68006db0 comp rx=0 tx=0).stop 2024-09-21T07:55:00.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.601+0000 7f2b7a9bc640 1 -- 172.21.15.129:0/1362236125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b740fd820 msgr2=0x7f2b7410c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:00.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.601+0000 7f2b7a9bc640 1 --2- 172.21.15.129:0/1362236125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b740fd820 0x7f2b7410c6e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009920 tx=0x7f2b64009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:00.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.601+0000 7f2b7a9bc640 1 -- 172.21.15.129:0/1362236125 shutdown_connections 2024-09-21T07:55:00.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.601+0000 7f2b7a9bc640 1 --2- 172.21.15.129:0/1362236125 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f2b5c0395d0 0x7f2b5c03ba80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:00.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.601+0000 7f2b7a9bc640 1 --2- 172.21.15.129:0/1362236125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b740fd820 0x7f2b7410c6e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:00.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.601+0000 7f2b7a9bc640 1 -- 172.21.15.129:0/1362236125 >> 172.21.15.129:0/1362236125 conn(0x7f2b740f6040 msgr2=0x7f2b740f6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:00.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.601+0000 7f2b7a9bc640 1 -- 172.21.15.129:0/1362236125 shutdown_connections 2024-09-21T07:55:00.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:00.601+0000 7f2b7a9bc640 1 -- 172.21.15.129:0/1362236125 wait complete. 2024-09-21T07:55:00.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:00 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:01.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:01 smithi107 ceph-mon[27622]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:01.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:01 smithi107 ceph-mon[27622]: from='client.? 172.21.15.129:0/1362236125' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T07:55:02.153 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T07:55:02.154 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:55:02.394 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:55:02.437 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:55:03.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.720+0000 7f75727bb640 1 -- 172.21.15.129:0/2467559520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f756c0fb2e0 msgr2=0x7f756c0fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:03.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.720+0000 7f75727bb640 1 --2- 172.21.15.129:0/2467559520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f756c0fb2e0 0x7f756c0fb6f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f755c004850 tx=0x7f755c009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:03.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.720+0000 7f75727bb640 1 -- 172.21.15.129:0/2467559520 shutdown_connections 2024-09-21T07:55:03.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.720+0000 7f75727bb640 1 --2- 172.21.15.129:0/2467559520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f756c0fb2e0 0x7f756c0fb6f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:03.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.720+0000 7f75727bb640 1 -- 172.21.15.129:0/2467559520 >> 172.21.15.129:0/2467559520 conn(0x7f756c0f6ac0 msgr2=0x7f756c0f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:03.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.720+0000 7f75727bb640 1 -- 172.21.15.129:0/2467559520 shutdown_connections 2024-09-21T07:55:03.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.720+0000 7f75727bb640 1 -- 172.21.15.129:0/2467559520 wait complete. 2024-09-21T07:55:03.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.720+0000 7f75727bb640 1 Processor -- start 2024-09-21T07:55:03.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.720+0000 7f75727bb640 1 -- start start 2024-09-21T07:55:03.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.721+0000 7f75727bb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f756c0fb2e0 0x7f756c10c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:03.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.721+0000 7f75727bb640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756c10ce40 con 0x7f756c0fb2e0 2024-09-21T07:55:03.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.721+0000 7f756bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f756c0fb2e0 0x7f756c10c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:03.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.721+0000 7f756bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f756c0fb2e0 0x7f756c10c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.129:56882/0 (socket says 172.21.15.129:56882) 2024-09-21T07:55:03.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.721+0000 7f756bfff640 1 -- 172.21.15.129:0/3460432833 learned_addr learned my addr 172.21.15.129:0/3460432833 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:55:03.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.721+0000 7f756bfff640 1 -- 172.21.15.129:0/3460432833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c005040 con 0x7f756c0fb2e0 2024-09-21T07:55:03.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.721+0000 7f756bfff640 1 --2- 172.21.15.129:0/3460432833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f756c0fb2e0 0x7f756c10c900 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f755c02a6d0 tx=0x7f755c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:03.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.721+0000 7f7568ff9640 1 -- 172.21.15.129:0/3460432833 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f755c033630 con 0x7f756c0fb2e0 2024-09-21T07:55:03.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.721+0000 7f7568ff9640 1 -- 172.21.15.129:0/3460432833 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f755c033c30 con 0x7f756c0fb2e0 2024-09-21T07:55:03.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.721+0000 7f75727bb640 1 -- 172.21.15.129:0/3460432833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f756c10d040 con 0x7f756c0fb2e0 2024-09-21T07:55:03.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.722+0000 7f7568ff9640 1 -- 172.21.15.129:0/3460432833 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f755c03dc00 con 0x7f756c0fb2e0 2024-09-21T07:55:03.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.722+0000 7f75727bb640 1 -- 172.21.15.129:0/3460432833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756c10d4b0 con 0x7f756c0fb2e0 2024-09-21T07:55:03.725 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.722+0000 7f7568ff9640 1 -- 172.21.15.129:0/3460432833 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f755c030020 con 0x7f756c0fb2e0 2024-09-21T07:55:03.725 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.722+0000 7f75727bb640 1 -- 172.21.15.129:0/3460432833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f756c05ed70 con 0x7f756c0fb2e0 2024-09-21T07:55:03.725 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.722+0000 7f7568ff9640 1 --2- 172.21.15.129:0/3460432833 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f7558039580 0x7f755803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:03.725 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.723+0000 7f7568ff9640 1 -- 172.21.15.129:0/3460432833 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f755c06c970 con 0x7f756c0fb2e0 2024-09-21T07:55:03.726 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.723+0000 7f756b7fe640 1 --2- 172.21.15.129:0/3460432833 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f7558039580 0x7f755803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:03.726 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.723+0000 7f756b7fe640 1 --2- 172.21.15.129:0/3460432833 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f7558039580 0x7f755803ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7554006fd0 tx=0x7f7554006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:03.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.728+0000 7f7568ff9640 1 -- 172.21.15.129:0/3460432833 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f755c03bb50 con 0x7f756c0fb2e0 2024-09-21T07:55:03.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:03 smithi107 ceph-mon[27622]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:03.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.942+0000 7f75727bb640 1 -- 172.21.15.129:0/3460432833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f756c04b720 con 0x7f756c0fb2e0 2024-09-21T07:55:03.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.942+0000 7f7568ff9640 1 -- 172.21.15.129:0/3460432833 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f755c042210 con 0x7f756c0fb2e0 2024-09-21T07:55:03.944 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:55:03.944 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":1,"fsid":"786d4f32-77ee-11ef-baf6-efdc52797490","modified":"2024-09-21T07:53:19.696564Z","created":"2024-09-21T07:53:19.696564Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi107","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T07:55:03.944 INFO:teuthology.orchestra.run.smithi129.stderr:dumped monmap epoch 1 2024-09-21T07:55:03.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.944+0000 7f75727bb640 1 -- 172.21.15.129:0/3460432833 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f7558039580 msgr2=0x7f755803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:03.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.944+0000 7f75727bb640 1 --2- 172.21.15.129:0/3460432833 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f7558039580 0x7f755803ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7554006fd0 tx=0x7f7554006db0 comp rx=0 tx=0).stop 2024-09-21T07:55:03.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.944+0000 7f75727bb640 1 -- 172.21.15.129:0/3460432833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f756c0fb2e0 msgr2=0x7f756c10c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:03.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.944+0000 7f75727bb640 1 --2- 172.21.15.129:0/3460432833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f756c0fb2e0 0x7f756c10c900 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f755c02a6d0 tx=0x7f755c009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:03.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.944+0000 7f75727bb640 1 -- 172.21.15.129:0/3460432833 shutdown_connections 2024-09-21T07:55:03.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.944+0000 7f75727bb640 1 --2- 172.21.15.129:0/3460432833 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f7558039580 0x7f755803ba30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:03.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.944+0000 7f75727bb640 1 --2- 172.21.15.129:0/3460432833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f756c0fb2e0 0x7f756c10c900 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:03.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.944+0000 7f75727bb640 1 -- 172.21.15.129:0/3460432833 >> 172.21.15.129:0/3460432833 conn(0x7f756c0f6ac0 msgr2=0x7f756c064990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:03.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.944+0000 7f75727bb640 1 -- 172.21.15.129:0/3460432833 shutdown_connections 2024-09-21T07:55:03.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:03.944+0000 7f75727bb640 1 -- 172.21.15.129:0/3460432833 wait complete. 2024-09-21T07:55:04.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:04 smithi107 ceph-mon[27622]: from='client.? 172.21.15.129:0/3460432833' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T07:55:05.516 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T07:55:05.517 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:55:05.699 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:05 smithi107 ceph-mon[27622]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:05.752 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:55:05.805 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:55:07.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.327+0000 7fc34ff49640 1 -- 172.21.15.129:0/1347369812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3480fb2e0 msgr2=0x7fc3480fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:07.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.327+0000 7fc34ff49640 1 --2- 172.21.15.129:0/1347369812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3480fb2e0 0x7fc3480fb6f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc340004850 tx=0x7fc340009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.327+0000 7fc34ff49640 1 -- 172.21.15.129:0/1347369812 shutdown_connections 2024-09-21T07:55:07.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.327+0000 7fc34ff49640 1 --2- 172.21.15.129:0/1347369812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3480fb2e0 0x7fc3480fb6f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.327+0000 7fc34ff49640 1 -- 172.21.15.129:0/1347369812 >> 172.21.15.129:0/1347369812 conn(0x7fc3480f6ac0 msgr2=0x7fc3480f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:07.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.327+0000 7fc34ff49640 1 -- 172.21.15.129:0/1347369812 shutdown_connections 2024-09-21T07:55:07.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.327+0000 7fc34ff49640 1 -- 172.21.15.129:0/1347369812 wait complete. 2024-09-21T07:55:07.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.327+0000 7fc34ff49640 1 Processor -- start 2024-09-21T07:55:07.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.327+0000 7fc34ff49640 1 -- start start 2024-09-21T07:55:07.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.327+0000 7fc34ff49640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3480fb2e0 0x7fc3480654d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:07.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.327+0000 7fc34ff49640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34810f660 con 0x7fc3480fb2e0 2024-09-21T07:55:07.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.328+0000 7fc34dce5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3480fb2e0 0x7fc3480654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:07.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.328+0000 7fc34dce5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3480fb2e0 0x7fc3480654d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.129:56888/0 (socket says 172.21.15.129:56888) 2024-09-21T07:55:07.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.328+0000 7fc34dce5640 1 -- 172.21.15.129:0/1337633401 learned_addr learned my addr 172.21.15.129:0/1337633401 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:55:07.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.328+0000 7fc34dce5640 1 -- 172.21.15.129:0/1337633401 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc340005040 con 0x7fc3480fb2e0 2024-09-21T07:55:07.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.328+0000 7fc34dce5640 1 --2- 172.21.15.129:0/1337633401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3480fb2e0 0x7fc3480654d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc34002a6d0 tx=0x7fc340009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:07.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.328+0000 7fc3467fc640 1 -- 172.21.15.129:0/1337633401 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc340033630 con 0x7fc3480fb2e0 2024-09-21T07:55:07.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.328+0000 7fc3467fc640 1 -- 172.21.15.129:0/1337633401 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc340033c30 con 0x7fc3480fb2e0 2024-09-21T07:55:07.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.328+0000 7fc34ff49640 1 -- 172.21.15.129:0/1337633401 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34810f7a0 con 0x7fc3480fb2e0 2024-09-21T07:55:07.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.328+0000 7fc3467fc640 1 -- 172.21.15.129:0/1337633401 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc34003dc00 con 0x7fc3480fb2e0 2024-09-21T07:55:07.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.328+0000 7fc34ff49640 1 -- 172.21.15.129:0/1337633401 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34810fbb0 con 0x7fc3480fb2e0 2024-09-21T07:55:07.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.329+0000 7fc34ff49640 1 -- 172.21.15.129:0/1337633401 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34805ed70 con 0x7fc3480fb2e0 2024-09-21T07:55:07.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.329+0000 7fc3467fc640 1 -- 172.21.15.129:0/1337633401 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fc340030020 con 0x7fc3480fb2e0 2024-09-21T07:55:07.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.330+0000 7fc3467fc640 1 --2- 172.21.15.129:0/1337633401 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fc330039580 0x7fc33003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:07.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.330+0000 7fc3467fc640 1 -- 172.21.15.129:0/1337633401 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc34006cae0 con 0x7fc3480fb2e0 2024-09-21T07:55:07.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.330+0000 7fc34d4e4640 1 --2- 172.21.15.129:0/1337633401 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fc330039580 0x7fc33003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:07.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.330+0000 7fc34d4e4640 1 --2- 172.21.15.129:0/1337633401 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fc330039580 0x7fc33003ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc33c006fd0 tx=0x7fc33c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:07.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.334+0000 7fc3467fc640 1 -- 172.21.15.129:0/1337633401 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc340045800 con 0x7fc3480fb2e0 2024-09-21T07:55:07.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.549+0000 7fc34ff49640 1 -- 172.21.15.129:0/1337633401 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc34804b720 con 0x7fc3480fb2e0 2024-09-21T07:55:07.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.549+0000 7fc3467fc640 1 -- 172.21.15.129:0/1337633401 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fc340045800 con 0x7fc3480fb2e0 2024-09-21T07:55:07.551 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:55:07.552 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":1,"fsid":"786d4f32-77ee-11ef-baf6-efdc52797490","modified":"2024-09-21T07:53:19.696564Z","created":"2024-09-21T07:53:19.696564Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi107","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T07:55:07.552 INFO:teuthology.orchestra.run.smithi129.stderr:dumped monmap epoch 1 2024-09-21T07:55:07.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.551+0000 7fc34ff49640 1 -- 172.21.15.129:0/1337633401 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fc330039580 msgr2=0x7fc33003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:07.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.551+0000 7fc34ff49640 1 --2- 172.21.15.129:0/1337633401 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fc330039580 0x7fc33003ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc33c006fd0 tx=0x7fc33c006db0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.551+0000 7fc34ff49640 1 -- 172.21.15.129:0/1337633401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3480fb2e0 msgr2=0x7fc3480654d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:07.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.551+0000 7fc34ff49640 1 --2- 172.21.15.129:0/1337633401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3480fb2e0 0x7fc3480654d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc34002a6d0 tx=0x7fc340009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.551+0000 7fc34ff49640 1 -- 172.21.15.129:0/1337633401 shutdown_connections 2024-09-21T07:55:07.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.551+0000 7fc34ff49640 1 --2- 172.21.15.129:0/1337633401 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fc330039580 0x7fc33003ba30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.551+0000 7fc34ff49640 1 --2- 172.21.15.129:0/1337633401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3480fb2e0 0x7fc3480654d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.552+0000 7fc34ff49640 1 -- 172.21.15.129:0/1337633401 >> 172.21.15.129:0/1337633401 conn(0x7fc3480f6ac0 msgr2=0x7fc3480f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:07.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.552+0000 7fc34ff49640 1 -- 172.21.15.129:0/1337633401 shutdown_connections 2024-09-21T07:55:07.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:07.552+0000 7fc34ff49640 1 -- 172.21.15.129:0/1337633401 wait complete. 2024-09-21T07:55:07.632 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:07 smithi107 ceph-mon[27622]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:08.540 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:08 smithi107 ceph-mon[27622]: from='client.? 172.21.15.129:0/1337633401' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T07:55:09.171 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T07:55:09.171 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:55:09.405 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:55:09.448 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:55:09.707 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:09 smithi107 ceph-mon[27622]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:09.707 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:09 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:09.707 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:09 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:09.707 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:09 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:09.707 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:09 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:09.708 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:09 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:09.708 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:09 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:09.708 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:09 smithi107 ceph-mon[27622]: Deploying daemon prometheus.smithi107 on smithi107 2024-09-21T07:55:09.708 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:09 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:10.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.893+0000 7f65e90f2640 1 -- 172.21.15.129:0/2876708176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e40655b0 msgr2=0x7f65e40ff090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:10.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.893+0000 7f65e90f2640 1 --2- 172.21.15.129:0/2876708176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e40655b0 0x7f65e40ff090 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f65d4004850 tx=0x7f65d4009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.893+0000 7f65e90f2640 1 -- 172.21.15.129:0/2876708176 shutdown_connections 2024-09-21T07:55:10.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.893+0000 7f65e90f2640 1 --2- 172.21.15.129:0/2876708176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e40655b0 0x7f65e40ff090 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.893+0000 7f65e90f2640 1 -- 172.21.15.129:0/2876708176 >> 172.21.15.129:0/2876708176 conn(0x7f65e40f6ac0 msgr2=0x7f65e40f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:10.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.893+0000 7f65e90f2640 1 -- 172.21.15.129:0/2876708176 shutdown_connections 2024-09-21T07:55:10.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.893+0000 7f65e90f2640 1 -- 172.21.15.129:0/2876708176 wait complete. 2024-09-21T07:55:10.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.893+0000 7f65e90f2640 1 Processor -- start 2024-09-21T07:55:10.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.893+0000 7f65e90f2640 1 -- start start 2024-09-21T07:55:10.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.894+0000 7f65e90f2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e40655b0 0x7f65e410c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:10.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.894+0000 7f65e90f2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e410cee0 con 0x7f65e40655b0 2024-09-21T07:55:10.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.894+0000 7f65e2d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e40655b0 0x7f65e410c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:10.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.894+0000 7f65e2d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e40655b0 0x7f65e410c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.129:58870/0 (socket says 172.21.15.129:58870) 2024-09-21T07:55:10.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.894+0000 7f65e2d9d640 1 -- 172.21.15.129:0/1880997701 learned_addr learned my addr 172.21.15.129:0/1880997701 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:55:10.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.894+0000 7f65e2d9d640 1 -- 172.21.15.129:0/1880997701 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d4005040 con 0x7f65e40655b0 2024-09-21T07:55:10.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.894+0000 7f65e2d9d640 1 --2- 172.21.15.129:0/1880997701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e40655b0 0x7f65e410c9a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f65d402a6d0 tx=0x7f65d4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:10.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.894+0000 7f65cb7fe640 1 -- 172.21.15.129:0/1880997701 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65d4033630 con 0x7f65e40655b0 2024-09-21T07:55:10.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.894+0000 7f65e90f2640 1 -- 172.21.15.129:0/1880997701 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e410d0e0 con 0x7f65e40655b0 2024-09-21T07:55:10.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.894+0000 7f65cb7fe640 1 -- 172.21.15.129:0/1880997701 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f65d4033c30 con 0x7f65e40655b0 2024-09-21T07:55:10.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.894+0000 7f65cb7fe640 1 -- 172.21.15.129:0/1880997701 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65d403dc30 con 0x7f65e40655b0 2024-09-21T07:55:10.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.895+0000 7f65e90f2640 1 -- 172.21.15.129:0/1880997701 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e410d550 con 0x7f65e40655b0 2024-09-21T07:55:10.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.895+0000 7f65e90f2640 1 -- 172.21.15.129:0/1880997701 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e405ed70 con 0x7f65e40655b0 2024-09-21T07:55:10.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.895+0000 7f65cb7fe640 1 -- 172.21.15.129:0/1880997701 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f65d4030020 con 0x7f65e40655b0 2024-09-21T07:55:10.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.896+0000 7f65cb7fe640 1 --2- 172.21.15.129:0/1880997701 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f65cc039580 0x7f65cc03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:10.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.896+0000 7f65cb7fe640 1 -- 172.21.15.129:0/1880997701 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f65d406c930 con 0x7f65e40655b0 2024-09-21T07:55:10.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.896+0000 7f65e259c640 1 --2- 172.21.15.129:0/1880997701 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f65cc039580 0x7f65cc03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:10.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.896+0000 7f65e259c640 1 --2- 172.21.15.129:0/1880997701 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f65cc039580 0x7f65cc03ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f65d8006fd0 tx=0x7f65d8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:10.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:10.901+0000 7f65cb7fe640 1 -- 172.21.15.129:0/1880997701 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f65d4045800 con 0x7f65e40655b0 2024-09-21T07:55:11.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:11.116+0000 7f65e90f2640 1 -- 172.21.15.129:0/1880997701 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f65e404b720 con 0x7f65e40655b0 2024-09-21T07:55:11.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:11.117+0000 7f65cb7fe640 1 -- 172.21.15.129:0/1880997701 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f65d4042210 con 0x7f65e40655b0 2024-09-21T07:55:11.120 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:55:11.120 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":1,"fsid":"786d4f32-77ee-11ef-baf6-efdc52797490","modified":"2024-09-21T07:53:19.696564Z","created":"2024-09-21T07:53:19.696564Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi107","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T07:55:11.120 INFO:teuthology.orchestra.run.smithi129.stderr:dumped monmap epoch 1 2024-09-21T07:55:11.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:11.119+0000 7f65e90f2640 1 -- 172.21.15.129:0/1880997701 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f65cc039580 msgr2=0x7f65cc03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:11.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:11.119+0000 7f65e90f2640 1 --2- 172.21.15.129:0/1880997701 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f65cc039580 0x7f65cc03ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f65d8006fd0 tx=0x7f65d8006db0 comp rx=0 tx=0).stop 2024-09-21T07:55:11.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:11.119+0000 7f65e90f2640 1 -- 172.21.15.129:0/1880997701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e40655b0 msgr2=0x7f65e410c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:11.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:11.119+0000 7f65e90f2640 1 --2- 172.21.15.129:0/1880997701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e40655b0 0x7f65e410c9a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f65d402a6d0 tx=0x7f65d4009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:11.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:11.119+0000 7f65e90f2640 1 -- 172.21.15.129:0/1880997701 shutdown_connections 2024-09-21T07:55:11.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:11.119+0000 7f65e90f2640 1 --2- 172.21.15.129:0/1880997701 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f65cc039580 0x7f65cc03ba30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:11.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:11.119+0000 7f65e90f2640 1 --2- 172.21.15.129:0/1880997701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e40655b0 0x7f65e410c9a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:11.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:11.119+0000 7f65e90f2640 1 -- 172.21.15.129:0/1880997701 >> 172.21.15.129:0/1880997701 conn(0x7f65e40f6ac0 msgr2=0x7f65e40f73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:11.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:11.119+0000 7f65e90f2640 1 -- 172.21.15.129:0/1880997701 shutdown_connections 2024-09-21T07:55:11.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:11.119+0000 7f65e90f2640 1 -- 172.21.15.129:0/1880997701 wait complete. 2024-09-21T07:55:11.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:11 smithi107 ceph-mon[27622]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:11.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:11 smithi107 ceph-mon[27622]: from='client.? 172.21.15.129:0/1880997701' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T07:55:12.707 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T07:55:12.707 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:55:12.946 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:55:12.989 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:55:13.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:13 smithi107 ceph-mon[27622]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:14.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.489+0000 7ff3a08ee640 1 -- 172.21.15.129:0/661530724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff39c0fb0d0 msgr2=0x7ff39c0fb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:14.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.489+0000 7ff3a08ee640 1 --2- 172.21.15.129:0/661530724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff39c0fb0d0 0x7ff39c0fb4e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff38c004850 tx=0x7ff38c009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.490+0000 7ff3a08ee640 1 -- 172.21.15.129:0/661530724 shutdown_connections 2024-09-21T07:55:14.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.490+0000 7ff3a08ee640 1 --2- 172.21.15.129:0/661530724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff39c0fb0d0 0x7ff39c0fb4e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.490+0000 7ff3a08ee640 1 -- 172.21.15.129:0/661530724 >> 172.21.15.129:0/661530724 conn(0x7ff39c0f6890 msgr2=0x7ff39c0f8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:14.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.490+0000 7ff3a08ee640 1 -- 172.21.15.129:0/661530724 shutdown_connections 2024-09-21T07:55:14.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.490+0000 7ff3a08ee640 1 -- 172.21.15.129:0/661530724 wait complete. 2024-09-21T07:55:14.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.490+0000 7ff3a08ee640 1 Processor -- start 2024-09-21T07:55:14.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.490+0000 7ff3a08ee640 1 -- start start 2024-09-21T07:55:14.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.490+0000 7ff3a08ee640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff39c0fb0d0 0x7ff39c066080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:14.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.490+0000 7ff3a08ee640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c10f3f0 con 0x7ff39c0fb0d0 2024-09-21T07:55:14.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.491+0000 7ff39a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff39c0fb0d0 0x7ff39c066080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:14.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.491+0000 7ff39a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff39c0fb0d0 0x7ff39c066080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.129:58882/0 (socket says 172.21.15.129:58882) 2024-09-21T07:55:14.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.491+0000 7ff39a59c640 1 -- 172.21.15.129:0/2730437617 learned_addr learned my addr 172.21.15.129:0/2730437617 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:55:14.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.491+0000 7ff39a59c640 1 -- 172.21.15.129:0/2730437617 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c005040 con 0x7ff39c0fb0d0 2024-09-21T07:55:14.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.491+0000 7ff39a59c640 1 --2- 172.21.15.129:0/2730437617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff39c0fb0d0 0x7ff39c066080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff38c02a6d0 tx=0x7ff38c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:14.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.491+0000 7ff38affd640 1 -- 172.21.15.129:0/2730437617 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff38c033630 con 0x7ff39c0fb0d0 2024-09-21T07:55:14.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.491+0000 7ff38affd640 1 -- 172.21.15.129:0/2730437617 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff38c033c30 con 0x7ff39c0fb0d0 2024-09-21T07:55:14.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.491+0000 7ff3a08ee640 1 -- 172.21.15.129:0/2730437617 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39c10f530 con 0x7ff39c0fb0d0 2024-09-21T07:55:14.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.491+0000 7ff38affd640 1 -- 172.21.15.129:0/2730437617 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff38c03dc00 con 0x7ff39c0fb0d0 2024-09-21T07:55:14.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.491+0000 7ff3a08ee640 1 -- 172.21.15.129:0/2730437617 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39c10f9a0 con 0x7ff39c0fb0d0 2024-09-21T07:55:14.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.492+0000 7ff3a08ee640 1 -- 172.21.15.129:0/2730437617 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff39c05ed70 con 0x7ff39c0fb0d0 2024-09-21T07:55:14.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.492+0000 7ff38affd640 1 -- 172.21.15.129:0/2730437617 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7ff38c030020 con 0x7ff39c0fb0d0 2024-09-21T07:55:14.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.492+0000 7ff38affd640 1 --2- 172.21.15.129:0/2730437617 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7ff384039580 0x7ff38403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:14.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.493+0000 7ff38affd640 1 -- 172.21.15.129:0/2730437617 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff38c06cb30 con 0x7ff39c0fb0d0 2024-09-21T07:55:14.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.494+0000 7ff399d9b640 1 --2- 172.21.15.129:0/2730437617 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7ff384039580 0x7ff38403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:14.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.494+0000 7ff399d9b640 1 --2- 172.21.15.129:0/2730437617 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7ff384039580 0x7ff38403ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff390006fd0 tx=0x7ff390006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:14.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.498+0000 7ff38affd640 1 -- 172.21.15.129:0/2730437617 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff38c045800 con 0x7ff39c0fb0d0 2024-09-21T07:55:14.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.710+0000 7ff3a08ee640 1 -- 172.21.15.129:0/2730437617 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff39c105780 con 0x7ff39c0fb0d0 2024-09-21T07:55:14.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.711+0000 7ff38affd640 1 -- 172.21.15.129:0/2730437617 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7ff38c042210 con 0x7ff39c0fb0d0 2024-09-21T07:55:14.714 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:55:14.714 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":1,"fsid":"786d4f32-77ee-11ef-baf6-efdc52797490","modified":"2024-09-21T07:53:19.696564Z","created":"2024-09-21T07:53:19.696564Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi107","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T07:55:14.714 INFO:teuthology.orchestra.run.smithi129.stderr:dumped monmap epoch 1 2024-09-21T07:55:14.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.713+0000 7ff3a08ee640 1 -- 172.21.15.129:0/2730437617 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7ff384039580 msgr2=0x7ff38403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:14.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.713+0000 7ff3a08ee640 1 --2- 172.21.15.129:0/2730437617 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7ff384039580 0x7ff38403ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff390006fd0 tx=0x7ff390006db0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.713+0000 7ff3a08ee640 1 -- 172.21.15.129:0/2730437617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff39c0fb0d0 msgr2=0x7ff39c066080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:14.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.713+0000 7ff3a08ee640 1 --2- 172.21.15.129:0/2730437617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff39c0fb0d0 0x7ff39c066080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff38c02a6d0 tx=0x7ff38c009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.713+0000 7ff3a08ee640 1 -- 172.21.15.129:0/2730437617 shutdown_connections 2024-09-21T07:55:14.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.713+0000 7ff3a08ee640 1 --2- 172.21.15.129:0/2730437617 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7ff384039580 0x7ff38403ba30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.713+0000 7ff3a08ee640 1 --2- 172.21.15.129:0/2730437617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff39c0fb0d0 0x7ff39c066080 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.713+0000 7ff3a08ee640 1 -- 172.21.15.129:0/2730437617 >> 172.21.15.129:0/2730437617 conn(0x7ff39c0f6890 msgr2=0x7ff39c0f70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:14.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.713+0000 7ff3a08ee640 1 -- 172.21.15.129:0/2730437617 shutdown_connections 2024-09-21T07:55:14.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:14.713+0000 7ff3a08ee640 1 -- 172.21.15.129:0/2730437617 wait complete. 2024-09-21T07:55:15.715 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:15 smithi107 ceph-mon[27622]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:15.716 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:15 smithi107 ceph-mon[27622]: from='client.? 172.21.15.129:0/2730437617' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T07:55:16.311 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T07:55:16.311 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:55:16.548 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:55:16.591 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:55:17.526 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:17 smithi107 ceph-mon[27622]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:18.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.057+0000 7fa9a9de7640 1 -- 172.21.15.129:0/3695683433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9a40fb2e0 msgr2=0x7fa9a40fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:18.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.057+0000 7fa9a9de7640 1 --2- 172.21.15.129:0/3695683433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9a40fb2e0 0x7fa9a40fb6f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa994004850 tx=0x7fa994009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:18.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.057+0000 7fa9a9de7640 1 -- 172.21.15.129:0/3695683433 shutdown_connections 2024-09-21T07:55:18.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.057+0000 7fa9a9de7640 1 --2- 172.21.15.129:0/3695683433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9a40fb2e0 0x7fa9a40fb6f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:18.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.057+0000 7fa9a9de7640 1 -- 172.21.15.129:0/3695683433 >> 172.21.15.129:0/3695683433 conn(0x7fa9a40f6ac0 msgr2=0x7fa9a40f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:18.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.057+0000 7fa9a9de7640 1 -- 172.21.15.129:0/3695683433 shutdown_connections 2024-09-21T07:55:18.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.057+0000 7fa9a9de7640 1 -- 172.21.15.129:0/3695683433 wait complete. 2024-09-21T07:55:18.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.058+0000 7fa9a9de7640 1 Processor -- start 2024-09-21T07:55:18.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.058+0000 7fa9a9de7640 1 -- start start 2024-09-21T07:55:18.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.058+0000 7fa9a9de7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9a40fb2e0 0x7fa9a4065530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:18.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.058+0000 7fa9a9de7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a410f600 con 0x7fa9a40fb2e0 2024-09-21T07:55:18.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.058+0000 7fa9a37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9a40fb2e0 0x7fa9a4065530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:18.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.058+0000 7fa9a37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9a40fb2e0 0x7fa9a4065530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.129:58902/0 (socket says 172.21.15.129:58902) 2024-09-21T07:55:18.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.058+0000 7fa9a37fe640 1 -- 172.21.15.129:0/1838236396 learned_addr learned my addr 172.21.15.129:0/1838236396 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:55:18.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.059+0000 7fa9a37fe640 1 -- 172.21.15.129:0/1838236396 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa994005040 con 0x7fa9a40fb2e0 2024-09-21T07:55:18.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.059+0000 7fa9a37fe640 1 --2- 172.21.15.129:0/1838236396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9a40fb2e0 0x7fa9a4065530 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa994009920 tx=0x7fa994009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:18.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.059+0000 7fa99bfff640 1 -- 172.21.15.129:0/1838236396 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa994033630 con 0x7fa9a40fb2e0 2024-09-21T07:55:18.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.059+0000 7fa99bfff640 1 -- 172.21.15.129:0/1838236396 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa994033c30 con 0x7fa9a40fb2e0 2024-09-21T07:55:18.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.059+0000 7fa9a9de7640 1 -- 172.21.15.129:0/1838236396 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a410f740 con 0x7fa9a40fb2e0 2024-09-21T07:55:18.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.059+0000 7fa99bfff640 1 -- 172.21.15.129:0/1838236396 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa99403dc40 con 0x7fa9a40fb2e0 2024-09-21T07:55:18.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.059+0000 7fa9a9de7640 1 -- 172.21.15.129:0/1838236396 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a410fbb0 con 0x7fa9a40fb2e0 2024-09-21T07:55:18.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.060+0000 7fa99bfff640 1 -- 172.21.15.129:0/1838236396 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fa994030020 con 0x7fa9a40fb2e0 2024-09-21T07:55:18.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.060+0000 7fa9a9de7640 1 -- 172.21.15.129:0/1838236396 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a4101700 con 0x7fa9a40fb2e0 2024-09-21T07:55:18.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.060+0000 7fa99bfff640 1 --2- 172.21.15.129:0/1838236396 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fa9900395d0 0x7fa99003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:18.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.061+0000 7fa99bfff640 1 -- 172.21.15.129:0/1838236396 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa99406c990 con 0x7fa9a40fb2e0 2024-09-21T07:55:18.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.061+0000 7fa9a2ffd640 1 --2- 172.21.15.129:0/1838236396 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fa9900395d0 0x7fa99003ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:18.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.061+0000 7fa9a2ffd640 1 --2- 172.21.15.129:0/1838236396 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fa9900395d0 0x7fa99003ba80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa98c006fd0 tx=0x7fa98c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:18.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.065+0000 7fa99bfff640 1 -- 172.21.15.129:0/1838236396 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa994033da0 con 0x7fa9a40fb2e0 2024-09-21T07:55:18.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.280+0000 7fa9a9de7640 1 -- 172.21.15.129:0/1838236396 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa9a405ed90 con 0x7fa9a40fb2e0 2024-09-21T07:55:18.282 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.280+0000 7fa99bfff640 1 -- 172.21.15.129:0/1838236396 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fa994045800 con 0x7fa9a40fb2e0 2024-09-21T07:55:18.282 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:55:18.282 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":1,"fsid":"786d4f32-77ee-11ef-baf6-efdc52797490","modified":"2024-09-21T07:53:19.696564Z","created":"2024-09-21T07:53:19.696564Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi107","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T07:55:18.282 INFO:teuthology.orchestra.run.smithi129.stderr:dumped monmap epoch 1 2024-09-21T07:55:18.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.282+0000 7fa9a9de7640 1 -- 172.21.15.129:0/1838236396 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fa9900395d0 msgr2=0x7fa99003ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:18.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.282+0000 7fa9a9de7640 1 --2- 172.21.15.129:0/1838236396 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fa9900395d0 0x7fa99003ba80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa98c006fd0 tx=0x7fa98c006db0 comp rx=0 tx=0).stop 2024-09-21T07:55:18.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.282+0000 7fa9a9de7640 1 -- 172.21.15.129:0/1838236396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9a40fb2e0 msgr2=0x7fa9a4065530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:18.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.282+0000 7fa9a9de7640 1 --2- 172.21.15.129:0/1838236396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9a40fb2e0 0x7fa9a4065530 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa994009920 tx=0x7fa994009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:18.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.282+0000 7fa9a9de7640 1 -- 172.21.15.129:0/1838236396 shutdown_connections 2024-09-21T07:55:18.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.282+0000 7fa9a9de7640 1 --2- 172.21.15.129:0/1838236396 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7fa9900395d0 0x7fa99003ba80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:18.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.282+0000 7fa9a9de7640 1 --2- 172.21.15.129:0/1838236396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9a40fb2e0 0x7fa9a4065530 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:18.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.282+0000 7fa9a9de7640 1 -- 172.21.15.129:0/1838236396 >> 172.21.15.129:0/1838236396 conn(0x7fa9a40f6ac0 msgr2=0x7fa9a40f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:18.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.282+0000 7fa9a9de7640 1 -- 172.21.15.129:0/1838236396 shutdown_connections 2024-09-21T07:55:18.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:18.282+0000 7fa9a9de7640 1 -- 172.21.15.129:0/1838236396 wait complete. 2024-09-21T07:55:18.539 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:18 smithi107 ceph-mon[27622]: from='client.? 172.21.15.129:0/1838236396' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T07:55:19.847 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T07:55:19.848 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:55:20.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:19 smithi107 ceph-mon[27622]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:20.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:19 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:20.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:19 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:20.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:19 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:20.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:19 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-21T07:55:20.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:19 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:20.080 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:55:20.124 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:55:21.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:20 smithi107 ceph-mon[27622]: from='mgr.14160 172.21.15.107:0/3057460888' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-21T07:55:21.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:20 smithi107 ceph-mon[27622]: mgrmap e14: smithi107.wzulxb(active, since 55s) 2024-09-21T07:55:21.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.623+0000 7f9f2f893640 1 -- 172.21.15.129:0/1905288104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f280fd820 msgr2=0x7f9f280fdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.623+0000 7f9f2f893640 1 --2- 172.21.15.129:0/1905288104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f280fd820 0x7f9f280fdc30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9f24004850 tx=0x7f9f24009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.623+0000 7f9f2f893640 1 -- 172.21.15.129:0/1905288104 shutdown_connections 2024-09-21T07:55:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.623+0000 7f9f2f893640 1 --2- 172.21.15.129:0/1905288104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f280fd820 0x7f9f280fdc30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.623+0000 7f9f2f893640 1 -- 172.21.15.129:0/1905288104 >> 172.21.15.129:0/1905288104 conn(0x7f9f280f6040 msgr2=0x7f9f280f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.623+0000 7f9f2f893640 1 -- 172.21.15.129:0/1905288104 shutdown_connections 2024-09-21T07:55:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.623+0000 7f9f2f893640 1 -- 172.21.15.129:0/1905288104 wait complete. 2024-09-21T07:55:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.624+0000 7f9f2f893640 1 Processor -- start 2024-09-21T07:55:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.624+0000 7f9f2f893640 1 -- start start 2024-09-21T07:55:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.624+0000 7f9f2f893640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f280fd820 0x7f9f2810c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.624+0000 7f9f2f893640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2810cc20 con 0x7f9f280fd820 2024-09-21T07:55:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.624+0000 7f9f2d62f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f280fd820 0x7f9f2810c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.624+0000 7f9f2d62f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f280fd820 0x7f9f2810c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.129:50970/0 (socket says 172.21.15.129:50970) 2024-09-21T07:55:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.624+0000 7f9f2d62f640 1 -- 172.21.15.129:0/2450774397 learned_addr learned my addr 172.21.15.129:0/2450774397 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:55:21.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.625+0000 7f9f2d62f640 1 -- 172.21.15.129:0/2450774397 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f24005040 con 0x7f9f280fd820 2024-09-21T07:55:21.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.625+0000 7f9f2d62f640 1 --2- 172.21.15.129:0/2450774397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f280fd820 0x7f9f2810c6e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9f2402a6d0 tx=0x7f9f24009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:21.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.625+0000 7f9f19ffb640 1 -- 172.21.15.129:0/2450774397 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f24033630 con 0x7f9f280fd820 2024-09-21T07:55:21.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.625+0000 7f9f19ffb640 1 -- 172.21.15.129:0/2450774397 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9f24033c30 con 0x7f9f280fd820 2024-09-21T07:55:21.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.625+0000 7f9f19ffb640 1 -- 172.21.15.129:0/2450774397 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f2403dc00 con 0x7f9f280fd820 2024-09-21T07:55:21.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.625+0000 7f9f2f893640 1 -- 172.21.15.129:0/2450774397 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f2810ce20 con 0x7f9f280fd820 2024-09-21T07:55:21.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.625+0000 7f9f2f893640 1 -- 172.21.15.129:0/2450774397 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f2810d290 con 0x7f9f280fd820 2024-09-21T07:55:21.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.626+0000 7f9f19ffb640 1 -- 172.21.15.129:0/2450774397 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 14) v1 ==== 45578+0+0 (secure 0 0 0) 0x7f9f24030020 con 0x7f9f280fd820 2024-09-21T07:55:21.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.626+0000 7f9f2f893640 1 -- 172.21.15.129:0/2450774397 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2805ed70 con 0x7f9f280fd820 2024-09-21T07:55:21.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.626+0000 7f9f19ffb640 1 --2- 172.21.15.129:0/2450774397 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f9f140395d0 0x7f9f1403ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:21.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.626+0000 7f9f19ffb640 1 -- 172.21.15.129:0/2450774397 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9f2406c9b0 con 0x7f9f280fd820 2024-09-21T07:55:21.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.626+0000 7f9f2ce2e640 1 -- 172.21.15.129:0/2450774397 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f9f140395d0 msgr2=0x7f9f1403ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/2850161381 2024-09-21T07:55:21.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.626+0000 7f9f2ce2e640 1 --2- 172.21.15.129:0/2450774397 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f9f140395d0 0x7f9f1403ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T07:55:21.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.631+0000 7f9f19ffb640 1 -- 172.21.15.129:0/2450774397 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9f24033790 con 0x7f9f280fd820 2024-09-21T07:55:21.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.827+0000 7f9f2ce2e640 1 -- 172.21.15.129:0/2450774397 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f9f140395d0 msgr2=0x7f9f1403ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/2850161381 2024-09-21T07:55:21.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.827+0000 7f9f2ce2e640 1 --2- 172.21.15.129:0/2450774397 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f9f140395d0 0x7f9f1403ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-21T07:55:21.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.846+0000 7f9f2f893640 1 -- 172.21.15.129:0/2450774397 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9f2804b720 con 0x7f9f280fd820 2024-09-21T07:55:21.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.847+0000 7f9f19ffb640 1 -- 172.21.15.129:0/2450774397 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f9f24045390 con 0x7f9f280fd820 2024-09-21T07:55:21.848 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:55:21.848 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":1,"fsid":"786d4f32-77ee-11ef-baf6-efdc52797490","modified":"2024-09-21T07:53:19.696564Z","created":"2024-09-21T07:53:19.696564Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi107","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T07:55:21.848 INFO:teuthology.orchestra.run.smithi129.stderr:dumped monmap epoch 1 2024-09-21T07:55:21.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.848+0000 7f9f2f893640 1 -- 172.21.15.129:0/2450774397 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f9f140395d0 msgr2=0x7f9f1403ba80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:55:21.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.848+0000 7f9f2f893640 1 --2- 172.21.15.129:0/2450774397 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f9f140395d0 0x7f9f1403ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:21.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.848+0000 7f9f2f893640 1 -- 172.21.15.129:0/2450774397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f280fd820 msgr2=0x7f9f2810c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:21.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.848+0000 7f9f2f893640 1 --2- 172.21.15.129:0/2450774397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f280fd820 0x7f9f2810c6e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9f2402a6d0 tx=0x7f9f24009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:21.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.848+0000 7f9f2f893640 1 -- 172.21.15.129:0/2450774397 shutdown_connections 2024-09-21T07:55:21.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.848+0000 7f9f2f893640 1 --2- 172.21.15.129:0/2450774397 >> [v2:172.21.15.107:6800/2850161381,v1:172.21.15.107:6801/2850161381] conn(0x7f9f140395d0 0x7f9f1403ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:21.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.848+0000 7f9f2f893640 1 --2- 172.21.15.129:0/2450774397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f280fd820 0x7f9f2810c6e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:21.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.848+0000 7f9f2f893640 1 -- 172.21.15.129:0/2450774397 >> 172.21.15.129:0/2450774397 conn(0x7f9f280f6040 msgr2=0x7f9f280f6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:21.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.849+0000 7f9f2f893640 1 -- 172.21.15.129:0/2450774397 shutdown_connections 2024-09-21T07:55:21.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:21.849+0000 7f9f2f893640 1 -- 172.21.15.129:0/2450774397 wait complete. 2024-09-21T07:55:22.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:21 smithi107 ceph-mon[27622]: from='client.? 172.21.15.129:0/2450774397' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T07:55:23.470 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T07:55:23.470 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:55:23.711 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:55:23.755 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:55:24.424 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:24 smithi107 ceph-mon[27622]: Active manager daemon smithi107.wzulxb restarted 2024-09-21T07:55:24.424 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:24 smithi107 ceph-mon[27622]: Activating manager daemon smithi107.wzulxb 2024-09-21T07:55:24.424 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:24 smithi107 ceph-mon[27622]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T07:55:24.424 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:24 smithi107 ceph-mon[27622]: mgrmap e15: smithi107.wzulxb(active, starting, since 0.00322259s) 2024-09-21T07:55:24.424 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-21T07:55:24.424 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr metadata", "who": "smithi107.wzulxb", "id": "smithi107.wzulxb"}]: dispatch 2024-09-21T07:55:24.425 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T07:55:24.425 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T07:55:24.425 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T07:55:24.425 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:24 smithi107 ceph-mon[27622]: Manager daemon smithi107.wzulxb is now available 2024-09-21T07:55:24.425 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:55:24.425 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:24.425 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:55:24.425 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.wzulxb/mirror_snapshot_schedule"}]: dispatch 2024-09-21T07:55:24.426 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.wzulxb/trash_purge_schedule"}]: dispatch 2024-09-21T07:55:25.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.269+0000 7efe04270640 1 -- 172.21.15.129:0/513008273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdfc0fb2e0 msgr2=0x7efdfc0fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:25.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.269+0000 7efe04270640 1 --2- 172.21.15.129:0/513008273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdfc0fb2e0 0x7efdfc0fb6f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efdec009bd0 tx=0x7efdec004d10 comp rx=0 tx=0).stop 2024-09-21T07:55:25.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.269+0000 7efe04270640 1 -- 172.21.15.129:0/513008273 shutdown_connections 2024-09-21T07:55:25.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.269+0000 7efe04270640 1 --2- 172.21.15.129:0/513008273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdfc0fb2e0 0x7efdfc0fb6f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:25.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.269+0000 7efe04270640 1 -- 172.21.15.129:0/513008273 >> 172.21.15.129:0/513008273 conn(0x7efdfc0f6ac0 msgr2=0x7efdfc0f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:25.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.269+0000 7efe04270640 1 -- 172.21.15.129:0/513008273 shutdown_connections 2024-09-21T07:55:25.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.269+0000 7efe04270640 1 -- 172.21.15.129:0/513008273 wait complete. 2024-09-21T07:55:25.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.269+0000 7efe04270640 1 Processor -- start 2024-09-21T07:55:25.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.269+0000 7efe04270640 1 -- start start 2024-09-21T07:55:25.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.270+0000 7efe04270640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdfc0fb2e0 0x7efdfc10c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:25.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.270+0000 7efe04270640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc10ce60 con 0x7efdfc0fb2e0 2024-09-21T07:55:25.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.270+0000 7efe0200c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdfc0fb2e0 0x7efdfc10c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:25.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.270+0000 7efe0200c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdfc0fb2e0 0x7efdfc10c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.129:50974/0 (socket says 172.21.15.129:50974) 2024-09-21T07:55:25.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.270+0000 7efe0200c640 1 -- 172.21.15.129:0/3454087149 learned_addr learned my addr 172.21.15.129:0/3454087149 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:55:25.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.270+0000 7efe0200c640 1 -- 172.21.15.129:0/3454087149 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec0098b0 con 0x7efdfc0fb2e0 2024-09-21T07:55:25.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.270+0000 7efe0200c640 1 --2- 172.21.15.129:0/3454087149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdfc0fb2e0 0x7efdfc10c920 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efdec003400 tx=0x7efdec004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:25.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.270+0000 7efdfaffd640 1 -- 172.21.15.129:0/3454087149 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdec032910 con 0x7efdfc0fb2e0 2024-09-21T07:55:25.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.270+0000 7efdfaffd640 1 -- 172.21.15.129:0/3454087149 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efdec03d420 con 0x7efdfc0fb2e0 2024-09-21T07:55:25.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.270+0000 7efe04270640 1 -- 172.21.15.129:0/3454087149 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdfc10d060 con 0x7efdfc0fb2e0 2024-09-21T07:55:25.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.270+0000 7efdfaffd640 1 -- 172.21.15.129:0/3454087149 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdec031590 con 0x7efdfc0fb2e0 2024-09-21T07:55:25.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.271+0000 7efe04270640 1 -- 172.21.15.129:0/3454087149 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdfc10dbf0 con 0x7efdfc0fb2e0 2024-09-21T07:55:25.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.271+0000 7efdfaffd640 1 -- 172.21.15.129:0/3454087149 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 45428+0+0 (secure 0 0 0) 0x7efdec02f030 con 0x7efdfc0fb2e0 2024-09-21T07:55:25.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.271+0000 7efe04270640 1 -- 172.21.15.129:0/3454087149 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdfc102800 con 0x7efdfc0fb2e0 2024-09-21T07:55:25.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.271+0000 7efdfaffd640 1 --2- 172.21.15.129:0/3454087149 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7efde4039420 0x7efde403b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:25.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.272+0000 7efdfaffd640 1 -- 172.21.15.129:0/3454087149 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7efdec06d930 con 0x7efdfc0fb2e0 2024-09-21T07:55:25.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.272+0000 7efe0180b640 1 --2- 172.21.15.129:0/3454087149 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7efde4039420 0x7efde403b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:25.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.272+0000 7efe0180b640 1 --2- 172.21.15.129:0/3454087149 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7efde4039420 0x7efde403b8d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efdf0006fd0 tx=0x7efdf0006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:25.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.277+0000 7efdfaffd640 1 -- 172.21.15.129:0/3454087149 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efdec04edc0 con 0x7efdfc0fb2e0 2024-09-21T07:55:25.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.527+0000 7efe04270640 1 -- 172.21.15.129:0/3454087149 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7efdfc0008d0 con 0x7efdfc0fb2e0 2024-09-21T07:55:25.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.528+0000 7efdfaffd640 1 -- 172.21.15.129:0/3454087149 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7efdec041030 con 0x7efdfc0fb2e0 2024-09-21T07:55:25.530 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:55:25.530 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":1,"fsid":"786d4f32-77ee-11ef-baf6-efdc52797490","modified":"2024-09-21T07:53:19.696564Z","created":"2024-09-21T07:53:19.696564Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi107","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T07:55:25.530 INFO:teuthology.orchestra.run.smithi129.stderr:dumped monmap epoch 1 2024-09-21T07:55:25.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.530+0000 7efe04270640 1 -- 172.21.15.129:0/3454087149 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7efde4039420 msgr2=0x7efde403b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:25.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.530+0000 7efe04270640 1 --2- 172.21.15.129:0/3454087149 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7efde4039420 0x7efde403b8d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efdf0006fd0 tx=0x7efdf0006db0 comp rx=0 tx=0).stop 2024-09-21T07:55:25.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.530+0000 7efe04270640 1 -- 172.21.15.129:0/3454087149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdfc0fb2e0 msgr2=0x7efdfc10c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:25.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.530+0000 7efe04270640 1 --2- 172.21.15.129:0/3454087149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdfc0fb2e0 0x7efdfc10c920 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efdec003400 tx=0x7efdec004d10 comp rx=0 tx=0).stop 2024-09-21T07:55:25.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.530+0000 7efe04270640 1 -- 172.21.15.129:0/3454087149 shutdown_connections 2024-09-21T07:55:25.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.530+0000 7efe04270640 1 --2- 172.21.15.129:0/3454087149 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7efde4039420 0x7efde403b8d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:25.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.530+0000 7efe04270640 1 --2- 172.21.15.129:0/3454087149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdfc0fb2e0 0x7efdfc10c920 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:25.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.530+0000 7efe04270640 1 -- 172.21.15.129:0/3454087149 >> 172.21.15.129:0/3454087149 conn(0x7efdfc0f6ac0 msgr2=0x7efdfc0f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:25.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.530+0000 7efe04270640 1 -- 172.21.15.129:0/3454087149 shutdown_connections 2024-09-21T07:55:25.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:25.530+0000 7efe04270640 1 -- 172.21.15.129:0/3454087149 wait complete. 2024-09-21T07:55:26.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:25 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:26.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:25 smithi107 ceph-mon[27622]: [21/Sep/2024:07:55:24] ENGINE Bus STARTING 2024-09-21T07:55:26.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:25 smithi107 ceph-mon[27622]: [21/Sep/2024:07:55:25] ENGINE Serving on https://172.21.15.107:7150 2024-09-21T07:55:26.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:25 smithi107 ceph-mon[27622]: [21/Sep/2024:07:55:25] ENGINE Bus STARTED 2024-09-21T07:55:26.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:25 smithi107 ceph-mon[27622]: [21/Sep/2024:07:55:25] ENGINE Error in HTTPServer.serve 2024-09-21T07:55:26.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Traceback (most recent call last): 2024-09-21T07:55:26.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:55:26.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._connections.run(self.expiration_interval) 2024-09-21T07:55:26.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:55:26.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._run(expiration_interval) 2024-09-21T07:55:26.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:55:26.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:55:26.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:55:26.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:55:26.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:55:26.056 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: s = self.context.wrap_socket( 2024-09-21T07:55:26.056 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:55:26.056 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: return self.sslsocket_class._create( 2024-09-21T07:55:26.056 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:55:26.056 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self.do_handshake() 2024-09-21T07:55:26.056 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:55:26.056 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._sslobj.do_handshake() 2024-09-21T07:55:26.056 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:55:26.056 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:25 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:26.056 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:25 smithi107 ceph-mon[27622]: mgrmap e16: smithi107.wzulxb(active, since 1.00593s) 2024-09-21T07:55:26.056 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:25 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:26.056 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:25 smithi107 ceph-mon[27622]: from='client.? 172.21.15.129:0/3454087149' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T07:55:27.130 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T07:55:27.131 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:55:27.546 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:55:27.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:27 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:27.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:27 smithi107 ceph-mon[27622]: mgrmap e17: smithi107.wzulxb(active, since 2s) 2024-09-21T07:55:27.943 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:55:29.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:29 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:29.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:29 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:29.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:29 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:29.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:29 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:29.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:29 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd/host:smithi107", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:55:30.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.955+0000 7fda426f4640 1 -- 172.21.15.129:0/1663057971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda3c0fb0c0 msgr2=0x7fda3c0fb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:30.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.955+0000 7fda426f4640 1 --2- 172.21.15.129:0/1663057971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda3c0fb0c0 0x7fda3c0fb4d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fda2c004850 tx=0x7fda2c009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.955+0000 7fda426f4640 1 -- 172.21.15.129:0/1663057971 shutdown_connections 2024-09-21T07:55:30.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.955+0000 7fda426f4640 1 --2- 172.21.15.129:0/1663057971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda3c0fb0c0 0x7fda3c0fb4d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.955+0000 7fda426f4640 1 -- 172.21.15.129:0/1663057971 >> 172.21.15.129:0/1663057971 conn(0x7fda3c0f6880 msgr2=0x7fda3c0f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:30.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.955+0000 7fda426f4640 1 -- 172.21.15.129:0/1663057971 shutdown_connections 2024-09-21T07:55:30.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.955+0000 7fda426f4640 1 -- 172.21.15.129:0/1663057971 wait complete. 2024-09-21T07:55:30.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.956+0000 7fda426f4640 1 Processor -- start 2024-09-21T07:55:30.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.956+0000 7fda426f4640 1 -- start start 2024-09-21T07:55:30.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.956+0000 7fda426f4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda3c0fb0c0 0x7fda3c065dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:30.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.956+0000 7fda426f4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c10f430 con 0x7fda3c0fb0c0 2024-09-21T07:55:30.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.956+0000 7fda3bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda3c0fb0c0 0x7fda3c065dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:30.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.956+0000 7fda3bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda3c0fb0c0 0x7fda3c065dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.129:52258/0 (socket says 172.21.15.129:52258) 2024-09-21T07:55:30.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.956+0000 7fda3bfff640 1 -- 172.21.15.129:0/1588401868 learned_addr learned my addr 172.21.15.129:0/1588401868 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:55:30.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.957+0000 7fda3bfff640 1 -- 172.21.15.129:0/1588401868 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c005040 con 0x7fda3c0fb0c0 2024-09-21T07:55:30.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.957+0000 7fda3bfff640 1 --2- 172.21.15.129:0/1588401868 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda3c0fb0c0 0x7fda3c065dc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fda2c02a6d0 tx=0x7fda2c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:30.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.957+0000 7fda397fa640 1 -- 172.21.15.129:0/1588401868 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda2c033630 con 0x7fda3c0fb0c0 2024-09-21T07:55:30.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.957+0000 7fda397fa640 1 -- 172.21.15.129:0/1588401868 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fda2c033c30 con 0x7fda3c0fb0c0 2024-09-21T07:55:30.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.957+0000 7fda397fa640 1 -- 172.21.15.129:0/1588401868 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda2c03dc00 con 0x7fda3c0fb0c0 2024-09-21T07:55:30.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.957+0000 7fda426f4640 1 -- 172.21.15.129:0/1588401868 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda3c10f570 con 0x7fda3c0fb0c0 2024-09-21T07:55:30.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.957+0000 7fda426f4640 1 -- 172.21.15.129:0/1588401868 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda3c10f9e0 con 0x7fda3c0fb0c0 2024-09-21T07:55:30.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.958+0000 7fda397fa640 1 -- 172.21.15.129:0/1588401868 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7fda2c030020 con 0x7fda3c0fb0c0 2024-09-21T07:55:30.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.958+0000 7fda426f4640 1 -- 172.21.15.129:0/1588401868 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda3c05ed70 con 0x7fda3c0fb0c0 2024-09-21T07:55:30.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.958+0000 7fda397fa640 1 --2- 172.21.15.129:0/1588401868 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fda28039670 0x7fda2803bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:30.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.958+0000 7fda397fa640 1 -- 172.21.15.129:0/1588401868 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fda2c06ce00 con 0x7fda3c0fb0c0 2024-09-21T07:55:30.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.958+0000 7fda33fff640 1 --2- 172.21.15.129:0/1588401868 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fda28039670 0x7fda2803bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:30.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.959+0000 7fda33fff640 1 --2- 172.21.15.129:0/1588401868 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fda28039670 0x7fda2803bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fda24006fd0 tx=0x7fda24006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:30.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:29.965+0000 7fda397fa640 1 -- 172.21.15.129:0/1588401868 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fda2c047440 con 0x7fda3c0fb0c0 2024-09-21T07:55:30.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:30.193+0000 7fda426f4640 1 -- 172.21.15.129:0/1588401868 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fda3c105770 con 0x7fda3c0fb0c0 2024-09-21T07:55:30.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:30.194+0000 7fda397fa640 1 -- 172.21.15.129:0/1588401868 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fda2c042210 con 0x7fda3c0fb0c0 2024-09-21T07:55:30.196 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:55:30.196 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":1,"fsid":"786d4f32-77ee-11ef-baf6-efdc52797490","modified":"2024-09-21T07:53:19.696564Z","created":"2024-09-21T07:53:19.696564Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi107","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T07:55:30.196 INFO:teuthology.orchestra.run.smithi129.stderr:dumped monmap epoch 1 2024-09-21T07:55:30.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:30.196+0000 7fda426f4640 1 -- 172.21.15.129:0/1588401868 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fda28039670 msgr2=0x7fda2803bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:30.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:30.196+0000 7fda426f4640 1 --2- 172.21.15.129:0/1588401868 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fda28039670 0x7fda2803bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fda24006fd0 tx=0x7fda24006db0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:30.196+0000 7fda426f4640 1 -- 172.21.15.129:0/1588401868 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda3c0fb0c0 msgr2=0x7fda3c065dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:30.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:30.196+0000 7fda426f4640 1 --2- 172.21.15.129:0/1588401868 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda3c0fb0c0 0x7fda3c065dc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fda2c02a6d0 tx=0x7fda2c009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:30.196+0000 7fda426f4640 1 -- 172.21.15.129:0/1588401868 shutdown_connections 2024-09-21T07:55:30.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:30.196+0000 7fda426f4640 1 --2- 172.21.15.129:0/1588401868 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fda28039670 0x7fda2803bb20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:30.196+0000 7fda426f4640 1 --2- 172.21.15.129:0/1588401868 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda3c0fb0c0 0x7fda3c065dc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:30.196+0000 7fda426f4640 1 -- 172.21.15.129:0/1588401868 >> 172.21.15.129:0/1588401868 conn(0x7fda3c0f6880 msgr2=0x7fda3c0f7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:30.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:30.196+0000 7fda426f4640 1 -- 172.21.15.129:0/1588401868 shutdown_connections 2024-09-21T07:55:30.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:30.196+0000 7fda426f4640 1 -- 172.21.15.129:0/1588401868 wait complete. 2024-09-21T07:55:30.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:30 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:30.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:30 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:30.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:30 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:30.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:30 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:30.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:30 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd/host:smithi129", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:55:30.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:30 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:55:30.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:30 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:55:30.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:30 smithi107 ceph-mon[27622]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-21T07:55:30.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:30 smithi107 ceph-mon[27622]: Updating smithi129:/etc/ceph/ceph.conf 2024-09-21T07:55:30.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:30 smithi107 ceph-mon[27622]: Updating smithi107:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:55:30.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:30 smithi107 ceph-mon[27622]: Updating smithi129:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:55:30.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:30 smithi107 ceph-mon[27622]: from='client.? 172.21.15.129:0/1588401868' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T07:55:30.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:30 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:30.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:30 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:30.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:30 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:30.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:30 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:30.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:30 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:30.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:30 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi129", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T07:55:30.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:30 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi129", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-21T07:55:30.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:30 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:55:31.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:31 smithi107 ceph-mon[27622]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:55:31.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:31 smithi107 ceph-mon[27622]: Updating smithi129:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:55:31.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:31 smithi107 ceph-mon[27622]: Updating smithi107:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:55:31.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:31 smithi107 ceph-mon[27622]: Updating smithi129:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:55:31.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:31 smithi107 ceph-mon[27622]: Deploying daemon crash.smithi129 on smithi129 2024-09-21T07:55:31.849 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T07:55:31.849 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:55:32.145 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:55:33.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.651+0000 7f7d90ecf640 1 -- 172.21.15.129:0/3715941896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d8c102200 msgr2=0x7f7d8c1025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:33.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.651+0000 7f7d90ecf640 1 --2- 172.21.15.129:0/3715941896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d8c102200 0x7f7d8c1025d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009bd0 tx=0x7f7d7c004d10 comp rx=0 tx=0).stop 2024-09-21T07:55:33.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.651+0000 7f7d90ecf640 1 -- 172.21.15.129:0/3715941896 shutdown_connections 2024-09-21T07:55:33.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.651+0000 7f7d90ecf640 1 --2- 172.21.15.129:0/3715941896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d8c102200 0x7f7d8c1025d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:33.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.651+0000 7f7d90ecf640 1 -- 172.21.15.129:0/3715941896 >> 172.21.15.129:0/3715941896 conn(0x7f7d8c0f7dd0 msgr2=0x7f7d8c0fa1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:33.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.651+0000 7f7d90ecf640 1 -- 172.21.15.129:0/3715941896 shutdown_connections 2024-09-21T07:55:33.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.651+0000 7f7d90ecf640 1 -- 172.21.15.129:0/3715941896 wait complete. 2024-09-21T07:55:33.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.651+0000 7f7d90ecf640 1 Processor -- start 2024-09-21T07:55:33.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.652+0000 7f7d90ecf640 1 -- start start 2024-09-21T07:55:33.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.652+0000 7f7d90ecf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d8c102200 0x7f7d8c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:33.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.652+0000 7f7d90ecf640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c06ff50 con 0x7f7d8c102200 2024-09-21T07:55:33.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.652+0000 7f7d8a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d8c102200 0x7f7d8c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:33.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.652+0000 7f7d8a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d8c102200 0x7f7d8c06fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.129:52272/0 (socket says 172.21.15.129:52272) 2024-09-21T07:55:33.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.652+0000 7f7d8a59c640 1 -- 172.21.15.129:0/1160199676 learned_addr learned my addr 172.21.15.129:0/1160199676 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:55:33.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.652+0000 7f7d8a59c640 1 -- 172.21.15.129:0/1160199676 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c0098b0 con 0x7f7d8c102200 2024-09-21T07:55:33.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.652+0000 7f7d8a59c640 1 --2- 172.21.15.129:0/1160199676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d8c102200 0x7f7d8c06fa10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009ba0 tx=0x7f7d7c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:33.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.653+0000 7f7d7affd640 1 -- 172.21.15.129:0/1160199676 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d7c0327a0 con 0x7f7d8c102200 2024-09-21T07:55:33.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.653+0000 7f7d90ecf640 1 -- 172.21.15.129:0/1160199676 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8c070150 con 0x7f7d8c102200 2024-09-21T07:55:33.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.653+0000 7f7d7affd640 1 -- 172.21.15.129:0/1160199676 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7d7c032da0 con 0x7f7d8c102200 2024-09-21T07:55:33.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.653+0000 7f7d7affd640 1 -- 172.21.15.129:0/1160199676 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d7c03dd80 con 0x7f7d8c102200 2024-09-21T07:55:33.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.653+0000 7f7d90ecf640 1 -- 172.21.15.129:0/1160199676 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8c070620 con 0x7f7d8c102200 2024-09-21T07:55:33.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.654+0000 7f7d90ecf640 1 -- 172.21.15.129:0/1160199676 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8c0fd970 con 0x7f7d8c102200 2024-09-21T07:55:33.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.654+0000 7f7d7affd640 1 -- 172.21.15.129:0/1160199676 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7f7d7c02f030 con 0x7f7d8c102200 2024-09-21T07:55:33.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.654+0000 7f7d7affd640 1 --2- 172.21.15.129:0/1160199676 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7d74039620 0x7f7d7403bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:33.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.654+0000 7f7d7affd640 1 -- 172.21.15.129:0/1160199676 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f7d7c06da70 con 0x7f7d8c102200 2024-09-21T07:55:33.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.654+0000 7f7d89d9b640 1 --2- 172.21.15.129:0/1160199676 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7d74039620 0x7f7d7403bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:33.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.655+0000 7f7d89d9b640 1 --2- 172.21.15.129:0/1160199676 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7d74039620 0x7f7d7403bad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7d80006fd0 tx=0x7f7d80006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:33.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.659+0000 7f7d7affd640 1 -- 172.21.15.129:0/1160199676 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7d7c04e530 con 0x7f7d8c102200 2024-09-21T07:55:33.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.878+0000 7f7d90ecf640 1 -- 172.21.15.129:0/1160199676 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7d8c106490 con 0x7f7d8c102200 2024-09-21T07:55:33.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.879+0000 7f7d7affd640 1 -- 172.21.15.129:0/1160199676 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f7d7c04e350 con 0x7f7d8c102200 2024-09-21T07:55:33.881 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:55:33.881 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":1,"fsid":"786d4f32-77ee-11ef-baf6-efdc52797490","modified":"2024-09-21T07:53:19.696564Z","created":"2024-09-21T07:53:19.696564Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi107","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T07:55:33.881 INFO:teuthology.orchestra.run.smithi129.stderr:dumped monmap epoch 1 2024-09-21T07:55:33.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.883+0000 7f7d90ecf640 1 -- 172.21.15.129:0/1160199676 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7d74039620 msgr2=0x7f7d7403bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:33.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.883+0000 7f7d90ecf640 1 --2- 172.21.15.129:0/1160199676 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7d74039620 0x7f7d7403bad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7d80006fd0 tx=0x7f7d80006db0 comp rx=0 tx=0).stop 2024-09-21T07:55:33.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.883+0000 7f7d90ecf640 1 -- 172.21.15.129:0/1160199676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d8c102200 msgr2=0x7f7d8c06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:33.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.883+0000 7f7d90ecf640 1 --2- 172.21.15.129:0/1160199676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d8c102200 0x7f7d8c06fa10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009ba0 tx=0x7f7d7c004d10 comp rx=0 tx=0).stop 2024-09-21T07:55:33.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.883+0000 7f7d90ecf640 1 -- 172.21.15.129:0/1160199676 shutdown_connections 2024-09-21T07:55:33.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.883+0000 7f7d90ecf640 1 --2- 172.21.15.129:0/1160199676 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7d74039620 0x7f7d7403bad0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:33.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.883+0000 7f7d90ecf640 1 --2- 172.21.15.129:0/1160199676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d8c102200 0x7f7d8c06fa10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:33.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.883+0000 7f7d90ecf640 1 -- 172.21.15.129:0/1160199676 >> 172.21.15.129:0/1160199676 conn(0x7f7d8c0f7dd0 msgr2=0x7f7d8c0f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:33.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.883+0000 7f7d90ecf640 1 -- 172.21.15.129:0/1160199676 shutdown_connections 2024-09-21T07:55:33.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:33.883+0000 7f7d90ecf640 1 -- 172.21.15.129:0/1160199676 wait complete. 2024-09-21T07:55:34.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:33 smithi107 ceph-mon[27622]: from='client.? 172.21.15.129:0/1160199676' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T07:55:35.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:35 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:35.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:35 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:35.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:35 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:35.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:35 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:35.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:35 smithi107 ceph-mon[27622]: Deploying daemon node-exporter.smithi129 on smithi129 2024-09-21T07:55:35.722 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T07:55:35.723 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:55:35.965 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:55:38.710 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.708+0000 7f959a6f0640 1 -- 172.21.15.129:0/2501955457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9594102250 msgr2=0x7f9594102620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:38.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.708+0000 7f959a6f0640 1 --2- 172.21.15.129:0/2501955457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9594102250 0x7f9594102620 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9584004850 tx=0x7f9584009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:38.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.708+0000 7f959a6f0640 1 -- 172.21.15.129:0/2501955457 shutdown_connections 2024-09-21T07:55:38.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.708+0000 7f959a6f0640 1 --2- 172.21.15.129:0/2501955457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9594102250 0x7f9594102620 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:38.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.708+0000 7f959a6f0640 1 -- 172.21.15.129:0/2501955457 >> 172.21.15.129:0/2501955457 conn(0x7f9594071790 msgr2=0x7f9594071b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:38.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.708+0000 7f959a6f0640 1 -- 172.21.15.129:0/2501955457 shutdown_connections 2024-09-21T07:55:38.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.708+0000 7f959a6f0640 1 -- 172.21.15.129:0/2501955457 wait complete. 2024-09-21T07:55:38.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.709+0000 7f959a6f0640 1 Processor -- start 2024-09-21T07:55:38.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.709+0000 7f959a6f0640 1 -- start start 2024-09-21T07:55:38.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.709+0000 7f959a6f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9594102250 0x7f95941127b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:38.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.709+0000 7f959a6f0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9594112cf0 con 0x7f9594102250 2024-09-21T07:55:38.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.709+0000 7f9593fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9594102250 0x7f95941127b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:38.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.709+0000 7f9593fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9594102250 0x7f95941127b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.129:52304/0 (socket says 172.21.15.129:52304) 2024-09-21T07:55:38.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.709+0000 7f9593fff640 1 -- 172.21.15.129:0/2067345530 learned_addr learned my addr 172.21.15.129:0/2067345530 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:55:38.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.710+0000 7f9593fff640 1 -- 172.21.15.129:0/2067345530 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9584005040 con 0x7f9594102250 2024-09-21T07:55:38.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.710+0000 7f9593fff640 1 --2- 172.21.15.129:0/2067345530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9594102250 0x7f95941127b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9584004820 tx=0x7f9584009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:38.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.710+0000 7f9590ff9640 1 -- 172.21.15.129:0/2067345530 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9584033700 con 0x7f9594102250 2024-09-21T07:55:38.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.710+0000 7f9590ff9640 1 -- 172.21.15.129:0/2067345530 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9584033d00 con 0x7f9594102250 2024-09-21T07:55:38.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.710+0000 7f9590ff9640 1 -- 172.21.15.129:0/2067345530 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f958403dcb0 con 0x7f9594102250 2024-09-21T07:55:38.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.710+0000 7f959a6f0640 1 -- 172.21.15.129:0/2067345530 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9594112ef0 con 0x7f9594102250 2024-09-21T07:55:38.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.710+0000 7f959a6f0640 1 -- 172.21.15.129:0/2067345530 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9594113360 con 0x7f9594102250 2024-09-21T07:55:38.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.711+0000 7f9590ff9640 1 -- 172.21.15.129:0/2067345530 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7f9584030020 con 0x7f9594102250 2024-09-21T07:55:38.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.711+0000 7f959a6f0640 1 -- 172.21.15.129:0/2067345530 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9594064750 con 0x7f9594102250 2024-09-21T07:55:38.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.712+0000 7f9590ff9640 1 --2- 172.21.15.129:0/2067345530 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f9580039670 0x7f958003bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:38.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.712+0000 7f9590ff9640 1 -- 172.21.15.129:0/2067345530 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f958406cc50 con 0x7f9594102250 2024-09-21T07:55:38.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.712+0000 7f95937fe640 1 --2- 172.21.15.129:0/2067345530 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f9580039670 0x7f958003bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:38.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.712+0000 7f95937fe640 1 --2- 172.21.15.129:0/2067345530 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f9580039670 0x7f958003bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f957c006fd0 tx=0x7f957c006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:38.718 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.717+0000 7f9590ff9640 1 -- 172.21.15.129:0/2067345530 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9584046740 con 0x7f9594102250 2024-09-21T07:55:38.954 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.953+0000 7f959a6f0640 1 -- 172.21.15.129:0/2067345530 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f959405edc0 con 0x7f9594102250 2024-09-21T07:55:38.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.953+0000 7f9590ff9640 1 -- 172.21.15.129:0/2067345530 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f9584044a00 con 0x7f9594102250 2024-09-21T07:55:38.955 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:55:38.955 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":1,"fsid":"786d4f32-77ee-11ef-baf6-efdc52797490","modified":"2024-09-21T07:53:19.696564Z","created":"2024-09-21T07:53:19.696564Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi107","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T07:55:38.956 INFO:teuthology.orchestra.run.smithi129.stderr:dumped monmap epoch 1 2024-09-21T07:55:38.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.955+0000 7f959a6f0640 1 -- 172.21.15.129:0/2067345530 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f9580039670 msgr2=0x7f958003bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:38.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.955+0000 7f959a6f0640 1 --2- 172.21.15.129:0/2067345530 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f9580039670 0x7f958003bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f957c006fd0 tx=0x7f957c006db0 comp rx=0 tx=0).stop 2024-09-21T07:55:38.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.955+0000 7f959a6f0640 1 -- 172.21.15.129:0/2067345530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9594102250 msgr2=0x7f95941127b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:38.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.955+0000 7f959a6f0640 1 --2- 172.21.15.129:0/2067345530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9594102250 0x7f95941127b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9584004820 tx=0x7f9584009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:38.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.955+0000 7f959a6f0640 1 -- 172.21.15.129:0/2067345530 shutdown_connections 2024-09-21T07:55:38.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.955+0000 7f959a6f0640 1 --2- 172.21.15.129:0/2067345530 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f9580039670 0x7f958003bb20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:38.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.955+0000 7f959a6f0640 1 --2- 172.21.15.129:0/2067345530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9594102250 0x7f95941127b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:38.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.955+0000 7f959a6f0640 1 -- 172.21.15.129:0/2067345530 >> 172.21.15.129:0/2067345530 conn(0x7f9594071790 msgr2=0x7f9594102f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:38.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.955+0000 7f959a6f0640 1 -- 172.21.15.129:0/2067345530 shutdown_connections 2024-09-21T07:55:38.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:38.955+0000 7f959a6f0640 1 -- 172.21.15.129:0/2067345530 wait complete. 2024-09-21T07:55:39.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:39 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:39.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:39 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:39.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:39 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:39.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:39 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:39.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:39 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi129.wvlmvo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T07:55:39.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:39 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi129.wvlmvo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:55:39.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:39 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T07:55:39.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:39 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:55:39.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:39 smithi107 ceph-mon[27622]: Deploying daemon mgr.smithi129.wvlmvo on smithi129 2024-09-21T07:55:39.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:39 smithi107 ceph-mon[27622]: from='client.? 172.21.15.129:0/2067345530' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T07:55:39.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:39 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:39.807 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:39 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:55:40.585 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T07:55:40.585 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:55:40.865 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:55:42.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.721+0000 7f6fe04c5640 1 -- 172.21.15.129:0/33458565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fd81021e0 msgr2=0x7f6fd81025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:42.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.721+0000 7f6fe04c5640 1 --2- 172.21.15.129:0/33458565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fd81021e0 0x7f6fd81025b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4004850 tx=0x7f6fd4009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:42.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.722+0000 7f6fe04c5640 1 -- 172.21.15.129:0/33458565 shutdown_connections 2024-09-21T07:55:42.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.722+0000 7f6fe04c5640 1 --2- 172.21.15.129:0/33458565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fd81021e0 0x7f6fd81025b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:42.725 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.722+0000 7f6fe04c5640 1 -- 172.21.15.129:0/33458565 >> 172.21.15.129:0/33458565 conn(0x7f6fd80710b0 msgr2=0x7f6fd80714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:42.725 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.722+0000 7f6fe04c5640 1 -- 172.21.15.129:0/33458565 shutdown_connections 2024-09-21T07:55:42.725 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.722+0000 7f6fe04c5640 1 -- 172.21.15.129:0/33458565 wait complete. 2024-09-21T07:55:42.725 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.722+0000 7f6fe04c5640 1 Processor -- start 2024-09-21T07:55:42.725 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.722+0000 7f6fe04c5640 1 -- start start 2024-09-21T07:55:42.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.723+0000 7f6fe04c5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fd81021e0 0x7f6fd8112790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:42.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.723+0000 7f6fe04c5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd8112cd0 con 0x7f6fd81021e0 2024-09-21T07:55:42.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.723+0000 7f6fde261640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fd81021e0 0x7f6fd8112790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:42.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.723+0000 7f6fde261640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fd81021e0 0x7f6fd8112790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.129:47238/0 (socket says 172.21.15.129:47238) 2024-09-21T07:55:42.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.723+0000 7f6fde261640 1 -- 172.21.15.129:0/447823251 learned_addr learned my addr 172.21.15.129:0/447823251 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:55:42.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.723+0000 7f6fde261640 1 -- 172.21.15.129:0/447823251 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd4005040 con 0x7f6fd81021e0 2024-09-21T07:55:42.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.724+0000 7f6fde261640 1 --2- 172.21.15.129:0/447823251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fd81021e0 0x7f6fd8112790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6fd402a6d0 tx=0x7f6fd4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:42.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.724+0000 7f6fceffd640 1 -- 172.21.15.129:0/447823251 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fd402cf10 con 0x7f6fd81021e0 2024-09-21T07:55:42.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.724+0000 7f6fe04c5640 1 -- 172.21.15.129:0/447823251 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd8112ed0 con 0x7f6fd81021e0 2024-09-21T07:55:42.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.724+0000 7f6fceffd640 1 -- 172.21.15.129:0/447823251 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6fd4033ad0 con 0x7f6fd81021e0 2024-09-21T07:55:42.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.724+0000 7f6fceffd640 1 -- 172.21.15.129:0/447823251 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fd403ebb0 con 0x7f6fd81021e0 2024-09-21T07:55:42.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.724+0000 7f6fe04c5640 1 -- 172.21.15.129:0/447823251 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd81133a0 con 0x7f6fd81021e0 2024-09-21T07:55:42.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.725+0000 7f6fceffd640 1 -- 172.21.15.129:0/447823251 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7f6fd4030020 con 0x7f6fd81021e0 2024-09-21T07:55:42.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.725+0000 7f6fceffd640 1 --2- 172.21.15.129:0/447823251 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f6fc40396c0 0x7f6fc403bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:42.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.725+0000 7f6fceffd640 1 -- 172.21.15.129:0/447823251 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6fd406c680 con 0x7f6fd81021e0 2024-09-21T07:55:42.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.725+0000 7f6fe04c5640 1 -- 172.21.15.129:0/447823251 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd81133a0 con 0x7f6fd81021e0 2024-09-21T07:55:42.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.725+0000 7f6fdda60640 1 --2- 172.21.15.129:0/447823251 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f6fc40396c0 0x7f6fc403bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:42.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.726+0000 7f6fdda60640 1 --2- 172.21.15.129:0/447823251 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f6fc40396c0 0x7f6fc403bb70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8006fd0 tx=0x7f6fc8006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:42.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.730+0000 7f6fceffd640 1 -- 172.21.15.129:0/447823251 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6fd81133a0 con 0x7f6fd81021e0 2024-09-21T07:55:42.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.974+0000 7f6fe04c5640 1 -- 172.21.15.129:0/447823251 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6fd81133a0 con 0x7f6fd81021e0 2024-09-21T07:55:42.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.974+0000 7f6fceffd640 1 -- 172.21.15.129:0/447823251 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f6fd81133a0 con 0x7f6fd81021e0 2024-09-21T07:55:42.976 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:55:42.976 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":1,"fsid":"786d4f32-77ee-11ef-baf6-efdc52797490","modified":"2024-09-21T07:53:19.696564Z","created":"2024-09-21T07:53:19.696564Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi107","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T07:55:42.977 INFO:teuthology.orchestra.run.smithi129.stderr:dumped monmap epoch 1 2024-09-21T07:55:42.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.976+0000 7f6fe04c5640 1 -- 172.21.15.129:0/447823251 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f6fc40396c0 msgr2=0x7f6fc403bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:42.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.976+0000 7f6fe04c5640 1 --2- 172.21.15.129:0/447823251 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f6fc40396c0 0x7f6fc403bb70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8006fd0 tx=0x7f6fc8006db0 comp rx=0 tx=0).stop 2024-09-21T07:55:42.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.976+0000 7f6fe04c5640 1 -- 172.21.15.129:0/447823251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fd81021e0 msgr2=0x7f6fd8112790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:42.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.976+0000 7f6fe04c5640 1 --2- 172.21.15.129:0/447823251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fd81021e0 0x7f6fd8112790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6fd402a6d0 tx=0x7f6fd4009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:42.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.977+0000 7f6fe04c5640 1 -- 172.21.15.129:0/447823251 shutdown_connections 2024-09-21T07:55:42.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.977+0000 7f6fe04c5640 1 --2- 172.21.15.129:0/447823251 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f6fc40396c0 0x7f6fc403bb70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:42.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.977+0000 7f6fe04c5640 1 --2- 172.21.15.129:0/447823251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fd81021e0 0x7f6fd8112790 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:42.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.977+0000 7f6fe04c5640 1 -- 172.21.15.129:0/447823251 >> 172.21.15.129:0/447823251 conn(0x7f6fd80710b0 msgr2=0x7f6fd80f9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:42.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.977+0000 7f6fe04c5640 1 -- 172.21.15.129:0/447823251 shutdown_connections 2024-09-21T07:55:42.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:42.977+0000 7f6fe04c5640 1 -- 172.21.15.129:0/447823251 wait complete. 2024-09-21T07:55:43.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:43 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:43.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:43 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:43.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:43 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:43.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:43 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:43.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:43 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T07:55:43.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:43 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:55:43.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:43 smithi107 ceph-mon[27622]: Deploying daemon mon.smithi129 on smithi129 2024-09-21T07:55:43.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:43 smithi107 ceph-mon[27622]: from='client.? 172.21.15.129:0/447823251' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T07:55:44.575 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T07:55:44.576 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:55:44.961 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:55:45.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:45 smithi107 ceph-mon[27622]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:45.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:45 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:47.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.236+0000 7fecd1477640 1 -- 172.21.15.129:0/63826966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feccc1021e0 msgr2=0x7feccc1025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:47.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.236+0000 7fecd1477640 1 --2- 172.21.15.129:0/63826966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feccc1021e0 0x7feccc1025b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fecbc004850 tx=0x7fecbc009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:47.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.236+0000 7fecd1477640 1 -- 172.21.15.129:0/63826966 shutdown_connections 2024-09-21T07:55:47.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.237+0000 7fecd1477640 1 --2- 172.21.15.129:0/63826966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feccc1021e0 0x7feccc1025b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:47.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.237+0000 7fecd1477640 1 -- 172.21.15.129:0/63826966 >> 172.21.15.129:0/63826966 conn(0x7feccc0f7d90 msgr2=0x7feccc0fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:47.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.237+0000 7fecd1477640 1 -- 172.21.15.129:0/63826966 shutdown_connections 2024-09-21T07:55:47.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.237+0000 7fecd1477640 1 -- 172.21.15.129:0/63826966 wait complete. 2024-09-21T07:55:47.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.237+0000 7fecd1477640 1 Processor -- start 2024-09-21T07:55:47.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.237+0000 7fecd1477640 1 -- start start 2024-09-21T07:55:47.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.237+0000 7fecd1477640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feccc1021e0 0x7feccc112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:47.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.237+0000 7fecd1477640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc112cc0 con 0x7feccc1021e0 2024-09-21T07:55:47.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.238+0000 7feccaffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feccc1021e0 0x7feccc112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:47.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.238+0000 7feccaffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feccc1021e0 0x7feccc112780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.129:47262/0 (socket says 172.21.15.129:47262) 2024-09-21T07:55:47.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.238+0000 7feccaffd640 1 -- 172.21.15.129:0/3598172207 learned_addr learned my addr 172.21.15.129:0/3598172207 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:55:47.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.238+0000 7feccaffd640 1 -- 172.21.15.129:0/3598172207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc005040 con 0x7feccc1021e0 2024-09-21T07:55:47.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.238+0000 7feccaffd640 1 --2- 172.21.15.129:0/3598172207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feccc1021e0 0x7feccc112780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fecbc02a6d0 tx=0x7fecbc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:47.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.238+0000 7fecc3fff640 1 -- 172.21.15.129:0/3598172207 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fecbc02cf10 con 0x7feccc1021e0 2024-09-21T07:55:47.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.238+0000 7fecd1477640 1 -- 172.21.15.129:0/3598172207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feccc112ec0 con 0x7feccc1021e0 2024-09-21T07:55:47.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.238+0000 7fecc3fff640 1 -- 172.21.15.129:0/3598172207 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fecbc033ad0 con 0x7feccc1021e0 2024-09-21T07:55:47.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.238+0000 7fecc3fff640 1 -- 172.21.15.129:0/3598172207 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fecbc03ebb0 con 0x7feccc1021e0 2024-09-21T07:55:47.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.238+0000 7fecd1477640 1 -- 172.21.15.129:0/3598172207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feccc113390 con 0x7feccc1021e0 2024-09-21T07:55:47.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.239+0000 7fecd1477640 1 -- 172.21.15.129:0/3598172207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feccc0fd950 con 0x7feccc1021e0 2024-09-21T07:55:47.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.240+0000 7fecc3fff640 1 -- 172.21.15.129:0/3598172207 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7fecbc030020 con 0x7feccc1021e0 2024-09-21T07:55:47.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.240+0000 7fecc3fff640 1 --2- 172.21.15.129:0/3598172207 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fecb806eca0 0x7fecb8071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:47.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.240+0000 7fecc3fff640 1 -- 172.21.15.129:0/3598172207 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fecbc0ad620 con 0x7feccc1021e0 2024-09-21T07:55:47.261 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.241+0000 7fecc27fc640 1 --2- 172.21.15.129:0/3598172207 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fecb806eca0 0x7fecb8071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:47.261 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.241+0000 7fecc27fc640 1 --2- 172.21.15.129:0/3598172207 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fecb806eca0 0x7fecb8071150 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fecb4006fd0 tx=0x7fecb4006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:47.261 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.245+0000 7fecc3fff640 1 -- 172.21.15.129:0/3598172207 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fecbc07b820 con 0x7feccc1021e0 2024-09-21T07:55:47.390 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.388+0000 7fecc3fff640 1 -- 172.21.15.129:0/3598172207 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecbc07b820 con 0x7feccc1021e0 2024-09-21T07:55:47.411 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:47 smithi129 bash[34377]: d9680c5a5b92c2521bd1a9fed9446e5a8417287d897f6202db5317119c6b4c03 2024-09-21T07:55:47.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:47.474+0000 7fecd1477640 1 -- 172.21.15.129:0/3598172207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7feccc113390 con 0x7feccc1021e0 2024-09-21T07:55:47.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:47 smithi107 ceph-mon[27622]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:47.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:47 smithi107 ceph-mon[27622]: Standby manager daemon smithi129.wvlmvo started 2024-09-21T07:55:47.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:47 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.129:0/3664478084' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi129.wvlmvo/crt"}]: dispatch 2024-09-21T07:55:47.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:47 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.129:0/3664478084' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T07:55:47.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:47 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.129:0/3664478084' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi129.wvlmvo/key"}]: dispatch 2024-09-21T07:55:47.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:47 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.129:0/3664478084' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T07:55:47.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:47 smithi129 systemd[1]: Started Ceph mon.smithi129 for 786d4f32-77ee-11ef-baf6-efdc52797490. 2024-09-21T07:55:52.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:52.400+0000 7fecc3fff640 1 -- 172.21.15.129:0/3598172207 <== mon.0 v2:172.21.15.107:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1021 (secure 0 0 0) 0x7feccc113390 con 0x7feccc1021e0 2024-09-21T07:55:52.402 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:55:52.402 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":2,"fsid":"786d4f32-77ee-11ef-baf6-efdc52797490","modified":"2024-09-21T07:55:47.387739Z","created":"2024-09-21T07:53:19.696564Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi107","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi129","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:3300","nonce":0},{"type":"v1","addr":"172.21.15.129:6789","nonce":0}]},"addr":"172.21.15.129:6789/0","public_addr":"172.21.15.129:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T07:55:52.402 INFO:teuthology.orchestra.run.smithi129.stderr:dumped monmap epoch 2 2024-09-21T07:55:52.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:52.402+0000 7fecd1477640 1 -- 172.21.15.129:0/3598172207 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fecb806eca0 msgr2=0x7fecb8071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:52.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:52.402+0000 7fecd1477640 1 --2- 172.21.15.129:0/3598172207 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fecb806eca0 0x7fecb8071150 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fecb4006fd0 tx=0x7fecb4006db0 comp rx=0 tx=0).stop 2024-09-21T07:55:52.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:52.402+0000 7fecd1477640 1 -- 172.21.15.129:0/3598172207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feccc1021e0 msgr2=0x7feccc112780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:52.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:52.402+0000 7fecd1477640 1 --2- 172.21.15.129:0/3598172207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feccc1021e0 0x7feccc112780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fecbc02a6d0 tx=0x7fecbc009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:52.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:52.403+0000 7fecd1477640 1 -- 172.21.15.129:0/3598172207 shutdown_connections 2024-09-21T07:55:52.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:52.403+0000 7fecd1477640 1 --2- 172.21.15.129:0/3598172207 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fecb806eca0 0x7fecb8071150 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:52.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:52.403+0000 7fecd1477640 1 --2- 172.21.15.129:0/3598172207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feccc1021e0 0x7feccc112780 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:52.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:52.403+0000 7fecd1477640 1 -- 172.21.15.129:0/3598172207 >> 172.21.15.129:0/3598172207 conn(0x7feccc0f7d90 msgr2=0x7feccc0f95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:52.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:52.403+0000 7fecd1477640 1 -- 172.21.15.129:0/3598172207 shutdown_connections 2024-09-21T07:55:52.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:55:52.403+0000 7fecd1477640 1 -- 172.21.15.129:0/3598172207 wait complete. 2024-09-21T07:55:52.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-21T07:55:52.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: mon.smithi107 calling monitor election 2024-09-21T07:55:52.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T07:55:52.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: from='client.? 172.21.15.129:0/3598172207' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T07:55:52.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:52.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T07:55:52.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T07:55:52.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: mon.smithi129 calling monitor election 2024-09-21T07:55:52.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:52.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T07:55:52.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T07:55:52.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T07:55:52.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: mon.smithi107 is new leader, mons smithi107,smithi129 in quorum (ranks 0,1) 2024-09-21T07:55:52.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: monmap e2: 2 mons at {smithi107=[v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0],smithi129=[v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-21T07:55:52.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: fsmap 2024-09-21T07:55:52.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T07:55:52.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: mgrmap e18: smithi107.wzulxb(active, since 28s), standbys: smithi129.wvlmvo 2024-09-21T07:55:52.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: overall HEALTH_OK 2024-09-21T07:55:52.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:52.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:52.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:52.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:52.769 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:52 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:52.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-21T07:55:52.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: mon.smithi107 calling monitor election 2024-09-21T07:55:52.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T07:55:52.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: from='client.? 172.21.15.129:0/3598172207' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T07:55:52.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:52.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T07:55:52.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T07:55:52.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: mon.smithi129 calling monitor election 2024-09-21T07:55:52.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:52.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T07:55:52.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T07:55:52.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T07:55:52.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: mon.smithi107 is new leader, mons smithi107,smithi129 in quorum (ranks 0,1) 2024-09-21T07:55:52.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: monmap e2: 2 mons at {smithi107=[v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0],smithi129=[v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-21T07:55:52.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: fsmap 2024-09-21T07:55:52.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T07:55:52.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: mgrmap e18: smithi107.wzulxb(active, since 28s), standbys: smithi129.wvlmvo 2024-09-21T07:55:52.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: overall HEALTH_OK 2024-09-21T07:55:52.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:52.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:52.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:52.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:52.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:52 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:53.093 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T07:55:53.094 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T07:55:53.348 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:55:53.715 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:53 smithi129 ceph-mon[34472]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:53.716 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:53 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:55:53.716 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:53 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T07:55:53.782 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:53 smithi107 ceph-mon[27622]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:53.782 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:53 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:55:53.782 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:53 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T07:55:54.716 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:54 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:55:54.717 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:54 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:54.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:54 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:55:54.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:54 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:54.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.956+0000 7f36d5d55640 1 -- 172.21.15.107:0/3488755634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36d01010e0 msgr2=0x7f36d01014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:54.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.956+0000 7f36d5d55640 1 --2- 172.21.15.107:0/3488755634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36d01010e0 0x7f36d01014b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f36c0004850 tx=0x7f36c0009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:54.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.956+0000 7f36d5d55640 1 -- 172.21.15.107:0/3488755634 shutdown_connections 2024-09-21T07:55:54.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.956+0000 7f36d5d55640 1 --2- 172.21.15.107:0/3488755634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36d01010e0 0x7f36d01014b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:54.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.956+0000 7f36d5d55640 1 -- 172.21.15.107:0/3488755634 >> 172.21.15.107:0/3488755634 conn(0x7f36d00710b0 msgr2=0x7f36d00714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:54.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.956+0000 7f36d5d55640 1 -- 172.21.15.107:0/3488755634 shutdown_connections 2024-09-21T07:55:54.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.956+0000 7f36d5d55640 1 -- 172.21.15.107:0/3488755634 wait complete. 2024-09-21T07:55:54.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.956+0000 7f36d5d55640 1 Processor -- start 2024-09-21T07:55:54.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.957+0000 7f36d5d55640 1 -- start start 2024-09-21T07:55:54.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.957+0000 7f36d5d55640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f36d01010e0 0x7f36d0111790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:54.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.957+0000 7f36d5d55640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36d0111cd0 0x7f36d010b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:54.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.957+0000 7f36d5d55640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d0112290 con 0x7f36d0111cd0 2024-09-21T07:55:54.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.957+0000 7f36d5d55640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d01123d0 con 0x7f36d01010e0 2024-09-21T07:55:54.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.957+0000 7f36ceffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36d0111cd0 0x7f36d010b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:54.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.957+0000 7f36ceffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36d0111cd0 0x7f36d010b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49458/0 (socket says 172.21.15.107:49458) 2024-09-21T07:55:54.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.957+0000 7f36ceffd640 1 -- 172.21.15.107:0/1286493381 learned_addr learned my addr 172.21.15.107:0/1286493381 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:55:54.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.957+0000 7f36cf7fe640 1 --2- 172.21.15.107:0/1286493381 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f36d01010e0 0x7f36d0111790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:54.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.957+0000 7f36cf7fe640 1 -- 172.21.15.107:0/1286493381 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f36d01010e0 msgr2=0x7f36d0111790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-21T07:55:54.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.957+0000 7f36cf7fe640 1 -- 172.21.15.107:0/1286493381 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f36d01010e0 msgr2=0x7f36d0111790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T07:55:54.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.957+0000 7f36cf7fe640 1 --2- 172.21.15.107:0/1286493381 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f36d01010e0 0x7f36d0111790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-21T07:55:55.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.957+0000 7f36ceffd640 1 -- 172.21.15.107:0/1286493381 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f36d01010e0 msgr2=0x7f36d0111790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:55:55.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.957+0000 7f36cf7fe640 1 --2- 172.21.15.107:0/1286493381 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f36d01010e0 0x7f36d0111790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T07:55:55.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.957+0000 7f36ceffd640 1 --2- 172.21.15.107:0/1286493381 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f36d01010e0 0x7f36d0111790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.957+0000 7f36ceffd640 1 -- 172.21.15.107:0/1286493381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c0005040 con 0x7f36d0111cd0 2024-09-21T07:55:55.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.957+0000 7f36ceffd640 1 --2- 172.21.15.107:0/1286493381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36d0111cd0 0x7f36d010b730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f36c400daf0 tx=0x7f36c400b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:55.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.958+0000 7f36b7fff640 1 -- 172.21.15.107:0/1286493381 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36c400ee30 con 0x7f36d0111cd0 2024-09-21T07:55:55.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.958+0000 7f36d5d55640 1 -- 172.21.15.107:0/1286493381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d010bd30 con 0x7f36d0111cd0 2024-09-21T07:55:55.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.958+0000 7f36b7fff640 1 -- 172.21.15.107:0/1286493381 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f36c40168e0 con 0x7f36d0111cd0 2024-09-21T07:55:55.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.958+0000 7f36b7fff640 1 -- 172.21.15.107:0/1286493381 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36c4015a20 con 0x7f36d0111cd0 2024-09-21T07:55:55.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.958+0000 7f36d5d55640 1 -- 172.21.15.107:0/1286493381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d010c250 con 0x7f36d0111cd0 2024-09-21T07:55:55.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.959+0000 7f36d5d55640 1 -- 172.21.15.107:0/1286493381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d010c580 con 0x7f36d0111cd0 2024-09-21T07:55:55.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.959+0000 7f36b7fff640 1 -- 172.21.15.107:0/1286493381 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f36c4016a50 con 0x7f36d0111cd0 2024-09-21T07:55:55.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.960+0000 7f36b7fff640 1 --2- 172.21.15.107:0/1286493381 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f36b806edd0 0x7f36b8071280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:55.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.960+0000 7f36cf7fe640 1 --2- 172.21.15.107:0/1286493381 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f36b806edd0 0x7f36b8071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:55.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.960+0000 7f36b7fff640 1 -- 172.21.15.107:0/1286493381 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f36c408f330 con 0x7f36d0111cd0 2024-09-21T07:55:55.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.960+0000 7f36cf7fe640 1 --2- 172.21.15.107:0/1286493381 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f36b806edd0 0x7f36b8071280 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f36c0032430 tx=0x7f36c0009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:55.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:54.964+0000 7f36b7fff640 1 -- 172.21.15.107:0/1286493381 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f36c40502a0 con 0x7f36d0111cd0 2024-09-21T07:55:55.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:55.176+0000 7f36d5d55640 1 -- 172.21.15.107:0/1286493381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f36d00fc850 con 0x7f36d0111cd0 2024-09-21T07:55:55.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:55.176+0000 7f36b7fff640 1 -- 172.21.15.107:0/1286493381 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7f36c401b090 con 0x7f36d0111cd0 2024-09-21T07:55:55.178 INFO:teuthology.orchestra.run.smithi107.stdout:# minimal ceph.conf for 786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T07:55:55.179 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2024-09-21T07:55:55.179 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = 786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T07:55:55.179 INFO:teuthology.orchestra.run.smithi107.stdout: mon_host = [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] 2024-09-21T07:55:55.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:55.178+0000 7f36d5d55640 1 -- 172.21.15.107:0/1286493381 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f36b806edd0 msgr2=0x7f36b8071280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:55.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:55.178+0000 7f36d5d55640 1 --2- 172.21.15.107:0/1286493381 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f36b806edd0 0x7f36b8071280 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f36c0032430 tx=0x7f36c0009da0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:55.178+0000 7f36d5d55640 1 -- 172.21.15.107:0/1286493381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36d0111cd0 msgr2=0x7f36d010b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:55.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:55.178+0000 7f36d5d55640 1 --2- 172.21.15.107:0/1286493381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36d0111cd0 0x7f36d010b730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f36c400daf0 tx=0x7f36c400b460 comp rx=0 tx=0).stop 2024-09-21T07:55:55.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:55.178+0000 7f36d5d55640 1 -- 172.21.15.107:0/1286493381 shutdown_connections 2024-09-21T07:55:55.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:55.178+0000 7f36d5d55640 1 --2- 172.21.15.107:0/1286493381 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f36b806edd0 0x7f36b8071280 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:55.178+0000 7f36d5d55640 1 --2- 172.21.15.107:0/1286493381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36d0111cd0 0x7f36d010b730 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:55.178+0000 7f36d5d55640 1 --2- 172.21.15.107:0/1286493381 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f36d01010e0 0x7f36d0111790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:55.178+0000 7f36d5d55640 1 -- 172.21.15.107:0/1286493381 >> 172.21.15.107:0/1286493381 conn(0x7f36d00710b0 msgr2=0x7f36d00fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:55.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:55.179+0000 7f36d5d55640 1 -- 172.21.15.107:0/1286493381 shutdown_connections 2024-09-21T07:55:55.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:55:55.179+0000 7f36d5d55640 1 -- 172.21.15.107:0/1286493381 wait complete. 2024-09-21T07:55:55.769 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:55 smithi107 ceph-mon[27622]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:55.769 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:55 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:55.769 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:55 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:55.769 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:55 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:55:55.770 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:55 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:55:55.770 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:55 smithi107 ceph-mon[27622]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-21T07:55:55.770 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:55 smithi107 ceph-mon[27622]: Updating smithi129:/etc/ceph/ceph.conf 2024-09-21T07:55:55.770 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:55 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:55.770 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:55 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:55.770 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:55 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:55.770 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:55 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:55.770 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:55 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:55.770 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:55 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1286493381' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:55:55.770 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:55 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T07:55:55.770 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:55 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T07:55:55.770 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:55 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:55:55.795 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T07:55:55.795 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-21T07:55:55.795 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T07:55:55.825 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-21T07:55:55.826 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:55:55.891 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T07:55:55.891 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T07:55:55.917 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:55 smithi129 ceph-mon[34472]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:55.917 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:55 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:55.917 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:55 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:55.917 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:55 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:55:55.917 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:55 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:55:55.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:55 smithi129 ceph-mon[34472]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-21T07:55:55.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:55 smithi129 ceph-mon[34472]: Updating smithi129:/etc/ceph/ceph.conf 2024-09-21T07:55:55.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:55 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:55.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:55 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:55.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:55 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:55.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:55 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:55.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:55 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:55.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:55 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/1286493381' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:55:55.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:55 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T07:55:55.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:55 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T07:55:55.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:55 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:55:55.919 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T07:55:55.919 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:55:55.984 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T07:55:55.984 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-21T07:55:55.984 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:55:56.000 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:55:56.000 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-09-21T07:55:56.055 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:55:56.056 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:55:56.056 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T07:55:56.056 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:55:56.056 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:55:56.056 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-21 07:55:18.174628119 +0000 2024-09-21T07:55:56.056 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-21 07:50:00.698157397 +0000 2024-09-21T07:55:56.056 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-21 07:50:00.698157397 +0000 2024-09-21T07:55:56.056 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-21 07:50:00.698157397 +0000 2024-09-21T07:55:56.056 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:55:56.119 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-21T07:55:56.120 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-21T07:55:56.120 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000284076 s, 1.8 MB/s 2024-09-21T07:55:56.121 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:55:56.177 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-09-21T07:55:56.233 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:55:56.233 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:55:56.233 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-21T07:55:56.233 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:55:56.233 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:55:56.234 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-21 07:55:18.174628119 +0000 2024-09-21T07:55:56.234 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-21 07:50:01.025151905 +0000 2024-09-21T07:55:56.234 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-21 07:50:01.025151905 +0000 2024-09-21T07:55:56.234 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-21 07:50:01.025151905 +0000 2024-09-21T07:55:56.234 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:55:56.296 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-21T07:55:56.297 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-21T07:55:56.297 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000215587 s, 2.4 MB/s 2024-09-21T07:55:56.298 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:55:56.354 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-09-21T07:55:56.409 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:55:56.409 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:55:56.410 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T07:55:56.410 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:55:56.410 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:55:56.410 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-21 07:55:18.174628119 +0000 2024-09-21T07:55:56.410 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-21 07:50:01.357146330 +0000 2024-09-21T07:55:56.410 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-21 07:50:01.357146330 +0000 2024-09-21T07:55:56.410 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-21 07:50:01.357146330 +0000 2024-09-21T07:55:56.410 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:55:56.472 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-21T07:55:56.473 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-21T07:55:56.473 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000208526 s, 2.5 MB/s 2024-09-21T07:55:56.474 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:55:56.530 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-09-21T07:55:56.586 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:55:56.586 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:55:56.586 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-21T07:55:56.586 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:55:56.586 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:55:56.586 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-21 07:55:18.175628103 +0000 2024-09-21T07:55:56.586 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-21 07:50:01.684140838 +0000 2024-09-21T07:55:56.587 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-21 07:50:01.684140838 +0000 2024-09-21T07:55:56.587 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-21 07:50:01.684140838 +0000 2024-09-21T07:55:56.587 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:55:56.649 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-21T07:55:56.650 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-21T07:55:56.650 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000209981 s, 2.4 MB/s 2024-09-21T07:55:56.651 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:55:56.707 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T07:55:56.708 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:55:56.725 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:55:56.725 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_1 2024-09-21T07:55:56.782 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:55:56.782 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:55:56.782 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T07:55:56.782 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:55:56.782 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:55:56.782 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-09-21 07:55:45.991291508 +0000 2024-09-21T07:55:56.782 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-09-21 07:50:10.565453325 +0000 2024-09-21T07:55:56.782 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-09-21 07:50:10.565453325 +0000 2024-09-21T07:55:56.783 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-09-21 07:50:10.565453325 +0000 2024-09-21T07:55:56.783 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:55:56.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:56 smithi107 ceph-mon[27622]: Updating smithi107:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:55:56.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:56 smithi107 ceph-mon[27622]: Updating smithi129:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:55:56.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:56 smithi107 ceph-mon[27622]: Reconfiguring mon.smithi107 (unknown last config time)... 2024-09-21T07:55:56.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:56 smithi107 ceph-mon[27622]: Reconfiguring daemon mon.smithi107 on smithi107 2024-09-21T07:55:56.848 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-09-21T07:55:56.849 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-09-21T07:55:56.849 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000352283 s, 1.5 MB/s 2024-09-21T07:55:56.850 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:55:56.908 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_2 2024-09-21T07:55:56.964 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:55:56.965 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:55:56.965 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T07:55:56.965 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:55:56.965 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:55:56.965 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-09-21 07:55:45.992291486 +0000 2024-09-21T07:55:56.965 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-09-21 07:50:10.895446159 +0000 2024-09-21T07:55:56.965 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-09-21 07:50:10.895446159 +0000 2024-09-21T07:55:56.965 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-09-21 07:50:10.895446159 +0000 2024-09-21T07:55:56.965 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:55:57.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:56 smithi129 ceph-mon[34472]: Updating smithi107:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:55:57.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:56 smithi129 ceph-mon[34472]: Updating smithi129:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:55:57.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:56 smithi129 ceph-mon[34472]: Reconfiguring mon.smithi107 (unknown last config time)... 2024-09-21T07:55:57.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:56 smithi129 ceph-mon[34472]: Reconfiguring daemon mon.smithi107 on smithi107 2024-09-21T07:55:57.029 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-09-21T07:55:57.029 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-09-21T07:55:57.029 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000248302 s, 2.1 MB/s 2024-09-21T07:55:57.030 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:55:57.087 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_3 2024-09-21T07:55:57.143 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:55:57.143 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:55:57.143 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T07:55:57.143 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:55:57.143 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:55:57.143 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-09-21 07:55:45.992291486 +0000 2024-09-21T07:55:57.143 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-09-21 07:50:11.223439036 +0000 2024-09-21T07:55:57.143 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-09-21 07:50:11.223439036 +0000 2024-09-21T07:55:57.143 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-09-21 07:50:11.223439036 +0000 2024-09-21T07:55:57.143 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:55:57.207 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-09-21T07:55:57.207 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-09-21T07:55:57.207 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.00023028 s, 2.2 MB/s 2024-09-21T07:55:57.208 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:55:57.265 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_4 2024-09-21T07:55:57.321 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:55:57.321 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:55:57.321 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-21T07:55:57.321 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:55:57.321 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:55:57.321 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-09-21 07:55:45.993291465 +0000 2024-09-21T07:55:57.321 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-09-21 07:50:11.558431761 +0000 2024-09-21T07:55:57.322 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-09-21 07:50:11.558431761 +0000 2024-09-21T07:55:57.322 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-09-21 07:50:11.558431761 +0000 2024-09-21T07:55:57.322 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:55:57.384 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-09-21T07:55:57.384 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-09-21T07:55:57.385 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000217082 s, 2.4 MB/s 2024-09-21T07:55:57.386 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:55:57.442 INFO:tasks.cephadm:Deploying osd.0 on smithi107 with /dev/vg_nvme/lv_4... 2024-09-21T07:55:57.442 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T07:55:57.925 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:57 smithi107 ceph-mon[27622]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:57.925 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:57 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:57.925 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:57 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:57.925 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:57 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi107.wzulxb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T07:55:57.925 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:57 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T07:55:57.925 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:57 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:55:58.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:57 smithi129 ceph-mon[34472]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:58.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:57 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:58.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:57 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:58.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:57 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi107.wzulxb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T07:55:58.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:57 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T07:55:58.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:57 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:55:58.323 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:55:58.802 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:58 smithi107 ceph-mon[27622]: Reconfiguring mgr.smithi107.wzulxb (unknown last config time)... 2024-09-21T07:55:58.802 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:58 smithi107 ceph-mon[27622]: Reconfiguring daemon mgr.smithi107.wzulxb on smithi107 2024-09-21T07:55:58.802 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:58.803 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:58.803 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi107", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T07:55:58.803 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:55:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:58 smithi129 ceph-mon[34472]: Reconfiguring mgr.smithi107.wzulxb (unknown last config time)... 2024-09-21T07:55:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:58 smithi129 ceph-mon[34472]: Reconfiguring daemon mgr.smithi107.wzulxb on smithi107 2024-09-21T07:55:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:55:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi107", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T07:55:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:55:59.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:59 smithi107 ceph-mon[27622]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:55:59.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:59 smithi107 ceph-mon[27622]: Reconfiguring crash.smithi107 (monmap changed)... 2024-09-21T07:55:59.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:55:59 smithi107 ceph-mon[27622]: Reconfiguring daemon crash.smithi107 on smithi107 2024-09-21T07:56:00.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:59 smithi129 ceph-mon[34472]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:00.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:59 smithi129 ceph-mon[34472]: Reconfiguring crash.smithi107 (monmap changed)... 2024-09-21T07:56:00.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:55:59 smithi129 ceph-mon[34472]: Reconfiguring daemon crash.smithi107 on smithi107 2024-09-21T07:56:01.729 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:01 smithi107 ceph-mon[27622]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:01.730 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:01 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:01.730 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:01 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:01.730 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:01 smithi107 ceph-mon[27622]: Reconfiguring alertmanager.smithi107 (dependencies changed)... 2024-09-21T07:56:01.730 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:01 smithi107 ceph-mon[27622]: Reconfiguring daemon alertmanager.smithi107 on smithi107 2024-09-21T07:56:01.734 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:56:01.753 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi107:vg_nvme/lv_4 2024-09-21T07:56:01.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:01 smithi129 ceph-mon[34472]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:01.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:01 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:01.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:01 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:01.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:01 smithi129 ceph-mon[34472]: Reconfiguring alertmanager.smithi107 (dependencies changed)... 2024-09-21T07:56:01.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:01 smithi129 ceph-mon[34472]: Reconfiguring daemon alertmanager.smithi107 on smithi107 2024-09-21T07:56:03.530 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:03 smithi107 ceph-mon[27622]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:03.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:03 smithi129 ceph-mon[34472]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:03.828 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:56:05.659 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:05 smithi107 ceph-mon[27622]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:05.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:05 smithi129 ceph-mon[34472]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:05.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.870+0000 7fe159908640 1 -- 172.21.15.107:0/3697245660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1540fd820 msgr2=0x7fe1540fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:05.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.870+0000 7fe159908640 1 --2- 172.21.15.107:0/3697245660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1540fd820 0x7fe1540fdc90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0048d0 tx=0x7fe13c009da0 comp rx=0 tx=0).stop 2024-09-21T07:56:05.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.870+0000 7fe159908640 1 -- 172.21.15.107:0/3697245660 shutdown_connections 2024-09-21T07:56:05.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.870+0000 7fe159908640 1 --2- 172.21.15.107:0/3697245660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1540fd820 0x7fe1540fdc90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:05.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.870+0000 7fe159908640 1 --2- 172.21.15.107:0/3697245660 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe1540fc550 0x7fe1540fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:05.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.870+0000 7fe159908640 1 -- 172.21.15.107:0/3697245660 >> 172.21.15.107:0/3697245660 conn(0x7fe1540f7d30 msgr2=0x7fe1540fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:05.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.870+0000 7fe159908640 1 -- 172.21.15.107:0/3697245660 shutdown_connections 2024-09-21T07:56:05.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.870+0000 7fe159908640 1 -- 172.21.15.107:0/3697245660 wait complete. 2024-09-21T07:56:05.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.871+0000 7fe159908640 1 Processor -- start 2024-09-21T07:56:05.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.871+0000 7fe159908640 1 -- start start 2024-09-21T07:56:05.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.871+0000 7fe159908640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1540fc550 0x7fe154071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:05.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.871+0000 7fe159908640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe1540fd820 0x7fe15406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:05.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.871+0000 7fe159908640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15406fff0 con 0x7fe1540fc550 2024-09-21T07:56:05.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.871+0000 7fe159908640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe154070130 con 0x7fe1540fd820 2024-09-21T07:56:05.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.871+0000 7fe152ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1540fc550 0x7fe154071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:05.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.871+0000 7fe152ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1540fc550 0x7fe154071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58324/0 (socket says 172.21.15.107:58324) 2024-09-21T07:56:05.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.871+0000 7fe152ffd640 1 -- 172.21.15.107:0/308307679 learned_addr learned my addr 172.21.15.107:0/308307679 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:56:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.871+0000 7fe14a7fc640 1 --2- 172.21.15.107:0/308307679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe1540fd820 0x7fe15406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.872+0000 7fe152ffd640 1 -- 172.21.15.107:0/308307679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe1540fd820 msgr2=0x7fe15406fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.872+0000 7fe152ffd640 1 --2- 172.21.15.107:0/308307679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe1540fd820 0x7fe15406fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.872+0000 7fe152ffd640 1 -- 172.21.15.107:0/308307679 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c005040 con 0x7fe1540fc550 2024-09-21T07:56:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.872+0000 7fe152ffd640 1 --2- 172.21.15.107:0/308307679 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1540fc550 0x7fe154071570 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe144002a50 tx=0x7fe144004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.872+0000 7fe14bfff640 1 -- 172.21.15.107:0/308307679 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe144007c30 con 0x7fe1540fc550 2024-09-21T07:56:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.872+0000 7fe14bfff640 1 -- 172.21.15.107:0/308307679 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe14400f040 con 0x7fe1540fc550 2024-09-21T07:56:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.872+0000 7fe159908640 1 -- 172.21.15.107:0/308307679 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe154070410 con 0x7fe1540fc550 2024-09-21T07:56:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.872+0000 7fe14bfff640 1 -- 172.21.15.107:0/308307679 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe14400da90 con 0x7fe1540fc550 2024-09-21T07:56:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.872+0000 7fe159908640 1 -- 172.21.15.107:0/308307679 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe154115100 con 0x7fe1540fc550 2024-09-21T07:56:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.873+0000 7fe159908640 1 -- 172.21.15.107:0/308307679 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1540fb9b0 con 0x7fe1540fc550 2024-09-21T07:56:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.873+0000 7fe14bfff640 1 -- 172.21.15.107:0/308307679 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7fe14400dc30 con 0x7fe1540fc550 2024-09-21T07:56:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.874+0000 7fe14bfff640 1 --2- 172.21.15.107:0/308307679 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe14006ecc0 0x7fe140071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.874+0000 7fe14bfff640 1 -- 172.21.15.107:0/308307679 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fe14408c8b0 con 0x7fe1540fc550 2024-09-21T07:56:05.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.874+0000 7fe14a7fc640 1 --2- 172.21.15.107:0/308307679 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe14006ecc0 0x7fe140071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:05.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.875+0000 7fe14a7fc640 1 --2- 172.21.15.107:0/308307679 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe14006ecc0 0x7fe140071170 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe13c007ac0 tx=0x7fe13c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:05.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:05.879+0000 7fe14bfff640 1 -- 172.21.15.107:0/308307679 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe14404d2a0 con 0x7fe1540fc550 2024-09-21T07:56:06.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:06.052+0000 7fe159908640 1 -- 172.21.15.107:0/308307679 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe154101c40 con 0x7fe14006ecc0 2024-09-21T07:56:06.697 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:06 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T07:56:06.697 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:06 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T07:56:06.698 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:06 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:56:06.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:06 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T07:56:06.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:06 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T07:56:06.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:06 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:56:07.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:07 smithi129 ceph-mon[34472]: from='client.14236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:56:07.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:07 smithi129 ceph-mon[34472]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:07.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:07 smithi107 ceph-mon[27622]: from='client.14236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:56:07.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:07 smithi107 ceph-mon[27622]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:09.961 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:09 smithi107 ceph-mon[27622]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:09.961 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:09 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:09.962 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:09 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:09.962 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:09 smithi107 ceph-mon[27622]: Reconfiguring grafana.smithi107 (dependencies changed)... 2024-09-21T07:56:09.962 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:09 smithi107 ceph-mon[27622]: Reconfiguring daemon grafana.smithi107 on smithi107 2024-09-21T07:56:09.962 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:09 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:56:09.962 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:09 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/749684228' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b75c59ed-e2a3-4721-97b0-cd3109b895f4"}]: dispatch 2024-09-21T07:56:09.962 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:09 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/749684228' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b75c59ed-e2a3-4721-97b0-cd3109b895f4"}]': finished 2024-09-21T07:56:09.962 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:09 smithi107 ceph-mon[27622]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T07:56:09.963 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:09 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T07:56:10.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:09 smithi129 ceph-mon[34472]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:10.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:09 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:10.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:09 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:10.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:09 smithi129 ceph-mon[34472]: Reconfiguring grafana.smithi107 (dependencies changed)... 2024-09-21T07:56:10.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:09 smithi129 ceph-mon[34472]: Reconfiguring daemon grafana.smithi107 on smithi107 2024-09-21T07:56:10.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:09 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:56:10.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:09 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/749684228' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b75c59ed-e2a3-4721-97b0-cd3109b895f4"}]: dispatch 2024-09-21T07:56:10.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:09 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/749684228' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b75c59ed-e2a3-4721-97b0-cd3109b895f4"}]': finished 2024-09-21T07:56:10.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:09 smithi129 ceph-mon[34472]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T07:56:10.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:09 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T07:56:11.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:10 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/3255879075' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T07:56:11.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:10 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/3255879075' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T07:56:12.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:11 smithi129 ceph-mon[34472]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:12.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:11 smithi107 ceph-mon[27622]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:14.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:13 smithi129 ceph-mon[34472]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:14.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:13 smithi107 ceph-mon[27622]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:15.912 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:15 smithi107 ceph-mon[27622]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:16.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:15 smithi129 ceph-mon[34472]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:17.902 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:17 smithi107 ceph-mon[27622]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:18.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:17 smithi129 ceph-mon[34472]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:19.909 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:19 smithi107 ceph-mon[27622]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:19.909 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:19 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:19.909 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:19 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:20.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:19 smithi129 ceph-mon[34472]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:20.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:19 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:20.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:19 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:21.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:20 smithi129 ceph-mon[34472]: Reconfiguring prometheus.smithi107 (dependencies changed)... 2024-09-21T07:56:21.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:20 smithi129 ceph-mon[34472]: Reconfiguring daemon prometheus.smithi107 on smithi107 2024-09-21T07:56:21.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:20 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-21T07:56:21.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:20 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:56:21.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:20 smithi107 ceph-mon[27622]: Reconfiguring prometheus.smithi107 (dependencies changed)... 2024-09-21T07:56:21.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:20 smithi107 ceph-mon[27622]: Reconfiguring daemon prometheus.smithi107 on smithi107 2024-09-21T07:56:21.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:20 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-21T07:56:21.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:20 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:56:22.015 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:21 smithi107 ceph-mon[27622]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:22.015 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:21 smithi107 ceph-mon[27622]: Deploying daemon osd.0 on smithi107 2024-09-21T07:56:22.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:21 smithi129 ceph-mon[34472]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:22.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:21 smithi129 ceph-mon[34472]: Deploying daemon osd.0 on smithi107 2024-09-21T07:56:24.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:23 smithi129 ceph-mon[34472]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:24.050 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:23 smithi107 ceph-mon[27622]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:24.844 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:56:24.844 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:24.844 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:24.844 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi129", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T07:56:24.844 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:56:25.005 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:24 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:56:25.005 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:24 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:25.005 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:24 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:25.005 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:24 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi129", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T07:56:25.005 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:24 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:56:25.725 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:25 smithi129 ceph-mon[34472]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:25.725 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:25 smithi129 ceph-mon[34472]: Reconfiguring crash.smithi129 (monmap changed)... 2024-09-21T07:56:25.725 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:25 smithi129 ceph-mon[34472]: Reconfiguring daemon crash.smithi129 on smithi129 2024-09-21T07:56:25.870 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:25 smithi107 ceph-mon[27622]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:25.871 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:25 smithi107 ceph-mon[27622]: Reconfiguring crash.smithi129 (monmap changed)... 2024-09-21T07:56:25.871 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:25 smithi107 ceph-mon[27622]: Reconfiguring daemon crash.smithi129 on smithi129 2024-09-21T07:56:27.012 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:26 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:27.013 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:26 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:27.013 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:26 smithi107 ceph-mon[27622]: Reconfiguring mgr.smithi129.wvlmvo (monmap changed)... 2024-09-21T07:56:27.013 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:26 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi129.wvlmvo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T07:56:27.013 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:26 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T07:56:27.013 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:26 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:56:27.013 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:26 smithi107 ceph-mon[27622]: Reconfiguring daemon mgr.smithi129.wvlmvo on smithi129 2024-09-21T07:56:27.119 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:26 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:27.120 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:26 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:27.120 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:26 smithi129 ceph-mon[34472]: Reconfiguring mgr.smithi129.wvlmvo (monmap changed)... 2024-09-21T07:56:27.120 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:26 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi129.wvlmvo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T07:56:27.120 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:26 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T07:56:27.120 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:26 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:56:27.120 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:26 smithi129 ceph-mon[34472]: Reconfiguring daemon mgr.smithi129.wvlmvo on smithi129 2024-09-21T07:56:28.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:27 smithi129 ceph-mon[34472]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:28.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:27 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:28.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:27 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:28.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:27 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T07:56:28.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:27 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T07:56:28.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:27 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:56:28.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:27 smithi107 ceph-mon[27622]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:28.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:27 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:28.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:27 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:28.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:27 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T07:56:28.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:27 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T07:56:28.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:27 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:56:29.014 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:28 smithi107 ceph-mon[27622]: Reconfiguring mon.smithi129 (monmap changed)... 2024-09-21T07:56:29.014 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:28 smithi107 ceph-mon[27622]: Reconfiguring daemon mon.smithi129 on smithi129 2024-09-21T07:56:29.014 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:28 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:29.014 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:28 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:29.014 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:28 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T07:56:29.014 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:28 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi107.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T07:56:29.014 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:28 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:29.014 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:28 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T07:56:29.014 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:28 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi107.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T07:56:29.015 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:28 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:29.015 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:28 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T07:56:29.015 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:28 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi107.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T07:56:29.015 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:28 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:29.015 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:28 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:56:29.058 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:28 smithi129 ceph-mon[34472]: Reconfiguring mon.smithi129 (monmap changed)... 2024-09-21T07:56:29.058 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:28 smithi129 ceph-mon[34472]: Reconfiguring daemon mon.smithi129 on smithi129 2024-09-21T07:56:29.058 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:28 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:29.058 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:28 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:29.058 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:28 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T07:56:29.058 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:28 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi107.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T07:56:29.058 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:28 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:29.058 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:28 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T07:56:29.059 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:28 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi107.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T07:56:29.059 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:28 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:29.059 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:28 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T07:56:29.059 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:28 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi107.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T07:56:29.059 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:28 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:29.059 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:28 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:56:30.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:29 smithi129 ceph-mon[34472]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:30.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:29 smithi129 ceph-mon[34472]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T07:56:30.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:29 smithi129 ceph-mon[34472]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi107.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T07:56:30.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:29 smithi129 ceph-mon[34472]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T07:56:30.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:29 smithi129 ceph-mon[34472]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi107.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T07:56:30.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:29 smithi129 ceph-mon[34472]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T07:56:30.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:29 smithi129 ceph-mon[34472]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi107.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T07:56:30.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:29 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:30.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:29 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:30.023 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:29 smithi107 ceph-mon[27622]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:30.023 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:29 smithi107 ceph-mon[27622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T07:56:30.024 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:29 smithi107 ceph-mon[27622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi107.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T07:56:30.024 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:29 smithi107 ceph-mon[27622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T07:56:30.024 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:29 smithi107 ceph-mon[27622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi107.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T07:56:30.024 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:29 smithi107 ceph-mon[27622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T07:56:30.024 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:29 smithi107 ceph-mon[27622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi107.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T07:56:30.024 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:29 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:30.024 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:29 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:31.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:31 smithi129 ceph-mon[34472]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:31.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:31 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:31.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:31 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:31.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:31 smithi107 ceph-mon[27622]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:31.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:31 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:31.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:31 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:32.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:32.990+0000 7fe14bfff640 1 -- 172.21.15.107:0/308307679 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe154101c40 con 0x7fe14006ecc0 2024-09-21T07:56:32.992 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 0 on host 'smithi107' 2024-09-21T07:56:32.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:32.993+0000 7fe159908640 1 -- 172.21.15.107:0/308307679 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe14006ecc0 msgr2=0x7fe140071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:32.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:32.993+0000 7fe159908640 1 --2- 172.21.15.107:0/308307679 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe14006ecc0 0x7fe140071170 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe13c007ac0 tx=0x7fe13c035040 comp rx=0 tx=0).stop 2024-09-21T07:56:32.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:32.993+0000 7fe159908640 1 -- 172.21.15.107:0/308307679 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1540fc550 msgr2=0x7fe154071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:32.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:32.993+0000 7fe159908640 1 --2- 172.21.15.107:0/308307679 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1540fc550 0x7fe154071570 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe144002a50 tx=0x7fe144004600 comp rx=0 tx=0).stop 2024-09-21T07:56:32.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:32.993+0000 7fe159908640 1 -- 172.21.15.107:0/308307679 shutdown_connections 2024-09-21T07:56:32.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:32.993+0000 7fe159908640 1 --2- 172.21.15.107:0/308307679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe1540fd820 0x7fe15406fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:32.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:32.993+0000 7fe159908640 1 --2- 172.21.15.107:0/308307679 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe14006ecc0 0x7fe140071170 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:32.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:32.993+0000 7fe159908640 1 --2- 172.21.15.107:0/308307679 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1540fc550 0x7fe154071570 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:32.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:32.993+0000 7fe159908640 1 -- 172.21.15.107:0/308307679 >> 172.21.15.107:0/308307679 conn(0x7fe1540f7d30 msgr2=0x7fe1540f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:32.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:32.993+0000 7fe159908640 1 -- 172.21.15.107:0/308307679 shutdown_connections 2024-09-21T07:56:32.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:32.993+0000 7fe159908640 1 -- 172.21.15.107:0/308307679 wait complete. 2024-09-21T07:56:33.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:33 smithi107 ceph-mon[27622]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:33.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:33 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:33.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:33 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:33.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:33 smithi107 ceph-mon[27622]: from='osd.0 [v2:172.21.15.107:6802/373234429,v1:172.21.15.107:6803/373234429]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-21T07:56:33.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:33 smithi129 ceph-mon[34472]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:33.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:33 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:33.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:33 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:33.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:33 smithi129 ceph-mon[34472]: from='osd.0 [v2:172.21.15.107:6802/373234429,v1:172.21.15.107:6803/373234429]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-21T07:56:33.612 DEBUG:teuthology.orchestra.run.smithi107:osd.0> sudo journalctl -f -n 0 -u ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.0.service 2024-09-21T07:56:33.614 INFO:tasks.cephadm:Deploying osd.1 on smithi107 with /dev/vg_nvme/lv_3... 2024-09-21T07:56:33.614 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T07:56:33.988 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:56:35.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:34 smithi129 ceph-mon[34472]: from='osd.0 [v2:172.21.15.107:6802/373234429,v1:172.21.15.107:6803/373234429]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T07:56:35.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:34 smithi129 ceph-mon[34472]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T07:56:35.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:34 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T07:56:35.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:34 smithi129 ceph-mon[34472]: from='osd.0 [v2:172.21.15.107:6802/373234429,v1:172.21.15.107:6803/373234429]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-21T07:56:35.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:34 smithi129 ceph-mon[34472]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:35.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:34 smithi107 ceph-mon[27622]: from='osd.0 [v2:172.21.15.107:6802/373234429,v1:172.21.15.107:6803/373234429]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T07:56:35.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:34 smithi107 ceph-mon[27622]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T07:56:35.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:34 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T07:56:35.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:34 smithi107 ceph-mon[27622]: from='osd.0 [v2:172.21.15.107:6802/373234429,v1:172.21.15.107:6803/373234429]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-21T07:56:35.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:34 smithi107 ceph-mon[27622]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:35.305 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 07:56:35 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0[45651]: 2024-09-21T07:56:34.998+0000 7f12d0108640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T07:56:35.305 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 07:56:35 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0[45651]: 2024-09-21T07:56:35.002+0000 7f12c971a640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:56:36.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:36 smithi129 ceph-mon[34472]: from='osd.0 [v2:172.21.15.107:6802/373234429,v1:172.21.15.107:6803/373234429]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-21T07:56:36.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:36 smithi129 ceph-mon[34472]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T07:56:36.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:36 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T07:56:36.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:36 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T07:56:36.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:36 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:36.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:36 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:36.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:36 smithi107 ceph-mon[27622]: from='osd.0 [v2:172.21.15.107:6802/373234429,v1:172.21.15.107:6803/373234429]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-21T07:56:36.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:36 smithi107 ceph-mon[27622]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T07:56:36.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:36 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T07:56:36.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:36 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T07:56:36.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:36 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:36.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:36 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:37.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:37 smithi129 ceph-mon[34472]: purged_snaps scrub starts 2024-09-21T07:56:37.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:37 smithi129 ceph-mon[34472]: purged_snaps scrub ok 2024-09-21T07:56:37.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:37 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T07:56:37.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:37 smithi129 ceph-mon[34472]: osd.0 [v2:172.21.15.107:6802/373234429,v1:172.21.15.107:6803/373234429] boot 2024-09-21T07:56:37.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:37 smithi129 ceph-mon[34472]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T07:56:37.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:37 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T07:56:37.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:37 smithi129 ceph-mon[34472]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:37.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:37 smithi107 ceph-mon[27622]: purged_snaps scrub starts 2024-09-21T07:56:37.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:37 smithi107 ceph-mon[27622]: purged_snaps scrub ok 2024-09-21T07:56:37.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:37 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T07:56:37.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:37 smithi107 ceph-mon[27622]: osd.0 [v2:172.21.15.107:6802/373234429,v1:172.21.15.107:6803/373234429] boot 2024-09-21T07:56:37.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:37 smithi107 ceph-mon[27622]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T07:56:37.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:37 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T07:56:37.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:37 smithi107 ceph-mon[27622]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:56:38.126 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:56:38.146 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi107:vg_nvme/lv_3 2024-09-21T07:56:39.084 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:56:39.205 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:39 smithi107 ceph-mon[27622]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T07:56:39.205 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:39 smithi107 ceph-mon[27622]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:56:39.363 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:39 smithi129 ceph-mon[34472]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T07:56:39.363 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:39 smithi129 ceph-mon[34472]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:56:40.283 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:40 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:56:40.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:40 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:56:40.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.607+0000 7f647cf68640 1 -- 172.21.15.107:0/959343175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6478065bc0 msgr2=0x7f64781015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:40.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.607+0000 7f647cf68640 1 --2- 172.21.15.107:0/959343175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6478065bc0 0x7f64781015c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6468009c50 tx=0x7f6468004d10 comp rx=0 tx=0).stop 2024-09-21T07:56:40.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.607+0000 7f647cf68640 1 -- 172.21.15.107:0/959343175 shutdown_connections 2024-09-21T07:56:40.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.607+0000 7f647cf68640 1 --2- 172.21.15.107:0/959343175 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6478101b00 0x7f6478103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.607+0000 7f647cf68640 1 --2- 172.21.15.107:0/959343175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6478065bc0 0x7f64781015c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.607+0000 7f647cf68640 1 -- 172.21.15.107:0/959343175 >> 172.21.15.107:0/959343175 conn(0x7f64780f6c10 msgr2=0x7f64780f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:40.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.607+0000 7f647cf68640 1 -- 172.21.15.107:0/959343175 shutdown_connections 2024-09-21T07:56:40.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.607+0000 7f647cf68640 1 -- 172.21.15.107:0/959343175 wait complete. 2024-09-21T07:56:40.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.607+0000 7f647cf68640 1 Processor -- start 2024-09-21T07:56:40.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.607+0000 7f647cf68640 1 -- start start 2024-09-21T07:56:40.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.607+0000 7f647cf68640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6478065bc0 0x7f647810f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.607+0000 7f647cf68640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6478101b00 0x7f647810f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.607+0000 7f647cf68640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64781106b0 con 0x7f6478101b00 2024-09-21T07:56:40.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.607+0000 7f647cf68640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6478110820 con 0x7f6478065bc0 2024-09-21T07:56:40.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.608+0000 7f6475d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6478101b00 0x7f647810f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:40.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.608+0000 7f6475d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6478101b00 0x7f647810f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44870/0 (socket says 172.21.15.107:44870) 2024-09-21T07:56:40.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.608+0000 7f6475d9b640 1 -- 172.21.15.107:0/2808584802 learned_addr learned my addr 172.21.15.107:0/2808584802 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:56:40.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.608+0000 7f647659c640 1 --2- 172.21.15.107:0/2808584802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6478065bc0 0x7f647810f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:40.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.608+0000 7f6475d9b640 1 -- 172.21.15.107:0/2808584802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6478065bc0 msgr2=0x7f647810f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:40.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.608+0000 7f6475d9b640 1 --2- 172.21.15.107:0/2808584802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6478065bc0 0x7f647810f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.608+0000 7f6475d9b640 1 -- 172.21.15.107:0/2808584802 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64680098b0 con 0x7f6478101b00 2024-09-21T07:56:40.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.608+0000 7f6475d9b640 1 --2- 172.21.15.107:0/2808584802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6478101b00 0x7f647810f8e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f646000b580 tx=0x7f64600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:40.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.608+0000 7f646effd640 1 -- 172.21.15.107:0/2808584802 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f646000f570 con 0x7f6478101b00 2024-09-21T07:56:40.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.608+0000 7f646effd640 1 -- 172.21.15.107:0/2808584802 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f646000fb70 con 0x7f6478101b00 2024-09-21T07:56:40.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.608+0000 7f646effd640 1 -- 172.21.15.107:0/2808584802 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6460010d40 con 0x7f6478101b00 2024-09-21T07:56:40.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.608+0000 7f647cf68640 1 -- 172.21.15.107:0/2808584802 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6478110b00 con 0x7f6478101b00 2024-09-21T07:56:40.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.608+0000 7f647cf68640 1 -- 172.21.15.107:0/2808584802 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6478111020 con 0x7f6478101b00 2024-09-21T07:56:40.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.609+0000 7f647cf68640 1 -- 172.21.15.107:0/2808584802 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64780fa890 con 0x7f6478101b00 2024-09-21T07:56:40.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.610+0000 7f646effd640 1 -- 172.21.15.107:0/2808584802 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f646000fce0 con 0x7f6478101b00 2024-09-21T07:56:40.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.610+0000 7f646effd640 1 --2- 172.21.15.107:0/2808584802 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f646406ecc0 0x7f6464071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.610+0000 7f647659c640 1 --2- 172.21.15.107:0/2808584802 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f646406ecc0 0x7f6464071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:40.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.610+0000 7f646effd640 1 -- 172.21.15.107:0/2808584802 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f646008d090 con 0x7f6478101b00 2024-09-21T07:56:40.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.610+0000 7f647659c640 1 --2- 172.21.15.107:0/2808584802 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f646406ecc0 0x7f6464071170 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6468004a30 tx=0x7f6468004d10 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:40.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.614+0000 7f646effd640 1 -- 172.21.15.107:0/2808584802 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f646005b150 con 0x7f6478101b00 2024-09-21T07:56:40.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:40.778+0000 7f647cf68640 1 -- 172.21.15.107:0/2808584802 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6478111290 con 0x7f646406ecc0 2024-09-21T07:56:41.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:41 smithi107 ceph-mon[27622]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:56:41.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:41 smithi107 ceph-mon[27622]: from='client.14254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:56:41.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:41 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T07:56:41.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:41 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T07:56:41.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:41 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:56:41.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:41 smithi129 ceph-mon[34472]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:56:41.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:41 smithi129 ceph-mon[34472]: from='client.14254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:56:41.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:41 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T07:56:41.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:41 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T07:56:41.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:41 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:56:42.453 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:42 smithi107 ceph-mon[27622]: Detected new or changed devices on smithi107 2024-09-21T07:56:42.453 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:42 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:42.454 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:42 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:42.454 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:42 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:56:42.454 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:42 smithi107 ceph-mon[27622]: Adjusting osd_memory_target on smithi107 to 12863M 2024-09-21T07:56:42.454 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:42 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:42.454 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:42 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:56:42.454 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:42 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:56:42.454 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:42 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:42.454 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:42 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:56:42.655 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:42 smithi129 ceph-mon[34472]: Detected new or changed devices on smithi107 2024-09-21T07:56:42.655 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:42 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:42.655 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:42 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:42.655 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:42 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:56:42.656 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:42 smithi129 ceph-mon[34472]: Adjusting osd_memory_target on smithi107 to 12863M 2024-09-21T07:56:42.656 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:42 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:42.656 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:42 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:56:42.656 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:42 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:56:42.656 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:42 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:42.656 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:42 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:56:43.724 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:43 smithi107 ceph-mon[27622]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:56:43.725 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:43 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:43.725 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:43 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:43.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:43 smithi129 ceph-mon[34472]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:56:43.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:43 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:43.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:43 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:44.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:44 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/953985552' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "614577ae-2dfd-4d3a-af18-d150846ba68f"}]: dispatch 2024-09-21T07:56:44.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:44 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/953985552' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "614577ae-2dfd-4d3a-af18-d150846ba68f"}]': finished 2024-09-21T07:56:44.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:44 smithi129 ceph-mon[34472]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T07:56:44.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:44 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T07:56:44.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:44 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/1008156077' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T07:56:44.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:44 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/953985552' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "614577ae-2dfd-4d3a-af18-d150846ba68f"}]: dispatch 2024-09-21T07:56:44.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:44 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/953985552' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "614577ae-2dfd-4d3a-af18-d150846ba68f"}]': finished 2024-09-21T07:56:44.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:44 smithi107 ceph-mon[27622]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T07:56:44.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:44 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T07:56:44.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:44 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1008156077' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T07:56:45.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:45 smithi129 ceph-mon[34472]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:56:45.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:45 smithi107 ceph-mon[27622]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:56:47.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:47 smithi129 ceph-mon[34472]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:56:47.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:47 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:47.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:47 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:47.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:47 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:56:47.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:47 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:56:47.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:47 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:47.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:47 smithi107 ceph-mon[27622]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:56:47.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:47 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:47.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:47 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:47.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:47 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:56:47.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:47 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:56:47.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:47 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:49.598 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:49 smithi107 ceph-mon[27622]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:56:49.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:49 smithi129 ceph-mon[34472]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:56:51.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:51 smithi129 ceph-mon[34472]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:56:51.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:51 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-21T07:56:51.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:51 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:56:51.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:51 smithi129 ceph-mon[34472]: Deploying daemon osd.1 on smithi107 2024-09-21T07:56:51.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:51 smithi107 ceph-mon[27622]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:56:51.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:51 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-21T07:56:51.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:51 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:56:51.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:51 smithi107 ceph-mon[27622]: Deploying daemon osd.1 on smithi107 2024-09-21T07:56:53.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:53 smithi129 ceph-mon[34472]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:56:53.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:53 smithi107 ceph-mon[27622]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:56:54.734 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:54 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:56:54.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:54 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:56:55.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:55 smithi129 ceph-mon[34472]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:56:55.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:55 smithi107 ceph-mon[27622]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:56:56.727 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:56 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:56:56.728 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:56 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:56.728 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:56 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:56.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:56 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:56:56.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:56 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:56.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:56 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:57.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:57 smithi107 ceph-mon[27622]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:56:57.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:57 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:57.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:57 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:58.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:57 smithi129 ceph-mon[34472]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:56:58.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:57 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:58.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:57 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:56:58.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:58.755+0000 7f646effd640 1 -- 172.21.15.107:0/2808584802 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6478111290 con 0x7f646406ecc0 2024-09-21T07:56:58.758 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 1 on host 'smithi107' 2024-09-21T07:56:58.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:58.757+0000 7f647cf68640 1 -- 172.21.15.107:0/2808584802 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f646406ecc0 msgr2=0x7f6464071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:58.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:58.757+0000 7f647cf68640 1 --2- 172.21.15.107:0/2808584802 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f646406ecc0 0x7f6464071170 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6468004a30 tx=0x7f6468004d10 comp rx=0 tx=0).stop 2024-09-21T07:56:58.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:58.757+0000 7f647cf68640 1 -- 172.21.15.107:0/2808584802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6478101b00 msgr2=0x7f647810f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:58.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:58.757+0000 7f647cf68640 1 --2- 172.21.15.107:0/2808584802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6478101b00 0x7f647810f8e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f646000b580 tx=0x7f64600091a0 comp rx=0 tx=0).stop 2024-09-21T07:56:58.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:58.757+0000 7f647cf68640 1 -- 172.21.15.107:0/2808584802 shutdown_connections 2024-09-21T07:56:58.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:58.757+0000 7f647cf68640 1 --2- 172.21.15.107:0/2808584802 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f646406ecc0 0x7f6464071170 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:58.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:58.757+0000 7f647cf68640 1 --2- 172.21.15.107:0/2808584802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6478101b00 0x7f647810f8e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:58.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:58.757+0000 7f647cf68640 1 --2- 172.21.15.107:0/2808584802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6478065bc0 0x7f647810f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:58.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:58.757+0000 7f647cf68640 1 -- 172.21.15.107:0/2808584802 >> 172.21.15.107:0/2808584802 conn(0x7f64780f6c10 msgr2=0x7f64780f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:58.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:58.757+0000 7f647cf68640 1 -- 172.21.15.107:0/2808584802 shutdown_connections 2024-09-21T07:56:58.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:56:58.757+0000 7f647cf68640 1 -- 172.21.15.107:0/2808584802 wait complete. 2024-09-21T07:56:59.433 DEBUG:teuthology.orchestra.run.smithi107:osd.1> sudo journalctl -f -n 0 -u ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.1.service 2024-09-21T07:56:59.435 INFO:tasks.cephadm:Deploying osd.2 on smithi107 with /dev/vg_nvme/lv_2... 2024-09-21T07:56:59.435 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T07:57:00.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:59 smithi129 ceph-mon[34472]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:57:00.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:59 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:00.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:59 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:00.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:56:59 smithi129 ceph-mon[34472]: from='osd.1 [v2:172.21.15.107:6810/2552944255,v1:172.21.15.107:6811/2552944255]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-21T07:57:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:59 smithi107 ceph-mon[27622]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:57:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:59 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:00.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:59 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:00.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:56:59 smithi107 ceph-mon[27622]: from='osd.1 [v2:172.21.15.107:6810/2552944255,v1:172.21.15.107:6811/2552944255]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-21T07:57:00.918 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:57:01.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:00 smithi129 ceph-mon[34472]: from='osd.1 [v2:172.21.15.107:6810/2552944255,v1:172.21.15.107:6811/2552944255]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T07:57:01.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:00 smithi129 ceph-mon[34472]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T07:57:01.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:00 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T07:57:01.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:00 smithi129 ceph-mon[34472]: from='osd.1 [v2:172.21.15.107:6810/2552944255,v1:172.21.15.107:6811/2552944255]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-21T07:57:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:00 smithi107 ceph-mon[27622]: from='osd.1 [v2:172.21.15.107:6810/2552944255,v1:172.21.15.107:6811/2552944255]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T07:57:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:00 smithi107 ceph-mon[27622]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T07:57:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:00 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T07:57:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:00 smithi107 ceph-mon[27622]: from='osd.1 [v2:172.21.15.107:6810/2552944255,v1:172.21.15.107:6811/2552944255]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-21T07:57:01.055 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 07:57:00 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1[53285]: 2024-09-21T07:57:00.764+0000 7f02a5a1b640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T07:57:01.055 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 07:57:00 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1[53285]: 2024-09-21T07:57:00.768+0000 7f02a0852640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:57:02.019 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:01 smithi107 ceph-mon[27622]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:57:02.019 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:01 smithi107 ceph-mon[27622]: from='osd.1 [v2:172.21.15.107:6810/2552944255,v1:172.21.15.107:6811/2552944255]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-21T07:57:02.019 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:01 smithi107 ceph-mon[27622]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T07:57:02.019 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:01 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T07:57:02.019 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:01 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T07:57:02.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:01 smithi129 ceph-mon[34472]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:57:02.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:01 smithi129 ceph-mon[34472]: from='osd.1 [v2:172.21.15.107:6810/2552944255,v1:172.21.15.107:6811/2552944255]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-21T07:57:02.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:01 smithi129 ceph-mon[34472]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T07:57:02.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:01 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T07:57:02.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:01 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T07:57:02.934 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:02 smithi107 ceph-mon[27622]: purged_snaps scrub starts 2024-09-21T07:57:02.934 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:02 smithi107 ceph-mon[27622]: purged_snaps scrub ok 2024-09-21T07:57:02.934 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:02 smithi107 ceph-mon[27622]: osd.1 [v2:172.21.15.107:6810/2552944255,v1:172.21.15.107:6811/2552944255] boot 2024-09-21T07:57:02.934 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:02 smithi107 ceph-mon[27622]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T07:57:02.934 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:02 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T07:57:03.168 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:02 smithi129 ceph-mon[34472]: purged_snaps scrub starts 2024-09-21T07:57:03.168 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:02 smithi129 ceph-mon[34472]: purged_snaps scrub ok 2024-09-21T07:57:03.168 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:02 smithi129 ceph-mon[34472]: osd.1 [v2:172.21.15.107:6810/2552944255,v1:172.21.15.107:6811/2552944255] boot 2024-09-21T07:57:03.168 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:02 smithi129 ceph-mon[34472]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T07:57:03.168 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:02 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T07:57:03.923 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:03 smithi107 ceph-mon[27622]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:57:03.923 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:03 smithi107 ceph-mon[27622]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T07:57:03.923 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:03 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:03.923 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:03 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:04.189 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:03 smithi129 ceph-mon[34472]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:57:04.189 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:03 smithi129 ceph-mon[34472]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T07:57:04.189 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:03 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:04.189 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:03 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:04.885 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:57:04.907 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi107:vg_nvme/lv_2 2024-09-21T07:57:05.339 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:57:06.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:05 smithi107 ceph-mon[27622]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:06.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:05 smithi129 ceph-mon[34472]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:07.990 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:07 smithi107 ceph-mon[27622]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:07.990 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:07 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:07.990 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:07 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:07.990 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:07 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:57:07.990 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:07 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:57:07.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.980+0000 7f4895c93640 1 -- 172.21.15.107:0/582410943 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48900fc540 msgr2=0x7f48900fc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:07.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.980+0000 7f4895c93640 1 --2- 172.21.15.107:0/582410943 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48900fc540 0x7f48900fc950 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f48800048d0 tx=0x7f4880009da0 comp rx=0 tx=0).stop 2024-09-21T07:57:07.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.980+0000 7f4895c93640 1 -- 172.21.15.107:0/582410943 shutdown_connections 2024-09-21T07:57:07.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.980+0000 7f4895c93640 1 --2- 172.21.15.107:0/582410943 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f48900fd810 0x7f48900fdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:07.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.980+0000 7f4895c93640 1 --2- 172.21.15.107:0/582410943 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48900fc540 0x7f48900fc950 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:07.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.980+0000 7f4895c93640 1 -- 172.21.15.107:0/582410943 >> 172.21.15.107:0/582410943 conn(0x7f48900f7d00 msgr2=0x7f48900fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:07.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.980+0000 7f4895c93640 1 -- 172.21.15.107:0/582410943 shutdown_connections 2024-09-21T07:57:07.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.980+0000 7f4895c93640 1 -- 172.21.15.107:0/582410943 wait complete. 2024-09-21T07:57:07.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.981+0000 7f4895c93640 1 Processor -- start 2024-09-21T07:57:07.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.981+0000 7f4895c93640 1 -- start start 2024-09-21T07:57:07.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.981+0000 7f4895c93640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48900fc540 0x7f489010d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:07.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.981+0000 7f4895c93640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f48900fd810 0x7f489010d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:07.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.981+0000 7f4895c93640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489010e480 con 0x7f48900fc540 2024-09-21T07:57:07.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.981+0000 7f4895c93640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489010e5f0 con 0x7f48900fd810 2024-09-21T07:57:07.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.981+0000 7f488f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48900fc540 0x7f489010d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:07.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.981+0000 7f488f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48900fc540 0x7f489010d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59706/0 (socket says 172.21.15.107:59706) 2024-09-21T07:57:07.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.981+0000 7f488f7fe640 1 -- 172.21.15.107:0/3702728866 learned_addr learned my addr 172.21.15.107:0/3702728866 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:57:07.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.981+0000 7f488effd640 1 --2- 172.21.15.107:0/3702728866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f48900fd810 0x7f489010d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:07.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.981+0000 7f488f7fe640 1 -- 172.21.15.107:0/3702728866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f48900fd810 msgr2=0x7f489010d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:07.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.981+0000 7f488f7fe640 1 --2- 172.21.15.107:0/3702728866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f48900fd810 0x7f489010d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:07.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.981+0000 7f488f7fe640 1 -- 172.21.15.107:0/3702728866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4880005040 con 0x7f48900fc540 2024-09-21T07:57:07.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.981+0000 7f488effd640 1 --2- 172.21.15.107:0/3702728866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f48900fd810 0x7f489010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:57:07.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.982+0000 7f488f7fe640 1 --2- 172.21.15.107:0/3702728866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48900fc540 0x7f489010d0d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4880003080 tx=0x7f4880009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:07.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.982+0000 7f4887fff640 1 -- 172.21.15.107:0/3702728866 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4880038070 con 0x7f48900fc540 2024-09-21T07:57:07.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.982+0000 7f4895c93640 1 -- 172.21.15.107:0/3702728866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489010e870 con 0x7f48900fc540 2024-09-21T07:57:07.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.982+0000 7f4887fff640 1 -- 172.21.15.107:0/3702728866 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f488002abd0 con 0x7f48900fc540 2024-09-21T07:57:07.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.982+0000 7f4887fff640 1 -- 172.21.15.107:0/3702728866 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f488003e670 con 0x7f48900fc540 2024-09-21T07:57:07.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.982+0000 7f4895c93640 1 -- 172.21.15.107:0/3702728866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489010ed90 con 0x7f48900fc540 2024-09-21T07:57:07.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.983+0000 7f4895c93640 1 -- 172.21.15.107:0/3702728866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48901057d0 con 0x7f48900fc540 2024-09-21T07:57:07.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.984+0000 7f4887fff640 1 -- 172.21.15.107:0/3702728866 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f4880030020 con 0x7f48900fc540 2024-09-21T07:57:07.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.984+0000 7f4887fff640 1 --2- 172.21.15.107:0/3702728866 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f487c06ecc0 0x7f487c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:07.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.984+0000 7f4887fff640 1 -- 172.21.15.107:0/3702728866 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f48800ad880 con 0x7f48900fc540 2024-09-21T07:57:07.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.984+0000 7f488effd640 1 --2- 172.21.15.107:0/3702728866 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f487c06ecc0 0x7f487c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:07.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.984+0000 7f488effd640 1 --2- 172.21.15.107:0/3702728866 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f487c06ecc0 0x7f487c071170 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f489010ce80 tx=0x7f4878008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:07.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:07.988+0000 7f4887fff640 1 -- 172.21.15.107:0/3702728866 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f488007b670 con 0x7f48900fc540 2024-09-21T07:57:08.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:08.181+0000 7f4895c93640 1 -- 172.21.15.107:0/3702728866 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f489010efb0 con 0x7f487c06ecc0 2024-09-21T07:57:08.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:07 smithi129 ceph-mon[34472]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:08.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:07 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:08.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:07 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:08.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:07 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:57:08.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:07 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:57:09.045 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:08 smithi107 ceph-mon[27622]: Detected new or changed devices on smithi107 2024-09-21T07:57:09.045 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:08 smithi107 ceph-mon[27622]: Adjusting osd_memory_target on smithi107 to 6431M 2024-09-21T07:57:09.045 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:08 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:09.046 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:08 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:09.046 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:08 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:57:09.046 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:08 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:09.046 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:08 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:57:09.046 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:08 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T07:57:09.046 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:08 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T07:57:09.046 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:08 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:09.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:08 smithi129 ceph-mon[34472]: Detected new or changed devices on smithi107 2024-09-21T07:57:09.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:08 smithi129 ceph-mon[34472]: Adjusting osd_memory_target on smithi107 to 6431M 2024-09-21T07:57:09.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:08 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:09.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:08 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:09.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:08 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:57:09.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:08 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:09.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:08 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:57:09.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:08 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T07:57:09.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:08 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T07:57:09.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:08 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:09.984 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:09 smithi107 ceph-mon[27622]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:09.984 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:09 smithi107 ceph-mon[27622]: from='client.14272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:57:09.984 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:09 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:57:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:09 smithi129 ceph-mon[34472]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:09 smithi129 ceph-mon[34472]: from='client.14272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:57:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:09 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:57:11.939 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:11 smithi107 ceph-mon[27622]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:12.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:11 smithi129 ceph-mon[34472]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:12.906 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:12 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1943772973' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31b84275-0f5c-4a4a-8384-5444f81445a8"}]: dispatch 2024-09-21T07:57:12.906 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:12 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1943772973' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31b84275-0f5c-4a4a-8384-5444f81445a8"}]': finished 2024-09-21T07:57:12.906 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:12 smithi107 ceph-mon[27622]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T07:57:12.906 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:12 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T07:57:13.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:12 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/1943772973' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31b84275-0f5c-4a4a-8384-5444f81445a8"}]: dispatch 2024-09-21T07:57:13.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:12 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/1943772973' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31b84275-0f5c-4a4a-8384-5444f81445a8"}]': finished 2024-09-21T07:57:13.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:12 smithi129 ceph-mon[34472]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T07:57:13.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:12 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T07:57:14.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:13 smithi107 ceph-mon[27622]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:14.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:13 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/4231431600' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T07:57:14.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:13 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:14.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:13 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:14.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:13 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:14.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:13 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:57:14.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:13 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:14.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:13 smithi129 ceph-mon[34472]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:14.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:13 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/4231431600' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T07:57:14.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:13 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:14.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:13 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:14.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:13 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:14.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:13 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:57:14.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:13 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:16.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:15 smithi107 ceph-mon[27622]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:16.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:15 smithi129 ceph-mon[34472]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:18.249 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:17 smithi107 ceph-mon[27622]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:18.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:17 smithi129 ceph-mon[34472]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:20.050 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:19 smithi107 ceph-mon[27622]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:20.050 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:19 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-21T07:57:20.050 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:19 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:20.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:19 smithi129 ceph-mon[34472]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:20.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:19 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-21T07:57:20.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:19 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:21.068 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:20 smithi107 ceph-mon[27622]: Deploying daemon osd.2 on smithi107 2024-09-21T07:57:21.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:20 smithi129 ceph-mon[34472]: Deploying daemon osd.2 on smithi107 2024-09-21T07:57:22.068 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:21 smithi107 ceph-mon[27622]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:21 smithi129 ceph-mon[34472]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:24.030 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:23 smithi107 ceph-mon[27622]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:24.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:23 smithi129 ceph-mon[34472]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:24.825 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:57:24.825 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:57:24.825 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:24.825 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:25.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:24 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:57:25.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:24 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:57:25.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:24 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:25.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:24 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:26.044 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:25 smithi107 ceph-mon[27622]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:26.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:25 smithi129 ceph-mon[34472]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:27.945 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:27 smithi107 ceph-mon[27622]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:28.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:27 smithi129 ceph-mon[34472]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:28.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:28.543+0000 7f4887fff640 1 -- 172.21.15.107:0/3702728866 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f489010efb0 con 0x7f487c06ecc0 2024-09-21T07:57:28.545 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 2 on host 'smithi107' 2024-09-21T07:57:28.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:28.545+0000 7f4895c93640 1 -- 172.21.15.107:0/3702728866 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f487c06ecc0 msgr2=0x7f487c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:28.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:28.545+0000 7f4895c93640 1 --2- 172.21.15.107:0/3702728866 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f487c06ecc0 0x7f487c071170 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f489010ce80 tx=0x7f4878008040 comp rx=0 tx=0).stop 2024-09-21T07:57:28.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:28.546+0000 7f4895c93640 1 -- 172.21.15.107:0/3702728866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48900fc540 msgr2=0x7f489010d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:28.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:28.546+0000 7f4895c93640 1 --2- 172.21.15.107:0/3702728866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48900fc540 0x7f489010d0d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4880003080 tx=0x7f4880009da0 comp rx=0 tx=0).stop 2024-09-21T07:57:28.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:28.546+0000 7f4895c93640 1 -- 172.21.15.107:0/3702728866 shutdown_connections 2024-09-21T07:57:28.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:28.546+0000 7f4895c93640 1 --2- 172.21.15.107:0/3702728866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f48900fd810 0x7f489010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:28.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:28.546+0000 7f4895c93640 1 --2- 172.21.15.107:0/3702728866 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f487c06ecc0 0x7f487c071170 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:28.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:28.546+0000 7f4895c93640 1 --2- 172.21.15.107:0/3702728866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48900fc540 0x7f489010d0d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:28.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:28.546+0000 7f4895c93640 1 -- 172.21.15.107:0/3702728866 >> 172.21.15.107:0/3702728866 conn(0x7f48900f7d00 msgr2=0x7f48900f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:28.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:28.546+0000 7f4895c93640 1 -- 172.21.15.107:0/3702728866 shutdown_connections 2024-09-21T07:57:28.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:57:28.546+0000 7f4895c93640 1 -- 172.21.15.107:0/3702728866 wait complete. 2024-09-21T07:57:29.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:29 smithi129 ceph-mon[34472]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:29.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:29 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:29.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:29 smithi129 ceph-mon[34472]: from='osd.2 [v2:172.21.15.107:6818/2268135286,v1:172.21.15.107:6819/2268135286]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-21T07:57:29.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:29 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:29.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:29 smithi107 ceph-mon[27622]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:29.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:29 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:29.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:29 smithi107 ceph-mon[27622]: from='osd.2 [v2:172.21.15.107:6818/2268135286,v1:172.21.15.107:6819/2268135286]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-21T07:57:29.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:29 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:30.001 DEBUG:teuthology.orchestra.run.smithi107:osd.2> sudo journalctl -f -n 0 -u ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.2.service 2024-09-21T07:57:30.013 INFO:tasks.cephadm:Deploying osd.3 on smithi129 with /dev/vg_nvme/lv_4... 2024-09-21T07:57:30.015 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T07:57:30.269 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi129/config 2024-09-21T07:57:30.672 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:30 smithi129 ceph-mon[34472]: from='osd.2 [v2:172.21.15.107:6818/2268135286,v1:172.21.15.107:6819/2268135286]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T07:57:30.672 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:30 smithi129 ceph-mon[34472]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T07:57:30.672 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:30 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T07:57:30.672 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:30 smithi129 ceph-mon[34472]: from='osd.2 [v2:172.21.15.107:6818/2268135286,v1:172.21.15.107:6819/2268135286]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-21T07:57:30.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:30 smithi107 ceph-mon[27622]: from='osd.2 [v2:172.21.15.107:6818/2268135286,v1:172.21.15.107:6819/2268135286]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T07:57:30.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:30 smithi107 ceph-mon[27622]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T07:57:30.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:30 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T07:57:30.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:30 smithi107 ceph-mon[27622]: from='osd.2 [v2:172.21.15.107:6818/2268135286,v1:172.21.15.107:6819/2268135286]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-21T07:57:30.805 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 07:57:30 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2[60972]: 2024-09-21T07:57:30.545+0000 7f19245d3640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T07:57:30.805 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 07:57:30 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2[60972]: 2024-09-21T07:57:30.549+0000 7f192040c640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:57:31.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:31 smithi107 ceph-mon[27622]: purged_snaps scrub starts 2024-09-21T07:57:31.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:31 smithi107 ceph-mon[27622]: purged_snaps scrub ok 2024-09-21T07:57:31.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:31 smithi107 ceph-mon[27622]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:31.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:31 smithi107 ceph-mon[27622]: from='osd.2 [v2:172.21.15.107:6818/2268135286,v1:172.21.15.107:6819/2268135286]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-21T07:57:31.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:31 smithi107 ceph-mon[27622]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T07:57:31.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:31 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T07:57:31.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:31 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T07:57:31.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:31 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T07:57:31.904 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:31 smithi129 ceph-mon[34472]: purged_snaps scrub starts 2024-09-21T07:57:31.904 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:31 smithi129 ceph-mon[34472]: purged_snaps scrub ok 2024-09-21T07:57:31.904 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:31 smithi129 ceph-mon[34472]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:31.904 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:31 smithi129 ceph-mon[34472]: from='osd.2 [v2:172.21.15.107:6818/2268135286,v1:172.21.15.107:6819/2268135286]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-21T07:57:31.904 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:31 smithi129 ceph-mon[34472]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T07:57:31.905 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:31 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T07:57:31.905 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:31 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T07:57:31.905 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:31 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T07:57:32.705 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:57:32.725 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi129:vg_nvme/lv_4 2024-09-21T07:57:32.956 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:32 smithi107 ceph-mon[27622]: osd.2 [v2:172.21.15.107:6818/2268135286,v1:172.21.15.107:6819/2268135286] boot 2024-09-21T07:57:32.956 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:32 smithi107 ceph-mon[27622]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T07:57:32.956 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:32 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T07:57:32.956 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:32 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:32.956 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:32 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:32.956 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:32 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-21T07:57:32.968 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi129/config 2024-09-21T07:57:33.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:32 smithi129 ceph-mon[34472]: osd.2 [v2:172.21.15.107:6818/2268135286,v1:172.21.15.107:6819/2268135286] boot 2024-09-21T07:57:33.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:32 smithi129 ceph-mon[34472]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T07:57:33.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:32 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T07:57:33.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:32 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:33.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:32 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:33.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:32 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-21T07:57:33.905 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:33 smithi107 ceph-mon[27622]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:33.906 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:33 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-21T07:57:33.906 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:33 smithi107 ceph-mon[27622]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T07:57:33.906 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:33 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-21T07:57:33.906 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:33 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:57:33.906 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:33 smithi107 ceph-mon[27622]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T07:57:33.972 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:33 smithi129 ceph-mon[34472]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-21T07:57:33.972 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:33 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-21T07:57:33.972 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:33 smithi129 ceph-mon[34472]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T07:57:33.972 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:33 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-21T07:57:33.972 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:33 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:57:33.972 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:33 smithi129 ceph-mon[34472]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T07:57:34.169 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 07:57:33 smithi107 sudo[64629]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:57:34.169 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 07:57:33 smithi107 sudo[64629]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:57:34.169 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 07:57:33 smithi107 sudo[64629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:57:34.169 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 07:57:33 smithi107 sudo[64629]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:57:34.440 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 07:57:34 smithi107 sudo[65495]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:57:34.440 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 07:57:34 smithi107 sudo[65495]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:57:34.440 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 07:57:34 smithi107 sudo[65495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:57:34.440 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 07:57:34 smithi107 sudo[65495]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:57:34.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.452+0000 7f70745ac640 1 -- 172.21.15.129:0/2713466765 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f706c0ff680 msgr2=0x7f706c101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:34.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.452+0000 7f70745ac640 1 --2- 172.21.15.129:0/2713466765 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f706c0ff680 0x7f706c101a60 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f70600048d0 tx=0x7f7060009da0 comp rx=0 tx=0).stop 2024-09-21T07:57:34.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.452+0000 7f70745ac640 1 -- 172.21.15.129:0/2713466765 shutdown_connections 2024-09-21T07:57:34.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.452+0000 7f70745ac640 1 --2- 172.21.15.129:0/2713466765 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f706c0ff680 0x7f706c101a60 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:34.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.452+0000 7f70745ac640 1 --2- 172.21.15.129:0/2713466765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f706c065c40 0x7f706c0ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:34.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.452+0000 7f70745ac640 1 -- 172.21.15.129:0/2713466765 >> 172.21.15.129:0/2713466765 conn(0x7f706c0f6c10 msgr2=0x7f706c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:34.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.452+0000 7f70745ac640 1 -- 172.21.15.129:0/2713466765 shutdown_connections 2024-09-21T07:57:34.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.452+0000 7f70745ac640 1 -- 172.21.15.129:0/2713466765 wait complete. 2024-09-21T07:57:34.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.452+0000 7f70745ac640 1 Processor -- start 2024-09-21T07:57:34.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.452+0000 7f70745ac640 1 -- start start 2024-09-21T07:57:34.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.452+0000 7f70745ac640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f706c065c40 0x7f706c10d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:34.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.452+0000 7f70745ac640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f706c0ff680 0x7f706c10d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:34.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.452+0000 7f70745ac640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c10dc00 con 0x7f706c0ff680 2024-09-21T07:57:34.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.452+0000 7f70745ac640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c10e420 con 0x7f706c065c40 2024-09-21T07:57:34.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.452+0000 7f7072348640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f706c065c40 0x7f706c10d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:34.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.452+0000 7f7072348640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f706c065c40 0x7f706c10d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:56520/0 (socket says 172.21.15.129:56520) 2024-09-21T07:57:34.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.452+0000 7f7072348640 1 -- 172.21.15.129:0/2600427092 learned_addr learned my addr 172.21.15.129:0/2600427092 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:57:34.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.453+0000 7f7071b47640 1 --2- 172.21.15.129:0/2600427092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f706c0ff680 0x7f706c10d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:34.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.453+0000 7f7072348640 1 -- 172.21.15.129:0/2600427092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f706c0ff680 msgr2=0x7f706c10d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:34.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.453+0000 7f7072348640 1 --2- 172.21.15.129:0/2600427092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f706c0ff680 0x7f706c10d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:34.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.453+0000 7f7072348640 1 -- 172.21.15.129:0/2600427092 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7060005040 con 0x7f706c065c40 2024-09-21T07:57:34.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.453+0000 7f7072348640 1 --2- 172.21.15.129:0/2600427092 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f706c065c40 0x7f706c10d070 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f705c00ece0 tx=0x7f705c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:34.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.453+0000 7f706affd640 1 -- 172.21.15.129:0/2600427092 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f705c00cab0 con 0x7f706c065c40 2024-09-21T07:57:34.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.453+0000 7f706affd640 1 -- 172.21.15.129:0/2600427092 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f705c00f040 con 0x7f706c065c40 2024-09-21T07:57:34.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.453+0000 7f70745ac640 1 -- 172.21.15.129:0/2600427092 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706c10e6b0 con 0x7f706c065c40 2024-09-21T07:57:34.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.453+0000 7f706affd640 1 -- 172.21.15.129:0/2600427092 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f705c009680 con 0x7f706c065c40 2024-09-21T07:57:34.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.453+0000 7f70745ac640 1 -- 172.21.15.129:0/2600427092 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706c10ec50 con 0x7f706c065c40 2024-09-21T07:57:34.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.454+0000 7f70745ac640 1 -- 172.21.15.129:0/2600427092 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706c0fa890 con 0x7f706c065c40 2024-09-21T07:57:34.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.455+0000 7f706affd640 1 -- 172.21.15.129:0/2600427092 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f705c007890 con 0x7f706c065c40 2024-09-21T07:57:34.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.455+0000 7f706affd640 1 --2- 172.21.15.129:0/2600427092 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f705406ecc0 0x7f7054071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:34.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.455+0000 7f706affd640 1 -- 172.21.15.129:0/2600427092 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3228+0+0 (secure 0 0 0) 0x7f705c08dd90 con 0x7f706c065c40 2024-09-21T07:57:34.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.455+0000 7f7071b47640 1 --2- 172.21.15.129:0/2600427092 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f705406ecc0 0x7f7054071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:34.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.456+0000 7f7071b47640 1 --2- 172.21.15.129:0/2600427092 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f705406ecc0 0x7f7054071170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7060007ac0 tx=0x7f7060035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:34.462 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.460+0000 7f706affd640 1 -- 172.21.15.129:0/2600427092 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f705c05b910 con 0x7f706c065c40 2024-09-21T07:57:34.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.571+0000 7f706affd640 1 -- 172.21.15.129:0/2600427092 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f705c057e70 con 0x7f706c065c40 2024-09-21T07:57:34.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:34.625+0000 7f70745ac640 1 -- 172.21.15.129:0/2600427092 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f706c10f000 con 0x7f705406ecc0 2024-09-21T07:57:34.712 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 07:57:34 smithi107 sudo[65501]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:57:34.712 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 07:57:34 smithi107 sudo[65501]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:57:34.712 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 07:57:34 smithi107 sudo[65501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:57:34.712 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 07:57:34 smithi107 sudo[65501]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:57:34.972 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 07:57:34 smithi107 sudo[65552]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:57:34.972 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 07:57:34 smithi107 sudo[65552]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:57:34.973 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 07:57:34 smithi107 sudo[65552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:57:34.973 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 07:57:34 smithi107 sudo[65552]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:57:35.248 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 07:57:34 smithi107 sudo[65640]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:57:35.248 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 07:57:34 smithi107 sudo[65640]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:57:35.248 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 07:57:34 smithi107 sudo[65640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:57:35.248 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 07:57:34 smithi107 sudo[65640]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:57:35.249 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 ceph-mon[27622]: pgmap v74: 1 pgs: 1 creating+peering; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:35.249 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:35.249 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 ceph-mon[27622]: mgrmap e19: smithi107.wzulxb(active, since 2m), standbys: smithi129.wvlmvo 2024-09-21T07:57:35.249 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 ceph-mon[27622]: osdmap e22: 3 total, 3 up, 3 in 2024-09-21T07:57:35.249 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 ceph-mon[27622]: Detected new or changed devices on smithi107 2024-09-21T07:57:35.249 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:35.249 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:35.249 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:57:35.249 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:57:35.250 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:57:35.250 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 ceph-mon[27622]: Adjusting osd_memory_target on smithi107 to 4287M 2024-09-21T07:57:35.250 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:35.250 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:35.250 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:57:35.250 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:35.250 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 ceph-mon[27622]: from='client.24129 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:57:35.250 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T07:57:35.250 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T07:57:35.251 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:35.251 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:57:35.345 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:35 smithi129 ceph-mon[34472]: pgmap v74: 1 pgs: 1 creating+peering; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:35.345 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:35 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:35.345 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:35 smithi129 ceph-mon[34472]: mgrmap e19: smithi107.wzulxb(active, since 2m), standbys: smithi129.wvlmvo 2024-09-21T07:57:35.345 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:35 smithi129 ceph-mon[34472]: osdmap e22: 3 total, 3 up, 3 in 2024-09-21T07:57:35.346 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:35 smithi129 ceph-mon[34472]: Detected new or changed devices on smithi107 2024-09-21T07:57:35.346 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:35 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:35.346 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:35 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:35.346 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:35 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:57:35.346 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:35 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:57:35.346 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:35 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:57:35.346 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:35 smithi129 ceph-mon[34472]: Adjusting osd_memory_target on smithi107 to 4287M 2024-09-21T07:57:35.346 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:35 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:35.346 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:35 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:35.346 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:35 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:57:35.347 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:35 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:35.347 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:35 smithi129 ceph-mon[34472]: from='client.24129 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:57:35.347 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:35 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T07:57:35.347 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:35 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T07:57:35.347 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:35 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:35.347 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:35 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:57:35.499 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 07:57:35 smithi107 sudo[65695]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:57:35.500 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 07:57:35 smithi107 sudo[65695]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:57:35.500 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 07:57:35 smithi107 sudo[65695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:57:35.500 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 07:57:35 smithi107 sudo[65695]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:57:35.760 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 sudo[65714]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:57:35.760 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 sudo[65714]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:57:35.760 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 sudo[65714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:57:35.760 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 sudo[65714]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:57:36.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 sudo[65740]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:57:36.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 sudo[65740]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:57:36.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 sudo[65740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:57:36.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:35 smithi107 sudo[65740]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:57:36.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:36 smithi129 sudo[37654]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:57:36.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:36 smithi129 sudo[37654]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:57:36.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:36 smithi129 sudo[37654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:57:36.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:36 smithi129 sudo[37654]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:57:36.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:36 smithi129 sudo[37678]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:57:36.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:36 smithi129 sudo[37678]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:57:36.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:36 smithi129 sudo[37678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:57:36.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:36 smithi129 sudo[37678]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:57:36.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:36 smithi129 ceph-mon[34472]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:57:36.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:36 smithi129 ceph-mon[34472]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:57:36.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:36 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-21T07:57:36.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:36 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T07:57:36.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:36 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-21T07:57:36.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:36 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T07:57:36.536 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:36 smithi107 ceph-mon[27622]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:57:36.536 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:36 smithi107 ceph-mon[27622]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:57:36.536 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:36 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-21T07:57:36.536 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:36 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T07:57:36.536 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:36 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-21T07:57:36.537 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:36 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T07:57:37.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:37 smithi129 ceph-mon[34472]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:57:37.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:37 smithi129 ceph-mon[34472]: pgmap v76: 1 pgs: 1 creating+peering; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:37.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:37 smithi129 ceph-mon[34472]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:57:37.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:37 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:37.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:37 smithi129 ceph-mon[34472]: from='client.? 172.21.15.129:0/2842875406' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57445a72-d438-4f24-9e18-c69eb61e3c64"}]: dispatch 2024-09-21T07:57:37.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:37 smithi129 ceph-mon[34472]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57445a72-d438-4f24-9e18-c69eb61e3c64"}]: dispatch 2024-09-21T07:57:37.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:37 smithi129 ceph-mon[34472]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57445a72-d438-4f24-9e18-c69eb61e3c64"}]': finished 2024-09-21T07:57:37.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:37 smithi129 ceph-mon[34472]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T07:57:37.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:37 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T07:57:37.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:37 smithi107 ceph-mon[27622]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:57:37.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:37 smithi107 ceph-mon[27622]: pgmap v76: 1 pgs: 1 creating+peering; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:37.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:37 smithi107 ceph-mon[27622]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:57:37.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:37 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:37.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:37 smithi107 ceph-mon[27622]: from='client.? 172.21.15.129:0/2842875406' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57445a72-d438-4f24-9e18-c69eb61e3c64"}]: dispatch 2024-09-21T07:57:37.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:37 smithi107 ceph-mon[27622]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57445a72-d438-4f24-9e18-c69eb61e3c64"}]: dispatch 2024-09-21T07:57:37.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:37 smithi107 ceph-mon[27622]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57445a72-d438-4f24-9e18-c69eb61e3c64"}]': finished 2024-09-21T07:57:37.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:37 smithi107 ceph-mon[27622]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T07:57:37.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:37 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T07:57:38.340 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:38 smithi107 ceph-mon[27622]: from='client.? 172.21.15.129:0/2572642007' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T07:57:38.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:38 smithi129 ceph-mon[34472]: from='client.? 172.21.15.129:0/2572642007' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T07:57:40.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:39 smithi129 ceph-mon[34472]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:40.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:39 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:40.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:39 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:40.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:39 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:40.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:39 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:57:40.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:39 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:40.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:39 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:57:40.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:39 smithi107 ceph-mon[27622]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:40.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:39 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:40.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:39 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:40.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:39 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:40.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:39 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:57:40.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:39 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:40.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:39 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:57:42.000 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:41 smithi129 ceph-mon[34472]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:42.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:41 smithi107 ceph-mon[27622]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:43.827 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:43 smithi129 ceph-mon[34472]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:44.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:43 smithi107 ceph-mon[27622]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:45.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:44 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-21T07:57:45.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:44 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:45.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:44 smithi129 ceph-mon[34472]: Deploying daemon osd.3 on smithi129 2024-09-21T07:57:45.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:44 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-21T07:57:45.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:44 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:45.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:44 smithi107 ceph-mon[27622]: Deploying daemon osd.3 on smithi129 2024-09-21T07:57:46.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:45 smithi129 ceph-mon[34472]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:46.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:45 smithi107 ceph-mon[27622]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:48.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:47 smithi129 ceph-mon[34472]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:48.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:47 smithi107 ceph-mon[27622]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:48.982 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:48 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:57:48.982 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:48 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:48.982 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:48 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:49.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:48 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:57:49.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:48 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:49.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:48 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:49.912 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:49 smithi129 ceph-mon[34472]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:50.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:49 smithi107 ceph-mon[27622]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:51.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:51.126+0000 7f706affd640 1 -- 172.21.15.129:0/2600427092 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f706c10f000 con 0x7f705406ecc0 2024-09-21T07:57:51.128 INFO:teuthology.orchestra.run.smithi129.stdout:Created osd(s) 3 on host 'smithi129' 2024-09-21T07:57:51.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:51.128+0000 7f70745ac640 1 -- 172.21.15.129:0/2600427092 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f705406ecc0 msgr2=0x7f7054071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:51.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:51.128+0000 7f70745ac640 1 --2- 172.21.15.129:0/2600427092 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f705406ecc0 0x7f7054071170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7060007ac0 tx=0x7f7060035040 comp rx=0 tx=0).stop 2024-09-21T07:57:51.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:51.128+0000 7f70745ac640 1 -- 172.21.15.129:0/2600427092 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f706c065c40 msgr2=0x7f706c10d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:51.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:51.128+0000 7f70745ac640 1 --2- 172.21.15.129:0/2600427092 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f706c065c40 0x7f706c10d070 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f705c00ece0 tx=0x7f705c00b040 comp rx=0 tx=0).stop 2024-09-21T07:57:51.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:51.128+0000 7f70745ac640 1 -- 172.21.15.129:0/2600427092 shutdown_connections 2024-09-21T07:57:51.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:51.128+0000 7f70745ac640 1 --2- 172.21.15.129:0/2600427092 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f705406ecc0 0x7f7054071170 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:51.128+0000 7f70745ac640 1 --2- 172.21.15.129:0/2600427092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f706c0ff680 0x7f706c10d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:51.128+0000 7f70745ac640 1 --2- 172.21.15.129:0/2600427092 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f706c065c40 0x7f706c10d070 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:51.128+0000 7f70745ac640 1 -- 172.21.15.129:0/2600427092 >> 172.21.15.129:0/2600427092 conn(0x7f706c0f6c10 msgr2=0x7f706c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:51.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:51.128+0000 7f70745ac640 1 -- 172.21.15.129:0/2600427092 shutdown_connections 2024-09-21T07:57:51.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:51.128+0000 7f70745ac640 1 -- 172.21.15.129:0/2600427092 wait complete. 2024-09-21T07:57:51.749 DEBUG:teuthology.orchestra.run.smithi129:osd.3> sudo journalctl -f -n 0 -u ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.3.service 2024-09-21T07:57:51.751 INFO:tasks.cephadm:Deploying osd.4 on smithi129 with /dev/vg_nvme/lv_3... 2024-09-21T07:57:51.752 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T07:57:52.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:51 smithi129 ceph-mon[34472]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:52.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:51 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:52.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:51 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:52.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:51 smithi107 ceph-mon[27622]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:52.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:51 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:52.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:51 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:52.143 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi129/config 2024-09-21T07:57:52.720 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:52 smithi129 ceph-mon[34472]: from='osd.3 [v2:172.21.15.129:6800/1110660771,v1:172.21.15.129:6801/1110660771]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T07:57:52.721 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:52 smithi129 ceph-mon[34472]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T07:57:52.721 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 07:57:52 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3[39767]: 2024-09-21T07:57:52.322+0000 7f05e1679440 -1 osd.3 0 log_to_monitors true 2024-09-21T07:57:53.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:52 smithi107 ceph-mon[27622]: from='osd.3 [v2:172.21.15.129:6800/1110660771,v1:172.21.15.129:6801/1110660771]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T07:57:53.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:52 smithi107 ceph-mon[27622]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T07:57:53.993 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 07:57:53 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3[39767]: 2024-09-21T07:57:53.734+0000 7f05dcdeb640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T07:57:53.993 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 07:57:53 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3[39767]: 2024-09-21T07:57:53.741+0000 7f05d6c20640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:57:53.993 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:53 smithi129 ceph-mon[34472]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:53.993 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:53 smithi129 ceph-mon[34472]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T07:57:53.993 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:53 smithi129 ceph-mon[34472]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T07:57:53.993 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:53 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T07:57:53.993 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:53 smithi129 ceph-mon[34472]: from='osd.3 [v2:172.21.15.129:6800/1110660771,v1:172.21.15.129:6801/1110660771]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T07:57:53.993 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:53 smithi129 ceph-mon[34472]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T07:57:54.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:53 smithi107 ceph-mon[27622]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:54.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:53 smithi107 ceph-mon[27622]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T07:57:54.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:53 smithi107 ceph-mon[27622]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T07:57:54.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:53 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T07:57:54.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:53 smithi107 ceph-mon[27622]: from='osd.3 [v2:172.21.15.129:6800/1110660771,v1:172.21.15.129:6801/1110660771]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T07:57:54.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:53 smithi107 ceph-mon[27622]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T07:57:55.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:54 smithi129 ceph-mon[34472]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]': finished 2024-09-21T07:57:55.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:54 smithi129 ceph-mon[34472]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T07:57:55.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:54 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T07:57:55.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:54 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T07:57:55.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:54 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:55.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:54 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:55.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:54 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:57:55.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:54 smithi107 ceph-mon[27622]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]': finished 2024-09-21T07:57:55.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:54 smithi107 ceph-mon[27622]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T07:57:55.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:54 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T07:57:55.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:54 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T07:57:55.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:54 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:55.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:54 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:55.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:54 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:57:55.085 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:57:55.104 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi129:vg_nvme/lv_3 2024-09-21T07:57:55.578 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi129/config 2024-09-21T07:57:55.926 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:55 smithi129 ceph-mon[34472]: purged_snaps scrub starts 2024-09-21T07:57:55.926 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:55 smithi129 ceph-mon[34472]: purged_snaps scrub ok 2024-09-21T07:57:55.926 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:55 smithi129 ceph-mon[34472]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:55.927 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:55 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T07:57:55.927 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:55 smithi129 ceph-mon[34472]: osd.3 [v2:172.21.15.129:6800/1110660771,v1:172.21.15.129:6801/1110660771] boot 2024-09-21T07:57:55.927 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:55 smithi129 ceph-mon[34472]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T07:57:55.927 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:55 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T07:57:56.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:55 smithi107 ceph-mon[27622]: purged_snaps scrub starts 2024-09-21T07:57:56.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:55 smithi107 ceph-mon[27622]: purged_snaps scrub ok 2024-09-21T07:57:56.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:55 smithi107 ceph-mon[27622]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-21T07:57:56.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:55 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T07:57:56.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:55 smithi107 ceph-mon[27622]: osd.3 [v2:172.21.15.129:6800/1110660771,v1:172.21.15.129:6801/1110660771] boot 2024-09-21T07:57:56.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:55 smithi107 ceph-mon[27622]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T07:57:56.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:55 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T07:57:56.908 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:56 smithi129 ceph-mon[34472]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T07:57:57.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:56 smithi107 ceph-mon[27622]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T07:57:57.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.794+0000 7fdc8d7cf640 1 -- 172.21.15.129:0/3635503408 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc880fb430 msgr2=0x7fdc880fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:57.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.794+0000 7fdc8d7cf640 1 --2- 172.21.15.129:0/3635503408 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc880fb430 0x7fdc880fb840 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdc780048d0 tx=0x7fdc78009da0 comp rx=0 tx=0).stop 2024-09-21T07:57:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.794+0000 7fdc8d7cf640 1 -- 172.21.15.129:0/3635503408 shutdown_connections 2024-09-21T07:57:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.794+0000 7fdc8d7cf640 1 --2- 172.21.15.129:0/3635503408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc880fc700 0x7fdc880fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.794+0000 7fdc8d7cf640 1 --2- 172.21.15.129:0/3635503408 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc880fb430 0x7fdc880fb840 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.794+0000 7fdc8d7cf640 1 -- 172.21.15.129:0/3635503408 >> 172.21.15.129:0/3635503408 conn(0x7fdc880f6c10 msgr2=0x7fdc880f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.794+0000 7fdc8d7cf640 1 -- 172.21.15.129:0/3635503408 shutdown_connections 2024-09-21T07:57:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.794+0000 7fdc8d7cf640 1 -- 172.21.15.129:0/3635503408 wait complete. 2024-09-21T07:57:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.794+0000 7fdc8d7cf640 1 Processor -- start 2024-09-21T07:57:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.795+0000 7fdc8d7cf640 1 -- start start 2024-09-21T07:57:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.795+0000 7fdc8d7cf640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc880fb430 0x7fdc8810aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.795+0000 7fdc8d7cf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc880fc700 0x7fdc8810b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.795+0000 7fdc8d7cf640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8810ba30 con 0x7fdc880fc700 2024-09-21T07:57:57.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.795+0000 7fdc8d7cf640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8810c250 con 0x7fdc880fb430 2024-09-21T07:57:57.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.795+0000 7fdc86ffd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc880fb430 0x7fdc8810aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:57.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.795+0000 7fdc86ffd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc880fb430 0x7fdc8810aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:60712/0 (socket says 172.21.15.129:60712) 2024-09-21T07:57:57.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.795+0000 7fdc86ffd640 1 -- 172.21.15.129:0/1355755381 learned_addr learned my addr 172.21.15.129:0/1355755381 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:57:57.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.795+0000 7fdc7ffff640 1 --2- 172.21.15.129:0/1355755381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc880fc700 0x7fdc8810b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:57.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.795+0000 7fdc86ffd640 1 -- 172.21.15.129:0/1355755381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc880fc700 msgr2=0x7fdc8810b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:57.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.795+0000 7fdc86ffd640 1 --2- 172.21.15.129:0/1355755381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc880fc700 0x7fdc8810b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:57.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.795+0000 7fdc86ffd640 1 -- 172.21.15.129:0/1355755381 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc78005040 con 0x7fdc880fb430 2024-09-21T07:57:57.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.795+0000 7fdc7ffff640 1 --2- 172.21.15.129:0/1355755381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc880fc700 0x7fdc8810b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:57:57.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.795+0000 7fdc86ffd640 1 --2- 172.21.15.129:0/1355755381 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc880fb430 0x7fdc8810aea0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdc78003080 tx=0x7fdc78009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:57.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.795+0000 7fdc7f7fe640 1 -- 172.21.15.129:0/1355755381 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc78038070 con 0x7fdc880fb430 2024-09-21T07:57:57.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.795+0000 7fdc8d7cf640 1 -- 172.21.15.129:0/1355755381 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc8810c480 con 0x7fdc880fb430 2024-09-21T07:57:57.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.796+0000 7fdc7f7fe640 1 -- 172.21.15.129:0/1355755381 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdc7802abd0 con 0x7fdc880fb430 2024-09-21T07:57:57.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.796+0000 7fdc7f7fe640 1 -- 172.21.15.129:0/1355755381 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc7803e670 con 0x7fdc880fb430 2024-09-21T07:57:57.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.796+0000 7fdc8d7cf640 1 -- 172.21.15.129:0/1355755381 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8810ca20 con 0x7fdc880fb430 2024-09-21T07:57:57.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.797+0000 7fdc8d7cf640 1 -- 172.21.15.129:0/1355755381 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc880fa890 con 0x7fdc880fb430 2024-09-21T07:57:57.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.797+0000 7fdc7f7fe640 1 -- 172.21.15.129:0/1355755381 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fdc78030020 con 0x7fdc880fb430 2024-09-21T07:57:57.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.798+0000 7fdc7f7fe640 1 --2- 172.21.15.129:0/1355755381 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fdc74073170 0x7fdc74075620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:57.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.798+0000 7fdc7f7fe640 1 -- 172.21.15.129:0/1355755381 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3770+0+0 (secure 0 0 0) 0x7fdc780adef0 con 0x7fdc880fb430 2024-09-21T07:57:57.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.798+0000 7fdc7ffff640 1 --2- 172.21.15.129:0/1355755381 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fdc74073170 0x7fdc74075620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:57.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.799+0000 7fdc7ffff640 1 --2- 172.21.15.129:0/1355755381 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fdc74073170 0x7fdc74075620 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdc8810ac50 tx=0x7fdc70009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:57.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.805+0000 7fdc7f7fe640 1 -- 172.21.15.129:0/1355755381 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdc7807b6b0 con 0x7fdc880fb430 2024-09-21T07:57:57.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:57:57.977+0000 7fdc8d7cf640 1 -- 172.21.15.129:0/1355755381 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc8810cdc0 con 0x7fdc74073170 2024-09-21T07:57:58.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:57 smithi129 ceph-mon[34472]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-21T07:57:58.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:57 smithi129 ceph-mon[34472]: osdmap e28: 4 total, 4 up, 4 in 2024-09-21T07:57:58.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:57 smithi107 ceph-mon[27622]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-21T07:57:58.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:57 smithi107 ceph-mon[27622]: osdmap e28: 4 total, 4 up, 4 in 2024-09-21T07:57:58.845 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T07:57:58.845 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T07:57:58.845 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:58.845 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:58.845 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:58.845 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:57:58.846 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:58.846 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:58.846 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:57:58.846 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:58.846 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:57:58.846 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:58.846 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:57:58.847 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:59.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T07:57:59.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T07:57:59.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:59.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:59.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:59.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:57:59.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:59.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:59.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:57:59.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:57:59.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:57:59.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:57:59.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:57:59.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:00.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:59 smithi129 ceph-mon[34472]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:58:00.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:59 smithi129 ceph-mon[34472]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 131 KiB/s, 0 objects/s recovering 2024-09-21T07:58:00.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:59 smithi129 ceph-mon[34472]: Detected new or changed devices on smithi129 2024-09-21T07:58:00.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:57:59 smithi129 ceph-mon[34472]: Adjusting osd_memory_target on smithi129 to 15936M 2024-09-21T07:58:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:59 smithi107 ceph-mon[27622]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:58:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:59 smithi107 ceph-mon[27622]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 131 KiB/s, 0 objects/s recovering 2024-09-21T07:58:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:59 smithi107 ceph-mon[27622]: Detected new or changed devices on smithi129 2024-09-21T07:58:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:57:59 smithi107 ceph-mon[27622]: Adjusting osd_memory_target on smithi129 to 15936M 2024-09-21T07:58:01.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:00 smithi129 ceph-mon[34472]: from='client.? 172.21.15.129:0/3393452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "619f850e-d5ab-4aa0-ae32-7702b79354eb"}]: dispatch 2024-09-21T07:58:01.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:00 smithi129 ceph-mon[34472]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "619f850e-d5ab-4aa0-ae32-7702b79354eb"}]: dispatch 2024-09-21T07:58:01.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:00 smithi129 ceph-mon[34472]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "619f850e-d5ab-4aa0-ae32-7702b79354eb"}]': finished 2024-09-21T07:58:01.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:00 smithi129 ceph-mon[34472]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T07:58:01.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:00 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T07:58:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:00 smithi107 ceph-mon[27622]: from='client.? 172.21.15.129:0/3393452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "619f850e-d5ab-4aa0-ae32-7702b79354eb"}]: dispatch 2024-09-21T07:58:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:00 smithi107 ceph-mon[27622]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "619f850e-d5ab-4aa0-ae32-7702b79354eb"}]: dispatch 2024-09-21T07:58:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:00 smithi107 ceph-mon[27622]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "619f850e-d5ab-4aa0-ae32-7702b79354eb"}]': finished 2024-09-21T07:58:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:00 smithi107 ceph-mon[27622]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T07:58:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:00 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T07:58:02.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:01 smithi129 ceph-mon[34472]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:58:02.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:01 smithi129 ceph-mon[34472]: from='client.? 172.21.15.129:0/3976719707' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T07:58:02.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:01 smithi107 ceph-mon[27622]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:58:02.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:01 smithi107 ceph-mon[27622]: from='client.? 172.21.15.129:0/3976719707' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T07:58:04.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:03 smithi129 ceph-mon[34472]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T07:58:04.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:03 smithi107 ceph-mon[27622]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T07:58:06.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:05 smithi129 ceph-mon[34472]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:58:06.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:05 smithi107 ceph-mon[27622]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:58:08.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:07 smithi129 ceph-mon[34472]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T07:58:08.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:07 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-21T07:58:08.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:07 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:58:08.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:07 smithi107 ceph-mon[27622]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T07:58:08.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:07 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-21T07:58:08.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:07 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:58:09.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:08 smithi107 ceph-mon[27622]: Deploying daemon osd.4 on smithi129 2024-09-21T07:58:09.069 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:08 smithi129 ceph-mon[34472]: Deploying daemon osd.4 on smithi129 2024-09-21T07:58:10.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:09 smithi107 ceph-mon[27622]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-21T07:58:10.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:09 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:58:10.070 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:09 smithi129 ceph-mon[34472]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-21T07:58:10.070 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:09 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:58:11.862 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:11 smithi129 ceph-mon[34472]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-21T07:58:12.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:11 smithi107 ceph-mon[27622]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-21T07:58:13.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:12 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:58:13.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:12 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:13.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:12 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:13.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:12 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:58:13.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:12 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:13.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:12 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:14.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:13 smithi129 ceph-mon[34472]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-21T07:58:14.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:13 smithi107 ceph-mon[27622]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-21T07:58:16.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:15 smithi107 ceph-mon[27622]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-21T07:58:16.060 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:15 smithi129 ceph-mon[34472]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-21T07:58:16.094 INFO:teuthology.orchestra.run.smithi129.stdout:Created osd(s) 4 on host 'smithi129' 2024-09-21T07:58:16.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:16.092+0000 7fdc7f7fe640 1 -- 172.21.15.129:0/1355755381 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fdc8810cdc0 con 0x7fdc74073170 2024-09-21T07:58:16.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:16.095+0000 7fdc8d7cf640 1 -- 172.21.15.129:0/1355755381 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fdc74073170 msgr2=0x7fdc74075620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:16.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:16.095+0000 7fdc8d7cf640 1 --2- 172.21.15.129:0/1355755381 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fdc74073170 0x7fdc74075620 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdc8810ac50 tx=0x7fdc70009040 comp rx=0 tx=0).stop 2024-09-21T07:58:16.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:16.095+0000 7fdc8d7cf640 1 -- 172.21.15.129:0/1355755381 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc880fb430 msgr2=0x7fdc8810aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:16.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:16.095+0000 7fdc8d7cf640 1 --2- 172.21.15.129:0/1355755381 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc880fb430 0x7fdc8810aea0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdc78003080 tx=0x7fdc78009da0 comp rx=0 tx=0).stop 2024-09-21T07:58:16.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:16.095+0000 7fdc8d7cf640 1 -- 172.21.15.129:0/1355755381 shutdown_connections 2024-09-21T07:58:16.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:16.095+0000 7fdc8d7cf640 1 --2- 172.21.15.129:0/1355755381 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fdc74073170 0x7fdc74075620 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:16.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:16.095+0000 7fdc8d7cf640 1 --2- 172.21.15.129:0/1355755381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc880fc700 0x7fdc8810b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:16.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:16.095+0000 7fdc8d7cf640 1 --2- 172.21.15.129:0/1355755381 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc880fb430 0x7fdc8810aea0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:16.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:16.095+0000 7fdc8d7cf640 1 -- 172.21.15.129:0/1355755381 >> 172.21.15.129:0/1355755381 conn(0x7fdc880f6c10 msgr2=0x7fdc880f8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:16.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:16.095+0000 7fdc8d7cf640 1 -- 172.21.15.129:0/1355755381 shutdown_connections 2024-09-21T07:58:16.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:16.095+0000 7fdc8d7cf640 1 -- 172.21.15.129:0/1355755381 wait complete. 2024-09-21T07:58:16.691 DEBUG:teuthology.orchestra.run.smithi129:osd.4> sudo journalctl -f -n 0 -u ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.4.service 2024-09-21T07:58:16.693 INFO:tasks.cephadm:Deploying osd.5 on smithi129 with /dev/vg_nvme/lv_2... 2024-09-21T07:58:16.693 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T07:58:16.981 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi129/config 2024-09-21T07:58:17.392 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:17 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:17.392 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:17 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:17.392 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:17 smithi129 ceph-mon[34472]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-21T07:58:17.392 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:17 smithi129 ceph-mon[34472]: from='osd.4 [v2:172.21.15.129:6808/431008109,v1:172.21.15.129:6809/431008109]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T07:58:17.392 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:17 smithi129 ceph-mon[34472]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T07:58:17.392 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:17 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:17.392 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:17 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:17.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:17 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:17.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:17 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:17.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:17 smithi107 ceph-mon[27622]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-21T07:58:17.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:17 smithi107 ceph-mon[27622]: from='osd.4 [v2:172.21.15.129:6808/431008109,v1:172.21.15.129:6809/431008109]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T07:58:17.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:17 smithi107 ceph-mon[27622]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T07:58:17.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:17 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:17.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:17 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:18.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:18 smithi129 ceph-mon[34472]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T07:58:18.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:18 smithi129 ceph-mon[34472]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T07:58:18.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:18 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T07:58:18.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:18 smithi129 ceph-mon[34472]: from='osd.4 [v2:172.21.15.129:6808/431008109,v1:172.21.15.129:6809/431008109]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T07:58:18.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:18 smithi129 ceph-mon[34472]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T07:58:18.268 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:58:18 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[46116]: 2024-09-21T07:58:18.101+0000 7f662b86e640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T07:58:18.268 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:58:18 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[46116]: 2024-09-21T07:58:18.107+0000 7f6626ea6640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:58:18.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:18 smithi107 ceph-mon[27622]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T07:58:18.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:18 smithi107 ceph-mon[27622]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T07:58:18.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:18 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T07:58:18.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:18 smithi107 ceph-mon[27622]: from='osd.4 [v2:172.21.15.129:6808/431008109,v1:172.21.15.129:6809/431008109]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T07:58:18.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:18 smithi107 ceph-mon[27622]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T07:58:19.361 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:19 smithi129 ceph-mon[34472]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]': finished 2024-09-21T07:58:19.361 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:19 smithi129 ceph-mon[34472]: osdmap e31: 5 total, 4 up, 5 in 2024-09-21T07:58:19.361 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:19 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T07:58:19.361 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:19 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T07:58:19.361 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:19 smithi129 ceph-mon[34472]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-21T07:58:19.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:19 smithi107 ceph-mon[27622]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]': finished 2024-09-21T07:58:19.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:19 smithi107 ceph-mon[27622]: osdmap e31: 5 total, 4 up, 5 in 2024-09-21T07:58:19.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:19 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T07:58:19.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:19 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T07:58:19.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:19 smithi107 ceph-mon[27622]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-21T07:58:20.409 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:20 smithi129 ceph-mon[34472]: purged_snaps scrub starts 2024-09-21T07:58:20.410 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:20 smithi129 ceph-mon[34472]: purged_snaps scrub ok 2024-09-21T07:58:20.410 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:20 smithi129 ceph-mon[34472]: osd.4 [v2:172.21.15.129:6808/431008109,v1:172.21.15.129:6809/431008109] boot 2024-09-21T07:58:20.410 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:20 smithi129 ceph-mon[34472]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T07:58:20.410 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:20 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T07:58:20.415 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:58:20.436 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi129:vg_nvme/lv_2 2024-09-21T07:58:20.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:20 smithi107 ceph-mon[27622]: purged_snaps scrub starts 2024-09-21T07:58:20.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:20 smithi107 ceph-mon[27622]: purged_snaps scrub ok 2024-09-21T07:58:20.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:20 smithi107 ceph-mon[27622]: osd.4 [v2:172.21.15.129:6808/431008109,v1:172.21.15.129:6809/431008109] boot 2024-09-21T07:58:20.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:20 smithi107 ceph-mon[27622]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T07:58:20.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:20 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T07:58:20.967 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi129/config 2024-09-21T07:58:21.340 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:21 smithi129 ceph-mon[34472]: osdmap e33: 5 total, 5 up, 5 in 2024-09-21T07:58:21.340 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:21 smithi129 ceph-mon[34472]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:21.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:21 smithi107 ceph-mon[27622]: osdmap e33: 5 total, 5 up, 5 in 2024-09-21T07:58:21.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:21 smithi107 ceph-mon[27622]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:23.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.186+0000 7ff89246e640 1 -- 172.21.15.129:0/3715596466 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff88c0fc520 msgr2=0x7ff88c0fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:23.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.186+0000 7ff89246e640 1 --2- 172.21.15.129:0/3715596466 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff88c0fc520 0x7ff88c0fc930 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff87c0048d0 tx=0x7ff87c009da0 comp rx=0 tx=0).stop 2024-09-21T07:58:23.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.186+0000 7ff89246e640 1 -- 172.21.15.129:0/3715596466 shutdown_connections 2024-09-21T07:58:23.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.186+0000 7ff89246e640 1 --2- 172.21.15.129:0/3715596466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff88c0fd7f0 0x7ff88c0fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:23.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.186+0000 7ff89246e640 1 --2- 172.21.15.129:0/3715596466 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff88c0fc520 0x7ff88c0fc930 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:23.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.186+0000 7ff89246e640 1 -- 172.21.15.129:0/3715596466 >> 172.21.15.129:0/3715596466 conn(0x7ff88c0f7ce0 msgr2=0x7ff88c0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:23.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.186+0000 7ff89246e640 1 -- 172.21.15.129:0/3715596466 shutdown_connections 2024-09-21T07:58:23.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.186+0000 7ff89246e640 1 -- 172.21.15.129:0/3715596466 wait complete. 2024-09-21T07:58:23.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.187+0000 7ff89246e640 1 Processor -- start 2024-09-21T07:58:23.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.187+0000 7ff89246e640 1 -- start start 2024-09-21T07:58:23.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.187+0000 7ff89246e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff88c0fc520 0x7ff88c10d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:23.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.187+0000 7ff89246e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff88c0fd7f0 0x7ff88c10d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:23.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.187+0000 7ff89246e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c10e480 con 0x7ff88c0fd7f0 2024-09-21T07:58:23.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.187+0000 7ff89246e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c10e5f0 con 0x7ff88c0fc520 2024-09-21T07:58:23.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.187+0000 7ff88bfff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff88c0fc520 0x7ff88c10d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:23.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.187+0000 7ff88bfff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff88c0fc520 0x7ff88c10d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:47168/0 (socket says 172.21.15.129:47168) 2024-09-21T07:58:23.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.187+0000 7ff88bfff640 1 -- 172.21.15.129:0/1656553764 learned_addr learned my addr 172.21.15.129:0/1656553764 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:58:23.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.187+0000 7ff883fff640 1 --2- 172.21.15.129:0/1656553764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff88c0fd7f0 0x7ff88c10d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:23.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.187+0000 7ff88bfff640 1 -- 172.21.15.129:0/1656553764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff88c0fd7f0 msgr2=0x7ff88c10d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:23.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.187+0000 7ff88bfff640 1 --2- 172.21.15.129:0/1656553764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff88c0fd7f0 0x7ff88c10d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:23.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.187+0000 7ff88bfff640 1 -- 172.21.15.129:0/1656553764 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87c005040 con 0x7ff88c0fc520 2024-09-21T07:58:23.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.187+0000 7ff883fff640 1 --2- 172.21.15.129:0/1656553764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff88c0fd7f0 0x7ff88c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:58:23.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.187+0000 7ff88bfff640 1 --2- 172.21.15.129:0/1656553764 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff88c0fc520 0x7ff88c10d0d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff87c003080 tx=0x7ff87c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:23.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.188+0000 7ff8897fa640 1 -- 172.21.15.129:0/1656553764 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff87c038070 con 0x7ff88c0fc520 2024-09-21T07:58:23.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.188+0000 7ff89246e640 1 -- 172.21.15.129:0/1656553764 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88c10e870 con 0x7ff88c0fc520 2024-09-21T07:58:23.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.188+0000 7ff8897fa640 1 -- 172.21.15.129:0/1656553764 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff87c02abd0 con 0x7ff88c0fc520 2024-09-21T07:58:23.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.188+0000 7ff8897fa640 1 -- 172.21.15.129:0/1656553764 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff87c03e670 con 0x7ff88c0fc520 2024-09-21T07:58:23.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.188+0000 7ff89246e640 1 -- 172.21.15.129:0/1656553764 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88c10ed90 con 0x7ff88c0fc520 2024-09-21T07:58:23.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.189+0000 7ff89246e640 1 -- 172.21.15.129:0/1656553764 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff88c1057b0 con 0x7ff88c0fc520 2024-09-21T07:58:23.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.189+0000 7ff8897fa640 1 -- 172.21.15.129:0/1656553764 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7ff87c030020 con 0x7ff88c0fc520 2024-09-21T07:58:23.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.189+0000 7ff8897fa640 1 --2- 172.21.15.129:0/1656553764 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7ff87806ed60 0x7ff878071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:23.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.190+0000 7ff8897fa640 1 -- 172.21.15.129:0/1656553764 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4202+0+0 (secure 0 0 0) 0x7ff87c0ae0a0 con 0x7ff88c0fc520 2024-09-21T07:58:23.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.190+0000 7ff883fff640 1 --2- 172.21.15.129:0/1656553764 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7ff87806ed60 0x7ff878071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:23.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.190+0000 7ff883fff640 1 --2- 172.21.15.129:0/1656553764 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7ff87806ed60 0x7ff878071210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff874006fd0 tx=0x7ff874008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:23.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.194+0000 7ff8897fa640 1 -- 172.21.15.129:0/1656553764 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff87c07b6b0 con 0x7ff88c0fc520 2024-09-21T07:58:23.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:23.359+0000 7ff89246e640 1 -- 172.21.15.129:0/1656553764 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff88c10efb0 con 0x7ff87806ed60 2024-09-21T07:58:23.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:23 smithi107 ceph-mon[27622]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:23.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:23 smithi107 ceph-mon[27622]: Detected new or changed devices on smithi129 2024-09-21T07:58:23.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:23 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:23.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:23 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:23.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:23 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:58:23.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:23 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:58:23.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:23 smithi107 ceph-mon[27622]: Adjusting osd_memory_target on smithi129 to 7968M 2024-09-21T07:58:23.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:23 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:23.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:23 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:58:23.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:23 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:58:23.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:23 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:23.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:23 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:58:23.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:23 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:58:23.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:23 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:58:23.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:23 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:23.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:23 smithi129 ceph-mon[34472]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:23.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:23 smithi129 ceph-mon[34472]: Detected new or changed devices on smithi129 2024-09-21T07:58:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:23 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:23 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:23 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:58:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:23 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:58:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:23 smithi129 ceph-mon[34472]: Adjusting osd_memory_target on smithi129 to 7968M 2024-09-21T07:58:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:23 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:23 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:58:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:23 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:58:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:23 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:23 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:58:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:23 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:58:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:23 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:58:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:23 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:24.323 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:24 smithi129 ceph-mon[34472]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:58:24.323 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:24 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T07:58:24.324 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:24 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T07:58:24.324 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:24 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:58:24.324 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:24 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:58:24.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:24 smithi107 ceph-mon[27622]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:58:24.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T07:58:24.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T07:58:24.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:58:24.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:58:25.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:25 smithi129 ceph-mon[34472]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:25.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:25 smithi107 ceph-mon[27622]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:26.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:26 smithi129 ceph-mon[34472]: from='client.? 172.21.15.129:0/765793276' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da233bd9-495d-49fc-bf34-39e983b9dd14"}]: dispatch 2024-09-21T07:58:26.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:26 smithi129 ceph-mon[34472]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da233bd9-495d-49fc-bf34-39e983b9dd14"}]: dispatch 2024-09-21T07:58:26.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:26 smithi129 ceph-mon[34472]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da233bd9-495d-49fc-bf34-39e983b9dd14"}]': finished 2024-09-21T07:58:26.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:26 smithi129 ceph-mon[34472]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T07:58:26.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:26 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T07:58:26.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:26 smithi129 ceph-mon[34472]: from='client.? 172.21.15.129:0/1596697400' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T07:58:26.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:26 smithi107 ceph-mon[27622]: from='client.? 172.21.15.129:0/765793276' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da233bd9-495d-49fc-bf34-39e983b9dd14"}]: dispatch 2024-09-21T07:58:26.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:26 smithi107 ceph-mon[27622]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da233bd9-495d-49fc-bf34-39e983b9dd14"}]: dispatch 2024-09-21T07:58:26.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:26 smithi107 ceph-mon[27622]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da233bd9-495d-49fc-bf34-39e983b9dd14"}]': finished 2024-09-21T07:58:26.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:26 smithi107 ceph-mon[27622]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T07:58:26.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:26 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T07:58:26.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:26 smithi107 ceph-mon[27622]: from='client.? 172.21.15.129:0/1596697400' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T07:58:27.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:27 smithi107 ceph-mon[27622]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:28.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:27 smithi129 ceph-mon[34472]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:29.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:29 smithi107 ceph-mon[27622]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:29.940 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:29 smithi129 ceph-mon[34472]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:31.600 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:31 smithi129 ceph-mon[34472]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:31.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:31 smithi107 ceph-mon[27622]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:32.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:32 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-21T07:58:32.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:32 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:58:32.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:32 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-21T07:58:32.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:32 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:58:33.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:33 smithi107 ceph-mon[27622]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:33.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:33 smithi107 ceph-mon[27622]: Deploying daemon osd.5 on smithi129 2024-09-21T07:58:33.840 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:33 smithi129 ceph-mon[34472]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:33.840 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:33 smithi129 ceph-mon[34472]: Deploying daemon osd.5 on smithi129 2024-09-21T07:58:35.727 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:35 smithi129 ceph-mon[34472]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:35.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:35 smithi107 ceph-mon[27622]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:37.790 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:37 smithi129 ceph-mon[34472]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:37.790 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:37 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:58:37.790 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:37 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:37.790 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:37 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:37.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:37 smithi107 ceph-mon[27622]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:37.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:37 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:58:37.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:37 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:37.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:37 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:39.793 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:39 smithi129 ceph-mon[34472]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:39.793 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:39 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:58:39.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:39 smithi107 ceph-mon[27622]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:39.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:39 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:58:41.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:41.188+0000 7ff8897fa640 1 -- 172.21.15.129:0/1656553764 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff88c10efb0 con 0x7ff87806ed60 2024-09-21T07:58:41.190 INFO:teuthology.orchestra.run.smithi129.stdout:Created osd(s) 5 on host 'smithi129' 2024-09-21T07:58:41.192 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:41.191+0000 7ff89246e640 1 -- 172.21.15.129:0/1656553764 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7ff87806ed60 msgr2=0x7ff878071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:41.192 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:41.191+0000 7ff89246e640 1 --2- 172.21.15.129:0/1656553764 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7ff87806ed60 0x7ff878071210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff874006fd0 tx=0x7ff874008040 comp rx=0 tx=0).stop 2024-09-21T07:58:41.192 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:41.191+0000 7ff89246e640 1 -- 172.21.15.129:0/1656553764 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff88c0fc520 msgr2=0x7ff88c10d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:41.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:41.191+0000 7ff89246e640 1 --2- 172.21.15.129:0/1656553764 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff88c0fc520 0x7ff88c10d0d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff87c003080 tx=0x7ff87c009da0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:41.191+0000 7ff89246e640 1 -- 172.21.15.129:0/1656553764 shutdown_connections 2024-09-21T07:58:41.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:41.191+0000 7ff89246e640 1 --2- 172.21.15.129:0/1656553764 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7ff87806ed60 0x7ff878071210 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:41.191+0000 7ff89246e640 1 --2- 172.21.15.129:0/1656553764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff88c0fd7f0 0x7ff88c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:41.191+0000 7ff89246e640 1 --2- 172.21.15.129:0/1656553764 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff88c0fc520 0x7ff88c10d0d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:41.191+0000 7ff89246e640 1 -- 172.21.15.129:0/1656553764 >> 172.21.15.129:0/1656553764 conn(0x7ff88c0f7ce0 msgr2=0x7ff88c0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:41.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:41.191+0000 7ff89246e640 1 -- 172.21.15.129:0/1656553764 shutdown_connections 2024-09-21T07:58:41.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:41.191+0000 7ff89246e640 1 -- 172.21.15.129:0/1656553764 wait complete. 2024-09-21T07:58:41.803 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:41 smithi129 ceph-mon[34472]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:41.804 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:41 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:41.804 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:41 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:41.804 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:41 smithi129 ceph-mon[34472]: from='osd.5 [v2:172.21.15.129:6816/4170919914,v1:172.21.15.129:6817/4170919914]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T07:58:41.804 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:41 smithi129 ceph-mon[34472]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T07:58:41.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:41 smithi107 ceph-mon[27622]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:41.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:41 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:41.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:41 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:41.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:41 smithi107 ceph-mon[27622]: from='osd.5 [v2:172.21.15.129:6816/4170919914,v1:172.21.15.129:6817/4170919914]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T07:58:41.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:41 smithi107 ceph-mon[27622]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T07:58:41.806 DEBUG:teuthology.orchestra.run.smithi129:osd.5> sudo journalctl -f -n 0 -u ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.5.service 2024-09-21T07:58:41.808 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-21T07:58:41.808 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph osd stat -f json 2024-09-21T07:58:42.068 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:58:43.233 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:42 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:43.233 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:42 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:43.233 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:42 smithi107 ceph-mon[27622]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:43.234 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:42 smithi107 ceph-mon[27622]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T07:58:43.234 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:42 smithi107 ceph-mon[27622]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T07:58:43.234 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:42 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T07:58:43.234 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:42 smithi107 ceph-mon[27622]: from='osd.5 [v2:172.21.15.129:6816/4170919914,v1:172.21.15.129:6817/4170919914]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T07:58:43.234 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:42 smithi107 ceph-mon[27622]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T07:58:43.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:42 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:43.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:42 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:43.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:42 smithi129 ceph-mon[34472]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:43.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:42 smithi129 ceph-mon[34472]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T07:58:43.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:42 smithi129 ceph-mon[34472]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T07:58:43.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:42 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T07:58:43.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:42 smithi129 ceph-mon[34472]: from='osd.5 [v2:172.21.15.129:6816/4170919914,v1:172.21.15.129:6817/4170919914]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T07:58:43.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:42 smithi129 ceph-mon[34472]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T07:58:43.267 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 07:58:43 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[52488]: 2024-09-21T07:58:43.194+0000 7f31f922c640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T07:58:43.267 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 07:58:43 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[52488]: 2024-09-21T07:58:43.201+0000 7f31f5866640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:58:43.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.744+0000 7fa3b3814640 1 -- 172.21.15.107:0/821722844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac065be0 msgr2=0x7fa3ac0ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:43.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.744+0000 7fa3b3814640 1 --2- 172.21.15.107:0/821722844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac065be0 0x7fa3ac0ff1a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80048d0 tx=0x7fa3a8009da0 comp rx=0 tx=0).stop 2024-09-21T07:58:43.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.744+0000 7fa3b3814640 1 -- 172.21.15.107:0/821722844 shutdown_connections 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.744+0000 7fa3b3814640 1 --2- 172.21.15.107:0/821722844 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa3ac0ff6e0 0x7fa3ac101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.744+0000 7fa3b3814640 1 --2- 172.21.15.107:0/821722844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac065be0 0x7fa3ac0ff1a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.744+0000 7fa3b3814640 1 -- 172.21.15.107:0/821722844 >> 172.21.15.107:0/821722844 conn(0x7fa3ac0f6c10 msgr2=0x7fa3ac0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.744+0000 7fa3b3814640 1 -- 172.21.15.107:0/821722844 shutdown_connections 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.744+0000 7fa3b3814640 1 -- 172.21.15.107:0/821722844 wait complete. 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.744+0000 7fa3b3814640 1 Processor -- start 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.744+0000 7fa3b3814640 1 -- start start 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.745+0000 7fa3b3814640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac065be0 0x7fa3ac10d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.745+0000 7fa3b3814640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa3ac0ff6e0 0x7fa3ac10d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.745+0000 7fa3b3814640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac10dcc0 con 0x7fa3ac065be0 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.745+0000 7fa3b3814640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac10e490 con 0x7fa3ac0ff6e0 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.745+0000 7fa3b15b0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac065be0 0x7fa3ac10d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.745+0000 7fa3b15b0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac065be0 0x7fa3ac10d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52426/0 (socket says 172.21.15.107:52426) 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.745+0000 7fa3b15b0640 1 -- 172.21.15.107:0/1015265510 learned_addr learned my addr 172.21.15.107:0/1015265510 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.745+0000 7fa3b0daf640 1 --2- 172.21.15.107:0/1015265510 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa3ac0ff6e0 0x7fa3ac10d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.745+0000 7fa3b15b0640 1 -- 172.21.15.107:0/1015265510 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa3ac0ff6e0 msgr2=0x7fa3ac10d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.745+0000 7fa3b15b0640 1 --2- 172.21.15.107:0/1015265510 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa3ac0ff6e0 0x7fa3ac10d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.745+0000 7fa3b15b0640 1 -- 172.21.15.107:0/1015265510 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a8005040 con 0x7fa3ac065be0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.745+0000 7fa3b15b0640 1 --2- 172.21.15.107:0/1015265510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac065be0 0x7fa3ac10d130 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009ac0 tx=0x7fa3a8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.745+0000 7fa39dffb640 1 -- 172.21.15.107:0/1015265510 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3a8038070 con 0x7fa3ac065be0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.745+0000 7fa39dffb640 1 -- 172.21.15.107:0/1015265510 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa3a8032d30 con 0x7fa3ac065be0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.745+0000 7fa39dffb640 1 -- 172.21.15.107:0/1015265510 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3a803eba0 con 0x7fa3ac065be0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.745+0000 7fa3b3814640 1 -- 172.21.15.107:0/1015265510 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ac10e6c0 con 0x7fa3ac065be0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.745+0000 7fa3b3814640 1 -- 172.21.15.107:0/1015265510 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ac10ec60 con 0x7fa3ac065be0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.746+0000 7fa3b3814640 1 -- 172.21.15.107:0/1015265510 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ac0fa890 con 0x7fa3ac065be0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.747+0000 7fa39dffb640 1 -- 172.21.15.107:0/1015265510 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fa3a8030020 con 0x7fa3ac065be0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.747+0000 7fa39dffb640 1 --2- 172.21.15.107:0/1015265510 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fa39806ed60 0x7fa398071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.747+0000 7fa39dffb640 1 -- 172.21.15.107:0/1015265510 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4354+0+0 (secure 0 0 0) 0x7fa3a80ae1c0 con 0x7fa3ac065be0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.747+0000 7fa3b0daf640 1 --2- 172.21.15.107:0/1015265510 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fa39806ed60 0x7fa398071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:43.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.748+0000 7fa3b0daf640 1 --2- 172.21.15.107:0/1015265510 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fa39806ed60 0x7fa398071210 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac10cee0 tx=0x7fa3a000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:43.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.752+0000 7fa39dffb640 1 -- 172.21.15.107:0/1015265510 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa3a807b730 con 0x7fa3ac065be0 2024-09-21T07:58:43.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.911+0000 7fa3b3814640 1 -- 172.21.15.107:0/1015265510 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fa3ac04b720 con 0x7fa3ac065be0 2024-09-21T07:58:43.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.912+0000 7fa39dffb640 1 -- 172.21.15.107:0/1015265510 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) v1 ==== 74+0+130 (secure 0 0 0) 0x7fa3a807b0d0 con 0x7fa3ac065be0 2024-09-21T07:58:43.914 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:58:43.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.914+0000 7fa3b3814640 1 -- 172.21.15.107:0/1015265510 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fa39806ed60 msgr2=0x7fa398071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:43.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.914+0000 7fa3b3814640 1 --2- 172.21.15.107:0/1015265510 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fa39806ed60 0x7fa398071210 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac10cee0 tx=0x7fa3a000b040 comp rx=0 tx=0).stop 2024-09-21T07:58:43.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.914+0000 7fa3b3814640 1 -- 172.21.15.107:0/1015265510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac065be0 msgr2=0x7fa3ac10d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:43.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.914+0000 7fa3b3814640 1 --2- 172.21.15.107:0/1015265510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac065be0 0x7fa3ac10d130 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009ac0 tx=0x7fa3a8009da0 comp rx=0 tx=0).stop 2024-09-21T07:58:43.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.914+0000 7fa3b3814640 1 -- 172.21.15.107:0/1015265510 shutdown_connections 2024-09-21T07:58:43.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.914+0000 7fa3b3814640 1 --2- 172.21.15.107:0/1015265510 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa3ac0ff6e0 0x7fa3ac10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:43.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.914+0000 7fa3b3814640 1 --2- 172.21.15.107:0/1015265510 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fa39806ed60 0x7fa398071210 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:43.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.914+0000 7fa3b3814640 1 --2- 172.21.15.107:0/1015265510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac065be0 0x7fa3ac10d130 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:43.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.914+0000 7fa3b3814640 1 -- 172.21.15.107:0/1015265510 >> 172.21.15.107:0/1015265510 conn(0x7fa3ac0f6c10 msgr2=0x7fa3ac0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:43.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.914+0000 7fa3b3814640 1 -- 172.21.15.107:0/1015265510 shutdown_connections 2024-09-21T07:58:43.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:43.914+0000 7fa3b3814640 1 -- 172.21.15.107:0/1015265510 wait complete. 2024-09-21T07:58:44.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:44 smithi129 ceph-mon[34472]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]': finished 2024-09-21T07:58:44.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:44 smithi129 ceph-mon[34472]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T07:58:44.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:44 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T07:58:44.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:44 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T07:58:44.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:44 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/1015265510' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T07:58:44.498 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:44 smithi107 ceph-mon[27622]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]': finished 2024-09-21T07:58:44.499 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:44 smithi107 ceph-mon[27622]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T07:58:44.499 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:44 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T07:58:44.499 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:44 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T07:58:44.499 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:44 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1015265510' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T07:58:44.522 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":36,"num_osds":6,"num_up_osds":5,"osd_up_since":1726905499,"num_in_osds":6,"osd_in_since":1726905505,"num_remapped_pgs":0} 2024-09-21T07:58:45.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:45 smithi129 ceph-mon[34472]: purged_snaps scrub starts 2024-09-21T07:58:45.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:45 smithi129 ceph-mon[34472]: purged_snaps scrub ok 2024-09-21T07:58:45.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:45 smithi129 ceph-mon[34472]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:45.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:45 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T07:58:45.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:45 smithi129 ceph-mon[34472]: osd.5 [v2:172.21.15.129:6816/4170919914,v1:172.21.15.129:6817/4170919914] boot 2024-09-21T07:58:45.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:45 smithi129 ceph-mon[34472]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T07:58:45.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:45 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T07:58:45.523 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph osd stat -f json 2024-09-21T07:58:45.546 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:45 smithi107 ceph-mon[27622]: purged_snaps scrub starts 2024-09-21T07:58:45.546 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:45 smithi107 ceph-mon[27622]: purged_snaps scrub ok 2024-09-21T07:58:45.546 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:45 smithi107 ceph-mon[27622]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-21T07:58:45.547 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:45 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T07:58:45.547 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:45 smithi107 ceph-mon[27622]: osd.5 [v2:172.21.15.129:6816/4170919914,v1:172.21.15.129:6817/4170919914] boot 2024-09-21T07:58:45.547 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:45 smithi107 ceph-mon[27622]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T07:58:45.547 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:45 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T07:58:45.797 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:58:46.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:46 smithi129 ceph-mon[34472]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T07:58:46.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:46 smithi129 ceph-mon[34472]: Detected new or changed devices on smithi129 2024-09-21T07:58:46.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:46 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:46.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:46 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:46.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:46 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:58:46.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:46 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:58:46.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:46 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:58:46.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:46 smithi129 ceph-mon[34472]: Adjusting osd_memory_target on smithi129 to 5312M 2024-09-21T07:58:46.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:46 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:46.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:46 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:58:46.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:46 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:58:46.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:46 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:46.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:46 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:58:46.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:46 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:58:46.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:46 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:58:46.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:46 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:46.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:46 smithi107 ceph-mon[27622]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T07:58:46.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:46 smithi107 ceph-mon[27622]: Detected new or changed devices on smithi129 2024-09-21T07:58:46.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:46 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:46.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:46 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:46.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:46 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:58:46.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:46 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:58:46.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:46 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T07:58:46.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:46 smithi107 ceph-mon[27622]: Adjusting osd_memory_target on smithi129 to 5312M 2024-09-21T07:58:46.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:46 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:46.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:46 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:58:46.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:46 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:58:46.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:46 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:46.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:46 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:58:46.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:46 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:58:46.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:46 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:58:46.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:46 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:58:47.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.405+0000 7f6042d00640 1 -- 172.21.15.107:0/3678195427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f603c0fa960 msgr2=0x7f603c0fad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:47.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.405+0000 7f6042d00640 1 --2- 172.21.15.107:0/3678195427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f603c0fa960 0x7f603c0fad70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f60300048d0 tx=0x7f6030009da0 comp rx=0 tx=0).stop 2024-09-21T07:58:47.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.405+0000 7f6042d00640 1 -- 172.21.15.107:0/3678195427 shutdown_connections 2024-09-21T07:58:47.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.405+0000 7f6042d00640 1 --2- 172.21.15.107:0/3678195427 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f603c0fb2b0 0x7f603c0fdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:47.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.405+0000 7f6042d00640 1 --2- 172.21.15.107:0/3678195427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f603c0fa960 0x7f603c0fad70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:47.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.405+0000 7f6042d00640 1 -- 172.21.15.107:0/3678195427 >> 172.21.15.107:0/3678195427 conn(0x7f603c0f63a0 msgr2=0x7f603c0f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:47.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.405+0000 7f6042d00640 1 -- 172.21.15.107:0/3678195427 shutdown_connections 2024-09-21T07:58:47.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.406+0000 7f6042d00640 1 -- 172.21.15.107:0/3678195427 wait complete. 2024-09-21T07:58:47.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.406+0000 7f6042d00640 1 Processor -- start 2024-09-21T07:58:47.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.406+0000 7f6042d00640 1 -- start start 2024-09-21T07:58:47.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.406+0000 7f6042d00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f603c0fa960 0x7f603c0fd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:47.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.406+0000 7f6042d00640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f603c0fb2b0 0x7f603c0fb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:47.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.406+0000 7f6042d00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0fbef0 con 0x7f603c0fa960 2024-09-21T07:58:47.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.406+0000 7f6042d00640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0fc030 con 0x7f603c0fb2b0 2024-09-21T07:58:47.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.407+0000 7f6040a9c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f603c0fa960 0x7f603c0fd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:47.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.407+0000 7f6040a9c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f603c0fa960 0x7f603c0fd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52434/0 (socket says 172.21.15.107:52434) 2024-09-21T07:58:47.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.407+0000 7f6040a9c640 1 -- 172.21.15.107:0/2584329445 learned_addr learned my addr 172.21.15.107:0/2584329445 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:58:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.407+0000 7f603bfff640 1 --2- 172.21.15.107:0/2584329445 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f603c0fb2b0 0x7f603c0fb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.407+0000 7f6040a9c640 1 -- 172.21.15.107:0/2584329445 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f603c0fb2b0 msgr2=0x7f603c0fb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.407+0000 7f6040a9c640 1 --2- 172.21.15.107:0/2584329445 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f603c0fb2b0 0x7f603c0fb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.407+0000 7f6040a9c640 1 -- 172.21.15.107:0/2584329445 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6030005040 con 0x7f603c0fa960 2024-09-21T07:58:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.407+0000 7f6040a9c640 1 --2- 172.21.15.107:0/2584329445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f603c0fa960 0x7f603c0fd470 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6030003080 tx=0x7f6030009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.407+0000 7f60397fa640 1 -- 172.21.15.107:0/2584329445 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6030038070 con 0x7f603c0fa960 2024-09-21T07:58:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.407+0000 7f60397fa640 1 -- 172.21.15.107:0/2584329445 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f603002abd0 con 0x7f603c0fa960 2024-09-21T07:58:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.407+0000 7f6042d00640 1 -- 172.21.15.107:0/2584329445 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603c0fc2b0 con 0x7f603c0fa960 2024-09-21T07:58:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.407+0000 7f60397fa640 1 -- 172.21.15.107:0/2584329445 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f603003e670 con 0x7f603c0fa960 2024-09-21T07:58:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.407+0000 7f6042d00640 1 -- 172.21.15.107:0/2584329445 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603c115330 con 0x7f603c0fa960 2024-09-21T07:58:47.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.408+0000 7f6042d00640 1 -- 172.21.15.107:0/2584329445 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603c04b720 con 0x7f603c0fa960 2024-09-21T07:58:47.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.409+0000 7f60397fa640 1 -- 172.21.15.107:0/2584329445 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f6030030020 con 0x7f603c0fa960 2024-09-21T07:58:47.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.409+0000 7f60397fa640 1 --2- 172.21.15.107:0/2584329445 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f602c06ed60 0x7f602c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:47.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.409+0000 7f60397fa640 1 -- 172.21.15.107:0/2584329445 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f60300ae1a0 con 0x7f603c0fa960 2024-09-21T07:58:47.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.409+0000 7f603bfff640 1 --2- 172.21.15.107:0/2584329445 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f602c06ed60 0x7f602c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:47.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.410+0000 7f603bfff640 1 --2- 172.21.15.107:0/2584329445 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f602c06ed60 0x7f602c071210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6028007fd0 tx=0x7f6028009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:47.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.413+0000 7f60397fa640 1 -- 172.21.15.107:0/2584329445 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f603007b6b0 con 0x7f603c0fa960 2024-09-21T07:58:47.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.570+0000 7f6042d00640 1 -- 172.21.15.107:0/2584329445 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f603c065830 con 0x7f603c0fa960 2024-09-21T07:58:47.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.571+0000 7f60397fa640 1 -- 172.21.15.107:0/2584329445 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f603007b050 con 0x7f603c0fa960 2024-09-21T07:58:47.573 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:58:47.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.573+0000 7f6042d00640 1 -- 172.21.15.107:0/2584329445 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f602c06ed60 msgr2=0x7f602c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:47.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.573+0000 7f6042d00640 1 --2- 172.21.15.107:0/2584329445 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f602c06ed60 0x7f602c071210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6028007fd0 tx=0x7f6028009040 comp rx=0 tx=0).stop 2024-09-21T07:58:47.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.573+0000 7f6042d00640 1 -- 172.21.15.107:0/2584329445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f603c0fa960 msgr2=0x7f603c0fd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:47.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.573+0000 7f6042d00640 1 --2- 172.21.15.107:0/2584329445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f603c0fa960 0x7f603c0fd470 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6030003080 tx=0x7f6030009da0 comp rx=0 tx=0).stop 2024-09-21T07:58:47.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.573+0000 7f6042d00640 1 -- 172.21.15.107:0/2584329445 shutdown_connections 2024-09-21T07:58:47.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.573+0000 7f6042d00640 1 --2- 172.21.15.107:0/2584329445 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f603c0fb2b0 0x7f603c0fb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:47.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.573+0000 7f6042d00640 1 --2- 172.21.15.107:0/2584329445 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f602c06ed60 0x7f602c071210 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:47.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.573+0000 7f6042d00640 1 --2- 172.21.15.107:0/2584329445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f603c0fa960 0x7f603c0fd470 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:47.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.573+0000 7f6042d00640 1 -- 172.21.15.107:0/2584329445 >> 172.21.15.107:0/2584329445 conn(0x7f603c0f63a0 msgr2=0x7f603c0f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:47.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.573+0000 7f6042d00640 1 -- 172.21.15.107:0/2584329445 shutdown_connections 2024-09-21T07:58:47.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:47.573+0000 7f6042d00640 1 -- 172.21.15.107:0/2584329445 wait complete. 2024-09-21T07:58:47.935 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:47 smithi107 ceph-mon[27622]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:58:47.935 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:47 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/2584329445' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T07:58:48.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:47 smithi129 ceph-mon[34472]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:58:48.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:47 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/2584329445' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T07:58:48.156 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1726905524,"num_in_osds":6,"osd_in_since":1726905505,"num_remapped_pgs":0} 2024-09-21T07:58:48.157 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:58:48.439 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:58:49.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:49 smithi107 ceph-mon[27622]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:58:50.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:49 smithi129 ceph-mon[34472]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:58:50.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.017+0000 7f1960df1640 1 -- 172.21.15.107:0/2608198638 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f195c0fb4a0 msgr2=0x7f195c0fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:50.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.017+0000 7f1960df1640 1 --2- 172.21.15.107:0/2608198638 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f195c0fb4a0 0x7f195c0fb910 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f19500048d0 tx=0x7f1950009da0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.017+0000 7f1960df1640 1 -- 172.21.15.107:0/2608198638 shutdown_connections 2024-09-21T07:58:50.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.017+0000 7f1960df1640 1 --2- 172.21.15.107:0/2608198638 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f195c0fb4a0 0x7f195c0fb910 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.017+0000 7f1960df1640 1 --2- 172.21.15.107:0/2608198638 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f195c1014e0 0x7f195c1018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.017+0000 7f1960df1640 1 -- 172.21.15.107:0/2608198638 >> 172.21.15.107:0/2608198638 conn(0x7f195c0f7060 msgr2=0x7f195c0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:50.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.017+0000 7f1960df1640 1 -- 172.21.15.107:0/2608198638 shutdown_connections 2024-09-21T07:58:50.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.017+0000 7f1960df1640 1 -- 172.21.15.107:0/2608198638 wait complete. 2024-09-21T07:58:50.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.017+0000 7f1960df1640 1 Processor -- start 2024-09-21T07:58:50.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.017+0000 7f1960df1640 1 -- start start 2024-09-21T07:58:50.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.018+0000 7f1960df1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f195c0fb4a0 0x7f195c10af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.018+0000 7f1960df1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f195c1014e0 0x7f195c10b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.018+0000 7f1960df1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c10b9c0 con 0x7f195c0fb4a0 2024-09-21T07:58:50.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.018+0000 7f1960df1640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c10bb30 con 0x7f195c1014e0 2024-09-21T07:58:50.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.018+0000 7f195a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f195c0fb4a0 0x7f195c10af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:50.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.018+0000 7f195a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f195c0fb4a0 0x7f195c10af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52452/0 (socket says 172.21.15.107:52452) 2024-09-21T07:58:50.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.018+0000 7f195a59c640 1 -- 172.21.15.107:0/1939131113 learned_addr learned my addr 172.21.15.107:0/1939131113 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:58:50.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.018+0000 7f1959d9b640 1 --2- 172.21.15.107:0/1939131113 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f195c1014e0 0x7f195c10b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:50.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.018+0000 7f195a59c640 1 -- 172.21.15.107:0/1939131113 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f195c1014e0 msgr2=0x7f195c10b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:50.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.018+0000 7f195a59c640 1 --2- 172.21.15.107:0/1939131113 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f195c1014e0 0x7f195c10b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.018+0000 7f195a59c640 1 -- 172.21.15.107:0/1939131113 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1950005040 con 0x7f195c0fb4a0 2024-09-21T07:58:50.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.018+0000 7f1959d9b640 1 --2- 172.21.15.107:0/1939131113 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f195c1014e0 0x7f195c10b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:50.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.018+0000 7f195a59c640 1 --2- 172.21.15.107:0/1939131113 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f195c0fb4a0 0x7f195c10af40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f194c002a50 tx=0x7f194c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:50.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.018+0000 7f194affd640 1 -- 172.21.15.107:0/1939131113 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f194c007c30 con 0x7f195c0fb4a0 2024-09-21T07:58:50.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.018+0000 7f194affd640 1 -- 172.21.15.107:0/1939131113 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f194c00f040 con 0x7f195c0fb4a0 2024-09-21T07:58:50.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.019+0000 7f1960df1640 1 -- 172.21.15.107:0/1939131113 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195c11d960 con 0x7f195c0fb4a0 2024-09-21T07:58:50.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.019+0000 7f194affd640 1 -- 172.21.15.107:0/1939131113 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f194c00da90 con 0x7f195c0fb4a0 2024-09-21T07:58:50.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.019+0000 7f1960df1640 1 -- 172.21.15.107:0/1939131113 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195c11dd10 con 0x7f195c0fb4a0 2024-09-21T07:58:50.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.020+0000 7f1960df1640 1 -- 172.21.15.107:0/1939131113 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195c0fcbe0 con 0x7f195c0fb4a0 2024-09-21T07:58:50.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.020+0000 7f194affd640 1 -- 172.21.15.107:0/1939131113 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f194c00dc30 con 0x7f195c0fb4a0 2024-09-21T07:58:50.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.020+0000 7f194affd640 1 --2- 172.21.15.107:0/1939131113 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f194406ed60 0x7f1944071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.020+0000 7f1959d9b640 1 --2- 172.21.15.107:0/1939131113 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f194406ed60 0x7f1944071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:50.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.020+0000 7f194affd640 1 -- 172.21.15.107:0/1939131113 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f194c08d690 con 0x7f195c0fb4a0 2024-09-21T07:58:50.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.021+0000 7f1959d9b640 1 --2- 172.21.15.107:0/1939131113 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f194406ed60 0x7f1944071210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f195c10c880 tx=0x7f1950035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:50.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.024+0000 7f194affd640 1 -- 172.21.15.107:0/1939131113 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f194c04d2a0 con 0x7f195c0fb4a0 2024-09-21T07:58:50.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.188+0000 7f1960df1640 1 -- 172.21.15.107:0/1939131113 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f195c0fac60 con 0x7f195c0fb4a0 2024-09-21T07:58:50.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.188+0000 7f194affd640 1 -- 172.21.15.107:0/1939131113 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11121 (secure 0 0 0) 0x7f194c05ab70 con 0x7f195c0fb4a0 2024-09-21T07:58:50.190 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:58:50.190 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":38,"fsid":"786d4f32-77ee-11ef-baf6-efdc52797490","created":"2024-09-21T07:53:25.337796+0000","modified":"2024-09-21T07:58:45.196656+0000","last_up_change":"2024-09-21T07:58:44.190083+0000","last_in_change":"2024-09-21T07:58:25.510395+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:57:32.423638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b75c59ed-e2a3-4721-97b0-cd3109b895f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":373234429},{"type":"v1","addr":"172.21.15.107:6803","nonce":373234429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":373234429},{"type":"v1","addr":"172.21.15.107:6805","nonce":373234429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":373234429},{"type":"v1","addr":"172.21.15.107:6809","nonce":373234429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":373234429},{"type":"v1","addr":"172.21.15.107:6807","nonce":373234429}]},"public_addr":"172.21.15.107:6803/373234429","cluster_addr":"172.21.15.107:6805/373234429","heartbeat_back_addr":"172.21.15.107:6809/373234429","heartbeat_front_addr":"172.21.15.107:6807/373234429","state":["exists","up"]},{"osd":1,"uuid":"614577ae-2dfd-4d3a-af18-d150846ba68f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2552944255},{"type":"v1","addr":"172.21.15.107:6811","nonce":2552944255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2552944255},{"type":"v1","addr":"172.21.15.107:6813","nonce":2552944255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2552944255},{"type":"v1","addr":"172.21.15.107:6817","nonce":2552944255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2552944255},{"type":"v1","addr":"172.21.15.107:6815","nonce":2552944255}]},"public_addr":"172.21.15.107:6811/2552944255","cluster_addr":"172.21.15.107:6813/2552944255","heartbeat_back_addr":"172.21.15.107:6817/2552944255","heartbeat_front_addr":"172.21.15.107:6815/2552944255","state":["exists","up"]},{"osd":2,"uuid":"31b84275-0f5c-4a4a-8384-5444f81445a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2268135286},{"type":"v1","addr":"172.21.15.107:6819","nonce":2268135286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2268135286},{"type":"v1","addr":"172.21.15.107:6821","nonce":2268135286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2268135286},{"type":"v1","addr":"172.21.15.107:6825","nonce":2268135286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2268135286},{"type":"v1","addr":"172.21.15.107:6823","nonce":2268135286}]},"public_addr":"172.21.15.107:6819/2268135286","cluster_addr":"172.21.15.107:6821/2268135286","heartbeat_back_addr":"172.21.15.107:6825/2268135286","heartbeat_front_addr":"172.21.15.107:6823/2268135286","state":["exists","up"]},{"osd":3,"uuid":"57445a72-d438-4f24-9e18-c69eb61e3c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1110660771},{"type":"v1","addr":"172.21.15.129:6801","nonce":1110660771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1110660771},{"type":"v1","addr":"172.21.15.129:6803","nonce":1110660771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1110660771},{"type":"v1","addr":"172.21.15.129:6807","nonce":1110660771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1110660771},{"type":"v1","addr":"172.21.15.129:6805","nonce":1110660771}]},"public_addr":"172.21.15.129:6801/1110660771","cluster_addr":"172.21.15.129:6803/1110660771","heartbeat_back_addr":"172.21.15.129:6807/1110660771","heartbeat_front_addr":"172.21.15.129:6805/1110660771","state":["exists","up"]},{"osd":4,"uuid":"619f850e-d5ab-4aa0-ae32-7702b79354eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":431008109},{"type":"v1","addr":"172.21.15.129:6809","nonce":431008109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":431008109},{"type":"v1","addr":"172.21.15.129:6811","nonce":431008109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":431008109},{"type":"v1","addr":"172.21.15.129:6815","nonce":431008109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":431008109},{"type":"v1","addr":"172.21.15.129:6813","nonce":431008109}]},"public_addr":"172.21.15.129:6809/431008109","cluster_addr":"172.21.15.129:6811/431008109","heartbeat_back_addr":"172.21.15.129:6815/431008109","heartbeat_front_addr":"172.21.15.129:6813/431008109","state":["exists","up"]},{"osd":5,"uuid":"da233bd9-495d-49fc-bf34-39e983b9dd14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":4170919914},{"type":"v1","addr":"172.21.15.129:6817","nonce":4170919914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":4170919914},{"type":"v1","addr":"172.21.15.129:6819","nonce":4170919914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":4170919914},{"type":"v1","addr":"172.21.15.129:6823","nonce":4170919914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":4170919914},{"type":"v1","addr":"172.21.15.129:6821","nonce":4170919914}]},"public_addr":"172.21.15.129:6817/4170919914","cluster_addr":"172.21.15.129:6819/4170919914","heartbeat_back_addr":"172.21.15.129:6823/4170919914","heartbeat_front_addr":"172.21.15.129:6821/4170919914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:34.070965+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:00.399663+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:29.519414+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:53.302742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:58:17.213919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:58:42.201984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:0/2498876652":"2024-09-22T07:55:24.118876+0000","172.21.15.107:0/2676703491":"2024-09-22T07:53:55.453491+0000","172.21.15.107:6800/287926342":"2024-09-22T07:53:55.453491+0000","172.21.15.107:6801/2912640406":"2024-09-22T07:54:24.297241+0000","172.21.15.107:6801/287926342":"2024-09-22T07:53:55.453491+0000","172.21.15.107:0/4136397866":"2024-09-22T07:54:24.297241+0000","172.21.15.107:0/3732544930":"2024-09-22T07:53:55.453491+0000","172.21.15.107:0/2976092283":"2024-09-22T07:54:24.297241+0000","172.21.15.107:6800/2850161381":"2024-09-22T07:55:24.118876+0000","172.21.15.107:6801/2850161381":"2024-09-22T07:55:24.118876+0000","172.21.15.107:6800/2912640406":"2024-09-22T07:54:24.297241+0000","172.21.15.107:0/3831586505":"2024-09-22T07:54:24.297241+0000","172.21.15.107:0/2314131589":"2024-09-22T07:55:24.118876+0000","172.21.15.107:0/805704025":"2024-09-22T07:53:55.453491+0000","172.21.15.107:0/1232121301":"2024-09-22T07:55:24.118876+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:58:50.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.190+0000 7f1960df1640 1 -- 172.21.15.107:0/1939131113 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f194406ed60 msgr2=0x7f1944071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:50.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.190+0000 7f1960df1640 1 --2- 172.21.15.107:0/1939131113 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f194406ed60 0x7f1944071210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f195c10c880 tx=0x7f1950035040 comp rx=0 tx=0).stop 2024-09-21T07:58:50.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.190+0000 7f1960df1640 1 -- 172.21.15.107:0/1939131113 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f195c0fb4a0 msgr2=0x7f195c10af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:50.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.190+0000 7f1960df1640 1 --2- 172.21.15.107:0/1939131113 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f195c0fb4a0 0x7f195c10af40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f194c002a50 tx=0x7f194c004600 comp rx=0 tx=0).stop 2024-09-21T07:58:50.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.191+0000 7f1960df1640 1 -- 172.21.15.107:0/1939131113 shutdown_connections 2024-09-21T07:58:50.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.191+0000 7f1960df1640 1 --2- 172.21.15.107:0/1939131113 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f195c1014e0 0x7f195c10b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.191+0000 7f1960df1640 1 --2- 172.21.15.107:0/1939131113 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f194406ed60 0x7f1944071210 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.191+0000 7f1960df1640 1 --2- 172.21.15.107:0/1939131113 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f195c0fb4a0 0x7f195c10af40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.191+0000 7f1960df1640 1 -- 172.21.15.107:0/1939131113 >> 172.21.15.107:0/1939131113 conn(0x7f195c0f7060 msgr2=0x7f195c0f8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:50.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.191+0000 7f1960df1640 1 -- 172.21.15.107:0/1939131113 shutdown_connections 2024-09-21T07:58:50.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:50.191+0000 7f1960df1640 1 -- 172.21.15.107:0/1939131113 wait complete. 2024-09-21T07:58:50.822 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:57:32.423638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-09-21T07:58:50.822 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T07:58:51.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:50 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/1939131113' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T07:58:51.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:50 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1939131113' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T07:58:51.075 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:58:52.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:51 smithi107 ceph-mon[27622]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:58:52.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:51 smithi129 ceph-mon[34472]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:58:52.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.635+0000 7f7d9f402640 1 -- 172.21.15.107:0/421509213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d981014b0 msgr2=0x7f7d98101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:52.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.635+0000 7f7d9f402640 1 --2- 172.21.15.107:0/421509213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d981014b0 0x7f7d98101880 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7d880048d0 tx=0x7f7d88009da0 comp rx=0 tx=0).stop 2024-09-21T07:58:52.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.636+0000 7f7d9f402640 1 -- 172.21.15.107:0/421509213 shutdown_connections 2024-09-21T07:58:52.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.636+0000 7f7d9f402640 1 --2- 172.21.15.107:0/421509213 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7d980fb470 0x7f7d980fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:52.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.636+0000 7f7d9f402640 1 --2- 172.21.15.107:0/421509213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d981014b0 0x7f7d98101880 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:52.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.636+0000 7f7d9f402640 1 -- 172.21.15.107:0/421509213 >> 172.21.15.107:0/421509213 conn(0x7f7d980f7030 msgr2=0x7f7d980f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:52.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.636+0000 7f7d9f402640 1 -- 172.21.15.107:0/421509213 shutdown_connections 2024-09-21T07:58:52.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.636+0000 7f7d9f402640 1 -- 172.21.15.107:0/421509213 wait complete. 2024-09-21T07:58:52.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.636+0000 7f7d9f402640 1 Processor -- start 2024-09-21T07:58:52.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.636+0000 7f7d9f402640 1 -- start start 2024-09-21T07:58:52.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.636+0000 7f7d9f402640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d980fb470 0x7f7d981120a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:52.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.636+0000 7f7d9f402640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7d981014b0 0x7f7d981125e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:52.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.636+0000 7f7d9f402640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d98112be0 con 0x7f7d980fb470 2024-09-21T07:58:52.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.636+0000 7f7d9f402640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9810c020 con 0x7f7d981014b0 2024-09-21T07:58:52.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.636+0000 7f7d9d19e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d980fb470 0x7f7d981120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:52.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.637+0000 7f7d9d19e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d980fb470 0x7f7d981120a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54086/0 (socket says 172.21.15.107:54086) 2024-09-21T07:58:52.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.637+0000 7f7d9d19e640 1 -- 172.21.15.107:0/399065271 learned_addr learned my addr 172.21.15.107:0/399065271 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:58:52.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.637+0000 7f7d9c99d640 1 --2- 172.21.15.107:0/399065271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7d981014b0 0x7f7d981125e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:52.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.637+0000 7f7d9d19e640 1 -- 172.21.15.107:0/399065271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7d981014b0 msgr2=0x7f7d981125e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:52.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.637+0000 7f7d9d19e640 1 --2- 172.21.15.107:0/399065271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7d981014b0 0x7f7d981125e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:52.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.637+0000 7f7d9d19e640 1 -- 172.21.15.107:0/399065271 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d88005040 con 0x7f7d980fb470 2024-09-21T07:58:52.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.637+0000 7f7d9c99d640 1 --2- 172.21.15.107:0/399065271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7d981014b0 0x7f7d981125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:58:52.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.637+0000 7f7d9d19e640 1 --2- 172.21.15.107:0/399065271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d980fb470 0x7f7d981120a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7d88000c00 tx=0x7f7d88009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:52.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.637+0000 7f7d95ffb640 1 -- 172.21.15.107:0/399065271 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d88038070 con 0x7f7d980fb470 2024-09-21T07:58:52.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.637+0000 7f7d9f402640 1 -- 172.21.15.107:0/399065271 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9810c2a0 con 0x7f7d980fb470 2024-09-21T07:58:52.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.637+0000 7f7d95ffb640 1 -- 172.21.15.107:0/399065271 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7d8802ade0 con 0x7f7d980fb470 2024-09-21T07:58:52.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.637+0000 7f7d95ffb640 1 -- 172.21.15.107:0/399065271 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d8802c7e0 con 0x7f7d980fb470 2024-09-21T07:58:52.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.637+0000 7f7d9f402640 1 -- 172.21.15.107:0/399065271 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9810c760 con 0x7f7d980fb470 2024-09-21T07:58:52.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.638+0000 7f7d9f402640 1 -- 172.21.15.107:0/399065271 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d980fcbb0 con 0x7f7d980fb470 2024-09-21T07:58:52.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.639+0000 7f7d95ffb640 1 -- 172.21.15.107:0/399065271 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f7d88030020 con 0x7f7d980fb470 2024-09-21T07:58:52.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.639+0000 7f7d95ffb640 1 --2- 172.21.15.107:0/399065271 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7d8006ed60 0x7f7d80071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:52.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.639+0000 7f7d95ffb640 1 -- 172.21.15.107:0/399065271 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7d880adad0 con 0x7f7d980fb470 2024-09-21T07:58:52.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.639+0000 7f7d9c99d640 1 --2- 172.21.15.107:0/399065271 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7d8006ed60 0x7f7d80071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:52.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.640+0000 7f7d9c99d640 1 --2- 172.21.15.107:0/399065271 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7d8006ed60 0x7f7d80071210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c009af0 tx=0x7f7d8c00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:52.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.643+0000 7f7d95ffb640 1 -- 172.21.15.107:0/399065271 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7d8807afe0 con 0x7f7d980fb470 2024-09-21T07:58:52.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.799+0000 7f7d9f402640 1 -- 172.21.15.107:0/399065271 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d98108460 con 0x7f7d980fb470 2024-09-21T07:58:52.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.800+0000 7f7d95ffb640 1 -- 172.21.15.107:0/399065271 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d8807a980 con 0x7f7d980fb470 2024-09-21T07:58:52.802 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-09-21T07:58:52.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.802+0000 7f7d9f402640 1 -- 172.21.15.107:0/399065271 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7d8006ed60 msgr2=0x7f7d80071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:52.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.802+0000 7f7d9f402640 1 --2- 172.21.15.107:0/399065271 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7d8006ed60 0x7f7d80071210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c009af0 tx=0x7f7d8c00b040 comp rx=0 tx=0).stop 2024-09-21T07:58:52.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.802+0000 7f7d9f402640 1 -- 172.21.15.107:0/399065271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d980fb470 msgr2=0x7f7d981120a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:52.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.802+0000 7f7d9f402640 1 --2- 172.21.15.107:0/399065271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d980fb470 0x7f7d981120a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7d88000c00 tx=0x7f7d88009da0 comp rx=0 tx=0).stop 2024-09-21T07:58:52.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.802+0000 7f7d9f402640 1 -- 172.21.15.107:0/399065271 shutdown_connections 2024-09-21T07:58:52.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.802+0000 7f7d9f402640 1 --2- 172.21.15.107:0/399065271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7d981014b0 0x7f7d981125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:52.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.802+0000 7f7d9f402640 1 --2- 172.21.15.107:0/399065271 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7d8006ed60 0x7f7d80071210 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:52.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.802+0000 7f7d9f402640 1 --2- 172.21.15.107:0/399065271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d980fb470 0x7f7d981120a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:52.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.802+0000 7f7d9f402640 1 -- 172.21.15.107:0/399065271 >> 172.21.15.107:0/399065271 conn(0x7f7d980f7030 msgr2=0x7f7d980f88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:52.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.802+0000 7f7d9f402640 1 -- 172.21.15.107:0/399065271 shutdown_connections 2024-09-21T07:58:52.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:52.802+0000 7f7d9f402640 1 -- 172.21.15.107:0/399065271 wait complete. 2024-09-21T07:58:53.571 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T07:58:53.572 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T07:58:53.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:53 smithi107 ceph-mon[27622]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:58:53.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:53 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/399065271' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-21T07:58:53.814 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:58:54.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:53 smithi129 ceph-mon[34472]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:58:54.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:53 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/399065271' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-21T07:58:54.854 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:54 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:58:55.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:54 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:58:55.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.366+0000 7f51fcdfa640 1 -- 172.21.15.107:0/726325908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51f80fc720 msgr2=0x7f51f80fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:55.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.366+0000 7f51fcdfa640 1 --2- 172.21.15.107:0/726325908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51f80fc720 0x7f51f80fcb90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0048d0 tx=0x7f51ec009da0 comp rx=0 tx=0).stop 2024-09-21T07:58:55.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.366+0000 7f51fcdfa640 1 -- 172.21.15.107:0/726325908 shutdown_connections 2024-09-21T07:58:55.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.366+0000 7f51fcdfa640 1 --2- 172.21.15.107:0/726325908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51f80fc720 0x7f51f80fcb90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:55.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.366+0000 7f51fcdfa640 1 --2- 172.21.15.107:0/726325908 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51f80fb450 0x7f51f80fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:55.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.366+0000 7f51fcdfa640 1 -- 172.21.15.107:0/726325908 >> 172.21.15.107:0/726325908 conn(0x7f51f80f6c10 msgr2=0x7f51f80f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:55.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.366+0000 7f51fcdfa640 1 -- 172.21.15.107:0/726325908 shutdown_connections 2024-09-21T07:58:55.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.366+0000 7f51fcdfa640 1 -- 172.21.15.107:0/726325908 wait complete. 2024-09-21T07:58:55.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.367+0000 7f51fcdfa640 1 Processor -- start 2024-09-21T07:58:55.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.367+0000 7f51fcdfa640 1 -- start start 2024-09-21T07:58:55.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.367+0000 7f51fcdfa640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51f80fb450 0x7f51f810fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:55.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.367+0000 7f51fcdfa640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51f80fc720 0x7f51f8112380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:55.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.367+0000 7f51fcdfa640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f8066790 con 0x7f51f80fc720 2024-09-21T07:58:55.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.367+0000 7f51fcdfa640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f8066900 con 0x7f51f80fb450 2024-09-21T07:58:55.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.367+0000 7f51f5d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51f80fc720 0x7f51f8112380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:55.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.367+0000 7f51f5d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51f80fc720 0x7f51f8112380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54102/0 (socket says 172.21.15.107:54102) 2024-09-21T07:58:55.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.367+0000 7f51f5d9b640 1 -- 172.21.15.107:0/1061735090 learned_addr learned my addr 172.21.15.107:0/1061735090 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:58:55.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.367+0000 7f51f659c640 1 --2- 172.21.15.107:0/1061735090 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51f80fb450 0x7f51f810fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:55.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.367+0000 7f51f5d9b640 1 -- 172.21.15.107:0/1061735090 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51f80fb450 msgr2=0x7f51f810fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:55.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.367+0000 7f51f5d9b640 1 --2- 172.21.15.107:0/1061735090 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51f80fb450 0x7f51f810fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:55.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.367+0000 7f51f5d9b640 1 -- 172.21.15.107:0/1061735090 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec005040 con 0x7f51f80fc720 2024-09-21T07:58:55.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.368+0000 7f51f5d9b640 1 --2- 172.21.15.107:0/1061735090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51f80fc720 0x7f51f8112380 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f51ec000c00 tx=0x7f51ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:55.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.368+0000 7f51e6ffd640 1 -- 172.21.15.107:0/1061735090 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51ec038070 con 0x7f51f80fc720 2024-09-21T07:58:55.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.368+0000 7f51e6ffd640 1 -- 172.21.15.107:0/1061735090 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f51ec02ae90 con 0x7f51f80fc720 2024-09-21T07:58:55.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.368+0000 7f51fcdfa640 1 -- 172.21.15.107:0/1061735090 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f81128c0 con 0x7f51f80fc720 2024-09-21T07:58:55.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.368+0000 7f51e6ffd640 1 -- 172.21.15.107:0/1061735090 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51ec03d440 con 0x7f51f80fc720 2024-09-21T07:58:55.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.368+0000 7f51fcdfa640 1 -- 172.21.15.107:0/1061735090 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f8112dd0 con 0x7f51f80fc720 2024-09-21T07:58:55.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.369+0000 7f51fcdfa640 1 -- 172.21.15.107:0/1061735090 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f80fa8b0 con 0x7f51f80fc720 2024-09-21T07:58:55.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.369+0000 7f51e6ffd640 1 -- 172.21.15.107:0/1061735090 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f51ec030020 con 0x7f51f80fc720 2024-09-21T07:58:55.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.370+0000 7f51e6ffd640 1 --2- 172.21.15.107:0/1061735090 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f51e006ed50 0x7f51e0071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:55.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.370+0000 7f51e6ffd640 1 -- 172.21.15.107:0/1061735090 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f51ec0ae420 con 0x7f51f80fc720 2024-09-21T07:58:55.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.370+0000 7f51f659c640 1 --2- 172.21.15.107:0/1061735090 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f51e006ed50 0x7f51e0071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:55.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.370+0000 7f51f659c640 1 --2- 172.21.15.107:0/1061735090 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f51e006ed50 0x7f51e0071200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f51e80041d0 tx=0x7f51e8009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:55.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.374+0000 7f51e6ffd640 1 -- 172.21.15.107:0/1061735090 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f51ec07b900 con 0x7f51f80fc720 2024-09-21T07:58:55.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.587+0000 7f51fcdfa640 1 -- 172.21.15.107:0/1061735090 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f51f804b720 con 0x7f51f80fc720 2024-09-21T07:58:55.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.591+0000 7f51e6ffd640 1 -- 172.21.15.107:0/1061735090 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f51ec07b2a0 con 0x7f51f80fc720 2024-09-21T07:58:55.593 INFO:teuthology.orchestra.run.smithi107.stdout:[client.0] 2024-09-21T07:58:55.594 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQC/fO5mphskIxAA5lS39s7w8stOFiXEDGqWZQ== 2024-09-21T07:58:55.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.593+0000 7f51fcdfa640 1 -- 172.21.15.107:0/1061735090 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f51e006ed50 msgr2=0x7f51e0071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:55.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.593+0000 7f51fcdfa640 1 --2- 172.21.15.107:0/1061735090 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f51e006ed50 0x7f51e0071200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f51e80041d0 tx=0x7f51e8009040 comp rx=0 tx=0).stop 2024-09-21T07:58:55.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.593+0000 7f51fcdfa640 1 -- 172.21.15.107:0/1061735090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51f80fc720 msgr2=0x7f51f8112380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:55.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.593+0000 7f51fcdfa640 1 --2- 172.21.15.107:0/1061735090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51f80fc720 0x7f51f8112380 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f51ec000c00 tx=0x7f51ec009da0 comp rx=0 tx=0).stop 2024-09-21T07:58:55.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.593+0000 7f51fcdfa640 1 -- 172.21.15.107:0/1061735090 shutdown_connections 2024-09-21T07:58:55.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.593+0000 7f51fcdfa640 1 --2- 172.21.15.107:0/1061735090 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f51e006ed50 0x7f51e0071200 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:55.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.593+0000 7f51fcdfa640 1 --2- 172.21.15.107:0/1061735090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51f80fc720 0x7f51f8112380 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:55.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.593+0000 7f51fcdfa640 1 --2- 172.21.15.107:0/1061735090 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51f80fb450 0x7f51f810fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:55.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.593+0000 7f51fcdfa640 1 -- 172.21.15.107:0/1061735090 >> 172.21.15.107:0/1061735090 conn(0x7f51f80f6c10 msgr2=0x7f51f80f8430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:55.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.593+0000 7f51fcdfa640 1 -- 172.21.15.107:0/1061735090 shutdown_connections 2024-09-21T07:58:55.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:58:55.593+0000 7f51fcdfa640 1 -- 172.21.15.107:0/1061735090 wait complete. 2024-09-21T07:58:56.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:55 smithi107 ceph-mon[27622]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:58:56.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:55 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1061735090' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T07:58:56.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:55 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1061735090' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:58:56.188 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-21T07:58:56.188 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T07:58:56.188 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T07:58:56.225 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T07:58:56.254 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:55 smithi129 ceph-mon[34472]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:58:56.254 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:55 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/1061735090' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T07:58:56.254 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:55 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/1061735090' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:58:56.481 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi129/config 2024-09-21T07:58:57.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.955+0000 7f35dfd63640 1 -- 172.21.15.129:0/1545327966 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f35d80fc530 msgr2=0x7f35d80fc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:57.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.955+0000 7f35dfd63640 1 --2- 172.21.15.129:0/1545327966 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f35d80fc530 0x7f35d80fc940 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f35c80048d0 tx=0x7f35c8009da0 comp rx=0 tx=0).stop 2024-09-21T07:58:57.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.955+0000 7f35dfd63640 1 -- 172.21.15.129:0/1545327966 shutdown_connections 2024-09-21T07:58:57.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.955+0000 7f35dfd63640 1 --2- 172.21.15.129:0/1545327966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35d80fd800 0x7f35d80fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:57.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.955+0000 7f35dfd63640 1 --2- 172.21.15.129:0/1545327966 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f35d80fc530 0x7f35d80fc940 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:57.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.955+0000 7f35dfd63640 1 -- 172.21.15.129:0/1545327966 >> 172.21.15.129:0/1545327966 conn(0x7f35d80f7d10 msgr2=0x7f35d80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:57.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.955+0000 7f35dfd63640 1 -- 172.21.15.129:0/1545327966 shutdown_connections 2024-09-21T07:58:57.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.955+0000 7f35dfd63640 1 -- 172.21.15.129:0/1545327966 wait complete. 2024-09-21T07:58:57.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.956+0000 7f35dfd63640 1 Processor -- start 2024-09-21T07:58:57.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.956+0000 7f35dfd63640 1 -- start start 2024-09-21T07:58:57.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.956+0000 7f35dfd63640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f35d80fc530 0x7f35d810f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:57.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.956+0000 7f35dfd63640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35d80fd800 0x7f35d810f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:57.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.956+0000 7f35dfd63640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d8110680 con 0x7f35d80fd800 2024-09-21T07:58:57.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.956+0000 7f35dfd63640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d81107f0 con 0x7f35d80fc530 2024-09-21T07:58:57.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.956+0000 7f35ddaff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f35d80fc530 0x7f35d810f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:57.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.956+0000 7f35ddaff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f35d80fc530 0x7f35d810f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:60512/0 (socket says 172.21.15.129:60512) 2024-09-21T07:58:57.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.956+0000 7f35ddaff640 1 -- 172.21.15.129:0/290371379 learned_addr learned my addr 172.21.15.129:0/290371379 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:58:57.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.956+0000 7f35ddaff640 1 -- 172.21.15.129:0/290371379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35d80fd800 msgr2=0x7f35d810f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:57.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.956+0000 7f35ddaff640 1 --2- 172.21.15.129:0/290371379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35d80fd800 0x7f35d810f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:57.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.956+0000 7f35ddaff640 1 -- 172.21.15.129:0/290371379 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c8005040 con 0x7f35d80fc530 2024-09-21T07:58:57.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.956+0000 7f35ddaff640 1 --2- 172.21.15.129:0/290371379 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f35d80fc530 0x7f35d810f2d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f35c8003080 tx=0x7f35c8009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:57.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.956+0000 7f35ce7fc640 1 -- 172.21.15.129:0/290371379 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35c8038070 con 0x7f35d80fc530 2024-09-21T07:58:57.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.957+0000 7f35ce7fc640 1 -- 172.21.15.129:0/290371379 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f35c802abd0 con 0x7f35d80fc530 2024-09-21T07:58:57.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.957+0000 7f35ce7fc640 1 -- 172.21.15.129:0/290371379 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35c803e670 con 0x7f35d80fc530 2024-09-21T07:58:57.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.957+0000 7f35dfd63640 1 -- 172.21.15.129:0/290371379 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d8110a70 con 0x7f35d80fc530 2024-09-21T07:58:57.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.957+0000 7f35dfd63640 1 -- 172.21.15.129:0/290371379 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d8110f90 con 0x7f35d80fc530 2024-09-21T07:58:57.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.958+0000 7f35dfd63640 1 -- 172.21.15.129:0/290371379 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d80fb990 con 0x7f35d80fc530 2024-09-21T07:58:57.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.958+0000 7f35ce7fc640 1 -- 172.21.15.129:0/290371379 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f35c8030020 con 0x7f35d80fc530 2024-09-21T07:58:57.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.958+0000 7f35ce7fc640 1 --2- 172.21.15.129:0/290371379 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f35c406ed60 0x7f35c4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:57.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.959+0000 7f35ce7fc640 1 -- 172.21.15.129:0/290371379 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f35c80ae150 con 0x7f35d80fc530 2024-09-21T07:58:57.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.959+0000 7f35dd2fe640 1 --2- 172.21.15.129:0/290371379 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f35c406ed60 0x7f35c4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:57.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.959+0000 7f35dd2fe640 1 --2- 172.21.15.129:0/290371379 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f35c406ed60 0x7f35c4071210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f35d810f080 tx=0x7f35d4006d20 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:57.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:57.963+0000 7f35ce7fc640 1 -- 172.21.15.129:0/290371379 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f35c807b630 con 0x7f35d80fc530 2024-09-21T07:58:58.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:57 smithi107 ceph-mon[27622]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:58:58.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:58.174+0000 7f35dfd63640 1 -- 172.21.15.129:0/290371379 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f35d8104fb0 con 0x7f35d80fc530 2024-09-21T07:58:58.176 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:57 smithi129 ceph-mon[34472]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:58:58.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:58.179+0000 7f35ce7fc640 1 -- 172.21.15.129:0/290371379 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f35c807afd0 con 0x7f35d80fc530 2024-09-21T07:58:58.181 INFO:teuthology.orchestra.run.smithi129.stdout:[client.1] 2024-09-21T07:58:58.181 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQDCfO5mpmqBChAA87jtE7S2mNulIelkvugxIw== 2024-09-21T07:58:58.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:58.181+0000 7f35dfd63640 1 -- 172.21.15.129:0/290371379 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f35c406ed60 msgr2=0x7f35c4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:58.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:58.181+0000 7f35dfd63640 1 --2- 172.21.15.129:0/290371379 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f35c406ed60 0x7f35c4071210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f35d810f080 tx=0x7f35d4006d20 comp rx=0 tx=0).stop 2024-09-21T07:58:58.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:58.181+0000 7f35dfd63640 1 -- 172.21.15.129:0/290371379 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f35d80fc530 msgr2=0x7f35d810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:58.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:58.181+0000 7f35dfd63640 1 --2- 172.21.15.129:0/290371379 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f35d80fc530 0x7f35d810f2d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f35c8003080 tx=0x7f35c8009da0 comp rx=0 tx=0).stop 2024-09-21T07:58:58.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:58.181+0000 7f35dfd63640 1 -- 172.21.15.129:0/290371379 shutdown_connections 2024-09-21T07:58:58.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:58.181+0000 7f35dfd63640 1 --2- 172.21.15.129:0/290371379 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f35c406ed60 0x7f35c4071210 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:58.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:58.181+0000 7f35dfd63640 1 --2- 172.21.15.129:0/290371379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35d80fd800 0x7f35d810f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:58.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:58.181+0000 7f35dfd63640 1 --2- 172.21.15.129:0/290371379 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f35d80fc530 0x7f35d810f2d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:58.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:58.181+0000 7f35dfd63640 1 -- 172.21.15.129:0/290371379 >> 172.21.15.129:0/290371379 conn(0x7f35d80f7d10 msgr2=0x7f35d80f9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:58.184 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:58.181+0000 7f35dfd63640 1 -- 172.21.15.129:0/290371379 shutdown_connections 2024-09-21T07:58:58.184 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:58:58.181+0000 7f35dfd63640 1 -- 172.21.15.129:0/290371379 wait complete. 2024-09-21T07:58:58.816 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T07:58:58.816 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-21T07:58:58.816 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T07:58:58.893 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T07:58:58.894 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T07:58:58.894 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T07:58:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:58 smithi129 ceph-mon[34472]: from='client.? 172.21.15.129:0/290371379' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T07:58:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:58 smithi129 ceph-mon[34472]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T07:58:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:58 smithi129 ceph-mon[34472]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:58:59.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:58 smithi107 ceph-mon[27622]: from='client.? 172.21.15.129:0/290371379' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T07:58:59.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:58 smithi107 ceph-mon[27622]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T07:58:59.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:58 smithi107 ceph-mon[27622]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:58:59.149 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:58:59 smithi107 ceph-mon[27622]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:00.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:58:59 smithi129 ceph-mon[34472]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:00.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.773+0000 7fe4f8f3b640 1 -- 172.21.15.107:0/3023445200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f4102ed0 msgr2=0x7fe4f40fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:00.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.773+0000 7fe4f8f3b640 1 --2- 172.21.15.107:0/3023445200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f4102ed0 0x7fe4f40fc590 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0048d0 tx=0x7fe4dc009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:00.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.773+0000 7fe4f8f3b640 1 -- 172.21.15.107:0/3023445200 shutdown_connections 2024-09-21T07:59:00.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.773+0000 7fe4f8f3b640 1 --2- 172.21.15.107:0/3023445200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f4102ed0 0x7fe4f40fc590 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:00.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.773+0000 7fe4f8f3b640 1 --2- 172.21.15.107:0/3023445200 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4f4102530 0x7fe4f4102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:00.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.773+0000 7fe4f8f3b640 1 -- 172.21.15.107:0/3023445200 >> 172.21.15.107:0/3023445200 conn(0x7fe4f40f8110 msgr2=0x7fe4f40fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:00.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.773+0000 7fe4f8f3b640 1 -- 172.21.15.107:0/3023445200 shutdown_connections 2024-09-21T07:59:00.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.773+0000 7fe4f8f3b640 1 -- 172.21.15.107:0/3023445200 wait complete. 2024-09-21T07:59:00.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.774+0000 7fe4f8f3b640 1 Processor -- start 2024-09-21T07:59:00.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.774+0000 7fe4f8f3b640 1 -- start start 2024-09-21T07:59:00.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.774+0000 7fe4f8f3b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4f4102530 0x7fe4f4113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:00.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.774+0000 7fe4f8f3b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f4102ed0 0x7fe4f4113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:00.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.774+0000 7fe4f8f3b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f4113d50 con 0x7fe4f4102ed0 2024-09-21T07:59:00.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.774+0000 7fe4f8f3b640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f410d190 con 0x7fe4f4102530 2024-09-21T07:59:00.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.774+0000 7fe4f1d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f4102ed0 0x7fe4f4113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:00.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.774+0000 7fe4f1d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f4102ed0 0x7fe4f4113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54116/0 (socket says 172.21.15.107:54116) 2024-09-21T07:59:00.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.774+0000 7fe4f1d9b640 1 -- 172.21.15.107:0/2043104656 learned_addr learned my addr 172.21.15.107:0/2043104656 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:00.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.774+0000 7fe4f259c640 1 --2- 172.21.15.107:0/2043104656 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4f4102530 0x7fe4f4113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:00.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.774+0000 7fe4f1d9b640 1 -- 172.21.15.107:0/2043104656 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4f4102530 msgr2=0x7fe4f4113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:00.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.774+0000 7fe4f1d9b640 1 --2- 172.21.15.107:0/2043104656 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4f4102530 0x7fe4f4113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:00.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.774+0000 7fe4f1d9b640 1 -- 172.21.15.107:0/2043104656 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc005040 con 0x7fe4f4102ed0 2024-09-21T07:59:00.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.775+0000 7fe4f1d9b640 1 --2- 172.21.15.107:0/2043104656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f4102ed0 0x7fe4f4113750 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0043d0 tx=0x7fe4dc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:00.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.775+0000 7fe4eaffd640 1 -- 172.21.15.107:0/2043104656 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4dc038070 con 0x7fe4f4102ed0 2024-09-21T07:59:00.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.775+0000 7fe4eaffd640 1 -- 172.21.15.107:0/2043104656 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe4dc0096e0 con 0x7fe4f4102ed0 2024-09-21T07:59:00.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.775+0000 7fe4eaffd640 1 -- 172.21.15.107:0/2043104656 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4dc02c8a0 con 0x7fe4f4102ed0 2024-09-21T07:59:00.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.775+0000 7fe4f8f3b640 1 -- 172.21.15.107:0/2043104656 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f410d410 con 0x7fe4f4102ed0 2024-09-21T07:59:00.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.775+0000 7fe4f8f3b640 1 -- 172.21.15.107:0/2043104656 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f410d950 con 0x7fe4f4102ed0 2024-09-21T07:59:00.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.776+0000 7fe4f8f3b640 1 -- 172.21.15.107:0/2043104656 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f40fdcb0 con 0x7fe4f4102ed0 2024-09-21T07:59:00.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.776+0000 7fe4eaffd640 1 -- 172.21.15.107:0/2043104656 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fe4dc030020 con 0x7fe4f4102ed0 2024-09-21T07:59:00.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.777+0000 7fe4eaffd640 1 --2- 172.21.15.107:0/2043104656 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe4e006ed60 0x7fe4e0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:00.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.777+0000 7fe4eaffd640 1 -- 172.21.15.107:0/2043104656 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe4dc0adb70 con 0x7fe4f4102ed0 2024-09-21T07:59:00.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.777+0000 7fe4f259c640 1 --2- 172.21.15.107:0/2043104656 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe4e006ed60 0x7fe4e0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:00.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.777+0000 7fe4f259c640 1 --2- 172.21.15.107:0/2043104656 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe4e006ed60 0x7fe4e0071210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec004ce0 tx=0x7fe4ec00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:00.782 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.781+0000 7fe4eaffd640 1 -- 172.21.15.107:0/2043104656 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe4dc07b050 con 0x7fe4f4102ed0 2024-09-21T07:59:00.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.977+0000 7fe4f8f3b640 1 -- 172.21.15.107:0/2043104656 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe4f4109560 con 0x7fe4f4102ed0 2024-09-21T07:59:00.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.980+0000 7fe4eaffd640 1 -- 172.21.15.107:0/2043104656 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+176720 (secure 0 0 0) 0x7fe4dc07a9f0 con 0x7fe4f4102ed0 2024-09-21T07:59:00.984 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:59:00.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.982+0000 7fe4f8f3b640 1 -- 172.21.15.107:0/2043104656 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe4e006ed60 msgr2=0x7fe4e0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:00.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.982+0000 7fe4f8f3b640 1 --2- 172.21.15.107:0/2043104656 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe4e006ed60 0x7fe4e0071210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec004ce0 tx=0x7fe4ec00b040 comp rx=0 tx=0).stop 2024-09-21T07:59:00.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.982+0000 7fe4f8f3b640 1 -- 172.21.15.107:0/2043104656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f4102ed0 msgr2=0x7fe4f4113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:00.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.982+0000 7fe4f8f3b640 1 --2- 172.21.15.107:0/2043104656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f4102ed0 0x7fe4f4113750 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0043d0 tx=0x7fe4dc009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:00.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.982+0000 7fe4f8f3b640 1 -- 172.21.15.107:0/2043104656 shutdown_connections 2024-09-21T07:59:00.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.982+0000 7fe4f8f3b640 1 --2- 172.21.15.107:0/2043104656 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe4e006ed60 0x7fe4e0071210 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:00.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.982+0000 7fe4f8f3b640 1 --2- 172.21.15.107:0/2043104656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f4102ed0 0x7fe4f4113750 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:00.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.982+0000 7fe4f8f3b640 1 --2- 172.21.15.107:0/2043104656 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4f4102530 0x7fe4f4113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:00.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.982+0000 7fe4f8f3b640 1 -- 172.21.15.107:0/2043104656 >> 172.21.15.107:0/2043104656 conn(0x7fe4f40f8110 msgr2=0x7fe4f40f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:00.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.982+0000 7fe4f8f3b640 1 -- 172.21.15.107:0/2043104656 shutdown_connections 2024-09-21T07:59:00.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:00.982+0000 7fe4f8f3b640 1 -- 172.21.15.107:0/2043104656 wait complete. 2024-09-21T07:59:01.762 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":19,"flags":0,"active_gid":14206,"active_name":"smithi107.wzulxb","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3723665882},{"type":"v1","addr":"172.21.15.107:6801","nonce":3723665882}]},"active_addr":"172.21.15.107:6801/3723665882","active_change":"2024-09-21T07:55:24.119023+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14224,"name":"smithi129.wvlmvo","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.107:8443/","prometheus":"http://172.21.15.107:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":3875126490}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":3328111247}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":53635306}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":3269113875}]}]} 2024-09-21T07:59:01.765 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T07:59:01.765 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T07:59:01.766 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:59:02.012 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:02.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:01 smithi107 ceph-mon[27622]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:02.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:01 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/2043104656' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T07:59:02.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:01 smithi129 ceph-mon[34472]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:02.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:01 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/2043104656' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T07:59:03.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.590+0000 7f4dd4f22640 1 -- 172.21.15.107:0/2784929730 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4dd01014c0 msgr2=0x7f4dd0101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:03.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.590+0000 7f4dd4f22640 1 --2- 172.21.15.107:0/2784929730 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4dd01014c0 0x7f4dd0101890 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00048d0 tx=0x7f4dc0009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.590+0000 7f4dd4f22640 1 -- 172.21.15.107:0/2784929730 shutdown_connections 2024-09-21T07:59:03.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.590+0000 7f4dd4f22640 1 --2- 172.21.15.107:0/2784929730 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4dd00fb480 0x7f4dd00fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.590+0000 7f4dd4f22640 1 --2- 172.21.15.107:0/2784929730 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4dd01014c0 0x7f4dd0101890 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.590+0000 7f4dd4f22640 1 -- 172.21.15.107:0/2784929730 >> 172.21.15.107:0/2784929730 conn(0x7f4dd00f7000 msgr2=0x7f4dd00f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:03.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.590+0000 7f4dd4f22640 1 -- 172.21.15.107:0/2784929730 shutdown_connections 2024-09-21T07:59:03.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.590+0000 7f4dd4f22640 1 -- 172.21.15.107:0/2784929730 wait complete. 2024-09-21T07:59:03.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.591+0000 7f4dd4f22640 1 Processor -- start 2024-09-21T07:59:03.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.591+0000 7f4dd4f22640 1 -- start start 2024-09-21T07:59:03.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.591+0000 7f4dd4f22640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4dd00fb480 0x7f4dd010e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:03.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.591+0000 7f4dd4f22640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4dd01014c0 0x7f4dd010e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:03.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.591+0000 7f4dd4f22640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd010ed90 con 0x7f4dd01014c0 2024-09-21T07:59:03.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.591+0000 7f4dd4f22640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd010ef00 con 0x7f4dd00fb480 2024-09-21T07:59:03.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.591+0000 7f4dcdd9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4dd01014c0 0x7f4dd010e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:03.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.591+0000 7f4dcdd9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4dd01014c0 0x7f4dd010e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49530/0 (socket says 172.21.15.107:49530) 2024-09-21T07:59:03.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.591+0000 7f4dcdd9b640 1 -- 172.21.15.107:0/2944465664 learned_addr learned my addr 172.21.15.107:0/2944465664 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:03.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.591+0000 7f4dce59c640 1 --2- 172.21.15.107:0/2944465664 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4dd00fb480 0x7f4dd010e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:03.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.591+0000 7f4dcdd9b640 1 -- 172.21.15.107:0/2944465664 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4dd00fb480 msgr2=0x7f4dd010e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:03.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.591+0000 7f4dcdd9b640 1 --2- 172.21.15.107:0/2944465664 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4dd00fb480 0x7f4dd010e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.591+0000 7f4dcdd9b640 1 -- 172.21.15.107:0/2944465664 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc0005040 con 0x7f4dd01014c0 2024-09-21T07:59:03.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.591+0000 7f4dcdd9b640 1 --2- 172.21.15.107:0/2944465664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4dd01014c0 0x7f4dd010e700 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400b790 tx=0x7f4dc40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:03.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.592+0000 7f4dbeffd640 1 -- 172.21.15.107:0/2944465664 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dc400c700 con 0x7f4dd01014c0 2024-09-21T07:59:03.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.592+0000 7f4dbeffd640 1 -- 172.21.15.107:0/2944465664 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4dc400cd00 con 0x7f4dd01014c0 2024-09-21T07:59:03.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.592+0000 7f4dbeffd640 1 -- 172.21.15.107:0/2944465664 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dc4015e70 con 0x7f4dd01014c0 2024-09-21T07:59:03.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.592+0000 7f4dd4f22640 1 -- 172.21.15.107:0/2944465664 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd0117290 con 0x7f4dd01014c0 2024-09-21T07:59:03.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.592+0000 7f4dd4f22640 1 -- 172.21.15.107:0/2944465664 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd0117760 con 0x7f4dd01014c0 2024-09-21T07:59:03.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.593+0000 7f4dd4f22640 1 -- 172.21.15.107:0/2944465664 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd00fcbc0 con 0x7f4dd01014c0 2024-09-21T07:59:03.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.593+0000 7f4dbeffd640 1 -- 172.21.15.107:0/2944465664 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f4dc4012070 con 0x7f4dd01014c0 2024-09-21T07:59:03.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.594+0000 7f4dbeffd640 1 --2- 172.21.15.107:0/2944465664 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f4db806ed60 0x7f4db8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:03.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.594+0000 7f4dbeffd640 1 -- 172.21.15.107:0/2944465664 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4dc408d930 con 0x7f4dd01014c0 2024-09-21T07:59:03.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.594+0000 7f4dce59c640 1 --2- 172.21.15.107:0/2944465664 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f4db806ed60 0x7f4db8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:03.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.594+0000 7f4dce59c640 1 --2- 172.21.15.107:0/2944465664 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f4db806ed60 0x7f4db8071210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0004540 tx=0x7f4dc0009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:03.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.598+0000 7f4dbeffd640 1 -- 172.21.15.107:0/2944465664 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4dc405ae10 con 0x7f4dd01014c0 2024-09-21T07:59:03.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.754+0000 7f4dd4f22640 1 -- 172.21.15.107:0/2944465664 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4dd0108550 con 0x7f4dd01014c0 2024-09-21T07:59:03.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.755+0000 7f4dbeffd640 1 -- 172.21.15.107:0/2944465664 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11121 (secure 0 0 0) 0x7f4dc405a7b0 con 0x7f4dd01014c0 2024-09-21T07:59:03.757 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:59:03.757 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":38,"fsid":"786d4f32-77ee-11ef-baf6-efdc52797490","created":"2024-09-21T07:53:25.337796+0000","modified":"2024-09-21T07:58:45.196656+0000","last_up_change":"2024-09-21T07:58:44.190083+0000","last_in_change":"2024-09-21T07:58:25.510395+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:57:32.423638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b75c59ed-e2a3-4721-97b0-cd3109b895f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":373234429},{"type":"v1","addr":"172.21.15.107:6803","nonce":373234429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":373234429},{"type":"v1","addr":"172.21.15.107:6805","nonce":373234429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":373234429},{"type":"v1","addr":"172.21.15.107:6809","nonce":373234429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":373234429},{"type":"v1","addr":"172.21.15.107:6807","nonce":373234429}]},"public_addr":"172.21.15.107:6803/373234429","cluster_addr":"172.21.15.107:6805/373234429","heartbeat_back_addr":"172.21.15.107:6809/373234429","heartbeat_front_addr":"172.21.15.107:6807/373234429","state":["exists","up"]},{"osd":1,"uuid":"614577ae-2dfd-4d3a-af18-d150846ba68f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2552944255},{"type":"v1","addr":"172.21.15.107:6811","nonce":2552944255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2552944255},{"type":"v1","addr":"172.21.15.107:6813","nonce":2552944255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2552944255},{"type":"v1","addr":"172.21.15.107:6817","nonce":2552944255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2552944255},{"type":"v1","addr":"172.21.15.107:6815","nonce":2552944255}]},"public_addr":"172.21.15.107:6811/2552944255","cluster_addr":"172.21.15.107:6813/2552944255","heartbeat_back_addr":"172.21.15.107:6817/2552944255","heartbeat_front_addr":"172.21.15.107:6815/2552944255","state":["exists","up"]},{"osd":2,"uuid":"31b84275-0f5c-4a4a-8384-5444f81445a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2268135286},{"type":"v1","addr":"172.21.15.107:6819","nonce":2268135286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2268135286},{"type":"v1","addr":"172.21.15.107:6821","nonce":2268135286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2268135286},{"type":"v1","addr":"172.21.15.107:6825","nonce":2268135286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2268135286},{"type":"v1","addr":"172.21.15.107:6823","nonce":2268135286}]},"public_addr":"172.21.15.107:6819/2268135286","cluster_addr":"172.21.15.107:6821/2268135286","heartbeat_back_addr":"172.21.15.107:6825/2268135286","heartbeat_front_addr":"172.21.15.107:6823/2268135286","state":["exists","up"]},{"osd":3,"uuid":"57445a72-d438-4f24-9e18-c69eb61e3c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1110660771},{"type":"v1","addr":"172.21.15.129:6801","nonce":1110660771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1110660771},{"type":"v1","addr":"172.21.15.129:6803","nonce":1110660771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1110660771},{"type":"v1","addr":"172.21.15.129:6807","nonce":1110660771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1110660771},{"type":"v1","addr":"172.21.15.129:6805","nonce":1110660771}]},"public_addr":"172.21.15.129:6801/1110660771","cluster_addr":"172.21.15.129:6803/1110660771","heartbeat_back_addr":"172.21.15.129:6807/1110660771","heartbeat_front_addr":"172.21.15.129:6805/1110660771","state":["exists","up"]},{"osd":4,"uuid":"619f850e-d5ab-4aa0-ae32-7702b79354eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":431008109},{"type":"v1","addr":"172.21.15.129:6809","nonce":431008109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":431008109},{"type":"v1","addr":"172.21.15.129:6811","nonce":431008109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":431008109},{"type":"v1","addr":"172.21.15.129:6815","nonce":431008109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":431008109},{"type":"v1","addr":"172.21.15.129:6813","nonce":431008109}]},"public_addr":"172.21.15.129:6809/431008109","cluster_addr":"172.21.15.129:6811/431008109","heartbeat_back_addr":"172.21.15.129:6815/431008109","heartbeat_front_addr":"172.21.15.129:6813/431008109","state":["exists","up"]},{"osd":5,"uuid":"da233bd9-495d-49fc-bf34-39e983b9dd14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":4170919914},{"type":"v1","addr":"172.21.15.129:6817","nonce":4170919914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":4170919914},{"type":"v1","addr":"172.21.15.129:6819","nonce":4170919914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":4170919914},{"type":"v1","addr":"172.21.15.129:6823","nonce":4170919914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":4170919914},{"type":"v1","addr":"172.21.15.129:6821","nonce":4170919914}]},"public_addr":"172.21.15.129:6817/4170919914","cluster_addr":"172.21.15.129:6819/4170919914","heartbeat_back_addr":"172.21.15.129:6823/4170919914","heartbeat_front_addr":"172.21.15.129:6821/4170919914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:34.070965+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:00.399663+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:29.519414+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:53.302742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:58:17.213919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:58:42.201984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:0/2498876652":"2024-09-22T07:55:24.118876+0000","172.21.15.107:0/2676703491":"2024-09-22T07:53:55.453491+0000","172.21.15.107:6800/287926342":"2024-09-22T07:53:55.453491+0000","172.21.15.107:6801/2912640406":"2024-09-22T07:54:24.297241+0000","172.21.15.107:6801/287926342":"2024-09-22T07:53:55.453491+0000","172.21.15.107:0/4136397866":"2024-09-22T07:54:24.297241+0000","172.21.15.107:0/3732544930":"2024-09-22T07:53:55.453491+0000","172.21.15.107:0/2976092283":"2024-09-22T07:54:24.297241+0000","172.21.15.107:6800/2850161381":"2024-09-22T07:55:24.118876+0000","172.21.15.107:6801/2850161381":"2024-09-22T07:55:24.118876+0000","172.21.15.107:6800/2912640406":"2024-09-22T07:54:24.297241+0000","172.21.15.107:0/3831586505":"2024-09-22T07:54:24.297241+0000","172.21.15.107:0/2314131589":"2024-09-22T07:55:24.118876+0000","172.21.15.107:0/805704025":"2024-09-22T07:53:55.453491+0000","172.21.15.107:0/1232121301":"2024-09-22T07:55:24.118876+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:59:03.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.757+0000 7f4dd4f22640 1 -- 172.21.15.107:0/2944465664 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f4db806ed60 msgr2=0x7f4db8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:03.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.757+0000 7f4dd4f22640 1 --2- 172.21.15.107:0/2944465664 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f4db806ed60 0x7f4db8071210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0004540 tx=0x7f4dc0009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.757+0000 7f4dd4f22640 1 -- 172.21.15.107:0/2944465664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4dd01014c0 msgr2=0x7f4dd010e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:03.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.757+0000 7f4dd4f22640 1 --2- 172.21.15.107:0/2944465664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4dd01014c0 0x7f4dd010e700 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400b790 tx=0x7f4dc40091d0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.757+0000 7f4dd4f22640 1 -- 172.21.15.107:0/2944465664 shutdown_connections 2024-09-21T07:59:03.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.757+0000 7f4dd4f22640 1 --2- 172.21.15.107:0/2944465664 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f4db806ed60 0x7f4db8071210 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.757+0000 7f4dd4f22640 1 --2- 172.21.15.107:0/2944465664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4dd01014c0 0x7f4dd010e700 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.757+0000 7f4dd4f22640 1 --2- 172.21.15.107:0/2944465664 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4dd00fb480 0x7f4dd010e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.757+0000 7f4dd4f22640 1 -- 172.21.15.107:0/2944465664 >> 172.21.15.107:0/2944465664 conn(0x7f4dd00f7000 msgr2=0x7f4dd00f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:03.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.757+0000 7f4dd4f22640 1 -- 172.21.15.107:0/2944465664 shutdown_connections 2024-09-21T07:59:03.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:03.757+0000 7f4dd4f22640 1 -- 172.21.15.107:0/2944465664 wait complete. 2024-09-21T07:59:04.052 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:03 smithi107 ceph-mon[27622]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:04.052 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:03 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/2944465664' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T07:59:04.069 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:03 smithi129 ceph-mon[34472]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:04.069 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:03 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/2944465664' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T07:59:04.488 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T07:59:04.488 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:59:04.731 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:05.964 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:05 smithi107 ceph-mon[27622]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:06.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.147+0000 7f576067c640 1 -- 172.21.15.107:0/2308582273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5758102530 msgr2=0x7f5758102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:06.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.147+0000 7f576067c640 1 --2- 172.21.15.107:0/2308582273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5758102530 0x7f5758102900 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f57500048d0 tx=0x7f5750009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:06.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.147+0000 7f576067c640 1 -- 172.21.15.107:0/2308582273 shutdown_connections 2024-09-21T07:59:06.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.147+0000 7f576067c640 1 --2- 172.21.15.107:0/2308582273 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5758102ed0 0x7f57580fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:06.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.147+0000 7f576067c640 1 --2- 172.21.15.107:0/2308582273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5758102530 0x7f5758102900 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:06.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.147+0000 7f576067c640 1 -- 172.21.15.107:0/2308582273 >> 172.21.15.107:0/2308582273 conn(0x7f57580f80f0 msgr2=0x7f57580fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:06.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.147+0000 7f576067c640 1 -- 172.21.15.107:0/2308582273 shutdown_connections 2024-09-21T07:59:06.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.147+0000 7f576067c640 1 -- 172.21.15.107:0/2308582273 wait complete. 2024-09-21T07:59:06.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.147+0000 7f576067c640 1 Processor -- start 2024-09-21T07:59:06.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.147+0000 7f576067c640 1 -- start start 2024-09-21T07:59:06.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.148+0000 7f576067c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5758102530 0x7f5758113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:06.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.148+0000 7f576067c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5758102ed0 0x7f5758113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:06.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.148+0000 7f576067c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5758113e20 con 0x7f5758102530 2024-09-21T07:59:06.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.148+0000 7f576067c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575810d1d0 con 0x7f5758102ed0 2024-09-21T07:59:06.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.148+0000 7f575e418640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5758102530 0x7f5758113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:06.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.148+0000 7f575e418640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5758102530 0x7f5758113250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49560/0 (socket says 172.21.15.107:49560) 2024-09-21T07:59:06.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.148+0000 7f575e418640 1 -- 172.21.15.107:0/3586888737 learned_addr learned my addr 172.21.15.107:0/3586888737 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:06.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.148+0000 7f575e418640 1 -- 172.21.15.107:0/3586888737 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5758102ed0 msgr2=0x7f5758113790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:06.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.148+0000 7f575e418640 1 --2- 172.21.15.107:0/3586888737 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5758102ed0 0x7f5758113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:06.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.148+0000 7f575e418640 1 -- 172.21.15.107:0/3586888737 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5750005040 con 0x7f5758102530 2024-09-21T07:59:06.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.148+0000 7f575e418640 1 --2- 172.21.15.107:0/3586888737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5758102530 0x7f5758113250 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5750000c00 tx=0x7f5750009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:06.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.148+0000 7f5756ffd640 1 -- 172.21.15.107:0/3586888737 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5750038070 con 0x7f5758102530 2024-09-21T07:59:06.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.148+0000 7f5756ffd640 1 -- 172.21.15.107:0/3586888737 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f575003daf0 con 0x7f5758102530 2024-09-21T07:59:06.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.148+0000 7f576067c640 1 -- 172.21.15.107:0/3586888737 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575810d450 con 0x7f5758102530 2024-09-21T07:59:06.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.148+0000 7f5756ffd640 1 -- 172.21.15.107:0/3586888737 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5750033b20 con 0x7f5758102530 2024-09-21T07:59:06.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.148+0000 7f576067c640 1 -- 172.21.15.107:0/3586888737 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575810d970 con 0x7f5758102530 2024-09-21T07:59:06.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.149+0000 7f576067c640 1 -- 172.21.15.107:0/3586888737 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57580fdcb0 con 0x7f5758102530 2024-09-21T07:59:06.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.150+0000 7f5756ffd640 1 -- 172.21.15.107:0/3586888737 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f5750030020 con 0x7f5758102530 2024-09-21T07:59:06.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.150+0000 7f5756ffd640 1 --2- 172.21.15.107:0/3586888737 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f574006ed60 0x7f5740071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:06.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.150+0000 7f5756ffd640 1 -- 172.21.15.107:0/3586888737 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f57500ae010 con 0x7f5758102530 2024-09-21T07:59:06.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.150+0000 7f575dc17640 1 --2- 172.21.15.107:0/3586888737 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f574006ed60 0x7f5740071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:06.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.151+0000 7f575dc17640 1 --2- 172.21.15.107:0/3586888737 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f574006ed60 0x7f5740071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f575810eb10 tx=0x7f574c006d20 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:06.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.154+0000 7f5756ffd640 1 -- 172.21.15.107:0/3586888737 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f575007b470 con 0x7f5758102530 2024-09-21T07:59:06.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:05 smithi129 ceph-mon[34472]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:06.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.313+0000 7f576067c640 1 -- 172.21.15.107:0/3586888737 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57580fbd30 con 0x7f5758102530 2024-09-21T07:59:06.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.314+0000 7f5756ffd640 1 -- 172.21.15.107:0/3586888737 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11121 (secure 0 0 0) 0x7f57580fbd30 con 0x7f5758102530 2024-09-21T07:59:06.315 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:59:06.316 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":38,"fsid":"786d4f32-77ee-11ef-baf6-efdc52797490","created":"2024-09-21T07:53:25.337796+0000","modified":"2024-09-21T07:58:45.196656+0000","last_up_change":"2024-09-21T07:58:44.190083+0000","last_in_change":"2024-09-21T07:58:25.510395+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:57:32.423638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b75c59ed-e2a3-4721-97b0-cd3109b895f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":373234429},{"type":"v1","addr":"172.21.15.107:6803","nonce":373234429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":373234429},{"type":"v1","addr":"172.21.15.107:6805","nonce":373234429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":373234429},{"type":"v1","addr":"172.21.15.107:6809","nonce":373234429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":373234429},{"type":"v1","addr":"172.21.15.107:6807","nonce":373234429}]},"public_addr":"172.21.15.107:6803/373234429","cluster_addr":"172.21.15.107:6805/373234429","heartbeat_back_addr":"172.21.15.107:6809/373234429","heartbeat_front_addr":"172.21.15.107:6807/373234429","state":["exists","up"]},{"osd":1,"uuid":"614577ae-2dfd-4d3a-af18-d150846ba68f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2552944255},{"type":"v1","addr":"172.21.15.107:6811","nonce":2552944255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2552944255},{"type":"v1","addr":"172.21.15.107:6813","nonce":2552944255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":2552944255},{"type":"v1","addr":"172.21.15.107:6817","nonce":2552944255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2552944255},{"type":"v1","addr":"172.21.15.107:6815","nonce":2552944255}]},"public_addr":"172.21.15.107:6811/2552944255","cluster_addr":"172.21.15.107:6813/2552944255","heartbeat_back_addr":"172.21.15.107:6817/2552944255","heartbeat_front_addr":"172.21.15.107:6815/2552944255","state":["exists","up"]},{"osd":2,"uuid":"31b84275-0f5c-4a4a-8384-5444f81445a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2268135286},{"type":"v1","addr":"172.21.15.107:6819","nonce":2268135286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2268135286},{"type":"v1","addr":"172.21.15.107:6821","nonce":2268135286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2268135286},{"type":"v1","addr":"172.21.15.107:6825","nonce":2268135286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2268135286},{"type":"v1","addr":"172.21.15.107:6823","nonce":2268135286}]},"public_addr":"172.21.15.107:6819/2268135286","cluster_addr":"172.21.15.107:6821/2268135286","heartbeat_back_addr":"172.21.15.107:6825/2268135286","heartbeat_front_addr":"172.21.15.107:6823/2268135286","state":["exists","up"]},{"osd":3,"uuid":"57445a72-d438-4f24-9e18-c69eb61e3c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1110660771},{"type":"v1","addr":"172.21.15.129:6801","nonce":1110660771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1110660771},{"type":"v1","addr":"172.21.15.129:6803","nonce":1110660771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1110660771},{"type":"v1","addr":"172.21.15.129:6807","nonce":1110660771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1110660771},{"type":"v1","addr":"172.21.15.129:6805","nonce":1110660771}]},"public_addr":"172.21.15.129:6801/1110660771","cluster_addr":"172.21.15.129:6803/1110660771","heartbeat_back_addr":"172.21.15.129:6807/1110660771","heartbeat_front_addr":"172.21.15.129:6805/1110660771","state":["exists","up"]},{"osd":4,"uuid":"619f850e-d5ab-4aa0-ae32-7702b79354eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":431008109},{"type":"v1","addr":"172.21.15.129:6809","nonce":431008109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":431008109},{"type":"v1","addr":"172.21.15.129:6811","nonce":431008109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":431008109},{"type":"v1","addr":"172.21.15.129:6815","nonce":431008109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":431008109},{"type":"v1","addr":"172.21.15.129:6813","nonce":431008109}]},"public_addr":"172.21.15.129:6809/431008109","cluster_addr":"172.21.15.129:6811/431008109","heartbeat_back_addr":"172.21.15.129:6815/431008109","heartbeat_front_addr":"172.21.15.129:6813/431008109","state":["exists","up"]},{"osd":5,"uuid":"da233bd9-495d-49fc-bf34-39e983b9dd14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":4170919914},{"type":"v1","addr":"172.21.15.129:6817","nonce":4170919914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":4170919914},{"type":"v1","addr":"172.21.15.129:6819","nonce":4170919914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":4170919914},{"type":"v1","addr":"172.21.15.129:6823","nonce":4170919914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":4170919914},{"type":"v1","addr":"172.21.15.129:6821","nonce":4170919914}]},"public_addr":"172.21.15.129:6817/4170919914","cluster_addr":"172.21.15.129:6819/4170919914","heartbeat_back_addr":"172.21.15.129:6823/4170919914","heartbeat_front_addr":"172.21.15.129:6821/4170919914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:34.070965+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:00.399663+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:29.519414+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:53.302742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:58:17.213919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:58:42.201984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:0/2498876652":"2024-09-22T07:55:24.118876+0000","172.21.15.107:0/2676703491":"2024-09-22T07:53:55.453491+0000","172.21.15.107:6800/287926342":"2024-09-22T07:53:55.453491+0000","172.21.15.107:6801/2912640406":"2024-09-22T07:54:24.297241+0000","172.21.15.107:6801/287926342":"2024-09-22T07:53:55.453491+0000","172.21.15.107:0/4136397866":"2024-09-22T07:54:24.297241+0000","172.21.15.107:0/3732544930":"2024-09-22T07:53:55.453491+0000","172.21.15.107:0/2976092283":"2024-09-22T07:54:24.297241+0000","172.21.15.107:6800/2850161381":"2024-09-22T07:55:24.118876+0000","172.21.15.107:6801/2850161381":"2024-09-22T07:55:24.118876+0000","172.21.15.107:6800/2912640406":"2024-09-22T07:54:24.297241+0000","172.21.15.107:0/3831586505":"2024-09-22T07:54:24.297241+0000","172.21.15.107:0/2314131589":"2024-09-22T07:55:24.118876+0000","172.21.15.107:0/805704025":"2024-09-22T07:53:55.453491+0000","172.21.15.107:0/1232121301":"2024-09-22T07:55:24.118876+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:59:06.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.315+0000 7f576067c640 1 -- 172.21.15.107:0/3586888737 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f574006ed60 msgr2=0x7f5740071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:06.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.315+0000 7f576067c640 1 --2- 172.21.15.107:0/3586888737 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f574006ed60 0x7f5740071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f575810eb10 tx=0x7f574c006d20 comp rx=0 tx=0).stop 2024-09-21T07:59:06.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.315+0000 7f576067c640 1 -- 172.21.15.107:0/3586888737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5758102530 msgr2=0x7f5758113250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:06.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.315+0000 7f576067c640 1 --2- 172.21.15.107:0/3586888737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5758102530 0x7f5758113250 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5750000c00 tx=0x7f5750009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:06.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.315+0000 7f576067c640 1 -- 172.21.15.107:0/3586888737 shutdown_connections 2024-09-21T07:59:06.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.316+0000 7f576067c640 1 --2- 172.21.15.107:0/3586888737 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5758102ed0 0x7f5758113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:06.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.316+0000 7f576067c640 1 --2- 172.21.15.107:0/3586888737 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f574006ed60 0x7f5740071210 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:06.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.316+0000 7f576067c640 1 --2- 172.21.15.107:0/3586888737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5758102530 0x7f5758113250 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:06.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.316+0000 7f576067c640 1 -- 172.21.15.107:0/3586888737 >> 172.21.15.107:0/3586888737 conn(0x7f57580f80f0 msgr2=0x7f57580f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:06.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.316+0000 7f576067c640 1 -- 172.21.15.107:0/3586888737 shutdown_connections 2024-09-21T07:59:06.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:06.316+0000 7f576067c640 1 -- 172.21.15.107:0/3586888737 wait complete. 2024-09-21T07:59:07.028 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T07:59:07.029 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T07:59:07.029 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T07:59:07.030 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T07:59:07.030 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T07:59:07.030 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T07:59:07.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:06 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/3586888737' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T07:59:07.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:06 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/3586888737' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T07:59:07.326 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:07.326 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:08.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:07 smithi107 ceph-mon[27622]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:08.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:07 smithi129 ceph-mon[34472]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:08.682 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:09.543 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:09.544 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:09.544 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:10.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:09 smithi129 ceph-mon[34472]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:09 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:59:10.275 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:09 smithi107 ceph-mon[27622]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:10.275 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:09 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:59:11.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.134+0000 7f08d8c32640 1 -- 172.21.15.107:0/3286947269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08d4102550 msgr2=0x7f08d4102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:11.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.134+0000 7f08d8c32640 1 --2- 172.21.15.107:0/3286947269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08d4102550 0x7f08d4102920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f08cc0048d0 tx=0x7f08cc009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:11.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.134+0000 7f08d8c32640 1 -- 172.21.15.107:0/3286947269 shutdown_connections 2024-09-21T07:59:11.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.134+0000 7f08d8c32640 1 --2- 172.21.15.107:0/3286947269 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f08d4102ef0 0x7f08d40fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:11.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.134+0000 7f08d8c32640 1 --2- 172.21.15.107:0/3286947269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08d4102550 0x7f08d4102920 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:11.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.134+0000 7f08d8c32640 1 -- 172.21.15.107:0/3286947269 >> 172.21.15.107:0/3286947269 conn(0x7f08d40f80f0 msgr2=0x7f08d40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:11.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.134+0000 7f08d8c32640 1 -- 172.21.15.107:0/3286947269 shutdown_connections 2024-09-21T07:59:11.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.134+0000 7f08d8c32640 1 -- 172.21.15.107:0/3286947269 wait complete. 2024-09-21T07:59:11.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.135+0000 7f08d8c32640 1 Processor -- start 2024-09-21T07:59:11.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.135+0000 7f08d8c32640 1 -- start start 2024-09-21T07:59:11.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.135+0000 7f08d8c32640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08d4102550 0x7f08d41135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:11.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.135+0000 7f08d8c32640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f08d4102ef0 0x7f08d4113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:11.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.135+0000 7f08d8c32640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d41141d0 con 0x7f08d4102550 2024-09-21T07:59:11.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.135+0000 7f08d8c32640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d410d550 con 0x7f08d4102ef0 2024-09-21T07:59:11.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.135+0000 7f08d259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08d4102550 0x7f08d41135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:11.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.135+0000 7f08d259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08d4102550 0x7f08d41135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47500/0 (socket says 172.21.15.107:47500) 2024-09-21T07:59:11.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.135+0000 7f08d259c640 1 -- 172.21.15.107:0/2450588945 learned_addr learned my addr 172.21.15.107:0/2450588945 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:11.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.135+0000 7f08d259c640 1 -- 172.21.15.107:0/2450588945 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f08d4102ef0 msgr2=0x7f08d4113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:11.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.135+0000 7f08d259c640 1 --2- 172.21.15.107:0/2450588945 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f08d4102ef0 0x7f08d4113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:11.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.135+0000 7f08d259c640 1 -- 172.21.15.107:0/2450588945 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc005040 con 0x7f08d4102550 2024-09-21T07:59:11.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.135+0000 7f08d259c640 1 --2- 172.21.15.107:0/2450588945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08d4102550 0x7f08d41135b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f08cc000c00 tx=0x7f08cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:11.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.135+0000 7f08caffd640 1 -- 172.21.15.107:0/2450588945 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08cc038070 con 0x7f08d4102550 2024-09-21T07:59:11.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.135+0000 7f08caffd640 1 -- 172.21.15.107:0/2450588945 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f08cc03daf0 con 0x7f08d4102550 2024-09-21T07:59:11.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.135+0000 7f08d8c32640 1 -- 172.21.15.107:0/2450588945 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d410d780 con 0x7f08d4102550 2024-09-21T07:59:11.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.136+0000 7f08caffd640 1 -- 172.21.15.107:0/2450588945 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08cc033b20 con 0x7f08d4102550 2024-09-21T07:59:11.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.136+0000 7f08d8c32640 1 -- 172.21.15.107:0/2450588945 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d410dca0 con 0x7f08d4102550 2024-09-21T07:59:11.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.137+0000 7f08d8c32640 1 -- 172.21.15.107:0/2450588945 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f08d40fdcd0 con 0x7f08d4102550 2024-09-21T07:59:11.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.137+0000 7f08caffd640 1 -- 172.21.15.107:0/2450588945 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f08cc030020 con 0x7f08d4102550 2024-09-21T07:59:11.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.138+0000 7f08caffd640 1 --2- 172.21.15.107:0/2450588945 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f08c006ed60 0x7f08c0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:11.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.138+0000 7f08caffd640 1 -- 172.21.15.107:0/2450588945 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f08cc0ae0a0 con 0x7f08d4102550 2024-09-21T07:59:11.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.138+0000 7f08d1d9b640 1 --2- 172.21.15.107:0/2450588945 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f08c006ed60 0x7f08c0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:11.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.138+0000 7f08caffd640 1 --2- 172.21.15.107:0/2450588945 >> [v2:172.21.15.129:6816/4170919914,v1:172.21.15.129:6817/4170919914] conn(0x7f08c0074ae0 0x7f08c0076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:11.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.138+0000 7f08caffd640 1 -- 172.21.15.107:0/2450588945 --> [v2:172.21.15.129:6816/4170919914,v1:172.21.15.129:6817/4170919914] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f08c00775a0 con 0x7f08c0074ae0 2024-09-21T07:59:11.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.138+0000 7f08caffd640 1 -- 172.21.15.107:0/2450588945 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08cc0b06f0 con 0x7f08d4102550 2024-09-21T07:59:11.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.138+0000 7f08d1d9b640 1 --2- 172.21.15.107:0/2450588945 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f08c006ed60 0x7f08c0071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f08d410e830 tx=0x7f08bc009370 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:11.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.138+0000 7f08d2d9d640 1 --2- 172.21.15.107:0/2450588945 >> [v2:172.21.15.129:6816/4170919914,v1:172.21.15.129:6817/4170919914] conn(0x7f08c0074ae0 0x7f08c0076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:11.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.139+0000 7f08d2d9d640 1 --2- 172.21.15.107:0/2450588945 >> [v2:172.21.15.129:6816/4170919914,v1:172.21.15.129:6817/4170919914] conn(0x7f08c0074ae0 0x7f08c0076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:11.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.139+0000 7f08caffd640 1 -- 172.21.15.107:0/2450588945 <== osd.5 v2:172.21.15.129:6816/4170919914 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f08c00775a0 con 0x7f08c0074ae0 2024-09-21T07:59:11.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.152+0000 7f08d8c32640 1 -- 172.21.15.107:0/2450588945 --> [v2:172.21.15.129:6816/4170919914,v1:172.21.15.129:6817/4170919914] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f08d410e240 con 0x7f08c0074ae0 2024-09-21T07:59:11.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.152+0000 7f08caffd640 1 -- 172.21.15.107:0/2450588945 <== osd.5 v2:172.21.15.129:6816/4170919914 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f08d410e240 con 0x7f08c0074ae0 2024-09-21T07:59:11.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.152+0000 7f08d8c32640 1 -- 172.21.15.107:0/2450588945 >> [v2:172.21.15.129:6816/4170919914,v1:172.21.15.129:6817/4170919914] conn(0x7f08c0074ae0 msgr2=0x7f08c0076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:11.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.152+0000 7f08d8c32640 1 --2- 172.21.15.107:0/2450588945 >> [v2:172.21.15.129:6816/4170919914,v1:172.21.15.129:6817/4170919914] conn(0x7f08c0074ae0 0x7f08c0076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:11.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.152+0000 7f08d8c32640 1 -- 172.21.15.107:0/2450588945 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f08c006ed60 msgr2=0x7f08c0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:11.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.152+0000 7f08d8c32640 1 --2- 172.21.15.107:0/2450588945 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f08c006ed60 0x7f08c0071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f08d410e830 tx=0x7f08bc009370 comp rx=0 tx=0).stop 2024-09-21T07:59:11.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.152+0000 7f08d8c32640 1 -- 172.21.15.107:0/2450588945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08d4102550 msgr2=0x7f08d41135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:11.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.152+0000 7f08d8c32640 1 --2- 172.21.15.107:0/2450588945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08d4102550 0x7f08d41135b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f08cc000c00 tx=0x7f08cc009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:11.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.152+0000 7f08d8c32640 1 -- 172.21.15.107:0/2450588945 shutdown_connections 2024-09-21T07:59:11.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.152+0000 7f08d8c32640 1 --2- 172.21.15.107:0/2450588945 >> [v2:172.21.15.129:6816/4170919914,v1:172.21.15.129:6817/4170919914] conn(0x7f08c0074ae0 0x7f08c0076ef0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:11.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.152+0000 7f08d8c32640 1 --2- 172.21.15.107:0/2450588945 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f08d4102ef0 0x7f08d4113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:11.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.152+0000 7f08d8c32640 1 --2- 172.21.15.107:0/2450588945 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f08c006ed60 0x7f08c0071210 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:11.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.152+0000 7f08d8c32640 1 --2- 172.21.15.107:0/2450588945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08d4102550 0x7f08d41135b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:11.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.152+0000 7f08d8c32640 1 -- 172.21.15.107:0/2450588945 >> 172.21.15.107:0/2450588945 conn(0x7f08d40f80f0 msgr2=0x7f08d40f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:11.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.152+0000 7f08d8c32640 1 -- 172.21.15.107:0/2450588945 shutdown_connections 2024-09-21T07:59:11.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:11.153+0000 7f08d8c32640 1 -- 172.21.15.107:0/2450588945 wait complete. 2024-09-21T07:59:12.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:11 smithi107 ceph-mon[27622]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:12.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:11 smithi129 ceph-mon[34472]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:13.918 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:13 smithi107 ceph-mon[27622]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:14.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:13 smithi129 ceph-mon[34472]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:14.321 INFO:teuthology.orchestra.run.smithi107.stdout:158913789960 2024-09-21T07:59:14.321 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T07:59:15.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.781+0000 7fd4faad5640 1 -- 172.21.15.107:0/2206156088 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4f4102530 msgr2=0x7fd4f4102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:15.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.781+0000 7fd4faad5640 1 --2- 172.21.15.107:0/2206156088 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4f4102530 0x7fd4f4102900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40048d0 tx=0x7fd4e4009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:15.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.781+0000 7fd4faad5640 1 -- 172.21.15.107:0/2206156088 shutdown_connections 2024-09-21T07:59:15.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.781+0000 7fd4faad5640 1 --2- 172.21.15.107:0/2206156088 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd4f4102ed0 0x7fd4f40fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:15.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.781+0000 7fd4faad5640 1 --2- 172.21.15.107:0/2206156088 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4f4102530 0x7fd4f4102900 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:15.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.781+0000 7fd4faad5640 1 -- 172.21.15.107:0/2206156088 >> 172.21.15.107:0/2206156088 conn(0x7fd4f40f80f0 msgr2=0x7fd4f40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:15.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.781+0000 7fd4faad5640 1 -- 172.21.15.107:0/2206156088 shutdown_connections 2024-09-21T07:59:15.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.781+0000 7fd4faad5640 1 -- 172.21.15.107:0/2206156088 wait complete. 2024-09-21T07:59:15.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.781+0000 7fd4faad5640 1 Processor -- start 2024-09-21T07:59:15.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.782+0000 7fd4faad5640 1 -- start start 2024-09-21T07:59:15.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.782+0000 7fd4faad5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4f4102530 0x7fd4f4113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:15.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.782+0000 7fd4faad5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd4f4102ed0 0x7fd4f4113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:15.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.782+0000 7fd4faad5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f4113d80 con 0x7fd4f4102530 2024-09-21T07:59:15.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.782+0000 7fd4faad5640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f410d1c0 con 0x7fd4f4102ed0 2024-09-21T07:59:15.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.782+0000 7fd4f8871640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4f4102530 0x7fd4f4113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:15.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.782+0000 7fd4f8871640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4f4102530 0x7fd4f4113240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47518/0 (socket says 172.21.15.107:47518) 2024-09-21T07:59:15.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.782+0000 7fd4f8871640 1 -- 172.21.15.107:0/2522355771 learned_addr learned my addr 172.21.15.107:0/2522355771 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:15.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.782+0000 7fd4f3fff640 1 --2- 172.21.15.107:0/2522355771 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd4f4102ed0 0x7fd4f4113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:15.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.782+0000 7fd4f8871640 1 -- 172.21.15.107:0/2522355771 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd4f4102ed0 msgr2=0x7fd4f4113780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:15.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.782+0000 7fd4f8871640 1 --2- 172.21.15.107:0/2522355771 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd4f4102ed0 0x7fd4f4113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:15.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.782+0000 7fd4f8871640 1 -- 172.21.15.107:0/2522355771 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e4005040 con 0x7fd4f4102530 2024-09-21T07:59:15.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.782+0000 7fd4f8871640 1 --2- 172.21.15.107:0/2522355771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4f4102530 0x7fd4f4113240 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4000c00 tx=0x7fd4e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:15.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.783+0000 7fd4f17fa640 1 -- 172.21.15.107:0/2522355771 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4e4038070 con 0x7fd4f4102530 2024-09-21T07:59:15.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.783+0000 7fd4f17fa640 1 -- 172.21.15.107:0/2522355771 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd4e402ade0 con 0x7fd4f4102530 2024-09-21T07:59:15.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.783+0000 7fd4faad5640 1 -- 172.21.15.107:0/2522355771 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f410d440 con 0x7fd4f4102530 2024-09-21T07:59:15.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.783+0000 7fd4f17fa640 1 -- 172.21.15.107:0/2522355771 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4e402c7e0 con 0x7fd4f4102530 2024-09-21T07:59:15.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.783+0000 7fd4faad5640 1 -- 172.21.15.107:0/2522355771 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f410d980 con 0x7fd4f4102530 2024-09-21T07:59:15.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.783+0000 7fd4faad5640 1 -- 172.21.15.107:0/2522355771 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd4f410deb0 con 0x7fd4f4102530 2024-09-21T07:59:15.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.784+0000 7fd4f17fa640 1 -- 172.21.15.107:0/2522355771 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fd4e4030020 con 0x7fd4f4102530 2024-09-21T07:59:15.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.785+0000 7fd4f17fa640 1 --2- 172.21.15.107:0/2522355771 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fd4e006ed60 0x7fd4e0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:15.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.785+0000 7fd4f17fa640 1 -- 172.21.15.107:0/2522355771 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd4e40ada00 con 0x7fd4f4102530 2024-09-21T07:59:15.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.785+0000 7fd4f3fff640 1 --2- 172.21.15.107:0/2522355771 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fd4e006ed60 0x7fd4e0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:15.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.785+0000 7fd4f17fa640 1 --2- 172.21.15.107:0/2522355771 >> [v2:172.21.15.107:6810/2552944255,v1:172.21.15.107:6811/2552944255] conn(0x7fd4e0074ae0 0x7fd4e0076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:15.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.785+0000 7fd4f17fa640 1 -- 172.21.15.107:0/2522355771 --> [v2:172.21.15.107:6810/2552944255,v1:172.21.15.107:6811/2552944255] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4e00775a0 con 0x7fd4e0074ae0 2024-09-21T07:59:15.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.785+0000 7fd4f17fa640 1 -- 172.21.15.107:0/2522355771 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4e40b2220 con 0x7fd4f4102530 2024-09-21T07:59:15.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.785+0000 7fd4f9072640 1 --2- 172.21.15.107:0/2522355771 >> [v2:172.21.15.107:6810/2552944255,v1:172.21.15.107:6811/2552944255] conn(0x7fd4e0074ae0 0x7fd4e0076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:15.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.785+0000 7fd4f3fff640 1 --2- 172.21.15.107:0/2522355771 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fd4e006ed60 0x7fd4e0071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd4f410eb00 tx=0x7fd4dc00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:15.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.785+0000 7fd4f9072640 1 --2- 172.21.15.107:0/2522355771 >> [v2:172.21.15.107:6810/2552944255,v1:172.21.15.107:6811/2552944255] conn(0x7fd4e0074ae0 0x7fd4e0076ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:15.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.786+0000 7fd4f17fa640 1 -- 172.21.15.107:0/2522355771 <== osd.1 v2:172.21.15.107:6810/2552944255 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd4e00775a0 con 0x7fd4e0074ae0 2024-09-21T07:59:15.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.798+0000 7fd4faad5640 1 -- 172.21.15.107:0/2522355771 --> [v2:172.21.15.107:6810/2552944255,v1:172.21.15.107:6811/2552944255] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd4f40fdcb0 con 0x7fd4e0074ae0 2024-09-21T07:59:15.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.798+0000 7fd4f17fa640 1 -- 172.21.15.107:0/2522355771 <== osd.1 v2:172.21.15.107:6810/2552944255 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd4f40fdcb0 con 0x7fd4e0074ae0 2024-09-21T07:59:15.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.798+0000 7fd4faad5640 1 -- 172.21.15.107:0/2522355771 >> [v2:172.21.15.107:6810/2552944255,v1:172.21.15.107:6811/2552944255] conn(0x7fd4e0074ae0 msgr2=0x7fd4e0076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:15.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.798+0000 7fd4faad5640 1 --2- 172.21.15.107:0/2522355771 >> [v2:172.21.15.107:6810/2552944255,v1:172.21.15.107:6811/2552944255] conn(0x7fd4e0074ae0 0x7fd4e0076ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:15.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.799+0000 7fd4faad5640 1 -- 172.21.15.107:0/2522355771 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fd4e006ed60 msgr2=0x7fd4e0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:15.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.799+0000 7fd4faad5640 1 --2- 172.21.15.107:0/2522355771 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fd4e006ed60 0x7fd4e0071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd4f410eb00 tx=0x7fd4dc00b040 comp rx=0 tx=0).stop 2024-09-21T07:59:15.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.799+0000 7fd4faad5640 1 -- 172.21.15.107:0/2522355771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4f4102530 msgr2=0x7fd4f4113240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:15.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.799+0000 7fd4faad5640 1 --2- 172.21.15.107:0/2522355771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4f4102530 0x7fd4f4113240 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4000c00 tx=0x7fd4e4009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:15.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.799+0000 7fd4faad5640 1 -- 172.21.15.107:0/2522355771 shutdown_connections 2024-09-21T07:59:15.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.799+0000 7fd4faad5640 1 --2- 172.21.15.107:0/2522355771 >> [v2:172.21.15.107:6810/2552944255,v1:172.21.15.107:6811/2552944255] conn(0x7fd4e0074ae0 0x7fd4e0076ef0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:15.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.799+0000 7fd4faad5640 1 --2- 172.21.15.107:0/2522355771 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd4f4102ed0 0x7fd4f4113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:15.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.799+0000 7fd4faad5640 1 --2- 172.21.15.107:0/2522355771 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fd4e006ed60 0x7fd4e0071210 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:15.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.799+0000 7fd4faad5640 1 --2- 172.21.15.107:0/2522355771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4f4102530 0x7fd4f4113240 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:15.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.799+0000 7fd4faad5640 1 -- 172.21.15.107:0/2522355771 >> 172.21.15.107:0/2522355771 conn(0x7fd4f40f80f0 msgr2=0x7fd4f40f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:15.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.799+0000 7fd4faad5640 1 -- 172.21.15.107:0/2522355771 shutdown_connections 2024-09-21T07:59:15.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:15.799+0000 7fd4faad5640 1 -- 172.21.15.107:0/2522355771 wait complete. 2024-09-21T07:59:16.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:15 smithi107 ceph-mon[27622]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:16.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:15 smithi129 ceph-mon[34472]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:16.496 INFO:teuthology.orchestra.run.smithi107.stdout:60129542172 2024-09-21T07:59:16.496 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T07:59:17.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.546+0000 7fca852d1640 1 -- 172.21.15.107:0/1130808568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca800fcf80 msgr2=0x7fca800fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:17.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.546+0000 7fca852d1640 1 --2- 172.21.15.107:0/1130808568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca800fcf80 0x7fca800fd3d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fca740048d0 tx=0x7fca74009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:17.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.546+0000 7fca852d1640 1 -- 172.21.15.107:0/1130808568 shutdown_connections 2024-09-21T07:59:17.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.546+0000 7fca852d1640 1 --2- 172.21.15.107:0/1130808568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca800fcf80 0x7fca800fd3d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:17.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.546+0000 7fca852d1640 1 --2- 172.21.15.107:0/1130808568 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca800fb810 0x7fca800fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:17.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.546+0000 7fca852d1640 1 -- 172.21.15.107:0/1130808568 >> 172.21.15.107:0/1130808568 conn(0x7fca800723b0 msgr2=0x7fca800727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:17.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.546+0000 7fca852d1640 1 -- 172.21.15.107:0/1130808568 shutdown_connections 2024-09-21T07:59:17.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.546+0000 7fca852d1640 1 -- 172.21.15.107:0/1130808568 wait complete. 2024-09-21T07:59:17.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.547+0000 7fca852d1640 1 Processor -- start 2024-09-21T07:59:17.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.547+0000 7fca852d1640 1 -- start start 2024-09-21T07:59:17.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.547+0000 7fca852d1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca800fb810 0x7fca8010bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:17.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.547+0000 7fca852d1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca800fcf80 0x7fca8010c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:17.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.547+0000 7fca852d1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8010c9e0 con 0x7fca800fcf80 2024-09-21T07:59:17.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.547+0000 7fca852d1640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8010cb20 con 0x7fca800fb810 2024-09-21T07:59:17.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.547+0000 7fca7e7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca800fcf80 0x7fca8010c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:17.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.547+0000 7fca7e7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca800fcf80 0x7fca8010c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47556/0 (socket says 172.21.15.107:47556) 2024-09-21T07:59:17.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.547+0000 7fca7e7fc640 1 -- 172.21.15.107:0/1688071684 learned_addr learned my addr 172.21.15.107:0/1688071684 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:17.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.547+0000 7fca7effd640 1 --2- 172.21.15.107:0/1688071684 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca800fb810 0x7fca8010bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:17.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.547+0000 7fca7e7fc640 1 -- 172.21.15.107:0/1688071684 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca800fb810 msgr2=0x7fca8010bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:17.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.547+0000 7fca7e7fc640 1 --2- 172.21.15.107:0/1688071684 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca800fb810 0x7fca8010bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:17.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.547+0000 7fca7e7fc640 1 -- 172.21.15.107:0/1688071684 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca74005040 con 0x7fca800fcf80 2024-09-21T07:59:17.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.547+0000 7fca7e7fc640 1 --2- 172.21.15.107:0/1688071684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca800fcf80 0x7fca8010c4a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fca74000c00 tx=0x7fca74009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:17.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.547+0000 7fca677fe640 1 -- 172.21.15.107:0/1688071684 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca74038070 con 0x7fca800fcf80 2024-09-21T07:59:17.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.547+0000 7fca677fe640 1 -- 172.21.15.107:0/1688071684 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fca7402ade0 con 0x7fca800fcf80 2024-09-21T07:59:17.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.548+0000 7fca852d1640 1 -- 172.21.15.107:0/1688071684 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8010cda0 con 0x7fca800fcf80 2024-09-21T07:59:17.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.548+0000 7fca677fe640 1 -- 172.21.15.107:0/1688071684 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca7402c7b0 con 0x7fca800fcf80 2024-09-21T07:59:17.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.548+0000 7fca852d1640 1 -- 172.21.15.107:0/1688071684 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca801198a0 con 0x7fca800fcf80 2024-09-21T07:59:17.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.548+0000 7fca852d1640 1 -- 172.21.15.107:0/1688071684 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fca800fae90 con 0x7fca800fcf80 2024-09-21T07:59:17.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.549+0000 7fca677fe640 1 -- 172.21.15.107:0/1688071684 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fca74030020 con 0x7fca800fcf80 2024-09-21T07:59:17.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.549+0000 7fca677fe640 1 --2- 172.21.15.107:0/1688071684 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fca6806ed60 0x7fca68071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:17.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.549+0000 7fca7effd640 1 --2- 172.21.15.107:0/1688071684 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fca6806ed60 0x7fca68071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:17.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.549+0000 7fca677fe640 1 -- 172.21.15.107:0/1688071684 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fca740ae170 con 0x7fca800fcf80 2024-09-21T07:59:17.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.550+0000 7fca677fe640 1 --2- 172.21.15.107:0/1688071684 >> [v2:172.21.15.129:6800/1110660771,v1:172.21.15.129:6801/1110660771] conn(0x7fca68074ae0 0x7fca68076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:17.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.550+0000 7fca677fe640 1 -- 172.21.15.107:0/1688071684 --> [v2:172.21.15.129:6800/1110660771,v1:172.21.15.129:6801/1110660771] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca680775a0 con 0x7fca68074ae0 2024-09-21T07:59:17.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.550+0000 7fca677fe640 1 -- 172.21.15.107:0/1688071684 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca740b0760 con 0x7fca800fcf80 2024-09-21T07:59:17.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.550+0000 7fca7effd640 1 --2- 172.21.15.107:0/1688071684 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fca6806ed60 0x7fca68071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca70009af0 tx=0x7fca7000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:17.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.550+0000 7fca7f7fe640 1 --2- 172.21.15.107:0/1688071684 >> [v2:172.21.15.129:6800/1110660771,v1:172.21.15.129:6801/1110660771] conn(0x7fca68074ae0 0x7fca68076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:17.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.550+0000 7fca7f7fe640 1 --2- 172.21.15.107:0/1688071684 >> [v2:172.21.15.129:6800/1110660771,v1:172.21.15.129:6801/1110660771] conn(0x7fca68074ae0 0x7fca68076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:17.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.551+0000 7fca677fe640 1 -- 172.21.15.107:0/1688071684 <== osd.3 v2:172.21.15.129:6800/1110660771 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fca680775a0 con 0x7fca68074ae0 2024-09-21T07:59:17.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.563+0000 7fca852d1640 1 -- 172.21.15.107:0/1688071684 --> [v2:172.21.15.129:6800/1110660771,v1:172.21.15.129:6801/1110660771] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fca800fcbc0 con 0x7fca68074ae0 2024-09-21T07:59:17.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.564+0000 7fca677fe640 1 -- 172.21.15.107:0/1688071684 <== osd.3 v2:172.21.15.129:6800/1110660771 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fca800fcbc0 con 0x7fca68074ae0 2024-09-21T07:59:17.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.564+0000 7fca852d1640 1 -- 172.21.15.107:0/1688071684 >> [v2:172.21.15.129:6800/1110660771,v1:172.21.15.129:6801/1110660771] conn(0x7fca68074ae0 msgr2=0x7fca68076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:17.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.564+0000 7fca852d1640 1 --2- 172.21.15.107:0/1688071684 >> [v2:172.21.15.129:6800/1110660771,v1:172.21.15.129:6801/1110660771] conn(0x7fca68074ae0 0x7fca68076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:17.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.564+0000 7fca852d1640 1 -- 172.21.15.107:0/1688071684 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fca6806ed60 msgr2=0x7fca68071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:17.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.564+0000 7fca852d1640 1 --2- 172.21.15.107:0/1688071684 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fca6806ed60 0x7fca68071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca70009af0 tx=0x7fca7000b040 comp rx=0 tx=0).stop 2024-09-21T07:59:17.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.564+0000 7fca852d1640 1 -- 172.21.15.107:0/1688071684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca800fcf80 msgr2=0x7fca8010c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:17.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.564+0000 7fca852d1640 1 --2- 172.21.15.107:0/1688071684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca800fcf80 0x7fca8010c4a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fca74000c00 tx=0x7fca74009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:17.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.564+0000 7fca852d1640 1 -- 172.21.15.107:0/1688071684 shutdown_connections 2024-09-21T07:59:17.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.564+0000 7fca852d1640 1 --2- 172.21.15.107:0/1688071684 >> [v2:172.21.15.129:6800/1110660771,v1:172.21.15.129:6801/1110660771] conn(0x7fca68074ae0 0x7fca68076ef0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:17.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.564+0000 7fca852d1640 1 --2- 172.21.15.107:0/1688071684 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fca6806ed60 0x7fca68071210 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:17.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.564+0000 7fca852d1640 1 --2- 172.21.15.107:0/1688071684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca800fcf80 0x7fca8010c4a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:17.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.564+0000 7fca852d1640 1 --2- 172.21.15.107:0/1688071684 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca800fb810 0x7fca8010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:17.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.564+0000 7fca852d1640 1 -- 172.21.15.107:0/1688071684 >> 172.21.15.107:0/1688071684 conn(0x7fca800723b0 msgr2=0x7fca800fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:17.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.564+0000 7fca852d1640 1 -- 172.21.15.107:0/1688071684 shutdown_connections 2024-09-21T07:59:17.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.564+0000 7fca852d1640 1 -- 172.21.15.107:0/1688071684 wait complete. 2024-09-21T07:59:17.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.977+0000 7fc97b2c7640 1 -- 172.21.15.107:0/3696652242 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc974102ef0 msgr2=0x7fc9740fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:17.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.977+0000 7fc97b2c7640 1 --2- 172.21.15.107:0/3696652242 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc974102ef0 0x7fc9740fc5b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc9640048d0 tx=0x7fc964009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:17.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.977+0000 7fc97b2c7640 1 -- 172.21.15.107:0/3696652242 shutdown_connections 2024-09-21T07:59:17.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.977+0000 7fc97b2c7640 1 --2- 172.21.15.107:0/3696652242 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc974102ef0 0x7fc9740fc5b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:17.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.977+0000 7fc97b2c7640 1 --2- 172.21.15.107:0/3696652242 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc974102550 0x7fc974102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:17.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.977+0000 7fc97b2c7640 1 -- 172.21.15.107:0/3696652242 >> 172.21.15.107:0/3696652242 conn(0x7fc9740f80f0 msgr2=0x7fc9740fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:17.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.977+0000 7fc97b2c7640 1 -- 172.21.15.107:0/3696652242 shutdown_connections 2024-09-21T07:59:17.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.977+0000 7fc97b2c7640 1 -- 172.21.15.107:0/3696652242 wait complete. 2024-09-21T07:59:17.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.978+0000 7fc97b2c7640 1 Processor -- start 2024-09-21T07:59:17.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.978+0000 7fc97b2c7640 1 -- start start 2024-09-21T07:59:17.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.978+0000 7fc97b2c7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc974102550 0x7fc974113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:17.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.978+0000 7fc97b2c7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc974102ef0 0x7fc974113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:17.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.978+0000 7fc97b2c7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9741140b0 con 0x7fc974102550 2024-09-21T07:59:17.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.978+0000 7fc97b2c7640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97410d4c0 con 0x7fc974102ef0 2024-09-21T07:59:17.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.979+0000 7fc979063640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc974102550 0x7fc974113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:17.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.979+0000 7fc979063640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc974102550 0x7fc974113520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47568/0 (socket says 172.21.15.107:47568) 2024-09-21T07:59:17.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.979+0000 7fc979063640 1 -- 172.21.15.107:0/2726696043 learned_addr learned my addr 172.21.15.107:0/2726696043 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:17.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.979+0000 7fc978862640 1 --2- 172.21.15.107:0/2726696043 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc974102ef0 0x7fc974113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:17.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.979+0000 7fc979063640 1 -- 172.21.15.107:0/2726696043 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc974102ef0 msgr2=0x7fc974113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:17.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.979+0000 7fc979063640 1 --2- 172.21.15.107:0/2726696043 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc974102ef0 0x7fc974113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:17.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.979+0000 7fc979063640 1 -- 172.21.15.107:0/2726696043 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc964005040 con 0x7fc974102550 2024-09-21T07:59:17.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.979+0000 7fc979063640 1 --2- 172.21.15.107:0/2726696043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc974102550 0x7fc974113520 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc97000c790 tx=0x7fc9700043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:17.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.980+0000 7fc969ffb640 1 -- 172.21.15.107:0/2726696043 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc97000a820 con 0x7fc974102550 2024-09-21T07:59:17.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.980+0000 7fc969ffb640 1 -- 172.21.15.107:0/2726696043 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc97000ae20 con 0x7fc974102550 2024-09-21T07:59:17.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.980+0000 7fc97b2c7640 1 -- 172.21.15.107:0/2726696043 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97410d7a0 con 0x7fc974102550 2024-09-21T07:59:17.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.980+0000 7fc969ffb640 1 -- 172.21.15.107:0/2726696043 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9700113a0 con 0x7fc974102550 2024-09-21T07:59:17.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.980+0000 7fc97b2c7640 1 -- 172.21.15.107:0/2726696043 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97410dd10 con 0x7fc974102550 2024-09-21T07:59:17.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.981+0000 7fc97b2c7640 1 -- 172.21.15.107:0/2726696043 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc9740fdcd0 con 0x7fc974102550 2024-09-21T07:59:17.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.981+0000 7fc969ffb640 1 -- 172.21.15.107:0/2726696043 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fc970012400 con 0x7fc974102550 2024-09-21T07:59:17.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.982+0000 7fc969ffb640 1 --2- 172.21.15.107:0/2726696043 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fc96006ed60 0x7fc960071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:17.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.982+0000 7fc969ffb640 1 -- 172.21.15.107:0/2726696043 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc97008def0 con 0x7fc974102550 2024-09-21T07:59:17.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.982+0000 7fc978862640 1 --2- 172.21.15.107:0/2726696043 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fc96006ed60 0x7fc960071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:17.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.982+0000 7fc969ffb640 1 --2- 172.21.15.107:0/2726696043 >> [v2:172.21.15.107:6802/373234429,v1:172.21.15.107:6803/373234429] conn(0x7fc960074ae0 0x7fc960076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:17.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.982+0000 7fc969ffb640 1 -- 172.21.15.107:0/2726696043 --> [v2:172.21.15.107:6802/373234429,v1:172.21.15.107:6803/373234429] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc9600775a0 con 0x7fc960074ae0 2024-09-21T07:59:17.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.982+0000 7fc969ffb640 1 -- 172.21.15.107:0/2726696043 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc970090560 con 0x7fc974102550 2024-09-21T07:59:17.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.982+0000 7fc979864640 1 --2- 172.21.15.107:0/2726696043 >> [v2:172.21.15.107:6802/373234429,v1:172.21.15.107:6803/373234429] conn(0x7fc960074ae0 0x7fc960076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:17.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.982+0000 7fc978862640 1 --2- 172.21.15.107:0/2726696043 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fc96006ed60 0x7fc960071210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc964000c00 tx=0x7fc964035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:17.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.983+0000 7fc979864640 1 --2- 172.21.15.107:0/2726696043 >> [v2:172.21.15.107:6802/373234429,v1:172.21.15.107:6803/373234429] conn(0x7fc960074ae0 0x7fc960076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:17.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.983+0000 7fc969ffb640 1 -- 172.21.15.107:0/2726696043 <== osd.0 v2:172.21.15.107:6802/373234429 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fc9600775a0 con 0x7fc960074ae0 2024-09-21T07:59:17.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.997+0000 7fc97b2c7640 1 -- 172.21.15.107:0/2726696043 --> [v2:172.21.15.107:6802/373234429,v1:172.21.15.107:6803/373234429] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc9740fbd50 con 0x7fc960074ae0 2024-09-21T07:59:17.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.997+0000 7fc969ffb640 1 -- 172.21.15.107:0/2726696043 <== osd.0 v2:172.21.15.107:6802/373234429 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc9740fbd50 con 0x7fc960074ae0 2024-09-21T07:59:18.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.997+0000 7fc97b2c7640 1 -- 172.21.15.107:0/2726696043 >> [v2:172.21.15.107:6802/373234429,v1:172.21.15.107:6803/373234429] conn(0x7fc960074ae0 msgr2=0x7fc960076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:18.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.997+0000 7fc97b2c7640 1 --2- 172.21.15.107:0/2726696043 >> [v2:172.21.15.107:6802/373234429,v1:172.21.15.107:6803/373234429] conn(0x7fc960074ae0 0x7fc960076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.998+0000 7fc97b2c7640 1 -- 172.21.15.107:0/2726696043 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fc96006ed60 msgr2=0x7fc960071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:18.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.998+0000 7fc97b2c7640 1 --2- 172.21.15.107:0/2726696043 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fc96006ed60 0x7fc960071210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc964000c00 tx=0x7fc964035040 comp rx=0 tx=0).stop 2024-09-21T07:59:18.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.998+0000 7fc97b2c7640 1 -- 172.21.15.107:0/2726696043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc974102550 msgr2=0x7fc974113520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:18.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.998+0000 7fc97b2c7640 1 --2- 172.21.15.107:0/2726696043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc974102550 0x7fc974113520 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc97000c790 tx=0x7fc9700043c0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.998+0000 7fc97b2c7640 1 -- 172.21.15.107:0/2726696043 shutdown_connections 2024-09-21T07:59:18.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.998+0000 7fc97b2c7640 1 --2- 172.21.15.107:0/2726696043 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc974102ef0 0x7fc974113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.998+0000 7fc97b2c7640 1 --2- 172.21.15.107:0/2726696043 >> [v2:172.21.15.107:6802/373234429,v1:172.21.15.107:6803/373234429] conn(0x7fc960074ae0 0x7fc960076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.998+0000 7fc97b2c7640 1 --2- 172.21.15.107:0/2726696043 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fc96006ed60 0x7fc960071210 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.998+0000 7fc97b2c7640 1 --2- 172.21.15.107:0/2726696043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc974102550 0x7fc974113520 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.998+0000 7fc97b2c7640 1 -- 172.21.15.107:0/2726696043 >> 172.21.15.107:0/2726696043 conn(0x7fc9740f80f0 msgr2=0x7fc9740f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:18.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.998+0000 7fc97b2c7640 1 -- 172.21.15.107:0/2726696043 shutdown_connections 2024-09-21T07:59:18.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.998+0000 7fc97b2c7640 1 -- 172.21.15.107:0/2726696043 wait complete. 2024-09-21T07:59:18.081 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:17 smithi107 ceph-mon[27622]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:18.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:17 smithi129 ceph-mon[34472]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:18.819 INFO:teuthology.orchestra.run.smithi107.stdout:38654705699 2024-09-21T07:59:18.819 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T07:59:18.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.443+0000 7f04d7542640 1 -- 172.21.15.107:0/112904953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d0102530 msgr2=0x7f04d0102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:18.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.443+0000 7f04d7542640 1 --2- 172.21.15.107:0/112904953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d0102530 0x7f04d0102900 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0048d0 tx=0x7f04cc009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.443+0000 7f04d7542640 1 -- 172.21.15.107:0/112904953 shutdown_connections 2024-09-21T07:59:18.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.443+0000 7f04d7542640 1 --2- 172.21.15.107:0/112904953 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f04d0102ed0 0x7f04d00fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.443+0000 7f04d7542640 1 --2- 172.21.15.107:0/112904953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d0102530 0x7f04d0102900 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.443+0000 7f04d7542640 1 -- 172.21.15.107:0/112904953 >> 172.21.15.107:0/112904953 conn(0x7f04d00f8110 msgr2=0x7f04d00fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:18.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.443+0000 7f04d7542640 1 -- 172.21.15.107:0/112904953 shutdown_connections 2024-09-21T07:59:18.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.443+0000 7f04d7542640 1 -- 172.21.15.107:0/112904953 wait complete. 2024-09-21T07:59:18.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.443+0000 7f04d7542640 1 Processor -- start 2024-09-21T07:59:18.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.443+0000 7f04d7542640 1 -- start start 2024-09-21T07:59:18.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.444+0000 7f04d7542640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d0102530 0x7f04d0113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.444+0000 7f04d7542640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f04d0102ed0 0x7f04d0113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.444+0000 7f04d7542640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d0113d50 con 0x7f04d0102530 2024-09-21T07:59:18.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.444+0000 7f04d7542640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d010d190 con 0x7f04d0102ed0 2024-09-21T07:59:18.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.444+0000 7f04d52de640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d0102530 0x7f04d0113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:18.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.444+0000 7f04d52de640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d0102530 0x7f04d0113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47524/0 (socket says 172.21.15.107:47524) 2024-09-21T07:59:18.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.444+0000 7f04d52de640 1 -- 172.21.15.107:0/3459496245 learned_addr learned my addr 172.21.15.107:0/3459496245 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:18.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.444+0000 7f04d52de640 1 -- 172.21.15.107:0/3459496245 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f04d0102ed0 msgr2=0x7f04d0113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:18.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.444+0000 7f04d4add640 1 --2- 172.21.15.107:0/3459496245 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f04d0102ed0 0x7f04d0113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:18.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.444+0000 7f04d52de640 1 --2- 172.21.15.107:0/3459496245 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f04d0102ed0 0x7f04d0113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.444+0000 7f04d52de640 1 -- 172.21.15.107:0/3459496245 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc005040 con 0x7f04d0102530 2024-09-21T07:59:18.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.444+0000 7f04d52de640 1 --2- 172.21.15.107:0/3459496245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d0102530 0x7f04d0113210 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f04cc003080 tx=0x7f04cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:18.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.444+0000 7f04c5ffb640 1 -- 172.21.15.107:0/3459496245 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04cc038070 con 0x7f04d0102530 2024-09-21T07:59:18.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.444+0000 7f04c5ffb640 1 -- 172.21.15.107:0/3459496245 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f04cc0097e0 con 0x7f04d0102530 2024-09-21T07:59:18.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.444+0000 7f04d7542640 1 -- 172.21.15.107:0/3459496245 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d010d410 con 0x7f04d0102530 2024-09-21T07:59:18.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.444+0000 7f04c5ffb640 1 -- 172.21.15.107:0/3459496245 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04cc03d420 con 0x7f04d0102530 2024-09-21T07:59:18.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.445+0000 7f04d7542640 1 -- 172.21.15.107:0/3459496245 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d010d950 con 0x7f04d0102530 2024-09-21T07:59:18.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.445+0000 7f04d7542640 1 -- 172.21.15.107:0/3459496245 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f04d010de30 con 0x7f04d0102530 2024-09-21T07:59:18.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.446+0000 7f04c5ffb640 1 -- 172.21.15.107:0/3459496245 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f04cc030020 con 0x7f04d0102530 2024-09-21T07:59:18.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.446+0000 7f04c5ffb640 1 --2- 172.21.15.107:0/3459496245 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f04bc06ed60 0x7f04bc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.446+0000 7f04d4add640 1 --2- 172.21.15.107:0/3459496245 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f04bc06ed60 0x7f04bc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:18.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.446+0000 7f04c5ffb640 1 -- 172.21.15.107:0/3459496245 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f04cc0ae470 con 0x7f04d0102530 2024-09-21T07:59:18.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.447+0000 7f04c5ffb640 1 --2- 172.21.15.107:0/3459496245 >> [v2:172.21.15.107:6818/2268135286,v1:172.21.15.107:6819/2268135286] conn(0x7f04bc074ae0 0x7f04bc076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.447+0000 7f04c5ffb640 1 -- 172.21.15.107:0/3459496245 --> [v2:172.21.15.107:6818/2268135286,v1:172.21.15.107:6819/2268135286] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f04bc0775a0 con 0x7f04bc074ae0 2024-09-21T07:59:18.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.447+0000 7f04c5ffb640 1 -- 172.21.15.107:0/3459496245 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04cc0b0a60 con 0x7f04d0102530 2024-09-21T07:59:18.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.447+0000 7f04d5adf640 1 --2- 172.21.15.107:0/3459496245 >> [v2:172.21.15.107:6818/2268135286,v1:172.21.15.107:6819/2268135286] conn(0x7f04bc074ae0 0x7f04bc076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:18.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.447+0000 7f04d4add640 1 --2- 172.21.15.107:0/3459496245 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f04bc06ed60 0x7f04bc071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f04c0007fd0 tx=0x7f04c0009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:18.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.447+0000 7f04d5adf640 1 --2- 172.21.15.107:0/3459496245 >> [v2:172.21.15.107:6818/2268135286,v1:172.21.15.107:6819/2268135286] conn(0x7f04bc074ae0 0x7f04bc076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:18.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.448+0000 7f04c5ffb640 1 -- 172.21.15.107:0/3459496245 <== osd.2 v2:172.21.15.107:6818/2268135286 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f04bc0775a0 con 0x7f04bc074ae0 2024-09-21T07:59:18.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.460+0000 7f04d7542640 1 -- 172.21.15.107:0/3459496245 --> [v2:172.21.15.107:6818/2268135286,v1:172.21.15.107:6819/2268135286] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f04d010dff0 con 0x7f04bc074ae0 2024-09-21T07:59:18.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.460+0000 7f04c5ffb640 1 -- 172.21.15.107:0/3459496245 <== osd.2 v2:172.21.15.107:6818/2268135286 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f04d010dff0 con 0x7f04bc074ae0 2024-09-21T07:59:18.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.460+0000 7f04d7542640 1 -- 172.21.15.107:0/3459496245 >> [v2:172.21.15.107:6818/2268135286,v1:172.21.15.107:6819/2268135286] conn(0x7f04bc074ae0 msgr2=0x7f04bc076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:18.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.460+0000 7f04d7542640 1 --2- 172.21.15.107:0/3459496245 >> [v2:172.21.15.107:6818/2268135286,v1:172.21.15.107:6819/2268135286] conn(0x7f04bc074ae0 0x7f04bc076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.461+0000 7f04d7542640 1 -- 172.21.15.107:0/3459496245 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f04bc06ed60 msgr2=0x7f04bc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:18.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.461+0000 7f04d7542640 1 --2- 172.21.15.107:0/3459496245 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f04bc06ed60 0x7f04bc071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f04c0007fd0 tx=0x7f04c0009040 comp rx=0 tx=0).stop 2024-09-21T07:59:18.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.461+0000 7f04d7542640 1 -- 172.21.15.107:0/3459496245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d0102530 msgr2=0x7f04d0113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:18.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.461+0000 7f04d7542640 1 --2- 172.21.15.107:0/3459496245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d0102530 0x7f04d0113210 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f04cc003080 tx=0x7f04cc009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.461+0000 7f04d7542640 1 -- 172.21.15.107:0/3459496245 shutdown_connections 2024-09-21T07:59:18.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.461+0000 7f04d7542640 1 --2- 172.21.15.107:0/3459496245 >> [v2:172.21.15.107:6818/2268135286,v1:172.21.15.107:6819/2268135286] conn(0x7f04bc074ae0 0x7f04bc076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.461+0000 7f04d7542640 1 --2- 172.21.15.107:0/3459496245 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f04d0102ed0 0x7f04d0113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.461+0000 7f04d7542640 1 --2- 172.21.15.107:0/3459496245 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f04bc06ed60 0x7f04bc071210 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.461+0000 7f04d7542640 1 --2- 172.21.15.107:0/3459496245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d0102530 0x7f04d0113210 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.461+0000 7f04d7542640 1 -- 172.21.15.107:0/3459496245 >> 172.21.15.107:0/3459496245 conn(0x7f04d00f8110 msgr2=0x7f04d00f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:18.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.461+0000 7f04d7542640 1 -- 172.21.15.107:0/3459496245 shutdown_connections 2024-09-21T07:59:18.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:17.461+0000 7f04d7542640 1 -- 172.21.15.107:0/3459496245 wait complete. 2024-09-21T07:59:19.594 INFO:teuthology.orchestra.run.smithi107.stdout:81604378648 2024-09-21T07:59:19.595 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T07:59:19.824 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:19 smithi107 ceph-mon[27622]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:20.121 INFO:teuthology.orchestra.run.smithi107.stdout:111669149716 2024-09-21T07:59:20.122 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T07:59:20.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:19 smithi129 ceph-mon[34472]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:20.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.801+0000 7f853b846640 1 -- 172.21.15.107:0/1720133146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8534102ed0 msgr2=0x7f85340fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:20.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.801+0000 7f853b846640 1 --2- 172.21.15.107:0/1720133146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8534102ed0 0x7f85340fc590 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f85240048d0 tx=0x7f8524009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:20.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.801+0000 7f853b846640 1 -- 172.21.15.107:0/1720133146 shutdown_connections 2024-09-21T07:59:20.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.801+0000 7f853b846640 1 --2- 172.21.15.107:0/1720133146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8534102ed0 0x7f85340fc590 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:20.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.801+0000 7f853b846640 1 --2- 172.21.15.107:0/1720133146 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8534102530 0x7f8534102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:20.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.802+0000 7f853b846640 1 -- 172.21.15.107:0/1720133146 >> 172.21.15.107:0/1720133146 conn(0x7f85340f8110 msgr2=0x7f85340fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:20.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.802+0000 7f853b846640 1 -- 172.21.15.107:0/1720133146 shutdown_connections 2024-09-21T07:59:20.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.802+0000 7f853b846640 1 -- 172.21.15.107:0/1720133146 wait complete. 2024-09-21T07:59:20.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.803+0000 7f853b846640 1 Processor -- start 2024-09-21T07:59:20.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.803+0000 7f853b846640 1 -- start start 2024-09-21T07:59:20.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.803+0000 7f853b846640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8534102530 0x7f85341131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:20.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.803+0000 7f853b846640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8534102ed0 0x7f8534113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:20.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.803+0000 7f853b846640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8534113d30 con 0x7f8534102530 2024-09-21T07:59:20.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.803+0000 7f853b846640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853410d170 con 0x7f8534102ed0 2024-09-21T07:59:20.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.803+0000 7f85395e2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8534102530 0x7f85341131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:20.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.803+0000 7f85395e2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8534102530 0x7f85341131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47572/0 (socket says 172.21.15.107:47572) 2024-09-21T07:59:20.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.803+0000 7f85395e2640 1 -- 172.21.15.107:0/3581157269 learned_addr learned my addr 172.21.15.107:0/3581157269 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:20.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.803+0000 7f85395e2640 1 -- 172.21.15.107:0/3581157269 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8534102ed0 msgr2=0x7f8534113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:20.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.803+0000 7f85395e2640 1 --2- 172.21.15.107:0/3581157269 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8534102ed0 0x7f8534113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:20.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.803+0000 7f85395e2640 1 -- 172.21.15.107:0/3581157269 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8524005040 con 0x7f8534102530 2024-09-21T07:59:20.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.804+0000 7f85395e2640 1 --2- 172.21.15.107:0/3581157269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8534102530 0x7f85341131f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f853000c830 tx=0x7f8530004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:20.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.804+0000 7f8529ffb640 1 -- 172.21.15.107:0/3581157269 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f853000a850 con 0x7f8534102530 2024-09-21T07:59:20.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.804+0000 7f853b846640 1 -- 172.21.15.107:0/3581157269 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f853410d450 con 0x7f8534102530 2024-09-21T07:59:20.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.804+0000 7f8529ffb640 1 -- 172.21.15.107:0/3581157269 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f853000ae50 con 0x7f8534102530 2024-09-21T07:59:20.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.804+0000 7f8529ffb640 1 -- 172.21.15.107:0/3581157269 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85300113a0 con 0x7f8534102530 2024-09-21T07:59:20.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.804+0000 7f853b846640 1 -- 172.21.15.107:0/3581157269 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853410d9f0 con 0x7f8534102530 2024-09-21T07:59:20.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.805+0000 7f853b846640 1 -- 172.21.15.107:0/3581157269 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f853410df30 con 0x7f8534102530 2024-09-21T07:59:20.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.805+0000 7f8529ffb640 1 -- 172.21.15.107:0/3581157269 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f8530012400 con 0x7f8534102530 2024-09-21T07:59:20.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.806+0000 7f8529ffb640 1 --2- 172.21.15.107:0/3581157269 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f852006ed60 0x7f8520071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:20.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.806+0000 7f8529ffb640 1 -- 172.21.15.107:0/3581157269 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f853008e040 con 0x7f8534102530 2024-09-21T07:59:20.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.806+0000 7f8538de1640 1 --2- 172.21.15.107:0/3581157269 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f852006ed60 0x7f8520071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:20.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.806+0000 7f8529ffb640 1 --2- 172.21.15.107:0/3581157269 >> [v2:172.21.15.129:6808/431008109,v1:172.21.15.129:6809/431008109] conn(0x7f8520074ae0 0x7f8520076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:20.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.806+0000 7f8529ffb640 1 -- 172.21.15.107:0/3581157269 --> [v2:172.21.15.129:6808/431008109,v1:172.21.15.129:6809/431008109] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f85200775a0 con 0x7f8520074ae0 2024-09-21T07:59:20.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.806+0000 7f8529ffb640 1 -- 172.21.15.107:0/3581157269 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8530090690 con 0x7f8534102530 2024-09-21T07:59:20.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.806+0000 7f8538de1640 1 --2- 172.21.15.107:0/3581157269 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f852006ed60 0x7f8520071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8524009ac0 tx=0x7f8524009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:20.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.806+0000 7f8539de3640 1 --2- 172.21.15.107:0/3581157269 >> [v2:172.21.15.129:6808/431008109,v1:172.21.15.129:6809/431008109] conn(0x7f8520074ae0 0x7f8520076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:20.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.807+0000 7f8539de3640 1 --2- 172.21.15.107:0/3581157269 >> [v2:172.21.15.129:6808/431008109,v1:172.21.15.129:6809/431008109] conn(0x7f8520074ae0 0x7f8520076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:20.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.808+0000 7f8529ffb640 1 -- 172.21.15.107:0/3581157269 <== osd.4 v2:172.21.15.129:6808/431008109 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f85200775a0 con 0x7f8520074ae0 2024-09-21T07:59:20.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.823+0000 7f853b846640 1 -- 172.21.15.107:0/3581157269 --> [v2:172.21.15.129:6808/431008109,v1:172.21.15.129:6809/431008109] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f85340f9b70 con 0x7f8520074ae0 2024-09-21T07:59:20.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.823+0000 7f8529ffb640 1 -- 172.21.15.107:0/3581157269 <== osd.4 v2:172.21.15.129:6808/431008109 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f85340f9b70 con 0x7f8520074ae0 2024-09-21T07:59:20.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.823+0000 7f853b846640 1 -- 172.21.15.107:0/3581157269 >> [v2:172.21.15.129:6808/431008109,v1:172.21.15.129:6809/431008109] conn(0x7f8520074ae0 msgr2=0x7f8520076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:20.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.823+0000 7f853b846640 1 --2- 172.21.15.107:0/3581157269 >> [v2:172.21.15.129:6808/431008109,v1:172.21.15.129:6809/431008109] conn(0x7f8520074ae0 0x7f8520076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:20.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.823+0000 7f853b846640 1 -- 172.21.15.107:0/3581157269 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f852006ed60 msgr2=0x7f8520071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:20.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.823+0000 7f853b846640 1 --2- 172.21.15.107:0/3581157269 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f852006ed60 0x7f8520071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8524009ac0 tx=0x7f8524009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:20.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.823+0000 7f853b846640 1 -- 172.21.15.107:0/3581157269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8534102530 msgr2=0x7f85341131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:20.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.823+0000 7f853b846640 1 --2- 172.21.15.107:0/3581157269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8534102530 0x7f85341131f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f853000c830 tx=0x7f8530004430 comp rx=0 tx=0).stop 2024-09-21T07:59:20.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.824+0000 7f853b846640 1 -- 172.21.15.107:0/3581157269 shutdown_connections 2024-09-21T07:59:20.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.824+0000 7f853b846640 1 --2- 172.21.15.107:0/3581157269 >> [v2:172.21.15.129:6808/431008109,v1:172.21.15.129:6809/431008109] conn(0x7f8520074ae0 0x7f8520076ef0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:20.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.824+0000 7f853b846640 1 --2- 172.21.15.107:0/3581157269 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8534102ed0 0x7f8534113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:20.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.824+0000 7f853b846640 1 --2- 172.21.15.107:0/3581157269 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f852006ed60 0x7f8520071210 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:20.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.824+0000 7f853b846640 1 --2- 172.21.15.107:0/3581157269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8534102530 0x7f85341131f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:20.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.824+0000 7f853b846640 1 -- 172.21.15.107:0/3581157269 >> 172.21.15.107:0/3581157269 conn(0x7f85340f8110 msgr2=0x7f85340f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:20.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.824+0000 7f853b846640 1 -- 172.21.15.107:0/3581157269 shutdown_connections 2024-09-21T07:59:20.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:19.824+0000 7f853b846640 1 -- 172.21.15.107:0/3581157269 wait complete. 2024-09-21T07:59:20.595 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:21.009 INFO:teuthology.orchestra.run.smithi107.stdout:137438953487 2024-09-21T07:59:21.010 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T07:59:21.043 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:21.068 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:22.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:21 smithi107 ceph-mon[27622]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:22.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:21 smithi129 ceph-mon[34472]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:22.407 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:22.408 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:23.277 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:24.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:23 smithi107 ceph-mon[27622]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:24.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:23 smithi129 ceph-mon[34472]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:24.983 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:59:25.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:24 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:59:26.183 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:25 smithi107 ceph-mon[27622]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:26.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:25 smithi129 ceph-mon[34472]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:27.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.364+0000 7f42a1064640 1 -- 172.21.15.107:0/3161236092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f429c0fb4b0 msgr2=0x7f429c0fb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:27.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.364+0000 7f42a1064640 1 --2- 172.21.15.107:0/3161236092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f429c0fb4b0 0x7f429c0fb920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f42840048d0 tx=0x7f4284009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.364+0000 7f42a1064640 1 -- 172.21.15.107:0/3161236092 shutdown_connections 2024-09-21T07:59:27.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.364+0000 7f42a1064640 1 --2- 172.21.15.107:0/3161236092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f429c0fb4b0 0x7f429c0fb920 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.364+0000 7f42a1064640 1 --2- 172.21.15.107:0/3161236092 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f429c1014f0 0x7f429c1018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.364+0000 7f42a1064640 1 -- 172.21.15.107:0/3161236092 >> 172.21.15.107:0/3161236092 conn(0x7f429c0f7030 msgr2=0x7f429c0f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:27.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.364+0000 7f42a1064640 1 -- 172.21.15.107:0/3161236092 shutdown_connections 2024-09-21T07:59:27.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.364+0000 7f42a1064640 1 -- 172.21.15.107:0/3161236092 wait complete. 2024-09-21T07:59:27.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.365+0000 7f42a1064640 1 Processor -- start 2024-09-21T07:59:27.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.365+0000 7f42a1064640 1 -- start start 2024-09-21T07:59:27.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.365+0000 7f42a1064640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f429c0fb4b0 0x7f429c10e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.365+0000 7f42a1064640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f429c1014f0 0x7f429c10e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.365+0000 7f42a1064640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c10ee10 con 0x7f429c1014f0 2024-09-21T07:59:27.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.365+0000 7f42a1064640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c10ef80 con 0x7f429c0fb4b0 2024-09-21T07:59:27.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.365+0000 7f429a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f429c1014f0 0x7f429c10e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.365+0000 7f429a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f429c1014f0 0x7f429c10e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45580/0 (socket says 172.21.15.107:45580) 2024-09-21T07:59:27.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.365+0000 7f429a59c640 1 -- 172.21.15.107:0/1325926683 learned_addr learned my addr 172.21.15.107:0/1325926683 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:27.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.365+0000 7f429a59c640 1 -- 172.21.15.107:0/1325926683 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f429c0fb4b0 msgr2=0x7f429c10e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:27.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.365+0000 7f429ad9d640 1 --2- 172.21.15.107:0/1325926683 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f429c0fb4b0 0x7f429c10e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.365+0000 7f429a59c640 1 --2- 172.21.15.107:0/1325926683 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f429c0fb4b0 0x7f429c10e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.365+0000 7f429a59c640 1 -- 172.21.15.107:0/1325926683 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4284005040 con 0x7f429c1014f0 2024-09-21T07:59:27.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.366+0000 7f429a59c640 1 --2- 172.21.15.107:0/1325926683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f429c1014f0 0x7f429c10e730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4284003080 tx=0x7f4284009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:27.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.366+0000 7f42937fe640 1 -- 172.21.15.107:0/1325926683 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4284038070 con 0x7f429c1014f0 2024-09-21T07:59:27.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.366+0000 7f42a1064640 1 -- 172.21.15.107:0/1325926683 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429c117260 con 0x7f429c1014f0 2024-09-21T07:59:27.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.366+0000 7f42937fe640 1 -- 172.21.15.107:0/1325926683 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f428402ade0 con 0x7f429c1014f0 2024-09-21T07:59:27.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.366+0000 7f42937fe640 1 -- 172.21.15.107:0/1325926683 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f428402c880 con 0x7f429c1014f0 2024-09-21T07:59:27.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.366+0000 7f42a1064640 1 -- 172.21.15.107:0/1325926683 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429c117670 con 0x7f429c1014f0 2024-09-21T07:59:27.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.367+0000 7f42a1064640 1 -- 172.21.15.107:0/1325926683 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429c0fcbf0 con 0x7f429c1014f0 2024-09-21T07:59:27.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.367+0000 7f42937fe640 1 -- 172.21.15.107:0/1325926683 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f4284030020 con 0x7f429c1014f0 2024-09-21T07:59:27.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.368+0000 7f42937fe640 1 --2- 172.21.15.107:0/1325926683 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f428806ed50 0x7f4288071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.368+0000 7f429ad9d640 1 --2- 172.21.15.107:0/1325926683 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f428806ed50 0x7f4288071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.368+0000 7f42937fe640 1 -- 172.21.15.107:0/1325926683 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f42840adf50 con 0x7f429c1014f0 2024-09-21T07:59:27.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.368+0000 7f429ad9d640 1 --2- 172.21.15.107:0/1325926683 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f428806ed50 0x7f4288071200 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f429400a900 tx=0x7f4294008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:27.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.372+0000 7f42937fe640 1 -- 172.21.15.107:0/1325926683 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f428407b470 con 0x7f429c1014f0 2024-09-21T07:59:27.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.530+0000 7f42a1064640 1 -- 172.21.15.107:0/1325926683 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f429c04b720 con 0x7f429c1014f0 2024-09-21T07:59:27.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.531+0000 7f42937fe640 1 -- 172.21.15.107:0/1325926683 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f428407ae10 con 0x7f429c1014f0 2024-09-21T07:59:27.532 INFO:teuthology.orchestra.run.smithi107.stdout:60129542174 2024-09-21T07:59:27.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.533+0000 7f42a1064640 1 -- 172.21.15.107:0/1325926683 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f428806ed50 msgr2=0x7f4288071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:27.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.533+0000 7f42a1064640 1 --2- 172.21.15.107:0/1325926683 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f428806ed50 0x7f4288071200 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f429400a900 tx=0x7f4294008040 comp rx=0 tx=0).stop 2024-09-21T07:59:27.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.533+0000 7f42a1064640 1 -- 172.21.15.107:0/1325926683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f429c1014f0 msgr2=0x7f429c10e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:27.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.533+0000 7f42a1064640 1 --2- 172.21.15.107:0/1325926683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f429c1014f0 0x7f429c10e730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4284003080 tx=0x7f4284009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.533+0000 7f42a1064640 1 -- 172.21.15.107:0/1325926683 shutdown_connections 2024-09-21T07:59:27.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.533+0000 7f42a1064640 1 --2- 172.21.15.107:0/1325926683 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f428806ed50 0x7f4288071200 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.533+0000 7f42a1064640 1 --2- 172.21.15.107:0/1325926683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f429c1014f0 0x7f429c10e730 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.533+0000 7f42a1064640 1 --2- 172.21.15.107:0/1325926683 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f429c0fb4b0 0x7f429c10e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.533+0000 7f42a1064640 1 -- 172.21.15.107:0/1325926683 >> 172.21.15.107:0/1325926683 conn(0x7f429c0f7030 msgr2=0x7f429c0f8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:27.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.534+0000 7f42a1064640 1 -- 172.21.15.107:0/1325926683 shutdown_connections 2024-09-21T07:59:27.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:27.534+0000 7f42a1064640 1 -- 172.21.15.107:0/1325926683 wait complete. 2024-09-21T07:59:28.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:27 smithi107 ceph-mon[27622]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:28.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:27 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1325926683' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-21T07:59:28.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:27 smithi129 ceph-mon[34472]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:28.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:27 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/1325926683' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-21T07:59:28.386 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542172 got 60129542174 for osd.1 2024-09-21T07:59:28.386 DEBUG:teuthology.parallel:result is None 2024-09-21T07:59:28.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.630+0000 7f3d4e67c640 1 -- 172.21.15.107:0/1745127545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d480fb810 msgr2=0x7f3d480fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:28.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.630+0000 7f3d4e67c640 1 --2- 172.21.15.107:0/1745127545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d480fb810 0x7f3d480fbbe0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3d380048d0 tx=0x7f3d38009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:28.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.630+0000 7f3d4e67c640 1 -- 172.21.15.107:0/1745127545 shutdown_connections 2024-09-21T07:59:28.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.630+0000 7f3d4e67c640 1 --2- 172.21.15.107:0/1745127545 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3d480fcf80 0x7f3d480fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:28.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.630+0000 7f3d4e67c640 1 --2- 172.21.15.107:0/1745127545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d480fb810 0x7f3d480fbbe0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:28.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.630+0000 7f3d4e67c640 1 -- 172.21.15.107:0/1745127545 >> 172.21.15.107:0/1745127545 conn(0x7f3d480723b0 msgr2=0x7f3d480727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:28.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.630+0000 7f3d4e67c640 1 -- 172.21.15.107:0/1745127545 shutdown_connections 2024-09-21T07:59:28.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.630+0000 7f3d4e67c640 1 -- 172.21.15.107:0/1745127545 wait complete. 2024-09-21T07:59:28.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.630+0000 7f3d4e67c640 1 Processor -- start 2024-09-21T07:59:28.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.631+0000 7f3d4e67c640 1 -- start start 2024-09-21T07:59:28.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.631+0000 7f3d4e67c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d480fb810 0x7f3d481120b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:28.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.631+0000 7f3d4e67c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3d480fcf80 0x7f3d481125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:28.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.631+0000 7f3d4e67c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d48112bf0 con 0x7f3d480fb810 2024-09-21T07:59:28.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.631+0000 7f3d4e67c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4810c030 con 0x7f3d480fcf80 2024-09-21T07:59:28.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.631+0000 7f3d47fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d480fb810 0x7f3d481120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:28.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.631+0000 7f3d47fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d480fb810 0x7f3d481120b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45584/0 (socket says 172.21.15.107:45584) 2024-09-21T07:59:28.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.631+0000 7f3d47fff640 1 -- 172.21.15.107:0/2861903871 learned_addr learned my addr 172.21.15.107:0/2861903871 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:28.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.631+0000 7f3d47fff640 1 -- 172.21.15.107:0/2861903871 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3d480fcf80 msgr2=0x7f3d481125f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:28.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.631+0000 7f3d47fff640 1 --2- 172.21.15.107:0/2861903871 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3d480fcf80 0x7f3d481125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:28.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.631+0000 7f3d47fff640 1 -- 172.21.15.107:0/2861903871 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d38005040 con 0x7f3d480fb810 2024-09-21T07:59:28.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.631+0000 7f3d47fff640 1 --2- 172.21.15.107:0/2861903871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d480fb810 0x7f3d481120b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3d38003080 tx=0x7f3d38009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:28.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.632+0000 7f3d44ff9640 1 -- 172.21.15.107:0/2861903871 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d38038070 con 0x7f3d480fb810 2024-09-21T07:59:28.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.632+0000 7f3d4e67c640 1 -- 172.21.15.107:0/2861903871 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4810c2b0 con 0x7f3d480fb810 2024-09-21T07:59:28.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.632+0000 7f3d44ff9640 1 -- 172.21.15.107:0/2861903871 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3d380097e0 con 0x7f3d480fb810 2024-09-21T07:59:28.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.632+0000 7f3d44ff9640 1 -- 172.21.15.107:0/2861903871 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d3803d420 con 0x7f3d480fb810 2024-09-21T07:59:28.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.632+0000 7f3d4e67c640 1 -- 172.21.15.107:0/2861903871 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4810c7f0 con 0x7f3d480fb810 2024-09-21T07:59:28.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.633+0000 7f3d4e67c640 1 -- 172.21.15.107:0/2861903871 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d480fcbc0 con 0x7f3d480fb810 2024-09-21T07:59:28.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.633+0000 7f3d44ff9640 1 -- 172.21.15.107:0/2861903871 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f3d38030020 con 0x7f3d480fb810 2024-09-21T07:59:28.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.634+0000 7f3d44ff9640 1 --2- 172.21.15.107:0/2861903871 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f3d3406ed60 0x7f3d34071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:28.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.634+0000 7f3d44ff9640 1 -- 172.21.15.107:0/2861903871 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3d380ae470 con 0x7f3d480fb810 2024-09-21T07:59:28.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.634+0000 7f3d477fe640 1 --2- 172.21.15.107:0/2861903871 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f3d3406ed60 0x7f3d34071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:28.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.634+0000 7f3d477fe640 1 --2- 172.21.15.107:0/2861903871 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f3d3406ed60 0x7f3d34071210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3d4810d970 tx=0x7f3d30007cb0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:28.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.638+0000 7f3d44ff9640 1 -- 172.21.15.107:0/2861903871 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3d3807b8d0 con 0x7f3d480fb810 2024-09-21T07:59:28.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.799+0000 7f3d4e67c640 1 -- 172.21.15.107:0/2861903871 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3d4810d720 con 0x7f3d480fb810 2024-09-21T07:59:28.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.799+0000 7f3d44ff9640 1 -- 172.21.15.107:0/2861903871 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d3807b270 con 0x7f3d480fb810 2024-09-21T07:59:28.801 INFO:teuthology.orchestra.run.smithi107.stdout:81604378650 2024-09-21T07:59:28.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.801+0000 7f3d4e67c640 1 -- 172.21.15.107:0/2861903871 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f3d3406ed60 msgr2=0x7f3d34071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:28.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.801+0000 7f3d4e67c640 1 --2- 172.21.15.107:0/2861903871 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f3d3406ed60 0x7f3d34071210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3d4810d970 tx=0x7f3d30007cb0 comp rx=0 tx=0).stop 2024-09-21T07:59:28.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.801+0000 7f3d4e67c640 1 -- 172.21.15.107:0/2861903871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d480fb810 msgr2=0x7f3d481120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:28.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.801+0000 7f3d4e67c640 1 --2- 172.21.15.107:0/2861903871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d480fb810 0x7f3d481120b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3d38003080 tx=0x7f3d38009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:28.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.801+0000 7f3d4e67c640 1 -- 172.21.15.107:0/2861903871 shutdown_connections 2024-09-21T07:59:28.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.801+0000 7f3d4e67c640 1 --2- 172.21.15.107:0/2861903871 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3d480fcf80 0x7f3d481125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:28.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.801+0000 7f3d4e67c640 1 --2- 172.21.15.107:0/2861903871 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f3d3406ed60 0x7f3d34071210 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:28.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.801+0000 7f3d4e67c640 1 --2- 172.21.15.107:0/2861903871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d480fb810 0x7f3d481120b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:28.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.801+0000 7f3d4e67c640 1 -- 172.21.15.107:0/2861903871 >> 172.21.15.107:0/2861903871 conn(0x7f3d480723b0 msgr2=0x7f3d480fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:28.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.801+0000 7f3d4e67c640 1 -- 172.21.15.107:0/2861903871 shutdown_connections 2024-09-21T07:59:28.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:28.801+0000 7f3d4e67c640 1 -- 172.21.15.107:0/2861903871 wait complete. 2024-09-21T07:59:29.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:28 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/2861903871' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-21T07:59:29.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:28 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/2861903871' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-21T07:59:29.929 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378648 got 81604378650 for osd.2 2024-09-21T07:59:29.929 DEBUG:teuthology.parallel:result is None 2024-09-21T07:59:30.155 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:29 smithi107 ceph-mon[27622]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:29 smithi129 ceph-mon[34472]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:31.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.091+0000 7f71f51b6640 1 -- 172.21.15.107:0/654223869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71f00fb480 msgr2=0x7f71f00fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:31.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.091+0000 7f71f51b6640 1 --2- 172.21.15.107:0/654223869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71f00fb480 0x7f71f00fb8f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f71d80048d0 tx=0x7f71d8009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.091+0000 7f71f51b6640 1 -- 172.21.15.107:0/654223869 shutdown_connections 2024-09-21T07:59:31.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.091+0000 7f71f51b6640 1 --2- 172.21.15.107:0/654223869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71f00fb480 0x7f71f00fb8f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.091+0000 7f71f51b6640 1 --2- 172.21.15.107:0/654223869 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71f01014c0 0x7f71f0101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.091+0000 7f71f51b6640 1 -- 172.21.15.107:0/654223869 >> 172.21.15.107:0/654223869 conn(0x7f71f00f7000 msgr2=0x7f71f00f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:31.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.091+0000 7f71f51b6640 1 -- 172.21.15.107:0/654223869 shutdown_connections 2024-09-21T07:59:31.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.091+0000 7f71f51b6640 1 -- 172.21.15.107:0/654223869 wait complete. 2024-09-21T07:59:31.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.092+0000 7f71f51b6640 1 Processor -- start 2024-09-21T07:59:31.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.092+0000 7f71f51b6640 1 -- start start 2024-09-21T07:59:31.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.092+0000 7f71f51b6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71f00fb480 0x7f71f0113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:31.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.092+0000 7f71f51b6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71f01014c0 0x7f71f0113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:31.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.092+0000 7f71f51b6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f0113e10 con 0x7f71f01014c0 2024-09-21T07:59:31.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.092+0000 7f71f51b6640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f010d1c0 con 0x7f71f00fb480 2024-09-21T07:59:31.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.092+0000 7f71e7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71f01014c0 0x7f71f0113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:31.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.092+0000 7f71e7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71f01014c0 0x7f71f0113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45606/0 (socket says 172.21.15.107:45606) 2024-09-21T07:59:31.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.092+0000 7f71e7fff640 1 -- 172.21.15.107:0/2269053235 learned_addr learned my addr 172.21.15.107:0/2269053235 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:31.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.092+0000 7f71eed9d640 1 --2- 172.21.15.107:0/2269053235 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71f00fb480 0x7f71f0113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:31.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.092+0000 7f71e7fff640 1 -- 172.21.15.107:0/2269053235 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71f00fb480 msgr2=0x7f71f0113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:31.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.092+0000 7f71e7fff640 1 --2- 172.21.15.107:0/2269053235 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71f00fb480 0x7f71f0113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.092+0000 7f71e7fff640 1 -- 172.21.15.107:0/2269053235 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d8005040 con 0x7f71f01014c0 2024-09-21T07:59:31.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.092+0000 7f71eed9d640 1 --2- 172.21.15.107:0/2269053235 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71f00fb480 0x7f71f0113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:59:31.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.092+0000 7f71e7fff640 1 --2- 172.21.15.107:0/2269053235 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71f01014c0 0x7f71f0113780 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f71d8003080 tx=0x7f71d8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:31.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.093+0000 7f71e77fe640 1 -- 172.21.15.107:0/2269053235 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71d8038070 con 0x7f71f01014c0 2024-09-21T07:59:31.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.093+0000 7f71e77fe640 1 -- 172.21.15.107:0/2269053235 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f71d802ade0 con 0x7f71f01014c0 2024-09-21T07:59:31.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.093+0000 7f71f51b6640 1 -- 172.21.15.107:0/2269053235 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f010d440 con 0x7f71f01014c0 2024-09-21T07:59:31.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.093+0000 7f71e77fe640 1 -- 172.21.15.107:0/2269053235 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71d802c880 con 0x7f71f01014c0 2024-09-21T07:59:31.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.093+0000 7f71f51b6640 1 -- 172.21.15.107:0/2269053235 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f010d8a0 con 0x7f71f01014c0 2024-09-21T07:59:31.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.094+0000 7f71f51b6640 1 -- 172.21.15.107:0/2269053235 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f00fcbc0 con 0x7f71f01014c0 2024-09-21T07:59:31.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.094+0000 7f71e77fe640 1 -- 172.21.15.107:0/2269053235 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f71d8030020 con 0x7f71f01014c0 2024-09-21T07:59:31.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.095+0000 7f71e77fe640 1 --2- 172.21.15.107:0/2269053235 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f71dc06ed50 0x7f71dc071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:31.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.095+0000 7f71e77fe640 1 -- 172.21.15.107:0/2269053235 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f71d80adf50 con 0x7f71f01014c0 2024-09-21T07:59:31.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.095+0000 7f71eed9d640 1 --2- 172.21.15.107:0/2269053235 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f71dc06ed50 0x7f71dc071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:31.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.095+0000 7f71eed9d640 1 --2- 172.21.15.107:0/2269053235 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f71dc06ed50 0x7f71dc071200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f71e0006fd0 tx=0x7f71e0008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:31.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.098+0000 7f71e77fe640 1 -- 172.21.15.107:0/2269053235 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f71d807b470 con 0x7f71f01014c0 2024-09-21T07:59:31.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.254+0000 7f71f51b6640 1 -- 172.21.15.107:0/2269053235 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f71f00fac40 con 0x7f71f01014c0 2024-09-21T07:59:31.256 INFO:teuthology.orchestra.run.smithi107.stdout:158913789963 2024-09-21T07:59:31.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.255+0000 7f71e77fe640 1 -- 172.21.15.107:0/2269053235 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71d807ae10 con 0x7f71f01014c0 2024-09-21T07:59:31.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.257+0000 7f71f51b6640 1 -- 172.21.15.107:0/2269053235 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f71dc06ed50 msgr2=0x7f71dc071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:31.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.257+0000 7f71f51b6640 1 --2- 172.21.15.107:0/2269053235 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f71dc06ed50 0x7f71dc071200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f71e0006fd0 tx=0x7f71e0008040 comp rx=0 tx=0).stop 2024-09-21T07:59:31.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.257+0000 7f71f51b6640 1 -- 172.21.15.107:0/2269053235 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71f01014c0 msgr2=0x7f71f0113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:31.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.257+0000 7f71f51b6640 1 --2- 172.21.15.107:0/2269053235 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71f01014c0 0x7f71f0113780 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f71d8003080 tx=0x7f71d8009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.257+0000 7f71f51b6640 1 -- 172.21.15.107:0/2269053235 shutdown_connections 2024-09-21T07:59:31.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.257+0000 7f71f51b6640 1 --2- 172.21.15.107:0/2269053235 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f71dc06ed50 0x7f71dc071200 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.257+0000 7f71f51b6640 1 --2- 172.21.15.107:0/2269053235 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71f01014c0 0x7f71f0113780 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.257+0000 7f71f51b6640 1 --2- 172.21.15.107:0/2269053235 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71f00fb480 0x7f71f0113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.257+0000 7f71f51b6640 1 -- 172.21.15.107:0/2269053235 >> 172.21.15.107:0/2269053235 conn(0x7f71f00f7000 msgr2=0x7f71f00f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:31.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.258+0000 7f71f51b6640 1 -- 172.21.15.107:0/2269053235 shutdown_connections 2024-09-21T07:59:31.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.258+0000 7f71f51b6640 1 -- 172.21.15.107:0/2269053235 wait complete. 2024-09-21T07:59:31.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.331+0000 7f11a04dc640 1 -- 172.21.15.107:0/2194165651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1198102ed0 msgr2=0x7f11980fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:31.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.331+0000 7f11a04dc640 1 --2- 172.21.15.107:0/2194165651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1198102ed0 0x7f11980fc590 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f11880048d0 tx=0x7f1188009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.331+0000 7f11a04dc640 1 -- 172.21.15.107:0/2194165651 shutdown_connections 2024-09-21T07:59:31.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.331+0000 7f11a04dc640 1 --2- 172.21.15.107:0/2194165651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1198102ed0 0x7f11980fc590 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.331+0000 7f11a04dc640 1 --2- 172.21.15.107:0/2194165651 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1198102530 0x7f1198102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.331+0000 7f11a04dc640 1 -- 172.21.15.107:0/2194165651 >> 172.21.15.107:0/2194165651 conn(0x7f11980f80f0 msgr2=0x7f11980fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:31.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.331+0000 7f11a04dc640 1 -- 172.21.15.107:0/2194165651 shutdown_connections 2024-09-21T07:59:31.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.331+0000 7f11a04dc640 1 -- 172.21.15.107:0/2194165651 wait complete. 2024-09-21T07:59:31.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.332+0000 7f11a04dc640 1 Processor -- start 2024-09-21T07:59:31.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.332+0000 7f11a04dc640 1 -- start start 2024-09-21T07:59:31.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.332+0000 7f11a04dc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1198102530 0x7f11981131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:31.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.332+0000 7f11a04dc640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1198102ed0 0x7f1198113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:31.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.332+0000 7f11a04dc640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1198113d30 con 0x7f1198102530 2024-09-21T07:59:31.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.332+0000 7f11a04dc640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119810d170 con 0x7f1198102ed0 2024-09-21T07:59:31.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.332+0000 7f119e278640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1198102530 0x7f11981131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:31.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.332+0000 7f119e278640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1198102530 0x7f11981131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57116/0 (socket says 172.21.15.107:57116) 2024-09-21T07:59:31.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.332+0000 7f119e278640 1 -- 172.21.15.107:0/872552383 learned_addr learned my addr 172.21.15.107:0/872552383 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:31.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.332+0000 7f119da77640 1 --2- 172.21.15.107:0/872552383 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1198102ed0 0x7f1198113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:31.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.333+0000 7f119e278640 1 -- 172.21.15.107:0/872552383 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1198102ed0 msgr2=0x7f1198113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:31.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.333+0000 7f119e278640 1 --2- 172.21.15.107:0/872552383 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1198102ed0 0x7f1198113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.333+0000 7f119e278640 1 -- 172.21.15.107:0/872552383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1188005040 con 0x7f1198102530 2024-09-21T07:59:31.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.333+0000 7f119e278640 1 --2- 172.21.15.107:0/872552383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1198102530 0x7f11981131f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f119400c790 tx=0x7f11940043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:31.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.333+0000 7f118effd640 1 -- 172.21.15.107:0/872552383 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f119400a820 con 0x7f1198102530 2024-09-21T07:59:31.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.333+0000 7f118effd640 1 -- 172.21.15.107:0/872552383 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f119400ae20 con 0x7f1198102530 2024-09-21T07:59:31.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.333+0000 7f11a04dc640 1 -- 172.21.15.107:0/872552383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119810d450 con 0x7f1198102530 2024-09-21T07:59:31.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.333+0000 7f118effd640 1 -- 172.21.15.107:0/872552383 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11940113a0 con 0x7f1198102530 2024-09-21T07:59:31.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.333+0000 7f11a04dc640 1 -- 172.21.15.107:0/872552383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119810d9c0 con 0x7f1198102530 2024-09-21T07:59:31.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.334+0000 7f11a04dc640 1 -- 172.21.15.107:0/872552383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11980fdcb0 con 0x7f1198102530 2024-09-21T07:59:31.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.334+0000 7f118effd640 1 -- 172.21.15.107:0/872552383 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f1194012400 con 0x7f1198102530 2024-09-21T07:59:31.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.335+0000 7f118effd640 1 --2- 172.21.15.107:0/872552383 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f118406ed60 0x7f1184071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:31.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.335+0000 7f119da77640 1 --2- 172.21.15.107:0/872552383 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f118406ed60 0x7f1184071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:31.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.335+0000 7f118effd640 1 -- 172.21.15.107:0/872552383 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f119408dfc0 con 0x7f1198102530 2024-09-21T07:59:31.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.335+0000 7f119da77640 1 --2- 172.21.15.107:0/872552383 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f118406ed60 0x7f1184071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1188000c00 tx=0x7f1188035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:31.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.339+0000 7f118effd640 1 -- 172.21.15.107:0/872552383 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f119405b4a0 con 0x7f1198102530 2024-09-21T07:59:31.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.499+0000 7f11a04dc640 1 -- 172.21.15.107:0/872552383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f119804b720 con 0x7f1198102530 2024-09-21T07:59:31.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.499+0000 7f118effd640 1 -- 172.21.15.107:0/872552383 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f119405ae40 con 0x7f1198102530 2024-09-21T07:59:31.501 INFO:teuthology.orchestra.run.smithi107.stdout:137438953489 2024-09-21T07:59:31.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.501+0000 7f11a04dc640 1 -- 172.21.15.107:0/872552383 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f118406ed60 msgr2=0x7f1184071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:31.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.501+0000 7f11a04dc640 1 --2- 172.21.15.107:0/872552383 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f118406ed60 0x7f1184071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1188000c00 tx=0x7f1188035040 comp rx=0 tx=0).stop 2024-09-21T07:59:31.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.501+0000 7f11a04dc640 1 -- 172.21.15.107:0/872552383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1198102530 msgr2=0x7f11981131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:31.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.501+0000 7f11a04dc640 1 --2- 172.21.15.107:0/872552383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1198102530 0x7f11981131f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f119400c790 tx=0x7f11940043c0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.501+0000 7f11a04dc640 1 -- 172.21.15.107:0/872552383 shutdown_connections 2024-09-21T07:59:31.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.501+0000 7f11a04dc640 1 --2- 172.21.15.107:0/872552383 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1198102ed0 0x7f1198113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.501+0000 7f11a04dc640 1 --2- 172.21.15.107:0/872552383 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f118406ed60 0x7f1184071210 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.501+0000 7f11a04dc640 1 --2- 172.21.15.107:0/872552383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1198102530 0x7f11981131f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.501+0000 7f11a04dc640 1 -- 172.21.15.107:0/872552383 >> 172.21.15.107:0/872552383 conn(0x7f11980f80f0 msgr2=0x7f11980f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:31.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.501+0000 7f11a04dc640 1 -- 172.21.15.107:0/872552383 shutdown_connections 2024-09-21T07:59:31.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:31.502+0000 7f11a04dc640 1 -- 172.21.15.107:0/872552383 wait complete. 2024-09-21T07:59:32.229 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:31 smithi107 ceph-mon[27622]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:32.229 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:31 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/2269053235' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-21T07:59:32.229 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:31 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/872552383' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-21T07:59:32.254 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953487 got 137438953489 for osd.4 2024-09-21T07:59:32.254 DEBUG:teuthology.parallel:result is None 2024-09-21T07:59:32.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:31 smithi129 ceph-mon[34472]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:32.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:31 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/2269053235' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-21T07:59:32.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:31 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/872552383' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-21T07:59:32.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.689+0000 7f4fddc98640 1 -- 172.21.15.107:0/1625358191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fd80fe450 msgr2=0x7f4fd80fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:32.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.689+0000 7f4fddc98640 1 --2- 172.21.15.107:0/1625358191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fd80fe450 0x7f4fd80fe820 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80048d0 tx=0x7f4fc8009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.689+0000 7f4fddc98640 1 -- 172.21.15.107:0/1625358191 shutdown_connections 2024-09-21T07:59:32.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.689+0000 7f4fddc98640 1 --2- 172.21.15.107:0/1625358191 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4fd8064fe0 0x7f4fd8065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.689+0000 7f4fddc98640 1 --2- 172.21.15.107:0/1625358191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fd80fe450 0x7f4fd80fe820 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.689+0000 7f4fddc98640 1 -- 172.21.15.107:0/1625358191 >> 172.21.15.107:0/1625358191 conn(0x7f4fd80723b0 msgr2=0x7f4fd80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:32.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.689+0000 7f4fddc98640 1 -- 172.21.15.107:0/1625358191 shutdown_connections 2024-09-21T07:59:32.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.689+0000 7f4fddc98640 1 -- 172.21.15.107:0/1625358191 wait complete. 2024-09-21T07:59:32.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.689+0000 7f4fddc98640 1 Processor -- start 2024-09-21T07:59:32.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.689+0000 7f4fddc98640 1 -- start start 2024-09-21T07:59:32.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.689+0000 7f4fddc98640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fd8064fe0 0x7f4fd8113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.689+0000 7f4fddc98640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4fd80fe450 0x7f4fd8113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.689+0000 7f4fddc98640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8113d50 con 0x7f4fd8064fe0 2024-09-21T07:59:32.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.689+0000 7f4fddc98640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd810d190 con 0x7f4fd80fe450 2024-09-21T07:59:32.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.690+0000 7f4fd77fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fd8064fe0 0x7f4fd8113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.690+0000 7f4fd77fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fd8064fe0 0x7f4fd8113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57136/0 (socket says 172.21.15.107:57136) 2024-09-21T07:59:32.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.690+0000 7f4fd77fe640 1 -- 172.21.15.107:0/555793525 learned_addr learned my addr 172.21.15.107:0/555793525 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:32.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.690+0000 7f4fd77fe640 1 -- 172.21.15.107:0/555793525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4fd80fe450 msgr2=0x7f4fd8113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:32.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.690+0000 7f4fd77fe640 1 --2- 172.21.15.107:0/555793525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4fd80fe450 0x7f4fd8113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.690+0000 7f4fd77fe640 1 -- 172.21.15.107:0/555793525 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc8005040 con 0x7f4fd8064fe0 2024-09-21T07:59:32.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.690+0000 7f4fd77fe640 1 --2- 172.21.15.107:0/555793525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fd8064fe0 0x7f4fd8113210 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8000c00 tx=0x7f4fc8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:32.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.690+0000 7f4fbffff640 1 -- 172.21.15.107:0/555793525 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fc8038070 con 0x7f4fd8064fe0 2024-09-21T07:59:32.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.690+0000 7f4fbffff640 1 -- 172.21.15.107:0/555793525 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4fc802ade0 con 0x7f4fd8064fe0 2024-09-21T07:59:32.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.690+0000 7f4fddc98640 1 -- 172.21.15.107:0/555793525 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd810d410 con 0x7f4fd8064fe0 2024-09-21T07:59:32.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.690+0000 7f4fbffff640 1 -- 172.21.15.107:0/555793525 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fc802c7e0 con 0x7f4fd8064fe0 2024-09-21T07:59:32.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.690+0000 7f4fddc98640 1 -- 172.21.15.107:0/555793525 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd810d8d0 con 0x7f4fd8064fe0 2024-09-21T07:59:32.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.691+0000 7f4fddc98640 1 -- 172.21.15.107:0/555793525 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd80fdce0 con 0x7f4fd8064fe0 2024-09-21T07:59:32.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.692+0000 7f4fbffff640 1 -- 172.21.15.107:0/555793525 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f4fc8030020 con 0x7f4fd8064fe0 2024-09-21T07:59:32.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.692+0000 7f4fbffff640 1 --2- 172.21.15.107:0/555793525 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f4fc006ed60 0x7f4fc0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.692+0000 7f4fd6ffd640 1 --2- 172.21.15.107:0/555793525 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f4fc006ed60 0x7f4fc0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.692+0000 7f4fbffff640 1 -- 172.21.15.107:0/555793525 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4fc80adad0 con 0x7f4fd8064fe0 2024-09-21T07:59:32.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.693+0000 7f4fd6ffd640 1 --2- 172.21.15.107:0/555793525 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f4fc006ed60 0x7f4fc0071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4fd810ead0 tx=0x7f4fcc004f70 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:32.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.697+0000 7f4fbffff640 1 -- 172.21.15.107:0/555793525 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4fc807afe0 con 0x7f4fd8064fe0 2024-09-21T07:59:32.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.859+0000 7f4fddc98640 1 -- 172.21.15.107:0/555793525 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4fd810e8b0 con 0x7f4fd8064fe0 2024-09-21T07:59:32.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.859+0000 7f4fbffff640 1 -- 172.21.15.107:0/555793525 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4fc807a980 con 0x7f4fd8064fe0 2024-09-21T07:59:32.861 INFO:teuthology.orchestra.run.smithi107.stdout:111669149719 2024-09-21T07:59:32.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.861+0000 7f4fddc98640 1 -- 172.21.15.107:0/555793525 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f4fc006ed60 msgr2=0x7f4fc0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:32.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.861+0000 7f4fddc98640 1 --2- 172.21.15.107:0/555793525 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f4fc006ed60 0x7f4fc0071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4fd810ead0 tx=0x7f4fcc004f70 comp rx=0 tx=0).stop 2024-09-21T07:59:32.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.861+0000 7f4fddc98640 1 -- 172.21.15.107:0/555793525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fd8064fe0 msgr2=0x7f4fd8113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:32.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.861+0000 7f4fddc98640 1 --2- 172.21.15.107:0/555793525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fd8064fe0 0x7f4fd8113210 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8000c00 tx=0x7f4fc8009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.861+0000 7f4fddc98640 1 -- 172.21.15.107:0/555793525 shutdown_connections 2024-09-21T07:59:32.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.861+0000 7f4fddc98640 1 --2- 172.21.15.107:0/555793525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4fd80fe450 0x7f4fd8113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.861+0000 7f4fddc98640 1 --2- 172.21.15.107:0/555793525 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f4fc006ed60 0x7f4fc0071210 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.861+0000 7f4fddc98640 1 --2- 172.21.15.107:0/555793525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fd8064fe0 0x7f4fd8113210 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.861+0000 7f4fddc98640 1 -- 172.21.15.107:0/555793525 >> 172.21.15.107:0/555793525 conn(0x7f4fd80723b0 msgr2=0x7f4fd80fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.861+0000 7f4fddc98640 1 -- 172.21.15.107:0/555793525 shutdown_connections 2024-09-21T07:59:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.861+0000 7f4fddc98640 1 -- 172.21.15.107:0/555793525 wait complete. 2024-09-21T07:59:32.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.867+0000 7fa125355640 1 -- 172.21.15.107:0/3778242494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1200fded0 msgr2=0x7fa1201065a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:32.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.867+0000 7fa125355640 1 --2- 172.21.15.107:0/3778242494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1200fded0 0x7fa1201065a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa114004900 tx=0x7fa114009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.867+0000 7fa125355640 1 -- 172.21.15.107:0/3778242494 shutdown_connections 2024-09-21T07:59:32.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.867+0000 7fa125355640 1 --2- 172.21.15.107:0/3778242494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1200fded0 0x7fa1201065a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.867+0000 7fa125355640 1 --2- 172.21.15.107:0/3778242494 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1200fd530 0x7fa1200fd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.867+0000 7fa125355640 1 -- 172.21.15.107:0/3778242494 >> 172.21.15.107:0/3778242494 conn(0x7fa1200f7030 msgr2=0x7fa1200f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:32.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.867+0000 7fa125355640 1 -- 172.21.15.107:0/3778242494 shutdown_connections 2024-09-21T07:59:32.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.867+0000 7fa125355640 1 -- 172.21.15.107:0/3778242494 wait complete. 2024-09-21T07:59:32.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.868+0000 7fa125355640 1 Processor -- start 2024-09-21T07:59:32.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.868+0000 7fa125355640 1 -- start start 2024-09-21T07:59:32.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.868+0000 7fa125355640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1200fd530 0x7fa120113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.868+0000 7fa125355640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1200fded0 0x7fa120113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.868+0000 7fa125355640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa120113d90 con 0x7fa1200fded0 2024-09-21T07:59:32.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.868+0000 7fa125355640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12010d1d0 con 0x7fa1200fd530 2024-09-21T07:59:32.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.868+0000 7fa11e7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1200fded0 0x7fa120113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.868+0000 7fa11e7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1200fded0 0x7fa120113790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57162/0 (socket says 172.21.15.107:57162) 2024-09-21T07:59:32.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.868+0000 7fa11e7fc640 1 -- 172.21.15.107:0/4123492317 learned_addr learned my addr 172.21.15.107:0/4123492317 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:32.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.868+0000 7fa11effd640 1 --2- 172.21.15.107:0/4123492317 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1200fd530 0x7fa120113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.869+0000 7fa11e7fc640 1 -- 172.21.15.107:0/4123492317 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1200fd530 msgr2=0x7fa120113250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:32.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.869+0000 7fa11e7fc640 1 --2- 172.21.15.107:0/4123492317 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1200fd530 0x7fa120113250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.869+0000 7fa11e7fc640 1 -- 172.21.15.107:0/4123492317 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa114005040 con 0x7fa1200fded0 2024-09-21T07:59:32.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.869+0000 7fa11e7fc640 1 --2- 172.21.15.107:0/4123492317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1200fded0 0x7fa120113790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa114009ac0 tx=0x7fa114009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:32.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.869+0000 7fa1077fe640 1 -- 172.21.15.107:0/4123492317 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa114038070 con 0x7fa1200fded0 2024-09-21T07:59:32.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.869+0000 7fa125355640 1 -- 172.21.15.107:0/4123492317 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa12010d450 con 0x7fa1200fded0 2024-09-21T07:59:32.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.869+0000 7fa1077fe640 1 -- 172.21.15.107:0/4123492317 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa11402ae80 con 0x7fa1200fded0 2024-09-21T07:59:32.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.869+0000 7fa1077fe640 1 -- 172.21.15.107:0/4123492317 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa114009680 con 0x7fa1200fded0 2024-09-21T07:59:32.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.869+0000 7fa125355640 1 -- 172.21.15.107:0/4123492317 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12010d910 con 0x7fa1200fded0 2024-09-21T07:59:32.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.870+0000 7fa125355640 1 -- 172.21.15.107:0/4123492317 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa120066090 con 0x7fa1200fded0 2024-09-21T07:59:32.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.870+0000 7fa1077fe640 1 -- 172.21.15.107:0/4123492317 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fa114030020 con 0x7fa1200fded0 2024-09-21T07:59:32.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.871+0000 7fa1077fe640 1 --2- 172.21.15.107:0/4123492317 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fa10806ed60 0x7fa108071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.871+0000 7fa1077fe640 1 -- 172.21.15.107:0/4123492317 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa1140ae430 con 0x7fa1200fded0 2024-09-21T07:59:32.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.871+0000 7fa11effd640 1 --2- 172.21.15.107:0/4123492317 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fa10806ed60 0x7fa108071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.871+0000 7fa11effd640 1 --2- 172.21.15.107:0/4123492317 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fa10806ed60 0x7fa108071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa110007fd0 tx=0x7fa110009e90 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:32.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:32.875+0000 7fa1077fe640 1 -- 172.21.15.107:0/4123492317 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa11407b890 con 0x7fa1200fded0 2024-09-21T07:59:33.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:33.035+0000 7fa125355640 1 -- 172.21.15.107:0/4123492317 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa120109570 con 0x7fa1200fded0 2024-09-21T07:59:33.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:33.035+0000 7fa1077fe640 1 -- 172.21.15.107:0/4123492317 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa11407b230 con 0x7fa1200fded0 2024-09-21T07:59:33.037 INFO:teuthology.orchestra.run.smithi107.stdout:38654705702 2024-09-21T07:59:33.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:33.037+0000 7fa125355640 1 -- 172.21.15.107:0/4123492317 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fa10806ed60 msgr2=0x7fa108071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:33.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:33.037+0000 7fa125355640 1 --2- 172.21.15.107:0/4123492317 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fa10806ed60 0x7fa108071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa110007fd0 tx=0x7fa110009e90 comp rx=0 tx=0).stop 2024-09-21T07:59:33.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:33.037+0000 7fa125355640 1 -- 172.21.15.107:0/4123492317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1200fded0 msgr2=0x7fa120113790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:33.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:33.037+0000 7fa125355640 1 --2- 172.21.15.107:0/4123492317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1200fded0 0x7fa120113790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa114009ac0 tx=0x7fa114009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:33.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:33.037+0000 7fa125355640 1 -- 172.21.15.107:0/4123492317 shutdown_connections 2024-09-21T07:59:33.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:33.037+0000 7fa125355640 1 --2- 172.21.15.107:0/4123492317 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fa10806ed60 0x7fa108071210 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:33.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:33.037+0000 7fa125355640 1 --2- 172.21.15.107:0/4123492317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1200fded0 0x7fa120113790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:33.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:33.037+0000 7fa125355640 1 --2- 172.21.15.107:0/4123492317 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1200fd530 0x7fa120113250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:33.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:33.037+0000 7fa125355640 1 -- 172.21.15.107:0/4123492317 >> 172.21.15.107:0/4123492317 conn(0x7fa1200f7030 msgr2=0x7fa120102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:33.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:33.037+0000 7fa125355640 1 -- 172.21.15.107:0/4123492317 shutdown_connections 2024-09-21T07:59:33.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:33.037+0000 7fa125355640 1 -- 172.21.15.107:0/4123492317 wait complete. 2024-09-21T07:59:33.787 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705699 got 38654705702 for osd.0 2024-09-21T07:59:33.788 DEBUG:teuthology.parallel:result is None 2024-09-21T07:59:34.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:33 smithi107 ceph-mon[27622]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:34.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:33 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/555793525' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-21T07:59:34.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:33 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/4123492317' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-21T07:59:34.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:33 smithi129 ceph-mon[34472]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:34.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:33 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/555793525' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-21T07:59:34.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:33 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/4123492317' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-21T07:59:34.325 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789960 got 158913789963 for osd.5 2024-09-21T07:59:34.325 DEBUG:teuthology.parallel:result is None 2024-09-21T07:59:34.739 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149716 got 111669149719 for osd.3 2024-09-21T07:59:34.739 DEBUG:teuthology.parallel:result is None 2024-09-21T07:59:34.739 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T07:59:34.739 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:59:34.991 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:36.064 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:35 smithi107 ceph-mon[27622]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:36.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:35 smithi129 ceph-mon[34472]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:36.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.550+0000 7f0a68ea7640 1 -- 172.21.15.107:0/1829048025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a640fb490 msgr2=0x7f0a640fb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:36.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.550+0000 7f0a68ea7640 1 --2- 172.21.15.107:0/1829048025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a640fb490 0x7f0a640fb900 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0a580048d0 tx=0x7f0a58009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:36.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.550+0000 7f0a68ea7640 1 -- 172.21.15.107:0/1829048025 shutdown_connections 2024-09-21T07:59:36.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.550+0000 7f0a68ea7640 1 --2- 172.21.15.107:0/1829048025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a640fb490 0x7f0a640fb900 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:36.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.550+0000 7f0a68ea7640 1 --2- 172.21.15.107:0/1829048025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0a641014d0 0x7f0a641018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:36.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.550+0000 7f0a68ea7640 1 -- 172.21.15.107:0/1829048025 >> 172.21.15.107:0/1829048025 conn(0x7f0a640f7010 msgr2=0x7f0a640f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:36.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.550+0000 7f0a68ea7640 1 -- 172.21.15.107:0/1829048025 shutdown_connections 2024-09-21T07:59:36.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.550+0000 7f0a68ea7640 1 -- 172.21.15.107:0/1829048025 wait complete. 2024-09-21T07:59:36.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.550+0000 7f0a68ea7640 1 Processor -- start 2024-09-21T07:59:36.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.550+0000 7f0a68ea7640 1 -- start start 2024-09-21T07:59:36.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.551+0000 7f0a68ea7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a640fb490 0x7f0a6410e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:36.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.551+0000 7f0a68ea7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0a641014d0 0x7f0a6410e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:36.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.551+0000 7f0a68ea7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6410ecf0 con 0x7f0a640fb490 2024-09-21T07:59:36.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.551+0000 7f0a68ea7640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6410ee60 con 0x7f0a641014d0 2024-09-21T07:59:36.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.551+0000 7f0a6259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a640fb490 0x7f0a6410e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:36.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.551+0000 7f0a6259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a640fb490 0x7f0a6410e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57178/0 (socket says 172.21.15.107:57178) 2024-09-21T07:59:36.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.551+0000 7f0a6259c640 1 -- 172.21.15.107:0/1421289897 learned_addr learned my addr 172.21.15.107:0/1421289897 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:36.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.551+0000 7f0a61d9b640 1 --2- 172.21.15.107:0/1421289897 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0a641014d0 0x7f0a6410e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:36.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.551+0000 7f0a6259c640 1 -- 172.21.15.107:0/1421289897 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0a641014d0 msgr2=0x7f0a6410e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:36.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.551+0000 7f0a6259c640 1 --2- 172.21.15.107:0/1421289897 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0a641014d0 0x7f0a6410e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:36.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.551+0000 7f0a6259c640 1 -- 172.21.15.107:0/1421289897 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a58005040 con 0x7f0a640fb490 2024-09-21T07:59:36.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.551+0000 7f0a61d9b640 1 --2- 172.21.15.107:0/1421289897 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0a641014d0 0x7f0a6410e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:59:36.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.551+0000 7f0a6259c640 1 --2- 172.21.15.107:0/1421289897 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a640fb490 0x7f0a6410e160 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400c830 tx=0x7f0a54004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:36.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.551+0000 7f0a52ffd640 1 -- 172.21.15.107:0/1421289897 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a5400a850 con 0x7f0a640fb490 2024-09-21T07:59:36.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.551+0000 7f0a52ffd640 1 -- 172.21.15.107:0/1421289897 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0a5400ae50 con 0x7f0a640fb490 2024-09-21T07:59:36.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.551+0000 7f0a68ea7640 1 -- 172.21.15.107:0/1421289897 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a641171d0 con 0x7f0a640fb490 2024-09-21T07:59:36.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.551+0000 7f0a52ffd640 1 -- 172.21.15.107:0/1421289897 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a540113a0 con 0x7f0a640fb490 2024-09-21T07:59:36.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.551+0000 7f0a68ea7640 1 -- 172.21.15.107:0/1421289897 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a641176e0 con 0x7f0a640fb490 2024-09-21T07:59:36.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.552+0000 7f0a68ea7640 1 -- 172.21.15.107:0/1421289897 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a640fcbd0 con 0x7f0a640fb490 2024-09-21T07:59:36.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.553+0000 7f0a52ffd640 1 -- 172.21.15.107:0/1421289897 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f0a54012400 con 0x7f0a640fb490 2024-09-21T07:59:36.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.553+0000 7f0a52ffd640 1 --2- 172.21.15.107:0/1421289897 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f0a4c06ed60 0x7f0a4c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:36.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.553+0000 7f0a61d9b640 1 --2- 172.21.15.107:0/1421289897 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f0a4c06ed60 0x7f0a4c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:36.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.553+0000 7f0a52ffd640 1 -- 172.21.15.107:0/1421289897 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0a5408e010 con 0x7f0a640fb490 2024-09-21T07:59:36.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.554+0000 7f0a61d9b640 1 --2- 172.21.15.107:0/1421289897 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f0a4c06ed60 0x7f0a4c071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800b020 tx=0x7f0a58009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:36.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.557+0000 7f0a52ffd640 1 -- 172.21.15.107:0/1421289897 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0a5405b4f0 con 0x7f0a640fb490 2024-09-21T07:59:36.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.710+0000 7f0a68ea7640 1 -- 172.21.15.107:0/1421289897 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a64066280 con 0x7f0a4c06ed60 2024-09-21T07:59:36.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.711+0000 7f0a52ffd640 1 -- 172.21.15.107:0/1421289897 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27964 (secure 0 0 0) 0x7f0a64066280 con 0x7f0a4c06ed60 2024-09-21T07:59:36.713 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:59:36.713 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-09-21T07:59:36.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.713+0000 7f0a68ea7640 1 -- 172.21.15.107:0/1421289897 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f0a4c06ed60 msgr2=0x7f0a4c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:36.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.713+0000 7f0a68ea7640 1 --2- 172.21.15.107:0/1421289897 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f0a4c06ed60 0x7f0a4c071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800b020 tx=0x7f0a58009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:36.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.713+0000 7f0a68ea7640 1 -- 172.21.15.107:0/1421289897 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a640fb490 msgr2=0x7f0a6410e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:36.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.713+0000 7f0a68ea7640 1 --2- 172.21.15.107:0/1421289897 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a640fb490 0x7f0a6410e160 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400c830 tx=0x7f0a54004430 comp rx=0 tx=0).stop 2024-09-21T07:59:36.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.713+0000 7f0a68ea7640 1 -- 172.21.15.107:0/1421289897 shutdown_connections 2024-09-21T07:59:36.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.713+0000 7f0a68ea7640 1 --2- 172.21.15.107:0/1421289897 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0a641014d0 0x7f0a6410e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:36.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.713+0000 7f0a68ea7640 1 --2- 172.21.15.107:0/1421289897 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f0a4c06ed60 0x7f0a4c071210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:36.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.713+0000 7f0a68ea7640 1 --2- 172.21.15.107:0/1421289897 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a640fb490 0x7f0a6410e160 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:36.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.713+0000 7f0a68ea7640 1 -- 172.21.15.107:0/1421289897 >> 172.21.15.107:0/1421289897 conn(0x7f0a640f7010 msgr2=0x7f0a640f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:36.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.713+0000 7f0a68ea7640 1 -- 172.21.15.107:0/1421289897 shutdown_connections 2024-09-21T07:59:36.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:36.713+0000 7f0a68ea7640 1 -- 172.21.15.107:0/1421289897 wait complete. 2024-09-21T07:59:37.471 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-21T07:59:36.165195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787936,"kb_used_data":3780,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682976,"statfs":{"total":575970213888,"available":574139367424,"internally_reserved":0,"allocated":3870720,"data_stored":2558100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001997"},"pg_stats":[{"pgid":"1.0","version":"22'72","reported_seq":130,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-21T07:58:44.231231+0000","last_change":"2024-09-21T07:58:19.102592+0000","last_active":"2024-09-21T07:58:44.231231+0000","last_peered":"2024-09-21T07:58:44.231231+0000","last_clean":"2024-09-21T07:58:44.231231+0000","last_became_active":"2024-09-21T07:58:19.102314+0000","last_became_peered":"2024-09-21T07:58:19.102314+0000","last_unstale":"2024-09-21T07:58:44.231231+0000","last_undegraded":"2024-09-21T07:58:44.231231+0000","last_fullsized":"2024-09-21T07:58:44.231231+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:57:32.554578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:57:32.554578+0000","last_clean_scrub_stamp":"2024-09-21T07:57:32.554578+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:20.639252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]}]},{"osd":4,"up_from":32,"seq":137438953490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297700,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447452,"statfs":{"total":95995035648,"available":95690190848,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 07:59:22 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.443},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.41699999999999998}]},{"osd":1,"last update":"Sat Sep 21 07:59:22 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.46999999999999997}]},{"osd":2,"last update":"Sat Sep 21 07:59:22 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.433},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.49199999999999999}]},{"osd":3,"last update":"Sat Sep 21 07:59:22 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298280,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446872,"statfs":{"total":95995035648,"available":95689596928,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 07:58:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.56899999999999995}]},{"osd":1,"last update":"Sat Sep 21 07:58:57 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.61899999999999999}]},{"osd":2,"last update":"Sat Sep 21 07:58:57 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.63}]},{"osd":4,"last update":"Sat Sep 21 07:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.497}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 07:58:34 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.253},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.216}]},{"osd":1,"last update":"Sat Sep 21 07:58:34 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.23200000000000001}]},{"osd":3,"last update":"Sat Sep 21 07:58:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56799999999999995}]},{"osd":4,"last update":"Sat Sep 21 07:59:22 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":7.0999999999999996,"5min":7.0999999999999996,"15min":7.0999999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298284,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446868,"statfs":{"total":95995035648,"available":95689592832,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 07:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.32400000000000001,"15min":0.32100000000000001},"min":{"1min":0.22,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.496,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.315},"min":{"1min":0.23899999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.252}]},{"osd":2,"last update":"Sat Sep 21 07:58:34 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.24199999999999999}]},{"osd":3,"last update":"Sat Sep 21 07:58:54 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.38900000000000001}]},{"osd":4,"last update":"Sat Sep 21 07:59:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.377}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298280,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446872,"statfs":{"total":95995035648,"available":95689596928,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 07:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.317,"15min":0.314},"min":{"1min":0.21099999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.54100000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.32400000000000001,"15min":0.32200000000000001},"min":{"1min":0.22800000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.45500000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.41099999999999998}]},{"osd":2,"last update":"Sat Sep 21 07:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.379},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.39300000000000002}]},{"osd":3,"last update":"Sat Sep 21 07:58:55 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.70799999999999996}]},{"osd":4,"last update":"Sat Sep 21 07:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:59:37.472 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:59:37.715 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:38.107 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:37 smithi107 ceph-mon[27622]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:38.107 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:37 smithi107 ceph-mon[27622]: from='client.14402 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:59:38.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:37 smithi129 ceph-mon[34472]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:38.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:37 smithi129 ceph-mon[34472]: from='client.14402 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:59:39.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.394+0000 7f7b94c30640 1 -- 172.21.15.107:0/3635854172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b90102ef0 msgr2=0x7f7b900fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:39.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.394+0000 7f7b94c30640 1 --2- 172.21.15.107:0/3635854172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b90102ef0 0x7f7b900fc5b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7b840048d0 tx=0x7f7b84009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.394+0000 7f7b94c30640 1 -- 172.21.15.107:0/3635854172 shutdown_connections 2024-09-21T07:59:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.394+0000 7f7b94c30640 1 --2- 172.21.15.107:0/3635854172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b90102ef0 0x7f7b900fc5b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.394+0000 7f7b94c30640 1 --2- 172.21.15.107:0/3635854172 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7b90102550 0x7f7b90102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.394+0000 7f7b94c30640 1 -- 172.21.15.107:0/3635854172 >> 172.21.15.107:0/3635854172 conn(0x7f7b900f80f0 msgr2=0x7f7b900fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.394+0000 7f7b94c30640 1 -- 172.21.15.107:0/3635854172 shutdown_connections 2024-09-21T07:59:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.394+0000 7f7b94c30640 1 -- 172.21.15.107:0/3635854172 wait complete. 2024-09-21T07:59:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.395+0000 7f7b94c30640 1 Processor -- start 2024-09-21T07:59:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.395+0000 7f7b94c30640 1 -- start start 2024-09-21T07:59:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.395+0000 7f7b94c30640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b90102550 0x7f7b901135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.395+0000 7f7b94c30640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7b90102ef0 0x7f7b90113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.395+0000 7f7b94c30640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b901141d0 con 0x7f7b90102550 2024-09-21T07:59:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.395+0000 7f7b94c30640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9010d550 con 0x7f7b90102ef0 2024-09-21T07:59:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.395+0000 7f7b8e59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b90102550 0x7f7b901135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.395+0000 7f7b8e59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b90102550 0x7f7b901135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57194/0 (socket says 172.21.15.107:57194) 2024-09-21T07:59:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.395+0000 7f7b8e59c640 1 -- 172.21.15.107:0/258942039 learned_addr learned my addr 172.21.15.107:0/258942039 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:39.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.395+0000 7f7b8e59c640 1 -- 172.21.15.107:0/258942039 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7b90102ef0 msgr2=0x7f7b90113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:39.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.395+0000 7f7b8e59c640 1 --2- 172.21.15.107:0/258942039 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7b90102ef0 0x7f7b90113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:39.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.395+0000 7f7b8e59c640 1 -- 172.21.15.107:0/258942039 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b84005040 con 0x7f7b90102550 2024-09-21T07:59:39.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.395+0000 7f7b8e59c640 1 --2- 172.21.15.107:0/258942039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b90102550 0x7f7b901135b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000b790 tx=0x7f7b800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:39.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.396+0000 7f7b7effd640 1 -- 172.21.15.107:0/258942039 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b8000c700 con 0x7f7b90102550 2024-09-21T07:59:39.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.396+0000 7f7b7effd640 1 -- 172.21.15.107:0/258942039 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7b8000cd00 con 0x7f7b90102550 2024-09-21T07:59:39.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.396+0000 7f7b7effd640 1 -- 172.21.15.107:0/258942039 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b80015e70 con 0x7f7b90102550 2024-09-21T07:59:39.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.396+0000 7f7b94c30640 1 -- 172.21.15.107:0/258942039 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9010d7e0 con 0x7f7b90102550 2024-09-21T07:59:39.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.396+0000 7f7b94c30640 1 -- 172.21.15.107:0/258942039 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9010dd00 con 0x7f7b90102550 2024-09-21T07:59:39.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.397+0000 7f7b94c30640 1 -- 172.21.15.107:0/258942039 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b900fdcd0 con 0x7f7b90102550 2024-09-21T07:59:39.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.397+0000 7f7b7effd640 1 -- 172.21.15.107:0/258942039 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f7b80012070 con 0x7f7b90102550 2024-09-21T07:59:39.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.397+0000 7f7b7effd640 1 --2- 172.21.15.107:0/258942039 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7b7806ed60 0x7f7b78071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:39.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.398+0000 7f7b7effd640 1 -- 172.21.15.107:0/258942039 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7b8008d9b0 con 0x7f7b90102550 2024-09-21T07:59:39.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.398+0000 7f7b8dd9b640 1 --2- 172.21.15.107:0/258942039 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7b7806ed60 0x7f7b78071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:39.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.398+0000 7f7b8dd9b640 1 --2- 172.21.15.107:0/258942039 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7b7806ed60 0x7f7b78071210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009ac0 tx=0x7f7b84009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:39.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.402+0000 7f7b7effd640 1 -- 172.21.15.107:0/258942039 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7b8005ae10 con 0x7f7b90102550 2024-09-21T07:59:39.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.556+0000 7f7b94c30640 1 -- 172.21.15.107:0/258942039 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b9004b720 con 0x7f7b7806ed60 2024-09-21T07:59:39.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.558+0000 7f7b7effd640 1 -- 172.21.15.107:0/258942039 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27904 (secure 0 0 0) 0x7f7b9004b720 con 0x7f7b7806ed60 2024-09-21T07:59:39.559 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:59:39.560 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-09-21T07:59:39.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.559+0000 7f7b94c30640 1 -- 172.21.15.107:0/258942039 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7b7806ed60 msgr2=0x7f7b78071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:39.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.559+0000 7f7b94c30640 1 --2- 172.21.15.107:0/258942039 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7b7806ed60 0x7f7b78071210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009ac0 tx=0x7f7b84009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:39.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.559+0000 7f7b94c30640 1 -- 172.21.15.107:0/258942039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b90102550 msgr2=0x7f7b901135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:39.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.559+0000 7f7b94c30640 1 --2- 172.21.15.107:0/258942039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b90102550 0x7f7b901135b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000b790 tx=0x7f7b800091d0 comp rx=0 tx=0).stop 2024-09-21T07:59:39.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.560+0000 7f7b94c30640 1 -- 172.21.15.107:0/258942039 shutdown_connections 2024-09-21T07:59:39.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.560+0000 7f7b94c30640 1 --2- 172.21.15.107:0/258942039 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7b90102ef0 0x7f7b90113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:39.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.560+0000 7f7b94c30640 1 --2- 172.21.15.107:0/258942039 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7b7806ed60 0x7f7b78071210 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:39.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.560+0000 7f7b94c30640 1 --2- 172.21.15.107:0/258942039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b90102550 0x7f7b901135b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:39.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.560+0000 7f7b94c30640 1 -- 172.21.15.107:0/258942039 >> 172.21.15.107:0/258942039 conn(0x7f7b900f80f0 msgr2=0x7f7b900f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:39.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.560+0000 7f7b94c30640 1 -- 172.21.15.107:0/258942039 shutdown_connections 2024-09-21T07:59:39.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:39.560+0000 7f7b94c30640 1 -- 172.21.15.107:0/258942039 wait complete. 2024-09-21T07:59:40.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:39 smithi129 ceph-mon[34472]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:39 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:59:40.275 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:39 smithi107 ceph-mon[27622]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:40.276 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:39 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:59:40.299 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-21T07:59:38.165626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787936,"kb_used_data":3780,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682976,"statfs":{"total":575970213888,"available":574139367424,"internally_reserved":0,"allocated":3870720,"data_stored":2558100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002127"},"pg_stats":[{"pgid":"1.0","version":"22'72","reported_seq":130,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-21T07:58:44.231231+0000","last_change":"2024-09-21T07:58:19.102592+0000","last_active":"2024-09-21T07:58:44.231231+0000","last_peered":"2024-09-21T07:58:44.231231+0000","last_clean":"2024-09-21T07:58:44.231231+0000","last_became_active":"2024-09-21T07:58:19.102314+0000","last_became_peered":"2024-09-21T07:58:19.102314+0000","last_unstale":"2024-09-21T07:58:44.231231+0000","last_undegraded":"2024-09-21T07:58:44.231231+0000","last_fullsized":"2024-09-21T07:58:44.231231+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:57:32.554578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:57:32.554578+0000","last_clean_scrub_stamp":"2024-09-21T07:57:32.554578+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:20.639252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]}]},{"osd":4,"up_from":32,"seq":137438953490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297700,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447452,"statfs":{"total":95995035648,"available":95690190848,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 07:59:22 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.443},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.41699999999999998}]},{"osd":1,"last update":"Sat Sep 21 07:59:22 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.46999999999999997}]},{"osd":2,"last update":"Sat Sep 21 07:59:22 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.433},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.49199999999999999}]},{"osd":3,"last update":"Sat Sep 21 07:59:22 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298280,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446872,"statfs":{"total":95995035648,"available":95689596928,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 07:58:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.56899999999999995}]},{"osd":1,"last update":"Sat Sep 21 07:58:57 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.61899999999999999}]},{"osd":2,"last update":"Sat Sep 21 07:58:57 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.63}]},{"osd":4,"last update":"Sat Sep 21 07:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.497}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 07:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.36599999999999999,"15min":0.374},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.46200000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.317},{"interface":"front","average":{"1min":0.313,"5min":0.36099999999999999,"15min":0.36899999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.42799999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.26900000000000002}]},{"osd":1,"last update":"Sat Sep 21 07:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.38,"15min":0.38700000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.505,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.38200000000000001,"15min":0.39100000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48799999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.28299999999999997}]},{"osd":3,"last update":"Sat Sep 21 07:58:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.435}]},{"osd":4,"last update":"Sat Sep 21 07:59:22 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":7.0999999999999996,"5min":7.0999999999999996,"15min":7.0999999999999996},"last":0.374},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298284,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446868,"statfs":{"total":95995035648,"available":95689592832,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 07:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.32400000000000001,"15min":0.32100000000000001},"min":{"1min":0.22,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.496,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.315},"min":{"1min":0.23899999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.23799999999999999}]},{"osd":2,"last update":"Sat Sep 21 07:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.34799999999999998,"15min":0.34999999999999998},"min":{"1min":0.215,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.35499999999999998,"15min":0.35899999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.47299999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.27500000000000002}]},{"osd":3,"last update":"Sat Sep 21 07:58:54 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.63500000000000001}]},{"osd":4,"last update":"Sat Sep 21 07:59:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298280,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446872,"statfs":{"total":95995035648,"available":95689596928,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 07:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.317,"15min":0.314},"min":{"1min":0.21099999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.54100000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.32400000000000001,"15min":0.32200000000000001},"min":{"1min":0.22800000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.45500000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.23499999999999999}]},{"osd":2,"last update":"Sat Sep 21 07:59:34 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.46999999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.373,"15min":0.379},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48399999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.31900000000000001}]},{"osd":3,"last update":"Sat Sep 21 07:58:55 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.52300000000000002}]},{"osd":4,"last update":"Sat Sep 21 07:59:19 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:59:40.300 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T07:59:40.300 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T07:59:40.300 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T07:59:40.300 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph health --format=json 2024-09-21T07:59:40.542 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:40.996 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:40 smithi107 ceph-mon[27622]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:59:41.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:40 smithi129 ceph-mon[34472]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:59:42.020 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:41 smithi107 ceph-mon[27622]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:42.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.236+0000 7f39b4b86640 1 -- 172.21.15.107:0/1869018543 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39b00fb480 msgr2=0x7f39b00fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:42.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.236+0000 7f39b4b86640 1 --2- 172.21.15.107:0/1869018543 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39b00fb480 0x7f39b00fb8f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f39980048d0 tx=0x7f3998009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:42.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.236+0000 7f39b4b86640 1 -- 172.21.15.107:0/1869018543 shutdown_connections 2024-09-21T07:59:42.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.236+0000 7f39b4b86640 1 --2- 172.21.15.107:0/1869018543 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39b00fb480 0x7f39b00fb8f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:42.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.236+0000 7f39b4b86640 1 --2- 172.21.15.107:0/1869018543 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39b01014c0 0x7f39b0101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:42.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.236+0000 7f39b4b86640 1 -- 172.21.15.107:0/1869018543 >> 172.21.15.107:0/1869018543 conn(0x7f39b00f7000 msgr2=0x7f39b00f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:42.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.236+0000 7f39b4b86640 1 -- 172.21.15.107:0/1869018543 shutdown_connections 2024-09-21T07:59:42.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.236+0000 7f39b4b86640 1 -- 172.21.15.107:0/1869018543 wait complete. 2024-09-21T07:59:42.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.237+0000 7f39b4b86640 1 Processor -- start 2024-09-21T07:59:42.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.237+0000 7f39b4b86640 1 -- start start 2024-09-21T07:59:42.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.237+0000 7f39b4b86640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39b00fb480 0x7f39b0112150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:42.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.237+0000 7f39b4b86640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39b01014c0 0x7f39b0112690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:42.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.237+0000 7f39b4b86640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b0112d20 con 0x7f39b00fb480 2024-09-21T07:59:42.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.237+0000 7f39b4b86640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b010c0d0 con 0x7f39b01014c0 2024-09-21T07:59:42.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.237+0000 7f39ae59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39b00fb480 0x7f39b0112150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:42.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.237+0000 7f39ae59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39b00fb480 0x7f39b0112150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52490/0 (socket says 172.21.15.107:52490) 2024-09-21T07:59:42.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.237+0000 7f39ae59c640 1 -- 172.21.15.107:0/1655549561 learned_addr learned my addr 172.21.15.107:0/1655549561 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:42.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.237+0000 7f39a7fff640 1 --2- 172.21.15.107:0/1655549561 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39b01014c0 0x7f39b0112690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:42.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.238+0000 7f39ae59c640 1 -- 172.21.15.107:0/1655549561 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39b01014c0 msgr2=0x7f39b0112690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:42.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.238+0000 7f39ae59c640 1 --2- 172.21.15.107:0/1655549561 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39b01014c0 0x7f39b0112690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:42.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.238+0000 7f39ae59c640 1 -- 172.21.15.107:0/1655549561 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3998005040 con 0x7f39b00fb480 2024-09-21T07:59:42.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.238+0000 7f39ae59c640 1 --2- 172.21.15.107:0/1655549561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39b00fb480 0x7f39b0112150 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f39a000b790 tx=0x7f39a00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:42.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.238+0000 7f39a6ffd640 1 -- 172.21.15.107:0/1655549561 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39a000c700 con 0x7f39b00fb480 2024-09-21T07:59:42.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.238+0000 7f39a6ffd640 1 -- 172.21.15.107:0/1655549561 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f39a000cd00 con 0x7f39b00fb480 2024-09-21T07:59:42.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.238+0000 7f39b4b86640 1 -- 172.21.15.107:0/1655549561 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b010c3b0 con 0x7f39b00fb480 2024-09-21T07:59:42.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.238+0000 7f39a6ffd640 1 -- 172.21.15.107:0/1655549561 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39a0015e70 con 0x7f39b00fb480 2024-09-21T07:59:42.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.238+0000 7f39b4b86640 1 -- 172.21.15.107:0/1655549561 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b010c8a0 con 0x7f39b00fb480 2024-09-21T07:59:42.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.239+0000 7f39b4b86640 1 -- 172.21.15.107:0/1655549561 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b00fcbc0 con 0x7f39b00fb480 2024-09-21T07:59:42.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.239+0000 7f39a6ffd640 1 -- 172.21.15.107:0/1655549561 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f39a0012070 con 0x7f39b00fb480 2024-09-21T07:59:42.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.240+0000 7f39a6ffd640 1 --2- 172.21.15.107:0/1655549561 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f399c06ed60 0x7f399c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:42.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.240+0000 7f39a6ffd640 1 -- 172.21.15.107:0/1655549561 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f39a008d930 con 0x7f39b00fb480 2024-09-21T07:59:42.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.240+0000 7f39a7fff640 1 --2- 172.21.15.107:0/1655549561 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f399c06ed60 0x7f399c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:42.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.241+0000 7f39a7fff640 1 --2- 172.21.15.107:0/1655549561 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f399c06ed60 0x7f399c071210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f39b00f7440 tx=0x7f3998035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:42.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.244+0000 7f39a6ffd640 1 -- 172.21.15.107:0/1655549561 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f39a005ae10 con 0x7f39b00fb480 2024-09-21T07:59:42.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:41 smithi129 ceph-mon[34472]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:42.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.434+0000 7f39b4b86640 1 -- 172.21.15.107:0/1655549561 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f39b004b7b0 con 0x7f39b00fb480 2024-09-21T07:59:42.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.434+0000 7f39a6ffd640 1 -- 172.21.15.107:0/1655549561 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f39a005a7b0 con 0x7f39b00fb480 2024-09-21T07:59:42.436 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T07:59:42.436 INFO:teuthology.orchestra.run.smithi107.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T07:59:42.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.436+0000 7f39b4b86640 1 -- 172.21.15.107:0/1655549561 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f399c06ed60 msgr2=0x7f399c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:42.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.436+0000 7f39b4b86640 1 --2- 172.21.15.107:0/1655549561 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f399c06ed60 0x7f399c071210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f39b00f7440 tx=0x7f3998035040 comp rx=0 tx=0).stop 2024-09-21T07:59:42.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.436+0000 7f39b4b86640 1 -- 172.21.15.107:0/1655549561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39b00fb480 msgr2=0x7f39b0112150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:42.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.436+0000 7f39b4b86640 1 --2- 172.21.15.107:0/1655549561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39b00fb480 0x7f39b0112150 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f39a000b790 tx=0x7f39a00091d0 comp rx=0 tx=0).stop 2024-09-21T07:59:42.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.436+0000 7f39b4b86640 1 -- 172.21.15.107:0/1655549561 shutdown_connections 2024-09-21T07:59:42.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.436+0000 7f39b4b86640 1 --2- 172.21.15.107:0/1655549561 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39b01014c0 0x7f39b0112690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:42.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.436+0000 7f39b4b86640 1 --2- 172.21.15.107:0/1655549561 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f399c06ed60 0x7f399c071210 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:42.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.436+0000 7f39b4b86640 1 --2- 172.21.15.107:0/1655549561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39b00fb480 0x7f39b0112150 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:42.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.436+0000 7f39b4b86640 1 -- 172.21.15.107:0/1655549561 >> 172.21.15.107:0/1655549561 conn(0x7f39b00f7000 msgr2=0x7f39b00f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:42.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.436+0000 7f39b4b86640 1 -- 172.21.15.107:0/1655549561 shutdown_connections 2024-09-21T07:59:42.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:42.436+0000 7f39b4b86640 1 -- 172.21.15.107:0/1655549561 wait complete. 2024-09-21T07:59:43.089 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T07:59:43.089 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T07:59:43.089 INFO:teuthology.run_tasks:Running task print... 2024-09-21T07:59:43.098 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-09-21T07:59:43.098 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T07:59:43.125 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi107.front.sepia.ceph.com 2024-09-21T07:59:43.126 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-21T07:59:43.148 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:42 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1655549561' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-21T07:59:43.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:42 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/1655549561' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-21T07:59:43.370 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:44.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:43 smithi107 ceph-mon[27622]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:44.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:43 smithi129 ceph-mon[34472]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:45.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.025+0000 7f244b3bf640 1 -- 172.21.15.107:0/3347753210 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24440ff6e0 msgr2=0x7f2444101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:45.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.025+0000 7f244b3bf640 1 --2- 172.21.15.107:0/3347753210 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24440ff6e0 0x7f2444101ac0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f24340048d0 tx=0x7f2434009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:45.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.025+0000 7f244b3bf640 1 -- 172.21.15.107:0/3347753210 shutdown_connections 2024-09-21T07:59:45.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.025+0000 7f244b3bf640 1 --2- 172.21.15.107:0/3347753210 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24440ff6e0 0x7f2444101ac0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:45.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.025+0000 7f244b3bf640 1 --2- 172.21.15.107:0/3347753210 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2444065be0 0x7f24440ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:45.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.025+0000 7f244b3bf640 1 -- 172.21.15.107:0/3347753210 >> 172.21.15.107:0/3347753210 conn(0x7f24440f6c10 msgr2=0x7f24440f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:45.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.026+0000 7f244b3bf640 1 -- 172.21.15.107:0/3347753210 shutdown_connections 2024-09-21T07:59:45.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.026+0000 7f244b3bf640 1 -- 172.21.15.107:0/3347753210 wait complete. 2024-09-21T07:59:45.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.026+0000 7f244b3bf640 1 Processor -- start 2024-09-21T07:59:45.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.027+0000 7f244b3bf640 1 -- start start 2024-09-21T07:59:45.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.027+0000 7f244b3bf640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2444065be0 0x7f244410d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:45.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.027+0000 7f244b3bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24440ff6e0 0x7f244410d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:45.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.027+0000 7f244b3bf640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244410dc50 con 0x7f24440ff6e0 2024-09-21T07:59:45.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.027+0000 7f244b3bf640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244410e420 con 0x7f2444065be0 2024-09-21T07:59:45.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.027+0000 7f244895a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24440ff6e0 0x7f244410d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:45.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.027+0000 7f244895a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24440ff6e0 0x7f244410d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52506/0 (socket says 172.21.15.107:52506) 2024-09-21T07:59:45.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.027+0000 7f244895a640 1 -- 172.21.15.107:0/1727098417 learned_addr learned my addr 172.21.15.107:0/1727098417 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:45.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.027+0000 7f244915b640 1 --2- 172.21.15.107:0/1727098417 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2444065be0 0x7f244410d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:45.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.027+0000 7f244895a640 1 -- 172.21.15.107:0/1727098417 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2444065be0 msgr2=0x7f244410d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:45.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.027+0000 7f244895a640 1 --2- 172.21.15.107:0/1727098417 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2444065be0 0x7f244410d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:45.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.027+0000 7f244895a640 1 -- 172.21.15.107:0/1727098417 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2434005040 con 0x7f24440ff6e0 2024-09-21T07:59:45.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.027+0000 7f244915b640 1 --2- 172.21.15.107:0/1727098417 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2444065be0 0x7f244410d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:45.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.027+0000 7f244895a640 1 --2- 172.21.15.107:0/1727098417 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24440ff6e0 0x7f244410d600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2434009ac0 tx=0x7f2434009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:45.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.027+0000 7f2439ffb640 1 -- 172.21.15.107:0/1727098417 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2434038070 con 0x7f24440ff6e0 2024-09-21T07:59:45.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.027+0000 7f2439ffb640 1 -- 172.21.15.107:0/1727098417 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2434032d30 con 0x7f24440ff6e0 2024-09-21T07:59:45.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.027+0000 7f244b3bf640 1 -- 172.21.15.107:0/1727098417 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f244410e650 con 0x7f24440ff6e0 2024-09-21T07:59:45.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.027+0000 7f2439ffb640 1 -- 172.21.15.107:0/1727098417 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f243403db50 con 0x7f24440ff6e0 2024-09-21T07:59:45.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.028+0000 7f244b3bf640 1 -- 172.21.15.107:0/1727098417 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f244410eb10 con 0x7f24440ff6e0 2024-09-21T07:59:45.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.029+0000 7f244b3bf640 1 -- 172.21.15.107:0/1727098417 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24440fa890 con 0x7f24440ff6e0 2024-09-21T07:59:45.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.029+0000 7f2439ffb640 1 -- 172.21.15.107:0/1727098417 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f2434030020 con 0x7f24440ff6e0 2024-09-21T07:59:45.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.029+0000 7f2439ffb640 1 --2- 172.21.15.107:0/1727098417 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f243006ed60 0x7f2430071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:45.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.030+0000 7f2439ffb640 1 -- 172.21.15.107:0/1727098417 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f24340aea10 con 0x7f24440ff6e0 2024-09-21T07:59:45.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.030+0000 7f244915b640 1 --2- 172.21.15.107:0/1727098417 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f243006ed60 0x7f2430071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:45.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.030+0000 7f244915b640 1 --2- 172.21.15.107:0/1727098417 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f243006ed60 0x7f2430071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2440007fd0 tx=0x7f2440009e60 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:45.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.034+0000 7f2439ffb640 1 -- 172.21.15.107:0/1727098417 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f243407bee0 con 0x7f24440ff6e0 2024-09-21T07:59:45.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.195+0000 7f244b3bf640 1 -- 172.21.15.107:0/1727098417 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f244404b720 con 0x7f24440ff6e0 2024-09-21T07:59:45.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.200+0000 7f2439ffb640 1 -- 172.21.15.107:0/1727098417 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f243407b880 con 0x7f24440ff6e0 2024-09-21T07:59:45.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.202+0000 7f244b3bf640 1 -- 172.21.15.107:0/1727098417 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f243006ed60 msgr2=0x7f2430071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:45.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.202+0000 7f244b3bf640 1 --2- 172.21.15.107:0/1727098417 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f243006ed60 0x7f2430071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2440007fd0 tx=0x7f2440009e60 comp rx=0 tx=0).stop 2024-09-21T07:59:45.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.203+0000 7f244b3bf640 1 -- 172.21.15.107:0/1727098417 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24440ff6e0 msgr2=0x7f244410d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:45.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.203+0000 7f244b3bf640 1 --2- 172.21.15.107:0/1727098417 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24440ff6e0 0x7f244410d600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2434009ac0 tx=0x7f2434009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:45.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.203+0000 7f244b3bf640 1 -- 172.21.15.107:0/1727098417 shutdown_connections 2024-09-21T07:59:45.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.203+0000 7f244b3bf640 1 --2- 172.21.15.107:0/1727098417 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f243006ed60 0x7f2430071210 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:45.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.203+0000 7f244b3bf640 1 --2- 172.21.15.107:0/1727098417 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24440ff6e0 0x7f244410d600 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:45.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.203+0000 7f244b3bf640 1 --2- 172.21.15.107:0/1727098417 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2444065be0 0x7f244410d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:45.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.203+0000 7f244b3bf640 1 -- 172.21.15.107:0/1727098417 >> 172.21.15.107:0/1727098417 conn(0x7f24440f6c10 msgr2=0x7f24440f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:45.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.203+0000 7f244b3bf640 1 -- 172.21.15.107:0/1727098417 shutdown_connections 2024-09-21T07:59:45.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:45.203+0000 7f244b3bf640 1 -- 172.21.15.107:0/1727098417 wait complete. 2024-09-21T07:59:45.871 INFO:teuthology.run_tasks:Running task print... 2024-09-21T07:59:45.885 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-21T07:59:45.885 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T07:59:45.919 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi107.front.sepia.ceph.com 2024-09-21T07:59:45.919 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T07:59:46.166 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:46.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:45 smithi129 ceph-mon[34472]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:46.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:45 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/1727098417' entity='client.admin' 2024-09-21T07:59:46.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:45 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:59:46.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:45 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:59:46.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:45 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:59:46.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:45 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:59:46.286 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:45 smithi107 ceph-mon[27622]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:46.287 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:45 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1727098417' entity='client.admin' 2024-09-21T07:59:46.287 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:45 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T07:59:46.287 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:45 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T07:59:46.287 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:45 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T07:59:46.287 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:45 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T07:59:47.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.801+0000 7efd85142640 1 -- 172.21.15.107:0/4137382161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd80066790 msgr2=0x7efd800ff160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.801+0000 7efd85142640 1 --2- 172.21.15.107:0/4137382161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd80066790 0x7efd800ff160 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efd70009c50 tx=0x7efd70004d10 comp rx=0 tx=0).stop 2024-09-21T07:59:47.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.801+0000 7efd85142640 1 -- 172.21.15.107:0/4137382161 shutdown_connections 2024-09-21T07:59:47.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.801+0000 7efd85142640 1 --2- 172.21.15.107:0/4137382161 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efd800ff6a0 0x7efd80101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.801+0000 7efd85142640 1 --2- 172.21.15.107:0/4137382161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd80066790 0x7efd800ff160 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.801+0000 7efd85142640 1 -- 172.21.15.107:0/4137382161 >> 172.21.15.107:0/4137382161 conn(0x7efd800f6c10 msgr2=0x7efd800f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:47.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.801+0000 7efd85142640 1 -- 172.21.15.107:0/4137382161 shutdown_connections 2024-09-21T07:59:47.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.801+0000 7efd85142640 1 -- 172.21.15.107:0/4137382161 wait complete. 2024-09-21T07:59:47.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.802+0000 7efd85142640 1 Processor -- start 2024-09-21T07:59:47.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.802+0000 7efd85142640 1 -- start start 2024-09-21T07:59:47.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.802+0000 7efd85142640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efd80066790 0x7efd8010d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:47.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.802+0000 7efd85142640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd800ff6a0 0x7efd8010d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:47.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.802+0000 7efd85142640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8010e4e0 con 0x7efd800ff6a0 2024-09-21T07:59:47.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.802+0000 7efd85142640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8010e650 con 0x7efd80066790 2024-09-21T07:59:47.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.803+0000 7efd7e59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd800ff6a0 0x7efd8010d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:47.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.803+0000 7efd7e59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd800ff6a0 0x7efd8010d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52516/0 (socket says 172.21.15.107:52516) 2024-09-21T07:59:47.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.803+0000 7efd7e59c640 1 -- 172.21.15.107:0/1014273724 learned_addr learned my addr 172.21.15.107:0/1014273724 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:47.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.803+0000 7efd7ed9d640 1 --2- 172.21.15.107:0/1014273724 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efd80066790 0x7efd8010d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:47.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.803+0000 7efd7e59c640 1 -- 172.21.15.107:0/1014273724 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efd80066790 msgr2=0x7efd8010d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.803+0000 7efd7e59c640 1 --2- 172.21.15.107:0/1014273724 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efd80066790 0x7efd8010d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.803+0000 7efd7e59c640 1 -- 172.21.15.107:0/1014273724 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd700098b0 con 0x7efd800ff6a0 2024-09-21T07:59:47.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.803+0000 7efd7e59c640 1 --2- 172.21.15.107:0/1014273724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd800ff6a0 0x7efd8010d6c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efd7400b790 tx=0x7efd740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:47.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.803+0000 7efd677fe640 1 -- 172.21.15.107:0/1014273724 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd7400c700 con 0x7efd800ff6a0 2024-09-21T07:59:47.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.803+0000 7efd85142640 1 -- 172.21.15.107:0/1014273724 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8010e930 con 0x7efd800ff6a0 2024-09-21T07:59:47.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.803+0000 7efd677fe640 1 -- 172.21.15.107:0/1014273724 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efd7400cd00 con 0x7efd800ff6a0 2024-09-21T07:59:47.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.803+0000 7efd677fe640 1 -- 172.21.15.107:0/1014273724 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd74015e70 con 0x7efd800ff6a0 2024-09-21T07:59:47.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.803+0000 7efd85142640 1 -- 172.21.15.107:0/1014273724 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8010ee50 con 0x7efd800ff6a0 2024-09-21T07:59:47.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.804+0000 7efd85142640 1 -- 172.21.15.107:0/1014273724 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd800fa8b0 con 0x7efd800ff6a0 2024-09-21T07:59:47.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.805+0000 7efd677fe640 1 -- 172.21.15.107:0/1014273724 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7efd74012070 con 0x7efd800ff6a0 2024-09-21T07:59:47.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.805+0000 7efd677fe640 1 --2- 172.21.15.107:0/1014273724 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7efd6806ed60 0x7efd68071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:47.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.805+0000 7efd677fe640 1 -- 172.21.15.107:0/1014273724 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7efd7408d9c0 con 0x7efd800ff6a0 2024-09-21T07:59:47.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.805+0000 7efd7ed9d640 1 --2- 172.21.15.107:0/1014273724 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7efd6806ed60 0x7efd68071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:47.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.806+0000 7efd7ed9d640 1 --2- 172.21.15.107:0/1014273724 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7efd6806ed60 0x7efd68071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efd7002a8b0 tx=0x7efd70004d10 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:47.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.809+0000 7efd677fe640 1 -- 172.21.15.107:0/1014273724 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efd7405ae20 con 0x7efd800ff6a0 2024-09-21T07:59:47.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.979+0000 7efd85142640 1 -- 172.21.15.107:0/1014273724 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd8010f0d0 con 0x7efd6806ed60 2024-09-21T07:59:47.981 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:47 smithi107 ceph-mon[27622]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:47.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.980+0000 7efd677fe640 1 -- 172.21.15.107:0/1014273724 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7efd8010f0d0 con 0x7efd6806ed60 2024-09-21T07:59:47.982 INFO:teuthology.orchestra.run.smithi107.stdout:Backend: cephadm 2024-09-21T07:59:47.982 INFO:teuthology.orchestra.run.smithi107.stdout:Available: Yes 2024-09-21T07:59:47.982 INFO:teuthology.orchestra.run.smithi107.stdout:Paused: No 2024-09-21T07:59:47.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.983+0000 7efd85142640 1 -- 172.21.15.107:0/1014273724 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7efd6806ed60 msgr2=0x7efd68071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.983+0000 7efd85142640 1 --2- 172.21.15.107:0/1014273724 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7efd6806ed60 0x7efd68071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efd7002a8b0 tx=0x7efd70004d10 comp rx=0 tx=0).stop 2024-09-21T07:59:47.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.983+0000 7efd85142640 1 -- 172.21.15.107:0/1014273724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd800ff6a0 msgr2=0x7efd8010d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.983+0000 7efd85142640 1 --2- 172.21.15.107:0/1014273724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd800ff6a0 0x7efd8010d6c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efd7400b790 tx=0x7efd740091d0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.983+0000 7efd85142640 1 -- 172.21.15.107:0/1014273724 shutdown_connections 2024-09-21T07:59:47.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.983+0000 7efd85142640 1 --2- 172.21.15.107:0/1014273724 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7efd6806ed60 0x7efd68071210 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.983+0000 7efd85142640 1 --2- 172.21.15.107:0/1014273724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd800ff6a0 0x7efd8010d6c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.983+0000 7efd85142640 1 --2- 172.21.15.107:0/1014273724 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efd80066790 0x7efd8010d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.983+0000 7efd85142640 1 -- 172.21.15.107:0/1014273724 >> 172.21.15.107:0/1014273724 conn(0x7efd800f6c10 msgr2=0x7efd800f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:47.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.983+0000 7efd85142640 1 -- 172.21.15.107:0/1014273724 shutdown_connections 2024-09-21T07:59:47.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:47.983+0000 7efd85142640 1 -- 172.21.15.107:0/1014273724 wait complete. 2024-09-21T07:59:48.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:47 smithi129 ceph-mon[34472]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:48.621 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T07:59:48.869 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:50.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:49 smithi107 ceph-mon[27622]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:50.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:49 smithi107 ceph-mon[27622]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:50.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:49 smithi129 ceph-mon[34472]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:50.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:49 smithi129 ceph-mon[34472]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:50.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.576+0000 7fab55342640 1 -- 172.21.15.107:0/2843477205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab500fc550 msgr2=0x7fab500fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:50.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.576+0000 7fab55342640 1 --2- 172.21.15.107:0/2843477205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab500fc550 0x7fab500fc960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fab40009c50 tx=0x7fab40004d10 comp rx=0 tx=0).stop 2024-09-21T07:59:50.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.576+0000 7fab55342640 1 -- 172.21.15.107:0/2843477205 shutdown_connections 2024-09-21T07:59:50.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.576+0000 7fab55342640 1 --2- 172.21.15.107:0/2843477205 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fab500fd820 0x7fab500fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:50.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.576+0000 7fab55342640 1 --2- 172.21.15.107:0/2843477205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab500fc550 0x7fab500fc960 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:50.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.576+0000 7fab55342640 1 -- 172.21.15.107:0/2843477205 >> 172.21.15.107:0/2843477205 conn(0x7fab500f7d30 msgr2=0x7fab500fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:50.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.576+0000 7fab55342640 1 -- 172.21.15.107:0/2843477205 shutdown_connections 2024-09-21T07:59:50.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.576+0000 7fab55342640 1 -- 172.21.15.107:0/2843477205 wait complete. 2024-09-21T07:59:50.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.577+0000 7fab55342640 1 Processor -- start 2024-09-21T07:59:50.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.577+0000 7fab55342640 1 -- start start 2024-09-21T07:59:50.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.577+0000 7fab55342640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fab500fc550 0x7fab5010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:50.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.577+0000 7fab55342640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab500fd820 0x7fab5010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:50.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.577+0000 7fab55342640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5010dc10 con 0x7fab500fd820 2024-09-21T07:59:50.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.577+0000 7fab55342640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5010e430 con 0x7fab500fc550 2024-09-21T07:59:50.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.577+0000 7fab4e7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab500fd820 0x7fab5010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:50.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.577+0000 7fab4e7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab500fd820 0x7fab5010d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52540/0 (socket says 172.21.15.107:52540) 2024-09-21T07:59:50.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.577+0000 7fab4e7fc640 1 -- 172.21.15.107:0/224681794 learned_addr learned my addr 172.21.15.107:0/224681794 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:50.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.577+0000 7fab4effd640 1 --2- 172.21.15.107:0/224681794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fab500fc550 0x7fab5010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:50.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.577+0000 7fab4e7fc640 1 -- 172.21.15.107:0/224681794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fab500fc550 msgr2=0x7fab5010d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:50.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.577+0000 7fab4e7fc640 1 --2- 172.21.15.107:0/224681794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fab500fc550 0x7fab5010d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:50.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.577+0000 7fab4e7fc640 1 -- 172.21.15.107:0/224681794 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab400098b0 con 0x7fab500fd820 2024-09-21T07:59:50.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.577+0000 7fab4effd640 1 --2- 172.21.15.107:0/224681794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fab500fc550 0x7fab5010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:50.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.578+0000 7fab4e7fc640 1 --2- 172.21.15.107:0/224681794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab500fd820 0x7fab5010d5c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fab4400c810 tx=0x7fab440043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:50.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.578+0000 7fab377fe640 1 -- 172.21.15.107:0/224681794 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab4400a820 con 0x7fab500fd820 2024-09-21T07:59:50.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.578+0000 7fab377fe640 1 -- 172.21.15.107:0/224681794 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fab4400ae20 con 0x7fab500fd820 2024-09-21T07:59:50.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.578+0000 7fab377fe640 1 -- 172.21.15.107:0/224681794 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab440115c0 con 0x7fab500fd820 2024-09-21T07:59:50.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.578+0000 7fab55342640 1 -- 172.21.15.107:0/224681794 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5010e6c0 con 0x7fab500fd820 2024-09-21T07:59:50.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.578+0000 7fab55342640 1 -- 172.21.15.107:0/224681794 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5010ec10 con 0x7fab500fd820 2024-09-21T07:59:50.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.579+0000 7fab55342640 1 -- 172.21.15.107:0/224681794 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab500fb9b0 con 0x7fab500fd820 2024-09-21T07:59:50.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.579+0000 7fab377fe640 1 -- 172.21.15.107:0/224681794 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fab44012840 con 0x7fab500fd820 2024-09-21T07:59:50.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.580+0000 7fab377fe640 1 --2- 172.21.15.107:0/224681794 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fab3806ed60 0x7fab38071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:50.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.580+0000 7fab377fe640 1 -- 172.21.15.107:0/224681794 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fab4408e3f0 con 0x7fab500fd820 2024-09-21T07:59:50.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.580+0000 7fab4effd640 1 --2- 172.21.15.107:0/224681794 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fab3806ed60 0x7fab38071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:50.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.580+0000 7fab4effd640 1 --2- 172.21.15.107:0/224681794 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fab3806ed60 0x7fab38071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fab40000f80 tx=0x7fab40004d10 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:50.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.584+0000 7fab377fe640 1 -- 172.21.15.107:0/224681794 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fab4405b3d0 con 0x7fab500fd820 2024-09-21T07:59:50.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.746+0000 7fab55342640 1 -- 172.21.15.107:0/224681794 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fab5010eff0 con 0x7fab3806ed60 2024-09-21T07:59:50.756 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T07:59:50.756 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (3m) 2m ago 4m 25.8M - 0.25.0 c8568f914cd2 2b63428d7be3 2024-09-21T07:59:50.756 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (5m) 2m ago 5m 6899k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 4557b307c7dd 2024-09-21T07:59:50.756 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (4m) 68s ago 4m 6895k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be e74e9385abdf 2024-09-21T07:59:50.756 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (3m) 2m ago 4m 80.1M - 9.4.7 954c08fa6188 8571a453fdc8 2024-09-21T07:59:50.756 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:9283,8765,8443 running (6m) 2m ago 6m 440M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be d8e1cda67b5b 2024-09-21T07:59:50.756 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283 running (4m) 68s ago 4m 400M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be c5d2f3a0389e 2024-09-21T07:59:50.756 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (6m) 2m ago 6m 42.6M 2048M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7702e48722c8 2024-09-21T07:59:50.757 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (4m) 68s ago 4m 39.0M 2048M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be d9680c5a5b92 2024-09-21T07:59:50.757 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 running (5m) 2m ago 5m 16.3M - 1.5.0 0da6a335fe13 05e3175edba6 2024-09-21T07:59:50.757 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (4m) 68s ago 4m 16.2M - 1.5.0 0da6a335fe13 7285c04552f9 2024-09-21T07:59:50.757 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (3m) 2m ago 3m 37.5M 4287M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 6799bdf55207 2024-09-21T07:59:50.757 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (2m) 2m ago 2m 38.1M 4287M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 29d8ce3f3a52 2024-09-21T07:59:50.757 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (2m) 2m ago 2m 39.7M 4287M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be c9e1c4756c02 2024-09-21T07:59:50.757 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (2m) 68s ago 2m 41.1M 5312M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7d58f70b105c 2024-09-21T07:59:50.757 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (98s) 68s ago 98s 36.4M 5312M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 2f916ef76d22 2024-09-21T07:59:50.757 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (73s) 68s ago 73s 11.7M 5312M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 0f25d9454304 2024-09-21T07:59:50.757 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (3m) 2m ago 4m 37.9M - 2.43.0 a07b618ecd1d 36fd24c0b07b 2024-09-21T07:59:50.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.754+0000 7fab377fe640 1 -- 172.21.15.107:0/224681794 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2790 (secure 0 0 0) 0x7fab5010eff0 con 0x7fab3806ed60 2024-09-21T07:59:50.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.756+0000 7fab55342640 1 -- 172.21.15.107:0/224681794 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fab3806ed60 msgr2=0x7fab38071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:50.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.756+0000 7fab55342640 1 --2- 172.21.15.107:0/224681794 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fab3806ed60 0x7fab38071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fab40000f80 tx=0x7fab40004d10 comp rx=0 tx=0).stop 2024-09-21T07:59:50.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.756+0000 7fab55342640 1 -- 172.21.15.107:0/224681794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab500fd820 msgr2=0x7fab5010d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:50.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.756+0000 7fab55342640 1 --2- 172.21.15.107:0/224681794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab500fd820 0x7fab5010d5c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fab4400c810 tx=0x7fab440043c0 comp rx=0 tx=0).stop 2024-09-21T07:59:50.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.757+0000 7fab55342640 1 -- 172.21.15.107:0/224681794 shutdown_connections 2024-09-21T07:59:50.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.757+0000 7fab55342640 1 --2- 172.21.15.107:0/224681794 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fab3806ed60 0x7fab38071210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:50.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.757+0000 7fab55342640 1 --2- 172.21.15.107:0/224681794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab500fd820 0x7fab5010d5c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:50.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.757+0000 7fab55342640 1 --2- 172.21.15.107:0/224681794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fab500fc550 0x7fab5010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:50.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.757+0000 7fab55342640 1 -- 172.21.15.107:0/224681794 >> 172.21.15.107:0/224681794 conn(0x7fab500f7d30 msgr2=0x7fab500f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:50.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.757+0000 7fab55342640 1 -- 172.21.15.107:0/224681794 shutdown_connections 2024-09-21T07:59:50.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:50.757+0000 7fab55342640 1 -- 172.21.15.107:0/224681794 wait complete. 2024-09-21T07:59:51.520 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T07:59:51.763 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:52.133 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:51 smithi107 ceph-mon[27622]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:52.133 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:51 smithi107 ceph-mon[27622]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:52.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:51 smithi129 ceph-mon[34472]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:52.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:51 smithi129 ceph-mon[34472]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:53.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.619+0000 7ff5f629f640 1 -- 172.21.15.107:0/3521642678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5f00ff6a0 msgr2=0x7ff5f0101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:53.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.619+0000 7ff5f629f640 1 --2- 172.21.15.107:0/3521642678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5f00ff6a0 0x7ff5f0101a80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40048d0 tx=0x7ff5e4009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.619+0000 7ff5f629f640 1 -- 172.21.15.107:0/3521642678 shutdown_connections 2024-09-21T07:59:53.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.619+0000 7ff5f629f640 1 --2- 172.21.15.107:0/3521642678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5f00ff6a0 0x7ff5f0101a80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.619+0000 7ff5f629f640 1 --2- 172.21.15.107:0/3521642678 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5f0066710 0x7ff5f00ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.619+0000 7ff5f629f640 1 -- 172.21.15.107:0/3521642678 >> 172.21.15.107:0/3521642678 conn(0x7ff5f00f6c10 msgr2=0x7ff5f00f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:53.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.619+0000 7ff5f629f640 1 -- 172.21.15.107:0/3521642678 shutdown_connections 2024-09-21T07:59:53.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.619+0000 7ff5f629f640 1 -- 172.21.15.107:0/3521642678 wait complete. 2024-09-21T07:59:53.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.620+0000 7ff5f629f640 1 Processor -- start 2024-09-21T07:59:53.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.620+0000 7ff5f629f640 1 -- start start 2024-09-21T07:59:53.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.620+0000 7ff5f629f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5f0066710 0x7ff5f010d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.620+0000 7ff5f629f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5f00ff6a0 0x7ff5f010d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.620+0000 7ff5f629f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f010dd00 con 0x7ff5f0066710 2024-09-21T07:59:53.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.620+0000 7ff5f629f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f010e4d0 con 0x7ff5f00ff6a0 2024-09-21T07:59:53.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.620+0000 7ff5effff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5f0066710 0x7ff5f010d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.620+0000 7ff5effff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5f0066710 0x7ff5f010d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40602/0 (socket says 172.21.15.107:40602) 2024-09-21T07:59:53.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.620+0000 7ff5effff640 1 -- 172.21.15.107:0/2885248142 learned_addr learned my addr 172.21.15.107:0/2885248142 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:53.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.620+0000 7ff5ef7fe640 1 --2- 172.21.15.107:0/2885248142 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5f00ff6a0 0x7ff5f010d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.621+0000 7ff5effff640 1 -- 172.21.15.107:0/2885248142 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5f00ff6a0 msgr2=0x7ff5f010d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:53.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.621+0000 7ff5effff640 1 --2- 172.21.15.107:0/2885248142 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5f00ff6a0 0x7ff5f010d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.621+0000 7ff5effff640 1 -- 172.21.15.107:0/2885248142 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e4005040 con 0x7ff5f0066710 2024-09-21T07:59:53.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.621+0000 7ff5effff640 1 --2- 172.21.15.107:0/2885248142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5f0066710 0x7ff5f010d170 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000c7e0 tx=0x7ff5e00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:53.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.621+0000 7ff5ecff9640 1 -- 172.21.15.107:0/2885248142 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5e000a7a0 con 0x7ff5f0066710 2024-09-21T07:59:53.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.621+0000 7ff5ecff9640 1 -- 172.21.15.107:0/2885248142 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff5e000ada0 con 0x7ff5f0066710 2024-09-21T07:59:53.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.621+0000 7ff5f629f640 1 -- 172.21.15.107:0/2885248142 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f010e760 con 0x7ff5f0066710 2024-09-21T07:59:53.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.621+0000 7ff5ecff9640 1 -- 172.21.15.107:0/2885248142 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5e00113a0 con 0x7ff5f0066710 2024-09-21T07:59:53.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.621+0000 7ff5f629f640 1 -- 172.21.15.107:0/2885248142 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f010ed00 con 0x7ff5f0066710 2024-09-21T07:59:53.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.622+0000 7ff5f629f640 1 -- 172.21.15.107:0/2885248142 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f00fa8b0 con 0x7ff5f0066710 2024-09-21T07:59:53.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.622+0000 7ff5ecff9640 1 -- 172.21.15.107:0/2885248142 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7ff5e000a900 con 0x7ff5f0066710 2024-09-21T07:59:53.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.623+0000 7ff5ecff9640 1 --2- 172.21.15.107:0/2885248142 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7ff5d806ed60 0x7ff5d8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.623+0000 7ff5ecff9640 1 -- 172.21.15.107:0/2885248142 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff5e008ddb0 con 0x7ff5f0066710 2024-09-21T07:59:53.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.623+0000 7ff5ef7fe640 1 --2- 172.21.15.107:0/2885248142 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7ff5d806ed60 0x7ff5d8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.623+0000 7ff5ef7fe640 1 --2- 172.21.15.107:0/2885248142 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7ff5d806ed60 0x7ff5d8071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff5f010cf20 tx=0x7ff5e4035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:53.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.627+0000 7ff5ecff9640 1 -- 172.21.15.107:0/2885248142 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff5e005b330 con 0x7ff5f0066710 2024-09-21T07:59:53.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.787+0000 7ff5f629f640 1 -- 172.21.15.107:0/2885248142 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5f010f160 con 0x7ff5d806ed60 2024-09-21T07:59:53.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.790+0000 7ff5ecff9640 1 -- 172.21.15.107:0/2885248142 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1179 (secure 0 0 0) 0x7ff5f010f160 con 0x7ff5d806ed60 2024-09-21T07:59:53.793 INFO:teuthology.orchestra.run.smithi107.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T07:59:53.793 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-21T07:59:53.793 INFO:teuthology.orchestra.run.smithi107.stdout:crash 2/2 2m ago 5m * 2024-09-21T07:59:53.794 INFO:teuthology.orchestra.run.smithi107.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-21T07:59:53.794 INFO:teuthology.orchestra.run.smithi107.stdout:mgr 2/2 2m ago 5m count:2 2024-09-21T07:59:53.794 INFO:teuthology.orchestra.run.smithi107.stdout:mon 2/2 2m ago 4m smithi107:172.21.15.107=smithi107;smithi129:172.21.15.129=smithi129;count:2 2024-09-21T07:59:53.794 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-21T07:59:53.794 INFO:teuthology.orchestra.run.smithi107.stdout:osd 6 2m ago - 2024-09-21T07:59:53.794 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-21T07:59:53.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.792+0000 7ff5f629f640 1 -- 172.21.15.107:0/2885248142 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7ff5d806ed60 msgr2=0x7ff5d8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:53.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.792+0000 7ff5f629f640 1 --2- 172.21.15.107:0/2885248142 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7ff5d806ed60 0x7ff5d8071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff5f010cf20 tx=0x7ff5e4035040 comp rx=0 tx=0).stop 2024-09-21T07:59:53.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.792+0000 7ff5f629f640 1 -- 172.21.15.107:0/2885248142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5f0066710 msgr2=0x7ff5f010d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:53.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.792+0000 7ff5f629f640 1 --2- 172.21.15.107:0/2885248142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5f0066710 0x7ff5f010d170 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000c7e0 tx=0x7ff5e00043c0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.792+0000 7ff5f629f640 1 -- 172.21.15.107:0/2885248142 shutdown_connections 2024-09-21T07:59:53.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.792+0000 7ff5f629f640 1 --2- 172.21.15.107:0/2885248142 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5f00ff6a0 0x7ff5f010d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.792+0000 7ff5f629f640 1 --2- 172.21.15.107:0/2885248142 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7ff5d806ed60 0x7ff5d8071210 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.792+0000 7ff5f629f640 1 --2- 172.21.15.107:0/2885248142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5f0066710 0x7ff5f010d170 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.792+0000 7ff5f629f640 1 -- 172.21.15.107:0/2885248142 >> 172.21.15.107:0/2885248142 conn(0x7ff5f00f6c10 msgr2=0x7ff5f00f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:53.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.793+0000 7ff5f629f640 1 -- 172.21.15.107:0/2885248142 shutdown_connections 2024-09-21T07:59:53.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:53.793+0000 7ff5f629f640 1 -- 172.21.15.107:0/2885248142 wait complete. 2024-09-21T07:59:54.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:53 smithi107 ceph-mon[27622]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:54.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:53 smithi129 ceph-mon[34472]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:54.523 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T07:59:54.764 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:55.219 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:54 smithi107 ceph-mon[27622]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:55.219 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:54 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:59:55.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:54 smithi129 ceph-mon[34472]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:55.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:54 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T07:59:56.181 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:55 smithi107 ceph-mon[27622]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:56.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:55 smithi129 ceph-mon[34472]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:56.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.383+0000 7ff3c470c640 1 -- 172.21.15.107:0/233684415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3bc0fb430 msgr2=0x7ff3bc0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:56.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.383+0000 7ff3c470c640 1 --2- 172.21.15.107:0/233684415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3bc0fb430 0x7ff3bc0fb840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff3b80048d0 tx=0x7ff3b8009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.383+0000 7ff3c470c640 1 -- 172.21.15.107:0/233684415 shutdown_connections 2024-09-21T07:59:56.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.383+0000 7ff3c470c640 1 --2- 172.21.15.107:0/233684415 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff3bc0fc700 0x7ff3bc0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.383+0000 7ff3c470c640 1 --2- 172.21.15.107:0/233684415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3bc0fb430 0x7ff3bc0fb840 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.383+0000 7ff3c470c640 1 -- 172.21.15.107:0/233684415 >> 172.21.15.107:0/233684415 conn(0x7ff3bc0f6c10 msgr2=0x7ff3bc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:56.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.383+0000 7ff3c470c640 1 -- 172.21.15.107:0/233684415 shutdown_connections 2024-09-21T07:59:56.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.383+0000 7ff3c470c640 1 -- 172.21.15.107:0/233684415 wait complete. 2024-09-21T07:59:56.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.384+0000 7ff3c470c640 1 Processor -- start 2024-09-21T07:59:56.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.384+0000 7ff3c470c640 1 -- start start 2024-09-21T07:59:56.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.384+0000 7ff3c470c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3bc0fb430 0x7ff3bc10fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:56.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.384+0000 7ff3c470c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff3bc0fc700 0x7ff3bc1122d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:56.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.384+0000 7ff3c470c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc065c80 con 0x7ff3bc0fb430 2024-09-21T07:59:56.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.384+0000 7ff3c470c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc065df0 con 0x7ff3bc0fc700 2024-09-21T07:59:56.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.384+0000 7ff3c24a8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3bc0fb430 0x7ff3bc10fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:56.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.384+0000 7ff3c24a8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3bc0fb430 0x7ff3bc10fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40622/0 (socket says 172.21.15.107:40622) 2024-09-21T07:59:56.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.384+0000 7ff3c24a8640 1 -- 172.21.15.107:0/2002372891 learned_addr learned my addr 172.21.15.107:0/2002372891 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:56.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.384+0000 7ff3c24a8640 1 -- 172.21.15.107:0/2002372891 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff3bc0fc700 msgr2=0x7ff3bc1122d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:56.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.384+0000 7ff3c24a8640 1 --2- 172.21.15.107:0/2002372891 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff3bc0fc700 0x7ff3bc1122d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.384+0000 7ff3c24a8640 1 -- 172.21.15.107:0/2002372891 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b8005040 con 0x7ff3bc0fb430 2024-09-21T07:59:56.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.384+0000 7ff3c24a8640 1 --2- 172.21.15.107:0/2002372891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3bc0fb430 0x7ff3bc10fd80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8003080 tx=0x7ff3b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:56.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.384+0000 7ff3b2ffd640 1 -- 172.21.15.107:0/2002372891 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3b8038070 con 0x7ff3bc0fb430 2024-09-21T07:59:56.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.384+0000 7ff3b2ffd640 1 -- 172.21.15.107:0/2002372891 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff3b802abd0 con 0x7ff3bc0fb430 2024-09-21T07:59:56.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.384+0000 7ff3c470c640 1 -- 172.21.15.107:0/2002372891 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3bc112810 con 0x7ff3bc0fb430 2024-09-21T07:59:56.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.384+0000 7ff3b2ffd640 1 -- 172.21.15.107:0/2002372891 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3b803e670 con 0x7ff3bc0fb430 2024-09-21T07:59:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.384+0000 7ff3c470c640 1 -- 172.21.15.107:0/2002372891 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3bc112db0 con 0x7ff3bc0fb430 2024-09-21T07:59:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.385+0000 7ff3c470c640 1 -- 172.21.15.107:0/2002372891 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3bc0fa890 con 0x7ff3bc0fb430 2024-09-21T07:59:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.386+0000 7ff3b2ffd640 1 -- 172.21.15.107:0/2002372891 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7ff3b8030020 con 0x7ff3bc0fb430 2024-09-21T07:59:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.386+0000 7ff3b2ffd640 1 --2- 172.21.15.107:0/2002372891 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7ff3a806ed60 0x7ff3a8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.386+0000 7ff3c1ca7640 1 --2- 172.21.15.107:0/2002372891 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7ff3a806ed60 0x7ff3a8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.386+0000 7ff3b2ffd640 1 -- 172.21.15.107:0/2002372891 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff3b80ae190 con 0x7ff3bc0fb430 2024-09-21T07:59:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.387+0000 7ff3c1ca7640 1 --2- 172.21.15.107:0/2002372891 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7ff3a806ed60 0x7ff3a8071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac004af0 tx=0x7ff3ac007c30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.390+0000 7ff3b2ffd640 1 -- 172.21.15.107:0/2002372891 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff3b807b670 con 0x7ff3bc0fb430 2024-09-21T07:59:56.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.550+0000 7ff3c470c640 1 -- 172.21.15.107:0/2002372891 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3bc100b60 con 0x7ff3a806ed60 2024-09-21T07:59:56.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.552+0000 7ff3b2ffd640 1 -- 172.21.15.107:0/2002372891 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7ff3bc100b60 con 0x7ff3a806ed60 2024-09-21T07:59:56.555 INFO:teuthology.orchestra.run.smithi107.stdout:HOST ADDR LABELS STATUS 2024-09-21T07:59:56.555 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107 172.21.15.107 2024-09-21T07:59:56.555 INFO:teuthology.orchestra.run.smithi107.stdout:smithi129 172.21.15.129 2024-09-21T07:59:56.555 INFO:teuthology.orchestra.run.smithi107.stdout:2 hosts in cluster 2024-09-21T07:59:56.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.553+0000 7ff3c470c640 1 -- 172.21.15.107:0/2002372891 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7ff3a806ed60 msgr2=0x7ff3a8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:56.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.553+0000 7ff3c470c640 1 --2- 172.21.15.107:0/2002372891 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7ff3a806ed60 0x7ff3a8071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac004af0 tx=0x7ff3ac007c30 comp rx=0 tx=0).stop 2024-09-21T07:59:56.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.553+0000 7ff3c470c640 1 -- 172.21.15.107:0/2002372891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3bc0fb430 msgr2=0x7ff3bc10fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:56.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.553+0000 7ff3c470c640 1 --2- 172.21.15.107:0/2002372891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3bc0fb430 0x7ff3bc10fd80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8003080 tx=0x7ff3b8009da0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.554+0000 7ff3c470c640 1 -- 172.21.15.107:0/2002372891 shutdown_connections 2024-09-21T07:59:56.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.554+0000 7ff3c470c640 1 --2- 172.21.15.107:0/2002372891 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff3bc0fc700 0x7ff3bc1122d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.554+0000 7ff3c470c640 1 --2- 172.21.15.107:0/2002372891 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7ff3a806ed60 0x7ff3a8071210 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.554+0000 7ff3c470c640 1 --2- 172.21.15.107:0/2002372891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3bc0fb430 0x7ff3bc10fd80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.554+0000 7ff3c470c640 1 -- 172.21.15.107:0/2002372891 >> 172.21.15.107:0/2002372891 conn(0x7ff3bc0f6c10 msgr2=0x7ff3bc0f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:56.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.554+0000 7ff3c470c640 1 -- 172.21.15.107:0/2002372891 shutdown_connections 2024-09-21T07:59:56.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:56.554+0000 7ff3c470c640 1 -- 172.21.15.107:0/2002372891 wait complete. 2024-09-21T07:59:57.199 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:56 smithi107 ceph-mon[27622]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:57.199 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:56 smithi107 ceph-mon[27622]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:57.205 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T07:59:57.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:56 smithi129 ceph-mon[34472]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:57.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:56 smithi129 ceph-mon[34472]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:57.448 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T07:59:59.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.118+0000 7faa29a20640 1 -- 172.21.15.107:0/3295815363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa240fc6f0 msgr2=0x7faa240fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:59.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.118+0000 7faa29a20640 1 --2- 172.21.15.107:0/3295815363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa240fc6f0 0x7faa240fcb60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faa18009c50 tx=0x7faa18004d10 comp rx=0 tx=0).stop 2024-09-21T07:59:59.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.118+0000 7faa29a20640 1 -- 172.21.15.107:0/3295815363 shutdown_connections 2024-09-21T07:59:59.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.118+0000 7faa29a20640 1 --2- 172.21.15.107:0/3295815363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa240fc6f0 0x7faa240fcb60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:59.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.118+0000 7faa29a20640 1 --2- 172.21.15.107:0/3295815363 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faa240fb420 0x7faa240fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:59.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.118+0000 7faa29a20640 1 -- 172.21.15.107:0/3295815363 >> 172.21.15.107:0/3295815363 conn(0x7faa240f6c00 msgr2=0x7faa240f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:59.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.118+0000 7faa29a20640 1 -- 172.21.15.107:0/3295815363 shutdown_connections 2024-09-21T07:59:59.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.118+0000 7faa29a20640 1 -- 172.21.15.107:0/3295815363 wait complete. 2024-09-21T07:59:59.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.118+0000 7faa29a20640 1 Processor -- start 2024-09-21T07:59:59.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.118+0000 7faa29a20640 1 -- start start 2024-09-21T07:59:59.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.119+0000 7faa29a20640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faa240fb420 0x7faa2410fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:59.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.119+0000 7faa29a20640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa240fc6f0 0x7faa24112300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:59.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.119+0000 7faa29a20640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa240664f0 con 0x7faa240fc6f0 2024-09-21T07:59:59.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.119+0000 7faa29a20640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa24066660 con 0x7faa240fb420 2024-09-21T07:59:59.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.119+0000 7faa227fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa240fc6f0 0x7faa24112300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:59.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.119+0000 7faa227fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa240fc6f0 0x7faa24112300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40630/0 (socket says 172.21.15.107:40630) 2024-09-21T07:59:59.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.119+0000 7faa227fc640 1 -- 172.21.15.107:0/1511737833 learned_addr learned my addr 172.21.15.107:0/1511737833 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T07:59:59.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.119+0000 7faa22ffd640 1 --2- 172.21.15.107:0/1511737833 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faa240fb420 0x7faa2410fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:59.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.119+0000 7faa227fc640 1 -- 172.21.15.107:0/1511737833 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faa240fb420 msgr2=0x7faa2410fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:59.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.119+0000 7faa227fc640 1 --2- 172.21.15.107:0/1511737833 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faa240fb420 0x7faa2410fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:59.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.119+0000 7faa227fc640 1 -- 172.21.15.107:0/1511737833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa180098b0 con 0x7faa240fc6f0 2024-09-21T07:59:59.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.119+0000 7faa227fc640 1 --2- 172.21.15.107:0/1511737833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa240fc6f0 0x7faa24112300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faa18004a30 tx=0x7faa18004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:59.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.119+0000 7faa0b7fe640 1 -- 172.21.15.107:0/1511737833 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa18032850 con 0x7faa240fc6f0 2024-09-21T07:59:59.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.119+0000 7faa29a20640 1 -- 172.21.15.107:0/1511737833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa24112840 con 0x7faa240fc6f0 2024-09-21T07:59:59.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.119+0000 7faa0b7fe640 1 -- 172.21.15.107:0/1511737833 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faa18009710 con 0x7faa240fc6f0 2024-09-21T07:59:59.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.119+0000 7faa0b7fe640 1 -- 172.21.15.107:0/1511737833 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa1803dc20 con 0x7faa240fc6f0 2024-09-21T07:59:59.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.119+0000 7faa29a20640 1 -- 172.21.15.107:0/1511737833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa24112db0 con 0x7faa240fc6f0 2024-09-21T07:59:59.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.121+0000 7faa29a20640 1 -- 172.21.15.107:0/1511737833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa240fa880 con 0x7faa240fc6f0 2024-09-21T07:59:59.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.121+0000 7faa0b7fe640 1 -- 172.21.15.107:0/1511737833 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7faa1802f030 con 0x7faa240fc6f0 2024-09-21T07:59:59.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.121+0000 7faa0b7fe640 1 --2- 172.21.15.107:0/1511737833 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7faa0c06ed60 0x7faa0c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:59.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.121+0000 7faa0b7fe640 1 -- 172.21.15.107:0/1511737833 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7faa180af570 con 0x7faa240fc6f0 2024-09-21T07:59:59.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.122+0000 7faa22ffd640 1 --2- 172.21.15.107:0/1511737833 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7faa0c06ed60 0x7faa0c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:59.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.122+0000 7faa22ffd640 1 --2- 172.21.15.107:0/1511737833 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7faa0c06ed60 0x7faa0c071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faa1c007fd0 tx=0x7faa1c009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:59.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.126+0000 7faa0b7fe640 1 -- 172.21.15.107:0/1511737833 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7faa1807c9d0 con 0x7faa240fc6f0 2024-09-21T07:59:59.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.291+0000 7faa29a20640 1 -- 172.21.15.107:0/1511737833 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7faa24100b10 con 0x7faa0c06ed60 2024-09-21T07:59:59.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.293+0000 7faa0b7fe640 1 -- 172.21.15.107:0/1511737833 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7faa24100b10 con 0x7faa0c06ed60 2024-09-21T07:59:59.294 INFO:teuthology.orchestra.run.smithi107.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T07:59:59.295 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NK400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T07:59:59.295 INFO:teuthology.orchestra.run.smithi107.stdout:smithi129 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300HY400BGN 372G No 73s ago Has a FileSystem, LVM detected 2024-09-21T07:59:59.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.295+0000 7faa29a20640 1 -- 172.21.15.107:0/1511737833 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7faa0c06ed60 msgr2=0x7faa0c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:59.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.295+0000 7faa29a20640 1 --2- 172.21.15.107:0/1511737833 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7faa0c06ed60 0x7faa0c071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faa1c007fd0 tx=0x7faa1c009040 comp rx=0 tx=0).stop 2024-09-21T07:59:59.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.295+0000 7faa29a20640 1 -- 172.21.15.107:0/1511737833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa240fc6f0 msgr2=0x7faa24112300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:59.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.295+0000 7faa29a20640 1 --2- 172.21.15.107:0/1511737833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa240fc6f0 0x7faa24112300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faa18004a30 tx=0x7faa18004d10 comp rx=0 tx=0).stop 2024-09-21T07:59:59.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.295+0000 7faa29a20640 1 -- 172.21.15.107:0/1511737833 shutdown_connections 2024-09-21T07:59:59.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.295+0000 7faa29a20640 1 --2- 172.21.15.107:0/1511737833 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7faa0c06ed60 0x7faa0c071210 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:59.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.295+0000 7faa29a20640 1 --2- 172.21.15.107:0/1511737833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa240fc6f0 0x7faa24112300 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:59.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.295+0000 7faa29a20640 1 --2- 172.21.15.107:0/1511737833 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faa240fb420 0x7faa2410fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:59.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.295+0000 7faa29a20640 1 -- 172.21.15.107:0/1511737833 >> 172.21.15.107:0/1511737833 conn(0x7faa240f6c00 msgr2=0x7faa240f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:59.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.295+0000 7faa29a20640 1 -- 172.21.15.107:0/1511737833 shutdown_connections 2024-09-21T07:59:59.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T07:59:59.295+0000 7faa29a20640 1 -- 172.21.15.107:0/1511737833 wait complete. 2024-09-21T07:59:59.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 07:59:59 smithi129 ceph-mon[34472]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:59.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 07:59:59 smithi107 ceph-mon[27622]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T07:59:59.951 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T07:59:59.968 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi107.front.sepia.ceph.com 2024-09-21T07:59:59.968 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-21T08:00:00.212 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:00:00.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:00 smithi129 ceph-mon[34472]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:00.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:00 smithi129 ceph-mon[34472]: overall HEALTH_OK 2024-09-21T08:00:00.528 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:00 smithi107 ceph-mon[27622]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:00.528 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:00 smithi107 ceph-mon[27622]: overall HEALTH_OK 2024-09-21T08:00:01.281 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:01 smithi107 ceph-mon[27622]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:00:01.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:01 smithi129 ceph-mon[34472]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:00:01.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.763+0000 7f3e8dfca640 1 -- 172.21.15.107:0/3405843676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e880fc550 msgr2=0x7f3e880fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:01.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.763+0000 7f3e8dfca640 1 --2- 172.21.15.107:0/3405843676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e880fc550 0x7f3e880fc960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3e780048d0 tx=0x7f3e78009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:01.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.763+0000 7f3e8dfca640 1 -- 172.21.15.107:0/3405843676 shutdown_connections 2024-09-21T08:00:01.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.763+0000 7f3e8dfca640 1 --2- 172.21.15.107:0/3405843676 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e880fd820 0x7f3e880fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:01.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.763+0000 7f3e8dfca640 1 --2- 172.21.15.107:0/3405843676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e880fc550 0x7f3e880fc960 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:01.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.763+0000 7f3e8dfca640 1 -- 172.21.15.107:0/3405843676 >> 172.21.15.107:0/3405843676 conn(0x7f3e880f7d30 msgr2=0x7f3e880fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:01.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.763+0000 7f3e8dfca640 1 -- 172.21.15.107:0/3405843676 shutdown_connections 2024-09-21T08:00:01.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.763+0000 7f3e8dfca640 1 -- 172.21.15.107:0/3405843676 wait complete. 2024-09-21T08:00:01.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.764+0000 7f3e8dfca640 1 Processor -- start 2024-09-21T08:00:01.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.764+0000 7f3e8dfca640 1 -- start start 2024-09-21T08:00:01.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.764+0000 7f3e8dfca640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e880fc550 0x7f3e8810d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:01.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.764+0000 7f3e8dfca640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e880fd820 0x7f3e8810d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:01.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.764+0000 7f3e8dfca640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8810e4e0 con 0x7f3e880fc550 2024-09-21T08:00:01.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.764+0000 7f3e8dfca640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8810e650 con 0x7f3e880fd820 2024-09-21T08:00:01.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.764+0000 7f3e877fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e880fc550 0x7f3e8810d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:01.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.764+0000 7f3e877fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e880fc550 0x7f3e8810d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44182/0 (socket says 172.21.15.107:44182) 2024-09-21T08:00:01.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.764+0000 7f3e877fe640 1 -- 172.21.15.107:0/1800101995 learned_addr learned my addr 172.21.15.107:0/1800101995 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:00:01.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.764+0000 7f3e877fe640 1 -- 172.21.15.107:0/1800101995 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e880fd820 msgr2=0x7f3e8810d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:01.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.764+0000 7f3e877fe640 1 --2- 172.21.15.107:0/1800101995 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e880fd820 0x7f3e8810d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:01.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.764+0000 7f3e877fe640 1 -- 172.21.15.107:0/1800101995 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e78005040 con 0x7f3e880fc550 2024-09-21T08:00:01.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.764+0000 7f3e877fe640 1 --2- 172.21.15.107:0/1800101995 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e880fc550 0x7f3e8810d130 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3e78003080 tx=0x7f3e78009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:01.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.764+0000 7f3e84ff9640 1 -- 172.21.15.107:0/1800101995 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e78038070 con 0x7f3e880fc550 2024-09-21T08:00:01.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.764+0000 7f3e84ff9640 1 -- 172.21.15.107:0/1800101995 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3e78009800 con 0x7f3e880fc550 2024-09-21T08:00:01.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.764+0000 7f3e8dfca640 1 -- 172.21.15.107:0/1800101995 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8810e8d0 con 0x7f3e880fc550 2024-09-21T08:00:01.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.765+0000 7f3e84ff9640 1 -- 172.21.15.107:0/1800101995 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e78033660 con 0x7f3e880fc550 2024-09-21T08:00:01.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.765+0000 7f3e8dfca640 1 -- 172.21.15.107:0/1800101995 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8810ed90 con 0x7f3e880fc550 2024-09-21T08:00:01.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.765+0000 7f3e8dfca640 1 -- 172.21.15.107:0/1800101995 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e880fb9b0 con 0x7f3e880fc550 2024-09-21T08:00:01.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.766+0000 7f3e84ff9640 1 -- 172.21.15.107:0/1800101995 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f3e78030020 con 0x7f3e880fc550 2024-09-21T08:00:01.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.766+0000 7f3e84ff9640 1 --2- 172.21.15.107:0/1800101995 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f3e7406ed50 0x7f3e74071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:01.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.767+0000 7f3e84ff9640 1 -- 172.21.15.107:0/1800101995 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3e780adff0 con 0x7f3e880fc550 2024-09-21T08:00:01.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.767+0000 7f3e7ffff640 1 --2- 172.21.15.107:0/1800101995 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f3e7406ed50 0x7f3e74071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:01.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.767+0000 7f3e7ffff640 1 --2- 172.21.15.107:0/1800101995 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f3e7406ed50 0x7f3e74071200 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3e8810cee0 tx=0x7f3e70006d20 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:01.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.770+0000 7f3e84ff9640 1 -- 172.21.15.107:0/1800101995 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3e7807b450 con 0x7f3e880fc550 2024-09-21T08:00:01.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:01.948+0000 7f3e8dfca640 1 -- 172.21.15.107:0/1800101995 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e8810efb0 con 0x7f3e7406ed50 2024-09-21T08:00:02.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:02 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-21T08:00:02.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:02 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-21T08:00:03.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:03.264+0000 7f3e84ff9640 1 -- 172.21.15.107:0/1800101995 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3e8810efb0 con 0x7f3e7406ed50 2024-09-21T08:00:03.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:03.268+0000 7f3e8dfca640 1 -- 172.21.15.107:0/1800101995 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f3e7406ed50 msgr2=0x7f3e74071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:03.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:03.268+0000 7f3e8dfca640 1 --2- 172.21.15.107:0/1800101995 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f3e7406ed50 0x7f3e74071200 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3e8810cee0 tx=0x7f3e70006d20 comp rx=0 tx=0).stop 2024-09-21T08:00:03.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:03.268+0000 7f3e8dfca640 1 -- 172.21.15.107:0/1800101995 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e880fc550 msgr2=0x7f3e8810d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:03.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:03.268+0000 7f3e8dfca640 1 --2- 172.21.15.107:0/1800101995 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e880fc550 0x7f3e8810d130 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3e78003080 tx=0x7f3e78009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:03.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:03.268+0000 7f3e8dfca640 1 -- 172.21.15.107:0/1800101995 shutdown_connections 2024-09-21T08:00:03.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:03.268+0000 7f3e8dfca640 1 --2- 172.21.15.107:0/1800101995 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e880fd820 0x7f3e8810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:03.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:03.268+0000 7f3e8dfca640 1 --2- 172.21.15.107:0/1800101995 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f3e7406ed50 0x7f3e74071200 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:03.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:03.268+0000 7f3e8dfca640 1 --2- 172.21.15.107:0/1800101995 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e880fc550 0x7f3e8810d130 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:03.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:03.268+0000 7f3e8dfca640 1 -- 172.21.15.107:0/1800101995 >> 172.21.15.107:0/1800101995 conn(0x7f3e880f7d30 msgr2=0x7f3e880f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:03.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:03.268+0000 7f3e8dfca640 1 -- 172.21.15.107:0/1800101995 shutdown_connections 2024-09-21T08:00:03.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:03.268+0000 7f3e8dfca640 1 -- 172.21.15.107:0/1800101995 wait complete. 2024-09-21T08:00:03.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:03 smithi129 ceph-mon[34472]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:03.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:03 smithi129 ceph-mon[34472]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:00:03.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:03 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-21T08:00:03.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:03 smithi129 ceph-mon[34472]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T08:00:03.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:03 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-21T08:00:03.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:03 smithi107 ceph-mon[27622]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:03.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:03 smithi107 ceph-mon[27622]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:00:03.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:03 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-21T08:00:03.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:03 smithi107 ceph-mon[27622]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T08:00:03.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:03 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-21T08:00:03.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:03 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107[27618]: 2024-09-21T08:00:03.243+0000 7f8a5fb1d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:00:03.938 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T08:00:04.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:04 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-21T08:00:04.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:04 smithi129 ceph-mon[34472]: osdmap e40: 6 total, 6 up, 6 in 2024-09-21T08:00:04.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:04 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-21T08:00:04.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:04 smithi129 ceph-mon[34472]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:00:04.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:04 smithi129 ceph-mon[34472]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T08:00:04.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:04 smithi129 ceph-mon[34472]: osdmap e41: 6 total, 6 up, 6 in 2024-09-21T08:00:04.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:04 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-21T08:00:04.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:04 smithi129 ceph-mon[34472]: fsmap cephfs:0 2024-09-21T08:00:04.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:04 smithi129 ceph-mon[34472]: Saving service mds.cephfs spec with placement count:4 2024-09-21T08:00:04.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:04 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:04.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:04 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:00:04.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:04 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:00:04.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:04 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:00:04.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:04 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:04.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:04 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.qusoyf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:00:04.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:04 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.qusoyf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T08:00:04.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:04 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:00:04.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:04 smithi129 ceph-mon[34472]: Deploying daemon mds.cephfs.smithi107.qusoyf on smithi107 2024-09-21T08:00:04.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:04 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-21T08:00:04.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:04 smithi107 ceph-mon[27622]: osdmap e40: 6 total, 6 up, 6 in 2024-09-21T08:00:04.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:04 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-21T08:00:04.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:04 smithi107 ceph-mon[27622]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:00:04.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:04 smithi107 ceph-mon[27622]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T08:00:04.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:04 smithi107 ceph-mon[27622]: osdmap e41: 6 total, 6 up, 6 in 2024-09-21T08:00:04.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:04 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-21T08:00:04.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:04 smithi107 ceph-mon[27622]: fsmap cephfs:0 2024-09-21T08:00:04.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:04 smithi107 ceph-mon[27622]: Saving service mds.cephfs spec with placement count:4 2024-09-21T08:00:04.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:04 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:04.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:04 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:00:04.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:04 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:00:04.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:04 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:00:04.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:04 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:04.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:04 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.qusoyf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:00:04.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:04 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.qusoyf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T08:00:04.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:04 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:00:04.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:04 smithi107 ceph-mon[27622]: Deploying daemon mds.cephfs.smithi107.qusoyf on smithi107 2024-09-21T08:00:04.732 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:00:05.422 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:05 smithi107 ceph-mon[27622]: pgmap v169: 65 pgs: 15 creating+peering, 46 unknown, 4 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:00:05.422 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:05 smithi107 ceph-mon[27622]: osdmap e42: 6 total, 6 up, 6 in 2024-09-21T08:00:05.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:05 smithi129 ceph-mon[34472]: pgmap v169: 65 pgs: 15 creating+peering, 46 unknown, 4 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:00:05.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:05 smithi129 ceph-mon[34472]: osdmap e42: 6 total, 6 up, 6 in 2024-09-21T08:00:06.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:06 smithi129 ceph-mon[34472]: osdmap e43: 6 total, 6 up, 6 in 2024-09-21T08:00:06.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:06 smithi107 ceph-mon[27622]: osdmap e43: 6 total, 6 up, 6 in 2024-09-21T08:00:06.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.789+0000 7fe8ff50c640 1 -- 172.21.15.107:0/3769282774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8f80fb430 msgr2=0x7fe8f80fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:06.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.789+0000 7fe8ff50c640 1 --2- 172.21.15.107:0/3769282774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8f80fb430 0x7fe8f80fb840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80048d0 tx=0x7fe8e8009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.789+0000 7fe8ff50c640 1 -- 172.21.15.107:0/3769282774 shutdown_connections 2024-09-21T08:00:06.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.789+0000 7fe8ff50c640 1 --2- 172.21.15.107:0/3769282774 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe8f80fc700 0x7fe8f80fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.789+0000 7fe8ff50c640 1 --2- 172.21.15.107:0/3769282774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8f80fb430 0x7fe8f80fb840 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.789+0000 7fe8ff50c640 1 -- 172.21.15.107:0/3769282774 >> 172.21.15.107:0/3769282774 conn(0x7fe8f80f6c10 msgr2=0x7fe8f80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:06.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.789+0000 7fe8ff50c640 1 -- 172.21.15.107:0/3769282774 shutdown_connections 2024-09-21T08:00:06.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.789+0000 7fe8ff50c640 1 -- 172.21.15.107:0/3769282774 wait complete. 2024-09-21T08:00:06.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.789+0000 7fe8ff50c640 1 Processor -- start 2024-09-21T08:00:06.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.789+0000 7fe8ff50c640 1 -- start start 2024-09-21T08:00:06.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.790+0000 7fe8ff50c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe8f80fb430 0x7fe8f810d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:06.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.790+0000 7fe8ff50c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8f80fc700 0x7fe8f810d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:06.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.790+0000 7fe8ff50c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f810dca0 con 0x7fe8f80fc700 2024-09-21T08:00:06.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.790+0000 7fe8ff50c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f810e420 con 0x7fe8f80fb430 2024-09-21T08:00:06.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.790+0000 7fe8fcaa7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8f80fc700 0x7fe8f810d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:06.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.790+0000 7fe8fcaa7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8f80fc700 0x7fe8f810d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44194/0 (socket says 172.21.15.107:44194) 2024-09-21T08:00:06.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.790+0000 7fe8fcaa7640 1 -- 172.21.15.107:0/3867691938 learned_addr learned my addr 172.21.15.107:0/3867691938 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:00:06.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.790+0000 7fe8fd2a8640 1 --2- 172.21.15.107:0/3867691938 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe8f80fb430 0x7fe8f810d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:06.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.790+0000 7fe8fcaa7640 1 -- 172.21.15.107:0/3867691938 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe8f80fb430 msgr2=0x7fe8f810d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:06.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.790+0000 7fe8fcaa7640 1 --2- 172.21.15.107:0/3867691938 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe8f80fb430 0x7fe8f810d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.790+0000 7fe8fcaa7640 1 -- 172.21.15.107:0/3867691938 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e8005040 con 0x7fe8f80fc700 2024-09-21T08:00:06.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.790+0000 7fe8fcaa7640 1 --2- 172.21.15.107:0/3867691938 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8f80fc700 0x7fe8f810d650 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400c790 tx=0x7fe8f40043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:06.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.790+0000 7fe8edffb640 1 -- 172.21.15.107:0/3867691938 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8f400a7a0 con 0x7fe8f80fc700 2024-09-21T08:00:06.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.790+0000 7fe8edffb640 1 -- 172.21.15.107:0/3867691938 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe8f400ada0 con 0x7fe8f80fc700 2024-09-21T08:00:06.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.790+0000 7fe8ff50c640 1 -- 172.21.15.107:0/3867691938 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f810e6b0 con 0x7fe8f80fc700 2024-09-21T08:00:06.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.790+0000 7fe8edffb640 1 -- 172.21.15.107:0/3867691938 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8f40113a0 con 0x7fe8f80fc700 2024-09-21T08:00:06.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.791+0000 7fe8ff50c640 1 -- 172.21.15.107:0/3867691938 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f810ec50 con 0x7fe8f80fc700 2024-09-21T08:00:06.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.791+0000 7fe8ff50c640 1 -- 172.21.15.107:0/3867691938 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f80fa890 con 0x7fe8f80fc700 2024-09-21T08:00:06.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.792+0000 7fe8edffb640 1 -- 172.21.15.107:0/3867691938 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fe8f400a900 con 0x7fe8f80fc700 2024-09-21T08:00:06.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.792+0000 7fe8edffb640 1 --2- 172.21.15.107:0/3867691938 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe8e406ed60 0x7fe8e4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:06.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.792+0000 7fe8edffb640 1 -- 172.21.15.107:0/3867691938 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe8f408e240 con 0x7fe8f80fc700 2024-09-21T08:00:06.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.792+0000 7fe8fd2a8640 1 --2- 172.21.15.107:0/3867691938 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe8e406ed60 0x7fe8e4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:06.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.793+0000 7fe8fd2a8640 1 --2- 172.21.15.107:0/3867691938 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe8e406ed60 0x7fe8e4071210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8000c00 tx=0x7fe8e8035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:06.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:06.797+0000 7fe8edffb640 1 -- 172.21.15.107:0/3867691938 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe8f405b3e0 con 0x7fe8f80fc700 2024-09-21T08:00:07.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:07.006+0000 7fe8ff50c640 1 -- 172.21.15.107:0/3867691938 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe8f804b720 con 0x7fe8f80fc700 2024-09-21T08:00:07.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:07.006+0000 7fe8edffb640 1 -- 172.21.15.107:0/3867691938 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7fe8f405ad80 con 0x7fe8f80fc700 2024-09-21T08:00:07.008 INFO:teuthology.orchestra.run.smithi107.stdout:e2 2024-09-21T08:00:07.008 INFO:teuthology.orchestra.run.smithi107.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T08:00:07.008 INFO:teuthology.orchestra.run.smithi107.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:00:07.009 INFO:teuthology.orchestra.run.smithi107.stdout:legacy client fscid: 1 2024-09-21T08:00:07.009 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:00:07.009 INFO:teuthology.orchestra.run.smithi107.stdout:Filesystem 'cephfs' (1) 2024-09-21T08:00:07.009 INFO:teuthology.orchestra.run.smithi107.stdout:fs_name cephfs 2024-09-21T08:00:07.009 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 2 2024-09-21T08:00:07.009 INFO:teuthology.orchestra.run.smithi107.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T08:00:07.009 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-09-21T08:00:03.244314+0000 2024-09-21T08:00:07.009 INFO:teuthology.orchestra.run.smithi107.stdout:modified 2024-09-21T08:00:03.244369+0000 2024-09-21T08:00:07.009 INFO:teuthology.orchestra.run.smithi107.stdout:tableserver 0 2024-09-21T08:00:07.009 INFO:teuthology.orchestra.run.smithi107.stdout:root 0 2024-09-21T08:00:07.009 INFO:teuthology.orchestra.run.smithi107.stdout:session_timeout 60 2024-09-21T08:00:07.009 INFO:teuthology.orchestra.run.smithi107.stdout:session_autoclose 300 2024-09-21T08:00:07.009 INFO:teuthology.orchestra.run.smithi107.stdout:max_file_size 1099511627776 2024-09-21T08:00:07.009 INFO:teuthology.orchestra.run.smithi107.stdout:required_client_features {} 2024-09-21T08:00:07.009 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure 0 2024-09-21T08:00:07.010 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure_osd_epoch 0 2024-09-21T08:00:07.010 INFO:teuthology.orchestra.run.smithi107.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:00:07.010 INFO:teuthology.orchestra.run.smithi107.stdout:max_mds 1 2024-09-21T08:00:07.010 INFO:teuthology.orchestra.run.smithi107.stdout:in 2024-09-21T08:00:07.010 INFO:teuthology.orchestra.run.smithi107.stdout:up {} 2024-09-21T08:00:07.010 INFO:teuthology.orchestra.run.smithi107.stdout:failed 2024-09-21T08:00:07.010 INFO:teuthology.orchestra.run.smithi107.stdout:damaged 2024-09-21T08:00:07.010 INFO:teuthology.orchestra.run.smithi107.stdout:stopped 2024-09-21T08:00:07.010 INFO:teuthology.orchestra.run.smithi107.stdout:data_pools [3] 2024-09-21T08:00:07.010 INFO:teuthology.orchestra.run.smithi107.stdout:metadata_pool 2 2024-09-21T08:00:07.010 INFO:teuthology.orchestra.run.smithi107.stdout:inline_data disabled 2024-09-21T08:00:07.010 INFO:teuthology.orchestra.run.smithi107.stdout:balancer 2024-09-21T08:00:07.010 INFO:teuthology.orchestra.run.smithi107.stdout:standby_count_wanted 0 2024-09-21T08:00:07.010 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:00:07.011 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:00:07.011 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 2 2024-09-21T08:00:07.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:07.008+0000 7fe8ff50c640 1 -- 172.21.15.107:0/3867691938 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe8e406ed60 msgr2=0x7fe8e4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:07.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:07.008+0000 7fe8ff50c640 1 --2- 172.21.15.107:0/3867691938 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe8e406ed60 0x7fe8e4071210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8000c00 tx=0x7fe8e8035040 comp rx=0 tx=0).stop 2024-09-21T08:00:07.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:07.008+0000 7fe8ff50c640 1 -- 172.21.15.107:0/3867691938 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8f80fc700 msgr2=0x7fe8f810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:07.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:07.008+0000 7fe8ff50c640 1 --2- 172.21.15.107:0/3867691938 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8f80fc700 0x7fe8f810d650 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400c790 tx=0x7fe8f40043c0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:07.009+0000 7fe8ff50c640 1 -- 172.21.15.107:0/3867691938 shutdown_connections 2024-09-21T08:00:07.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:07.009+0000 7fe8ff50c640 1 --2- 172.21.15.107:0/3867691938 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe8e406ed60 0x7fe8e4071210 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:07.009+0000 7fe8ff50c640 1 --2- 172.21.15.107:0/3867691938 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8f80fc700 0x7fe8f810d650 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:07.009+0000 7fe8ff50c640 1 --2- 172.21.15.107:0/3867691938 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe8f80fb430 0x7fe8f810d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:07.009+0000 7fe8ff50c640 1 -- 172.21.15.107:0/3867691938 >> 172.21.15.107:0/3867691938 conn(0x7fe8f80f6c10 msgr2=0x7fe8f8065620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:07.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:07.009+0000 7fe8ff50c640 1 -- 172.21.15.107:0/3867691938 shutdown_connections 2024-09-21T08:00:07.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:07.009+0000 7fe8ff50c640 1 -- 172.21.15.107:0/3867691938 wait complete. 2024-09-21T08:00:07.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:07 smithi129 ceph-mon[34472]: pgmap v172: 65 pgs: 15 creating+peering, 18 unknown, 32 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:00:07.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:07 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/3867691938' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:00:07.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:07 smithi107 ceph-mon[27622]: pgmap v172: 65 pgs: 15 creating+peering, 18 unknown, 32 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:00:07.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:07 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/3867691938' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:00:07.855 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T08:00:07.865 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi107.front.sepia.ceph.com 2024-09-21T08:00:07.865 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-09-21T08:00:08.140 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:00:09.228 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:09 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:09.228 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:09 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:09.228 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:09 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:09.228 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:09 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi129.fwmfcy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:00:09.228 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:09 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi129.fwmfcy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T08:00:09.228 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:09 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:00:09.228 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:09 smithi107 ceph-mon[27622]: Deploying daemon mds.cephfs.smithi129.fwmfcy on smithi129 2024-09-21T08:00:09.228 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:09 smithi107 ceph-mon[27622]: pgmap v173: 65 pgs: 3 creating+peering, 62 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:00:09.228 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:09 smithi107 ceph-mon[27622]: mds.? [v2:172.21.15.107:6826/1021587565,v1:172.21.15.107:6827/1021587565] up:boot 2024-09-21T08:00:09.228 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:09 smithi107 ceph-mon[27622]: daemon mds.cephfs.smithi107.qusoyf assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-21T08:00:09.229 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:09 smithi107 ceph-mon[27622]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T08:00:09.229 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:09 smithi107 ceph-mon[27622]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T08:00:09.229 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:09 smithi107 ceph-mon[27622]: Cluster is now healthy 2024-09-21T08:00:09.229 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:09 smithi107 ceph-mon[27622]: fsmap cephfs:0 1 up:standby 2024-09-21T08:00:09.229 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:09 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.qusoyf"}]: dispatch 2024-09-21T08:00:09.229 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:09 smithi107 ceph-mon[27622]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:creating} 2024-09-21T08:00:09.229 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:09 smithi107 ceph-mon[27622]: daemon mds.cephfs.smithi107.qusoyf is now active in filesystem cephfs as rank 0 2024-09-21T08:00:09.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:09 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:09.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:09 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:09.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:09 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:09.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:09 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi129.fwmfcy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:00:09.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:09 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi129.fwmfcy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T08:00:09.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:09 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:00:09.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:09 smithi129 ceph-mon[34472]: Deploying daemon mds.cephfs.smithi129.fwmfcy on smithi129 2024-09-21T08:00:09.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:09 smithi129 ceph-mon[34472]: pgmap v173: 65 pgs: 3 creating+peering, 62 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:00:09.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:09 smithi129 ceph-mon[34472]: mds.? [v2:172.21.15.107:6826/1021587565,v1:172.21.15.107:6827/1021587565] up:boot 2024-09-21T08:00:09.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:09 smithi129 ceph-mon[34472]: daemon mds.cephfs.smithi107.qusoyf assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-21T08:00:09.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:09 smithi129 ceph-mon[34472]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T08:00:09.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:09 smithi129 ceph-mon[34472]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T08:00:09.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:09 smithi129 ceph-mon[34472]: Cluster is now healthy 2024-09-21T08:00:09.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:09 smithi129 ceph-mon[34472]: fsmap cephfs:0 1 up:standby 2024-09-21T08:00:09.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:09 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.qusoyf"}]: dispatch 2024-09-21T08:00:09.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:09 smithi129 ceph-mon[34472]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:creating} 2024-09-21T08:00:09.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:09 smithi129 ceph-mon[34472]: daemon mds.cephfs.smithi107.qusoyf is now active in filesystem cephfs as rank 0 2024-09-21T08:00:09.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.758+0000 7fe9ca435640 1 -- 172.21.15.107:0/415567838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9c4066790 msgr2=0x7fe9c40ff160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:09.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.758+0000 7fe9ca435640 1 --2- 172.21.15.107:0/415567838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9c4066790 0x7fe9c40ff160 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe9b40048d0 tx=0x7fe9b4009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.758+0000 7fe9ca435640 1 -- 172.21.15.107:0/415567838 shutdown_connections 2024-09-21T08:00:09.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.758+0000 7fe9ca435640 1 --2- 172.21.15.107:0/415567838 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe9c40ff6a0 0x7fe9c4101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.758+0000 7fe9ca435640 1 --2- 172.21.15.107:0/415567838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9c4066790 0x7fe9c40ff160 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.758+0000 7fe9ca435640 1 -- 172.21.15.107:0/415567838 >> 172.21.15.107:0/415567838 conn(0x7fe9c40f6c10 msgr2=0x7fe9c40f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.758+0000 7fe9ca435640 1 -- 172.21.15.107:0/415567838 shutdown_connections 2024-09-21T08:00:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.758+0000 7fe9ca435640 1 -- 172.21.15.107:0/415567838 wait complete. 2024-09-21T08:00:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.759+0000 7fe9ca435640 1 Processor -- start 2024-09-21T08:00:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.759+0000 7fe9ca435640 1 -- start start 2024-09-21T08:00:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.759+0000 7fe9ca435640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe9c4066790 0x7fe9c410d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.759+0000 7fe9ca435640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9c40ff6a0 0x7fe9c410d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.759+0000 7fe9ca435640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c410dc40 con 0x7fe9c40ff6a0 2024-09-21T08:00:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.759+0000 7fe9ca435640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c410e460 con 0x7fe9c4066790 2024-09-21T08:00:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.759+0000 7fe9c37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9c40ff6a0 0x7fe9c410d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.759+0000 7fe9c37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9c40ff6a0 0x7fe9c410d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44204/0 (socket says 172.21.15.107:44204) 2024-09-21T08:00:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.759+0000 7fe9c37fe640 1 -- 172.21.15.107:0/1223700931 learned_addr learned my addr 172.21.15.107:0/1223700931 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:00:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.759+0000 7fe9c3fff640 1 --2- 172.21.15.107:0/1223700931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe9c4066790 0x7fe9c410d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.760+0000 7fe9c37fe640 1 -- 172.21.15.107:0/1223700931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe9c4066790 msgr2=0x7fe9c410d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.760+0000 7fe9c37fe640 1 --2- 172.21.15.107:0/1223700931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe9c4066790 0x7fe9c410d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.760+0000 7fe9c37fe640 1 -- 172.21.15.107:0/1223700931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b4005040 con 0x7fe9c40ff6a0 2024-09-21T08:00:09.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.760+0000 7fe9c37fe640 1 --2- 172.21.15.107:0/1223700931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9c40ff6a0 0x7fe9c410d5f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8002a80 tx=0x7fe9b8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:09.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.760+0000 7fe9c0ff9640 1 -- 172.21.15.107:0/1223700931 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9b8007c30 con 0x7fe9c40ff6a0 2024-09-21T08:00:09.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.760+0000 7fe9ca435640 1 -- 172.21.15.107:0/1223700931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c410e6f0 con 0x7fe9c40ff6a0 2024-09-21T08:00:09.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.760+0000 7fe9c0ff9640 1 -- 172.21.15.107:0/1223700931 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe9b800f040 con 0x7fe9c40ff6a0 2024-09-21T08:00:09.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.760+0000 7fe9c0ff9640 1 -- 172.21.15.107:0/1223700931 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9b800dab0 con 0x7fe9c40ff6a0 2024-09-21T08:00:09.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.760+0000 7fe9ca435640 1 -- 172.21.15.107:0/1223700931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c410ec10 con 0x7fe9c40ff6a0 2024-09-21T08:00:09.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.761+0000 7fe9ca435640 1 -- 172.21.15.107:0/1223700931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c40fa8b0 con 0x7fe9c40ff6a0 2024-09-21T08:00:09.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.762+0000 7fe9c0ff9640 1 -- 172.21.15.107:0/1223700931 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fe9b800dc10 con 0x7fe9c40ff6a0 2024-09-21T08:00:09.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.762+0000 7fe9c0ff9640 1 --2- 172.21.15.107:0/1223700931 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe9ac06ed60 0x7fe9ac071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.762+0000 7fe9c3fff640 1 --2- 172.21.15.107:0/1223700931 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe9ac06ed60 0x7fe9ac071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:09.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.762+0000 7fe9c0ff9640 1 -- 172.21.15.107:0/1223700931 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe9b808da20 con 0x7fe9c40ff6a0 2024-09-21T08:00:09.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.763+0000 7fe9c3fff640 1 --2- 172.21.15.107:0/1223700931 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe9ac06ed60 0x7fe9ac071210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4000c00 tx=0x7fe9b4035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:09.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.766+0000 7fe9c0ff9640 1 -- 172.21.15.107:0/1223700931 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe9b804d2a0 con 0x7fe9c40ff6a0 2024-09-21T08:00:09.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:09.954+0000 7fe9ca435640 1 -- 172.21.15.107:0/1223700931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7fe9c404b720 con 0x7fe9c40ff6a0 2024-09-21T08:00:10.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:10.277+0000 7fe9c0ff9640 1 -- 172.21.15.107:0/1223700931 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7fe9b805abf0 con 0x7fe9c40ff6a0 2024-09-21T08:00:10.279 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:10 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:00:10.279 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:10 smithi107 ceph-mon[27622]: mds.? [v2:172.21.15.107:6826/1021587565,v1:172.21.15.107:6827/1021587565] up:active 2024-09-21T08:00:10.279 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:10 smithi107 ceph-mon[27622]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:active} 2024-09-21T08:00:10.279 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:10 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1223700931' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-21T08:00:10.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:10.279+0000 7fe9ca435640 1 -- 172.21.15.107:0/1223700931 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe9ac06ed60 msgr2=0x7fe9ac071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:10.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:10.279+0000 7fe9ca435640 1 --2- 172.21.15.107:0/1223700931 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe9ac06ed60 0x7fe9ac071210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4000c00 tx=0x7fe9b4035040 comp rx=0 tx=0).stop 2024-09-21T08:00:10.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:10.279+0000 7fe9ca435640 1 -- 172.21.15.107:0/1223700931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9c40ff6a0 msgr2=0x7fe9c410d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:10.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:10.279+0000 7fe9ca435640 1 --2- 172.21.15.107:0/1223700931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9c40ff6a0 0x7fe9c410d5f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8002a80 tx=0x7fe9b8004600 comp rx=0 tx=0).stop 2024-09-21T08:00:10.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:10.279+0000 7fe9ca435640 1 -- 172.21.15.107:0/1223700931 shutdown_connections 2024-09-21T08:00:10.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:10.279+0000 7fe9ca435640 1 --2- 172.21.15.107:0/1223700931 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fe9ac06ed60 0x7fe9ac071210 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:10.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:10.279+0000 7fe9ca435640 1 --2- 172.21.15.107:0/1223700931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9c40ff6a0 0x7fe9c410d5f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:10.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:10.279+0000 7fe9ca435640 1 --2- 172.21.15.107:0/1223700931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe9c4066790 0x7fe9c410d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:10.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:10.279+0000 7fe9ca435640 1 -- 172.21.15.107:0/1223700931 >> 172.21.15.107:0/1223700931 conn(0x7fe9c40f6c10 msgr2=0x7fe9c40f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:10.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:10.279+0000 7fe9ca435640 1 -- 172.21.15.107:0/1223700931 shutdown_connections 2024-09-21T08:00:10.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:10.279+0000 7fe9ca435640 1 -- 172.21.15.107:0/1223700931 wait complete. 2024-09-21T08:00:10.432 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:10 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:00:10.432 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:10 smithi129 ceph-mon[34472]: mds.? [v2:172.21.15.107:6826/1021587565,v1:172.21.15.107:6827/1021587565] up:active 2024-09-21T08:00:10.432 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:10 smithi129 ceph-mon[34472]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:active} 2024-09-21T08:00:10.432 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:10 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/1223700931' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-21T08:00:10.960 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T08:00:10.969 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi107.front.sepia.ceph.com 2024-09-21T08:00:10.969 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-09-21T08:00:11.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:11 smithi107 ceph-mon[27622]: pgmap v174: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 148 B/s wr, 0 op/s 2024-09-21T08:00:11.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:11 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1223700931' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-21T08:00:11.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:11 smithi107 ceph-mon[27622]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:active} 2024-09-21T08:00:11.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:11 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:11.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:11 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:11.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:11 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:11.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:11 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.grqzkt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:00:11.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:11 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.grqzkt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T08:00:11.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:11 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:00:11.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:11 smithi107 ceph-mon[27622]: Deploying daemon mds.cephfs.smithi107.grqzkt on smithi107 2024-09-21T08:00:11.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:11 smithi129 ceph-mon[34472]: pgmap v174: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 148 B/s wr, 0 op/s 2024-09-21T08:00:11.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:11 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/1223700931' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-21T08:00:11.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:11 smithi129 ceph-mon[34472]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:active} 2024-09-21T08:00:11.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:11 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:11.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:11 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:11.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:11 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:11.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:11 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.grqzkt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:00:11.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:11 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.grqzkt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T08:00:11.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:11 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:00:11.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:11 smithi129 ceph-mon[34472]: Deploying daemon mds.cephfs.smithi107.grqzkt on smithi107 2024-09-21T08:00:12.175 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:00:12.533 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:12 smithi107 ceph-mon[27622]: mds.? [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] up:boot 2024-09-21T08:00:12.534 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:12 smithi107 ceph-mon[27622]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:active} 1 up:standby 2024-09-21T08:00:12.534 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:12 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.fwmfcy"}]: dispatch 2024-09-21T08:00:12.534 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:12 smithi107 ceph-mon[27622]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:active} 1 up:standby 2024-09-21T08:00:12.598 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:12 smithi129 ceph-mon[34472]: mds.? [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] up:boot 2024-09-21T08:00:12.598 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:12 smithi129 ceph-mon[34472]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:active} 1 up:standby 2024-09-21T08:00:12.598 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:12 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.fwmfcy"}]: dispatch 2024-09-21T08:00:12.599 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:12 smithi129 ceph-mon[34472]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:active} 1 up:standby 2024-09-21T08:00:13.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:13 smithi129 ceph-mon[34472]: pgmap v175: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s wr, 2 op/s 2024-09-21T08:00:13.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:13 smithi107 ceph-mon[27622]: pgmap v175: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s wr, 2 op/s 2024-09-21T08:00:13.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.931+0000 7f106f1bd640 1 -- 172.21.15.107:0/1085911415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10680fd820 msgr2=0x7f10680fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:13.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.931+0000 7f106f1bd640 1 --2- 172.21.15.107:0/1085911415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10680fd820 0x7f10680fdc90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f10580048d0 tx=0x7f1058009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.931+0000 7f106f1bd640 1 -- 172.21.15.107:0/1085911415 shutdown_connections 2024-09-21T08:00:13.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.931+0000 7f106f1bd640 1 --2- 172.21.15.107:0/1085911415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10680fd820 0x7f10680fdc90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.931+0000 7f106f1bd640 1 --2- 172.21.15.107:0/1085911415 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f10680fc550 0x7f10680fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.931+0000 7f106f1bd640 1 -- 172.21.15.107:0/1085911415 >> 172.21.15.107:0/1085911415 conn(0x7f10680f7d30 msgr2=0x7f10680fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:13.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.931+0000 7f106f1bd640 1 -- 172.21.15.107:0/1085911415 shutdown_connections 2024-09-21T08:00:13.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.931+0000 7f106f1bd640 1 -- 172.21.15.107:0/1085911415 wait complete. 2024-09-21T08:00:13.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.932+0000 7f106f1bd640 1 Processor -- start 2024-09-21T08:00:13.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.932+0000 7f106f1bd640 1 -- start start 2024-09-21T08:00:13.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.932+0000 7f106f1bd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f10680fc550 0x7f106810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.932+0000 7f106f1bd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10680fd820 0x7f106810d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.932+0000 7f106f1bd640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106810dc40 con 0x7f10680fd820 2024-09-21T08:00:13.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.932+0000 7f106f1bd640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106810e460 con 0x7f10680fc550 2024-09-21T08:00:13.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.932+0000 7f105ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10680fd820 0x7f106810d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.932+0000 7f105ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10680fd820 0x7f106810d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39460/0 (socket says 172.21.15.107:39460) 2024-09-21T08:00:13.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.932+0000 7f105ffff640 1 -- 172.21.15.107:0/204287530 learned_addr learned my addr 172.21.15.107:0/204287530 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:00:13.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.932+0000 7f106cf59640 1 --2- 172.21.15.107:0/204287530 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f10680fc550 0x7f106810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.933+0000 7f105ffff640 1 -- 172.21.15.107:0/204287530 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f10680fc550 msgr2=0x7f106810d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:13.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.933+0000 7f105ffff640 1 --2- 172.21.15.107:0/204287530 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f10680fc550 0x7f106810d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.933+0000 7f105ffff640 1 -- 172.21.15.107:0/204287530 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1058005040 con 0x7f10680fd820 2024-09-21T08:00:13.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.933+0000 7f105ffff640 1 --2- 172.21.15.107:0/204287530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10680fd820 0x7f106810d5f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f10580048a0 tx=0x7f1058009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:13.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.933+0000 7f105d7fa640 1 -- 172.21.15.107:0/204287530 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1058038070 con 0x7f10680fd820 2024-09-21T08:00:13.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.933+0000 7f106f1bd640 1 -- 172.21.15.107:0/204287530 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106810e690 con 0x7f10680fd820 2024-09-21T08:00:13.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.933+0000 7f105d7fa640 1 -- 172.21.15.107:0/204287530 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1058004290 con 0x7f10680fd820 2024-09-21T08:00:13.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.933+0000 7f105d7fa640 1 -- 172.21.15.107:0/204287530 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1058033660 con 0x7f10680fd820 2024-09-21T08:00:13.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.933+0000 7f106f1bd640 1 -- 172.21.15.107:0/204287530 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106810ec30 con 0x7f10680fd820 2024-09-21T08:00:13.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.934+0000 7f106f1bd640 1 -- 172.21.15.107:0/204287530 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10680fb9b0 con 0x7f10680fd820 2024-09-21T08:00:13.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.934+0000 7f105d7fa640 1 -- 172.21.15.107:0/204287530 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f1058030020 con 0x7f10680fd820 2024-09-21T08:00:13.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.935+0000 7f105d7fa640 1 --2- 172.21.15.107:0/204287530 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f105006ed60 0x7f1050071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.935+0000 7f105d7fa640 1 -- 172.21.15.107:0/204287530 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f10580ae2e0 con 0x7f10680fd820 2024-09-21T08:00:13.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.935+0000 7f106cf59640 1 --2- 172.21.15.107:0/204287530 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f105006ed60 0x7f1050071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.935+0000 7f106cf59640 1 --2- 172.21.15.107:0/204287530 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f105006ed60 0x7f1050071210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1064009af0 tx=0x7f106400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:13.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:13.939+0000 7f105d7fa640 1 -- 172.21.15.107:0/204287530 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f105807b4b0 con 0x7f10680fd820 2024-09-21T08:00:14.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:14.154+0000 7f106f1bd640 1 -- 172.21.15.107:0/204287530 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f106804b720 con 0x7f10680fd820 2024-09-21T08:00:14.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:14.292+0000 7f105d7fa640 1 -- 172.21.15.107:0/204287530 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f105802c870 con 0x7f10680fd820 2024-09-21T08:00:14.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:14.294+0000 7f106f1bd640 1 -- 172.21.15.107:0/204287530 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f105006ed60 msgr2=0x7f1050071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:14.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:14.294+0000 7f106f1bd640 1 --2- 172.21.15.107:0/204287530 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f105006ed60 0x7f1050071210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1064009af0 tx=0x7f106400b040 comp rx=0 tx=0).stop 2024-09-21T08:00:14.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:14.294+0000 7f106f1bd640 1 -- 172.21.15.107:0/204287530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10680fd820 msgr2=0x7f106810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:14.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:14.294+0000 7f106f1bd640 1 --2- 172.21.15.107:0/204287530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10680fd820 0x7f106810d5f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f10580048a0 tx=0x7f1058009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:14.294+0000 7f106f1bd640 1 -- 172.21.15.107:0/204287530 shutdown_connections 2024-09-21T08:00:14.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:14.294+0000 7f106f1bd640 1 --2- 172.21.15.107:0/204287530 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f105006ed60 0x7f1050071210 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:14.294+0000 7f106f1bd640 1 --2- 172.21.15.107:0/204287530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10680fd820 0x7f106810d5f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:14.294+0000 7f106f1bd640 1 --2- 172.21.15.107:0/204287530 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f10680fc550 0x7f106810d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:14.294+0000 7f106f1bd640 1 -- 172.21.15.107:0/204287530 >> 172.21.15.107:0/204287530 conn(0x7f10680f7d30 msgr2=0x7f10680f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:14.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:14.295+0000 7f106f1bd640 1 -- 172.21.15.107:0/204287530 shutdown_connections 2024-09-21T08:00:14.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:14.295+0000 7f106f1bd640 1 -- 172.21.15.107:0/204287530 wait complete. 2024-09-21T08:00:14.422 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:14 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/204287530' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-21T08:00:14.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:14 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/204287530' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-21T08:00:15.130 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T08:00:15.143 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi107.front.sepia.ceph.com 2024-09-21T08:00:15.143 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- bash -c 'ceph fs set cephfs inline_data false' 2024-09-21T08:00:15.406 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:00:15.527 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:15 smithi107 ceph-mon[27622]: pgmap v176: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-21T08:00:15.527 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:15 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/204287530' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-21T08:00:15.527 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:15 smithi107 ceph-mon[27622]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:active} 1 up:standby 2024-09-21T08:00:15.527 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:15 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:15.527 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:15 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:15.527 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:15 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:15.527 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:15 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi129.belyba", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:00:15.528 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:15 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi129.belyba", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T08:00:15.528 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:15 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:00:15.528 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:15 smithi107 ceph-mon[27622]: Deploying daemon mds.cephfs.smithi129.belyba on smithi129 2024-09-21T08:00:15.666 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:15 smithi129 ceph-mon[34472]: pgmap v176: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-21T08:00:15.666 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:15 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/204287530' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-21T08:00:15.666 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:15 smithi129 ceph-mon[34472]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:active} 1 up:standby 2024-09-21T08:00:15.666 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:15 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:15.666 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:15 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:15.667 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:15 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:15.667 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:15 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi129.belyba", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:00:15.667 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:15 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi129.belyba", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T08:00:15.667 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:15 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:00:15.667 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:15 smithi129 ceph-mon[34472]: Deploying daemon mds.cephfs.smithi129.belyba on smithi129 2024-09-21T08:00:16.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:16 smithi107 ceph-mon[27622]: mds.? [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] up:boot 2024-09-21T08:00:16.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:16 smithi107 ceph-mon[27622]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:active} 2 up:standby 2024-09-21T08:00:16.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:16 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.grqzkt"}]: dispatch 2024-09-21T08:00:16.647 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:16 smithi129 ceph-mon[34472]: mds.? [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] up:boot 2024-09-21T08:00:16.647 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:16 smithi129 ceph-mon[34472]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:active} 2 up:standby 2024-09-21T08:00:16.647 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:16 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.grqzkt"}]: dispatch 2024-09-21T08:00:17.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.058+0000 7fb90fa5a640 1 -- 172.21.15.107:0/2173967271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9080fc520 msgr2=0x7fb9080fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:17.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.058+0000 7fb90fa5a640 1 --2- 172.21.15.107:0/2173967271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9080fc520 0x7fb9080fc930 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc0048d0 tx=0x7fb8fc009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.058+0000 7fb90fa5a640 1 -- 172.21.15.107:0/2173967271 shutdown_connections 2024-09-21T08:00:17.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.058+0000 7fb90fa5a640 1 --2- 172.21.15.107:0/2173967271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb9080fd7f0 0x7fb9080fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.058+0000 7fb90fa5a640 1 --2- 172.21.15.107:0/2173967271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9080fc520 0x7fb9080fc930 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.058+0000 7fb90fa5a640 1 -- 172.21.15.107:0/2173967271 >> 172.21.15.107:0/2173967271 conn(0x7fb9080f7ce0 msgr2=0x7fb9080fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:17.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.058+0000 7fb90fa5a640 1 -- 172.21.15.107:0/2173967271 shutdown_connections 2024-09-21T08:00:17.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.058+0000 7fb90fa5a640 1 -- 172.21.15.107:0/2173967271 wait complete. 2024-09-21T08:00:17.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.058+0000 7fb90fa5a640 1 Processor -- start 2024-09-21T08:00:17.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.059+0000 7fb90fa5a640 1 -- start start 2024-09-21T08:00:17.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.059+0000 7fb90fa5a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9080fc520 0x7fb90810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:17.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.059+0000 7fb90fa5a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb9080fd7f0 0x7fb90810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:17.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.059+0000 7fb90fa5a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90810dc10 con 0x7fb9080fc520 2024-09-21T08:00:17.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.059+0000 7fb90fa5a640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90810e430 con 0x7fb9080fd7f0 2024-09-21T08:00:17.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.059+0000 7fb90d7f6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9080fc520 0x7fb90810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:17.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.059+0000 7fb90d7f6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9080fc520 0x7fb90810d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39486/0 (socket says 172.21.15.107:39486) 2024-09-21T08:00:17.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.059+0000 7fb90d7f6640 1 -- 172.21.15.107:0/2053369877 learned_addr learned my addr 172.21.15.107:0/2053369877 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:00:17.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.059+0000 7fb90cff5640 1 --2- 172.21.15.107:0/2053369877 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb9080fd7f0 0x7fb90810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:17.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.059+0000 7fb90d7f6640 1 -- 172.21.15.107:0/2053369877 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb9080fd7f0 msgr2=0x7fb90810d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:17.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.059+0000 7fb90d7f6640 1 --2- 172.21.15.107:0/2053369877 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb9080fd7f0 0x7fb90810d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.059+0000 7fb90d7f6640 1 -- 172.21.15.107:0/2053369877 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8fc005040 con 0x7fb9080fc520 2024-09-21T08:00:17.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.059+0000 7fb90d7f6640 1 --2- 172.21.15.107:0/2053369877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9080fc520 0x7fb90810d080 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc0043d0 tx=0x7fb8fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:17.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.059+0000 7fb8f9ffb640 1 -- 172.21.15.107:0/2053369877 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8fc038070 con 0x7fb9080fc520 2024-09-21T08:00:17.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.059+0000 7fb8f9ffb640 1 -- 172.21.15.107:0/2053369877 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb8fc02ae90 con 0x7fb9080fc520 2024-09-21T08:00:17.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.059+0000 7fb8f9ffb640 1 -- 172.21.15.107:0/2053369877 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8fc03e670 con 0x7fb9080fc520 2024-09-21T08:00:17.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.059+0000 7fb90fa5a640 1 -- 172.21.15.107:0/2053369877 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb90810e660 con 0x7fb9080fc520 2024-09-21T08:00:17.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.060+0000 7fb90fa5a640 1 -- 172.21.15.107:0/2053369877 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb90810ec00 con 0x7fb9080fc520 2024-09-21T08:00:17.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.061+0000 7fb90fa5a640 1 -- 172.21.15.107:0/2053369877 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9080fb980 con 0x7fb9080fc520 2024-09-21T08:00:17.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.061+0000 7fb8f9ffb640 1 -- 172.21.15.107:0/2053369877 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fb8fc030020 con 0x7fb9080fc520 2024-09-21T08:00:17.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.061+0000 7fb8f9ffb640 1 --2- 172.21.15.107:0/2053369877 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fb8f406ed60 0x7fb8f4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:17.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.062+0000 7fb8f9ffb640 1 -- 172.21.15.107:0/2053369877 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb8fc0ae370 con 0x7fb9080fc520 2024-09-21T08:00:17.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.062+0000 7fb90cff5640 1 --2- 172.21.15.107:0/2053369877 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fb8f406ed60 0x7fb8f4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:17.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.062+0000 7fb90cff5640 1 --2- 172.21.15.107:0/2053369877 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fb8f406ed60 0x7fb8f4071210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb90810ce30 tx=0x7fb90400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:17.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.066+0000 7fb8f9ffb640 1 -- 172.21.15.107:0/2053369877 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb8fc07b540 con 0x7fb9080fc520 2024-09-21T08:00:17.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.277+0000 7fb90fa5a640 1 -- 172.21.15.107:0/2053369877 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7fb90804b720 con 0x7fb9080fc520 2024-09-21T08:00:17.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.305+0000 7fb8f9ffb640 1 -- 172.21.15.107:0/2053369877 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v11) v1 ==== 133+0+0 (secure 0 0 0) 0x7fb8fc07aee0 con 0x7fb9080fc520 2024-09-21T08:00:17.307 INFO:teuthology.orchestra.run.smithi107.stderr:inline data disabled 2024-09-21T08:00:17.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.308+0000 7fb90fa5a640 1 -- 172.21.15.107:0/2053369877 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fb8f406ed60 msgr2=0x7fb8f4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:17.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.308+0000 7fb90fa5a640 1 --2- 172.21.15.107:0/2053369877 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fb8f406ed60 0x7fb8f4071210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb90810ce30 tx=0x7fb90400b040 comp rx=0 tx=0).stop 2024-09-21T08:00:17.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.308+0000 7fb90fa5a640 1 -- 172.21.15.107:0/2053369877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9080fc520 msgr2=0x7fb90810d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:17.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.308+0000 7fb90fa5a640 1 --2- 172.21.15.107:0/2053369877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9080fc520 0x7fb90810d080 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc0043d0 tx=0x7fb8fc009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.308+0000 7fb90fa5a640 1 -- 172.21.15.107:0/2053369877 shutdown_connections 2024-09-21T08:00:17.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.308+0000 7fb90fa5a640 1 --2- 172.21.15.107:0/2053369877 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb9080fd7f0 0x7fb90810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.308+0000 7fb90fa5a640 1 --2- 172.21.15.107:0/2053369877 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fb8f406ed60 0x7fb8f4071210 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.308+0000 7fb90fa5a640 1 --2- 172.21.15.107:0/2053369877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9080fc520 0x7fb90810d080 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.308+0000 7fb90fa5a640 1 -- 172.21.15.107:0/2053369877 >> 172.21.15.107:0/2053369877 conn(0x7fb9080f7ce0 msgr2=0x7fb9080f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:17.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.308+0000 7fb90fa5a640 1 -- 172.21.15.107:0/2053369877 shutdown_connections 2024-09-21T08:00:17.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:17.308+0000 7fb90fa5a640 1 -- 172.21.15.107:0/2053369877 wait complete. 2024-09-21T08:00:17.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:17 smithi107 ceph-mon[27622]: pgmap v177: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-09-21T08:00:17.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:17 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:17.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:17 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:17.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:17 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:17.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:17 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:17.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:17 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:17.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:17 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:00:17.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:17 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/2053369877' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-21T08:00:17.759 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:17 smithi129 ceph-mon[34472]: pgmap v177: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-09-21T08:00:17.759 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:17 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:17.759 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:17 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:17.759 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:17 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:17.759 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:17 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:17.759 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:17 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:17.759 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:17 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:00:17.759 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:17 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/2053369877' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-21T08:00:18.081 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T08:00:18.090 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi107.front.sepia.ceph.com 2024-09-21T08:00:18.091 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T08:00:18.579 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:18 smithi107 ceph-mon[27622]: mds.? [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] up:boot 2024-09-21T08:00:18.579 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:18 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/2053369877' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-21T08:00:18.579 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:18 smithi107 ceph-mon[27622]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:active} 3 up:standby 2024-09-21T08:00:18.579 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:18 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.belyba"}]: dispatch 2024-09-21T08:00:18.592 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:18 smithi129 ceph-mon[34472]: mds.? [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] up:boot 2024-09-21T08:00:18.592 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:18 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/2053369877' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-21T08:00:18.593 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:18 smithi129 ceph-mon[34472]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:active} 3 up:standby 2024-09-21T08:00:18.593 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:18 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.belyba"}]: dispatch 2024-09-21T08:00:18.992 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:00:19.372 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:19 smithi107 ceph-mon[27622]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-21T08:00:19.372 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:19 smithi107 ceph-mon[27622]: Dropping low affinity active daemon mds.cephfs.smithi107.qusoyf in favor of higher affinity standby. 2024-09-21T08:00:19.372 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:19 smithi107 ceph-mon[27622]: Replacing daemon mds.cephfs.smithi107.qusoyf as rank 0 with standby daemon mds.cephfs.smithi107.grqzkt 2024-09-21T08:00:19.372 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:19 smithi107 ceph-mon[27622]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T08:00:19.372 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:19 smithi107 ceph-mon[27622]: osdmap e44: 6 total, 6 up, 6 in 2024-09-21T08:00:19.372 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:19 smithi107 ceph-mon[27622]: mds.? [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] up:standby 2024-09-21T08:00:19.372 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:19 smithi107 ceph-mon[27622]: fsmap cephfs:1/1 {0=cephfs.smithi107.grqzkt=up:replay} 2 up:standby 2024-09-21T08:00:19.372 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:19 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:19.372 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:19 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:19.372 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:19 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:19.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:19 smithi129 ceph-mon[34472]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-21T08:00:19.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:19 smithi129 ceph-mon[34472]: Dropping low affinity active daemon mds.cephfs.smithi107.qusoyf in favor of higher affinity standby. 2024-09-21T08:00:19.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:19 smithi129 ceph-mon[34472]: Replacing daemon mds.cephfs.smithi107.qusoyf as rank 0 with standby daemon mds.cephfs.smithi107.grqzkt 2024-09-21T08:00:19.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:19 smithi129 ceph-mon[34472]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T08:00:19.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:19 smithi129 ceph-mon[34472]: osdmap e44: 6 total, 6 up, 6 in 2024-09-21T08:00:19.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:19 smithi129 ceph-mon[34472]: mds.? [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] up:standby 2024-09-21T08:00:19.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:19 smithi129 ceph-mon[34472]: fsmap cephfs:1/1 {0=cephfs.smithi107.grqzkt=up:replay} 2 up:standby 2024-09-21T08:00:19.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:19 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:19.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:19 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:19.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:19 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:20.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:20 smithi129 ceph-mon[34472]: mds.? [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] up:standby 2024-09-21T08:00:20.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:20 smithi129 ceph-mon[34472]: mds.? [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] up:reconnect 2024-09-21T08:00:20.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:20 smithi129 ceph-mon[34472]: mds.? [v2:172.21.15.107:6826/2352538667,v1:172.21.15.107:6827/2352538667] up:boot 2024-09-21T08:00:20.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:20 smithi129 ceph-mon[34472]: fsmap cephfs:1/1 {0=cephfs.smithi107.grqzkt=up:reconnect} 3 up:standby 2024-09-21T08:00:20.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:20 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.qusoyf"}]: dispatch 2024-09-21T08:00:20.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:20 smithi107 ceph-mon[27622]: mds.? [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] up:standby 2024-09-21T08:00:20.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:20 smithi107 ceph-mon[27622]: mds.? [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] up:reconnect 2024-09-21T08:00:20.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:20 smithi107 ceph-mon[27622]: mds.? [v2:172.21.15.107:6826/2352538667,v1:172.21.15.107:6827/2352538667] up:boot 2024-09-21T08:00:20.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:20 smithi107 ceph-mon[27622]: fsmap cephfs:1/1 {0=cephfs.smithi107.grqzkt=up:reconnect} 3 up:standby 2024-09-21T08:00:20.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:20 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.qusoyf"}]: dispatch 2024-09-21T08:00:21.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.141+0000 7f56dc818640 1 -- 172.21.15.107:0/1397327581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56d80fd830 msgr2=0x7f56d80fdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:21.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.141+0000 7f56dc818640 1 --2- 172.21.15.107:0/1397327581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56d80fd830 0x7f56d80fdca0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f56c00048d0 tx=0x7f56c0009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.141+0000 7f56dc818640 1 -- 172.21.15.107:0/1397327581 shutdown_connections 2024-09-21T08:00:21.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.141+0000 7f56dc818640 1 --2- 172.21.15.107:0/1397327581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56d80fd830 0x7f56d80fdca0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.141+0000 7f56dc818640 1 --2- 172.21.15.107:0/1397327581 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f56d80fc560 0x7f56d80fc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.141+0000 7f56dc818640 1 -- 172.21.15.107:0/1397327581 >> 172.21.15.107:0/1397327581 conn(0x7f56d80f7d40 msgr2=0x7f56d80fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:21.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.141+0000 7f56dc818640 1 -- 172.21.15.107:0/1397327581 shutdown_connections 2024-09-21T08:00:21.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.141+0000 7f56dc818640 1 -- 172.21.15.107:0/1397327581 wait complete. 2024-09-21T08:00:21.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.142+0000 7f56dc818640 1 Processor -- start 2024-09-21T08:00:21.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.142+0000 7f56dc818640 1 -- start start 2024-09-21T08:00:21.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.142+0000 7f56dc818640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f56d80fc560 0x7f56d810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.142+0000 7f56dc818640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56d80fd830 0x7f56d810d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.142+0000 7f56dc818640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d810dc40 con 0x7f56d80fd830 2024-09-21T08:00:21.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.142+0000 7f56dc818640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d810e410 con 0x7f56d80fc560 2024-09-21T08:00:21.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.142+0000 7f56d5d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56d80fd830 0x7f56d810d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.142+0000 7f56d5d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56d80fd830 0x7f56d810d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43956/0 (socket says 172.21.15.107:43956) 2024-09-21T08:00:21.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.142+0000 7f56d5d9b640 1 -- 172.21.15.107:0/1689415567 learned_addr learned my addr 172.21.15.107:0/1689415567 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:00:21.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.142+0000 7f56d659c640 1 --2- 172.21.15.107:0/1689415567 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f56d80fc560 0x7f56d810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.142+0000 7f56d5d9b640 1 -- 172.21.15.107:0/1689415567 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f56d80fc560 msgr2=0x7f56d810d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:21.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.142+0000 7f56d5d9b640 1 --2- 172.21.15.107:0/1689415567 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f56d80fc560 0x7f56d810d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.142+0000 7f56d5d9b640 1 -- 172.21.15.107:0/1689415567 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c0005040 con 0x7f56d80fd830 2024-09-21T08:00:21.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.142+0000 7f56d5d9b640 1 --2- 172.21.15.107:0/1689415567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56d80fd830 0x7f56d810d5f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f56c00043d0 tx=0x7f56c0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:21.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.143+0000 7f56ceffd640 1 -- 172.21.15.107:0/1689415567 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56c0038070 con 0x7f56d80fd830 2024-09-21T08:00:21.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.143+0000 7f56dc818640 1 -- 172.21.15.107:0/1689415567 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d810e640 con 0x7f56d80fd830 2024-09-21T08:00:21.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.143+0000 7f56ceffd640 1 -- 172.21.15.107:0/1689415567 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f56c002ae90 con 0x7f56d80fd830 2024-09-21T08:00:21.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.143+0000 7f56ceffd640 1 -- 172.21.15.107:0/1689415567 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56c003e670 con 0x7f56d80fd830 2024-09-21T08:00:21.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.143+0000 7f56dc818640 1 -- 172.21.15.107:0/1689415567 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d810eb60 con 0x7f56d80fd830 2024-09-21T08:00:21.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.144+0000 7f56dc818640 1 -- 172.21.15.107:0/1689415567 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d80fb9c0 con 0x7f56d80fd830 2024-09-21T08:00:21.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.144+0000 7f56ceffd640 1 -- 172.21.15.107:0/1689415567 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f56c0030020 con 0x7f56d80fd830 2024-09-21T08:00:21.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.145+0000 7f56ceffd640 1 --2- 172.21.15.107:0/1689415567 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f56c406ed60 0x7f56c4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.145+0000 7f56ceffd640 1 -- 172.21.15.107:0/1689415567 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f56c00ae3c0 con 0x7f56d80fd830 2024-09-21T08:00:21.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.145+0000 7f56d659c640 1 --2- 172.21.15.107:0/1689415567 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f56c406ed60 0x7f56c4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.145+0000 7f56d659c640 1 --2- 172.21.15.107:0/1689415567 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f56c406ed60 0x7f56c4071210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f56d00102e0 tx=0x7f56d0009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:21.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.149+0000 7f56ceffd640 1 -- 172.21.15.107:0/1689415567 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f56c007b540 con 0x7f56d80fd830 2024-09-21T08:00:21.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.337+0000 7f56dc818640 1 -- 172.21.15.107:0/1689415567 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f56d810ee20 con 0x7f56d80fd830 2024-09-21T08:00:21.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.338+0000 7f56ceffd640 1 -- 172.21.15.107:0/1689415567 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1801 (secure 0 0 0) 0x7f56c007aee0 con 0x7f56d80fd830 2024-09-21T08:00:21.340 INFO:teuthology.orchestra.run.smithi107.stdout:e14 2024-09-21T08:00:21.340 INFO:teuthology.orchestra.run.smithi107.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T08:00:21.340 INFO:teuthology.orchestra.run.smithi107.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:00:21.340 INFO:teuthology.orchestra.run.smithi107.stdout:legacy client fscid: 1 2024-09-21T08:00:21.340 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:00:21.340 INFO:teuthology.orchestra.run.smithi107.stdout:Filesystem 'cephfs' (1) 2024-09-21T08:00:21.340 INFO:teuthology.orchestra.run.smithi107.stdout:fs_name cephfs 2024-09-21T08:00:21.340 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 14 2024-09-21T08:00:21.340 INFO:teuthology.orchestra.run.smithi107.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T08:00:21.340 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-09-21T08:00:03.244314+0000 2024-09-21T08:00:21.340 INFO:teuthology.orchestra.run.smithi107.stdout:modified 2024-09-21T08:00:20.454484+0000 2024-09-21T08:00:21.340 INFO:teuthology.orchestra.run.smithi107.stdout:tableserver 0 2024-09-21T08:00:21.341 INFO:teuthology.orchestra.run.smithi107.stdout:root 0 2024-09-21T08:00:21.341 INFO:teuthology.orchestra.run.smithi107.stdout:session_timeout 60 2024-09-21T08:00:21.341 INFO:teuthology.orchestra.run.smithi107.stdout:session_autoclose 300 2024-09-21T08:00:21.341 INFO:teuthology.orchestra.run.smithi107.stdout:max_file_size 1099511627776 2024-09-21T08:00:21.341 INFO:teuthology.orchestra.run.smithi107.stdout:required_client_features {} 2024-09-21T08:00:21.341 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure 0 2024-09-21T08:00:21.341 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure_osd_epoch 44 2024-09-21T08:00:21.341 INFO:teuthology.orchestra.run.smithi107.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:00:21.341 INFO:teuthology.orchestra.run.smithi107.stdout:max_mds 1 2024-09-21T08:00:21.341 INFO:teuthology.orchestra.run.smithi107.stdout:in 0 2024-09-21T08:00:21.341 INFO:teuthology.orchestra.run.smithi107.stdout:up {0=14458} 2024-09-21T08:00:21.341 INFO:teuthology.orchestra.run.smithi107.stdout:failed 2024-09-21T08:00:21.341 INFO:teuthology.orchestra.run.smithi107.stdout:damaged 2024-09-21T08:00:21.341 INFO:teuthology.orchestra.run.smithi107.stdout:stopped 2024-09-21T08:00:21.341 INFO:teuthology.orchestra.run.smithi107.stdout:data_pools [3] 2024-09-21T08:00:21.342 INFO:teuthology.orchestra.run.smithi107.stdout:metadata_pool 2 2024-09-21T08:00:21.342 INFO:teuthology.orchestra.run.smithi107.stdout:inline_data disabled 2024-09-21T08:00:21.342 INFO:teuthology.orchestra.run.smithi107.stdout:balancer 2024-09-21T08:00:21.342 INFO:teuthology.orchestra.run.smithi107.stdout:standby_count_wanted 1 2024-09-21T08:00:21.342 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.grqzkt{0:14458} state up:rejoin seq 4 join_fscid=1 addr [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:00:21.342 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:00:21.342 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:00:21.342 INFO:teuthology.orchestra.run.smithi107.stdout:Standby daemons: 2024-09-21T08:00:21.342 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:00:21.342 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.qusoyf{-1:14468} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6826/2352538667,v1:172.21.15.107:6827/2352538667] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:00:21.342 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.fwmfcy{-1:24239} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:00:21.342 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.belyba{-1:24247} state up:standby seq 1 addr [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:00:21.343 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 14 2024-09-21T08:00:21.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.340+0000 7f56dc818640 1 -- 172.21.15.107:0/1689415567 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f56c406ed60 msgr2=0x7f56c4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:21.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.340+0000 7f56dc818640 1 --2- 172.21.15.107:0/1689415567 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f56c406ed60 0x7f56c4071210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f56d00102e0 tx=0x7f56d0009040 comp rx=0 tx=0).stop 2024-09-21T08:00:21.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.340+0000 7f56dc818640 1 -- 172.21.15.107:0/1689415567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56d80fd830 msgr2=0x7f56d810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:21.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.340+0000 7f56dc818640 1 --2- 172.21.15.107:0/1689415567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56d80fd830 0x7f56d810d5f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f56c00043d0 tx=0x7f56c0009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.340+0000 7f56dc818640 1 -- 172.21.15.107:0/1689415567 shutdown_connections 2024-09-21T08:00:21.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.340+0000 7f56dc818640 1 --2- 172.21.15.107:0/1689415567 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f56c406ed60 0x7f56c4071210 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.340+0000 7f56dc818640 1 --2- 172.21.15.107:0/1689415567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56d80fd830 0x7f56d810d5f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.340+0000 7f56dc818640 1 --2- 172.21.15.107:0/1689415567 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f56d80fc560 0x7f56d810d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.340+0000 7f56dc818640 1 -- 172.21.15.107:0/1689415567 >> 172.21.15.107:0/1689415567 conn(0x7f56d80f7d40 msgr2=0x7f56d80f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:21.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.340+0000 7f56dc818640 1 -- 172.21.15.107:0/1689415567 shutdown_connections 2024-09-21T08:00:21.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:21.340+0000 7f56dc818640 1 -- 172.21.15.107:0/1689415567 wait complete. 2024-09-21T08:00:21.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:21 smithi129 ceph-mon[34472]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-21T08:00:21.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:21 smithi129 ceph-mon[34472]: mds.? [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] up:rejoin 2024-09-21T08:00:21.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:21 smithi129 ceph-mon[34472]: fsmap cephfs:1/1 {0=cephfs.smithi107.grqzkt=up:rejoin} 3 up:standby 2024-09-21T08:00:21.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:21 smithi129 ceph-mon[34472]: daemon mds.cephfs.smithi107.grqzkt is now active in filesystem cephfs as rank 0 2024-09-21T08:00:21.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:21 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/1689415567' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:00:21.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:21 smithi107 ceph-mon[27622]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-21T08:00:21.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:21 smithi107 ceph-mon[27622]: mds.? [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] up:rejoin 2024-09-21T08:00:21.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:21 smithi107 ceph-mon[27622]: fsmap cephfs:1/1 {0=cephfs.smithi107.grqzkt=up:rejoin} 3 up:standby 2024-09-21T08:00:21.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:21 smithi107 ceph-mon[27622]: daemon mds.cephfs.smithi107.grqzkt is now active in filesystem cephfs as rank 0 2024-09-21T08:00:21.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:21 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1689415567' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:00:22.230 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-21T08:00:22.612 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:00:22.735 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:22 smithi107 ceph-mon[27622]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T08:00:22.735 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:22 smithi107 ceph-mon[27622]: Cluster is now healthy 2024-09-21T08:00:22.735 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:22 smithi107 ceph-mon[27622]: mds.? [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] up:active 2024-09-21T08:00:22.735 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:22 smithi107 ceph-mon[27622]: mds.? [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] up:standby 2024-09-21T08:00:22.735 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:22 smithi107 ceph-mon[27622]: fsmap cephfs:1 {0=cephfs.smithi107.grqzkt=up:active} 3 up:standby 2024-09-21T08:00:22.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:22 smithi129 ceph-mon[34472]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T08:00:22.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:22 smithi129 ceph-mon[34472]: Cluster is now healthy 2024-09-21T08:00:22.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:22 smithi129 ceph-mon[34472]: mds.? [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] up:active 2024-09-21T08:00:22.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:22 smithi129 ceph-mon[34472]: mds.? [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] up:standby 2024-09-21T08:00:22.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:22 smithi129 ceph-mon[34472]: fsmap cephfs:1 {0=cephfs.smithi107.grqzkt=up:active} 3 up:standby 2024-09-21T08:00:23.687 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:23 smithi107 ceph-mon[27622]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 204 B/s wr, 3 op/s 2024-09-21T08:00:23.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:23 smithi129 ceph-mon[34472]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 204 B/s wr, 3 op/s 2024-09-21T08:00:24.600 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:00:24.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:24 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:00:25.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.138+0000 7f07fdd3f640 1 -- 172.21.15.107:0/2296231745 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07f80fc550 msgr2=0x7f07f80fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.138+0000 7f07fdd3f640 1 --2- 172.21.15.107:0/2296231745 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07f80fc550 0x7f07f80fc960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009c50 tx=0x7f07e8004d10 comp rx=0 tx=0).stop 2024-09-21T08:00:25.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.138+0000 7f07fdd3f640 1 -- 172.21.15.107:0/2296231745 shutdown_connections 2024-09-21T08:00:25.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.138+0000 7f07fdd3f640 1 --2- 172.21.15.107:0/2296231745 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07f80fd820 0x7f07f80fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.138+0000 7f07fdd3f640 1 --2- 172.21.15.107:0/2296231745 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07f80fc550 0x7f07f80fc960 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.138+0000 7f07fdd3f640 1 -- 172.21.15.107:0/2296231745 >> 172.21.15.107:0/2296231745 conn(0x7f07f80f7d30 msgr2=0x7f07f80fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:25.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.138+0000 7f07fdd3f640 1 -- 172.21.15.107:0/2296231745 shutdown_connections 2024-09-21T08:00:25.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.138+0000 7f07fdd3f640 1 -- 172.21.15.107:0/2296231745 wait complete. 2024-09-21T08:00:25.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.138+0000 7f07fdd3f640 1 Processor -- start 2024-09-21T08:00:25.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.138+0000 7f07fdd3f640 1 -- start start 2024-09-21T08:00:25.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.138+0000 7f07fdd3f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07f80fc550 0x7f07f810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.139+0000 7f07fdd3f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07f80fd820 0x7f07f810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.139+0000 7f07fdd3f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f810dc10 con 0x7f07f80fd820 2024-09-21T08:00:25.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.139+0000 7f07fdd3f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f810e430 con 0x7f07f80fc550 2024-09-21T08:00:25.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.139+0000 7f07f6ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07f80fd820 0x7f07f810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.139+0000 7f07f6ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07f80fd820 0x7f07f810d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43966/0 (socket says 172.21.15.107:43966) 2024-09-21T08:00:25.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.139+0000 7f07f6ffd640 1 -- 172.21.15.107:0/2632709989 learned_addr learned my addr 172.21.15.107:0/2632709989 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:00:25.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.139+0000 7f07f77fe640 1 --2- 172.21.15.107:0/2632709989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07f80fc550 0x7f07f810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.139+0000 7f07f6ffd640 1 -- 172.21.15.107:0/2632709989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07f80fc550 msgr2=0x7f07f810d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.139+0000 7f07f6ffd640 1 --2- 172.21.15.107:0/2632709989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07f80fc550 0x7f07f810d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.139+0000 7f07f6ffd640 1 -- 172.21.15.107:0/2632709989 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e80098b0 con 0x7f07f80fd820 2024-09-21T08:00:25.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.139+0000 7f07f77fe640 1 --2- 172.21.15.107:0/2632709989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07f80fc550 0x7f07f810d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:25.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.139+0000 7f07f6ffd640 1 --2- 172.21.15.107:0/2632709989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07f80fd820 0x7f07f810d5c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f07ec002a50 tx=0x7f07ec004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:25.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.139+0000 7f07dffff640 1 -- 172.21.15.107:0/2632709989 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07ec007c30 con 0x7f07f80fd820 2024-09-21T08:00:25.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.139+0000 7f07fdd3f640 1 -- 172.21.15.107:0/2632709989 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f810e6c0 con 0x7f07f80fd820 2024-09-21T08:00:25.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.139+0000 7f07dffff640 1 -- 172.21.15.107:0/2632709989 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f07ec00f040 con 0x7f07f80fd820 2024-09-21T08:00:25.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.139+0000 7f07dffff640 1 -- 172.21.15.107:0/2632709989 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07ec00da90 con 0x7f07f80fd820 2024-09-21T08:00:25.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.139+0000 7f07fdd3f640 1 -- 172.21.15.107:0/2632709989 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f810ec60 con 0x7f07f80fd820 2024-09-21T08:00:25.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.140+0000 7f07fdd3f640 1 -- 172.21.15.107:0/2632709989 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f80fb9b0 con 0x7f07f80fd820 2024-09-21T08:00:25.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.141+0000 7f07dffff640 1 -- 172.21.15.107:0/2632709989 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f07ec00dd00 con 0x7f07f80fd820 2024-09-21T08:00:25.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.141+0000 7f07dffff640 1 --2- 172.21.15.107:0/2632709989 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f07e006ed60 0x7f07e0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.141+0000 7f07dffff640 1 -- 172.21.15.107:0/2632709989 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f07ec08da90 con 0x7f07f80fd820 2024-09-21T08:00:25.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.141+0000 7f07f77fe640 1 --2- 172.21.15.107:0/2632709989 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f07e006ed60 0x7f07e0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.142+0000 7f07f77fe640 1 --2- 172.21.15.107:0/2632709989 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f07e006ed60 0x7f07e0071210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f07e8000f80 tx=0x7f07e8004d10 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:25.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.145+0000 7f07dffff640 1 -- 172.21.15.107:0/2632709989 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f07ec04d2a0 con 0x7f07f80fd820 2024-09-21T08:00:25.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.337+0000 7f07fdd3f640 1 -- 172.21.15.107:0/2632709989 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07f804b720 con 0x7f07f80fd820 2024-09-21T08:00:25.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.338+0000 7f07dffff640 1 -- 172.21.15.107:0/2632709989 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4697 (secure 0 0 0) 0x7f07f804b720 con 0x7f07f80fd820 2024-09-21T08:00:25.339 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 15 2024-09-21T08:00:25.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.339+0000 7f07fdd3f640 1 -- 172.21.15.107:0/2632709989 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f07e006ed60 msgr2=0x7f07e0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.339+0000 7f07fdd3f640 1 --2- 172.21.15.107:0/2632709989 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f07e006ed60 0x7f07e0071210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f07e8000f80 tx=0x7f07e8004d10 comp rx=0 tx=0).stop 2024-09-21T08:00:25.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.339+0000 7f07fdd3f640 1 -- 172.21.15.107:0/2632709989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07f80fd820 msgr2=0x7f07f810d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.339+0000 7f07fdd3f640 1 --2- 172.21.15.107:0/2632709989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07f80fd820 0x7f07f810d5c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f07ec002a50 tx=0x7f07ec004600 comp rx=0 tx=0).stop 2024-09-21T08:00:25.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.339+0000 7f07fdd3f640 1 -- 172.21.15.107:0/2632709989 shutdown_connections 2024-09-21T08:00:25.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.339+0000 7f07fdd3f640 1 --2- 172.21.15.107:0/2632709989 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f07e006ed60 0x7f07e0071210 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.339+0000 7f07fdd3f640 1 --2- 172.21.15.107:0/2632709989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07f80fd820 0x7f07f810d5c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.339+0000 7f07fdd3f640 1 --2- 172.21.15.107:0/2632709989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07f80fc550 0x7f07f810d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.339+0000 7f07fdd3f640 1 -- 172.21.15.107:0/2632709989 >> 172.21.15.107:0/2632709989 conn(0x7f07f80f7d30 msgr2=0x7f07f80f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:25.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.340+0000 7f07fdd3f640 1 -- 172.21.15.107:0/2632709989 shutdown_connections 2024-09-21T08:00:25.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:25.340+0000 7f07fdd3f640 1 -- 172.21.15.107:0/2632709989 wait complete. 2024-09-21T08:00:25.350 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:00:25.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:25 smithi107 ceph-mon[27622]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T08:00:25.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:25 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/2632709989' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T08:00:25.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:25 smithi129 ceph-mon[34472]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T08:00:25.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:25 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/2632709989' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T08:00:26.085 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-21T08:00:26.365 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:00:27.534 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:27 smithi107 ceph-mon[27622]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T08:00:27.534 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:27 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:27.534 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:27 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:27.534 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:27 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:00:27.534 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:27 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:00:27.534 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:27 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:27.535 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:27 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:00:27.674 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:27 smithi129 ceph-mon[34472]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T08:00:27.674 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:27 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:27.674 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:27 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:27.674 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:27 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:00:27.674 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:27 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:00:27.674 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:27 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:27.674 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:27 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:00:28.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.291+0000 7f312631f640 1 -- 172.21.15.107:0/232819544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31200fc550 msgr2=0x7f31200fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:28.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.291+0000 7f312631f640 1 --2- 172.21.15.107:0/232819544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31200fc550 0x7f31200fc960 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f31100048d0 tx=0x7f3110009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:28.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.291+0000 7f312631f640 1 -- 172.21.15.107:0/232819544 shutdown_connections 2024-09-21T08:00:28.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.291+0000 7f312631f640 1 --2- 172.21.15.107:0/232819544 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f31200fd820 0x7f31200fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:28.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.291+0000 7f312631f640 1 --2- 172.21.15.107:0/232819544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31200fc550 0x7f31200fc960 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:28.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.291+0000 7f312631f640 1 -- 172.21.15.107:0/232819544 >> 172.21.15.107:0/232819544 conn(0x7f31200f7d30 msgr2=0x7f31200fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:28.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.291+0000 7f312631f640 1 -- 172.21.15.107:0/232819544 shutdown_connections 2024-09-21T08:00:28.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.291+0000 7f312631f640 1 -- 172.21.15.107:0/232819544 wait complete. 2024-09-21T08:00:28.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.292+0000 7f312631f640 1 Processor -- start 2024-09-21T08:00:28.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.292+0000 7f312631f640 1 -- start start 2024-09-21T08:00:28.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.292+0000 7f312631f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f31200fc550 0x7f312010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:28.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.292+0000 7f312631f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31200fd820 0x7f312010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:28.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.292+0000 7f312631f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312010dc10 con 0x7f31200fd820 2024-09-21T08:00:28.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.292+0000 7f312631f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312010e430 con 0x7f31200fc550 2024-09-21T08:00:28.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.292+0000 7f311f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31200fd820 0x7f312010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:28.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.292+0000 7f311f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31200fd820 0x7f312010d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43986/0 (socket says 172.21.15.107:43986) 2024-09-21T08:00:28.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.292+0000 7f311f7fe640 1 -- 172.21.15.107:0/2150420327 learned_addr learned my addr 172.21.15.107:0/2150420327 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:00:28.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.292+0000 7f311ffff640 1 --2- 172.21.15.107:0/2150420327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f31200fc550 0x7f312010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:28.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.292+0000 7f311f7fe640 1 -- 172.21.15.107:0/2150420327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f31200fc550 msgr2=0x7f312010d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:28.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.292+0000 7f311f7fe640 1 --2- 172.21.15.107:0/2150420327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f31200fc550 0x7f312010d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:28.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.292+0000 7f311f7fe640 1 -- 172.21.15.107:0/2150420327 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3110005040 con 0x7f31200fd820 2024-09-21T08:00:28.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.293+0000 7f311f7fe640 1 --2- 172.21.15.107:0/2150420327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31200fd820 0x7f312010d5c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3114002a50 tx=0x7f3114004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:28.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.293+0000 7f311cff9640 1 -- 172.21.15.107:0/2150420327 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3114007c30 con 0x7f31200fd820 2024-09-21T08:00:28.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.293+0000 7f311cff9640 1 -- 172.21.15.107:0/2150420327 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f311400f040 con 0x7f31200fd820 2024-09-21T08:00:28.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.293+0000 7f312631f640 1 -- 172.21.15.107:0/2150420327 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312010e6c0 con 0x7f31200fd820 2024-09-21T08:00:28.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.293+0000 7f311cff9640 1 -- 172.21.15.107:0/2150420327 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f311400da10 con 0x7f31200fd820 2024-09-21T08:00:28.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.293+0000 7f312631f640 1 -- 172.21.15.107:0/2150420327 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312010ec60 con 0x7f31200fd820 2024-09-21T08:00:28.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.294+0000 7f312631f640 1 -- 172.21.15.107:0/2150420327 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31200fb9b0 con 0x7f31200fd820 2024-09-21T08:00:28.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.294+0000 7f311cff9640 1 -- 172.21.15.107:0/2150420327 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f311400dc80 con 0x7f31200fd820 2024-09-21T08:00:28.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.295+0000 7f311cff9640 1 --2- 172.21.15.107:0/2150420327 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f310806ed60 0x7f3108071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:28.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.295+0000 7f311cff9640 1 -- 172.21.15.107:0/2150420327 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f311408d990 con 0x7f31200fd820 2024-09-21T08:00:28.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.295+0000 7f311ffff640 1 --2- 172.21.15.107:0/2150420327 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f310806ed60 0x7f3108071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:28.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.295+0000 7f311ffff640 1 --2- 172.21.15.107:0/2150420327 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f310806ed60 0x7f3108071210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f311000b020 tx=0x7f3110035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:28.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.299+0000 7f311cff9640 1 -- 172.21.15.107:0/2150420327 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f311404d2a0 con 0x7f31200fd820 2024-09-21T08:00:28.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.523+0000 7f312631f640 1 -- 172.21.15.107:0/2150420327 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f312010ef20 con 0x7f31200fd820 2024-09-21T08:00:28.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.524+0000 7f311cff9640 1 -- 172.21.15.107:0/2150420327 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v15) v1 ==== 78+0+100 (secure 0 0 0) 0x7f311405abd0 con 0x7f31200fd820 2024-09-21T08:00:28.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.525+0000 7f312631f640 1 -- 172.21.15.107:0/2150420327 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f310806ed60 msgr2=0x7f3108071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:28.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.525+0000 7f312631f640 1 --2- 172.21.15.107:0/2150420327 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f310806ed60 0x7f3108071210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f311000b020 tx=0x7f3110035040 comp rx=0 tx=0).stop 2024-09-21T08:00:28.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.525+0000 7f312631f640 1 -- 172.21.15.107:0/2150420327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31200fd820 msgr2=0x7f312010d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:28.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.525+0000 7f312631f640 1 --2- 172.21.15.107:0/2150420327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31200fd820 0x7f312010d5c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3114002a50 tx=0x7f3114004600 comp rx=0 tx=0).stop 2024-09-21T08:00:28.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.526+0000 7f312631f640 1 -- 172.21.15.107:0/2150420327 shutdown_connections 2024-09-21T08:00:28.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.526+0000 7f312631f640 1 --2- 172.21.15.107:0/2150420327 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f310806ed60 0x7f3108071210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:28.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.526+0000 7f312631f640 1 --2- 172.21.15.107:0/2150420327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31200fd820 0x7f312010d5c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:28.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.526+0000 7f312631f640 1 --2- 172.21.15.107:0/2150420327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f31200fc550 0x7f312010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:28.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.526+0000 7f312631f640 1 -- 172.21.15.107:0/2150420327 >> 172.21.15.107:0/2150420327 conn(0x7f31200f7d30 msgr2=0x7f31200f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:28.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.526+0000 7f312631f640 1 -- 172.21.15.107:0/2150420327 shutdown_connections 2024-09-21T08:00:28.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:28.526+0000 7f312631f640 1 -- 172.21.15.107:0/2150420327 wait complete. 2024-09-21T08:00:28.536 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:00:29.226 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-21T08:00:29.258 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:00:29.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:29 smithi107 ceph-mon[27622]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T08:00:29.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:29 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:29.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:29 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:29.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:29 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/2150420327' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-21T08:00:29.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:29 smithi129 ceph-mon[34472]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T08:00:29.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:29 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:29.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:29 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:29.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:29 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/2150420327' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-21T08:00:30.799 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:00:31.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:31 smithi107 ceph-mon[27622]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T08:00:31.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:31 smithi129 ceph-mon[34472]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T08:00:33.609 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:33 smithi107 ceph-mon[27622]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T08:00:33.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.684+0000 7f2fd7bf5640 1 -- 172.21.15.107:0/3610519098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2fd0064fc0 msgr2=0x7f2fd0065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:33.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.684+0000 7f2fd7bf5640 1 --2- 172.21.15.107:0/3610519098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2fd0064fc0 0x7f2fd0065430 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00048d0 tx=0x7f2fc0009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:33.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.684+0000 7f2fd7bf5640 1 -- 172.21.15.107:0/3610519098 shutdown_connections 2024-09-21T08:00:33.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.684+0000 7f2fd7bf5640 1 --2- 172.21.15.107:0/3610519098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2fd0064fc0 0x7f2fd0065430 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:33.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.684+0000 7f2fd7bf5640 1 --2- 172.21.15.107:0/3610519098 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2fd00fe460 0x7f2fd00fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:33.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.684+0000 7f2fd7bf5640 1 -- 172.21.15.107:0/3610519098 >> 172.21.15.107:0/3610519098 conn(0x7f2fd00723b0 msgr2=0x7f2fd00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:33.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.684+0000 7f2fd7bf5640 1 -- 172.21.15.107:0/3610519098 shutdown_connections 2024-09-21T08:00:33.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.684+0000 7f2fd7bf5640 1 -- 172.21.15.107:0/3610519098 wait complete. 2024-09-21T08:00:33.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.684+0000 7f2fd7bf5640 1 Processor -- start 2024-09-21T08:00:33.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.684+0000 7f2fd7bf5640 1 -- start start 2024-09-21T08:00:33.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.685+0000 7f2fd7bf5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2fd0064fc0 0x7f2fd00fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:33.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.685+0000 7f2fd7bf5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2fd00fe460 0x7f2fd00fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:33.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.685+0000 7f2fd7bf5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd00fc070 con 0x7f2fd0064fc0 2024-09-21T08:00:33.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.685+0000 7f2fd7bf5640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd00fc1e0 con 0x7f2fd00fe460 2024-09-21T08:00:33.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.685+0000 7f2fd5991640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2fd0064fc0 0x7f2fd00fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:33.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.685+0000 7f2fd5991640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2fd0064fc0 0x7f2fd00fb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33730/0 (socket says 172.21.15.107:33730) 2024-09-21T08:00:33.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.685+0000 7f2fd5991640 1 -- 172.21.15.107:0/2820052904 learned_addr learned my addr 172.21.15.107:0/2820052904 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:00:33.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.685+0000 7f2fd5190640 1 --2- 172.21.15.107:0/2820052904 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2fd00fe460 0x7f2fd00fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:33.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.685+0000 7f2fd5991640 1 -- 172.21.15.107:0/2820052904 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2fd00fe460 msgr2=0x7f2fd00fbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:33.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.685+0000 7f2fd5991640 1 --2- 172.21.15.107:0/2820052904 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2fd00fe460 0x7f2fd00fbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:33.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.685+0000 7f2fd5991640 1 -- 172.21.15.107:0/2820052904 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc0005040 con 0x7f2fd0064fc0 2024-09-21T08:00:33.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.685+0000 7f2fd5991640 1 --2- 172.21.15.107:0/2820052904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2fd0064fc0 0x7f2fd00fb560 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00b790 tx=0x7f2fcc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:33.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.685+0000 7f2fc67fc640 1 -- 172.21.15.107:0/2820052904 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fcc00c700 con 0x7f2fd0064fc0 2024-09-21T08:00:33.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.685+0000 7f2fc67fc640 1 -- 172.21.15.107:0/2820052904 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2fcc00cd00 con 0x7f2fd0064fc0 2024-09-21T08:00:33.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.685+0000 7f2fd7bf5640 1 -- 172.21.15.107:0/2820052904 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd0119550 con 0x7f2fd0064fc0 2024-09-21T08:00:33.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.685+0000 7f2fc67fc640 1 -- 172.21.15.107:0/2820052904 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fcc015e70 con 0x7f2fd0064fc0 2024-09-21T08:00:33.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.685+0000 7f2fd7bf5640 1 -- 172.21.15.107:0/2820052904 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd0119990 con 0x7f2fd0064fc0 2024-09-21T08:00:33.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.686+0000 7f2fd7bf5640 1 -- 172.21.15.107:0/2820052904 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd00fdcf0 con 0x7f2fd0064fc0 2024-09-21T08:00:33.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.687+0000 7f2fc67fc640 1 -- 172.21.15.107:0/2820052904 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f2fcc012070 con 0x7f2fd0064fc0 2024-09-21T08:00:33.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.687+0000 7f2fc67fc640 1 --2- 172.21.15.107:0/2820052904 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f2fbc06ed60 0x7f2fbc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:33.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.687+0000 7f2fc67fc640 1 -- 172.21.15.107:0/2820052904 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2fcc08dd50 con 0x7f2fd0064fc0 2024-09-21T08:00:33.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.687+0000 7f2fd5190640 1 --2- 172.21.15.107:0/2820052904 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f2fbc06ed60 0x7f2fbc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:33.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.688+0000 7f2fd5190640 1 --2- 172.21.15.107:0/2820052904 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f2fbc06ed60 0x7f2fbc071210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0004540 tx=0x7f2fc0009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:33.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.691+0000 7f2fc67fc640 1 -- 172.21.15.107:0/2820052904 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2fcc05ae20 con 0x7f2fd0064fc0 2024-09-21T08:00:33.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:33 smithi129 ceph-mon[34472]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T08:00:33.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.901+0000 7f2fd7bf5640 1 -- 172.21.15.107:0/2820052904 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fd00fcc50 con 0x7f2fd0064fc0 2024-09-21T08:00:33.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.901+0000 7f2fc67fc640 1 -- 172.21.15.107:0/2820052904 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4697 (secure 0 0 0) 0x7f2fcc05a7c0 con 0x7f2fd0064fc0 2024-09-21T08:00:33.903 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:00:33.903 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14468,"name":"cephfs.smithi107.qusoyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/2352538667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2352538667},{"type":"v1","addr":"172.21.15.107:6827","nonce":2352538667}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24239,"name":"cephfs.smithi129.fwmfcy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.129:6825/694369363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":694369363},{"type":"v1","addr":"172.21.15.129:6825","nonce":694369363}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24247,"name":"cephfs.smithi129.belyba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.129:6827/3658871735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3658871735},{"type":"v1","addr":"172.21.15.129:6827","nonce":3658871735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:00:21.458971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14458":{"gid":14458,"name":"cephfs.smithi107.grqzkt","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.107:6829/3876219633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3876219633},{"type":"v1","addr":"172.21.15.107:6829","nonce":3876219633}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-09-21T08:00:33.903 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 15 2024-09-21T08:00:33.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.903+0000 7f2fd7bf5640 1 -- 172.21.15.107:0/2820052904 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f2fbc06ed60 msgr2=0x7f2fbc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:33.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.903+0000 7f2fd7bf5640 1 --2- 172.21.15.107:0/2820052904 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f2fbc06ed60 0x7f2fbc071210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0004540 tx=0x7f2fc0009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:33.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.903+0000 7f2fd7bf5640 1 -- 172.21.15.107:0/2820052904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2fd0064fc0 msgr2=0x7f2fd00fb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:33.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.903+0000 7f2fd7bf5640 1 --2- 172.21.15.107:0/2820052904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2fd0064fc0 0x7f2fd00fb560 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00b790 tx=0x7f2fcc0091d0 comp rx=0 tx=0).stop 2024-09-21T08:00:33.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.903+0000 7f2fd7bf5640 1 -- 172.21.15.107:0/2820052904 shutdown_connections 2024-09-21T08:00:33.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.904+0000 7f2fd7bf5640 1 --2- 172.21.15.107:0/2820052904 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2fd00fe460 0x7f2fd00fbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:33.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.904+0000 7f2fd7bf5640 1 --2- 172.21.15.107:0/2820052904 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f2fbc06ed60 0x7f2fbc071210 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:33.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.904+0000 7f2fd7bf5640 1 --2- 172.21.15.107:0/2820052904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2fd0064fc0 0x7f2fd00fb560 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:33.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.904+0000 7f2fd7bf5640 1 -- 172.21.15.107:0/2820052904 >> 172.21.15.107:0/2820052904 conn(0x7f2fd00723b0 msgr2=0x7f2fd0105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:33.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.904+0000 7f2fd7bf5640 1 -- 172.21.15.107:0/2820052904 shutdown_connections 2024-09-21T08:00:33.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:33.904+0000 7f2fd7bf5640 1 -- 172.21.15.107:0/2820052904 wait complete. 2024-09-21T08:00:34.529 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:34 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/2820052904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T08:00:34.529 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:34 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:34.529 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:34 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:34.529 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:34 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:00:34.530 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:34 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:00:34.530 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:34 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:34.554 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 1, 'flags': 18} 2024-09-21T08:00:34.555 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T08:00:35.909 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T08:00:35.909 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-09-21T08:00:35.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:35.909 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-09-21T08:00:35.910 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:35 smithi107 ceph-mon[27622]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T08:00:35.911 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:34 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/2820052904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T08:00:35.911 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:34 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:35.911 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:34 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:35.911 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:34 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:00:35.911 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:34 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:00:35.911 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:34 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:00:35.911 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:35 smithi129 ceph-mon[34472]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T08:00:35.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:35.930 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-09-21T08:00:36.004 INFO:teuthology.orchestra.run.smithi107.stderr:Cannot find device "ceph-brx" 2024-09-21T08:00:36.006 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:00:36.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:36.006 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list 2024-09-21T08:00:36.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:36.025 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link delete ceph-brx 2024-09-21T08:00:36.094 INFO:teuthology.orchestra.run.smithi129.stderr:Cannot find device "ceph-brx" 2024-09-21T08:00:36.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:00:36.095 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-21T08:00:36.095 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T08:00:36.095 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T08:00:36.095 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs ls 2024-09-21T08:00:36.348 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:00:37.475 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:37 smithi107 ceph-mon[27622]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 0 B/s wr, 0 op/s 2024-09-21T08:00:37.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:37 smithi129 ceph-mon[34472]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 0 B/s wr, 0 op/s 2024-09-21T08:00:37.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.946+0000 7fc24a3a9640 1 -- 172.21.15.107:0/1174505996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2440fb480 msgr2=0x7fc2440fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:37.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.946+0000 7fc24a3a9640 1 --2- 172.21.15.107:0/1174505996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2440fb480 0x7fc2440fb8f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc2380048d0 tx=0x7fc238009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:37.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.946+0000 7fc24a3a9640 1 -- 172.21.15.107:0/1174505996 shutdown_connections 2024-09-21T08:00:37.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.946+0000 7fc24a3a9640 1 --2- 172.21.15.107:0/1174505996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2440fb480 0x7fc2440fb8f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:37.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.946+0000 7fc24a3a9640 1 --2- 172.21.15.107:0/1174505996 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2441014c0 0x7fc244101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:37.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.946+0000 7fc24a3a9640 1 -- 172.21.15.107:0/1174505996 >> 172.21.15.107:0/1174505996 conn(0x7fc2440f7020 msgr2=0x7fc2440f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:37.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.946+0000 7fc24a3a9640 1 -- 172.21.15.107:0/1174505996 shutdown_connections 2024-09-21T08:00:37.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.946+0000 7fc24a3a9640 1 -- 172.21.15.107:0/1174505996 wait complete. 2024-09-21T08:00:37.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.947+0000 7fc24a3a9640 1 Processor -- start 2024-09-21T08:00:37.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.947+0000 7fc24a3a9640 1 -- start start 2024-09-21T08:00:37.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.947+0000 7fc24a3a9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2440fb480 0x7fc2441120b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:37.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.947+0000 7fc24a3a9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2441014c0 0x7fc2441125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:37.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.947+0000 7fc24a3a9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc244112bf0 con 0x7fc2440fb480 2024-09-21T08:00:37.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.947+0000 7fc24a3a9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24410c030 con 0x7fc2441014c0 2024-09-21T08:00:37.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.947+0000 7fc243fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2440fb480 0x7fc2441120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:37.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.947+0000 7fc243fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2440fb480 0x7fc2441120b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33744/0 (socket says 172.21.15.107:33744) 2024-09-21T08:00:37.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.947+0000 7fc243fff640 1 -- 172.21.15.107:0/2038185103 learned_addr learned my addr 172.21.15.107:0/2038185103 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:00:37.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.948+0000 7fc243fff640 1 -- 172.21.15.107:0/2038185103 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2441014c0 msgr2=0x7fc2441125f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:37.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.948+0000 7fc243fff640 1 --2- 172.21.15.107:0/2038185103 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2441014c0 0x7fc2441125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:37.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.948+0000 7fc243fff640 1 -- 172.21.15.107:0/2038185103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc238005040 con 0x7fc2440fb480 2024-09-21T08:00:37.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.948+0000 7fc243fff640 1 --2- 172.21.15.107:0/2038185103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2440fb480 0x7fc2441120b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc23400c830 tx=0x7fc234004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:37.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.948+0000 7fc240ff9640 1 -- 172.21.15.107:0/2038185103 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc23400a850 con 0x7fc2440fb480 2024-09-21T08:00:37.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.948+0000 7fc240ff9640 1 -- 172.21.15.107:0/2038185103 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc23400ae50 con 0x7fc2440fb480 2024-09-21T08:00:37.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.948+0000 7fc24a3a9640 1 -- 172.21.15.107:0/2038185103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24410c310 con 0x7fc2440fb480 2024-09-21T08:00:37.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.948+0000 7fc240ff9640 1 -- 172.21.15.107:0/2038185103 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2340113a0 con 0x7fc2440fb480 2024-09-21T08:00:37.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.948+0000 7fc24a3a9640 1 -- 172.21.15.107:0/2038185103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24410c8b0 con 0x7fc2440fb480 2024-09-21T08:00:37.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.949+0000 7fc24a3a9640 1 -- 172.21.15.107:0/2038185103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2440fcbc0 con 0x7fc2440fb480 2024-09-21T08:00:37.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.949+0000 7fc240ff9640 1 -- 172.21.15.107:0/2038185103 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fc234012400 con 0x7fc2440fb480 2024-09-21T08:00:37.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.950+0000 7fc240ff9640 1 --2- 172.21.15.107:0/2038185103 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fc22c06ed50 0x7fc22c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:37.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.950+0000 7fc2437fe640 1 --2- 172.21.15.107:0/2038185103 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fc22c06ed50 0x7fc22c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:37.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.950+0000 7fc240ff9640 1 -- 172.21.15.107:0/2038185103 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc23408e410 con 0x7fc2440fb480 2024-09-21T08:00:37.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.950+0000 7fc2437fe640 1 --2- 172.21.15.107:0/2038185103 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fc22c06ed50 0x7fc22c071200 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc23802a530 tx=0x7fc238009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:37.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:37.954+0000 7fc240ff9640 1 -- 172.21.15.107:0/2038185103 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc23405b560 con 0x7fc2440fb480 2024-09-21T08:00:38.146 INFO:teuthology.orchestra.run.smithi107.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-21T08:00:38.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:38.145+0000 7fc24a3a9640 1 -- 172.21.15.107:0/2038185103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc244108440 con 0x7fc2440fb480 2024-09-21T08:00:38.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:38.145+0000 7fc240ff9640 1 -- 172.21.15.107:0/2038185103 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7fc23405af00 con 0x7fc2440fb480 2024-09-21T08:00:38.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:38.147+0000 7fc24a3a9640 1 -- 172.21.15.107:0/2038185103 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fc22c06ed50 msgr2=0x7fc22c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:38.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:38.147+0000 7fc24a3a9640 1 --2- 172.21.15.107:0/2038185103 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fc22c06ed50 0x7fc22c071200 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc23802a530 tx=0x7fc238009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:38.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:38.147+0000 7fc24a3a9640 1 -- 172.21.15.107:0/2038185103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2440fb480 msgr2=0x7fc2441120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:38.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:38.147+0000 7fc24a3a9640 1 --2- 172.21.15.107:0/2038185103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2440fb480 0x7fc2441120b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc23400c830 tx=0x7fc234004430 comp rx=0 tx=0).stop 2024-09-21T08:00:38.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:38.147+0000 7fc24a3a9640 1 -- 172.21.15.107:0/2038185103 shutdown_connections 2024-09-21T08:00:38.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:38.147+0000 7fc24a3a9640 1 --2- 172.21.15.107:0/2038185103 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2441014c0 0x7fc2441125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:38.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:38.147+0000 7fc24a3a9640 1 --2- 172.21.15.107:0/2038185103 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fc22c06ed50 0x7fc22c071200 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:38.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:38.147+0000 7fc24a3a9640 1 --2- 172.21.15.107:0/2038185103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2440fb480 0x7fc2441120b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:38.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:38.147+0000 7fc24a3a9640 1 -- 172.21.15.107:0/2038185103 >> 172.21.15.107:0/2038185103 conn(0x7fc2440f7020 msgr2=0x7fc2440f8970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:38.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:38.147+0000 7fc24a3a9640 1 -- 172.21.15.107:0/2038185103 shutdown_connections 2024-09-21T08:00:38.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:38.147+0000 7fc24a3a9640 1 -- 172.21.15.107:0/2038185103 wait complete. 2024-09-21T08:00:38.500 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:38 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/2038185103' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T08:00:38.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:38 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/2038185103' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T08:00:38.859 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T08:00:38.859 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T08:00:38.859 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2024-09-21T08:00:38.859 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T08:00:38.859 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T08:00:38.859 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T08:00:38.859 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T08:00:38.859 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T08:00:38.859 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T08:00:38.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:38.860 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2024-09-21T08:00:38.875 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T08:00:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T08:00:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T08:00:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-21T08:00:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-09-21T08:00:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-21T08:00:38.876 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T08:00:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2024-09-21T08:00:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f0 2024-09-21T08:00:38.876 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T08:00:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2024-09-21T08:00:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f1 2024-09-21T08:00:38.876 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T08:00:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2024-09-21T08:00:38.876 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T08:00:38.877 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2024-09-21T08:00:38.877 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T08:00:38.877 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 42355sec preferred_lft 42355sec 2024-09-21T08:00:38.877 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link noprefixroute 2024-09-21T08:00:38.877 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-21T08:00:38.877 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T08:00:38.877 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T08:00:38.877 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-21T08:00:38.877 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add name ceph-brx type bridge 2024-09-21T08:00:38.878 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr flush dev ceph-brx 2024-09-21T08:00:38.878 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set ceph-brx up 2024-09-21T08:00:38.878 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T08:00:38.878 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-21T08:00:38.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T08:00:39.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:39.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:39.085 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T08:00:39.111 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-09-21T08:00:39.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:39.112 DEBUG:teuthology.orchestra.run.smithi107:> route 2024-09-21T08:00:39.184 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2024-09-21T08:00:39.184 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T08:00:39.184 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T08:00:39.184 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T08:00:39.185 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T08:00:39.185 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T08:00:39.185 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-21T08:00:39.185 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T08:00:39.185 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T08:00:39.185 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T08:00:39.185 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-21T08:00:39.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T08:00:39.380 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:39 smithi107 ceph-mon[27622]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-21T08:00:39.380 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:39 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:00:39.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:39.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:39.491 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-09-21T08:00:39.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:39.507 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list-id 2024-09-21T08:00:39.563 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T08:00:39.563 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-21T08:00:39.563 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T08:00:39.563 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T08:00:39.563 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-21T08:00:39.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T08:00:39.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:39.680 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T08:00:39.680 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T08:00:39.680 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-21T08:00:39.680 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T08:00:39.680 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T08:00:39.680 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T08:00:39.680 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T08:00:39.680 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T08:00:39.680 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-21T08:00:39.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T08:00:39.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:39 smithi129 ceph-mon[34472]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-21T08:00:39.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:39 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:00:39.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:39.804 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T08:00:39.804 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-21T08:00:39.804 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.0 up 2024-09-21T08:00:39.805 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T08:00:39.805 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-21T08:00:39.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T08:00:39.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:39.881 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T08:00:39.881 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T08:00:39.911 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T08:00:39.911 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T08:00:39.911 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T08:00:39.966 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T08:00:39.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:39.967 DEBUG:teuthology.orchestra.run.smithi107:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T08:00:40.058 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T08:00:40.058 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T08:00:40.058 INFO:teuthology.orchestra.run.smithi107.stdout:invalid new device string format 2024-09-21T08:00:40.205 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T08:00:40.205 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T08:00:40.205 INFO:teuthology.orchestra.run.smithi107.stdout:invalid new device string format 2024-09-21T08:00:40.205 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.107:3300,172.21.15.129:3300" 2024-09-21T08:00:40.205 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T08:00:40.210 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T08:00:40.210 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T08:00:40.210 INFO:teuthology.orchestra.run.smithi107.stdout:invalid new device string format 2024-09-21T08:00:40.210 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.107:3300,172.21.15.129:3300" 2024-09-21T08:00:40.210 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T08:00:40.210 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.107:6789,172.21.15.129:6789" 2024-09-21T08:00:40.210 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.107:6789,172.21.15.129:6789:/ 2024-09-21T08:00:40.210 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=786d4f32-77ee-11ef-baf6-efdc52797490" will pass to kernel 2024-09-21T08:00:40.211 INFO:teuthology.orchestra.run.smithi107.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T08:00:40.211 INFO:teuthology.orchestra.run.smithi107.stdout: You just mounted a file system that supports labels which does not 2024-09-21T08:00:40.211 INFO:teuthology.orchestra.run.smithi107.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T08:00:40.211 INFO:teuthology.orchestra.run.smithi107.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T08:00:40.211 INFO:teuthology.orchestra.run.smithi107.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T08:00:40.213 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T08:00:40.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:40.213 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T08:00:40.245 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T08:00:40.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T08:00:40.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:40.346 INFO:teuthology.orchestra.run.smithi107.stdout:client24269 2024-09-21T08:00:40.346 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-21T08:00:40.346 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T08:00:40.363 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T08:00:40.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T08:00:40.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:40.463 INFO:teuthology.orchestra.run.smithi107.stdout:client24269 2024-09-21T08:00:40.463 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T08:00:40.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T08:00:40.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:40.522 INFO:teuthology.orchestra.run.smithi107.stdout:client24269 2024-09-21T08:00:40.522 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/786d4f32-77ee-11ef-baf6-efdc52797490.client24269/status') 2024-09-21T08:00:40.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T08:00:40.582 INFO:teuthology.orchestra.run.smithi107.stdout:instance: client.24269 (3)172.21.15.107:0/2727935843 2024-09-21T08:00:40.582 INFO:teuthology.orchestra.run.smithi107.stdout:blocklisted: false 2024-09-21T08:00:40.583 INFO:teuthology.orchestra.run.smithi107.stderr:0+1 records in 2024-09-21T08:00:40.583 INFO:teuthology.orchestra.run.smithi107.stderr:0+1 records out 2024-09-21T08:00:40.583 INFO:teuthology.orchestra.run.smithi107.stderr:72 bytes copied, 2.3095e-05 s, 3.1 MB/s 2024-09-21T08:00:40.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:40.590 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-21T08:00:40.590 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T08:00:40.590 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T08:00:40.590 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs ls 2024-09-21T08:00:40.836 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:00:41.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:41 smithi107 ceph-mon[27622]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:00:41.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:41 smithi129 ceph-mon[34472]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:00:42.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.392+0000 7fc2bc206640 1 -- 172.21.15.107:0/3652259464 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2b4065c10 msgr2=0x7fc2b40fe0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:42.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.392+0000 7fc2bc206640 1 --2- 172.21.15.107:0/3652259464 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2b4065c10 0x7fc2b40fe0d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc2a80048d0 tx=0x7fc2a8009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:42.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.392+0000 7fc2bc206640 1 -- 172.21.15.107:0/3652259464 shutdown_connections 2024-09-21T08:00:42.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.392+0000 7fc2bc206640 1 --2- 172.21.15.107:0/3652259464 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2b4065c10 0x7fc2b40fe0d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:42.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.392+0000 7fc2bc206640 1 --2- 172.21.15.107:0/3652259464 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2b4065300 0x7fc2b40656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:42.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.392+0000 7fc2bc206640 1 -- 172.21.15.107:0/3652259464 >> 172.21.15.107:0/3652259464 conn(0x7fc2b40723b0 msgr2=0x7fc2b40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:42.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.392+0000 7fc2bc206640 1 -- 172.21.15.107:0/3652259464 shutdown_connections 2024-09-21T08:00:42.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.392+0000 7fc2bc206640 1 -- 172.21.15.107:0/3652259464 wait complete. 2024-09-21T08:00:42.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.392+0000 7fc2bc206640 1 Processor -- start 2024-09-21T08:00:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.392+0000 7fc2bc206640 1 -- start start 2024-09-21T08:00:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.392+0000 7fc2bc206640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2b4065300 0x7fc2b41153b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.392+0000 7fc2bc206640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2b4065c10 0x7fc2b41158f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.393+0000 7fc2bc206640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b4115ef0 con 0x7fc2b4065300 2024-09-21T08:00:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.393+0000 7fc2bc206640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b410f330 con 0x7fc2b4065c10 2024-09-21T08:00:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.393+0000 7fc2b9fa2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2b4065300 0x7fc2b41153b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.393+0000 7fc2b9fa2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2b4065300 0x7fc2b41153b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47694/0 (socket says 172.21.15.107:47694) 2024-09-21T08:00:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.393+0000 7fc2b9fa2640 1 -- 172.21.15.107:0/3702091759 learned_addr learned my addr 172.21.15.107:0/3702091759 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:00:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.393+0000 7fc2b97a1640 1 --2- 172.21.15.107:0/3702091759 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2b4065c10 0x7fc2b41158f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.393+0000 7fc2b9fa2640 1 -- 172.21.15.107:0/3702091759 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2b4065c10 msgr2=0x7fc2b41158f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.393+0000 7fc2b9fa2640 1 --2- 172.21.15.107:0/3702091759 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2b4065c10 0x7fc2b41158f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.393+0000 7fc2b9fa2640 1 -- 172.21.15.107:0/3702091759 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a8005040 con 0x7fc2b4065300 2024-09-21T08:00:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.393+0000 7fc2b9fa2640 1 --2- 172.21.15.107:0/3702091759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2b4065300 0x7fc2b41153b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400cb10 tx=0x7fc2a4007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.393+0000 7fc2b27fc640 1 -- 172.21.15.107:0/3702091759 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2a4004200 con 0x7fc2b4065300 2024-09-21T08:00:42.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.393+0000 7fc2b27fc640 1 -- 172.21.15.107:0/3702091759 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc2a400ac40 con 0x7fc2b4065300 2024-09-21T08:00:42.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.393+0000 7fc2bc206640 1 -- 172.21.15.107:0/3702091759 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b410f610 con 0x7fc2b4065300 2024-09-21T08:00:42.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.393+0000 7fc2b27fc640 1 -- 172.21.15.107:0/3702091759 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2a4003c50 con 0x7fc2b4065300 2024-09-21T08:00:42.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.393+0000 7fc2bc206640 1 -- 172.21.15.107:0/3702091759 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b410fb80 con 0x7fc2b4065300 2024-09-21T08:00:42.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.394+0000 7fc2bc206640 1 -- 172.21.15.107:0/3702091759 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b40fdce0 con 0x7fc2b4065300 2024-09-21T08:00:42.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.395+0000 7fc2b27fc640 1 -- 172.21.15.107:0/3702091759 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fc2a4003430 con 0x7fc2b4065300 2024-09-21T08:00:42.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.395+0000 7fc2b27fc640 1 --2- 172.21.15.107:0/3702091759 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fc29c06ed60 0x7fc29c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:42.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.395+0000 7fc2b27fc640 1 -- 172.21.15.107:0/3702091759 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc2a408e690 con 0x7fc2b4065300 2024-09-21T08:00:42.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.395+0000 7fc2b97a1640 1 --2- 172.21.15.107:0/3702091759 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fc29c06ed60 0x7fc29c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:42.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.396+0000 7fc2b97a1640 1 --2- 172.21.15.107:0/3702091759 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fc29c06ed60 0x7fc29c071210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009ac0 tx=0x7fc2a8035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:42.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.399+0000 7fc2b27fc640 1 -- 172.21.15.107:0/3702091759 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc2a405b7e0 con 0x7fc2b4065300 2024-09-21T08:00:42.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.591+0000 7fc2bc206640 1 -- 172.21.15.107:0/3702091759 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc2b404b750 con 0x7fc2b4065300 2024-09-21T08:00:42.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.591+0000 7fc2b27fc640 1 -- 172.21.15.107:0/3702091759 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7fc2a405b180 con 0x7fc2b4065300 2024-09-21T08:00:42.593 INFO:teuthology.orchestra.run.smithi107.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-21T08:00:42.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.593+0000 7fc2bc206640 1 -- 172.21.15.107:0/3702091759 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fc29c06ed60 msgr2=0x7fc29c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:42.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.593+0000 7fc2bc206640 1 --2- 172.21.15.107:0/3702091759 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fc29c06ed60 0x7fc29c071210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009ac0 tx=0x7fc2a8035040 comp rx=0 tx=0).stop 2024-09-21T08:00:42.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.593+0000 7fc2bc206640 1 -- 172.21.15.107:0/3702091759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2b4065300 msgr2=0x7fc2b41153b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:42.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.593+0000 7fc2bc206640 1 --2- 172.21.15.107:0/3702091759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2b4065300 0x7fc2b41153b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400cb10 tx=0x7fc2a4007ee0 comp rx=0 tx=0).stop 2024-09-21T08:00:42.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.593+0000 7fc2bc206640 1 -- 172.21.15.107:0/3702091759 shutdown_connections 2024-09-21T08:00:42.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.593+0000 7fc2bc206640 1 --2- 172.21.15.107:0/3702091759 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2b4065c10 0x7fc2b41158f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:42.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.593+0000 7fc2bc206640 1 --2- 172.21.15.107:0/3702091759 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fc29c06ed60 0x7fc29c071210 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:42.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.593+0000 7fc2bc206640 1 --2- 172.21.15.107:0/3702091759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2b4065300 0x7fc2b41153b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:42.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.593+0000 7fc2bc206640 1 -- 172.21.15.107:0/3702091759 >> 172.21.15.107:0/3702091759 conn(0x7fc2b40723b0 msgr2=0x7fc2b41011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:42.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.593+0000 7fc2bc206640 1 -- 172.21.15.107:0/3702091759 shutdown_connections 2024-09-21T08:00:42.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:42.593+0000 7fc2bc206640 1 -- 172.21.15.107:0/3702091759 wait complete. 2024-09-21T08:00:43.437 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T08:00:43.438 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T08:00:43.438 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi129.front.sepia.ceph.com 2024-09-21T08:00:43.438 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T08:00:43.438 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T08:00:43.438 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T08:00:43.438 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T08:00:43.438 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T08:00:43.438 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T08:00:43.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:43.438 DEBUG:teuthology.orchestra.run.smithi129:> ip addr 2024-09-21T08:00:43.458 INFO:teuthology.orchestra.run.smithi129.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T08:00:43.458 INFO:teuthology.orchestra.run.smithi129.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T08:00:43.458 INFO:teuthology.orchestra.run.smithi129.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T08:00:43.458 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-09-21T08:00:43.458 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 ::1/128 scope host 2024-09-21T08:00:43.458 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-09-21T08:00:43.458 INFO:teuthology.orchestra.run.smithi129.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T08:00:43.458 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:d9:19:38 brd ff:ff:ff:ff:ff:ff 2024-09-21T08:00:43.458 INFO:teuthology.orchestra.run.smithi129.stdout: altname enp7s0f0 2024-09-21T08:00:43.458 INFO:teuthology.orchestra.run.smithi129.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T08:00:43.458 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:d9:19:39 brd ff:ff:ff:ff:ff:ff 2024-09-21T08:00:43.459 INFO:teuthology.orchestra.run.smithi129.stdout: altname enp7s0f1 2024-09-21T08:00:43.459 INFO:teuthology.orchestra.run.smithi129.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T08:00:43.459 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:88:72:60 brd ff:ff:ff:ff:ff:ff 2024-09-21T08:00:43.459 INFO:teuthology.orchestra.run.smithi129.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T08:00:43.459 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:88:72:61 brd ff:ff:ff:ff:ff:ff 2024-09-21T08:00:43.459 INFO:teuthology.orchestra.run.smithi129.stdout: inet 172.21.15.129/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T08:00:43.459 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft 42349sec preferred_lft 42349sec 2024-09-21T08:00:43.459 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 fe80::ec4:7aff:fe88:7261/64 scope link noprefixroute 2024-09-21T08:00:43.459 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-09-21T08:00:43.459 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T08:00:43.460 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T08:00:43.460 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2024-09-21T08:00:43.460 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link add name ceph-brx type bridge 2024-09-21T08:00:43.460 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip addr flush dev ceph-brx 2024-09-21T08:00:43.460 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link set ceph-brx up 2024-09-21T08:00:43.460 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T08:00:43.460 DEBUG:teuthology.orchestra.run.smithi129:> ') 2024-09-21T08:00:43.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T08:00:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T08:00:43.623 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:43 smithi129 ceph-mon[34472]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-21T08:00:43.623 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:43 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/3702091759' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T08:00:43.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T08:00:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:43.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:43.679 DEBUG:teuthology.orchestra.run.smithi129:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T08:00:43.705 INFO:teuthology.orchestra.run.smithi129.stdout:1 2024-09-21T08:00:43.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:43.706 DEBUG:teuthology.orchestra.run.smithi129:> route 2024-09-21T08:00:43.772 INFO:teuthology.orchestra.run.smithi129.stdout:Kernel IP routing table 2024-09-21T08:00:43.772 INFO:teuthology.orchestra.run.smithi129.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T08:00:43.772 INFO:teuthology.orchestra.run.smithi129.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T08:00:43.772 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T08:00:43.772 INFO:teuthology.orchestra.run.smithi129.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T08:00:43.773 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T08:00:43.773 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2024-09-21T08:00:43.773 DEBUG:teuthology.orchestra.run.smithi129:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T08:00:43.773 DEBUG:teuthology.orchestra.run.smithi129:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T08:00:43.773 DEBUG:teuthology.orchestra.run.smithi129:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T08:00:43.773 DEBUG:teuthology.orchestra.run.smithi129:> ') 2024-09-21T08:00:43.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:43 smithi107 ceph-mon[27622]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-21T08:00:43.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:43 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/3702091759' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T08:00:43.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T08:00:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T08:00:44.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T08:00:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:44.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:44.079 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list 2024-09-21T08:00:44.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:44.094 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list-id 2024-09-21T08:00:44.150 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T08:00:44.150 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2024-09-21T08:00:44.150 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T08:00:44.150 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-21T08:00:44.150 DEBUG:teuthology.orchestra.run.smithi129:> ') 2024-09-21T08:00:44.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T08:00:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T08:00:44.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T08:00:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:44.267 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-21T08:00:44.267 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T08:00:44.267 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2024-09-21T08:00:44.267 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-21T08:00:44.267 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T08:00:44.267 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-21T08:00:44.267 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-21T08:00:44.268 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-21T08:00:44.268 DEBUG:teuthology.orchestra.run.smithi129:> ') 2024-09-21T08:00:44.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T08:00:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T08:00:44.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T08:00:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:44.387 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T08:00:44.387 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2024-09-21T08:00:44.387 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link set brx.0 up 2024-09-21T08:00:44.388 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T08:00:44.388 DEBUG:teuthology.orchestra.run.smithi129:> ') 2024-09-21T08:00:44.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T08:00:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T08:00:44.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T08:00:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:44.464 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T08:00:44.464 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T08:00:44.487 INFO:teuthology.orchestra.run.smithi129.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T08:00:44.487 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T08:00:44.487 DEBUG:teuthology.orchestra.run.smithi129:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T08:00:44.542 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T08:00:44.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:44.543 DEBUG:teuthology.orchestra.run.smithi129:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T08:00:44.642 INFO:teuthology.orchestra.run.smithi129.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T08:00:44.642 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T08:00:44.642 INFO:teuthology.orchestra.run.smithi129.stdout:invalid new device string format 2024-09-21T08:00:44.764 INFO:teuthology.orchestra.run.smithi129.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T08:00:44.765 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T08:00:44.765 INFO:teuthology.orchestra.run.smithi129.stdout:invalid new device string format 2024-09-21T08:00:44.765 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: resolved to: "172.21.15.107:3300,172.21.15.129:3300" 2024-09-21T08:00:44.765 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T08:00:44.772 INFO:teuthology.orchestra.run.smithi129.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T08:00:44.772 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T08:00:44.772 INFO:teuthology.orchestra.run.smithi129.stdout:invalid new device string format 2024-09-21T08:00:44.772 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: resolved to: "172.21.15.107:3300,172.21.15.129:3300" 2024-09-21T08:00:44.772 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T08:00:44.772 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: resolved to: "172.21.15.107:6789,172.21.15.129:6789" 2024-09-21T08:00:44.772 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.107:6789,172.21.15.129:6789:/ 2024-09-21T08:00:44.773 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=786d4f32-77ee-11ef-baf6-efdc52797490" will pass to kernel 2024-09-21T08:00:44.773 INFO:teuthology.orchestra.run.smithi129.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T08:00:44.773 INFO:teuthology.orchestra.run.smithi129.stdout: You just mounted a file system that supports labels which does not 2024-09-21T08:00:44.773 INFO:teuthology.orchestra.run.smithi129.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T08:00:44.773 INFO:teuthology.orchestra.run.smithi129.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T08:00:44.773 INFO:teuthology.orchestra.run.smithi129.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T08:00:44.774 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T08:00:44.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:44.775 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T08:00:44.799 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T08:00:44.887 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T08:00:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T08:00:44.889 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T08:00:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:44.894 INFO:teuthology.orchestra.run.smithi129.stdout:client14494 2024-09-21T08:00:44.895 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T08:00:44.895 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T08:00:44.911 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T08:00:44.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T08:00:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T08:00:45.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T08:00:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:45.006 INFO:teuthology.orchestra.run.smithi129.stdout:client14494 2024-09-21T08:00:45.006 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T08:00:45.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T08:00:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T08:00:45.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T08:00:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:45.061 INFO:teuthology.orchestra.run.smithi129.stdout:client14494 2024-09-21T08:00:45.061 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/786d4f32-77ee-11ef-baf6-efdc52797490.client14494/status') 2024-09-21T08:00:45.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T08:00:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T08:00:45.119 INFO:teuthology.orchestra.run.smithi129.stdout:instance: client.14494 (3)172.21.15.129:0/3058185692 2024-09-21T08:00:45.120 INFO:teuthology.orchestra.run.smithi129.stdout:blocklisted: false 2024-09-21T08:00:45.120 INFO:teuthology.orchestra.run.smithi129.stderr:0+1 records in 2024-09-21T08:00:45.120 INFO:teuthology.orchestra.run.smithi129.stderr:0+1 records out 2024-09-21T08:00:45.120 INFO:teuthology.orchestra.run.smithi129.stderr:72 bytes copied, 2.4553e-05 s, 2.9 MB/s 2024-09-21T08:00:45.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T08:00:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:45.127 INFO:teuthology.run_tasks:Running task print... 2024-09-21T08:00:45.145 INFO:teuthology.task.print:**** done client 2024-09-21T08:00:45.145 INFO:teuthology.run_tasks:Running task parallel... 2024-09-21T08:00:45.181 INFO:teuthology.task.parallel:starting parallel... 2024-09-21T08:00:45.181 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-21T08:00:45.182 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T08:00:45.182 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi107.front.sepia.ceph.com 2024-09-21T08:00:45.183 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-21T08:00:45.183 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-21T08:00:45.183 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-21T08:00:45.187 INFO:tasks.workunit:Pulling workunits from ref 4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-21T08:00:45.188 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T08:00:45.188 INFO:tasks.workunit:timeout=3h 2024-09-21T08:00:45.188 INFO:tasks.workunit:cleanup=True 2024-09-21T08:00:45.188 DEBUG:teuthology.orchestra.run.smithi107:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T08:00:45.205 INFO:teuthology.orchestra.run.smithi107.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T08:00:45.205 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T08:00:45.205 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 7fh/127d Inode: 1 Links: 2 2024-09-21T08:00:45.205 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T08:00:45.205 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T08:00:45.205 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-21T08:00:45.205 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-21 08:00:08.274512636 +0000 2024-09-21T08:00:45.205 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-21 08:00:40.241203504 +0000 2024-09-21T08:00:45.205 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-21 08:00:08.274512636 +0000 2024-09-21T08:00:45.205 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T08:00:45.206 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T08:00:45.272 DEBUG:teuthology.orchestra.run.smithi129:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-21T08:00:45.288 INFO:teuthology.orchestra.run.smithi129.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-21T08:00:45.288 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-09-21T08:00:45.288 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 75h/117d Inode: 1 Links: 3 2024-09-21T08:00:45.288 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T08:00:45.289 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T08:00:45.289 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-21T08:00:45.289 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-09-21 08:00:45.266118591 +0000 2024-09-21T08:00:45.289 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-09-21 08:00:45.266118591 +0000 2024-09-21T08:00:45.289 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-09-21 08:00:08.274512636 +0000 2024-09-21T08:00:45.289 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-21T08:00:45.289 DEBUG:teuthology.orchestra.run.smithi129:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-21T08:00:45.359 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-21T08:00:45.359 DEBUG:teuthology.orchestra.run.smithi129:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-21T08:00:45.387 INFO:tasks.workunit.client.0.smithi107.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T08:00:45.421 INFO:tasks.workunit.client.1.smithi129.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-21T08:00:45.444 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:00:45.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:45 smithi107 ceph-mon[27622]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-21T08:00:45.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:45 smithi129 ceph-mon[34472]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-21T08:00:47.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.059+0000 7fef46108640 1 -- 172.21.15.107:0/734029711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef400fc560 msgr2=0x7fef400fc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:47.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.059+0000 7fef46108640 1 --2- 172.21.15.107:0/734029711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef400fc560 0x7fef400fc970 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fef300048d0 tx=0x7fef30009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:47.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.059+0000 7fef46108640 1 -- 172.21.15.107:0/734029711 shutdown_connections 2024-09-21T08:00:47.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.059+0000 7fef46108640 1 --2- 172.21.15.107:0/734029711 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef400fd830 0x7fef400fdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:47.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.059+0000 7fef46108640 1 --2- 172.21.15.107:0/734029711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef400fc560 0x7fef400fc970 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:47.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.059+0000 7fef46108640 1 -- 172.21.15.107:0/734029711 >> 172.21.15.107:0/734029711 conn(0x7fef400f7d20 msgr2=0x7fef400fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:47.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.059+0000 7fef46108640 1 -- 172.21.15.107:0/734029711 shutdown_connections 2024-09-21T08:00:47.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.059+0000 7fef46108640 1 -- 172.21.15.107:0/734029711 wait complete. 2024-09-21T08:00:47.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.060+0000 7fef46108640 1 Processor -- start 2024-09-21T08:00:47.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.060+0000 7fef46108640 1 -- start start 2024-09-21T08:00:47.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.060+0000 7fef46108640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef400fc560 0x7fef4010d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:47.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.060+0000 7fef46108640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef400fd830 0x7fef4010d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:47.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.060+0000 7fef46108640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4010e470 con 0x7fef400fc560 2024-09-21T08:00:47.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.060+0000 7fef46108640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4010e5e0 con 0x7fef400fd830 2024-09-21T08:00:47.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.060+0000 7fef3f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef400fc560 0x7fef4010d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:47.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.060+0000 7fef3f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef400fc560 0x7fef4010d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47710/0 (socket says 172.21.15.107:47710) 2024-09-21T08:00:47.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.060+0000 7fef3f7fe640 1 -- 172.21.15.107:0/3800340582 learned_addr learned my addr 172.21.15.107:0/3800340582 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:00:47.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.060+0000 7fef3f7fe640 1 -- 172.21.15.107:0/3800340582 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef400fd830 msgr2=0x7fef4010d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:47.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.060+0000 7fef37fff640 1 --2- 172.21.15.107:0/3800340582 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef400fd830 0x7fef4010d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:47.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.060+0000 7fef3f7fe640 1 --2- 172.21.15.107:0/3800340582 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef400fd830 0x7fef4010d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:47.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.060+0000 7fef3f7fe640 1 -- 172.21.15.107:0/3800340582 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef30005040 con 0x7fef400fc560 2024-09-21T08:00:47.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.060+0000 7fef37fff640 1 --2- 172.21.15.107:0/3800340582 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef400fd830 0x7fef4010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:00:47.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.061+0000 7fef3f7fe640 1 --2- 172.21.15.107:0/3800340582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef400fc560 0x7fef4010d0c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fef30003080 tx=0x7fef30009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:47.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.061+0000 7fef3cff9640 1 -- 172.21.15.107:0/3800340582 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef30038070 con 0x7fef400fc560 2024-09-21T08:00:47.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.061+0000 7fef3cff9640 1 -- 172.21.15.107:0/3800340582 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fef30009800 con 0x7fef400fc560 2024-09-21T08:00:47.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.061+0000 7fef46108640 1 -- 172.21.15.107:0/3800340582 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4010e860 con 0x7fef400fc560 2024-09-21T08:00:47.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.061+0000 7fef3cff9640 1 -- 172.21.15.107:0/3800340582 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef30033660 con 0x7fef400fc560 2024-09-21T08:00:47.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.061+0000 7fef46108640 1 -- 172.21.15.107:0/3800340582 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4010ed20 con 0x7fef400fc560 2024-09-21T08:00:47.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.062+0000 7fef46108640 1 -- 172.21.15.107:0/3800340582 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef401057f0 con 0x7fef400fc560 2024-09-21T08:00:47.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.063+0000 7fef3cff9640 1 -- 172.21.15.107:0/3800340582 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fef30030020 con 0x7fef400fc560 2024-09-21T08:00:47.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.063+0000 7fef3cff9640 1 --2- 172.21.15.107:0/3800340582 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fef2c06ed50 0x7fef2c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:47.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.063+0000 7fef3cff9640 1 -- 172.21.15.107:0/3800340582 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fef300ae380 con 0x7fef400fc560 2024-09-21T08:00:47.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.063+0000 7fef37fff640 1 --2- 172.21.15.107:0/3800340582 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fef2c06ed50 0x7fef2c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:47.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.063+0000 7fef37fff640 1 --2- 172.21.15.107:0/3800340582 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fef2c06ed50 0x7fef2c071200 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fef28006fd0 tx=0x7fef28008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:47.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.067+0000 7fef3cff9640 1 -- 172.21.15.107:0/3800340582 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fef3007b450 con 0x7fef400fc560 2024-09-21T08:00:47.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.228+0000 7fef46108640 1 -- 172.21.15.107:0/3800340582 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fef400fb9c0 con 0x7fef400fc560 2024-09-21T08:00:47.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.229+0000 7fef3cff9640 1 -- 172.21.15.107:0/3800340582 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7fef3007adf0 con 0x7fef400fc560 2024-09-21T08:00:47.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.231+0000 7fef46108640 1 -- 172.21.15.107:0/3800340582 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fef2c06ed50 msgr2=0x7fef2c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:47.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.231+0000 7fef46108640 1 --2- 172.21.15.107:0/3800340582 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fef2c06ed50 0x7fef2c071200 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fef28006fd0 tx=0x7fef28008040 comp rx=0 tx=0).stop 2024-09-21T08:00:47.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.231+0000 7fef46108640 1 -- 172.21.15.107:0/3800340582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef400fc560 msgr2=0x7fef4010d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:47.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.231+0000 7fef46108640 1 --2- 172.21.15.107:0/3800340582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef400fc560 0x7fef4010d0c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fef30003080 tx=0x7fef30009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:47.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.231+0000 7fef46108640 1 -- 172.21.15.107:0/3800340582 shutdown_connections 2024-09-21T08:00:47.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.231+0000 7fef46108640 1 --2- 172.21.15.107:0/3800340582 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef400fd830 0x7fef4010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:47.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.231+0000 7fef46108640 1 --2- 172.21.15.107:0/3800340582 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fef2c06ed50 0x7fef2c071200 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:47.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.231+0000 7fef46108640 1 --2- 172.21.15.107:0/3800340582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef400fc560 0x7fef4010d0c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:47.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.231+0000 7fef46108640 1 -- 172.21.15.107:0/3800340582 >> 172.21.15.107:0/3800340582 conn(0x7fef400f7d20 msgr2=0x7fef400f9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:47.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.231+0000 7fef46108640 1 -- 172.21.15.107:0/3800340582 shutdown_connections 2024-09-21T08:00:47.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:47.231+0000 7fef46108640 1 -- 172.21.15.107:0/3800340582 wait complete. 2024-09-21T08:00:47.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:47 smithi107 ceph-mon[27622]: pgmap v193: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-21T08:00:47.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:47 smithi129 ceph-mon[34472]: pgmap v193: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-21T08:00:47.934 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-21T08:00:48.482 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:00:49.752 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:49 smithi107 ceph-mon[27622]: pgmap v194: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-21T08:00:49.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:49 smithi129 ceph-mon[34472]: pgmap v194: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-21T08:00:50.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.092+0000 7f3dd16db640 1 -- 172.21.15.107:0/686323702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3dcc0ff6a0 msgr2=0x7f3dcc101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:50.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.092+0000 7f3dd16db640 1 --2- 172.21.15.107:0/686323702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3dcc0ff6a0 0x7f3dcc101a80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3db40048d0 tx=0x7f3db4009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:50.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.092+0000 7f3dd16db640 1 -- 172.21.15.107:0/686323702 shutdown_connections 2024-09-21T08:00:50.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.092+0000 7f3dd16db640 1 --2- 172.21.15.107:0/686323702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3dcc0ff6a0 0x7f3dcc101a80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:50.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.092+0000 7f3dd16db640 1 --2- 172.21.15.107:0/686323702 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3dcc066710 0x7f3dcc0ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:50.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.092+0000 7f3dd16db640 1 -- 172.21.15.107:0/686323702 >> 172.21.15.107:0/686323702 conn(0x7f3dcc0f6c10 msgr2=0x7f3dcc0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:50.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.092+0000 7f3dd16db640 1 -- 172.21.15.107:0/686323702 shutdown_connections 2024-09-21T08:00:50.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.092+0000 7f3dd16db640 1 -- 172.21.15.107:0/686323702 wait complete. 2024-09-21T08:00:50.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.092+0000 7f3dd16db640 1 Processor -- start 2024-09-21T08:00:50.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.093+0000 7f3dd16db640 1 -- start start 2024-09-21T08:00:50.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.093+0000 7f3dd16db640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3dcc066710 0x7f3dcc10d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:50.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.093+0000 7f3dd16db640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3dcc0ff6a0 0x7f3dcc10d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:50.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.093+0000 7f3dd16db640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc10dd00 con 0x7f3dcc0ff6a0 2024-09-21T08:00:50.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.093+0000 7f3dd16db640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc10e4d0 con 0x7f3dcc066710 2024-09-21T08:00:50.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.093+0000 7f3dc27fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3dcc0ff6a0 0x7f3dcc10d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:50.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.093+0000 7f3dc27fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3dcc0ff6a0 0x7f3dcc10d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47718/0 (socket says 172.21.15.107:47718) 2024-09-21T08:00:50.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.093+0000 7f3dc27fc640 1 -- 172.21.15.107:0/909984920 learned_addr learned my addr 172.21.15.107:0/909984920 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:00:50.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.093+0000 7f3dcaffd640 1 --2- 172.21.15.107:0/909984920 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3dcc066710 0x7f3dcc10d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:50.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.093+0000 7f3dc27fc640 1 -- 172.21.15.107:0/909984920 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3dcc066710 msgr2=0x7f3dcc10d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:50.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.093+0000 7f3dc27fc640 1 --2- 172.21.15.107:0/909984920 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3dcc066710 0x7f3dcc10d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:50.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.093+0000 7f3dc27fc640 1 -- 172.21.15.107:0/909984920 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db4005040 con 0x7f3dcc0ff6a0 2024-09-21T08:00:50.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.093+0000 7f3dcaffd640 1 --2- 172.21.15.107:0/909984920 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3dcc066710 0x7f3dcc10d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:50.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.093+0000 7f3dc27fc640 1 --2- 172.21.15.107:0/909984920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3dcc0ff6a0 0x7f3dcc10d6b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3db4000c00 tx=0x7f3db4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:50.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.094+0000 7f3dc3fff640 1 -- 172.21.15.107:0/909984920 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3db4038070 con 0x7f3dcc0ff6a0 2024-09-21T08:00:50.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.094+0000 7f3dc3fff640 1 -- 172.21.15.107:0/909984920 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3db402ae90 con 0x7f3dcc0ff6a0 2024-09-21T08:00:50.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.094+0000 7f3dd16db640 1 -- 172.21.15.107:0/909984920 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dcc10e700 con 0x7f3dcc0ff6a0 2024-09-21T08:00:50.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.094+0000 7f3dc3fff640 1 -- 172.21.15.107:0/909984920 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3db403d420 con 0x7f3dcc0ff6a0 2024-09-21T08:00:50.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.094+0000 7f3dd16db640 1 -- 172.21.15.107:0/909984920 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dcc10ec40 con 0x7f3dcc0ff6a0 2024-09-21T08:00:50.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.095+0000 7f3dd16db640 1 -- 172.21.15.107:0/909984920 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dcc0fa8b0 con 0x7f3dcc0ff6a0 2024-09-21T08:00:50.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.095+0000 7f3dc3fff640 1 -- 172.21.15.107:0/909984920 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f3db4030020 con 0x7f3dcc0ff6a0 2024-09-21T08:00:50.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.096+0000 7f3dc3fff640 1 --2- 172.21.15.107:0/909984920 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f3db806ed60 0x7f3db8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:50.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.096+0000 7f3dc3fff640 1 -- 172.21.15.107:0/909984920 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3db40ae9b0 con 0x7f3dcc0ff6a0 2024-09-21T08:00:50.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.096+0000 7f3dcaffd640 1 --2- 172.21.15.107:0/909984920 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f3db806ed60 0x7f3db8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:50.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.096+0000 7f3dcaffd640 1 --2- 172.21.15.107:0/909984920 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f3db806ed60 0x7f3db8071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0041d0 tx=0x7f3dbc009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:50.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.100+0000 7f3dc3fff640 1 -- 172.21.15.107:0/909984920 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3db407ba80 con 0x7f3dcc0ff6a0 2024-09-21T08:00:50.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.254+0000 7f3dd16db640 1 -- 172.21.15.107:0/909984920 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f3dcc04b720 con 0x7f3dcc0ff6a0 2024-09-21T08:00:50.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.255+0000 7f3dc3fff640 1 -- 172.21.15.107:0/909984920 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f3db407b420 con 0x7f3dcc0ff6a0 2024-09-21T08:00:50.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.256+0000 7f3dd16db640 1 -- 172.21.15.107:0/909984920 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f3db806ed60 msgr2=0x7f3db8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:50.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.256+0000 7f3dd16db640 1 --2- 172.21.15.107:0/909984920 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f3db806ed60 0x7f3db8071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0041d0 tx=0x7f3dbc009040 comp rx=0 tx=0).stop 2024-09-21T08:00:50.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.256+0000 7f3dd16db640 1 -- 172.21.15.107:0/909984920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3dcc0ff6a0 msgr2=0x7f3dcc10d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:50.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.256+0000 7f3dd16db640 1 --2- 172.21.15.107:0/909984920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3dcc0ff6a0 0x7f3dcc10d6b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3db4000c00 tx=0x7f3db4009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:50.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.256+0000 7f3dd16db640 1 -- 172.21.15.107:0/909984920 shutdown_connections 2024-09-21T08:00:50.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.256+0000 7f3dd16db640 1 --2- 172.21.15.107:0/909984920 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f3db806ed60 0x7f3db8071210 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:50.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.257+0000 7f3dd16db640 1 --2- 172.21.15.107:0/909984920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3dcc0ff6a0 0x7f3dcc10d6b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:50.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.257+0000 7f3dd16db640 1 --2- 172.21.15.107:0/909984920 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3dcc066710 0x7f3dcc10d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:50.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.257+0000 7f3dd16db640 1 -- 172.21.15.107:0/909984920 >> 172.21.15.107:0/909984920 conn(0x7f3dcc0f6c10 msgr2=0x7f3dcc0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:50.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.257+0000 7f3dd16db640 1 -- 172.21.15.107:0/909984920 shutdown_connections 2024-09-21T08:00:50.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:50.257+0000 7f3dd16db640 1 -- 172.21.15.107:0/909984920 wait complete. 2024-09-21T08:00:50.943 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-21T08:00:51.187 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:00:51.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:51 smithi107 ceph-mon[27622]: pgmap v195: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-21T08:00:51.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:51 smithi129 ceph-mon[34472]: pgmap v195: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-21T08:00:52.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.670+0000 7f2ee2119640 1 -- 172.21.15.107:0/1865491169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2edc0fc3b0 msgr2=0x7f2edc0fc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:52.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.670+0000 7f2ee2119640 1 --2- 172.21.15.107:0/1865491169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2edc0fc3b0 0x7f2edc0fc820 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00048d0 tx=0x7f2ed0009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:52.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.670+0000 7f2ee2119640 1 -- 172.21.15.107:0/1865491169 shutdown_connections 2024-09-21T08:00:52.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.670+0000 7f2ee2119640 1 --2- 172.21.15.107:0/1865491169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2edc0fc3b0 0x7f2edc0fc820 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:52.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.670+0000 7f2ee2119640 1 --2- 172.21.15.107:0/1865491169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2edc0fba60 0x7f2edc0fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:52.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.670+0000 7f2ee2119640 1 -- 172.21.15.107:0/1865491169 >> 172.21.15.107:0/1865491169 conn(0x7f2edc0f63b0 msgr2=0x7f2edc0f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:52.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.670+0000 7f2ee2119640 1 -- 172.21.15.107:0/1865491169 shutdown_connections 2024-09-21T08:00:52.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.670+0000 7f2ee2119640 1 -- 172.21.15.107:0/1865491169 wait complete. 2024-09-21T08:00:52.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.671+0000 7f2ee2119640 1 Processor -- start 2024-09-21T08:00:52.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.671+0000 7f2ee2119640 1 -- start start 2024-09-21T08:00:52.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.671+0000 7f2ee2119640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2edc0fba60 0x7f2edc10d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:52.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.671+0000 7f2ee2119640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2edc0fc3b0 0x7f2edc10d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:52.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.671+0000 7f2ee2119640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc10e500 con 0x7f2edc0fc3b0 2024-09-21T08:00:52.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.671+0000 7f2ee2119640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc10e670 con 0x7f2edc0fba60 2024-09-21T08:00:52.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.671+0000 7f2edaffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2edc0fc3b0 0x7f2edc10d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:52.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.671+0000 7f2edaffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2edc0fc3b0 0x7f2edc10d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47200/0 (socket says 172.21.15.107:47200) 2024-09-21T08:00:52.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.671+0000 7f2edaffd640 1 -- 172.21.15.107:0/2852555521 learned_addr learned my addr 172.21.15.107:0/2852555521 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:00:52.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.671+0000 7f2edb7fe640 1 --2- 172.21.15.107:0/2852555521 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2edc0fba60 0x7f2edc10d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:52.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.672+0000 7f2edaffd640 1 -- 172.21.15.107:0/2852555521 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2edc0fba60 msgr2=0x7f2edc10d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:52.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.672+0000 7f2edaffd640 1 --2- 172.21.15.107:0/2852555521 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2edc0fba60 0x7f2edc10d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:52.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.672+0000 7f2edaffd640 1 -- 172.21.15.107:0/2852555521 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed0005040 con 0x7f2edc0fc3b0 2024-09-21T08:00:52.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.672+0000 7f2edb7fe640 1 --2- 172.21.15.107:0/2852555521 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2edc0fba60 0x7f2edc10d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:52.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.672+0000 7f2edaffd640 1 --2- 172.21.15.107:0/2852555521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2edc0fc3b0 0x7f2edc10d690 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0003080 tx=0x7f2ed0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:52.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.672+0000 7f2ec3fff640 1 -- 172.21.15.107:0/2852555521 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ed0038070 con 0x7f2edc0fc3b0 2024-09-21T08:00:52.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.672+0000 7f2ee2119640 1 -- 172.21.15.107:0/2852555521 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2edc10e8f0 con 0x7f2edc0fc3b0 2024-09-21T08:00:52.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.672+0000 7f2ec3fff640 1 -- 172.21.15.107:0/2852555521 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2ed002abd0 con 0x7f2edc0fc3b0 2024-09-21T08:00:52.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.672+0000 7f2ec3fff640 1 -- 172.21.15.107:0/2852555521 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ed003e670 con 0x7f2edc0fc3b0 2024-09-21T08:00:52.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.672+0000 7f2ee2119640 1 -- 172.21.15.107:0/2852555521 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2edc10ee10 con 0x7f2edc0fc3b0 2024-09-21T08:00:52.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.673+0000 7f2ee2119640 1 -- 172.21.15.107:0/2852555521 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2edc0fa050 con 0x7f2edc0fc3b0 2024-09-21T08:00:52.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.673+0000 7f2ec3fff640 1 -- 172.21.15.107:0/2852555521 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f2ed0030020 con 0x7f2edc0fc3b0 2024-09-21T08:00:52.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.674+0000 7f2ec3fff640 1 --2- 172.21.15.107:0/2852555521 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f2ec406ed60 0x7f2ec4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:52.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.674+0000 7f2ec3fff640 1 -- 172.21.15.107:0/2852555521 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2ed00ae680 con 0x7f2edc0fc3b0 2024-09-21T08:00:52.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.674+0000 7f2edb7fe640 1 --2- 172.21.15.107:0/2852555521 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f2ec406ed60 0x7f2ec4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:52.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.674+0000 7f2edb7fe640 1 --2- 172.21.15.107:0/2852555521 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f2ec406ed60 0x7f2ec4071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0657f0 tx=0x7f2ecc0096a0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:52.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.678+0000 7f2ec3fff640 1 -- 172.21.15.107:0/2852555521 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2ed007b6b0 con 0x7f2edc0fc3b0 2024-09-21T08:00:52.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.833+0000 7f2ee2119640 1 -- 172.21.15.107:0/2852555521 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f2edc04b720 con 0x7f2edc0fc3b0 2024-09-21T08:00:52.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.834+0000 7f2ec3fff640 1 -- 172.21.15.107:0/2852555521 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f2ed007b050 con 0x7f2edc0fc3b0 2024-09-21T08:00:52.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.835+0000 7f2ee2119640 1 -- 172.21.15.107:0/2852555521 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f2ec406ed60 msgr2=0x7f2ec4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:52.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.835+0000 7f2ee2119640 1 --2- 172.21.15.107:0/2852555521 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f2ec406ed60 0x7f2ec4071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0657f0 tx=0x7f2ecc0096a0 comp rx=0 tx=0).stop 2024-09-21T08:00:52.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.835+0000 7f2ee2119640 1 -- 172.21.15.107:0/2852555521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2edc0fc3b0 msgr2=0x7f2edc10d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:52.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.835+0000 7f2ee2119640 1 --2- 172.21.15.107:0/2852555521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2edc0fc3b0 0x7f2edc10d690 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0003080 tx=0x7f2ed0009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:52.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.836+0000 7f2ee2119640 1 -- 172.21.15.107:0/2852555521 shutdown_connections 2024-09-21T08:00:52.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.836+0000 7f2ee2119640 1 --2- 172.21.15.107:0/2852555521 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f2ec406ed60 0x7f2ec4071210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:52.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.836+0000 7f2ee2119640 1 --2- 172.21.15.107:0/2852555521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2edc0fc3b0 0x7f2edc10d690 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:52.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.836+0000 7f2ee2119640 1 --2- 172.21.15.107:0/2852555521 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2edc0fba60 0x7f2edc10d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:52.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.836+0000 7f2ee2119640 1 -- 172.21.15.107:0/2852555521 >> 172.21.15.107:0/2852555521 conn(0x7f2edc0f63b0 msgr2=0x7f2edc0fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:52.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.836+0000 7f2ee2119640 1 -- 172.21.15.107:0/2852555521 shutdown_connections 2024-09-21T08:00:52.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:52.836+0000 7f2ee2119640 1 -- 172.21.15.107:0/2852555521 wait complete. 2024-09-21T08:00:53.539 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:53 smithi107 ceph-mon[27622]: pgmap v196: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-21T08:00:53.565 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-21T08:00:53.681 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:53 smithi129 ceph-mon[34472]: pgmap v196: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-21T08:00:53.812 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:00:54.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:54 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:00:54.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:54 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:00:55.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.377+0000 7f7e8f77f640 1 -- 172.21.15.107:0/2962655509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e880fc230 msgr2=0x7f7e880fa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:55.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.377+0000 7f7e8f77f640 1 --2- 172.21.15.107:0/2962655509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e880fc230 0x7f7e880fa660 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0048d0 tx=0x7f7e7c009da0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.377+0000 7f7e8f77f640 1 -- 172.21.15.107:0/2962655509 shutdown_connections 2024-09-21T08:00:55.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.377+0000 7f7e8f77f640 1 --2- 172.21.15.107:0/2962655509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e880fc230 0x7f7e880fa660 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.377+0000 7f7e8f77f640 1 --2- 172.21.15.107:0/2962655509 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7e880fb8e0 0x7f7e880fbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.377+0000 7f7e8f77f640 1 -- 172.21.15.107:0/2962655509 >> 172.21.15.107:0/2962655509 conn(0x7f7e880f63b0 msgr2=0x7f7e880f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:55.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.377+0000 7f7e8f77f640 1 -- 172.21.15.107:0/2962655509 shutdown_connections 2024-09-21T08:00:55.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.377+0000 7f7e8f77f640 1 -- 172.21.15.107:0/2962655509 wait complete. 2024-09-21T08:00:55.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.378+0000 7f7e8f77f640 1 Processor -- start 2024-09-21T08:00:55.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.378+0000 7f7e8f77f640 1 -- start start 2024-09-21T08:00:55.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.378+0000 7f7e8f77f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e880fb8e0 0x7f7e881136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.378+0000 7f7e8f77f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7e880fc230 0x7f7e88113be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.378+0000 7f7e8f77f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e88114230 con 0x7f7e880fb8e0 2024-09-21T08:00:55.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.378+0000 7f7e8f77f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e88114a00 con 0x7f7e880fc230 2024-09-21T08:00:55.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.378+0000 7f7e8d51b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e880fb8e0 0x7f7e881136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.378+0000 7f7e8d51b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e880fb8e0 0x7f7e881136a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47222/0 (socket says 172.21.15.107:47222) 2024-09-21T08:00:55.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.378+0000 7f7e8d51b640 1 -- 172.21.15.107:0/3730760251 learned_addr learned my addr 172.21.15.107:0/3730760251 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:00:55.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.378+0000 7f7e8d51b640 1 -- 172.21.15.107:0/3730760251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7e880fc230 msgr2=0x7f7e88113be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:55.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.378+0000 7f7e8cd1a640 1 --2- 172.21.15.107:0/3730760251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7e880fc230 0x7f7e88113be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.378+0000 7f7e8d51b640 1 --2- 172.21.15.107:0/3730760251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7e880fc230 0x7f7e88113be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.378+0000 7f7e8d51b640 1 -- 172.21.15.107:0/3730760251 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7c005040 con 0x7f7e880fb8e0 2024-09-21T08:00:55.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.379+0000 7f7e8d51b640 1 --2- 172.21.15.107:0/3730760251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e880fb8e0 0x7f7e881136a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400c810 tx=0x7f7e840043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:55.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.379+0000 7f7e79ffb640 1 -- 172.21.15.107:0/3730760251 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e8400a820 con 0x7f7e880fb8e0 2024-09-21T08:00:55.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.379+0000 7f7e79ffb640 1 -- 172.21.15.107:0/3730760251 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7e8400ae20 con 0x7f7e880fb8e0 2024-09-21T08:00:55.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.379+0000 7f7e8f77f640 1 -- 172.21.15.107:0/3730760251 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e88114c90 con 0x7f7e880fb8e0 2024-09-21T08:00:55.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.379+0000 7f7e79ffb640 1 -- 172.21.15.107:0/3730760251 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e840115c0 con 0x7f7e880fb8e0 2024-09-21T08:00:55.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.379+0000 7f7e8f77f640 1 -- 172.21.15.107:0/3730760251 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e88115230 con 0x7f7e880fb8e0 2024-09-21T08:00:55.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.380+0000 7f7e8f77f640 1 -- 172.21.15.107:0/3730760251 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e880fa050 con 0x7f7e880fb8e0 2024-09-21T08:00:55.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.380+0000 7f7e79ffb640 1 -- 172.21.15.107:0/3730760251 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f7e84012840 con 0x7f7e880fb8e0 2024-09-21T08:00:55.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.381+0000 7f7e79ffb640 1 --2- 172.21.15.107:0/3730760251 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7e7406ed60 0x7f7e74071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.381+0000 7f7e79ffb640 1 -- 172.21.15.107:0/3730760251 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7e8408e780 con 0x7f7e880fb8e0 2024-09-21T08:00:55.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.381+0000 7f7e8cd1a640 1 --2- 172.21.15.107:0/3730760251 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7e7406ed60 0x7f7e74071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.381+0000 7f7e8cd1a640 1 --2- 172.21.15.107:0/3730760251 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7e7406ed60 0x7f7e74071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c000c00 tx=0x7f7e7c009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:55.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.385+0000 7f7e79ffb640 1 -- 172.21.15.107:0/3730760251 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7e8405b850 con 0x7f7e880fb8e0 2024-09-21T08:00:55.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:55 smithi107 ceph-mon[27622]: pgmap v197: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-21T08:00:55.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:00:55.553+0000 7f7e8f77f640 1 -- 172.21.15.107:0/3730760251 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e88115620 con 0x7f7e7406ed60 2024-09-21T08:00:55.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:55 smithi129 ceph-mon[34472]: pgmap v197: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-21T08:00:56.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:56 smithi129 ceph-mon[34472]: from='client.14510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:56.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:56 smithi107 ceph-mon[27622]: from='client.14510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:57.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:57 smithi107 ceph-mon[27622]: pgmap v198: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-21T08:00:57.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:57 smithi129 ceph-mon[34472]: pgmap v198: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-21T08:00:59.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:00:59 smithi129 ceph-mon[34472]: pgmap v199: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T08:00:59.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:00:59 smithi107 ceph-mon[27622]: pgmap v199: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T08:01:01.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:01 smithi129 ceph-mon[34472]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T08:01:01.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:01 smithi107 ceph-mon[27622]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T08:01:03.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:03 smithi129 ceph-mon[34472]: pgmap v201: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T08:01:03.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:03 smithi107 ceph-mon[27622]: pgmap v201: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T08:01:05.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:05 smithi129 ceph-mon[34472]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T08:01:05.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:05 smithi107 ceph-mon[27622]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T08:01:07.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:07 smithi107 ceph-mon[27622]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:07.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:07 smithi129 ceph-mon[34472]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:09.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:09 smithi129 ceph-mon[34472]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:09.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:09 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:01:09.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:09 smithi107 ceph-mon[27622]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:09.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:09 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:01:11.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:11 smithi129 ceph-mon[34472]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:11.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:11 smithi107 ceph-mon[27622]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:13.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:13 smithi129 ceph-mon[34472]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:13.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:13 smithi107 ceph-mon[27622]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:15.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:15 smithi129 ceph-mon[34472]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:15.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:15 smithi107 ceph-mon[27622]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:17.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:17 smithi107 ceph-mon[27622]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:17.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:17 smithi129 ceph-mon[34472]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:19.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:19 smithi129 ceph-mon[34472]: pgmap v209: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:19.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:19 smithi107 ceph-mon[27622]: pgmap v209: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:21.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:21 smithi129 ceph-mon[34472]: pgmap v210: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:21.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:21 smithi107 ceph-mon[27622]: pgmap v210: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:23.462 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:23 smithi107 ceph-mon[27622]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T08:01:23.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:23 smithi129 ceph-mon[34472]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T08:01:24.488 INFO:teuthology.orchestra.run.smithi107.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T08:01:24.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:24.486+0000 7f7e79ffb640 1 -- 172.21.15.107:0/3730760251 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f7e88115620 con 0x7f7e7406ed60 2024-09-21T08:01:24.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:24.489+0000 7f7e8f77f640 1 -- 172.21.15.107:0/3730760251 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7e7406ed60 msgr2=0x7f7e74071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:24.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:24.489+0000 7f7e8f77f640 1 --2- 172.21.15.107:0/3730760251 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7e7406ed60 0x7f7e74071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c000c00 tx=0x7f7e7c009da0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:24.489+0000 7f7e8f77f640 1 -- 172.21.15.107:0/3730760251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e880fb8e0 msgr2=0x7f7e881136a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:24.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:24.489+0000 7f7e8f77f640 1 --2- 172.21.15.107:0/3730760251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e880fb8e0 0x7f7e881136a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400c810 tx=0x7f7e840043c0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:24.489+0000 7f7e8f77f640 1 -- 172.21.15.107:0/3730760251 shutdown_connections 2024-09-21T08:01:24.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:24.489+0000 7f7e8f77f640 1 --2- 172.21.15.107:0/3730760251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7e880fc230 0x7f7e88113be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:24.489+0000 7f7e8f77f640 1 --2- 172.21.15.107:0/3730760251 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f7e7406ed60 0x7f7e74071210 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:24.489+0000 7f7e8f77f640 1 --2- 172.21.15.107:0/3730760251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e880fb8e0 0x7f7e881136a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:24.489+0000 7f7e8f77f640 1 -- 172.21.15.107:0/3730760251 >> 172.21.15.107:0/3730760251 conn(0x7f7e880f63b0 msgr2=0x7f7e880f7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:24.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:24.489+0000 7f7e8f77f640 1 -- 172.21.15.107:0/3730760251 shutdown_connections 2024-09-21T08:01:24.492 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:24.489+0000 7f7e8f77f640 1 -- 172.21.15.107:0/3730760251 wait complete. 2024-09-21T08:01:24.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:24 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:01:24.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:24 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:01:25.237 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-21T08:01:25.486 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:25 smithi107 ceph-mon[27622]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T08:01:25.486 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:25 smithi107 ceph-mon[27622]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T08:01:25.592 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:01:25.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:25 smithi129 ceph-mon[34472]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T08:01:25.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:25 smithi129 ceph-mon[34472]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T08:01:25.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:25 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:01:25.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:25 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:01:25.781 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:25 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:01:25.781 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:25 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:01:26.488 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:26 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:01:26.488 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:26 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:01:26.488 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:26 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:01:26.488 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:26 smithi107 ceph-mon[27622]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T08:01:26.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:26 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:01:26.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:26 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:01:26.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:26 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:01:26.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:26 smithi129 ceph-mon[34472]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T08:01:27.695 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:27 smithi107 ceph-mon[27622]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T08:01:27.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:27 smithi129 ceph-mon[34472]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T08:01:28.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.986+0000 7f8a2e495640 1 -- 172.21.15.107:0/1247296556 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a280fc390 msgr2=0x7f8a280fc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:28.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.986+0000 7f8a2e495640 1 --2- 172.21.15.107:0/1247296556 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a280fc390 0x7f8a280fc7e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0048d0 tx=0x7f8a1c009da0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.986+0000 7f8a2e495640 1 -- 172.21.15.107:0/1247296556 shutdown_connections 2024-09-21T08:01:28.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.986+0000 7f8a2e495640 1 --2- 172.21.15.107:0/1247296556 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a280fc390 0x7f8a280fc7e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.986+0000 7f8a2e495640 1 --2- 172.21.15.107:0/1247296556 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8a280fba40 0x7f8a280fbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.986+0000 7f8a2e495640 1 -- 172.21.15.107:0/1247296556 >> 172.21.15.107:0/1247296556 conn(0x7f8a280f6390 msgr2=0x7f8a280f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:28.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.986+0000 7f8a2e495640 1 -- 172.21.15.107:0/1247296556 shutdown_connections 2024-09-21T08:01:28.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.986+0000 7f8a2e495640 1 -- 172.21.15.107:0/1247296556 wait complete. 2024-09-21T08:01:28.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.987+0000 7f8a2e495640 1 Processor -- start 2024-09-21T08:01:28.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.987+0000 7f8a2e495640 1 -- start start 2024-09-21T08:01:28.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.987+0000 7f8a2e495640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a280fba40 0x7f8a2810bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:28.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.987+0000 7f8a2e495640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8a280fc390 0x7f8a2810c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:28.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.987+0000 7f8a2e495640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2810cad0 con 0x7f8a280fba40 2024-09-21T08:01:28.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.987+0000 7f8a2e495640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2810d2f0 con 0x7f8a280fc390 2024-09-21T08:01:28.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.987+0000 7f8a277fe640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8a280fc390 0x7f8a2810c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:28.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.987+0000 7f8a277fe640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8a280fc390 0x7f8a2810c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.107:51306/0 (socket says 172.21.15.107:51306) 2024-09-21T08:01:28.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.987+0000 7f8a277fe640 1 -- 172.21.15.107:0/1149984743 learned_addr learned my addr 172.21.15.107:0/1149984743 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:01:28.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.987+0000 7f8a27fff640 1 --2- 172.21.15.107:0/1149984743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a280fba40 0x7f8a2810bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:28.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.988+0000 7f8a277fe640 1 -- 172.21.15.107:0/1149984743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a280fba40 msgr2=0x7f8a2810bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:28.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.988+0000 7f8a277fe640 1 --2- 172.21.15.107:0/1149984743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a280fba40 0x7f8a2810bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.988+0000 7f8a277fe640 1 -- 172.21.15.107:0/1149984743 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c005040 con 0x7f8a280fc390 2024-09-21T08:01:28.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.988+0000 7f8a27fff640 1 --2- 172.21.15.107:0/1149984743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a280fba40 0x7f8a2810bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:28.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.988+0000 7f8a277fe640 1 --2- 172.21.15.107:0/1149984743 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8a280fc390 0x7f8a2810c480 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0043d0 tx=0x7f8a1c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:28.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.988+0000 7f8a24ff9640 1 -- 172.21.15.107:0/1149984743 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a1c038070 con 0x7f8a280fc390 2024-09-21T08:01:28.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.988+0000 7f8a2e495640 1 -- 172.21.15.107:0/1149984743 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2810d520 con 0x7f8a280fc390 2024-09-21T08:01:28.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.988+0000 7f8a24ff9640 1 -- 172.21.15.107:0/1149984743 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8a1c02ae90 con 0x7f8a280fc390 2024-09-21T08:01:28.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.988+0000 7f8a2e495640 1 -- 172.21.15.107:0/1149984743 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2810da40 con 0x7f8a280fc390 2024-09-21T08:01:28.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.988+0000 7f8a24ff9640 1 -- 172.21.15.107:0/1149984743 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a1c03e670 con 0x7f8a280fc390 2024-09-21T08:01:28.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.989+0000 7f8a2e495640 1 -- 172.21.15.107:0/1149984743 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a280fa010 con 0x7f8a280fc390 2024-09-21T08:01:28.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.991+0000 7f8a24ff9640 1 -- 172.21.15.107:0/1149984743 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f8a1c030020 con 0x7f8a280fc390 2024-09-21T08:01:28.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.991+0000 7f8a24ff9640 1 --2- 172.21.15.107:0/1149984743 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f8a1006ed60 0x7f8a10071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:28.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.991+0000 7f8a24ff9640 1 -- 172.21.15.107:0/1149984743 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8a1c0ae2d0 con 0x7f8a280fc390 2024-09-21T08:01:28.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.991+0000 7f8a27fff640 1 --2- 172.21.15.107:0/1149984743 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f8a1006ed60 0x7f8a10071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:28.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.992+0000 7f8a27fff640 1 --2- 172.21.15.107:0/1149984743 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f8a1006ed60 0x7f8a10071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009fd0 tx=0x7f8a1800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:28.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:27.999+0000 7f8a24ff9640 1 -- 172.21.15.107:0/1149984743 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8a1c07b4d0 con 0x7f8a280fc390 2024-09-21T08:01:28.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.176+0000 7f8a2e495640 1 -- 172.21.15.107:0/1149984743 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a2810de70 con 0x7f8a1006ed60 2024-09-21T08:01:28.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.178+0000 7f8a24ff9640 1 -- 172.21.15.107:0/1149984743 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f8a2810de70 con 0x7f8a1006ed60 2024-09-21T08:01:28.897 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:01:28.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.180+0000 7f8a2e495640 1 -- 172.21.15.107:0/1149984743 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f8a1006ed60 msgr2=0x7f8a10071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:28.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.180+0000 7f8a2e495640 1 --2- 172.21.15.107:0/1149984743 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f8a1006ed60 0x7f8a10071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009fd0 tx=0x7f8a1800b040 comp rx=0 tx=0).stop 2024-09-21T08:01:28.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.180+0000 7f8a2e495640 1 -- 172.21.15.107:0/1149984743 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8a280fc390 msgr2=0x7f8a2810c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:28.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.180+0000 7f8a2e495640 1 --2- 172.21.15.107:0/1149984743 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8a280fc390 0x7f8a2810c480 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0043d0 tx=0x7f8a1c009da0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.180+0000 7f8a2e495640 1 -- 172.21.15.107:0/1149984743 shutdown_connections 2024-09-21T08:01:28.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.180+0000 7f8a2e495640 1 --2- 172.21.15.107:0/1149984743 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8a280fc390 0x7f8a2810c480 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.180+0000 7f8a2e495640 1 --2- 172.21.15.107:0/1149984743 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f8a1006ed60 0x7f8a10071210 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.180+0000 7f8a2e495640 1 --2- 172.21.15.107:0/1149984743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a280fba40 0x7f8a2810bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.180+0000 7f8a2e495640 1 -- 172.21.15.107:0/1149984743 >> 172.21.15.107:0/1149984743 conn(0x7f8a280f6390 msgr2=0x7f8a280f7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:28.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.180+0000 7f8a2e495640 1 -- 172.21.15.107:0/1149984743 shutdown_connections 2024-09-21T08:01:28.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.180+0000 7f8a2e495640 1 -- 172.21.15.107:0/1149984743 wait complete. 2024-09-21T08:01:28.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.266+0000 7fd5efe4c640 1 -- 172.21.15.107:0/3445932914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5e80fb430 msgr2=0x7fd5e80fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:28.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.266+0000 7fd5efe4c640 1 --2- 172.21.15.107:0/3445932914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5e80fb430 0x7fd5e80fb840 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40048d0 tx=0x7fd5e4009da0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.266+0000 7fd5efe4c640 1 -- 172.21.15.107:0/3445932914 shutdown_connections 2024-09-21T08:01:28.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.266+0000 7fd5efe4c640 1 --2- 172.21.15.107:0/3445932914 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd5e80fc700 0x7fd5e80fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.266+0000 7fd5efe4c640 1 --2- 172.21.15.107:0/3445932914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5e80fb430 0x7fd5e80fb840 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.266+0000 7fd5efe4c640 1 -- 172.21.15.107:0/3445932914 >> 172.21.15.107:0/3445932914 conn(0x7fd5e80f6c10 msgr2=0x7fd5e80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:28.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.267+0000 7fd5efe4c640 1 -- 172.21.15.107:0/3445932914 shutdown_connections 2024-09-21T08:01:28.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.267+0000 7fd5efe4c640 1 -- 172.21.15.107:0/3445932914 wait complete. 2024-09-21T08:01:28.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.267+0000 7fd5efe4c640 1 Processor -- start 2024-09-21T08:01:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.268+0000 7fd5efe4c640 1 -- start start 2024-09-21T08:01:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.268+0000 7fd5efe4c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd5e80fc700 0x7fd5e810d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.268+0000 7fd5efe4c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5e810d740 0x7fd5e810e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.268+0000 7fd5efe4c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e810dc00 con 0x7fd5e810d740 2024-09-21T08:01:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.268+0000 7fd5efe4c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e810dd40 con 0x7fd5e80fc700 2024-09-21T08:01:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.268+0000 7fd5ed3e7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5e810d740 0x7fd5e810e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.268+0000 7fd5ed3e7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5e810d740 0x7fd5e810e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33792/0 (socket says 172.21.15.107:33792) 2024-09-21T08:01:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.268+0000 7fd5ed3e7640 1 -- 172.21.15.107:0/646702660 learned_addr learned my addr 172.21.15.107:0/646702660 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:01:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.268+0000 7fd5edbe8640 1 --2- 172.21.15.107:0/646702660 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd5e80fc700 0x7fd5e810d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.269+0000 7fd5ed3e7640 1 -- 172.21.15.107:0/646702660 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd5e80fc700 msgr2=0x7fd5e810d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.269+0000 7fd5ed3e7640 1 --2- 172.21.15.107:0/646702660 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd5e80fc700 0x7fd5e810d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.269+0000 7fd5ed3e7640 1 -- 172.21.15.107:0/646702660 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e4005040 con 0x7fd5e810d740 2024-09-21T08:01:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.269+0000 7fd5edbe8640 1 --2- 172.21.15.107:0/646702660 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd5e80fc700 0x7fd5e810d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.269+0000 7fd5ed3e7640 1 --2- 172.21.15.107:0/646702660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5e810d740 0x7fd5e810e5b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800eb70 tx=0x7fd5d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.269+0000 7fd5de7fc640 1 -- 172.21.15.107:0/646702660 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5d8007c30 con 0x7fd5e810d740 2024-09-21T08:01:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.269+0000 7fd5de7fc640 1 -- 172.21.15.107:0/646702660 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd5d800f040 con 0x7fd5e810d740 2024-09-21T08:01:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.269+0000 7fd5de7fc640 1 -- 172.21.15.107:0/646702660 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5d800ca60 con 0x7fd5e810d740 2024-09-21T08:01:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.269+0000 7fd5efe4c640 1 -- 172.21.15.107:0/646702660 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e810eb50 con 0x7fd5e810d740 2024-09-21T08:01:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.270+0000 7fd5efe4c640 1 -- 172.21.15.107:0/646702660 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e810f070 con 0x7fd5e810d740 2024-09-21T08:01:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.271+0000 7fd5efe4c640 1 -- 172.21.15.107:0/646702660 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e80fa890 con 0x7fd5e810d740 2024-09-21T08:01:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.271+0000 7fd5de7fc640 1 -- 172.21.15.107:0/646702660 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fd5d800cbc0 con 0x7fd5e810d740 2024-09-21T08:01:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.272+0000 7fd5de7fc640 1 --2- 172.21.15.107:0/646702660 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fd5d406ed60 0x7fd5d4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.272+0000 7fd5de7fc640 1 -- 172.21.15.107:0/646702660 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd5d808de80 con 0x7fd5e810d740 2024-09-21T08:01:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.272+0000 7fd5edbe8640 1 --2- 172.21.15.107:0/646702660 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fd5d406ed60 0x7fd5d4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.273+0000 7fd5edbe8640 1 --2- 172.21.15.107:0/646702660 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fd5d406ed60 0x7fd5d4071210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4009040 tx=0x7fd5e4035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.277+0000 7fd5de7fc640 1 -- 172.21.15.107:0/646702660 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd5d8057230 con 0x7fd5e810d740 2024-09-21T08:01:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.496+0000 7fd5efe4c640 1 -- 172.21.15.107:0/646702660 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5e8105060 con 0x7fd5d406ed60 2024-09-21T08:01:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.497+0000 7fd5de7fc640 1 -- 172.21.15.107:0/646702660 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7fd5e8105060 con 0x7fd5d406ed60 2024-09-21T08:01:28.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.500+0000 7fd5efe4c640 1 -- 172.21.15.107:0/646702660 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fd5d406ed60 msgr2=0x7fd5d4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:28.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.500+0000 7fd5efe4c640 1 --2- 172.21.15.107:0/646702660 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fd5d406ed60 0x7fd5d4071210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4009040 tx=0x7fd5e4035040 comp rx=0 tx=0).stop 2024-09-21T08:01:28.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.500+0000 7fd5efe4c640 1 -- 172.21.15.107:0/646702660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5e810d740 msgr2=0x7fd5e810e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:28.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.500+0000 7fd5efe4c640 1 --2- 172.21.15.107:0/646702660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5e810d740 0x7fd5e810e5b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800eb70 tx=0x7fd5d800b040 comp rx=0 tx=0).stop 2024-09-21T08:01:28.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.500+0000 7fd5efe4c640 1 -- 172.21.15.107:0/646702660 shutdown_connections 2024-09-21T08:01:28.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.500+0000 7fd5efe4c640 1 --2- 172.21.15.107:0/646702660 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fd5d406ed60 0x7fd5d4071210 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.500+0000 7fd5efe4c640 1 --2- 172.21.15.107:0/646702660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5e810d740 0x7fd5e810e5b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.500+0000 7fd5efe4c640 1 --2- 172.21.15.107:0/646702660 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd5e80fc700 0x7fd5e810d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.500+0000 7fd5efe4c640 1 -- 172.21.15.107:0/646702660 >> 172.21.15.107:0/646702660 conn(0x7fd5e80f6c10 msgr2=0x7fd5e80f8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:28.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.500+0000 7fd5efe4c640 1 -- 172.21.15.107:0/646702660 shutdown_connections 2024-09-21T08:01:28.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.500+0000 7fd5efe4c640 1 -- 172.21.15.107:0/646702660 wait complete. 2024-09-21T08:01:28.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.582+0000 7f6e2901d640 1 -- 172.21.15.107:0/541106870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e24065be0 msgr2=0x7f6e241015a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:28.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.582+0000 7f6e2901d640 1 --2- 172.21.15.107:0/541106870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e24065be0 0x7f6e241015a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009c50 tx=0x7f6e14004d10 comp rx=0 tx=0).stop 2024-09-21T08:01:28.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.582+0000 7f6e2901d640 1 -- 172.21.15.107:0/541106870 shutdown_connections 2024-09-21T08:01:28.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.582+0000 7f6e2901d640 1 --2- 172.21.15.107:0/541106870 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e24101ae0 0x7f6e24103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.582+0000 7f6e2901d640 1 --2- 172.21.15.107:0/541106870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e24065be0 0x7f6e241015a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.582+0000 7f6e2901d640 1 -- 172.21.15.107:0/541106870 >> 172.21.15.107:0/541106870 conn(0x7f6e240f6c10 msgr2=0x7f6e240f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.582+0000 7f6e2901d640 1 -- 172.21.15.107:0/541106870 shutdown_connections 2024-09-21T08:01:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.582+0000 7f6e2901d640 1 -- 172.21.15.107:0/541106870 wait complete. 2024-09-21T08:01:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.583+0000 7f6e2901d640 1 Processor -- start 2024-09-21T08:01:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.583+0000 7f6e2901d640 1 -- start start 2024-09-21T08:01:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.583+0000 7f6e2901d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e24101ae0 0x7f6e2410f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.583+0000 7f6e2901d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e2410f960 0x7f6e241107d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.583+0000 7f6e2901d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2410fe20 con 0x7f6e24101ae0 2024-09-21T08:01:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.583+0000 7f6e2901d640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2410ff60 con 0x7f6e2410f960 2024-09-21T08:01:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.583+0000 7f6e22d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e24101ae0 0x7f6e2410f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.583+0000 7f6e22d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e24101ae0 0x7f6e2410f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33804/0 (socket says 172.21.15.107:33804) 2024-09-21T08:01:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.583+0000 7f6e22d9d640 1 -- 172.21.15.107:0/723885206 learned_addr learned my addr 172.21.15.107:0/723885206 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:01:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.583+0000 7f6e2259c640 1 --2- 172.21.15.107:0/723885206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e2410f960 0x7f6e241107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:28.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.584+0000 7f6e22d9d640 1 -- 172.21.15.107:0/723885206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e2410f960 msgr2=0x7f6e241107d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:28.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.584+0000 7f6e22d9d640 1 --2- 172.21.15.107:0/723885206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e2410f960 0x7f6e241107d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.584+0000 7f6e22d9d640 1 -- 172.21.15.107:0/723885206 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e140098b0 con 0x7f6e24101ae0 2024-09-21T08:01:28.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.584+0000 7f6e22d9d640 1 --2- 172.21.15.107:0/723885206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e24101ae0 0x7f6e2410f420 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009c20 tx=0x7f6e14004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:28.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.584+0000 7f6e1b7fe640 1 -- 172.21.15.107:0/723885206 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e14032a60 con 0x7f6e24101ae0 2024-09-21T08:01:28.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.584+0000 7f6e2901d640 1 -- 172.21.15.107:0/723885206 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e24110d70 con 0x7f6e24101ae0 2024-09-21T08:01:28.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.584+0000 7f6e1b7fe640 1 -- 172.21.15.107:0/723885206 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6e14032bc0 con 0x7f6e24101ae0 2024-09-21T08:01:28.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.584+0000 7f6e1b7fe640 1 -- 172.21.15.107:0/723885206 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e140313d0 con 0x7f6e24101ae0 2024-09-21T08:01:28.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.584+0000 7f6e2901d640 1 -- 172.21.15.107:0/723885206 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e241112e0 con 0x7f6e24101ae0 2024-09-21T08:01:28.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.585+0000 7f6e2901d640 1 -- 172.21.15.107:0/723885206 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e240fa890 con 0x7f6e24101ae0 2024-09-21T08:01:28.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.586+0000 7f6e1b7fe640 1 -- 172.21.15.107:0/723885206 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f6e1402f030 con 0x7f6e24101ae0 2024-09-21T08:01:28.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.587+0000 7f6e1b7fe640 1 --2- 172.21.15.107:0/723885206 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f6e1006eda0 0x7f6e10071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:28.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.587+0000 7f6e2259c640 1 --2- 172.21.15.107:0/723885206 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f6e1006eda0 0x7f6e10071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:28.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.587+0000 7f6e1b7fe640 1 -- 172.21.15.107:0/723885206 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6e140afab0 con 0x7f6e24101ae0 2024-09-21T08:01:28.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.587+0000 7f6e2259c640 1 --2- 172.21.15.107:0/723885206 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f6e1006eda0 0x7f6e10071250 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c004ed0 tx=0x7f6e0c00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:28.904 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:01:28.904 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (5m) 54s ago 6m 24.7M - 0.25.0 c8568f914cd2 2b63428d7be3 2024-09-21T08:01:28.904 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (6m) 54s ago 6m 6899k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 4557b307c7dd 2024-09-21T08:01:28.904 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (5m) 60s ago 5m 6895k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be e74e9385abdf 2024-09-21T08:01:28.904 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (5m) 54s ago 6m 86.8M - 9.4.7 954c08fa6188 8571a453fdc8 2024-09-21T08:01:28.904 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (74s) 54s ago 74s 13.9M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 3bc779f88228 2024-09-21T08:01:28.904 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (81s) 54s ago 80s 11.0M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be ea8f140aade7 2024-09-21T08:01:28.904 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (72s) 60s ago 71s 14.0M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 329346c3afec 2024-09-21T08:01:28.904 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (78s) 60s ago 78s 16.4M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be baf87f32bfbc 2024-09-21T08:01:28.904 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:9283,8765,8443 running (7m) 54s ago 7m 448M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be d8e1cda67b5b 2024-09-21T08:01:28.905 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283 running (5m) 60s ago 5m 401M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be c5d2f3a0389e 2024-09-21T08:01:28.905 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (7m) 54s ago 8m 45.5M 2048M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7702e48722c8 2024-09-21T08:01:28.905 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (5m) 60s ago 5m 32.5M 2048M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be d9680c5a5b92 2024-09-21T08:01:28.905 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 running (6m) 54s ago 6m 16.0M - 1.5.0 0da6a335fe13 05e3175edba6 2024-09-21T08:01:28.905 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (5m) 60s ago 5m 16.7M - 1.5.0 0da6a335fe13 7285c04552f9 2024-09-21T08:01:28.905 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (5m) 54s ago 4m 43.9M 4287M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 6799bdf55207 2024-09-21T08:01:28.905 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (4m) 54s ago 4m 44.6M 4287M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 29d8ce3f3a52 2024-09-21T08:01:28.905 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (4m) 54s ago 4m 44.3M 4287M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be c9e1c4756c02 2024-09-21T08:01:28.905 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (3m) 60s ago 3m 46.9M 5312M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7d58f70b105c 2024-09-21T08:01:28.905 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (3m) 60s ago 3m 41.3M 5312M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 2f916ef76d22 2024-09-21T08:01:28.905 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (2m) 60s ago 2m 41.9M 5312M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 0f25d9454304 2024-09-21T08:01:28.905 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (5m) 54s ago 6m 58.6M - 2.43.0 a07b618ecd1d 36fd24c0b07b 2024-09-21T08:01:28.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.591+0000 7f6e1b7fe640 1 -- 172.21.15.107:0/723885206 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6e1407cae0 con 0x7f6e24101ae0 2024-09-21T08:01:28.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.764+0000 7f6e2901d640 1 -- 172.21.15.107:0/723885206 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e241072d0 con 0x7f6e1006eda0 2024-09-21T08:01:28.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.773+0000 7f6e1b7fe640 1 -- 172.21.15.107:0/723885206 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f6e241072d0 con 0x7f6e1006eda0 2024-09-21T08:01:28.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.776+0000 7f6e2901d640 1 -- 172.21.15.107:0/723885206 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f6e1006eda0 msgr2=0x7f6e10071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:28.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.776+0000 7f6e2901d640 1 --2- 172.21.15.107:0/723885206 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f6e1006eda0 0x7f6e10071250 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c004ed0 tx=0x7f6e0c00b040 comp rx=0 tx=0).stop 2024-09-21T08:01:28.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.776+0000 7f6e2901d640 1 -- 172.21.15.107:0/723885206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e24101ae0 msgr2=0x7f6e2410f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:28.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.776+0000 7f6e2901d640 1 --2- 172.21.15.107:0/723885206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e24101ae0 0x7f6e2410f420 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009c20 tx=0x7f6e14004d10 comp rx=0 tx=0).stop 2024-09-21T08:01:28.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.776+0000 7f6e2901d640 1 -- 172.21.15.107:0/723885206 shutdown_connections 2024-09-21T08:01:28.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.776+0000 7f6e2901d640 1 --2- 172.21.15.107:0/723885206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e2410f960 0x7f6e241107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.776+0000 7f6e2901d640 1 --2- 172.21.15.107:0/723885206 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f6e1006eda0 0x7f6e10071250 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.776+0000 7f6e2901d640 1 --2- 172.21.15.107:0/723885206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e24101ae0 0x7f6e2410f420 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.776+0000 7f6e2901d640 1 -- 172.21.15.107:0/723885206 >> 172.21.15.107:0/723885206 conn(0x7f6e240f6c10 msgr2=0x7f6e240f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:28.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.776+0000 7f6e2901d640 1 -- 172.21.15.107:0/723885206 shutdown_connections 2024-09-21T08:01:28.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.776+0000 7f6e2901d640 1 -- 172.21.15.107:0/723885206 wait complete. 2024-09-21T08:01:28.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.866+0000 7f8bf07c4640 1 -- 172.21.15.107:0/1677944592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8be8066510 msgr2=0x7f8be80ff170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:28.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.866+0000 7f8bf07c4640 1 --2- 172.21.15.107:0/1677944592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8be8066510 0x7f8be80ff170 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8be40048d0 tx=0x7f8be4009da0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.866+0000 7f8bf07c4640 1 -- 172.21.15.107:0/1677944592 shutdown_connections 2024-09-21T08:01:28.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.866+0000 7f8bf07c4640 1 --2- 172.21.15.107:0/1677944592 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8be80ff6b0 0x7f8be8101a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.866+0000 7f8bf07c4640 1 --2- 172.21.15.107:0/1677944592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8be8066510 0x7f8be80ff170 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.866+0000 7f8bf07c4640 1 -- 172.21.15.107:0/1677944592 >> 172.21.15.107:0/1677944592 conn(0x7f8be80f6be0 msgr2=0x7f8be80f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:28.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.867+0000 7f8bf07c4640 1 -- 172.21.15.107:0/1677944592 shutdown_connections 2024-09-21T08:01:28.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.867+0000 7f8bf07c4640 1 -- 172.21.15.107:0/1677944592 wait complete. 2024-09-21T08:01:28.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.867+0000 7f8bf07c4640 1 Processor -- start 2024-09-21T08:01:28.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.868+0000 7f8bf07c4640 1 -- start start 2024-09-21T08:01:28.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.868+0000 7f8bf07c4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8be8066510 0x7f8be81136e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:28.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.868+0000 7f8bf07c4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8be80ff6b0 0x7f8be8113c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:28.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.868+0000 7f8bf07c4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be8114270 con 0x7f8be8066510 2024-09-21T08:01:28.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.868+0000 7f8bf07c4640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be8114a40 con 0x7f8be80ff6b0 2024-09-21T08:01:28.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.868+0000 7f8bee560640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8be8066510 0x7f8be81136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:28.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.868+0000 7f8bee560640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8be8066510 0x7f8be81136e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33820/0 (socket says 172.21.15.107:33820) 2024-09-21T08:01:28.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.868+0000 7f8bee560640 1 -- 172.21.15.107:0/3762208887 learned_addr learned my addr 172.21.15.107:0/3762208887 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:01:28.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.868+0000 7f8bedd5f640 1 --2- 172.21.15.107:0/3762208887 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8be80ff6b0 0x7f8be8113c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:28.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.869+0000 7f8bedd5f640 1 -- 172.21.15.107:0/3762208887 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8be8066510 msgr2=0x7f8be81136e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:28.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.869+0000 7f8bedd5f640 1 --2- 172.21.15.107:0/3762208887 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8be8066510 0x7f8be81136e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:28.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.869+0000 7f8bedd5f640 1 -- 172.21.15.107:0/3762208887 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be4005040 con 0x7f8be80ff6b0 2024-09-21T08:01:28.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.869+0000 7f8bee560640 1 --2- 172.21.15.107:0/3762208887 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8be8066510 0x7f8be81136e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:28.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.869+0000 7f8bedd5f640 1 --2- 172.21.15.107:0/3762208887 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8be80ff6b0 0x7f8be8113c20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8bd800eb40 tx=0x7f8bd800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:28.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.869+0000 7f8bdeffd640 1 -- 172.21.15.107:0/3762208887 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bd8007c30 con 0x7f8be80ff6b0 2024-09-21T08:01:28.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.869+0000 7f8bf07c4640 1 -- 172.21.15.107:0/3762208887 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be8114c70 con 0x7f8be80ff6b0 2024-09-21T08:01:28.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.869+0000 7f8bdeffd640 1 -- 172.21.15.107:0/3762208887 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8bd800f040 con 0x7f8be80ff6b0 2024-09-21T08:01:28.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.869+0000 7f8bf07c4640 1 -- 172.21.15.107:0/3762208887 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be8115150 con 0x7f8be80ff6b0 2024-09-21T08:01:28.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.870+0000 7f8bdeffd640 1 -- 172.21.15.107:0/3762208887 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bd8009480 con 0x7f8be80ff6b0 2024-09-21T08:01:28.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.871+0000 7f8bdcff9640 1 -- 172.21.15.107:0/3762208887 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd0005210 con 0x7f8be80ff6b0 2024-09-21T08:01:28.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.873+0000 7f8bdeffd640 1 -- 172.21.15.107:0/3762208887 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f8bd800cc40 con 0x7f8be80ff6b0 2024-09-21T08:01:28.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.873+0000 7f8bdeffd640 1 --2- 172.21.15.107:0/3762208887 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f8bd406ee20 0x7f8bd40712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:28.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.873+0000 7f8bdeffd640 1 -- 172.21.15.107:0/3762208887 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8bd808df20 con 0x7f8be80ff6b0 2024-09-21T08:01:28.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.874+0000 7f8bee560640 1 --2- 172.21.15.107:0/3762208887 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f8bd406ee20 0x7f8bd40712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:28.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.874+0000 7f8bee560640 1 --2- 172.21.15.107:0/3762208887 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f8bd406ee20 0x7f8bd40712d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8be4004540 tx=0x7f8be4009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:28.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:28.883+0000 7f8bdeffd640 1 -- 172.21.15.107:0/3762208887 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8bd805ab50 con 0x7f8be80ff6b0 2024-09-21T08:01:29.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.154+0000 7f8bdcff9640 1 -- 172.21.15.107:0/3762208887 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8bd0005cd0 con 0x7f8be80ff6b0 2024-09-21T08:01:29.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.155+0000 7f8bdeffd640 1 -- 172.21.15.107:0/3762208887 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7f8bd805a970 con 0x7f8be80ff6b0 2024-09-21T08:01:29.157 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:01:29.157 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": { 2024-09-21T08:01:29.157 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 2 2024-09-21T08:01:29.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:01:29.157 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": { 2024-09-21T08:01:29.157 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 2 2024-09-21T08:01:29.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:01:29.157 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": { 2024-09-21T08:01:29.157 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 6 2024-09-21T08:01:29.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:01:29.158 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-21T08:01:29.158 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 4 2024-09-21T08:01:29.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:01:29.158 INFO:teuthology.orchestra.run.smithi107.stdout: "overall": { 2024-09-21T08:01:29.158 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 14 2024-09-21T08:01:29.158 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-21T08:01:29.158 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:01:29.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.158+0000 7f8bdcff9640 1 -- 172.21.15.107:0/3762208887 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f8bd406ee20 msgr2=0x7f8bd40712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:29.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.158+0000 7f8bdcff9640 1 --2- 172.21.15.107:0/3762208887 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f8bd406ee20 0x7f8bd40712d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8be4004540 tx=0x7f8be4009da0 comp rx=0 tx=0).stop 2024-09-21T08:01:29.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.158+0000 7f8bdcff9640 1 -- 172.21.15.107:0/3762208887 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8be80ff6b0 msgr2=0x7f8be8113c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:29.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.158+0000 7f8bdcff9640 1 --2- 172.21.15.107:0/3762208887 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8be80ff6b0 0x7f8be8113c20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8bd800eb40 tx=0x7f8bd800b040 comp rx=0 tx=0).stop 2024-09-21T08:01:29.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.158+0000 7f8bdcff9640 1 -- 172.21.15.107:0/3762208887 shutdown_connections 2024-09-21T08:01:29.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.158+0000 7f8bdcff9640 1 --2- 172.21.15.107:0/3762208887 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8be80ff6b0 0x7f8be8113c20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:29.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.158+0000 7f8bdcff9640 1 --2- 172.21.15.107:0/3762208887 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f8bd406ee20 0x7f8bd40712d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:29.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.158+0000 7f8bdcff9640 1 --2- 172.21.15.107:0/3762208887 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8be8066510 0x7f8be81136e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:29.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.158+0000 7f8bdcff9640 1 -- 172.21.15.107:0/3762208887 >> 172.21.15.107:0/3762208887 conn(0x7f8be80f6be0 msgr2=0x7f8be80fb350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:29.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.158+0000 7f8bdcff9640 1 -- 172.21.15.107:0/3762208887 shutdown_connections 2024-09-21T08:01:29.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.158+0000 7f8bdcff9640 1 -- 172.21.15.107:0/3762208887 wait complete. 2024-09-21T08:01:29.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.248+0000 7f172a773640 1 -- 172.21.15.107:0/2503860665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17240fb430 msgr2=0x7f17240fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:29.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.248+0000 7f172a773640 1 --2- 172.21.15.107:0/2503860665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17240fb430 0x7f17240fb840 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f17140048d0 tx=0x7f1714009da0 comp rx=0 tx=0).stop 2024-09-21T08:01:29.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.248+0000 7f172a773640 1 -- 172.21.15.107:0/2503860665 shutdown_connections 2024-09-21T08:01:29.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.248+0000 7f172a773640 1 --2- 172.21.15.107:0/2503860665 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17240fc700 0x7f17240fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:29.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.248+0000 7f172a773640 1 --2- 172.21.15.107:0/2503860665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17240fb430 0x7f17240fb840 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:29.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.248+0000 7f172a773640 1 -- 172.21.15.107:0/2503860665 >> 172.21.15.107:0/2503860665 conn(0x7f17240f6c10 msgr2=0x7f17240f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:29.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.248+0000 7f172a773640 1 -- 172.21.15.107:0/2503860665 shutdown_connections 2024-09-21T08:01:29.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.248+0000 7f172a773640 1 -- 172.21.15.107:0/2503860665 wait complete. 2024-09-21T08:01:29.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.249+0000 7f172a773640 1 Processor -- start 2024-09-21T08:01:29.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.249+0000 7f172a773640 1 -- start start 2024-09-21T08:01:29.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.250+0000 7f172a773640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17240fc700 0x7f172410f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:29.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.250+0000 7f172a773640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f172410f8c0 0x7f1724110730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:29.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.250+0000 7f1723fff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17240fc700 0x7f172410f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:29.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.250+0000 7f1723fff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17240fc700 0x7f172410f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.107:51378/0 (socket says 172.21.15.107:51378) 2024-09-21T08:01:29.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.250+0000 7f17237fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f172410f8c0 0x7f1724110730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:29.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.250+0000 7f17237fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f172410f8c0 0x7f1724110730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33830/0 (socket says 172.21.15.107:33830) 2024-09-21T08:01:29.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.250+0000 7f1723fff640 1 -- 172.21.15.107:0/2667130002 learned_addr learned my addr 172.21.15.107:0/2667130002 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:01:29.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.250+0000 7f172a773640 1 -- 172.21.15.107:0/2667130002 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172410fd80 con 0x7f172410f8c0 2024-09-21T08:01:29.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.250+0000 7f172a773640 1 -- 172.21.15.107:0/2667130002 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172410fec0 con 0x7f17240fc700 2024-09-21T08:01:29.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.251+0000 7f17237fe640 1 -- 172.21.15.107:0/2667130002 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17240fc700 msgr2=0x7f172410f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:29.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.251+0000 7f17237fe640 1 --2- 172.21.15.107:0/2667130002 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17240fc700 0x7f172410f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:29.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.251+0000 7f17237fe640 1 -- 172.21.15.107:0/2667130002 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1714005040 con 0x7f172410f8c0 2024-09-21T08:01:29.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.251+0000 7f1723fff640 1 --2- 172.21.15.107:0/2667130002 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17240fc700 0x7f172410f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:01:29.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.251+0000 7f17237fe640 1 --2- 172.21.15.107:0/2667130002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f172410f8c0 0x7f1724110730 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f171800eb70 tx=0x7f171800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:29.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.252+0000 7f1720ff9640 1 -- 172.21.15.107:0/2667130002 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1718007a20 con 0x7f172410f8c0 2024-09-21T08:01:29.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.252+0000 7f1720ff9640 1 -- 172.21.15.107:0/2667130002 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f171800f040 con 0x7f172410f8c0 2024-09-21T08:01:29.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.252+0000 7f1720ff9640 1 -- 172.21.15.107:0/2667130002 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17180094f0 con 0x7f172410f8c0 2024-09-21T08:01:29.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.252+0000 7f172a773640 1 -- 172.21.15.107:0/2667130002 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1724110cd0 con 0x7f172410f8c0 2024-09-21T08:01:29.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.252+0000 7f172a773640 1 -- 172.21.15.107:0/2667130002 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17241111f0 con 0x7f172410f8c0 2024-09-21T08:01:29.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.253+0000 7f172a773640 1 -- 172.21.15.107:0/2667130002 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17240fa890 con 0x7f172410f8c0 2024-09-21T08:01:29.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.255+0000 7f1720ff9640 1 -- 172.21.15.107:0/2667130002 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f1718007c10 con 0x7f172410f8c0 2024-09-21T08:01:29.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.256+0000 7f1720ff9640 1 --2- 172.21.15.107:0/2667130002 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f170c06ed60 0x7f170c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:29.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.256+0000 7f1720ff9640 1 -- 172.21.15.107:0/2667130002 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f171808df10 con 0x7f172410f8c0 2024-09-21T08:01:29.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.256+0000 7f1723fff640 1 --2- 172.21.15.107:0/2667130002 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f170c06ed60 0x7f170c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:29.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.257+0000 7f1723fff640 1 --2- 172.21.15.107:0/2667130002 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f170c06ed60 0x7f170c071210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1714003080 tx=0x7f1714009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:29.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.259+0000 7f1720ff9640 1 -- 172.21.15.107:0/2667130002 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f171805b100 con 0x7f172410f8c0 2024-09-21T08:01:29.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.473+0000 7f172a773640 1 -- 172.21.15.107:0/2667130002 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1724100940 con 0x7f170c06ed60 2024-09-21T08:01:29.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.475+0000 7f1720ff9640 1 -- 172.21.15.107:0/2667130002 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f1724100940 con 0x7f170c06ed60 2024-09-21T08:01:29.477 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:01:29.477 INFO:teuthology.orchestra.run.smithi107.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5", 2024-09-21T08:01:29.477 INFO:teuthology.orchestra.run.smithi107.stdout: "in_progress": true, 2024-09-21T08:01:29.477 INFO:teuthology.orchestra.run.smithi107.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T08:01:29.477 INFO:teuthology.orchestra.run.smithi107.stdout: "services_complete": [], 2024-09-21T08:01:29.477 INFO:teuthology.orchestra.run.smithi107.stdout: "progress": "0/2 daemons upgraded", 2024-09-21T08:01:29.478 INFO:teuthology.orchestra.run.smithi107.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 image on host smithi129", 2024-09-21T08:01:29.478 INFO:teuthology.orchestra.run.smithi107.stdout: "is_paused": false 2024-09-21T08:01:29.478 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:01:29.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.478+0000 7f172a773640 1 -- 172.21.15.107:0/2667130002 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f170c06ed60 msgr2=0x7f170c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:29.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.478+0000 7f172a773640 1 --2- 172.21.15.107:0/2667130002 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f170c06ed60 0x7f170c071210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1714003080 tx=0x7f1714009da0 comp rx=0 tx=0).stop 2024-09-21T08:01:29.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.478+0000 7f172a773640 1 -- 172.21.15.107:0/2667130002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f172410f8c0 msgr2=0x7f1724110730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:29.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.478+0000 7f172a773640 1 --2- 172.21.15.107:0/2667130002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f172410f8c0 0x7f1724110730 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f171800eb70 tx=0x7f171800b040 comp rx=0 tx=0).stop 2024-09-21T08:01:29.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.479+0000 7f172a773640 1 -- 172.21.15.107:0/2667130002 shutdown_connections 2024-09-21T08:01:29.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.479+0000 7f172a773640 1 --2- 172.21.15.107:0/2667130002 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f170c06ed60 0x7f170c071210 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1714003080 tx=0x7f1714009da0 comp rx=0 tx=0).stop 2024-09-21T08:01:29.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.479+0000 7f172a773640 1 --2- 172.21.15.107:0/2667130002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f172410f8c0 0x7f1724110730 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:29.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.479+0000 7f172a773640 1 --2- 172.21.15.107:0/2667130002 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17240fc700 0x7f172410f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:29.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.479+0000 7f172a773640 1 -- 172.21.15.107:0/2667130002 >> 172.21.15.107:0/2667130002 conn(0x7f17240f6c10 msgr2=0x7f17240f9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:29.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.479+0000 7f172a773640 1 -- 172.21.15.107:0/2667130002 shutdown_connections 2024-09-21T08:01:29.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:29.479+0000 7f172a773640 1 -- 172.21.15.107:0/2667130002 wait complete. 2024-09-21T08:01:29.786 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:29 smithi107 ceph-mon[27622]: from='client.24279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:01:29.787 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:29 smithi107 ceph-mon[27622]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-21T08:01:29.787 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:29 smithi107 ceph-mon[27622]: from='client.14518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:01:29.787 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:29 smithi107 ceph-mon[27622]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:01:29.787 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:29 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:01:29.787 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:29 smithi107 ceph-mon[27622]: Upgrade: Target is version 19.1.1-367-g9e2ac70b (unknown) 2024-09-21T08:01:29.787 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:29 smithi107 ceph-mon[27622]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, digests ['quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5'] 2024-09-21T08:01:29.787 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:29 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:01:29.787 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:29 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:01:29.787 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:29 smithi107 ceph-mon[27622]: Upgrade: Need to upgrade myself (mgr.smithi107.wzulxb) 2024-09-21T08:01:29.787 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:29 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/3762208887' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:01:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:29 smithi129 ceph-mon[34472]: from='client.24279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:01:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:29 smithi129 ceph-mon[34472]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-21T08:01:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:29 smithi129 ceph-mon[34472]: from='client.14518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:01:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:29 smithi129 ceph-mon[34472]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:01:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:29 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:01:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:29 smithi129 ceph-mon[34472]: Upgrade: Target is version 19.1.1-367-g9e2ac70b (unknown) 2024-09-21T08:01:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:29 smithi129 ceph-mon[34472]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, digests ['quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5'] 2024-09-21T08:01:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:29 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:01:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:29 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:01:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:29 smithi129 ceph-mon[34472]: Upgrade: Need to upgrade myself (mgr.smithi107.wzulxb) 2024-09-21T08:01:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:29 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/3762208887' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:01:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:30 smithi107 ceph-mon[27622]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 on smithi129 2024-09-21T08:01:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:30 smithi107 ceph-mon[27622]: from='client.14530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:01:31.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:30 smithi129 ceph-mon[34472]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 on smithi129 2024-09-21T08:01:31.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:30 smithi129 ceph-mon[34472]: from='client.14530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:01:32.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:31 smithi107 ceph-mon[27622]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-21T08:01:32.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:31 smithi129 ceph-mon[34472]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-21T08:01:34.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:33 smithi107 ceph-mon[27622]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-21T08:01:34.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:33 smithi129 ceph-mon[34472]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-21T08:01:36.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:35 smithi107 ceph-mon[27622]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-21T08:01:36.069 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:35 smithi129 ceph-mon[34472]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-21T08:01:38.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:37 smithi129 ceph-mon[34472]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T08:01:38.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:37 smithi107 ceph-mon[27622]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T08:01:40.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:39 smithi107 ceph-mon[27622]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T08:01:40.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:39 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:01:40.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:39 smithi129 ceph-mon[34472]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T08:01:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:39 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:01:42.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:41 smithi107 ceph-mon[27622]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:42.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:41 smithi129 ceph-mon[34472]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:44.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:43 smithi107 ceph-mon[27622]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:44.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:43 smithi129 ceph-mon[34472]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:46.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:45 smithi129 ceph-mon[34472]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:46.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:45 smithi107 ceph-mon[27622]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:46.585 INFO:tasks.workunit.client.1.smithi129.stderr:Updating files: 90% (11650/12896) Updating files: 91% (11736/12896) Updating files: 92% (11865/12896) Updating files: 93% (11994/12896) Updating files: 94% (12123/12896) Updating files: 95% (12252/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-21T08:01:46.690 INFO:tasks.workunit.client.0.smithi107.stderr:Note: switching to '4e45e6b490e6cbe082cdf155fea780438ec53fc7'. 2024-09-21T08:01:46.691 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-21T08:01:46.691 INFO:tasks.workunit.client.0.smithi107.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T08:01:46.691 INFO:tasks.workunit.client.0.smithi107.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T08:01:46.691 INFO:tasks.workunit.client.0.smithi107.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T08:01:46.691 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-21T08:01:46.691 INFO:tasks.workunit.client.0.smithi107.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T08:01:46.691 INFO:tasks.workunit.client.0.smithi107.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T08:01:46.691 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-21T08:01:46.691 INFO:tasks.workunit.client.0.smithi107.stderr: git switch -c 2024-09-21T08:01:46.691 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-21T08:01:46.691 INFO:tasks.workunit.client.0.smithi107.stderr:Or undo this operation with: 2024-09-21T08:01:46.691 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-21T08:01:46.691 INFO:tasks.workunit.client.0.smithi107.stderr: git switch - 2024-09-21T08:01:46.691 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-21T08:01:46.692 INFO:tasks.workunit.client.0.smithi107.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T08:01:46.692 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-21T08:01:46.692 INFO:tasks.workunit.client.0.smithi107.stderr:HEAD is now at 4e45e6b490e Merge pull request #59907 from zdover23/wip-doc-2024-09-21-backport-59904-to-squid 2024-09-21T08:01:46.696 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T08:01:46.723 INFO:tasks.workunit.client.0.smithi107.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T08:01:46.726 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T08:01:46.726 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T08:01:47.450 INFO:tasks.workunit.client.1.smithi129.stderr:Note: switching to '4e45e6b490e6cbe082cdf155fea780438ec53fc7'. 2024-09-21T08:01:47.450 INFO:tasks.workunit.client.1.smithi129.stderr: 2024-09-21T08:01:47.450 INFO:tasks.workunit.client.1.smithi129.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T08:01:47.450 INFO:tasks.workunit.client.1.smithi129.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T08:01:47.450 INFO:tasks.workunit.client.1.smithi129.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T08:01:47.450 INFO:tasks.workunit.client.1.smithi129.stderr: 2024-09-21T08:01:47.450 INFO:tasks.workunit.client.1.smithi129.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T08:01:47.450 INFO:tasks.workunit.client.1.smithi129.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T08:01:47.450 INFO:tasks.workunit.client.1.smithi129.stderr: 2024-09-21T08:01:47.450 INFO:tasks.workunit.client.1.smithi129.stderr: git switch -c 2024-09-21T08:01:47.450 INFO:tasks.workunit.client.1.smithi129.stderr: 2024-09-21T08:01:47.450 INFO:tasks.workunit.client.1.smithi129.stderr:Or undo this operation with: 2024-09-21T08:01:47.451 INFO:tasks.workunit.client.1.smithi129.stderr: 2024-09-21T08:01:47.451 INFO:tasks.workunit.client.1.smithi129.stderr: git switch - 2024-09-21T08:01:47.451 INFO:tasks.workunit.client.1.smithi129.stderr: 2024-09-21T08:01:47.451 INFO:tasks.workunit.client.1.smithi129.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T08:01:47.451 INFO:tasks.workunit.client.1.smithi129.stderr: 2024-09-21T08:01:47.451 INFO:tasks.workunit.client.1.smithi129.stderr:HEAD is now at 4e45e6b490e Merge pull request #59907 from zdover23/wip-doc-2024-09-21-backport-59904-to-squid 2024-09-21T08:01:47.456 DEBUG:teuthology.orchestra.run.smithi129:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-21T08:01:47.496 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T08:01:47.527 INFO:tasks.workunit.client.1.smithi129.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T08:01:47.529 INFO:tasks.workunit.client.1.smithi129.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-21T08:01:47.530 INFO:tasks.workunit.client.1.smithi129.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T08:01:47.576 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T08:01:47.617 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T08:01:47.619 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T08:01:47.619 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T08:01:47.658 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T08:01:47.662 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-21T08:01:47.662 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T08:01:47.718 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-21T08:01:47.720 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-21T08:01:47.720 DEBUG:teuthology.orchestra.run.smithi107:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4e45e6b490e6cbe082cdf155fea780438ec53fc7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-21T08:01:47.779 INFO:tasks.workunit.client.0.smithi107.stderr:+ mkdir -p fsstress 2024-09-21T08:01:47.780 INFO:tasks.workunit.client.0.smithi107.stderr:+ pushd fsstress 2024-09-21T08:01:47.780 INFO:tasks.workunit.client.0.smithi107.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-21T08:01:47.781 INFO:tasks.workunit.client.0.smithi107.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-21T08:01:48.259 INFO:tasks.workunit.client.1.smithi129.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T08:01:48.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:47 smithi129 ceph-mon[34472]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:48.283 INFO:tasks.workunit.client.0.smithi107.stderr:+ tar xzf ltp-full.tgz 2024-09-21T08:01:48.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:47 smithi107 ceph-mon[27622]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:48.346 INFO:tasks.workunit.client.1.smithi129.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T08:01:48.389 INFO:tasks.workunit.client.1.smithi129.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-21T08:01:48.391 INFO:tasks.workunit.client.1.smithi129.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-21T08:01:48.391 INFO:tasks.workunit.client.1.smithi129.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T08:01:48.433 INFO:tasks.workunit.client.1.smithi129.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-21T08:01:48.437 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T08:01:48.437 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-21T08:01:48.494 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-21T08:01:48.495 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-21T08:01:48.495 DEBUG:teuthology.orchestra.run.smithi129:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4e45e6b490e6cbe082cdf155fea780438ec53fc7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-21T08:01:48.557 INFO:tasks.workunit.client.1.smithi129.stderr:+ mkdir -p fsstress 2024-09-21T08:01:48.561 INFO:tasks.workunit.client.1.smithi129.stderr:+ pushd fsstress 2024-09-21T08:01:48.561 INFO:tasks.workunit.client.1.smithi129.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-21T08:01:48.561 INFO:tasks.workunit.client.1.smithi129.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-21T08:01:49.123 INFO:tasks.workunit.client.1.smithi129.stderr:+ tar xzf ltp-full.tgz 2024-09-21T08:01:50.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:49 smithi129 ceph-mon[34472]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:50.964 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:49 smithi107 ceph-mon[27622]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:52.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:51 smithi129 ceph-mon[34472]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:52.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:51 smithi107 ceph-mon[27622]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:01:54.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:53 smithi129 ceph-mon[34472]: pgmap v226: 65 pgs: 65 active+clean; 5.7 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 435 KiB/s wr, 0 op/s 2024-09-21T08:01:54.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:53 smithi107 ceph-mon[27622]: pgmap v226: 65 pgs: 65 active+clean; 5.7 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 435 KiB/s wr, 0 op/s 2024-09-21T08:01:55.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:54 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:01:55.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:54 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:01:56.072 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:55 smithi129 ceph-mon[34472]: pgmap v227: 65 pgs: 65 active+clean; 11 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 916 KiB/s wr, 37 op/s 2024-09-21T08:01:56.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:55 smithi107 ceph-mon[27622]: pgmap v227: 65 pgs: 65 active+clean; 11 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 916 KiB/s wr, 37 op/s 2024-09-21T08:01:58.237 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:57 smithi129 ceph-mon[34472]: pgmap v228: 65 pgs: 65 active+clean; 36 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.0 MiB/s wr, 198 op/s 2024-09-21T08:01:58.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:57 smithi107 ceph-mon[27622]: pgmap v228: 65 pgs: 65 active+clean; 36 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.0 MiB/s wr, 198 op/s 2024-09-21T08:01:59.258 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:58 smithi129 ceph-mon[34472]: Upgrade: Updating mgr.smithi129.wvlmvo 2024-09-21T08:01:59.258 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:01:59.258 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi129.wvlmvo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T08:01:59.258 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T08:01:59.258 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:58 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:01:59.258 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:58 smithi129 ceph-mon[34472]: Deploying daemon mgr.smithi129.wvlmvo on smithi129 2024-09-21T08:01:59.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:58 smithi107 ceph-mon[27622]: Upgrade: Updating mgr.smithi129.wvlmvo 2024-09-21T08:01:59.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:01:59.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi129.wvlmvo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T08:01:59.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T08:01:59.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:58 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:01:59.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:58 smithi107 ceph-mon[27622]: Deploying daemon mgr.smithi129.wvlmvo on smithi129 2024-09-21T08:01:59.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.579+0000 7feb0db1e640 1 -- 172.21.15.107:0/1004948012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb080ff710 msgr2=0x7feb08101af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:59.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.579+0000 7feb0db1e640 1 --2- 172.21.15.107:0/1004948012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb080ff710 0x7feb08101af0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7feafc0048d0 tx=0x7feafc009da0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.580+0000 7feb0db1e640 1 -- 172.21.15.107:0/1004948012 shutdown_connections 2024-09-21T08:01:59.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.580+0000 7feb0db1e640 1 --2- 172.21.15.107:0/1004948012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb080ff710 0x7feb08101af0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.580+0000 7feb0db1e640 1 --2- 172.21.15.107:0/1004948012 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feb08066630 0x7feb080ff1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.580+0000 7feb0db1e640 1 -- 172.21.15.107:0/1004948012 >> 172.21.15.107:0/1004948012 conn(0x7feb080f6c20 msgr2=0x7feb080f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:59.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.580+0000 7feb0db1e640 1 -- 172.21.15.107:0/1004948012 shutdown_connections 2024-09-21T08:01:59.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.580+0000 7feb0db1e640 1 -- 172.21.15.107:0/1004948012 wait complete. 2024-09-21T08:01:59.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.580+0000 7feb0db1e640 1 Processor -- start 2024-09-21T08:01:59.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.580+0000 7feb0db1e640 1 -- start start 2024-09-21T08:01:59.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.581+0000 7feb0db1e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb08066630 0x7feb0810d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.581+0000 7feb0db1e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feb080ff710 0x7feb0810d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.581+0000 7feb0db1e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0810dcb0 con 0x7feb08066630 2024-09-21T08:01:59.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.581+0000 7feb0db1e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0810e4d0 con 0x7feb080ff710 2024-09-21T08:01:59.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.581+0000 7feb077fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb08066630 0x7feb0810d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.581+0000 7feb077fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb08066630 0x7feb0810d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39340/0 (socket says 172.21.15.107:39340) 2024-09-21T08:01:59.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.581+0000 7feb077fe640 1 -- 172.21.15.107:0/4048666973 learned_addr learned my addr 172.21.15.107:0/4048666973 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:01:59.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.581+0000 7feb077fe640 1 -- 172.21.15.107:0/4048666973 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feb080ff710 msgr2=0x7feb0810d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:59.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.581+0000 7feb06ffd640 1 --2- 172.21.15.107:0/4048666973 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feb080ff710 0x7feb0810d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.581+0000 7feb077fe640 1 --2- 172.21.15.107:0/4048666973 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feb080ff710 0x7feb0810d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.581+0000 7feb077fe640 1 -- 172.21.15.107:0/4048666973 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc005040 con 0x7feb08066630 2024-09-21T08:01:59.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.581+0000 7feb06ffd640 1 --2- 172.21.15.107:0/4048666973 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feb080ff710 0x7feb0810d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:01:59.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.582+0000 7feb077fe640 1 --2- 172.21.15.107:0/4048666973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb08066630 0x7feb0810d120 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7feaf800eb70 tx=0x7feaf800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:59.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.582+0000 7feaeffff640 1 -- 172.21.15.107:0/4048666973 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaf8007c30 con 0x7feb08066630 2024-09-21T08:01:59.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.582+0000 7feaeffff640 1 -- 172.21.15.107:0/4048666973 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7feaf800f040 con 0x7feb08066630 2024-09-21T08:01:59.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.582+0000 7feb0db1e640 1 -- 172.21.15.107:0/4048666973 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0810e760 con 0x7feb08066630 2024-09-21T08:01:59.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.582+0000 7feaeffff640 1 -- 172.21.15.107:0/4048666973 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaf800cb00 con 0x7feb08066630 2024-09-21T08:01:59.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.582+0000 7feb0db1e640 1 -- 172.21.15.107:0/4048666973 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0810ed00 con 0x7feb08066630 2024-09-21T08:01:59.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.583+0000 7feb0db1e640 1 -- 172.21.15.107:0/4048666973 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb080fa8a0 con 0x7feb08066630 2024-09-21T08:01:59.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.584+0000 7feaeffff640 1 -- 172.21.15.107:0/4048666973 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7feaf8009110 con 0x7feb08066630 2024-09-21T08:01:59.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.585+0000 7feaeffff640 1 --2- 172.21.15.107:0/4048666973 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7feaf006ed50 0x7feaf0071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.585+0000 7feaeffff640 1 -- 172.21.15.107:0/4048666973 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7feaf808e420 con 0x7feb08066630 2024-09-21T08:01:59.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.586+0000 7feb06ffd640 1 --2- 172.21.15.107:0/4048666973 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7feaf006ed50 0x7feaf0071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.586+0000 7feb06ffd640 1 --2- 172.21.15.107:0/4048666973 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7feaf006ed50 0x7feaf0071200 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feafc00b020 tx=0x7feafc009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:59.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.593+0000 7feaeffff640 1 -- 172.21.15.107:0/4048666973 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7feaf8057700 con 0x7feb08066630 2024-09-21T08:01:59.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.808+0000 7feb0db1e640 1 -- 172.21.15.107:0/4048666973 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feb0810f220 con 0x7feaf006ed50 2024-09-21T08:01:59.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.810+0000 7feaeffff640 1 -- 172.21.15.107:0/4048666973 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7feb0810f220 con 0x7feaf006ed50 2024-09-21T08:01:59.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.812+0000 7feb0db1e640 1 -- 172.21.15.107:0/4048666973 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7feaf006ed50 msgr2=0x7feaf0071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:59.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.812+0000 7feb0db1e640 1 --2- 172.21.15.107:0/4048666973 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7feaf006ed50 0x7feaf0071200 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feafc00b020 tx=0x7feafc009da0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.812+0000 7feb0db1e640 1 -- 172.21.15.107:0/4048666973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb08066630 msgr2=0x7feb0810d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:59.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.812+0000 7feb0db1e640 1 --2- 172.21.15.107:0/4048666973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb08066630 0x7feb0810d120 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7feaf800eb70 tx=0x7feaf800b040 comp rx=0 tx=0).stop 2024-09-21T08:01:59.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.812+0000 7feb0db1e640 1 -- 172.21.15.107:0/4048666973 shutdown_connections 2024-09-21T08:01:59.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.812+0000 7feb0db1e640 1 --2- 172.21.15.107:0/4048666973 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feb080ff710 0x7feb0810d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.812+0000 7feb0db1e640 1 --2- 172.21.15.107:0/4048666973 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7feaf006ed50 0x7feaf0071200 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.812+0000 7feb0db1e640 1 --2- 172.21.15.107:0/4048666973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb08066630 0x7feb0810d120 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.812+0000 7feb0db1e640 1 -- 172.21.15.107:0/4048666973 >> 172.21.15.107:0/4048666973 conn(0x7feb080f6c20 msgr2=0x7feb080f6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:59.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.812+0000 7feb0db1e640 1 -- 172.21.15.107:0/4048666973 shutdown_connections 2024-09-21T08:01:59.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.812+0000 7feb0db1e640 1 -- 172.21.15.107:0/4048666973 wait complete. 2024-09-21T08:01:59.822 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:01:59.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.898+0000 7f0efd4d0640 1 -- 172.21.15.107:0/3671513430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ef80fc740 msgr2=0x7f0ef80fcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:59.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.898+0000 7f0efd4d0640 1 --2- 172.21.15.107:0/3671513430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ef80fc740 0x7f0ef80fcbb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0009c50 tx=0x7f0ee0004d10 comp rx=0 tx=0).stop 2024-09-21T08:01:59.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.899+0000 7f0efd4d0640 1 -- 172.21.15.107:0/3671513430 shutdown_connections 2024-09-21T08:01:59.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.899+0000 7f0efd4d0640 1 --2- 172.21.15.107:0/3671513430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ef80fc740 0x7f0ef80fcbb0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.899+0000 7f0efd4d0640 1 --2- 172.21.15.107:0/3671513430 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ef80fb470 0x7f0ef80fb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.899+0000 7f0efd4d0640 1 -- 172.21.15.107:0/3671513430 >> 172.21.15.107:0/3671513430 conn(0x7f0ef80f6c30 msgr2=0x7f0ef80f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:59.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.899+0000 7f0efd4d0640 1 -- 172.21.15.107:0/3671513430 shutdown_connections 2024-09-21T08:01:59.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.899+0000 7f0efd4d0640 1 -- 172.21.15.107:0/3671513430 wait complete. 2024-09-21T08:01:59.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.899+0000 7f0efd4d0640 1 Processor -- start 2024-09-21T08:01:59.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.899+0000 7f0efd4d0640 1 -- start start 2024-09-21T08:01:59.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.899+0000 7f0efd4d0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ef80fb470 0x7f0ef810f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.899+0000 7f0efd4d0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ef80fc740 0x7f0ef810f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.899+0000 7f0efd4d0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef810ff50 con 0x7f0ef80fc740 2024-09-21T08:01:59.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.899+0000 7f0efd4d0640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef8110720 con 0x7f0ef80fb470 2024-09-21T08:01:59.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.900+0000 7f0eeffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ef80fc740 0x7f0ef810f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.900+0000 7f0ef6ffd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ef80fb470 0x7f0ef810f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.900+0000 7f0eeffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ef80fc740 0x7f0ef810f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39358/0 (socket says 172.21.15.107:39358) 2024-09-21T08:01:59.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.900+0000 7f0ef6ffd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ef80fb470 0x7f0ef810f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.107:52364/0 (socket says 172.21.15.107:52364) 2024-09-21T08:01:59.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.900+0000 7f0eeffff640 1 -- 172.21.15.107:0/324866414 learned_addr learned my addr 172.21.15.107:0/324866414 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:01:59.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.900+0000 7f0eeffff640 1 -- 172.21.15.107:0/324866414 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ef80fb470 msgr2=0x7f0ef810f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:59.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.900+0000 7f0eeffff640 1 --2- 172.21.15.107:0/324866414 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ef80fb470 0x7f0ef810f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.900+0000 7f0eeffff640 1 -- 172.21.15.107:0/324866414 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee00098b0 con 0x7f0ef80fc740 2024-09-21T08:01:59.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.900+0000 7f0ef6ffd640 1 --2- 172.21.15.107:0/324866414 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ef80fb470 0x7f0ef810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:59.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.900+0000 7f0eeffff640 1 --2- 172.21.15.107:0/324866414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ef80fc740 0x7f0ef810f900 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0004a30 tx=0x7f0ee0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:59.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.900+0000 7f0eef7fe640 1 -- 172.21.15.107:0/324866414 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ee0009710 con 0x7f0ef80fc740 2024-09-21T08:01:59.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.901+0000 7f0eef7fe640 1 -- 172.21.15.107:0/324866414 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0ee0032b10 con 0x7f0ef80fc740 2024-09-21T08:01:59.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.901+0000 7f0efd4d0640 1 -- 172.21.15.107:0/324866414 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef8110950 con 0x7f0ef80fc740 2024-09-21T08:01:59.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.901+0000 7f0eef7fe640 1 -- 172.21.15.107:0/324866414 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ee003dbc0 con 0x7f0ef80fc740 2024-09-21T08:01:59.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.901+0000 7f0efd4d0640 1 -- 172.21.15.107:0/324866414 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef8110ef0 con 0x7f0ef80fc740 2024-09-21T08:01:59.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.902+0000 7f0efd4d0640 1 -- 172.21.15.107:0/324866414 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef80fa8d0 con 0x7f0ef80fc740 2024-09-21T08:01:59.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.902+0000 7f0eef7fe640 1 -- 172.21.15.107:0/324866414 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f0ee002f030 con 0x7f0ef80fc740 2024-09-21T08:01:59.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.903+0000 7f0eef7fe640 1 --2- 172.21.15.107:0/324866414 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f0ee406ed60 0x7f0ee4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.903+0000 7f0eef7fe640 1 -- 172.21.15.107:0/324866414 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0ee00af680 con 0x7f0ef80fc740 2024-09-21T08:01:59.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.903+0000 7f0ef6ffd640 1 --2- 172.21.15.107:0/324866414 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f0ee406ed60 0x7f0ee4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.904+0000 7f0ef6ffd640 1 --2- 172.21.15.107:0/324866414 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f0ee406ed60 0x7f0ee4071210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80041d0 tx=0x7f0ee8004330 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:59.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:01:59.908+0000 7f0eef7fe640 1 -- 172.21.15.107:0/324866414 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0ee007c7d0 con 0x7f0ef80fc740 2024-09-21T08:02:00.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.126+0000 7f0efd4d0640 1 -- 172.21.15.107:0/324866414 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ef8103fd0 con 0x7f0ee406ed60 2024-09-21T08:02:00.128 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:01:59 smithi107 ceph-mon[27622]: pgmap v229: 65 pgs: 65 active+clean; 62 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 5.3 MiB/s wr, 381 op/s 2024-09-21T08:02:00.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.127+0000 7f0eef7fe640 1 -- 172.21.15.107:0/324866414 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f0ef8103fd0 con 0x7f0ee406ed60 2024-09-21T08:02:00.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.129+0000 7f0efd4d0640 1 -- 172.21.15.107:0/324866414 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f0ee406ed60 msgr2=0x7f0ee4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:00.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.129+0000 7f0efd4d0640 1 --2- 172.21.15.107:0/324866414 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f0ee406ed60 0x7f0ee4071210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80041d0 tx=0x7f0ee8004330 comp rx=0 tx=0).stop 2024-09-21T08:02:00.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.129+0000 7f0efd4d0640 1 -- 172.21.15.107:0/324866414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ef80fc740 msgr2=0x7f0ef810f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:00.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.129+0000 7f0efd4d0640 1 --2- 172.21.15.107:0/324866414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ef80fc740 0x7f0ef810f900 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0004a30 tx=0x7f0ee0004d10 comp rx=0 tx=0).stop 2024-09-21T08:02:00.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.129+0000 7f0efd4d0640 1 -- 172.21.15.107:0/324866414 shutdown_connections 2024-09-21T08:02:00.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.129+0000 7f0efd4d0640 1 --2- 172.21.15.107:0/324866414 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f0ee406ed60 0x7f0ee4071210 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.130+0000 7f0efd4d0640 1 --2- 172.21.15.107:0/324866414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ef80fc740 0x7f0ef810f900 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.130+0000 7f0efd4d0640 1 --2- 172.21.15.107:0/324866414 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ef80fb470 0x7f0ef810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.130+0000 7f0efd4d0640 1 -- 172.21.15.107:0/324866414 >> 172.21.15.107:0/324866414 conn(0x7f0ef80f6c30 msgr2=0x7f0ef80661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:00.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.130+0000 7f0efd4d0640 1 -- 172.21.15.107:0/324866414 shutdown_connections 2024-09-21T08:02:00.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.130+0000 7f0efd4d0640 1 -- 172.21.15.107:0/324866414 wait complete. 2024-09-21T08:02:00.216 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:01:59 smithi129 ceph-mon[34472]: pgmap v229: 65 pgs: 65 active+clean; 62 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 5.3 MiB/s wr, 381 op/s 2024-09-21T08:02:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.235+0000 7fcbc998b640 1 -- 172.21.15.107:0/2779991416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbc40fc700 msgr2=0x7fcbc40fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.235+0000 7fcbc998b640 1 --2- 172.21.15.107:0/2779991416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbc40fc700 0x7fcbc40fcb70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0048d0 tx=0x7fcbac009da0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.235+0000 7fcbc998b640 1 -- 172.21.15.107:0/2779991416 shutdown_connections 2024-09-21T08:02:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.235+0000 7fcbc998b640 1 --2- 172.21.15.107:0/2779991416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbc40fc700 0x7fcbc40fcb70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.235+0000 7fcbc998b640 1 --2- 172.21.15.107:0/2779991416 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcbc40fb430 0x7fcbc40fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.235+0000 7fcbc998b640 1 -- 172.21.15.107:0/2779991416 >> 172.21.15.107:0/2779991416 conn(0x7fcbc40f6c10 msgr2=0x7fcbc40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.236+0000 7fcbc998b640 1 -- 172.21.15.107:0/2779991416 shutdown_connections 2024-09-21T08:02:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.236+0000 7fcbc998b640 1 -- 172.21.15.107:0/2779991416 wait complete. 2024-09-21T08:02:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.236+0000 7fcbc998b640 1 Processor -- start 2024-09-21T08:02:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.236+0000 7fcbc998b640 1 -- start start 2024-09-21T08:02:00.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.237+0000 7fcbc998b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbc40fb430 0x7fcbc41121c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:00.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.237+0000 7fcbc998b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcbc40fc700 0x7fcbc4114710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:00.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.237+0000 7fcbc998b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc410dc70 con 0x7fcbc40fb430 2024-09-21T08:02:00.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.237+0000 7fcbc998b640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc4065bd0 con 0x7fcbc40fc700 2024-09-21T08:02:00.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.237+0000 7fcbba7fc640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcbc40fc700 0x7fcbc4114710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:00.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.237+0000 7fcbba7fc640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcbc40fc700 0x7fcbc4114710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.107:52390/0 (socket says 172.21.15.107:52390) 2024-09-21T08:02:00.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.237+0000 7fcbba7fc640 1 -- 172.21.15.107:0/3309839397 learned_addr learned my addr 172.21.15.107:0/3309839397 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:02:00.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.237+0000 7fcbc2ffd640 1 --2- 172.21.15.107:0/3309839397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbc40fb430 0x7fcbc41121c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:00.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.237+0000 7fcbba7fc640 1 -- 172.21.15.107:0/3309839397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbc40fb430 msgr2=0x7fcbc41121c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:00.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.237+0000 7fcbba7fc640 1 --2- 172.21.15.107:0/3309839397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbc40fb430 0x7fcbc41121c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.237+0000 7fcbba7fc640 1 -- 172.21.15.107:0/3309839397 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac005040 con 0x7fcbc40fc700 2024-09-21T08:02:00.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.237+0000 7fcbc2ffd640 1 --2- 172.21.15.107:0/3309839397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbc40fb430 0x7fcbc41121c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:02:00.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.237+0000 7fcbba7fc640 1 --2- 172.21.15.107:0/3309839397 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcbc40fc700 0x7fcbc4114710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0043d0 tx=0x7fcbac009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:00.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.238+0000 7fcbbbfff640 1 -- 172.21.15.107:0/3309839397 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbac038070 con 0x7fcbc40fc700 2024-09-21T08:02:00.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.238+0000 7fcbc998b640 1 -- 172.21.15.107:0/3309839397 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc4065e50 con 0x7fcbc40fc700 2024-09-21T08:02:00.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.238+0000 7fcbbbfff640 1 -- 172.21.15.107:0/3309839397 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcbac02ae90 con 0x7fcbc40fc700 2024-09-21T08:02:00.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.238+0000 7fcbbbfff640 1 -- 172.21.15.107:0/3309839397 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbac03e670 con 0x7fcbc40fc700 2024-09-21T08:02:00.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.238+0000 7fcbc998b640 1 -- 172.21.15.107:0/3309839397 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc4114fb0 con 0x7fcbc40fc700 2024-09-21T08:02:00.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.239+0000 7fcbc998b640 1 -- 172.21.15.107:0/3309839397 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc40fa890 con 0x7fcbc40fc700 2024-09-21T08:02:00.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.239+0000 7fcbbbfff640 1 -- 172.21.15.107:0/3309839397 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fcbac030020 con 0x7fcbc40fc700 2024-09-21T08:02:00.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.240+0000 7fcbbbfff640 1 --2- 172.21.15.107:0/3309839397 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fcbb006ed60 0x7fcbb0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:00.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.240+0000 7fcbc2ffd640 1 --2- 172.21.15.107:0/3309839397 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fcbb006ed60 0x7fcbb0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:00.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.240+0000 7fcbbbfff640 1 -- 172.21.15.107:0/3309839397 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcbac0ae3e0 con 0x7fcbc40fc700 2024-09-21T08:02:00.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.241+0000 7fcbc2ffd640 1 --2- 172.21.15.107:0/3309839397 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fcbb006ed60 0x7fcbb0071210 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009fd0 tx=0x7fcbb4009e90 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:00.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.244+0000 7fcbbbfff640 1 -- 172.21.15.107:0/3309839397 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcbac07b530 con 0x7fcbc40fc700 2024-09-21T08:02:00.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.438+0000 7fcbc998b640 1 -- 172.21.15.107:0/3309839397 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbc4100b10 con 0x7fcbb006ed60 2024-09-21T08:02:00.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.450+0000 7fcbbbfff640 1 -- 172.21.15.107:0/3309839397 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7fcbc4100b10 con 0x7fcbb006ed60 2024-09-21T08:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (5m) 86s ago 7m 24.7M - 0.25.0 c8568f914cd2 2b63428d7be3 2024-09-21T08:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (7m) 86s ago 7m 6899k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 4557b307c7dd 2024-09-21T08:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (6m) 92s ago 6m 6895k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be e74e9385abdf 2024-09-21T08:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (5m) 86s ago 6m 86.8M - 9.4.7 954c08fa6188 8571a453fdc8 2024-09-21T08:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (106s) 86s ago 105s 13.9M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 3bc779f88228 2024-09-21T08:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (113s) 86s ago 112s 11.0M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be ea8f140aade7 2024-09-21T08:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (103s) 92s ago 103s 14.0M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 329346c3afec 2024-09-21T08:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (110s) 92s ago 109s 16.4M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be baf87f32bfbc 2024-09-21T08:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:9283,8765,8443 running (8m) 86s ago 8m 448M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be d8e1cda67b5b 2024-09-21T08:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283 running (6m) 92s ago 6m 401M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be c5d2f3a0389e 2024-09-21T08:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (8m) 86s ago 8m 45.5M 2048M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7702e48722c8 2024-09-21T08:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (6m) 92s ago 6m 32.5M 2048M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be d9680c5a5b92 2024-09-21T08:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 running (7m) 86s ago 7m 16.0M - 1.5.0 0da6a335fe13 05e3175edba6 2024-09-21T08:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (6m) 92s ago 6m 16.7M - 1.5.0 0da6a335fe13 7285c04552f9 2024-09-21T08:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (5m) 86s ago 5m 43.9M 4287M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 6799bdf55207 2024-09-21T08:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (5m) 86s ago 5m 44.6M 4287M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 29d8ce3f3a52 2024-09-21T08:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (4m) 86s ago 4m 44.3M 4287M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be c9e1c4756c02 2024-09-21T08:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (4m) 92s ago 4m 46.9M 5312M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7d58f70b105c 2024-09-21T08:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (3m) 92s ago 3m 41.3M 5312M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 2f916ef76d22 2024-09-21T08:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (3m) 92s ago 3m 41.9M 5312M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 0f25d9454304 2024-09-21T08:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (5m) 86s ago 6m 58.6M - 2.43.0 a07b618ecd1d 36fd24c0b07b 2024-09-21T08:02:00.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.452+0000 7fcbc998b640 1 -- 172.21.15.107:0/3309839397 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fcbb006ed60 msgr2=0x7fcbb0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:00.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.452+0000 7fcbc998b640 1 --2- 172.21.15.107:0/3309839397 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fcbb006ed60 0x7fcbb0071210 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009fd0 tx=0x7fcbb4009e90 comp rx=0 tx=0).stop 2024-09-21T08:02:00.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.452+0000 7fcbc998b640 1 -- 172.21.15.107:0/3309839397 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcbc40fc700 msgr2=0x7fcbc4114710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:00.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.452+0000 7fcbc998b640 1 --2- 172.21.15.107:0/3309839397 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcbc40fc700 0x7fcbc4114710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0043d0 tx=0x7fcbac009da0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.452+0000 7fcbc998b640 1 -- 172.21.15.107:0/3309839397 shutdown_connections 2024-09-21T08:02:00.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.452+0000 7fcbc998b640 1 --2- 172.21.15.107:0/3309839397 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcbc40fc700 0x7fcbc4114710 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.452+0000 7fcbc998b640 1 --2- 172.21.15.107:0/3309839397 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fcbb006ed60 0x7fcbb0071210 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.452+0000 7fcbc998b640 1 --2- 172.21.15.107:0/3309839397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbc40fb430 0x7fcbc41121c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.452+0000 7fcbc998b640 1 -- 172.21.15.107:0/3309839397 >> 172.21.15.107:0/3309839397 conn(0x7fcbc40f6c10 msgr2=0x7fcbc40f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:00.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.453+0000 7fcbc998b640 1 -- 172.21.15.107:0/3309839397 shutdown_connections 2024-09-21T08:02:00.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.453+0000 7fcbc998b640 1 -- 172.21.15.107:0/3309839397 wait complete. 2024-09-21T08:02:00.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.535+0000 7f01bd89b640 1 -- 172.21.15.107:0/355439520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01b80fc520 msgr2=0x7f01b80fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:00.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.535+0000 7f01bd89b640 1 --2- 172.21.15.107:0/355439520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01b80fc520 0x7f01b80fc930 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f01a80048d0 tx=0x7f01a8009da0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.535+0000 7f01bd89b640 1 -- 172.21.15.107:0/355439520 shutdown_connections 2024-09-21T08:02:00.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.535+0000 7f01bd89b640 1 --2- 172.21.15.107:0/355439520 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f01b80fd7f0 0x7f01b80fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.535+0000 7f01bd89b640 1 --2- 172.21.15.107:0/355439520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01b80fc520 0x7f01b80fc930 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.535+0000 7f01bd89b640 1 -- 172.21.15.107:0/355439520 >> 172.21.15.107:0/355439520 conn(0x7f01b80f7ce0 msgr2=0x7f01b80fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:00.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.536+0000 7f01bd89b640 1 -- 172.21.15.107:0/355439520 shutdown_connections 2024-09-21T08:02:00.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.536+0000 7f01bd89b640 1 -- 172.21.15.107:0/355439520 wait complete. 2024-09-21T08:02:00.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.536+0000 7f01bd89b640 1 Processor -- start 2024-09-21T08:02:00.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.536+0000 7f01bd89b640 1 -- start start 2024-09-21T08:02:00.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.537+0000 7f01bd89b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f01b80fc520 0x7f01b810d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:00.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.537+0000 7f01bd89b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01b80fd7f0 0x7f01b810d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:00.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.537+0000 7f01bd89b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b810e450 con 0x7f01b80fd7f0 2024-09-21T08:02:00.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.537+0000 7f01bd89b640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b810e5c0 con 0x7f01b80fc520 2024-09-21T08:02:00.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.537+0000 7f01b6ffd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f01b80fc520 0x7f01b810d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:00.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.537+0000 7f01b6ffd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f01b80fc520 0x7f01b810d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.107:52404/0 (socket says 172.21.15.107:52404) 2024-09-21T08:02:00.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.537+0000 7f01b6ffd640 1 -- 172.21.15.107:0/3166238592 learned_addr learned my addr 172.21.15.107:0/3166238592 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:02:00.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.537+0000 7f01affff640 1 --2- 172.21.15.107:0/3166238592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01b80fd7f0 0x7f01b810d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:00.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.538+0000 7f01b6ffd640 1 -- 172.21.15.107:0/3166238592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01b80fd7f0 msgr2=0x7f01b810d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:00.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.538+0000 7f01b6ffd640 1 --2- 172.21.15.107:0/3166238592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01b80fd7f0 0x7f01b810d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.538+0000 7f01b6ffd640 1 -- 172.21.15.107:0/3166238592 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a8005040 con 0x7f01b80fc520 2024-09-21T08:02:00.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.538+0000 7f01affff640 1 --2- 172.21.15.107:0/3166238592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01b80fd7f0 0x7f01b810d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:02:00.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.538+0000 7f01b6ffd640 1 --2- 172.21.15.107:0/3166238592 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f01b80fc520 0x7f01b810d0a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f01a8003080 tx=0x7f01a8009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:00.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.538+0000 7f01af7fe640 1 -- 172.21.15.107:0/3166238592 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01a8038070 con 0x7f01b80fc520 2024-09-21T08:02:00.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.538+0000 7f01af7fe640 1 -- 172.21.15.107:0/3166238592 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f01a802abd0 con 0x7f01b80fc520 2024-09-21T08:02:00.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.538+0000 7f01bd89b640 1 -- 172.21.15.107:0/3166238592 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b810e840 con 0x7f01b80fc520 2024-09-21T08:02:00.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.538+0000 7f01af7fe640 1 -- 172.21.15.107:0/3166238592 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01a803e670 con 0x7f01b80fc520 2024-09-21T08:02:00.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.538+0000 7f01bd89b640 1 -- 172.21.15.107:0/3166238592 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b810ed60 con 0x7f01b80fc520 2024-09-21T08:02:00.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.540+0000 7f01bd89b640 1 -- 172.21.15.107:0/3166238592 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b81057b0 con 0x7f01b80fc520 2024-09-21T08:02:00.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.540+0000 7f01af7fe640 1 -- 172.21.15.107:0/3166238592 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f01a8030020 con 0x7f01b80fc520 2024-09-21T08:02:00.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.540+0000 7f01af7fe640 1 --2- 172.21.15.107:0/3166238592 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f01a406ed60 0x7f01a4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:00.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.541+0000 7f01af7fe640 1 -- 172.21.15.107:0/3166238592 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f01a80ae5d0 con 0x7f01b80fc520 2024-09-21T08:02:00.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.541+0000 7f01affff640 1 --2- 172.21.15.107:0/3166238592 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f01a406ed60 0x7f01a4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:00.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.541+0000 7f01affff640 1 --2- 172.21.15.107:0/3166238592 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f01a406ed60 0x7f01a4071210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f01b810ce50 tx=0x7f01a0008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:00.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.545+0000 7f01af7fe640 1 -- 172.21.15.107:0/3166238592 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f01a807b6a0 con 0x7f01b80fc520 2024-09-21T08:02:00.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.838+0000 7f01bd89b640 1 -- 172.21.15.107:0/3166238592 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f01b810ef80 con 0x7f01b80fc520 2024-09-21T08:02:00.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.839+0000 7f01af7fe640 1 -- 172.21.15.107:0/3166238592 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7f01a807b040 con 0x7f01b80fc520 2024-09-21T08:02:00.841 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:02:00.841 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": { 2024-09-21T08:02:00.841 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 2 2024-09-21T08:02:00.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:02:00.841 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": { 2024-09-21T08:02:00.841 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 2 2024-09-21T08:02:00.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:02:00.841 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": { 2024-09-21T08:02:00.841 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 6 2024-09-21T08:02:00.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:02:00.841 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-21T08:02:00.842 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 4 2024-09-21T08:02:00.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:02:00.842 INFO:teuthology.orchestra.run.smithi107.stdout: "overall": { 2024-09-21T08:02:00.842 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 14 2024-09-21T08:02:00.842 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-21T08:02:00.842 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:02:00.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.841+0000 7f01bd89b640 1 -- 172.21.15.107:0/3166238592 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f01a406ed60 msgr2=0x7f01a4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:00.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.841+0000 7f01bd89b640 1 --2- 172.21.15.107:0/3166238592 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f01a406ed60 0x7f01a4071210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f01b810ce50 tx=0x7f01a0008040 comp rx=0 tx=0).stop 2024-09-21T08:02:00.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.841+0000 7f01bd89b640 1 -- 172.21.15.107:0/3166238592 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f01b80fc520 msgr2=0x7f01b810d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:00.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.841+0000 7f01bd89b640 1 --2- 172.21.15.107:0/3166238592 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f01b80fc520 0x7f01b810d0a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f01a8003080 tx=0x7f01a8009da0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.841+0000 7f01bd89b640 1 -- 172.21.15.107:0/3166238592 shutdown_connections 2024-09-21T08:02:00.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.841+0000 7f01bd89b640 1 --2- 172.21.15.107:0/3166238592 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7f01a406ed60 0x7f01a4071210 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.841+0000 7f01bd89b640 1 --2- 172.21.15.107:0/3166238592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01b80fd7f0 0x7f01b810d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.841+0000 7f01bd89b640 1 --2- 172.21.15.107:0/3166238592 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f01b80fc520 0x7f01b810d0a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.841+0000 7f01bd89b640 1 -- 172.21.15.107:0/3166238592 >> 172.21.15.107:0/3166238592 conn(0x7f01b80f7ce0 msgr2=0x7f01b80f9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:00.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.841+0000 7f01bd89b640 1 -- 172.21.15.107:0/3166238592 shutdown_connections 2024-09-21T08:02:00.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.842+0000 7f01bd89b640 1 -- 172.21.15.107:0/3166238592 wait complete. 2024-09-21T08:02:00.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.933+0000 7fb267d77640 1 -- 172.21.15.107:0/367346622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2600fb430 msgr2=0x7fb2600fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:00.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.933+0000 7fb267d77640 1 --2- 172.21.15.107:0/367346622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2600fb430 0x7fb2600fb840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0048d0 tx=0x7fb25c009da0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.933+0000 7fb267d77640 1 -- 172.21.15.107:0/367346622 shutdown_connections 2024-09-21T08:02:00.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.933+0000 7fb267d77640 1 --2- 172.21.15.107:0/367346622 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb2600fc700 0x7fb2600fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.933+0000 7fb267d77640 1 --2- 172.21.15.107:0/367346622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2600fb430 0x7fb2600fb840 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.933+0000 7fb267d77640 1 -- 172.21.15.107:0/367346622 >> 172.21.15.107:0/367346622 conn(0x7fb2600f6c10 msgr2=0x7fb2600f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:00.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.933+0000 7fb267d77640 1 -- 172.21.15.107:0/367346622 shutdown_connections 2024-09-21T08:02:00.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.933+0000 7fb267d77640 1 -- 172.21.15.107:0/367346622 wait complete. 2024-09-21T08:02:00.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.934+0000 7fb267d77640 1 Processor -- start 2024-09-21T08:02:00.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.934+0000 7fb267d77640 1 -- start start 2024-09-21T08:02:00.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.934+0000 7fb267d77640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb2600fb430 0x7fb26010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:00.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.934+0000 7fb267d77640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2600fc700 0x7fb26010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:00.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.934+0000 7fb267d77640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26010dc10 con 0x7fb2600fc700 2024-09-21T08:02:00.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.934+0000 7fb267d77640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26010e430 con 0x7fb2600fb430 2024-09-21T08:02:00.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.934+0000 7fb265312640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2600fc700 0x7fb26010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:00.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.934+0000 7fb265312640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2600fc700 0x7fb26010d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39388/0 (socket says 172.21.15.107:39388) 2024-09-21T08:02:00.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.934+0000 7fb265312640 1 -- 172.21.15.107:0/4101904041 learned_addr learned my addr 172.21.15.107:0/4101904041 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:02:00.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.935+0000 7fb265b13640 1 --2- 172.21.15.107:0/4101904041 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb2600fb430 0x7fb26010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:00.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.935+0000 7fb265312640 1 -- 172.21.15.107:0/4101904041 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb2600fb430 msgr2=0x7fb26010d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:00.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.935+0000 7fb265312640 1 --2- 172.21.15.107:0/4101904041 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb2600fb430 0x7fb26010d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:00.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.935+0000 7fb265312640 1 -- 172.21.15.107:0/4101904041 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25c005040 con 0x7fb2600fc700 2024-09-21T08:02:00.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.935+0000 7fb265b13640 1 --2- 172.21.15.107:0/4101904041 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb2600fb430 0x7fb26010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:00.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.935+0000 7fb265312640 1 --2- 172.21.15.107:0/4101904041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2600fc700 0x7fb26010d5c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb25000eb70 tx=0x7fb25000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:00.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.935+0000 7fb2567fc640 1 -- 172.21.15.107:0/4101904041 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb250007c30 con 0x7fb2600fc700 2024-09-21T08:02:00.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.935+0000 7fb2567fc640 1 -- 172.21.15.107:0/4101904041 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb25000f040 con 0x7fb2600fc700 2024-09-21T08:02:00.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.935+0000 7fb267d77640 1 -- 172.21.15.107:0/4101904041 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26010e660 con 0x7fb2600fc700 2024-09-21T08:02:00.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.935+0000 7fb2567fc640 1 -- 172.21.15.107:0/4101904041 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb250009420 con 0x7fb2600fc700 2024-09-21T08:02:00.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.936+0000 7fb267d77640 1 -- 172.21.15.107:0/4101904041 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26010ec00 con 0x7fb2600fc700 2024-09-21T08:02:00.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.937+0000 7fb267d77640 1 -- 172.21.15.107:0/4101904041 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2600fa890 con 0x7fb2600fc700 2024-09-21T08:02:00.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.938+0000 7fb2567fc640 1 -- 172.21.15.107:0/4101904041 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fb25000c6a0 con 0x7fb2600fc700 2024-09-21T08:02:00.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.938+0000 7fb2567fc640 1 --2- 172.21.15.107:0/4101904041 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fb24c06ed60 0x7fb24c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:00.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.938+0000 7fb2567fc640 1 -- 172.21.15.107:0/4101904041 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb25008dd90 con 0x7fb2600fc700 2024-09-21T08:02:00.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.939+0000 7fb265b13640 1 --2- 172.21.15.107:0/4101904041 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fb24c06ed60 0x7fb24c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:00.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.939+0000 7fb265b13640 1 --2- 172.21.15.107:0/4101904041 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fb24c06ed60 0x7fb24c071210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb25c000c00 tx=0x7fb25c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:00.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:00.943+0000 7fb2567fc640 1 -- 172.21.15.107:0/4101904041 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb25005af90 con 0x7fb2600fc700 2024-09-21T08:02:01.161 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:00 smithi129 ceph-mon[34472]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:01.161 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:00 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/3166238592' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:02:01.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:01.236+0000 7fb267d77640 1 -- 172.21.15.107:0/4101904041 --> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb260103fc0 con 0x7fb24c06ed60 2024-09-21T08:02:01.238 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:00 smithi107 ceph-mon[27622]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:01.238 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:00 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/3166238592' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:02:01.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:01.237+0000 7fb2567fc640 1 -- 172.21.15.107:0/4101904041 <== mgr.14206 v2:172.21.15.107:6800/3723665882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fb260103fc0 con 0x7fb24c06ed60 2024-09-21T08:02:01.239 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:02:01.239 INFO:teuthology.orchestra.run.smithi107.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5", 2024-09-21T08:02:01.239 INFO:teuthology.orchestra.run.smithi107.stdout: "in_progress": true, 2024-09-21T08:02:01.239 INFO:teuthology.orchestra.run.smithi107.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T08:02:01.239 INFO:teuthology.orchestra.run.smithi107.stdout: "services_complete": [], 2024-09-21T08:02:01.240 INFO:teuthology.orchestra.run.smithi107.stdout: "progress": "", 2024-09-21T08:02:01.240 INFO:teuthology.orchestra.run.smithi107.stdout: "message": "Currently upgrading mgr daemons", 2024-09-21T08:02:01.240 INFO:teuthology.orchestra.run.smithi107.stdout: "is_paused": false 2024-09-21T08:02:01.240 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:02:01.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:01.240+0000 7fb267d77640 1 -- 172.21.15.107:0/4101904041 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fb24c06ed60 msgr2=0x7fb24c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:01.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:01.240+0000 7fb267d77640 1 --2- 172.21.15.107:0/4101904041 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fb24c06ed60 0x7fb24c071210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb25c000c00 tx=0x7fb25c035040 comp rx=0 tx=0).stop 2024-09-21T08:02:01.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:01.240+0000 7fb267d77640 1 -- 172.21.15.107:0/4101904041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2600fc700 msgr2=0x7fb26010d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:01.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:01.240+0000 7fb267d77640 1 --2- 172.21.15.107:0/4101904041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2600fc700 0x7fb26010d5c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb25000eb70 tx=0x7fb25000b040 comp rx=0 tx=0).stop 2024-09-21T08:02:01.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:01.240+0000 7fb267d77640 1 -- 172.21.15.107:0/4101904041 shutdown_connections 2024-09-21T08:02:01.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:01.240+0000 7fb267d77640 1 --2- 172.21.15.107:0/4101904041 >> [v2:172.21.15.107:6800/3723665882,v1:172.21.15.107:6801/3723665882] conn(0x7fb24c06ed60 0x7fb24c071210 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:01.240+0000 7fb267d77640 1 --2- 172.21.15.107:0/4101904041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2600fc700 0x7fb26010d5c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:01.240+0000 7fb267d77640 1 --2- 172.21.15.107:0/4101904041 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb2600fb430 0x7fb26010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:01.240+0000 7fb267d77640 1 -- 172.21.15.107:0/4101904041 >> 172.21.15.107:0/4101904041 conn(0x7fb2600f6c10 msgr2=0x7fb2600656e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:01.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:01.240+0000 7fb267d77640 1 -- 172.21.15.107:0/4101904041 shutdown_connections 2024-09-21T08:02:01.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:01.240+0000 7fb267d77640 1 -- 172.21.15.107:0/4101904041 wait complete. 2024-09-21T08:02:02.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:01 smithi129 ceph-mon[34472]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:02.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:01 smithi129 ceph-mon[34472]: pgmap v230: 65 pgs: 65 active+clean; 62 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 5.3 MiB/s wr, 381 op/s 2024-09-21T08:02:02.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:01 smithi129 ceph-mon[34472]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:02.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:01 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:02:02.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:01 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:02:02.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:01 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:02:02.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:01 smithi107 ceph-mon[27622]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:02.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:01 smithi107 ceph-mon[27622]: pgmap v230: 65 pgs: 65 active+clean; 62 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 5.3 MiB/s wr, 381 op/s 2024-09-21T08:02:02.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:01 smithi107 ceph-mon[27622]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:02.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:01 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:02:02.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:01 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:02:02.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:01 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:02:03.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:02 smithi129 ceph-mon[34472]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:03.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:02 smithi107 ceph-mon[27622]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:04.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:03 smithi129 ceph-mon[34472]: pgmap v231: 65 pgs: 65 active+clean; 77 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.6 MiB/s wr, 390 op/s 2024-09-21T08:02:04.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:03 smithi107 ceph-mon[27622]: pgmap v231: 65 pgs: 65 active+clean; 77 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.6 MiB/s wr, 390 op/s 2024-09-21T08:02:06.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:05 smithi129 ceph-mon[34472]: pgmap v232: 65 pgs: 65 active+clean; 77 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.2 MiB/s wr, 391 op/s 2024-09-21T08:02:06.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:05 smithi107 ceph-mon[27622]: pgmap v232: 65 pgs: 65 active+clean; 77 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.2 MiB/s wr, 391 op/s 2024-09-21T08:02:08.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:07 smithi129 ceph-mon[34472]: pgmap v233: 65 pgs: 65 active+clean; 102 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 7.9 MiB/s wr, 623 op/s 2024-09-21T08:02:08.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:07 smithi129 ceph-mon[34472]: Standby manager daemon smithi129.wvlmvo restarted 2024-09-21T08:02:08.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:07 smithi129 ceph-mon[34472]: Standby manager daemon smithi129.wvlmvo started 2024-09-21T08:02:08.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:07 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi129.wvlmvo/crt"}]: dispatch 2024-09-21T08:02:08.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:07 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T08:02:08.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:07 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi129.wvlmvo/key"}]: dispatch 2024-09-21T08:02:08.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:07 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T08:02:08.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:07 smithi107 ceph-mon[27622]: pgmap v233: 65 pgs: 65 active+clean; 102 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 7.9 MiB/s wr, 623 op/s 2024-09-21T08:02:08.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:07 smithi107 ceph-mon[27622]: Standby manager daemon smithi129.wvlmvo restarted 2024-09-21T08:02:08.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:07 smithi107 ceph-mon[27622]: Standby manager daemon smithi129.wvlmvo started 2024-09-21T08:02:08.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:07 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi129.wvlmvo/crt"}]: dispatch 2024-09-21T08:02:08.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:07 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T08:02:08.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:07 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi129.wvlmvo/key"}]: dispatch 2024-09-21T08:02:08.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:07 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T08:02:09.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:08 smithi129 ceph-mon[34472]: mgrmap e20: smithi107.wzulxb(active, since 6m), standbys: smithi129.wvlmvo 2024-09-21T08:02:09.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:08 smithi107 ceph-mon[27622]: mgrmap e20: smithi107.wzulxb(active, since 6m), standbys: smithi129.wvlmvo 2024-09-21T08:02:10.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:09 smithi129 ceph-mon[34472]: pgmap v234: 65 pgs: 65 active+clean; 125 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7.9 MiB/s wr, 769 op/s 2024-09-21T08:02:10.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:09 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:02:10.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:09 smithi107 ceph-mon[27622]: pgmap v234: 65 pgs: 65 active+clean; 125 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7.9 MiB/s wr, 769 op/s 2024-09-21T08:02:10.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:09 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:02:11.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:11 smithi129 ceph-mon[34472]: pgmap v235: 65 pgs: 65 active+clean; 128 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 5.9 MiB/s wr, 644 op/s 2024-09-21T08:02:11.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:11 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:02:11.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:11 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:02:11.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:11 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:02:11.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:11 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:02:11.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:11 smithi107 ceph-mon[27622]: pgmap v235: 65 pgs: 65 active+clean; 128 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 5.9 MiB/s wr, 644 op/s 2024-09-21T08:02:11.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:11 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:02:11.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:11 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:02:11.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:11 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:02:11.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:11 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:02:13.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:13 smithi129 ceph-mon[34472]: pgmap v236: 65 pgs: 65 active+clean; 141 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 7.0 MiB/s wr, 674 op/s 2024-09-21T08:02:13.606 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:13 smithi107 ceph-mon[27622]: pgmap v236: 65 pgs: 65 active+clean; 141 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 7.0 MiB/s wr, 674 op/s 2024-09-21T08:02:15.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:15 smithi129 ceph-mon[34472]: pgmap v237: 65 pgs: 65 active+clean; 150 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s wr, 668 op/s 2024-09-21T08:02:15.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:15 smithi107 ceph-mon[27622]: pgmap v237: 65 pgs: 65 active+clean; 150 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s wr, 668 op/s 2024-09-21T08:02:16.644 INFO:tasks.workunit.client.0.smithi107.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-21T08:02:16.644 INFO:tasks.workunit.client.0.smithi107.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-21T08:02:16.644 INFO:tasks.workunit.client.0.smithi107.stderr:+ make 2024-09-21T08:02:17.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:17 smithi107 ceph-mon[27622]: pgmap v238: 65 pgs: 65 active+clean; 158 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.1 MiB/s wr, 667 op/s 2024-09-21T08:02:17.655 INFO:tasks.workunit.client.0.smithi107.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-21T08:02:17.691 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:17 smithi129 ceph-mon[34472]: pgmap v238: 65 pgs: 65 active+clean; 158 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.1 MiB/s wr, 667 op/s 2024-09-21T08:02:18.928 INFO:tasks.workunit.client.1.smithi129.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-21T08:02:18.928 INFO:tasks.workunit.client.1.smithi129.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-21T08:02:18.928 INFO:tasks.workunit.client.1.smithi129.stderr:+ make 2024-09-21T08:02:19.187 INFO:tasks.workunit.client.1.smithi129.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-21T08:02:19.281 INFO:tasks.workunit.client.0.smithi107.stderr:++ readlink -f fsstress 2024-09-21T08:02:19.281 INFO:tasks.workunit.client.0.smithi107.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-21T08:02:19.282 INFO:tasks.workunit.client.0.smithi107.stderr:+ popd 2024-09-21T08:02:19.282 INFO:tasks.workunit.client.0.smithi107.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-21T08:02:19.282 INFO:tasks.workunit.client.0.smithi107.stderr:+ popd 2024-09-21T08:02:19.282 INFO:tasks.workunit.client.0.smithi107.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-21T08:02:19.283 INFO:tasks.workunit.client.0.smithi107.stderr:++ mktemp -d -p . 2024-09-21T08:02:19.283 INFO:tasks.workunit.client.0.smithi107.stderr:+ T=./tmp.VU57r2VfmB 2024-09-21T08:02:19.283 INFO:tasks.workunit.client.0.smithi107.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.VU57r2VfmB -l 1 -n 1000 -p 10 -v 2024-09-21T08:02:19.284 INFO:tasks.workunit.client.0.smithi107.stdout:seed = 1726622449 2024-09-21T08:02:19.286 INFO:tasks.workunit.client.0.smithi107.stdout:0/0: rename - no filename 2024-09-21T08:02:19.286 INFO:tasks.workunit.client.0.smithi107.stdout:0/1: read - no filename 2024-09-21T08:02:19.286 INFO:tasks.workunit.client.0.smithi107.stdout:0/2: dread - no filename 2024-09-21T08:02:19.286 INFO:tasks.workunit.client.0.smithi107.stdout:0/3: chown . 47831667 1 2024-09-21T08:02:19.286 INFO:tasks.workunit.client.0.smithi107.stdout:0/4: fdatasync - no filename 2024-09-21T08:02:19.287 INFO:tasks.workunit.client.0.smithi107.stdout:1/0: truncate - no filename 2024-09-21T08:02:19.287 INFO:tasks.workunit.client.0.smithi107.stdout:0/5: symlink l0 0 2024-09-21T08:02:19.287 INFO:tasks.workunit.client.0.smithi107.stdout:0/6: dwrite - no filename 2024-09-21T08:02:19.287 INFO:tasks.workunit.client.0.smithi107.stdout:2/0: write - no filename 2024-09-21T08:02:19.288 INFO:tasks.workunit.client.0.smithi107.stdout:2/1: dread - no filename 2024-09-21T08:02:19.288 INFO:tasks.workunit.client.0.smithi107.stdout:2/2: link - no file 2024-09-21T08:02:19.288 INFO:tasks.workunit.client.0.smithi107.stdout:2/3: chown . 1 1 2024-09-21T08:02:19.288 INFO:tasks.workunit.client.0.smithi107.stdout:1/1: mkdir d0 0 2024-09-21T08:02:19.288 INFO:tasks.workunit.client.0.smithi107.stdout:1/2: getdents d0 0 2024-09-21T08:02:19.289 INFO:tasks.workunit.client.0.smithi107.stdout:1/3: read - no filename 2024-09-21T08:02:19.289 INFO:tasks.workunit.client.0.smithi107.stdout:0/7: mkdir d1 0 2024-09-21T08:02:19.289 INFO:tasks.workunit.client.0.smithi107.stdout:3/0: getdents . 0 2024-09-21T08:02:19.290 INFO:tasks.workunit.client.0.smithi107.stdout:3/1: chown . 7675 1 2024-09-21T08:02:19.290 INFO:tasks.workunit.client.0.smithi107.stdout:3/2: dwrite - no filename 2024-09-21T08:02:19.290 INFO:tasks.workunit.client.0.smithi107.stdout:2/4: creat f0 x:0 0 0 2024-09-21T08:02:19.290 INFO:tasks.workunit.client.0.smithi107.stdout:2/5: read - f0 zero size 2024-09-21T08:02:19.290 INFO:tasks.workunit.client.0.smithi107.stdout:2/6: dread - f0 zero size 2024-09-21T08:02:19.290 INFO:tasks.workunit.client.0.smithi107.stdout:2/7: rmdir - no directory 2024-09-21T08:02:19.290 INFO:tasks.workunit.client.0.smithi107.stdout:2/8: write f0 [745322,106183] 0 2024-09-21T08:02:19.291 INFO:tasks.workunit.client.0.smithi107.stdout:1/4: creat d0/f1 x:0 0 0 2024-09-21T08:02:19.291 INFO:tasks.workunit.client.0.smithi107.stdout:1/5: write d0/f1 [200493,75015] 0 2024-09-21T08:02:19.291 INFO:tasks.workunit.client.0.smithi107.stdout:1/6: truncate d0/f1 476064 0 2024-09-21T08:02:19.291 INFO:tasks.workunit.client.0.smithi107.stdout:0/8: rename l0 to d1/l2 0 2024-09-21T08:02:19.291 INFO:tasks.workunit.client.0.smithi107.stdout:0/9: dwrite - no filename 2024-09-21T08:02:19.291 INFO:tasks.workunit.client.0.smithi107.stdout:4/0: rename - no filename 2024-09-21T08:02:19.291 INFO:tasks.workunit.client.0.smithi107.stdout:4/1: chown . 3 1 2024-09-21T08:02:19.292 INFO:tasks.workunit.client.0.smithi107.stdout:1/7: unlink d0/f1 0 2024-09-21T08:02:19.292 INFO:tasks.workunit.client.0.smithi107.stdout:1/8: creat d0/f2 x:0 0 0 2024-09-21T08:02:19.292 INFO:tasks.workunit.client.0.smithi107.stdout:1/9: read - d0/f2 zero size 2024-09-21T08:02:19.292 INFO:tasks.workunit.client.0.smithi107.stdout:1/10: write d0/f2 [403958,4260] 0 2024-09-21T08:02:19.292 INFO:tasks.workunit.client.0.smithi107.stdout:1/11: chown d0/f2 468651 1 2024-09-21T08:02:19.293 INFO:tasks.workunit.client.0.smithi107.stdout:0/10: creat d1/f3 x:0 0 0 2024-09-21T08:02:19.294 INFO:tasks.workunit.client.0.smithi107.stdout:4/2: creat f0 x:0 0 0 2024-09-21T08:02:19.294 INFO:tasks.workunit.client.0.smithi107.stdout:4/3: dread - f0 zero size 2024-09-21T08:02:19.294 INFO:tasks.workunit.client.0.smithi107.stdout:4/4: write f0 [693410,19535] 0 2024-09-21T08:02:19.294 INFO:tasks.workunit.client.0.smithi107.stdout:4/5: truncate f0 1089160 0 2024-09-21T08:02:19.295 INFO:tasks.workunit.client.0.smithi107.stdout:0/11: unlink d1/f3 0 2024-09-21T08:02:19.295 INFO:tasks.workunit.client.0.smithi107.stdout:0/12: readlink d1/l2 0 2024-09-21T08:02:19.295 INFO:tasks.workunit.client.0.smithi107.stdout:6/0: link - no file 2024-09-21T08:02:19.296 INFO:tasks.workunit.client.0.smithi107.stdout:6/1: dwrite - no filename 2024-09-21T08:02:19.296 INFO:tasks.workunit.client.0.smithi107.stdout:6/2: dread - no filename 2024-09-21T08:02:19.296 INFO:tasks.workunit.client.0.smithi107.stdout:6/3: write - no filename 2024-09-21T08:02:19.296 INFO:tasks.workunit.client.0.smithi107.stdout:6/4: write - no filename 2024-09-21T08:02:19.296 INFO:tasks.workunit.client.0.smithi107.stdout:6/5: fdatasync - no filename 2024-09-21T08:02:19.296 INFO:tasks.workunit.client.0.smithi107.stdout:6/6: unlink - no file 2024-09-21T08:02:19.296 INFO:tasks.workunit.client.0.smithi107.stdout:6/7: fdatasync - no filename 2024-09-21T08:02:19.297 INFO:tasks.workunit.client.0.smithi107.stdout:5/0: mkdir d0 0 2024-09-21T08:02:19.297 INFO:tasks.workunit.client.0.smithi107.stdout:5/1: dread - no filename 2024-09-21T08:02:19.297 INFO:tasks.workunit.client.0.smithi107.stdout:5/2: rename d0 to d0/d1 22 2024-09-21T08:02:19.297 INFO:tasks.workunit.client.0.smithi107.stdout:5/3: chown d0 201904 1 2024-09-21T08:02:19.299 INFO:tasks.workunit.client.0.smithi107.stdout:7/0: dread - no filename 2024-09-21T08:02:19.299 INFO:tasks.workunit.client.0.smithi107.stdout:7/1: write - no filename 2024-09-21T08:02:19.299 INFO:tasks.workunit.client.0.smithi107.stdout:7/2: chown . 91839255 1 2024-09-21T08:02:19.299 INFO:tasks.workunit.client.0.smithi107.stdout:7/3: rename - no filename 2024-09-21T08:02:19.299 INFO:tasks.workunit.client.0.smithi107.stdout:7/4: dread - no filename 2024-09-21T08:02:19.299 INFO:tasks.workunit.client.0.smithi107.stdout:7/5: truncate - no filename 2024-09-21T08:02:19.300 INFO:tasks.workunit.client.0.smithi107.stdout:6/8: symlink l0 0 2024-09-21T08:02:19.300 INFO:tasks.workunit.client.0.smithi107.stdout:6/9: chown l0 169107 1 2024-09-21T08:02:19.300 INFO:tasks.workunit.client.0.smithi107.stdout:6/10: stat l0 0 2024-09-21T08:02:19.300 INFO:tasks.workunit.client.0.smithi107.stdout:6/11: write - no filename 2024-09-21T08:02:19.303 INFO:tasks.workunit.client.0.smithi107.stdout:5/4: rmdir d0 0 2024-09-21T08:02:19.306 INFO:tasks.workunit.client.0.smithi107.stdout:7/6: creat f0 x:0 0 0 2024-09-21T08:02:19.306 INFO:tasks.workunit.client.0.smithi107.stdout:7/7: truncate f0 605639 0 2024-09-21T08:02:19.321 INFO:tasks.workunit.client.0.smithi107.stdout:6/12: symlink l1 0 2024-09-21T08:02:19.321 INFO:tasks.workunit.client.0.smithi107.stdout:6/13: truncate - no filename 2024-09-21T08:02:19.325 INFO:tasks.workunit.client.0.smithi107.stdout:0/13: rename d1/l2 to d1/l4 0 2024-09-21T08:02:19.325 INFO:tasks.workunit.client.0.smithi107.stdout:0/14: dread - no filename 2024-09-21T08:02:19.335 INFO:tasks.workunit.client.0.smithi107.stdout:5/5: mknod c2 0 2024-09-21T08:02:19.335 INFO:tasks.workunit.client.0.smithi107.stdout:5/6: chown c2 272040933 1 2024-09-21T08:02:19.337 INFO:tasks.workunit.client.0.smithi107.stdout:8/0: creat f0 x:0 0 0 2024-09-21T08:02:19.343 INFO:tasks.workunit.client.0.smithi107.stdout:6/14: mkdir d2 0 2024-09-21T08:02:19.343 INFO:tasks.workunit.client.0.smithi107.stdout:6/15: dread - no filename 2024-09-21T08:02:19.344 INFO:tasks.workunit.client.0.smithi107.stdout:0/15: mkdir d1/d5 0 2024-09-21T08:02:19.344 INFO:tasks.workunit.client.0.smithi107.stdout:0/16: write - no filename 2024-09-21T08:02:19.344 INFO:tasks.workunit.client.0.smithi107.stdout:0/17: truncate - no filename 2024-09-21T08:02:19.345 INFO:tasks.workunit.client.0.smithi107.stdout:5/7: mknod c3 0 2024-09-21T08:02:19.347 INFO:tasks.workunit.client.0.smithi107.stdout:9/0: mknod c0 0 2024-09-21T08:02:19.347 INFO:tasks.workunit.client.0.smithi107.stdout:6/16: mkdir d2/d3 0 2024-09-21T08:02:19.347 INFO:tasks.workunit.client.0.smithi107.stdout:6/17: dread - no filename 2024-09-21T08:02:19.349 INFO:tasks.workunit.client.0.smithi107.stdout:5/8: mknod c4 0 2024-09-21T08:02:19.349 INFO:tasks.workunit.client.0.smithi107.stdout:5/9: dread - no filename 2024-09-21T08:02:19.349 INFO:tasks.workunit.client.0.smithi107.stdout:5/10: chown c4 7604 1 2024-09-21T08:02:19.350 INFO:tasks.workunit.client.0.smithi107.stdout:6/18: creat d2/d3/f4 x:0 0 0 2024-09-21T08:02:19.350 INFO:tasks.workunit.client.0.smithi107.stdout:6/19: write d2/d3/f4 [77679,96576] 0 2024-09-21T08:02:19.352 INFO:tasks.workunit.client.0.smithi107.stdout:5/11: mknod c5 0 2024-09-21T08:02:19.352 INFO:tasks.workunit.client.0.smithi107.stdout:5/12: dread - no filename 2024-09-21T08:02:19.352 INFO:tasks.workunit.client.0.smithi107.stdout:5/13: chown c3 27470738 1 2024-09-21T08:02:19.353 INFO:tasks.workunit.client.0.smithi107.stdout:5/14: link c3 c6 0 2024-09-21T08:02:19.354 INFO:tasks.workunit.client.0.smithi107.stdout:5/15: read - no filename 2024-09-21T08:02:19.354 INFO:tasks.workunit.client.0.smithi107.stdout:5/16: chown c2 7436 1 2024-09-21T08:02:19.355 INFO:tasks.workunit.client.0.smithi107.stdout:5/17: unlink c3 0 2024-09-21T08:02:19.355 INFO:tasks.workunit.client.0.smithi107.stdout:5/18: stat c5 0 2024-09-21T08:02:19.357 INFO:tasks.workunit.client.0.smithi107.stdout:5/19: mkdir d7 0 2024-09-21T08:02:19.357 INFO:tasks.workunit.client.0.smithi107.stdout:5/20: truncate - no filename 2024-09-21T08:02:19.358 INFO:tasks.workunit.client.0.smithi107.stdout:5/21: creat d7/f8 x:0 0 0 2024-09-21T08:02:19.358 INFO:tasks.workunit.client.0.smithi107.stdout:5/22: read - d7/f8 zero size 2024-09-21T08:02:19.358 INFO:tasks.workunit.client.0.smithi107.stdout:5/23: readlink - no filename 2024-09-21T08:02:19.535 INFO:tasks.workunit.client.0.smithi107.stdout:2/9: fdatasync f0 0 2024-09-21T08:02:19.535 INFO:tasks.workunit.client.0.smithi107.stdout:2/10: chown f0 5622 1 2024-09-21T08:02:19.685 INFO:tasks.workunit.client.1.smithi129.stderr:++ readlink -f fsstress 2024-09-21T08:02:19.686 INFO:tasks.workunit.client.1.smithi129.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-21T08:02:19.686 INFO:tasks.workunit.client.1.smithi129.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-21T08:02:19.687 INFO:tasks.workunit.client.1.smithi129.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-21T08:02:19.687 INFO:tasks.workunit.client.1.smithi129.stderr:+ popd 2024-09-21T08:02:19.687 INFO:tasks.workunit.client.1.smithi129.stderr:+ popd 2024-09-21T08:02:19.687 INFO:tasks.workunit.client.1.smithi129.stderr:++ mktemp -d -p . 2024-09-21T08:02:19.687 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:19 smithi129 ceph-mon[34472]: pgmap v239: 65 pgs: 65 active+clean; 162 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.3 MiB/s wr, 398 op/s 2024-09-21T08:02:19.692 INFO:tasks.workunit.client.1.smithi129.stderr:+ T=./tmp.DS0BYs9yI1 2024-09-21T08:02:19.693 INFO:tasks.workunit.client.1.smithi129.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.DS0BYs9yI1 -l 1 -n 1000 -p 10 -v 2024-09-21T08:02:19.697 INFO:tasks.workunit.client.1.smithi129.stdout:seed = 1726275303 2024-09-21T08:02:19.706 INFO:tasks.workunit.client.1.smithi129.stdout:0/0: dread - no filename 2024-09-21T08:02:19.707 INFO:tasks.workunit.client.1.smithi129.stdout:0/1: dwrite - no filename 2024-09-21T08:02:19.707 INFO:tasks.workunit.client.1.smithi129.stdout:0/2: truncate - no filename 2024-09-21T08:02:19.707 INFO:tasks.workunit.client.1.smithi129.stdout:0/3: rename - no filename 2024-09-21T08:02:19.707 INFO:tasks.workunit.client.1.smithi129.stdout:0/4: write - no filename 2024-09-21T08:02:19.707 INFO:tasks.workunit.client.1.smithi129.stdout:0/5: dwrite - no filename 2024-09-21T08:02:19.707 INFO:tasks.workunit.client.1.smithi129.stdout:0/6: dread - no filename 2024-09-21T08:02:19.707 INFO:tasks.workunit.client.1.smithi129.stdout:0/7: write - no filename 2024-09-21T08:02:19.712 INFO:tasks.workunit.client.1.smithi129.stdout:1/0: read - no filename 2024-09-21T08:02:19.712 INFO:tasks.workunit.client.1.smithi129.stdout:1/1: dwrite - no filename 2024-09-21T08:02:19.716 INFO:tasks.workunit.client.1.smithi129.stdout:1/2: symlink l0 0 2024-09-21T08:02:19.721 INFO:tasks.workunit.client.1.smithi129.stdout:1/3: mkdir d1 0 2024-09-21T08:02:19.728 INFO:tasks.workunit.client.1.smithi129.stdout:1/4: creat d1/f2 x:0 0 0 2024-09-21T08:02:19.728 INFO:tasks.workunit.client.1.smithi129.stdout:1/5: truncate d1/f2 77322 0 2024-09-21T08:02:19.731 INFO:tasks.workunit.client.1.smithi129.stdout:5/0: mknod c0 0 2024-09-21T08:02:19.731 INFO:tasks.workunit.client.1.smithi129.stdout:5/1: fsync - no filename 2024-09-21T08:02:19.731 INFO:tasks.workunit.client.1.smithi129.stdout:5/2: write - no filename 2024-09-21T08:02:19.731 INFO:tasks.workunit.client.1.smithi129.stdout:5/3: dread - no filename 2024-09-21T08:02:19.731 INFO:tasks.workunit.client.1.smithi129.stdout:5/4: fdatasync - no filename 2024-09-21T08:02:19.731 INFO:tasks.workunit.client.1.smithi129.stdout:5/5: rmdir - no directory 2024-09-21T08:02:19.731 INFO:tasks.workunit.client.1.smithi129.stdout:5/6: chown c0 991711 1 2024-09-21T08:02:19.731 INFO:tasks.workunit.client.1.smithi129.stdout:5/7: write - no filename 2024-09-21T08:02:19.731 INFO:tasks.workunit.client.1.smithi129.stdout:5/8: dwrite - no filename 2024-09-21T08:02:19.731 INFO:tasks.workunit.client.1.smithi129.stdout:5/9: write - no filename 2024-09-21T08:02:19.731 INFO:tasks.workunit.client.1.smithi129.stdout:6/0: fdatasync - no filename 2024-09-21T08:02:19.731 INFO:tasks.workunit.client.1.smithi129.stdout:6/1: dwrite - no filename 2024-09-21T08:02:19.731 INFO:tasks.workunit.client.1.smithi129.stdout:6/2: dread - no filename 2024-09-21T08:02:19.731 INFO:tasks.workunit.client.1.smithi129.stdout:6/3: dread - no filename 2024-09-21T08:02:19.732 INFO:tasks.workunit.client.1.smithi129.stdout:6/4: rename - no filename 2024-09-21T08:02:19.732 INFO:tasks.workunit.client.1.smithi129.stdout:6/5: fdatasync - no filename 2024-09-21T08:02:19.732 INFO:tasks.workunit.client.1.smithi129.stdout:6/6: unlink - no file 2024-09-21T08:02:19.734 INFO:tasks.workunit.client.1.smithi129.stdout:5/10: creat f1 x:0 0 0 2024-09-21T08:02:19.734 INFO:tasks.workunit.client.1.smithi129.stdout:5/11: dread - f1 zero size 2024-09-21T08:02:19.734 INFO:tasks.workunit.client.1.smithi129.stdout:5/12: chown f1 13549 1 2024-09-21T08:02:19.735 INFO:tasks.workunit.client.1.smithi129.stdout:6/7: symlink l0 0 2024-09-21T08:02:19.738 INFO:tasks.workunit.client.1.smithi129.stdout:5/13: mkdir d2 0 2024-09-21T08:02:19.738 INFO:tasks.workunit.client.1.smithi129.stdout:5/14: write f1 [242873,91926] 0 2024-09-21T08:02:19.741 INFO:tasks.workunit.client.1.smithi129.stdout:6/8: link l0 l1 0 2024-09-21T08:02:19.742 INFO:tasks.workunit.client.1.smithi129.stdout:8/0: mkdir d0 0 2024-09-21T08:02:19.742 INFO:tasks.workunit.client.1.smithi129.stdout:8/1: truncate - no filename 2024-09-21T08:02:19.742 INFO:tasks.workunit.client.1.smithi129.stdout:8/2: chown d0 28 1 2024-09-21T08:02:19.744 INFO:tasks.workunit.client.1.smithi129.stdout:9/0: read - no filename 2024-09-21T08:02:19.744 INFO:tasks.workunit.client.1.smithi129.stdout:9/1: rmdir - no directory 2024-09-21T08:02:19.744 INFO:tasks.workunit.client.1.smithi129.stdout:9/2: fsync - no filename 2024-09-21T08:02:19.744 INFO:tasks.workunit.client.1.smithi129.stdout:9/3: dread - no filename 2024-09-21T08:02:19.748 INFO:tasks.workunit.client.1.smithi129.stdout:5/15: creat d2/f3 x:0 0 0 2024-09-21T08:02:19.748 INFO:tasks.workunit.client.1.smithi129.stdout:5/16: readlink - no filename 2024-09-21T08:02:19.748 INFO:tasks.workunit.client.1.smithi129.stdout:5/17: creat d2/f4 x:0 0 0 2024-09-21T08:02:19.748 INFO:tasks.workunit.client.1.smithi129.stdout:6/9: creat f2 x:0 0 0 2024-09-21T08:02:19.752 INFO:tasks.workunit.client.1.smithi129.stdout:8/3: creat d0/f1 x:0 0 0 2024-09-21T08:02:19.752 INFO:tasks.workunit.client.1.smithi129.stdout:7/0: dwrite - no filename 2024-09-21T08:02:19.753 INFO:tasks.workunit.client.1.smithi129.stdout:7/1: truncate - no filename 2024-09-21T08:02:19.753 INFO:tasks.workunit.client.1.smithi129.stdout:7/2: truncate - no filename 2024-09-21T08:02:19.753 INFO:tasks.workunit.client.1.smithi129.stdout:7/3: dread - no filename 2024-09-21T08:02:19.753 INFO:tasks.workunit.client.1.smithi129.stdout:7/4: chown . 2053 1 2024-09-21T08:02:19.756 INFO:tasks.workunit.client.1.smithi129.stdout:9/4: creat f0 x:0 0 0 2024-09-21T08:02:19.756 INFO:tasks.workunit.client.1.smithi129.stdout:9/5: chown f0 2737 1 2024-09-21T08:02:19.756 INFO:tasks.workunit.client.1.smithi129.stdout:9/6: write f0 [523861,16949] 0 2024-09-21T08:02:19.760 INFO:tasks.workunit.client.1.smithi129.stdout:8/4: rename d0/f1 to d0/f2 0 2024-09-21T08:02:19.760 INFO:tasks.workunit.client.1.smithi129.stdout:8/5: stat d0/f2 0 2024-09-21T08:02:19.767 INFO:tasks.workunit.client.0.smithi107.stdout:0/18: rename d1/l4 to d1/d5/l6 0 2024-09-21T08:02:19.767 INFO:tasks.workunit.client.0.smithi107.stdout:0/19: stat d1 0 2024-09-21T08:02:19.767 INFO:tasks.workunit.client.0.smithi107.stdout:0/20: rename d1 to d1/d5/d7 22 2024-09-21T08:02:19.767 INFO:tasks.workunit.client.0.smithi107.stdout:0/21: creat d1/f8 x:0 0 0 2024-09-21T08:02:19.770 INFO:tasks.workunit.client.1.smithi129.stdout:7/5: mkdir d0 0 2024-09-21T08:02:19.775 INFO:tasks.workunit.client.1.smithi129.stdout:7/6: creat d0/f1 x:0 0 0 2024-09-21T08:02:19.775 INFO:tasks.workunit.client.1.smithi129.stdout:7/7: creat d0/f2 x:0 0 0 2024-09-21T08:02:19.781 INFO:tasks.workunit.client.1.smithi129.stdout:7/8: rename d0/f1 to d0/f3 0 2024-09-21T08:02:19.781 INFO:tasks.workunit.client.1.smithi129.stdout:7/9: creat d0/f4 x:0 0 0 2024-09-21T08:02:19.782 INFO:tasks.workunit.client.1.smithi129.stdout:7/10: dread - d0/f4 zero size 2024-09-21T08:02:19.787 INFO:tasks.workunit.client.1.smithi129.stdout:7/11: unlink d0/f2 0 2024-09-21T08:02:19.787 INFO:tasks.workunit.client.1.smithi129.stdout:7/12: write d0/f3 [606002,106387] 0 2024-09-21T08:02:19.787 INFO:tasks.workunit.client.1.smithi129.stdout:7/13: truncate d0/f4 440792 0 2024-09-21T08:02:19.787 INFO:tasks.workunit.client.1.smithi129.stdout:7/14: creat d0/f5 x:0 0 0 2024-09-21T08:02:19.787 INFO:tasks.workunit.client.1.smithi129.stdout:7/15: fdatasync d0/f5 0 2024-09-21T08:02:19.787 INFO:tasks.workunit.client.1.smithi129.stdout:7/16: chown d0/f3 17 1 2024-09-21T08:02:19.787 INFO:tasks.workunit.client.1.smithi129.stdout:7/17: chown d0 744047778 1 2024-09-21T08:02:19.787 INFO:tasks.workunit.client.1.smithi129.stdout:7/18: rename d0 to d0/d6 22 2024-09-21T08:02:19.787 INFO:tasks.workunit.client.1.smithi129.stdout:7/19: creat d0/f7 x:0 0 0 2024-09-21T08:02:19.795 INFO:tasks.workunit.client.1.smithi129.stdout:7/20: rename d0/f7 to d0/f8 0 2024-09-21T08:02:19.795 INFO:tasks.workunit.client.1.smithi129.stdout:7/21: dread - d0/f5 zero size 2024-09-21T08:02:19.797 INFO:tasks.workunit.client.1.smithi129.stdout:7/22: mknod d0/c9 0 2024-09-21T08:02:19.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:19 smithi107 ceph-mon[27622]: pgmap v239: 65 pgs: 65 active+clean; 162 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.3 MiB/s wr, 398 op/s 2024-09-21T08:02:19.923 INFO:tasks.workunit.client.0.smithi107.stdout:5/24: fsync d7/f8 0 2024-09-21T08:02:19.923 INFO:tasks.workunit.client.0.smithi107.stdout:5/25: dread - d7/f8 zero size 2024-09-21T08:02:19.938 INFO:tasks.workunit.client.0.smithi107.stdout:7/8: dwrite f0 [0,4194304] 0 2024-09-21T08:02:20.599 INFO:tasks.workunit.client.1.smithi129.stdout:8/6: unlink d0/f2 0 2024-09-21T08:02:20.717 INFO:tasks.workunit.client.0.smithi107.stdout:1/12: dread d0/f2 [0,4194304] 0 2024-09-21T08:02:20.929 INFO:tasks.workunit.client.0.smithi107.stdout:4/6: dwrite f0 [0,4194304] 0 2024-09-21T08:02:20.945 INFO:tasks.workunit.client.1.smithi129.stdout:1/6: dread d1/f2 [0,4194304] 0 2024-09-21T08:02:20.945 INFO:tasks.workunit.client.1.smithi129.stdout:1/7: readlink l0 0 2024-09-21T08:02:20.945 INFO:tasks.workunit.client.1.smithi129.stdout:1/8: chown d1/f2 181 1 2024-09-21T08:02:20.945 INFO:tasks.workunit.client.1.smithi129.stdout:1/9: creat d1/f3 x:0 0 0 2024-09-21T08:02:21.028 INFO:tasks.workunit.client.1.smithi129.stdout:7/23: dwrite d0/f3 [0,4194304] 0 2024-09-21T08:02:21.103 INFO:tasks.workunit.client.1.smithi129.stdout:6/10: dwrite f2 [0,4194304] 0 2024-09-21T08:02:21.106 INFO:tasks.workunit.client.0.smithi107.stdout:6/20: dwrite d2/d3/f4 [0,4194304] 0 2024-09-21T08:02:21.112 INFO:tasks.workunit.client.0.smithi107.stdout:1/13: dwrite d0/f2 [0,4194304] 0 2024-09-21T08:02:21.150 INFO:tasks.workunit.client.1.smithi129.stdout:9/7: dread f0 [0,4194304] 0 2024-09-21T08:02:21.150 INFO:tasks.workunit.client.1.smithi129.stdout:9/8: fsync f0 0 2024-09-21T08:02:21.283 INFO:tasks.workunit.client.1.smithi129.stdout:3/0: dwrite - no filename 2024-09-21T08:02:21.283 INFO:tasks.workunit.client.1.smithi129.stdout:2/0: fdatasync - no filename 2024-09-21T08:02:21.283 INFO:tasks.workunit.client.1.smithi129.stdout:3/1: link - no file 2024-09-21T08:02:21.283 INFO:tasks.workunit.client.1.smithi129.stdout:3/2: fdatasync - no filename 2024-09-21T08:02:21.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:21 smithi129 ceph-mon[34472]: pgmap v240: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s wr, 99 op/s 2024-09-21T08:02:21.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:21 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:02:21.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:21 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:02:21.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:21 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:02:21.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:21 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:02:21.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:21 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:02:21.636 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:21 smithi107 ceph-mon[27622]: pgmap v240: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s wr, 99 op/s 2024-09-21T08:02:21.637 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:21 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:02:21.637 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:21 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:02:21.637 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:21 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:02:21.637 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:21 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:02:21.637 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:21 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' 2024-09-21T08:02:22.262 INFO:tasks.workunit.client.0.smithi107.stdout:0/22: mkdir d1/d5/d9 0 2024-09-21T08:02:22.284 INFO:tasks.workunit.client.0.smithi107.stdout:0/23: dwrite d1/f8 [0,4194304] 0 2024-09-21T08:02:22.501 INFO:tasks.workunit.client.0.smithi107.stdout:9/1: rename c0 to c1 0 2024-09-21T08:02:22.501 INFO:tasks.workunit.client.0.smithi107.stdout:9/2: dread - no filename 2024-09-21T08:02:22.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:02:22.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr fail", "who": "smithi107.wzulxb"}]: dispatch 2024-09-21T08:02:22.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: Activating manager daemon smithi129.wvlmvo 2024-09-21T08:02:22.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-21T08:02:22.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T08:02:22.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.grqzkt"}]: dispatch 2024-09-21T08:02:22.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.qusoyf"}]: dispatch 2024-09-21T08:02:22.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.fwmfcy"}]: dispatch 2024-09-21T08:02:22.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.belyba"}]: dispatch 2024-09-21T08:02:22.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mgr metadata", "who": "smithi129.wvlmvo", "id": "smithi129.wvlmvo"}]: dispatch 2024-09-21T08:02:22.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T08:02:22.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T08:02:22.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T08:02:22.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T08:02:22.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T08:02:22.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T08:02:22.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: osdmap e45: 6 total, 6 up, 6 in 2024-09-21T08:02:22.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "mgr fail", "who": "smithi107.wzulxb"}]': finished 2024-09-21T08:02:22.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: mgrmap e21: smithi129.wvlmvo(active, starting, since 0.010144s) 2024-09-21T08:02:22.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T08:02:22.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T08:02:22.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T08:02:22.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: Manager daemon smithi129.wvlmvo is now available 2024-09-21T08:02:22.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: Checking for cert/key for grafana.smithi107 2024-09-21T08:02:22.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: Migrating grafana.smithi107 cert to cert store 2024-09-21T08:02:22.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:22.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: Migrating grafana.smithi107 key to cert store 2024-09-21T08:02:22.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:22.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:22.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:02:22.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:02:22.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi129.wvlmvo/mirror_snapshot_schedule"}]: dispatch 2024-09-21T08:02:22.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi129.wvlmvo/mirror_snapshot_schedule"}]: dispatch 2024-09-21T08:02:22.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi129.wvlmvo/trash_purge_schedule"}]: dispatch 2024-09-21T08:02:22.520 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:22 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi129.wvlmvo/trash_purge_schedule"}]: dispatch 2024-09-21T08:02:22.675 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:02:22.676 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr fail", "who": "smithi107.wzulxb"}]: dispatch 2024-09-21T08:02:22.676 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: Activating manager daemon smithi129.wvlmvo 2024-09-21T08:02:22.676 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-21T08:02:22.676 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T08:02:22.676 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.grqzkt"}]: dispatch 2024-09-21T08:02:22.676 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.qusoyf"}]: dispatch 2024-09-21T08:02:22.676 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.fwmfcy"}]: dispatch 2024-09-21T08:02:22.676 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.belyba"}]: dispatch 2024-09-21T08:02:22.676 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mgr metadata", "who": "smithi129.wvlmvo", "id": "smithi129.wvlmvo"}]: dispatch 2024-09-21T08:02:22.676 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T08:02:22.676 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T08:02:22.676 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T08:02:22.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T08:02:22.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T08:02:22.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T08:02:22.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: osdmap e45: 6 total, 6 up, 6 in 2024-09-21T08:02:22.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.14206 172.21.15.107:0/600132804' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "mgr fail", "who": "smithi107.wzulxb"}]': finished 2024-09-21T08:02:22.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: mgrmap e21: smithi129.wvlmvo(active, starting, since 0.010144s) 2024-09-21T08:02:22.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T08:02:22.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T08:02:22.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T08:02:22.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: Manager daemon smithi129.wvlmvo is now available 2024-09-21T08:02:22.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: Checking for cert/key for grafana.smithi107 2024-09-21T08:02:22.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: Migrating grafana.smithi107 cert to cert store 2024-09-21T08:02:22.677 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:22.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: Migrating grafana.smithi107 key to cert store 2024-09-21T08:02:22.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:22.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:22.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:02:22.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:02:22.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi129.wvlmvo/mirror_snapshot_schedule"}]: dispatch 2024-09-21T08:02:22.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi129.wvlmvo/mirror_snapshot_schedule"}]: dispatch 2024-09-21T08:02:22.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi129.wvlmvo/trash_purge_schedule"}]: dispatch 2024-09-21T08:02:22.678 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:22 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi129.wvlmvo/trash_purge_schedule"}]: dispatch 2024-09-21T08:02:22.791 INFO:tasks.workunit.client.0.smithi107.stdout:5/26: mknod d7/c9 0 2024-09-21T08:02:22.877 INFO:tasks.workunit.client.0.smithi107.stdout:7/9: symlink l1 0 2024-09-21T08:02:22.877 INFO:tasks.workunit.client.0.smithi107.stdout:7/10: chown l1 8161789 1 2024-09-21T08:02:22.877 INFO:tasks.workunit.client.0.smithi107.stdout:7/11: fsync f0 0 2024-09-21T08:02:22.900 INFO:tasks.workunit.client.0.smithi107.stdout:7/12: dwrite f0 [0,4194304] 0 2024-09-21T08:02:22.900 INFO:tasks.workunit.client.0.smithi107.stdout:7/13: fsync f0 0 2024-09-21T08:02:22.955 INFO:tasks.workunit.client.1.smithi129.stdout:8/7: mkdir d0/d3 0 2024-09-21T08:02:22.955 INFO:tasks.workunit.client.1.smithi129.stdout:8/8: stat d0 0 2024-09-21T08:02:22.955 INFO:tasks.workunit.client.1.smithi129.stdout:8/9: creat d0/f4 x:0 0 0 2024-09-21T08:02:23.386 INFO:tasks.workunit.client.0.smithi107.stdout:2/11: getdents . 0 2024-09-21T08:02:23.387 INFO:tasks.workunit.client.0.smithi107.stdout:2/12: fdatasync f0 0 2024-09-21T08:02:23.387 INFO:tasks.workunit.client.0.smithi107.stdout:2/13: readlink - no filename 2024-09-21T08:02:23.387 INFO:tasks.workunit.client.0.smithi107.stdout:2/14: write f0 [1200025,86893] 0 2024-09-21T08:02:23.703 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:23 smithi107 ceph-mon[27622]: Deploying cephadm binary to smithi107 2024-09-21T08:02:23.703 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:23 smithi107 ceph-mon[27622]: mgrmap e22: smithi129.wvlmvo(active, since 1.01143s) 2024-09-21T08:02:23.703 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:23 smithi107 ceph-mon[27622]: pgmap v3: 65 pgs: 65 active+clean; 268 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:02:23.703 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:23 smithi107 ceph-mon[27622]: Deploying cephadm binary to smithi129 2024-09-21T08:02:23.703 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:23 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:23.704 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:23 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:23.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:23 smithi129 ceph-mon[34472]: Deploying cephadm binary to smithi107 2024-09-21T08:02:23.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:23 smithi129 ceph-mon[34472]: mgrmap e22: smithi129.wvlmvo(active, since 1.01143s) 2024-09-21T08:02:23.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:23 smithi129 ceph-mon[34472]: pgmap v3: 65 pgs: 65 active+clean; 268 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:02:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:23 smithi129 ceph-mon[34472]: Deploying cephadm binary to smithi129 2024-09-21T08:02:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:23 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:23 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:23.831 INFO:tasks.workunit.client.0.smithi107.stdout:4/7: mknod c1 0 2024-09-21T08:02:23.838 INFO:tasks.workunit.client.0.smithi107.stdout:1/14: link d0/f2 d0/f3 0 2024-09-21T08:02:23.838 INFO:tasks.workunit.client.0.smithi107.stdout:1/15: creat d0/f4 x:0 0 0 2024-09-21T08:02:23.844 INFO:tasks.workunit.client.0.smithi107.stdout:0/24: unlink d1/d5/l6 0 2024-09-21T08:02:23.844 INFO:tasks.workunit.client.0.smithi107.stdout:0/25: creat d1/fa x:0 0 0 2024-09-21T08:02:23.844 INFO:tasks.workunit.client.0.smithi107.stdout:0/26: rename d1 to d1/d5/d9/db 22 2024-09-21T08:02:23.846 INFO:tasks.workunit.client.0.smithi107.stdout:9/3: rename c1 to c2 0 2024-09-21T08:02:23.846 INFO:tasks.workunit.client.0.smithi107.stdout:9/4: write - no filename 2024-09-21T08:02:23.846 INFO:tasks.workunit.client.0.smithi107.stdout:9/5: dread - no filename 2024-09-21T08:02:23.846 INFO:tasks.workunit.client.0.smithi107.stdout:9/6: write - no filename 2024-09-21T08:02:23.846 INFO:tasks.workunit.client.0.smithi107.stdout:9/7: dread - no filename 2024-09-21T08:02:23.848 INFO:tasks.workunit.client.0.smithi107.stdout:5/27: write d7/f8 [1027292,92507] 0 2024-09-21T08:02:23.848 INFO:tasks.workunit.client.0.smithi107.stdout:5/28: readlink - no filename 2024-09-21T08:02:23.848 INFO:tasks.workunit.client.0.smithi107.stdout:5/29: creat d7/fa x:0 0 0 2024-09-21T08:02:23.854 INFO:tasks.workunit.client.0.smithi107.stdout:2/15: mkdir d1 0 2024-09-21T08:02:23.854 INFO:tasks.workunit.client.0.smithi107.stdout:2/16: truncate f0 1611975 0 2024-09-21T08:02:23.854 INFO:tasks.workunit.client.0.smithi107.stdout:2/17: stat d1 0 2024-09-21T08:02:23.856 INFO:tasks.workunit.client.0.smithi107.stdout:4/8: write f0 [3777012,80348] 0 2024-09-21T08:02:23.856 INFO:tasks.workunit.client.0.smithi107.stdout:4/9: chown c1 180 1 2024-09-21T08:02:23.861 INFO:tasks.workunit.client.0.smithi107.stdout:9/8: creat f3 x:0 0 0 2024-09-21T08:02:23.861 INFO:tasks.workunit.client.0.smithi107.stdout:0/27: dwrite d1/fa [0,4194304] 0 2024-09-21T08:02:23.865 INFO:tasks.workunit.client.0.smithi107.stdout:5/30: mknod d7/cb 0 2024-09-21T08:02:23.865 INFO:tasks.workunit.client.0.smithi107.stdout:5/31: read - d7/fa zero size 2024-09-21T08:02:23.869 INFO:tasks.workunit.client.0.smithi107.stdout:2/18: mkdir d1/d2 0 2024-09-21T08:02:23.874 INFO:tasks.workunit.client.0.smithi107.stdout:4/10: mknod c2 0 2024-09-21T08:02:23.874 INFO:tasks.workunit.client.0.smithi107.stdout:4/11: readlink - no filename 2024-09-21T08:02:23.874 INFO:tasks.workunit.client.0.smithi107.stdout:4/12: chown c2 821905816 1 2024-09-21T08:02:23.875 INFO:tasks.workunit.client.0.smithi107.stdout:0/28: dwrite d1/fa [0,4194304] 0 2024-09-21T08:02:23.880 INFO:tasks.workunit.client.0.smithi107.stdout:9/9: mknod c4 0 2024-09-21T08:02:23.883 INFO:tasks.workunit.client.0.smithi107.stdout:5/32: mknod d7/cc 0 2024-09-21T08:02:23.889 INFO:tasks.workunit.client.0.smithi107.stdout:0/29: mknod d1/d5/cc 0 2024-09-21T08:02:23.899 INFO:tasks.workunit.client.0.smithi107.stdout:0/30: rmdir d1/d5/d9 0 2024-09-21T08:02:23.900 INFO:tasks.workunit.client.0.smithi107.stdout:9/10: dwrite f3 [0,4194304] 0 2024-09-21T08:02:23.902 INFO:tasks.workunit.client.0.smithi107.stdout:0/31: creat d1/d5/fd x:0 0 0 2024-09-21T08:02:23.903 INFO:tasks.workunit.client.0.smithi107.stdout:0/32: dread - d1/d5/fd zero size 2024-09-21T08:02:23.907 INFO:tasks.workunit.client.0.smithi107.stdout:9/11: symlink l5 0 2024-09-21T08:02:23.907 INFO:tasks.workunit.client.0.smithi107.stdout:9/12: chown c4 1004 1 2024-09-21T08:02:23.909 INFO:tasks.workunit.client.0.smithi107.stdout:9/13: rename l5 to l6 0 2024-09-21T08:02:24.156 INFO:tasks.workunit.client.1.smithi129.stdout:7/24: symlink d0/la 0 2024-09-21T08:02:24.279 INFO:tasks.workunit.client.1.smithi129.stdout:6/11: rename f2 to f3 0 2024-09-21T08:02:24.286 INFO:tasks.workunit.client.1.smithi129.stdout:6/12: dread f3 [0,4194304] 0 2024-09-21T08:02:24.307 INFO:tasks.workunit.client.1.smithi129.stdout:9/9: mknod c1 0 2024-09-21T08:02:24.324 INFO:tasks.workunit.client.1.smithi129.stdout:4/0: symlink l0 0 2024-09-21T08:02:24.324 INFO:tasks.workunit.client.1.smithi129.stdout:2/1: symlink l0 0 2024-09-21T08:02:24.325 INFO:tasks.workunit.client.1.smithi129.stdout:3/3: symlink l0 0 2024-09-21T08:02:24.630 INFO:tasks.workunit.client.0.smithi107.stdout:4/13: write f0 [4543592,104704] 0 2024-09-21T08:02:24.631 INFO:tasks.workunit.client.0.smithi107.stdout:4/14: stat c2 0 2024-09-21T08:02:24.632 INFO:tasks.workunit.client.0.smithi107.stdout:4/15: mknod c3 0 2024-09-21T08:02:24.634 INFO:tasks.workunit.client.0.smithi107.stdout:4/16: symlink l4 0 2024-09-21T08:02:24.634 INFO:tasks.workunit.client.0.smithi107.stdout:4/17: chown f0 2157115 1 2024-09-21T08:02:24.638 INFO:tasks.workunit.client.0.smithi107.stdout:0/33: write d1/f8 [4221050,73968] 0 2024-09-21T08:02:24.640 INFO:tasks.workunit.client.0.smithi107.stdout:0/34: unlink d1/fa 0 2024-09-21T08:02:24.640 INFO:tasks.workunit.client.0.smithi107.stdout:0/35: creat d1/fe x:0 0 0 2024-09-21T08:02:24.643 INFO:tasks.workunit.client.0.smithi107.stdout:0/36: symlink d1/lf 0 2024-09-21T08:02:24.645 INFO:tasks.workunit.client.0.smithi107.stdout:7/14: truncate f0 1230334 0 2024-09-21T08:02:24.650 INFO:tasks.workunit.client.0.smithi107.stdout:6/21: truncate d2/d3/f4 1615294 0 2024-09-21T08:02:24.651 INFO:tasks.workunit.client.0.smithi107.stdout:1/16: fsync d0/f4 0 2024-09-21T08:02:24.651 INFO:tasks.workunit.client.0.smithi107.stdout:1/17: creat d0/f5 x:0 0 0 2024-09-21T08:02:24.657 INFO:tasks.workunit.client.0.smithi107.stdout:0/37: dread d1/f8 [0,4194304] 0 2024-09-21T08:02:24.657 INFO:tasks.workunit.client.0.smithi107.stdout:0/38: write d1/fe [557474,13230] 0 2024-09-21T08:02:24.683 INFO:tasks.workunit.client.0.smithi107.stdout:1/18: mkdir d0/d6 0 2024-09-21T08:02:24.683 INFO:tasks.workunit.client.0.smithi107.stdout:1/19: chown d0/f2 8 1 2024-09-21T08:02:24.683 INFO:tasks.workunit.client.0.smithi107.stdout:0/39: unlink d1/d5/fd 0 2024-09-21T08:02:24.684 INFO:tasks.workunit.client.0.smithi107.stdout:0/40: mkdir d1/d10 0 2024-09-21T08:02:24.687 INFO:tasks.workunit.client.0.smithi107.stdout:1/20: dread d0/f2 [0,4194304] 0 2024-09-21T08:02:24.696 INFO:tasks.workunit.client.0.smithi107.stdout:5/33: rmdir d7 39 2024-09-21T08:02:24.697 INFO:tasks.workunit.client.0.smithi107.stdout:5/34: dread - d7/fa zero size 2024-09-21T08:02:24.698 INFO:tasks.workunit.client.0.smithi107.stdout:5/35: readlink - no filename 2024-09-21T08:02:24.701 INFO:tasks.workunit.client.0.smithi107.stdout:0/41: dwrite d1/f8 [0,4194304] 0 2024-09-21T08:02:24.701 INFO:tasks.workunit.client.0.smithi107.stdout:0/42: creat d1/f11 x:0 0 0 2024-09-21T08:02:24.703 INFO:tasks.workunit.client.0.smithi107.stdout:5/36: truncate d7/f8 1036888 0 2024-09-21T08:02:24.725 INFO:tasks.workunit.client.0.smithi107.stdout:0/43: dwrite d1/f8 [0,4194304] 0 2024-09-21T08:02:24.726 INFO:tasks.workunit.client.0.smithi107.stdout:0/44: getdents d1/d10 0 2024-09-21T08:02:24.726 INFO:tasks.workunit.client.0.smithi107.stdout:0/45: write d1/f11 [72478,9872] 0 2024-09-21T08:02:24.733 INFO:tasks.workunit.client.0.smithi107.stdout:5/37: dwrite d7/fa [0,4194304] 0 2024-09-21T08:02:24.734 INFO:tasks.workunit.client.0.smithi107.stdout:9/14: dwrite f3 [4194304,4194304] 0 2024-09-21T08:02:24.734 INFO:tasks.workunit.client.0.smithi107.stdout:9/15: creat f7 x:0 0 0 2024-09-21T08:02:24.734 INFO:tasks.workunit.client.0.smithi107.stdout:9/16: chown c4 1003 1 2024-09-21T08:02:24.734 INFO:tasks.workunit.client.0.smithi107.stdout:9/17: creat f8 x:0 0 0 2024-09-21T08:02:24.736 INFO:tasks.workunit.client.0.smithi107.stdout:0/46: read d1/f8 [3406042,114236] 0 2024-09-21T08:02:24.737 INFO:tasks.workunit.client.0.smithi107.stdout:0/47: readlink d1/lf 0 2024-09-21T08:02:24.737 INFO:tasks.workunit.client.0.smithi107.stdout:0/48: readlink d1/lf 0 2024-09-21T08:02:24.737 INFO:tasks.workunit.client.0.smithi107.stdout:0/49: creat d1/f12 x:0 0 0 2024-09-21T08:02:24.746 INFO:tasks.workunit.client.0.smithi107.stdout:0/50: symlink d1/d10/l13 0 2024-09-21T08:02:24.748 INFO:tasks.workunit.client.0.smithi107.stdout:0/51: write d1/fe [144810,4465] 0 2024-09-21T08:02:24.748 INFO:tasks.workunit.client.0.smithi107.stdout:0/52: creat d1/d5/f14 x:0 0 0 2024-09-21T08:02:24.748 INFO:tasks.workunit.client.0.smithi107.stdout:0/53: chown d1/lf 48 1 2024-09-21T08:02:24.749 INFO:tasks.workunit.client.0.smithi107.stdout:9/18: dread f3 [4194304,4194304] 0 2024-09-21T08:02:24.750 INFO:tasks.workunit.client.0.smithi107.stdout:5/38: dwrite d7/fa [0,4194304] 0 2024-09-21T08:02:24.752 INFO:tasks.workunit.client.0.smithi107.stdout:9/19: stat l6 0 2024-09-21T08:02:24.762 INFO:tasks.workunit.client.0.smithi107.stdout:9/20: write f3 [3277654,67101] 0 2024-09-21T08:02:24.762 INFO:tasks.workunit.client.0.smithi107.stdout:9/21: write f7 [810001,46529] 0 2024-09-21T08:02:24.767 INFO:tasks.workunit.client.0.smithi107.stdout:9/22: dread f7 [0,4194304] 0 2024-09-21T08:02:24.769 INFO:tasks.workunit.client.0.smithi107.stdout:9/23: stat c2 0 2024-09-21T08:02:24.775 INFO:tasks.workunit.client.0.smithi107.stdout:9/24: dread f3 [4194304,4194304] 0 2024-09-21T08:02:24.792 INFO:tasks.workunit.client.0.smithi107.stdout:9/25: dwrite f7 [0,4194304] 0 2024-09-21T08:02:24.792 INFO:tasks.workunit.client.0.smithi107.stdout:9/26: write f8 [343770,124680] 0 2024-09-21T08:02:25.095 INFO:tasks.workunit.client.1.smithi129.stdout:1/10: rmdir d1 39 2024-09-21T08:02:25.095 INFO:tasks.workunit.client.1.smithi129.stdout:7/25: rename d0/la to d0/lb 0 2024-09-21T08:02:25.098 INFO:tasks.workunit.client.1.smithi129.stdout:4/1: rename l0 to l1 0 2024-09-21T08:02:25.099 INFO:tasks.workunit.client.1.smithi129.stdout:2/2: mkdir d1 0 2024-09-21T08:02:25.099 INFO:tasks.workunit.client.1.smithi129.stdout:2/3: chown d1 1656 1 2024-09-21T08:02:25.099 INFO:tasks.workunit.client.1.smithi129.stdout:2/4: truncate - no filename 2024-09-21T08:02:25.099 INFO:tasks.workunit.client.1.smithi129.stdout:2/5: write - no filename 2024-09-21T08:02:25.099 INFO:tasks.workunit.client.1.smithi129.stdout:3/4: symlink l1 0 2024-09-21T08:02:25.099 INFO:tasks.workunit.client.1.smithi129.stdout:3/5: fsync - no filename 2024-09-21T08:02:25.100 INFO:tasks.workunit.client.1.smithi129.stdout:3/6: chown l0 52262 1 2024-09-21T08:02:25.100 INFO:tasks.workunit.client.1.smithi129.stdout:3/7: dread - no filename 2024-09-21T08:02:25.134 INFO:tasks.workunit.client.1.smithi129.stdout:8/10: unlink d0/f4 0 2024-09-21T08:02:25.134 INFO:tasks.workunit.client.1.smithi129.stdout:8/11: readlink - no filename 2024-09-21T08:02:25.134 INFO:tasks.workunit.client.1.smithi129.stdout:8/12: read - no filename 2024-09-21T08:02:25.134 INFO:tasks.workunit.client.1.smithi129.stdout:8/13: readlink - no filename 2024-09-21T08:02:25.134 INFO:tasks.workunit.client.1.smithi129.stdout:8/14: chown d0/d3 4771 1 2024-09-21T08:02:25.134 INFO:tasks.workunit.client.1.smithi129.stdout:8/15: unlink - no file 2024-09-21T08:02:25.135 INFO:tasks.workunit.client.1.smithi129.stdout:1/11: mkdir d1/d4 0 2024-09-21T08:02:25.139 INFO:tasks.workunit.client.1.smithi129.stdout:9/10: getdents . 0 2024-09-21T08:02:25.139 INFO:tasks.workunit.client.1.smithi129.stdout:4/2: creat f2 x:0 0 0 2024-09-21T08:02:25.139 INFO:tasks.workunit.client.1.smithi129.stdout:2/6: creat d1/f2 x:0 0 0 2024-09-21T08:02:25.139 INFO:tasks.workunit.client.1.smithi129.stdout:2/7: write d1/f2 [661450,101232] 0 2024-09-21T08:02:25.139 INFO:tasks.workunit.client.1.smithi129.stdout:2/8: rename d1 to d1/d3 22 2024-09-21T08:02:25.139 INFO:tasks.workunit.client.1.smithi129.stdout:2/9: creat d1/f4 x:0 0 0 2024-09-21T08:02:25.141 INFO:tasks.workunit.client.1.smithi129.stdout:8/16: mkdir d0/d5 0 2024-09-21T08:02:25.141 INFO:tasks.workunit.client.1.smithi129.stdout:8/17: dwrite - no filename 2024-09-21T08:02:25.141 INFO:tasks.workunit.client.1.smithi129.stdout:8/18: link - no file 2024-09-21T08:02:25.141 INFO:tasks.workunit.client.1.smithi129.stdout:8/19: dread - no filename 2024-09-21T08:02:25.142 INFO:tasks.workunit.client.1.smithi129.stdout:6/13: truncate f3 2777534 0 2024-09-21T08:02:25.143 INFO:tasks.workunit.client.1.smithi129.stdout:9/11: truncate f0 98689 0 2024-09-21T08:02:25.147 INFO:tasks.workunit.client.1.smithi129.stdout:8/20: rmdir d0/d5 0 2024-09-21T08:02:25.147 INFO:tasks.workunit.client.1.smithi129.stdout:8/21: chown d0 39274477 1 2024-09-21T08:02:25.147 INFO:tasks.workunit.client.1.smithi129.stdout:8/22: dwrite - no filename 2024-09-21T08:02:25.148 INFO:tasks.workunit.client.1.smithi129.stdout:8/23: write - no filename 2024-09-21T08:02:25.148 INFO:tasks.workunit.client.1.smithi129.stdout:8/24: dread - no filename 2024-09-21T08:02:25.150 INFO:tasks.workunit.client.1.smithi129.stdout:6/14: unlink l0 0 2024-09-21T08:02:25.150 INFO:tasks.workunit.client.1.smithi129.stdout:6/15: chown f3 1 1 2024-09-21T08:02:25.150 INFO:tasks.workunit.client.1.smithi129.stdout:6/16: chown l1 1 1 2024-09-21T08:02:25.150 INFO:tasks.workunit.client.1.smithi129.stdout:6/17: creat f4 x:0 0 0 2024-09-21T08:02:25.150 INFO:tasks.workunit.client.1.smithi129.stdout:6/18: creat f5 x:0 0 0 2024-09-21T08:02:25.150 INFO:tasks.workunit.client.1.smithi129.stdout:6/19: read - f4 zero size 2024-09-21T08:02:25.151 INFO:tasks.workunit.client.1.smithi129.stdout:9/12: mknod c2 0 2024-09-21T08:02:25.151 INFO:tasks.workunit.client.1.smithi129.stdout:1/12: dwrite d1/f2 [0,4194304] 0 2024-09-21T08:02:25.152 INFO:tasks.workunit.client.1.smithi129.stdout:2/10: link d1/f4 d1/f5 0 2024-09-21T08:02:25.152 INFO:tasks.workunit.client.1.smithi129.stdout:2/11: write d1/f4 [763384,14870] 0 2024-09-21T08:02:25.152 INFO:tasks.workunit.client.1.smithi129.stdout:2/12: truncate d1/f4 1175152 0 2024-09-21T08:02:25.152 INFO:tasks.workunit.client.1.smithi129.stdout:8/25: mkdir d0/d6 0 2024-09-21T08:02:25.152 INFO:tasks.workunit.client.1.smithi129.stdout:8/26: unlink - no file 2024-09-21T08:02:25.153 INFO:tasks.workunit.client.1.smithi129.stdout:8/27: readlink - no filename 2024-09-21T08:02:25.153 INFO:tasks.workunit.client.1.smithi129.stdout:8/28: write - no filename 2024-09-21T08:02:25.159 INFO:tasks.workunit.client.1.smithi129.stdout:1/13: link d1/f3 d1/d4/f5 0 2024-09-21T08:02:25.160 INFO:tasks.workunit.client.1.smithi129.stdout:2/13: symlink d1/l6 0 2024-09-21T08:02:25.160 INFO:tasks.workunit.client.1.smithi129.stdout:2/14: readlink l0 0 2024-09-21T08:02:25.163 INFO:tasks.workunit.client.1.smithi129.stdout:8/29: rmdir d0/d3 0 2024-09-21T08:02:25.163 INFO:tasks.workunit.client.1.smithi129.stdout:1/14: mknod d1/c6 0 2024-09-21T08:02:25.163 INFO:tasks.workunit.client.1.smithi129.stdout:1/15: dread - d1/f3 zero size 2024-09-21T08:02:25.163 INFO:tasks.workunit.client.1.smithi129.stdout:2/15: mknod d1/c7 0 2024-09-21T08:02:25.164 INFO:tasks.workunit.client.1.smithi129.stdout:8/30: mkdir d0/d6/d7 0 2024-09-21T08:02:25.164 INFO:tasks.workunit.client.1.smithi129.stdout:8/31: fdatasync - no filename 2024-09-21T08:02:25.164 INFO:tasks.workunit.client.1.smithi129.stdout:8/32: rename d0/d6 to d0/d6/d8 22 2024-09-21T08:02:25.164 INFO:tasks.workunit.client.1.smithi129.stdout:8/33: write - no filename 2024-09-21T08:02:25.164 INFO:tasks.workunit.client.1.smithi129.stdout:8/34: fsync - no filename 2024-09-21T08:02:25.165 INFO:tasks.workunit.client.1.smithi129.stdout:8/35: mkdir d0/d6/d7/d9 0 2024-09-21T08:02:25.166 INFO:tasks.workunit.client.1.smithi129.stdout:8/36: mknod d0/d6/ca 0 2024-09-21T08:02:25.167 INFO:tasks.workunit.client.1.smithi129.stdout:8/37: creat d0/d6/d7/fb x:0 0 0 2024-09-21T08:02:25.167 INFO:tasks.workunit.client.1.smithi129.stdout:8/38: write d0/d6/d7/fb [248457,79722] 0 2024-09-21T08:02:25.169 INFO:tasks.workunit.client.1.smithi129.stdout:6/20: dwrite f5 [0,4194304] 0 2024-09-21T08:02:25.173 INFO:tasks.workunit.client.1.smithi129.stdout:1/16: write d1/f2 [2649620,126638] 0 2024-09-21T08:02:25.174 INFO:tasks.workunit.client.1.smithi129.stdout:1/17: mknod d1/d4/c7 0 2024-09-21T08:02:25.174 INFO:tasks.workunit.client.1.smithi129.stdout:1/18: dread - d1/d4/f5 zero size 2024-09-21T08:02:25.175 INFO:tasks.workunit.client.1.smithi129.stdout:1/19: rename d1 to d1/d4/d8 22 2024-09-21T08:02:25.175 INFO:tasks.workunit.client.1.smithi129.stdout:8/39: dread d0/d6/d7/fb [0,4194304] 0 2024-09-21T08:02:25.175 INFO:tasks.workunit.client.1.smithi129.stdout:8/40: chown d0/d6 0 1 2024-09-21T08:02:25.176 INFO:tasks.workunit.client.1.smithi129.stdout:1/20: mkdir d1/d9 0 2024-09-21T08:02:25.176 INFO:tasks.workunit.client.1.smithi129.stdout:8/41: symlink d0/d6/lc 0 2024-09-21T08:02:25.177 INFO:tasks.workunit.client.1.smithi129.stdout:1/21: creat d1/d4/fa x:0 0 0 2024-09-21T08:02:25.212 INFO:tasks.workunit.client.1.smithi129.stdout:1/22: dwrite d1/f2 [0,4194304] 0 2024-09-21T08:02:25.212 INFO:tasks.workunit.client.1.smithi129.stdout:8/42: dwrite d0/d6/d7/fb [0,4194304] 0 2024-09-21T08:02:25.213 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:24 smithi107 ceph-mon[27622]: pgmap v4: 65 pgs: 65 active+clean; 268 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:02:25.213 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:24 smithi107 ceph-mon[27622]: [21/Sep/2024:08:02:23] ENGINE Bus STARTING 2024-09-21T08:02:25.213 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:24 smithi107 ceph-mon[27622]: mgrmap e23: smithi129.wvlmvo(active, since 2s) 2024-09-21T08:02:25.213 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:24 smithi107 ceph-mon[27622]: [21/Sep/2024:08:02:24] ENGINE Serving on http://172.21.15.129:8765 2024-09-21T08:02:25.222 INFO:tasks.workunit.client.1.smithi129.stdout:1/23: mknod d1/d4/cb 0 2024-09-21T08:02:25.228 INFO:tasks.workunit.client.1.smithi129.stdout:1/24: creat d1/fc x:0 0 0 2024-09-21T08:02:25.228 INFO:tasks.workunit.client.1.smithi129.stdout:1/25: chown d1/d9 16164 1 2024-09-21T08:02:25.231 INFO:tasks.workunit.client.1.smithi129.stdout:1/26: rename d1/fc to d1/fd 0 2024-09-21T08:02:25.232 INFO:tasks.workunit.client.1.smithi129.stdout:1/27: creat d1/d9/fe x:0 0 0 2024-09-21T08:02:25.248 INFO:tasks.workunit.client.1.smithi129.stdout:1/28: dwrite d1/d4/fa [0,4194304] 0 2024-09-21T08:02:25.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:24 smithi129 ceph-mon[34472]: pgmap v4: 65 pgs: 65 active+clean; 268 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:02:25.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:24 smithi129 ceph-mon[34472]: [21/Sep/2024:08:02:23] ENGINE Bus STARTING 2024-09-21T08:02:25.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:24 smithi129 ceph-mon[34472]: mgrmap e23: smithi129.wvlmvo(active, since 2s) 2024-09-21T08:02:25.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:24 smithi129 ceph-mon[34472]: [21/Sep/2024:08:02:24] ENGINE Serving on http://172.21.15.129:8765 2024-09-21T08:02:25.283 INFO:tasks.workunit.client.0.smithi107.stdout:4/18: truncate f0 2850287 0 2024-09-21T08:02:25.284 INFO:tasks.workunit.client.0.smithi107.stdout:4/19: link c2 c5 0 2024-09-21T08:02:25.284 INFO:tasks.workunit.client.0.smithi107.stdout:4/20: chown c5 1702387 1 2024-09-21T08:02:25.288 INFO:tasks.workunit.client.0.smithi107.stdout:7/15: rename f0 to f2 0 2024-09-21T08:02:25.306 INFO:tasks.workunit.client.0.smithi107.stdout:7/16: dwrite f2 [0,4194304] 0 2024-09-21T08:02:25.306 INFO:tasks.workunit.client.0.smithi107.stdout:7/17: creat f3 x:0 0 0 2024-09-21T08:02:25.318 INFO:tasks.workunit.client.0.smithi107.stdout:7/18: write f2 [1360557,119651] 0 2024-09-21T08:02:25.318 INFO:tasks.workunit.client.0.smithi107.stdout:7/19: creat f4 x:0 0 0 2024-09-21T08:02:25.318 INFO:tasks.workunit.client.0.smithi107.stdout:7/20: read - f3 zero size 2024-09-21T08:02:25.320 INFO:tasks.workunit.client.0.smithi107.stdout:7/21: mknod c5 0 2024-09-21T08:02:25.321 INFO:tasks.workunit.client.0.smithi107.stdout:7/22: symlink l6 0 2024-09-21T08:02:25.326 INFO:tasks.workunit.client.0.smithi107.stdout:9/27: truncate f3 2296816 0 2024-09-21T08:02:25.327 INFO:tasks.workunit.client.0.smithi107.stdout:9/28: mknod c9 0 2024-09-21T08:02:25.329 INFO:tasks.workunit.client.0.smithi107.stdout:9/29: rename f8 to fa 0 2024-09-21T08:02:25.424 INFO:tasks.workunit.client.1.smithi129.stdout:7/26: getdents d0 0 2024-09-21T08:02:25.425 INFO:tasks.workunit.client.1.smithi129.stdout:7/27: creat d0/fc x:0 0 0 2024-09-21T08:02:25.426 INFO:tasks.workunit.client.1.smithi129.stdout:4/3: link l1 l3 0 2024-09-21T08:02:25.426 INFO:tasks.workunit.client.1.smithi129.stdout:4/4: stat f2 0 2024-09-21T08:02:25.428 INFO:tasks.workunit.client.1.smithi129.stdout:3/8: getdents . 0 2024-09-21T08:02:25.428 INFO:tasks.workunit.client.1.smithi129.stdout:3/9: write - no filename 2024-09-21T08:02:25.428 INFO:tasks.workunit.client.1.smithi129.stdout:3/10: chown l1 41 1 2024-09-21T08:02:25.428 INFO:tasks.workunit.client.1.smithi129.stdout:7/28: symlink d0/ld 0 2024-09-21T08:02:25.431 INFO:tasks.workunit.client.1.smithi129.stdout:3/11: link l0 l2 0 2024-09-21T08:02:25.435 INFO:tasks.workunit.client.1.smithi129.stdout:3/12: mkdir d3 0 2024-09-21T08:02:25.436 INFO:tasks.workunit.client.1.smithi129.stdout:3/13: chown l1 7928146 1 2024-09-21T08:02:25.436 INFO:tasks.workunit.client.1.smithi129.stdout:3/14: readlink l1 0 2024-09-21T08:02:25.437 INFO:tasks.workunit.client.1.smithi129.stdout:3/15: creat d3/f4 x:0 0 0 2024-09-21T08:02:25.438 INFO:tasks.workunit.client.1.smithi129.stdout:3/16: creat d3/f5 x:0 0 0 2024-09-21T08:02:25.441 INFO:tasks.workunit.client.1.smithi129.stdout:3/17: mknod d3/c6 0 2024-09-21T08:02:25.445 INFO:tasks.workunit.client.1.smithi129.stdout:9/13: truncate f0 450611 0 2024-09-21T08:02:25.452 INFO:tasks.workunit.client.1.smithi129.stdout:1/29: fsync d1/f3 0 2024-09-21T08:02:25.453 INFO:tasks.workunit.client.1.smithi129.stdout:1/30: link d1/d4/c7 d1/d4/cf 0 2024-09-21T08:02:25.453 INFO:tasks.workunit.client.1.smithi129.stdout:1/31: chown d1/d4/fa 4022222 1 2024-09-21T08:02:25.454 INFO:tasks.workunit.client.1.smithi129.stdout:1/32: mknod d1/d4/c10 0 2024-09-21T08:02:25.455 INFO:tasks.workunit.client.1.smithi129.stdout:1/33: mknod d1/c11 0 2024-09-21T08:02:25.455 INFO:tasks.workunit.client.1.smithi129.stdout:1/34: creat d1/f12 x:0 0 0 2024-09-21T08:02:25.455 INFO:tasks.workunit.client.1.smithi129.stdout:1/35: dread - d1/fd zero size 2024-09-21T08:02:25.456 INFO:tasks.workunit.client.1.smithi129.stdout:2/16: rmdir d1 39 2024-09-21T08:02:25.456 INFO:tasks.workunit.client.1.smithi129.stdout:2/17: readlink d1/l6 0 2024-09-21T08:02:25.456 INFO:tasks.workunit.client.1.smithi129.stdout:2/18: write d1/f4 [2195148,93020] 0 2024-09-21T08:02:25.457 INFO:tasks.workunit.client.1.smithi129.stdout:2/19: chown l0 16174232 1 2024-09-21T08:02:25.457 INFO:tasks.workunit.client.1.smithi129.stdout:1/36: mknod d1/c13 0 2024-09-21T08:02:25.458 INFO:tasks.workunit.client.1.smithi129.stdout:2/20: fsync d1/f2 0 2024-09-21T08:02:25.460 INFO:tasks.workunit.client.1.smithi129.stdout:2/21: creat d1/f8 x:0 0 0 2024-09-21T08:02:25.485 INFO:tasks.workunit.client.1.smithi129.stdout:8/43: truncate d0/d6/d7/fb 994718 0 2024-09-21T08:02:25.485 INFO:tasks.workunit.client.1.smithi129.stdout:8/44: chown d0/d6/d7/fb 532815711 1 2024-09-21T08:02:25.486 INFO:tasks.workunit.client.1.smithi129.stdout:8/45: rename d0/d6/ca to d0/d6/cd 0 2024-09-21T08:02:25.487 INFO:tasks.workunit.client.1.smithi129.stdout:8/46: creat d0/fe x:0 0 0 2024-09-21T08:02:25.488 INFO:tasks.workunit.client.1.smithi129.stdout:2/22: dwrite d1/f5 [0,4194304] 0 2024-09-21T08:02:25.494 INFO:tasks.workunit.client.0.smithi107.stdout:6/22: mknod d2/c5 0 2024-09-21T08:02:25.494 INFO:tasks.workunit.client.0.smithi107.stdout:6/23: creat d2/d3/f6 x:0 0 0 2024-09-21T08:02:25.495 INFO:tasks.workunit.client.0.smithi107.stdout:5/39: unlink c2 0 2024-09-21T08:02:25.498 INFO:tasks.workunit.client.0.smithi107.stdout:7/23: getdents . 0 2024-09-21T08:02:25.500 INFO:tasks.workunit.client.0.smithi107.stdout:7/24: mkdir d7 0 2024-09-21T08:02:25.501 INFO:tasks.workunit.client.0.smithi107.stdout:9/30: truncate f3 2689608 0 2024-09-21T08:02:25.503 INFO:tasks.workunit.client.0.smithi107.stdout:7/25: chown f2 70038 1 2024-09-21T08:02:25.504 INFO:tasks.workunit.client.1.smithi129.stdout:0/8: sync 2024-09-21T08:02:25.504 INFO:tasks.workunit.client.1.smithi129.stdout:5/18: sync 2024-09-21T08:02:25.504 INFO:tasks.workunit.client.1.smithi129.stdout:0/9: truncate - no filename 2024-09-21T08:02:25.504 INFO:tasks.workunit.client.1.smithi129.stdout:0/10: fsync - no filename 2024-09-21T08:02:25.505 INFO:tasks.workunit.client.1.smithi129.stdout:0/11: dwrite - no filename 2024-09-21T08:02:25.505 INFO:tasks.workunit.client.1.smithi129.stdout:0/12: chown . 18 1 2024-09-21T08:02:25.505 INFO:tasks.workunit.client.1.smithi129.stdout:0/13: write - no filename 2024-09-21T08:02:25.505 INFO:tasks.workunit.client.1.smithi129.stdout:5/19: creat d2/f5 x:0 0 0 2024-09-21T08:02:25.505 INFO:tasks.workunit.client.1.smithi129.stdout:5/20: truncate d2/f3 307268 0 2024-09-21T08:02:25.505 INFO:tasks.workunit.client.0.smithi107.stdout:7/26: fsync f3 0 2024-09-21T08:02:25.505 INFO:tasks.workunit.client.0.smithi107.stdout:5/40: read d7/fa [1230263,129149] 0 2024-09-21T08:02:25.506 INFO:tasks.workunit.client.0.smithi107.stdout:5/41: stat d7/fa 0 2024-09-21T08:02:25.506 INFO:tasks.workunit.client.1.smithi129.stdout:0/14: creat f0 x:0 0 0 2024-09-21T08:02:25.509 INFO:tasks.workunit.client.0.smithi107.stdout:7/27: rename f2 to d7/f8 0 2024-09-21T08:02:25.509 INFO:tasks.workunit.client.0.smithi107.stdout:7/28: chown f3 47 1 2024-09-21T08:02:25.509 INFO:tasks.workunit.client.0.smithi107.stdout:7/29: rename d7 to d7/d9 22 2024-09-21T08:02:25.510 INFO:tasks.workunit.client.1.smithi129.stdout:5/21: mknod d2/c6 0 2024-09-21T08:02:25.511 INFO:tasks.workunit.client.1.smithi129.stdout:4/5: getdents . 0 2024-09-21T08:02:25.511 INFO:tasks.workunit.client.1.smithi129.stdout:5/22: dread d2/f3 [0,4194304] 0 2024-09-21T08:02:25.511 INFO:tasks.workunit.client.1.smithi129.stdout:5/23: chown d2/f4 2997 1 2024-09-21T08:02:25.512 INFO:tasks.workunit.client.1.smithi129.stdout:7/29: rmdir d0 39 2024-09-21T08:02:25.513 INFO:tasks.workunit.client.1.smithi129.stdout:0/15: mkdir d1 0 2024-09-21T08:02:25.514 INFO:tasks.workunit.client.1.smithi129.stdout:4/6: creat f4 x:0 0 0 2024-09-21T08:02:25.515 INFO:tasks.workunit.client.0.smithi107.stdout:6/24: dwrite d2/d3/f6 [0,4194304] 0 2024-09-21T08:02:25.515 INFO:tasks.workunit.client.1.smithi129.stdout:5/24: symlink d2/l7 0 2024-09-21T08:02:25.515 INFO:tasks.workunit.client.1.smithi129.stdout:5/25: readlink d2/l7 0 2024-09-21T08:02:25.515 INFO:tasks.workunit.client.1.smithi129.stdout:5/26: fsync f1 0 2024-09-21T08:02:25.517 INFO:tasks.workunit.client.1.smithi129.stdout:0/16: rmdir d1 0 2024-09-21T08:02:25.517 INFO:tasks.workunit.client.1.smithi129.stdout:0/17: rmdir - no directory 2024-09-21T08:02:25.520 INFO:tasks.workunit.client.1.smithi129.stdout:4/7: unlink f4 0 2024-09-21T08:02:25.524 INFO:tasks.workunit.client.1.smithi129.stdout:3/18: fsync d3/f4 0 2024-09-21T08:02:25.524 INFO:tasks.workunit.client.1.smithi129.stdout:3/19: dread - d3/f4 zero size 2024-09-21T08:02:25.525 INFO:tasks.workunit.client.0.smithi107.stdout:6/25: write d2/d3/f6 [3069952,77405] 0 2024-09-21T08:02:25.525 INFO:tasks.workunit.client.0.smithi107.stdout:6/26: write d2/d3/f6 [608027,11271] 0 2024-09-21T08:02:25.525 INFO:tasks.workunit.client.0.smithi107.stdout:5/42: dwrite d7/f8 [0,4194304] 0 2024-09-21T08:02:25.526 INFO:tasks.workunit.client.1.smithi129.stdout:7/30: rename d0/f3 to d0/fe 0 2024-09-21T08:02:25.528 INFO:tasks.workunit.client.1.smithi129.stdout:4/8: mkdir d5 0 2024-09-21T08:02:25.533 INFO:tasks.workunit.client.1.smithi129.stdout:3/20: rename d3/c6 to d3/c7 0 2024-09-21T08:02:25.533 INFO:tasks.workunit.client.1.smithi129.stdout:7/31: chown d0/f5 1824745 1 2024-09-21T08:02:25.535 INFO:tasks.workunit.client.1.smithi129.stdout:6/21: truncate f3 731621 0 2024-09-21T08:02:25.535 INFO:tasks.workunit.client.0.smithi107.stdout:5/43: chown c5 42133344 1 2024-09-21T08:02:25.535 INFO:tasks.workunit.client.0.smithi107.stdout:5/44: chown d7/c9 51 1 2024-09-21T08:02:25.537 INFO:tasks.workunit.client.1.smithi129.stdout:4/9: write f2 [684518,114580] 0 2024-09-21T08:02:25.537 INFO:tasks.workunit.client.1.smithi129.stdout:9/14: dread f0 [0,4194304] 0 2024-09-21T08:02:25.538 INFO:tasks.workunit.client.1.smithi129.stdout:3/21: rename l1 to d3/l8 0 2024-09-21T08:02:25.541 INFO:tasks.workunit.client.0.smithi107.stdout:5/45: dread d7/fa [0,4194304] 0 2024-09-21T08:02:25.541 INFO:tasks.workunit.client.1.smithi129.stdout:6/22: dread - f4 zero size 2024-09-21T08:02:25.542 INFO:tasks.workunit.client.1.smithi129.stdout:1/37: getdents d1/d4 0 2024-09-21T08:02:25.543 INFO:tasks.workunit.client.1.smithi129.stdout:4/10: mkdir d5/d6 0 2024-09-21T08:02:25.546 INFO:tasks.workunit.client.1.smithi129.stdout:9/15: mknod c3 0 2024-09-21T08:02:25.549 INFO:tasks.workunit.client.1.smithi129.stdout:7/32: symlink d0/lf 0 2024-09-21T08:02:25.549 INFO:tasks.workunit.client.1.smithi129.stdout:7/33: write d0/fe [4596108,79573] 0 2024-09-21T08:02:25.549 INFO:tasks.workunit.client.1.smithi129.stdout:7/34: write d0/f5 [424524,113815] 0 2024-09-21T08:02:25.549 INFO:tasks.workunit.client.1.smithi129.stdout:7/35: chown d0/f5 120870738 1 2024-09-21T08:02:25.550 INFO:tasks.workunit.client.1.smithi129.stdout:2/23: rmdir d1 39 2024-09-21T08:02:25.550 INFO:tasks.workunit.client.1.smithi129.stdout:6/23: chown l1 10483 1 2024-09-21T08:02:25.550 INFO:tasks.workunit.client.1.smithi129.stdout:5/27: dwrite d2/f5 [0,4194304] 0 2024-09-21T08:02:25.550 INFO:tasks.workunit.client.1.smithi129.stdout:2/24: write d1/f2 [1117977,85088] 0 2024-09-21T08:02:25.550 INFO:tasks.workunit.client.1.smithi129.stdout:5/28: chown d2 40930403 1 2024-09-21T08:02:25.550 INFO:tasks.workunit.client.1.smithi129.stdout:5/29: readlink d2/l7 0 2024-09-21T08:02:25.550 INFO:tasks.workunit.client.1.smithi129.stdout:5/30: truncate d2/f4 518467 0 2024-09-21T08:02:25.551 INFO:tasks.workunit.client.1.smithi129.stdout:5/31: write f1 [50094,122282] 0 2024-09-21T08:02:25.551 INFO:tasks.workunit.client.1.smithi129.stdout:5/32: creat d2/f8 x:0 0 0 2024-09-21T08:02:25.552 INFO:tasks.workunit.client.1.smithi129.stdout:9/16: creat f4 x:0 0 0 2024-09-21T08:02:25.552 INFO:tasks.workunit.client.0.smithi107.stdout:6/27: dwrite d2/d3/f4 [0,4194304] 0 2024-09-21T08:02:25.554 INFO:tasks.workunit.client.1.smithi129.stdout:0/18: dwrite f0 [0,4194304] 0 2024-09-21T08:02:25.554 INFO:tasks.workunit.client.1.smithi129.stdout:0/19: fdatasync f0 0 2024-09-21T08:02:25.554 INFO:tasks.workunit.client.1.smithi129.stdout:0/20: creat f2 x:0 0 0 2024-09-21T08:02:25.556 INFO:tasks.workunit.client.1.smithi129.stdout:9/17: symlink l5 0 2024-09-21T08:02:25.556 INFO:tasks.workunit.client.1.smithi129.stdout:9/18: truncate f0 568723 0 2024-09-21T08:02:25.558 INFO:tasks.workunit.client.0.smithi107.stdout:5/46: read d7/f8 [2385308,42247] 0 2024-09-21T08:02:25.560 INFO:tasks.workunit.client.1.smithi129.stdout:9/19: mknod c6 0 2024-09-21T08:02:25.562 INFO:tasks.workunit.client.1.smithi129.stdout:1/38: dwrite d1/d4/f5 [0,4194304] 0 2024-09-21T08:02:25.562 INFO:tasks.workunit.client.1.smithi129.stdout:1/39: fsync d1/f12 0 2024-09-21T08:02:25.563 INFO:tasks.workunit.client.1.smithi129.stdout:9/20: symlink l7 0 2024-09-21T08:02:25.563 INFO:tasks.workunit.client.1.smithi129.stdout:2/25: dread d1/f5 [0,4194304] 0 2024-09-21T08:02:25.565 INFO:tasks.workunit.client.0.smithi107.stdout:5/47: dread d7/fa [0,4194304] 0 2024-09-21T08:02:25.566 INFO:tasks.workunit.client.1.smithi129.stdout:5/33: write d2/f5 [2332902,112047] 0 2024-09-21T08:02:25.568 INFO:tasks.workunit.client.1.smithi129.stdout:4/11: dread f2 [0,4194304] 0 2024-09-21T08:02:25.570 INFO:tasks.workunit.client.0.smithi107.stdout:5/48: mkdir d7/dd 0 2024-09-21T08:02:25.572 INFO:tasks.workunit.client.1.smithi129.stdout:1/40: symlink d1/l14 0 2024-09-21T08:02:25.575 INFO:tasks.workunit.client.1.smithi129.stdout:9/21: rename l5 to l8 0 2024-09-21T08:02:25.575 INFO:tasks.workunit.client.1.smithi129.stdout:9/22: write f0 [1062451,86922] 0 2024-09-21T08:02:25.575 INFO:tasks.workunit.client.1.smithi129.stdout:9/23: write f4 [82782,35542] 0 2024-09-21T08:02:25.577 INFO:tasks.workunit.client.0.smithi107.stdout:5/49: rename d7/dd to d7/de 0 2024-09-21T08:02:25.580 INFO:tasks.workunit.client.1.smithi129.stdout:1/41: write d1/d4/fa [187638,117751] 0 2024-09-21T08:02:25.580 INFO:tasks.workunit.client.1.smithi129.stdout:2/26: rename d1/l6 to d1/l9 0 2024-09-21T08:02:25.583 INFO:tasks.workunit.client.1.smithi129.stdout:5/34: mknod d2/c9 0 2024-09-21T08:02:25.583 INFO:tasks.workunit.client.1.smithi129.stdout:5/35: write d2/f8 [457441,122283] 0 2024-09-21T08:02:25.583 INFO:tasks.workunit.client.1.smithi129.stdout:6/24: dwrite f4 [0,4194304] 0 2024-09-21T08:02:25.584 INFO:tasks.workunit.client.0.smithi107.stdout:5/50: creat d7/ff x:0 0 0 2024-09-21T08:02:25.586 INFO:tasks.workunit.client.1.smithi129.stdout:2/27: symlink d1/la 0 2024-09-21T08:02:25.588 INFO:tasks.workunit.client.0.smithi107.stdout:5/51: creat d7/de/f10 x:0 0 0 2024-09-21T08:02:25.588 INFO:tasks.workunit.client.0.smithi107.stdout:5/52: creat d7/f11 x:0 0 0 2024-09-21T08:02:25.589 INFO:tasks.workunit.client.1.smithi129.stdout:5/36: rename d2/l7 to d2/la 0 2024-09-21T08:02:25.590 INFO:tasks.workunit.client.0.smithi107.stdout:9/31: write f3 [3224405,54841] 0 2024-09-21T08:02:25.590 INFO:tasks.workunit.client.0.smithi107.stdout:9/32: rmdir - no directory 2024-09-21T08:02:25.591 INFO:tasks.workunit.client.0.smithi107.stdout:9/33: write fa [1217550,78142] 0 2024-09-21T08:02:25.591 INFO:tasks.workunit.client.0.smithi107.stdout:9/34: stat c2 0 2024-09-21T08:02:25.591 INFO:tasks.workunit.client.0.smithi107.stdout:9/35: fdatasync f7 0 2024-09-21T08:02:25.591 INFO:tasks.workunit.client.0.smithi107.stdout:9/36: creat fb x:0 0 0 2024-09-21T08:02:25.591 INFO:tasks.workunit.client.0.smithi107.stdout:9/37: write fb [761733,20465] 0 2024-09-21T08:02:25.592 INFO:tasks.workunit.client.0.smithi107.stdout:7/30: getdents d7 0 2024-09-21T08:02:25.592 INFO:tasks.workunit.client.0.smithi107.stdout:7/31: getdents d7 0 2024-09-21T08:02:25.593 INFO:tasks.workunit.client.1.smithi129.stdout:6/25: chown f5 12634 1 2024-09-21T08:02:25.593 INFO:tasks.workunit.client.1.smithi129.stdout:6/26: fdatasync f5 0 2024-09-21T08:02:25.594 INFO:tasks.workunit.client.1.smithi129.stdout:1/42: rmdir d1/d9 39 2024-09-21T08:02:25.597 INFO:tasks.workunit.client.1.smithi129.stdout:2/28: symlink d1/lb 0 2024-09-21T08:02:25.597 INFO:tasks.workunit.client.1.smithi129.stdout:7/36: dwrite d0/fe [0,4194304] 0 2024-09-21T08:02:25.599 INFO:tasks.workunit.client.0.smithi107.stdout:7/32: link d7/f8 d7/fa 0 2024-09-21T08:02:25.599 INFO:tasks.workunit.client.0.smithi107.stdout:7/33: fsync f3 0 2024-09-21T08:02:25.606 INFO:tasks.workunit.client.1.smithi129.stdout:4/12: dwrite f2 [0,4194304] 0 2024-09-21T08:02:25.606 INFO:tasks.workunit.client.1.smithi129.stdout:8/47: dwrite d0/d6/d7/fb [0,4194304] 0 2024-09-21T08:02:25.606 INFO:tasks.workunit.client.1.smithi129.stdout:8/48: write d0/fe [60843,17790] 0 2024-09-21T08:02:25.606 INFO:tasks.workunit.client.0.smithi107.stdout:7/34: creat d7/fb x:0 0 0 2024-09-21T08:02:25.607 INFO:tasks.workunit.client.1.smithi129.stdout:6/27: mknod c6 0 2024-09-21T08:02:25.607 INFO:tasks.workunit.client.1.smithi129.stdout:6/28: chown c6 8869356 1 2024-09-21T08:02:25.608 INFO:tasks.workunit.client.1.smithi129.stdout:3/22: rmdir d3 39 2024-09-21T08:02:25.610 INFO:tasks.workunit.client.1.smithi129.stdout:4/13: creat d5/d6/f7 x:0 0 0 2024-09-21T08:02:25.611 INFO:tasks.workunit.client.0.smithi107.stdout:7/35: rename d7/fa to d7/fc 0 2024-09-21T08:02:25.612 INFO:tasks.workunit.client.1.smithi129.stdout:1/43: dread d1/d4/f5 [0,4194304] 0 2024-09-21T08:02:25.614 INFO:tasks.workunit.client.1.smithi129.stdout:2/29: write d1/f4 [3220578,44808] 0 2024-09-21T08:02:25.614 INFO:tasks.workunit.client.1.smithi129.stdout:3/23: mknod d3/c9 0 2024-09-21T08:02:25.615 INFO:tasks.workunit.client.1.smithi129.stdout:4/14: mknod d5/c8 0 2024-09-21T08:02:25.616 INFO:tasks.workunit.client.1.smithi129.stdout:8/49: getdents d0 0 2024-09-21T08:02:25.619 INFO:tasks.workunit.client.1.smithi129.stdout:1/44: rename d1/d4/f5 to d1/f15 0 2024-09-21T08:02:25.619 INFO:tasks.workunit.client.1.smithi129.stdout:1/45: truncate d1/fd 289335 0 2024-09-21T08:02:25.620 INFO:tasks.workunit.client.1.smithi129.stdout:2/30: mkdir d1/dc 0 2024-09-21T08:02:25.622 INFO:tasks.workunit.client.1.smithi129.stdout:3/24: stat d3/l8 0 2024-09-21T08:02:25.622 INFO:tasks.workunit.client.1.smithi129.stdout:3/25: write d3/f5 [342243,17190] 0 2024-09-21T08:02:25.622 INFO:tasks.workunit.client.1.smithi129.stdout:3/26: chown d3/f5 1059 1 2024-09-21T08:02:25.622 INFO:tasks.workunit.client.1.smithi129.stdout:0/21: fsync f2 0 2024-09-21T08:02:25.622 INFO:tasks.workunit.client.1.smithi129.stdout:0/22: truncate f2 369189 0 2024-09-21T08:02:25.622 INFO:tasks.workunit.client.1.smithi129.stdout:0/23: write f2 [350042,48446] 0 2024-09-21T08:02:25.622 INFO:tasks.workunit.client.1.smithi129.stdout:4/15: symlink d5/d6/l9 0 2024-09-21T08:02:25.622 INFO:tasks.workunit.client.1.smithi129.stdout:4/16: creat d5/d6/fa x:0 0 0 2024-09-21T08:02:25.623 INFO:tasks.workunit.client.1.smithi129.stdout:9/24: dwrite f4 [0,4194304] 0 2024-09-21T08:02:25.623 INFO:tasks.workunit.client.1.smithi129.stdout:9/25: creat f9 x:0 0 0 2024-09-21T08:02:25.624 INFO:tasks.workunit.client.1.smithi129.stdout:1/46: mkdir d1/d16 0 2024-09-21T08:02:25.626 INFO:tasks.workunit.client.1.smithi129.stdout:3/27: mkdir d3/da 0 2024-09-21T08:02:25.626 INFO:tasks.workunit.client.1.smithi129.stdout:7/37: dwrite d0/f8 [0,4194304] 0 2024-09-21T08:02:25.634 INFO:tasks.workunit.client.1.smithi129.stdout:9/26: write f4 [3195424,28860] 0 2024-09-21T08:02:25.635 INFO:tasks.workunit.client.1.smithi129.stdout:9/27: readlink l7 0 2024-09-21T08:02:25.638 INFO:tasks.workunit.client.0.smithi107.stdout:5/53: rmdir d7/de 39 2024-09-21T08:02:25.640 INFO:tasks.workunit.client.1.smithi129.stdout:3/28: mknod d3/da/cb 0 2024-09-21T08:02:25.640 INFO:tasks.workunit.client.1.smithi129.stdout:3/29: chown d3/da 1637746 1 2024-09-21T08:02:25.640 INFO:tasks.workunit.client.1.smithi129.stdout:3/30: chown d3/da 109890 1 2024-09-21T08:02:25.644 INFO:tasks.workunit.client.0.smithi107.stdout:4/21: truncate f0 2592564 0 2024-09-21T08:02:25.646 INFO:tasks.workunit.client.1.smithi129.stdout:4/17: dwrite d5/d6/f7 [0,4194304] 0 2024-09-21T08:02:25.646 INFO:tasks.workunit.client.1.smithi129.stdout:5/37: getdents d2 0 2024-09-21T08:02:25.646 INFO:tasks.workunit.client.1.smithi129.stdout:8/50: dwrite d0/fe [0,4194304] 0 2024-09-21T08:02:25.647 INFO:tasks.workunit.client.1.smithi129.stdout:9/28: mknod ca 0 2024-09-21T08:02:25.649 INFO:tasks.workunit.client.1.smithi129.stdout:3/31: mkdir d3/da/dc 0 2024-09-21T08:02:25.650 INFO:tasks.workunit.client.0.smithi107.stdout:5/54: getdents d7 0 2024-09-21T08:02:25.650 INFO:tasks.workunit.client.0.smithi107.stdout:5/55: dread - d7/de/f10 zero size 2024-09-21T08:02:25.652 INFO:tasks.workunit.client.1.smithi129.stdout:7/38: mknod d0/c10 0 2024-09-21T08:02:25.652 INFO:tasks.workunit.client.1.smithi129.stdout:7/39: stat d0/f8 0 2024-09-21T08:02:25.653 INFO:tasks.workunit.client.0.smithi107.stdout:5/56: link d7/cc d7/de/c12 0 2024-09-21T08:02:25.653 INFO:tasks.workunit.client.0.smithi107.stdout:9/38: getdents . 0 2024-09-21T08:02:25.654 INFO:tasks.workunit.client.0.smithi107.stdout:9/39: write fa [816205,52717] 0 2024-09-21T08:02:25.656 INFO:tasks.workunit.client.0.smithi107.stdout:5/57: rmdir d7/de 39 2024-09-21T08:02:25.656 INFO:tasks.workunit.client.0.smithi107.stdout:5/58: dread - d7/f11 zero size 2024-09-21T08:02:25.656 INFO:tasks.workunit.client.0.smithi107.stdout:5/59: fsync d7/f8 0 2024-09-21T08:02:25.657 INFO:tasks.workunit.client.0.smithi107.stdout:5/60: write d7/de/f10 [520508,35104] 0 2024-09-21T08:02:25.659 INFO:tasks.workunit.client.0.smithi107.stdout:9/40: unlink fb 0 2024-09-21T08:02:25.660 INFO:tasks.workunit.client.0.smithi107.stdout:9/41: fdatasync fa 0 2024-09-21T08:02:25.660 INFO:tasks.workunit.client.0.smithi107.stdout:9/42: stat c4 0 2024-09-21T08:02:25.660 INFO:tasks.workunit.client.1.smithi129.stdout:4/18: unlink d5/d6/fa 0 2024-09-21T08:02:25.661 INFO:tasks.workunit.client.1.smithi129.stdout:4/19: chown d5/d6 165 1 2024-09-21T08:02:25.661 INFO:tasks.workunit.client.1.smithi129.stdout:5/38: rmdir d2 39 2024-09-21T08:02:25.662 INFO:tasks.workunit.client.1.smithi129.stdout:9/29: dwrite f9 [0,4194304] 0 2024-09-21T08:02:25.662 INFO:tasks.workunit.client.1.smithi129.stdout:9/30: fdatasync f9 0 2024-09-21T08:02:25.663 INFO:tasks.workunit.client.1.smithi129.stdout:8/51: symlink d0/d6/d7/lf 0 2024-09-21T08:02:25.663 INFO:tasks.workunit.client.0.smithi107.stdout:7/36: rename d7/fc to d7/fd 0 2024-09-21T08:02:25.667 INFO:tasks.workunit.client.1.smithi129.stdout:3/32: chown l0 31 1 2024-09-21T08:02:25.668 INFO:tasks.workunit.client.1.smithi129.stdout:5/39: mknod d2/cb 0 2024-09-21T08:02:25.670 INFO:tasks.workunit.client.0.smithi107.stdout:7/37: mknod d7/ce 0 2024-09-21T08:02:25.671 INFO:tasks.workunit.client.1.smithi129.stdout:4/20: dread f2 [0,4194304] 0 2024-09-21T08:02:25.672 INFO:tasks.workunit.client.1.smithi129.stdout:9/31: mknod cb 0 2024-09-21T08:02:25.673 INFO:tasks.workunit.client.0.smithi107.stdout:7/38: dread - f4 zero size 2024-09-21T08:02:25.673 INFO:tasks.workunit.client.0.smithi107.stdout:7/39: fdatasync d7/fd 0 2024-09-21T08:02:25.674 INFO:tasks.workunit.client.1.smithi129.stdout:3/33: creat d3/da/dc/fd x:0 0 0 2024-09-21T08:02:25.674 INFO:tasks.workunit.client.1.smithi129.stdout:3/34: write d3/da/dc/fd [222231,128030] 0 2024-09-21T08:02:25.676 INFO:tasks.workunit.client.0.smithi107.stdout:7/40: stat d7/f8 0 2024-09-21T08:02:25.679 INFO:tasks.workunit.client.1.smithi129.stdout:2/31: truncate d1/f2 943504 0 2024-09-21T08:02:25.680 INFO:tasks.workunit.client.1.smithi129.stdout:3/35: symlink d3/da/le 0 2024-09-21T08:02:25.681 INFO:tasks.workunit.client.1.smithi129.stdout:9/32: dread f4 [0,4194304] 0 2024-09-21T08:02:25.681 INFO:tasks.workunit.client.1.smithi129.stdout:7/40: rename d0/f4 to d0/f11 0 2024-09-21T08:02:25.682 INFO:tasks.workunit.client.0.smithi107.stdout:7/41: symlink d7/lf 0 2024-09-21T08:02:25.682 INFO:tasks.workunit.client.0.smithi107.stdout:7/42: fdatasync f4 0 2024-09-21T08:02:25.683 INFO:tasks.workunit.client.1.smithi129.stdout:8/52: dwrite d0/d6/d7/fb [4194304,4194304] 0 2024-09-21T08:02:25.684 INFO:tasks.workunit.client.1.smithi129.stdout:2/32: mkdir d1/dc/dd 0 2024-09-21T08:02:25.685 INFO:tasks.workunit.client.0.smithi107.stdout:9/43: dwrite f7 [0,4194304] 0 2024-09-21T08:02:25.685 INFO:tasks.workunit.client.1.smithi129.stdout:3/36: creat d3/da/ff x:0 0 0 2024-09-21T08:02:25.685 INFO:tasks.workunit.client.1.smithi129.stdout:3/37: truncate d3/f4 530192 0 2024-09-21T08:02:25.687 INFO:tasks.workunit.client.1.smithi129.stdout:9/33: rename c3 to cc 0 2024-09-21T08:02:25.826 INFO:tasks.workunit.client.0.smithi107.stdout:9/44: symlink lc 0 2024-09-21T08:02:25.828 INFO:tasks.workunit.client.1.smithi129.stdout:7/41: dwrite d0/f5 [0,4194304] 0 2024-09-21T08:02:25.828 INFO:tasks.workunit.client.1.smithi129.stdout:7/42: readlink d0/lf 0 2024-09-21T08:02:25.837 INFO:tasks.workunit.client.1.smithi129.stdout:2/33: dwrite d1/f4 [0,4194304] 0 2024-09-21T08:02:25.837 INFO:tasks.workunit.client.1.smithi129.stdout:2/34: fsync d1/f8 0 2024-09-21T08:02:25.838 INFO:tasks.workunit.client.1.smithi129.stdout:2/35: creat d1/dc/dd/fe x:0 0 0 2024-09-21T08:02:25.840 INFO:tasks.workunit.client.1.smithi129.stdout:7/43: rename d0/c9 to d0/c12 0 2024-09-21T08:02:25.841 INFO:tasks.workunit.client.1.smithi129.stdout:7/44: stat d0/fe 0 2024-09-21T08:02:25.842 INFO:tasks.workunit.client.1.smithi129.stdout:7/45: mknod d0/c13 0 2024-09-21T08:02:25.845 INFO:tasks.workunit.client.1.smithi129.stdout:7/46: mknod d0/c14 0 2024-09-21T08:02:25.847 INFO:tasks.workunit.client.1.smithi129.stdout:7/47: creat d0/f15 x:0 0 0 2024-09-21T08:02:25.849 INFO:tasks.workunit.client.1.smithi129.stdout:4/21: truncate f2 2692389 0 2024-09-21T08:02:25.850 INFO:tasks.workunit.client.1.smithi129.stdout:4/22: symlink d5/lb 0 2024-09-21T08:02:25.899 INFO:tasks.workunit.client.0.smithi107.stdout:7/43: dwrite d7/fd [0,4194304] 0 2024-09-21T08:02:25.899 INFO:tasks.workunit.client.1.smithi129.stdout:8/53: dwrite d0/d6/d7/fb [4194304,4194304] 0 2024-09-21T08:02:25.900 INFO:tasks.workunit.client.0.smithi107.stdout:7/44: chown l6 126471 1 2024-09-21T08:02:25.900 INFO:tasks.workunit.client.0.smithi107.stdout:7/45: fsync d7/fd 0 2024-09-21T08:02:25.900 INFO:tasks.workunit.client.0.smithi107.stdout:7/46: dread - f4 zero size 2024-09-21T08:02:25.900 INFO:tasks.workunit.client.0.smithi107.stdout:7/47: fsync d7/f8 0 2024-09-21T08:02:25.901 INFO:tasks.workunit.client.1.smithi129.stdout:8/54: link d0/d6/cd d0/d6/c10 0 2024-09-21T08:02:25.903 INFO:tasks.workunit.client.1.smithi129.stdout:7/48: rename d0/f11 to d0/f16 0 2024-09-21T08:02:25.904 INFO:tasks.workunit.client.1.smithi129.stdout:2/36: dwrite d1/dc/dd/fe [0,4194304] 0 2024-09-21T08:02:25.906 INFO:tasks.workunit.client.0.smithi107.stdout:7/48: mkdir d7/d10 0 2024-09-21T08:02:25.906 INFO:tasks.workunit.client.1.smithi129.stdout:3/38: rmdir d3/da 39 2024-09-21T08:02:25.910 INFO:tasks.workunit.client.0.smithi107.stdout:7/49: rename d7/fb to d7/f11 0 2024-09-21T08:02:25.911 INFO:tasks.workunit.client.1.smithi129.stdout:7/49: write d0/f5 [4568170,86212] 0 2024-09-21T08:02:25.912 INFO:tasks.workunit.client.1.smithi129.stdout:2/37: creat d1/dc/ff x:0 0 0 2024-09-21T08:02:25.913 INFO:tasks.workunit.client.1.smithi129.stdout:8/55: write d0/d6/d7/fb [7282669,109182] 0 2024-09-21T08:02:25.914 INFO:tasks.workunit.client.1.smithi129.stdout:3/39: rename d3/c9 to d3/da/c10 0 2024-09-21T08:02:25.914 INFO:tasks.workunit.client.1.smithi129.stdout:3/40: fdatasync d3/da/ff 0 2024-09-21T08:02:25.914 INFO:tasks.workunit.client.1.smithi129.stdout:3/41: write d3/da/dc/fd [1018713,53049] 0 2024-09-21T08:02:25.915 INFO:tasks.workunit.client.0.smithi107.stdout:4/22: truncate f0 1530098 0 2024-09-21T08:02:25.915 INFO:tasks.workunit.client.0.smithi107.stdout:4/23: chown c5 16117 1 2024-09-21T08:02:25.917 INFO:tasks.workunit.client.1.smithi129.stdout:9/34: dwrite f4 [0,4194304] 0 2024-09-21T08:02:25.917 INFO:tasks.workunit.client.1.smithi129.stdout:9/35: rmdir - no directory 2024-09-21T08:02:25.918 INFO:tasks.workunit.client.0.smithi107.stdout:9/45: dwrite fa [0,4194304] 0 2024-09-21T08:02:25.921 INFO:tasks.workunit.client.0.smithi107.stdout:9/46: rename c4 to cd 0 2024-09-21T08:02:25.923 INFO:tasks.workunit.client.1.smithi129.stdout:2/38: write d1/dc/dd/fe [583735,119907] 0 2024-09-21T08:02:25.923 INFO:tasks.workunit.client.1.smithi129.stdout:2/39: chown d1 6168374 1 2024-09-21T08:02:25.923 INFO:tasks.workunit.client.1.smithi129.stdout:2/40: creat d1/dc/f10 x:0 0 0 2024-09-21T08:02:25.926 INFO:tasks.workunit.client.1.smithi129.stdout:7/50: link d0/f16 d0/f17 0 2024-09-21T08:02:25.928 INFO:tasks.workunit.client.0.smithi107.stdout:7/50: write d7/f8 [719021,80745] 0 2024-09-21T08:02:25.929 INFO:tasks.workunit.client.1.smithi129.stdout:9/36: dread f9 [0,4194304] 0 2024-09-21T08:02:25.929 INFO:tasks.workunit.client.1.smithi129.stdout:9/37: creat fd x:0 0 0 2024-09-21T08:02:25.929 INFO:tasks.workunit.client.1.smithi129.stdout:9/38: write f0 [1229117,24610] 0 2024-09-21T08:02:25.929 INFO:tasks.workunit.client.1.smithi129.stdout:2/41: mknod d1/dc/dd/c11 0 2024-09-21T08:02:25.929 INFO:tasks.workunit.client.1.smithi129.stdout:2/42: truncate d1/f2 1138497 0 2024-09-21T08:02:25.931 INFO:tasks.workunit.client.0.smithi107.stdout:7/51: link l6 d7/d10/l12 0 2024-09-21T08:02:25.935 INFO:tasks.workunit.client.1.smithi129.stdout:7/51: link d0/lf d0/l18 0 2024-09-21T08:02:25.935 INFO:tasks.workunit.client.1.smithi129.stdout:7/52: chown d0/c12 1641285 1 2024-09-21T08:02:25.935 INFO:tasks.workunit.client.1.smithi129.stdout:7/53: write d0/f17 [518921,2434] 0 2024-09-21T08:02:25.936 INFO:tasks.workunit.client.0.smithi107.stdout:4/24: write f0 [893850,65868] 0 2024-09-21T08:02:25.938 INFO:tasks.workunit.client.1.smithi129.stdout:2/43: write d1/f4 [1031372,60798] 0 2024-09-21T08:02:25.939 INFO:tasks.workunit.client.0.smithi107.stdout:7/52: link d7/fd d7/f13 0 2024-09-21T08:02:25.941 INFO:tasks.workunit.client.1.smithi129.stdout:3/42: dwrite d3/da/dc/fd [0,4194304] 0 2024-09-21T08:02:25.942 INFO:tasks.workunit.client.0.smithi107.stdout:7/53: link f4 d7/f14 0 2024-09-21T08:02:25.943 INFO:tasks.workunit.client.1.smithi129.stdout:7/54: symlink d0/l19 0 2024-09-21T08:02:25.943 INFO:tasks.workunit.client.1.smithi129.stdout:7/55: chown d0/fe 0 1 2024-09-21T08:02:25.945 INFO:tasks.workunit.client.0.smithi107.stdout:9/47: dwrite f3 [0,4194304] 0 2024-09-21T08:02:25.946 INFO:tasks.workunit.client.1.smithi129.stdout:3/43: mkdir d3/da/dc/d11 0 2024-09-21T08:02:25.948 INFO:tasks.workunit.client.1.smithi129.stdout:2/44: fsync d1/dc/f10 0 2024-09-21T08:02:25.948 INFO:tasks.workunit.client.1.smithi129.stdout:3/44: mknod d3/c12 0 2024-09-21T08:02:25.954 INFO:tasks.workunit.client.1.smithi129.stdout:7/56: rename d0/c14 to d0/c1a 0 2024-09-21T08:02:25.954 INFO:tasks.workunit.client.1.smithi129.stdout:7/57: fsync d0/fc 0 2024-09-21T08:02:25.954 INFO:tasks.workunit.client.1.smithi129.stdout:2/45: rename d1/f2 to d1/dc/f12 0 2024-09-21T08:02:25.955 INFO:tasks.workunit.client.0.smithi107.stdout:7/54: rename c5 to d7/c15 0 2024-09-21T08:02:25.956 INFO:tasks.workunit.client.0.smithi107.stdout:9/48: write fa [3353935,115173] 0 2024-09-21T08:02:25.958 INFO:tasks.workunit.client.1.smithi129.stdout:9/39: truncate f0 536190 0 2024-09-21T08:02:25.958 INFO:tasks.workunit.client.1.smithi129.stdout:9/40: readlink l7 0 2024-09-21T08:02:25.959 INFO:tasks.workunit.client.1.smithi129.stdout:2/46: dread d1/f5 [0,4194304] 0 2024-09-21T08:02:25.961 INFO:tasks.workunit.client.1.smithi129.stdout:7/58: link d0/f5 d0/f1b 0 2024-09-21T08:02:25.963 INFO:tasks.workunit.client.0.smithi107.stdout:9/49: mknod ce 0 2024-09-21T08:02:25.963 INFO:tasks.workunit.client.0.smithi107.stdout:7/55: mknod d7/c16 0 2024-09-21T08:02:25.965 INFO:tasks.workunit.client.0.smithi107.stdout:7/56: unlink l6 0 2024-09-21T08:02:25.966 INFO:tasks.workunit.client.0.smithi107.stdout:7/57: creat d7/d10/f17 x:0 0 0 2024-09-21T08:02:25.972 INFO:tasks.workunit.client.0.smithi107.stdout:7/58: mkdir d7/d18 0 2024-09-21T08:02:25.974 INFO:tasks.workunit.client.0.smithi107.stdout:7/59: creat d7/d18/f19 x:0 0 0 2024-09-21T08:02:25.974 INFO:tasks.workunit.client.0.smithi107.stdout:7/60: chown d7/ce 21786 1 2024-09-21T08:02:25.977 INFO:tasks.workunit.client.0.smithi107.stdout:9/50: dread f3 [0,4194304] 0 2024-09-21T08:02:25.979 INFO:tasks.workunit.client.1.smithi129.stdout:7/59: read d0/f5 [3799480,65407] 0 2024-09-21T08:02:25.979 INFO:tasks.workunit.client.1.smithi129.stdout:7/60: chown d0/c12 1890697 1 2024-09-21T08:02:25.979 INFO:tasks.workunit.client.1.smithi129.stdout:7/61: chown d0/l19 0 1 2024-09-21T08:02:25.979 INFO:tasks.workunit.client.1.smithi129.stdout:7/62: chown d0 5409 1 2024-09-21T08:02:25.979 INFO:tasks.workunit.client.1.smithi129.stdout:7/63: truncate d0/f17 743990 0 2024-09-21T08:02:25.979 INFO:tasks.workunit.client.1.smithi129.stdout:7/64: creat d0/f1c x:0 0 0 2024-09-21T08:02:25.986 INFO:tasks.workunit.client.1.smithi129.stdout:9/41: dwrite f4 [0,4194304] 0 2024-09-21T08:02:25.986 INFO:tasks.workunit.client.1.smithi129.stdout:2/47: dwrite d1/dc/dd/fe [0,4194304] 0 2024-09-21T08:02:25.986 INFO:tasks.workunit.client.0.smithi107.stdout:9/51: fsync fa 0 2024-09-21T08:02:25.987 INFO:tasks.workunit.client.0.smithi107.stdout:9/52: fdatasync f7 0 2024-09-21T08:02:25.987 INFO:tasks.workunit.client.0.smithi107.stdout:9/53: fsync f7 0 2024-09-21T08:02:25.988 INFO:tasks.workunit.client.1.smithi129.stdout:7/65: fsync d0/f5 0 2024-09-21T08:02:25.988 INFO:tasks.workunit.client.1.smithi129.stdout:7/66: readlink d0/l18 0 2024-09-21T08:02:25.990 INFO:tasks.workunit.client.1.smithi129.stdout:2/48: dread d1/dc/f12 [0,4194304] 0 2024-09-21T08:02:25.990 INFO:tasks.workunit.client.1.smithi129.stdout:2/49: chown d1 114 1 2024-09-21T08:02:25.991 INFO:tasks.workunit.client.0.smithi107.stdout:7/61: getdents d7/d10 0 2024-09-21T08:02:25.994 INFO:tasks.workunit.client.1.smithi129.stdout:2/50: truncate d1/f5 2713277 0 2024-09-21T08:02:25.995 INFO:tasks.workunit.client.1.smithi129.stdout:7/67: getdents d0 0 2024-09-21T08:02:25.997 INFO:tasks.workunit.client.0.smithi107.stdout:7/62: mknod d7/d10/c1a 0 2024-09-21T08:02:25.998 INFO:tasks.workunit.client.1.smithi129.stdout:7/68: stat d0/lb 0 2024-09-21T08:02:25.999 INFO:tasks.workunit.client.0.smithi107.stdout:7/63: rmdir d7/d10 39 2024-09-21T08:02:26.000 INFO:tasks.workunit.client.0.smithi107.stdout:9/54: dread f7 [0,4194304] 0 2024-09-21T08:02:26.000 INFO:tasks.workunit.client.0.smithi107.stdout:7/64: mknod d7/d18/c1b 0 2024-09-21T08:02:26.000 INFO:tasks.workunit.client.0.smithi107.stdout:7/65: dread - d7/f14 zero size 2024-09-21T08:02:26.000 INFO:tasks.workunit.client.0.smithi107.stdout:7/66: write d7/fd [5074605,84095] 0 2024-09-21T08:02:26.001 INFO:tasks.workunit.client.1.smithi129.stdout:7/69: rename d0/f1c to d0/f1d 0 2024-09-21T08:02:26.007 INFO:tasks.workunit.client.1.smithi129.stdout:9/42: dwrite f4 [0,4194304] 0 2024-09-21T08:02:26.007 INFO:tasks.workunit.client.1.smithi129.stdout:9/43: stat f9 0 2024-09-21T08:02:26.007 INFO:tasks.workunit.client.1.smithi129.stdout:9/44: readlink l8 0 2024-09-21T08:02:26.007 INFO:tasks.workunit.client.1.smithi129.stdout:9/45: truncate f9 4466100 0 2024-09-21T08:02:26.007 INFO:tasks.workunit.client.1.smithi129.stdout:9/46: chown cc 113056419 1 2024-09-21T08:02:26.007 INFO:tasks.workunit.client.1.smithi129.stdout:9/47: chown fd 13631 1 2024-09-21T08:02:26.010 INFO:tasks.workunit.client.0.smithi107.stdout:9/55: read f7 [174676,113283] 0 2024-09-21T08:02:26.011 INFO:tasks.workunit.client.0.smithi107.stdout:9/56: mknod cf 0 2024-09-21T08:02:26.011 INFO:tasks.workunit.client.0.smithi107.stdout:9/57: rmdir - no directory 2024-09-21T08:02:26.011 INFO:tasks.workunit.client.1.smithi129.stdout:2/51: dread d1/dc/dd/fe [0,4194304] 0 2024-09-21T08:02:26.015 INFO:tasks.workunit.client.0.smithi107.stdout:9/58: unlink ce 0 2024-09-21T08:02:26.016 INFO:tasks.workunit.client.0.smithi107.stdout:7/67: dwrite d7/d18/f19 [0,4194304] 0 2024-09-21T08:02:26.017 INFO:tasks.workunit.client.0.smithi107.stdout:9/59: creat f10 x:0 0 0 2024-09-21T08:02:26.017 INFO:tasks.workunit.client.0.smithi107.stdout:9/60: stat l6 0 2024-09-21T08:02:26.019 INFO:tasks.workunit.client.1.smithi129.stdout:2/52: rename d1/dc/dd to d1/d13 0 2024-09-21T08:02:26.019 INFO:tasks.workunit.client.1.smithi129.stdout:2/53: write d1/f5 [683317,117203] 0 2024-09-21T08:02:26.022 INFO:tasks.workunit.client.0.smithi107.stdout:9/61: mkdir d11 0 2024-09-21T08:02:26.032 INFO:tasks.workunit.client.0.smithi107.stdout:9/62: dread f3 [0,4194304] 0 2024-09-21T08:02:26.033 INFO:tasks.workunit.client.0.smithi107.stdout:9/63: symlink d11/l12 0 2024-09-21T08:02:26.034 INFO:tasks.workunit.client.0.smithi107.stdout:9/64: symlink d11/l13 0 2024-09-21T08:02:26.035 INFO:tasks.workunit.client.0.smithi107.stdout:9/65: rmdir d11 39 2024-09-21T08:02:26.036 INFO:tasks.workunit.client.0.smithi107.stdout:9/66: mknod d11/c14 0 2024-09-21T08:02:26.036 INFO:tasks.workunit.client.0.smithi107.stdout:9/67: readlink l6 0 2024-09-21T08:02:26.036 INFO:tasks.workunit.client.0.smithi107.stdout:9/68: write f10 [256559,74537] 0 2024-09-21T08:02:26.036 INFO:tasks.workunit.client.0.smithi107.stdout:9/69: truncate f10 1065411 0 2024-09-21T08:02:26.039 INFO:tasks.workunit.client.1.smithi129.stdout:2/54: dwrite d1/dc/f10 [0,4194304] 0 2024-09-21T08:02:26.041 INFO:tasks.workunit.client.1.smithi129.stdout:2/55: unlink d1/l9 0 2024-09-21T08:02:26.042 INFO:tasks.workunit.client.0.smithi107.stdout:9/70: write f3 [879663,124319] 0 2024-09-21T08:02:26.042 INFO:tasks.workunit.client.0.smithi107.stdout:7/68: dwrite d7/fd [4194304,4194304] 0 2024-09-21T08:02:26.043 INFO:tasks.workunit.client.1.smithi129.stdout:2/56: creat d1/d13/f14 x:0 0 0 2024-09-21T08:02:26.046 INFO:tasks.workunit.client.1.smithi129.stdout:2/57: link d1/d13/f14 d1/dc/f15 0 2024-09-21T08:02:26.046 INFO:tasks.workunit.client.1.smithi129.stdout:2/58: write d1/f5 [2004739,26426] 0 2024-09-21T08:02:26.049 INFO:tasks.workunit.client.0.smithi107.stdout:7/69: rename d7/lf to d7/d10/l1c 0 2024-09-21T08:02:26.051 INFO:tasks.workunit.client.0.smithi107.stdout:7/70: creat d7/d10/f1d x:0 0 0 2024-09-21T08:02:26.077 INFO:tasks.workunit.client.0.smithi107.stdout:7/71: dwrite d7/f11 [0,4194304] 0 2024-09-21T08:02:26.077 INFO:tasks.workunit.client.0.smithi107.stdout:7/72: fsync f3 0 2024-09-21T08:02:26.077 INFO:tasks.workunit.client.1.smithi129.stdout:2/59: dwrite d1/dc/f10 [0,4194304] 0 2024-09-21T08:02:26.077 INFO:tasks.workunit.client.1.smithi129.stdout:2/60: creat d1/dc/f16 x:0 0 0 2024-09-21T08:02:26.077 INFO:tasks.workunit.client.1.smithi129.stdout:2/61: chown d1/dc/ff 4585356 1 2024-09-21T08:02:26.077 INFO:tasks.workunit.client.1.smithi129.stdout:2/62: readlink d1/la 0 2024-09-21T08:02:26.083 INFO:tasks.workunit.client.0.smithi107.stdout:7/73: rmdir d7 39 2024-09-21T08:02:26.083 INFO:tasks.workunit.client.0.smithi107.stdout:7/74: truncate f3 1037519 0 2024-09-21T08:02:26.085 INFO:tasks.workunit.client.0.smithi107.stdout:7/75: rename d7/d10/c1a to d7/d18/c1e 0 2024-09-21T08:02:26.085 INFO:tasks.workunit.client.0.smithi107.stdout:7/76: chown d7/d18/c1e 522 1 2024-09-21T08:02:26.087 INFO:tasks.workunit.client.0.smithi107.stdout:7/77: readlink d7/d10/l12 0 2024-09-21T08:02:26.088 INFO:tasks.workunit.client.0.smithi107.stdout:7/78: mknod d7/d18/c1f 0 2024-09-21T08:02:26.089 INFO:tasks.workunit.client.0.smithi107.stdout:7/79: rmdir d7 39 2024-09-21T08:02:26.111 INFO:tasks.workunit.client.1.smithi129.stdout:2/63: dwrite d1/f5 [0,4194304] 0 2024-09-21T08:02:26.113 INFO:tasks.workunit.client.1.smithi129.stdout:2/64: creat d1/f17 x:0 0 0 2024-09-21T08:02:26.113 INFO:tasks.workunit.client.1.smithi129.stdout:2/65: truncate d1/dc/f15 301070 0 2024-09-21T08:02:26.119 INFO:tasks.workunit.client.0.smithi107.stdout:7/80: dwrite d7/f11 [0,4194304] 0 2024-09-21T08:02:26.130 INFO:tasks.workunit.client.0.smithi107.stdout:7/81: dread d7/f11 [0,4194304] 0 2024-09-21T08:02:26.130 INFO:tasks.workunit.client.0.smithi107.stdout:7/82: read - d7/d10/f1d zero size 2024-09-21T08:02:26.146 INFO:tasks.workunit.client.0.smithi107.stdout:7/83: dwrite d7/f13 [4194304,4194304] 0 2024-09-21T08:02:26.147 INFO:tasks.workunit.client.0.smithi107.stdout:7/84: creat d7/d10/f20 x:0 0 0 2024-09-21T08:02:26.235 INFO:tasks.workunit.client.0.smithi107.stdout:7/85: dwrite d7/d18/f19 [0,4194304] 0 2024-09-21T08:02:26.237 INFO:tasks.workunit.client.0.smithi107.stdout:7/86: link f4 d7/d10/f21 0 2024-09-21T08:02:26.237 INFO:tasks.workunit.client.0.smithi107.stdout:7/87: chown d7/d18/f19 17 1 2024-09-21T08:02:26.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:25 smithi129 ceph-mon[34472]: [21/Sep/2024:08:02:24] ENGINE Serving on https://172.21.15.129:7150 2024-09-21T08:02:26.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:25 smithi129 ceph-mon[34472]: [21/Sep/2024:08:02:24] ENGINE Bus STARTED 2024-09-21T08:02:26.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:25 smithi129 ceph-mon[34472]: [21/Sep/2024:08:02:24] ENGINE Error in HTTPServer.serve 2024-09-21T08:02:26.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Traceback (most recent call last): 2024-09-21T08:02:26.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T08:02:26.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: self._connections.run(self.expiration_interval) 2024-09-21T08:02:26.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T08:02:26.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: self._run(expiration_interval) 2024-09-21T08:02:26.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T08:02:26.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T08:02:26.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T08:02:26.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T08:02:26.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T08:02:26.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: s = self.context.wrap_socket( 2024-09-21T08:02:26.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T08:02:26.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: return self.sslsocket_class._create( 2024-09-21T08:02:26.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T08:02:26.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: self.do_handshake() 2024-09-21T08:02:26.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T08:02:26.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: self._sslobj.do_handshake() 2024-09-21T08:02:26.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T08:02:26.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:25 smithi107 ceph-mon[27622]: [21/Sep/2024:08:02:24] ENGINE Serving on https://172.21.15.129:7150 2024-09-21T08:02:26.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:25 smithi107 ceph-mon[27622]: [21/Sep/2024:08:02:24] ENGINE Bus STARTED 2024-09-21T08:02:26.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:25 smithi107 ceph-mon[27622]: [21/Sep/2024:08:02:24] ENGINE Error in HTTPServer.serve 2024-09-21T08:02:26.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Traceback (most recent call last): 2024-09-21T08:02:26.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T08:02:26.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._connections.run(self.expiration_interval) 2024-09-21T08:02:26.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T08:02:26.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._run(expiration_interval) 2024-09-21T08:02:26.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T08:02:26.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T08:02:26.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T08:02:26.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T08:02:26.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T08:02:26.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: s = self.context.wrap_socket( 2024-09-21T08:02:26.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T08:02:26.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: return self.sslsocket_class._create( 2024-09-21T08:02:26.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T08:02:26.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self.do_handshake() 2024-09-21T08:02:26.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T08:02:26.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._sslobj.do_handshake() 2024-09-21T08:02:26.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T08:02:26.340 INFO:tasks.workunit.client.1.smithi129.stdout:5/40: sync 2024-09-21T08:02:26.340 INFO:tasks.workunit.client.1.smithi129.stdout:4/23: sync 2024-09-21T08:02:26.340 INFO:tasks.workunit.client.1.smithi129.stdout:7/70: sync 2024-09-21T08:02:26.340 INFO:tasks.workunit.client.1.smithi129.stdout:3/45: sync 2024-09-21T08:02:26.340 INFO:tasks.workunit.client.1.smithi129.stdout:2/66: sync 2024-09-21T08:02:26.340 INFO:tasks.workunit.client.1.smithi129.stdout:1/47: sync 2024-09-21T08:02:26.341 INFO:tasks.workunit.client.1.smithi129.stdout:6/29: sync 2024-09-21T08:02:26.341 INFO:tasks.workunit.client.1.smithi129.stdout:9/48: sync 2024-09-21T08:02:26.341 INFO:tasks.workunit.client.1.smithi129.stdout:1/48: fdatasync d1/d9/fe 0 2024-09-21T08:02:26.341 INFO:tasks.workunit.client.1.smithi129.stdout:8/56: sync 2024-09-21T08:02:26.341 INFO:tasks.workunit.client.1.smithi129.stdout:0/24: sync 2024-09-21T08:02:26.341 INFO:tasks.workunit.client.1.smithi129.stdout:2/67: write d1/dc/f12 [1941585,27584] 0 2024-09-21T08:02:26.341 INFO:tasks.workunit.client.1.smithi129.stdout:2/68: creat d1/dc/f18 x:0 0 0 2024-09-21T08:02:26.342 INFO:tasks.workunit.client.1.smithi129.stdout:5/41: read d2/f4 [451386,20669] 0 2024-09-21T08:02:26.342 INFO:tasks.workunit.client.1.smithi129.stdout:5/42: chown d2/f5 292538417 1 2024-09-21T08:02:26.342 INFO:tasks.workunit.client.1.smithi129.stdout:6/30: unlink l1 0 2024-09-21T08:02:26.342 INFO:tasks.workunit.client.1.smithi129.stdout:6/31: stat f4 0 2024-09-21T08:02:26.342 INFO:tasks.workunit.client.1.smithi129.stdout:9/49: rename l8 to le 0 2024-09-21T08:02:26.343 INFO:tasks.workunit.client.1.smithi129.stdout:9/50: rmdir - no directory 2024-09-21T08:02:26.343 INFO:tasks.workunit.client.1.smithi129.stdout:9/51: stat ca 0 2024-09-21T08:02:26.343 INFO:tasks.workunit.client.1.smithi129.stdout:9/52: creat ff x:0 0 0 2024-09-21T08:02:26.343 INFO:tasks.workunit.client.1.smithi129.stdout:4/24: dread f2 [0,4194304] 0 2024-09-21T08:02:26.345 INFO:tasks.workunit.client.1.smithi129.stdout:5/43: dread d2/f8 [0,4194304] 0 2024-09-21T08:02:26.345 INFO:tasks.workunit.client.1.smithi129.stdout:3/46: creat d3/f13 x:0 0 0 2024-09-21T08:02:26.345 INFO:tasks.workunit.client.1.smithi129.stdout:5/44: fsync d2/f8 0 2024-09-21T08:02:26.345 INFO:tasks.workunit.client.1.smithi129.stdout:5/45: chown d2/la 1 1 2024-09-21T08:02:26.345 INFO:tasks.workunit.client.1.smithi129.stdout:8/57: dread d0/d6/d7/fb [4194304,4194304] 0 2024-09-21T08:02:26.346 INFO:tasks.workunit.client.1.smithi129.stdout:8/58: chown d0/d6/c10 1646335 1 2024-09-21T08:02:26.346 INFO:tasks.workunit.client.1.smithi129.stdout:8/59: truncate d0/fe 4233545 0 2024-09-21T08:02:26.347 INFO:tasks.workunit.client.1.smithi129.stdout:1/49: unlink d1/l14 0 2024-09-21T08:02:26.347 INFO:tasks.workunit.client.1.smithi129.stdout:2/69: mkdir d1/dc/d19 0 2024-09-21T08:02:26.347 INFO:tasks.workunit.client.1.smithi129.stdout:1/50: write d1/d4/fa [2429783,58194] 0 2024-09-21T08:02:26.348 INFO:tasks.workunit.client.1.smithi129.stdout:7/71: mkdir d0/d1e 0 2024-09-21T08:02:26.348 INFO:tasks.workunit.client.1.smithi129.stdout:5/46: dread d2/f8 [0,4194304] 0 2024-09-21T08:02:26.350 INFO:tasks.workunit.client.1.smithi129.stdout:9/53: dread f9 [0,4194304] 0 2024-09-21T08:02:26.350 INFO:tasks.workunit.client.1.smithi129.stdout:9/54: read - ff zero size 2024-09-21T08:02:26.350 INFO:tasks.workunit.client.1.smithi129.stdout:2/70: mknod d1/d13/c1a 0 2024-09-21T08:02:26.351 INFO:tasks.workunit.client.1.smithi129.stdout:1/51: creat d1/d4/f17 x:0 0 0 2024-09-21T08:02:26.352 INFO:tasks.workunit.client.1.smithi129.stdout:5/47: mkdir d2/dc 0 2024-09-21T08:02:26.352 INFO:tasks.workunit.client.1.smithi129.stdout:5/48: chown d2/f5 5 1 2024-09-21T08:02:26.353 INFO:tasks.workunit.client.1.smithi129.stdout:5/49: chown d2/c9 665 1 2024-09-21T08:02:26.354 INFO:tasks.workunit.client.1.smithi129.stdout:9/55: rename fd to f10 0 2024-09-21T08:02:26.354 INFO:tasks.workunit.client.1.smithi129.stdout:2/71: mkdir d1/d13/d1b 0 2024-09-21T08:02:26.354 INFO:tasks.workunit.client.1.smithi129.stdout:2/72: write d1/d13/f14 [564353,40324] 0 2024-09-21T08:02:26.354 INFO:tasks.workunit.client.1.smithi129.stdout:2/73: creat d1/f1c x:0 0 0 2024-09-21T08:02:26.354 INFO:tasks.workunit.client.1.smithi129.stdout:2/74: dread - d1/dc/ff zero size 2024-09-21T08:02:26.354 INFO:tasks.workunit.client.1.smithi129.stdout:2/75: creat d1/d13/f1d x:0 0 0 2024-09-21T08:02:26.354 INFO:tasks.workunit.client.1.smithi129.stdout:2/76: chown l0 163676 1 2024-09-21T08:02:26.354 INFO:tasks.workunit.client.1.smithi129.stdout:5/50: dread d2/f3 [0,4194304] 0 2024-09-21T08:02:26.358 INFO:tasks.workunit.client.1.smithi129.stdout:7/72: dread d0/f5 [0,4194304] 0 2024-09-21T08:02:26.358 INFO:tasks.workunit.client.1.smithi129.stdout:9/56: dread f9 [0,4194304] 0 2024-09-21T08:02:26.358 INFO:tasks.workunit.client.1.smithi129.stdout:5/51: mknod d2/dc/cd 0 2024-09-21T08:02:26.359 INFO:tasks.workunit.client.1.smithi129.stdout:9/57: mknod c11 0 2024-09-21T08:02:26.360 INFO:tasks.workunit.client.1.smithi129.stdout:8/60: dread d0/fe [0,4194304] 0 2024-09-21T08:02:26.360 INFO:tasks.workunit.client.1.smithi129.stdout:7/73: creat d0/f1f x:0 0 0 2024-09-21T08:02:26.360 INFO:tasks.workunit.client.1.smithi129.stdout:7/74: stat d0/f15 0 2024-09-21T08:02:26.360 INFO:tasks.workunit.client.1.smithi129.stdout:7/75: fsync d0/f8 0 2024-09-21T08:02:26.362 INFO:tasks.workunit.client.1.smithi129.stdout:5/52: symlink d2/le 0 2024-09-21T08:02:26.363 INFO:tasks.workunit.client.1.smithi129.stdout:7/76: unlink d0/fc 0 2024-09-21T08:02:26.363 INFO:tasks.workunit.client.1.smithi129.stdout:9/58: write f9 [2143181,58035] 0 2024-09-21T08:02:26.364 INFO:tasks.workunit.client.1.smithi129.stdout:3/47: dread d3/da/dc/fd [0,4194304] 0 2024-09-21T08:02:26.366 INFO:tasks.workunit.client.1.smithi129.stdout:4/25: dwrite d5/d6/f7 [0,4194304] 0 2024-09-21T08:02:26.366 INFO:tasks.workunit.client.1.smithi129.stdout:4/26: chown d5 14 1 2024-09-21T08:02:26.366 INFO:tasks.workunit.client.1.smithi129.stdout:4/27: rename d5 to d5/d6/dc 22 2024-09-21T08:02:26.367 INFO:tasks.workunit.client.1.smithi129.stdout:6/32: write f5 [926377,93477] 0 2024-09-21T08:02:26.370 INFO:tasks.workunit.client.1.smithi129.stdout:6/33: mkdir d7 0 2024-09-21T08:02:26.373 INFO:tasks.workunit.client.1.smithi129.stdout:6/34: rename f3 to d7/f8 0 2024-09-21T08:02:26.373 INFO:tasks.workunit.client.1.smithi129.stdout:6/35: chown f4 5808613 1 2024-09-21T08:02:26.378 INFO:tasks.workunit.client.1.smithi129.stdout:6/36: creat d7/f9 x:0 0 0 2024-09-21T08:02:26.381 INFO:tasks.workunit.client.1.smithi129.stdout:4/28: write f2 [913932,26983] 0 2024-09-21T08:02:26.386 INFO:tasks.workunit.client.1.smithi129.stdout:5/53: write d2/f4 [1169800,120621] 0 2024-09-21T08:02:26.386 INFO:tasks.workunit.client.1.smithi129.stdout:8/61: truncate d0/fe 724630 0 2024-09-21T08:02:26.387 INFO:tasks.workunit.client.1.smithi129.stdout:5/54: creat d2/dc/ff x:0 0 0 2024-09-21T08:02:26.387 INFO:tasks.workunit.client.1.smithi129.stdout:5/55: chown d2/dc/ff 17 1 2024-09-21T08:02:26.387 INFO:tasks.workunit.client.1.smithi129.stdout:9/59: write f4 [942719,103945] 0 2024-09-21T08:02:26.387 INFO:tasks.workunit.client.1.smithi129.stdout:0/25: dwrite f0 [0,4194304] 0 2024-09-21T08:02:26.388 INFO:tasks.workunit.client.1.smithi129.stdout:5/56: creat d2/f10 x:0 0 0 2024-09-21T08:02:26.389 INFO:tasks.workunit.client.1.smithi129.stdout:9/60: symlink l12 0 2024-09-21T08:02:26.390 INFO:tasks.workunit.client.1.smithi129.stdout:5/57: link c0 d2/c11 0 2024-09-21T08:02:26.390 INFO:tasks.workunit.client.1.smithi129.stdout:5/58: creat d2/dc/f12 x:0 0 0 2024-09-21T08:02:26.391 INFO:tasks.workunit.client.1.smithi129.stdout:9/61: dread f0 [0,4194304] 0 2024-09-21T08:02:26.391 INFO:tasks.workunit.client.1.smithi129.stdout:9/62: readlink l7 0 2024-09-21T08:02:26.391 INFO:tasks.workunit.client.1.smithi129.stdout:9/63: dread - ff zero size 2024-09-21T08:02:26.391 INFO:tasks.workunit.client.1.smithi129.stdout:9/64: creat f13 x:0 0 0 2024-09-21T08:02:26.392 INFO:tasks.workunit.client.1.smithi129.stdout:4/29: truncate f2 58996 0 2024-09-21T08:02:26.394 INFO:tasks.workunit.client.1.smithi129.stdout:9/65: mknod c14 0 2024-09-21T08:02:26.394 INFO:tasks.workunit.client.1.smithi129.stdout:9/66: write f10 [229458,17459] 0 2024-09-21T08:02:26.394 INFO:tasks.workunit.client.1.smithi129.stdout:9/67: write ff [200879,62638] 0 2024-09-21T08:02:26.394 INFO:tasks.workunit.client.1.smithi129.stdout:9/68: creat f15 x:0 0 0 2024-09-21T08:02:26.394 INFO:tasks.workunit.client.1.smithi129.stdout:4/30: symlink d5/d6/ld 0 2024-09-21T08:02:26.396 INFO:tasks.workunit.client.1.smithi129.stdout:1/52: dwrite d1/f3 [4194304,4194304] 0 2024-09-21T08:02:26.396 INFO:tasks.workunit.client.1.smithi129.stdout:1/53: write d1/d4/f17 [817512,78885] 0 2024-09-21T08:02:26.396 INFO:tasks.workunit.client.1.smithi129.stdout:4/31: mknod d5/ce 0 2024-09-21T08:02:26.398 INFO:tasks.workunit.client.1.smithi129.stdout:1/54: mknod d1/d4/c18 0 2024-09-21T08:02:26.398 INFO:tasks.workunit.client.1.smithi129.stdout:1/55: truncate d1/fd 1320593 0 2024-09-21T08:02:26.398 INFO:tasks.workunit.client.1.smithi129.stdout:1/56: truncate d1/d4/f17 1166132 0 2024-09-21T08:02:26.398 INFO:tasks.workunit.client.1.smithi129.stdout:0/26: truncate f0 29083 0 2024-09-21T08:02:26.400 INFO:tasks.workunit.client.1.smithi129.stdout:5/59: dread d2/f5 [0,4194304] 0 2024-09-21T08:02:26.400 INFO:tasks.workunit.client.1.smithi129.stdout:5/60: stat d2/f8 0 2024-09-21T08:02:26.400 INFO:tasks.workunit.client.1.smithi129.stdout:5/61: creat d2/dc/f13 x:0 0 0 2024-09-21T08:02:26.400 INFO:tasks.workunit.client.1.smithi129.stdout:5/62: write d2/dc/f12 [84296,94245] 0 2024-09-21T08:02:26.400 INFO:tasks.workunit.client.1.smithi129.stdout:5/63: truncate f1 1225350 0 2024-09-21T08:02:26.400 INFO:tasks.workunit.client.1.smithi129.stdout:7/77: dwrite d0/f1b [0,4194304] 0 2024-09-21T08:02:26.400 INFO:tasks.workunit.client.1.smithi129.stdout:3/48: dwrite d3/da/ff [0,4194304] 0 2024-09-21T08:02:26.401 INFO:tasks.workunit.client.1.smithi129.stdout:1/57: mknod d1/c19 0 2024-09-21T08:02:26.402 INFO:tasks.workunit.client.1.smithi129.stdout:1/58: getdents d1/d16 0 2024-09-21T08:02:26.403 INFO:tasks.workunit.client.1.smithi129.stdout:5/64: mknod d2/dc/c14 0 2024-09-21T08:02:26.403 INFO:tasks.workunit.client.1.smithi129.stdout:5/65: write d2/dc/ff [740874,123183] 0 2024-09-21T08:02:26.403 INFO:tasks.workunit.client.1.smithi129.stdout:5/66: truncate d2/f10 755209 0 2024-09-21T08:02:26.403 INFO:tasks.workunit.client.1.smithi129.stdout:8/62: read d0/d6/d7/fb [1791791,7682] 0 2024-09-21T08:02:26.403 INFO:tasks.workunit.client.1.smithi129.stdout:2/77: dwrite d1/dc/f16 [0,4194304] 0 2024-09-21T08:02:26.403 INFO:tasks.workunit.client.1.smithi129.stdout:2/78: rename d1/dc to d1/dc/d1e 22 2024-09-21T08:02:26.407 INFO:tasks.workunit.client.1.smithi129.stdout:3/49: symlink d3/da/l14 0 2024-09-21T08:02:26.408 INFO:tasks.workunit.client.1.smithi129.stdout:7/78: rename d0/f1d to d0/f20 0 2024-09-21T08:02:26.408 INFO:tasks.workunit.client.1.smithi129.stdout:1/59: dread d1/f15 [0,4194304] 0 2024-09-21T08:02:26.409 INFO:tasks.workunit.client.1.smithi129.stdout:5/67: symlink d2/dc/l15 0 2024-09-21T08:02:26.410 INFO:tasks.workunit.client.1.smithi129.stdout:5/68: write d2/dc/f13 [67004,94889] 0 2024-09-21T08:02:26.410 INFO:tasks.workunit.client.1.smithi129.stdout:4/32: getdents d5 0 2024-09-21T08:02:26.413 INFO:tasks.workunit.client.1.smithi129.stdout:2/79: mkdir d1/d13/d1b/d1f 0 2024-09-21T08:02:26.413 INFO:tasks.workunit.client.1.smithi129.stdout:2/80: chown d1/dc 43 1 2024-09-21T08:02:26.413 INFO:tasks.workunit.client.1.smithi129.stdout:0/27: write f0 [187954,67865] 0 2024-09-21T08:02:26.414 INFO:tasks.workunit.client.1.smithi129.stdout:3/50: symlink d3/da/dc/d11/l15 0 2024-09-21T08:02:26.418 INFO:tasks.workunit.client.1.smithi129.stdout:3/51: write d3/da/dc/fd [3133077,26266] 0 2024-09-21T08:02:26.418 INFO:tasks.workunit.client.1.smithi129.stdout:3/52: write d3/f13 [132337,66634] 0 2024-09-21T08:02:26.419 INFO:tasks.workunit.client.1.smithi129.stdout:4/33: mknod d5/cf 0 2024-09-21T08:02:26.420 INFO:tasks.workunit.client.1.smithi129.stdout:2/81: write d1/dc/f12 [1041972,53441] 0 2024-09-21T08:02:26.420 INFO:tasks.workunit.client.1.smithi129.stdout:0/28: link f2 f3 0 2024-09-21T08:02:26.425 INFO:tasks.workunit.client.1.smithi129.stdout:3/53: rename d3/da/cb to d3/da/dc/d11/c16 0 2024-09-21T08:02:26.428 INFO:tasks.workunit.client.1.smithi129.stdout:7/79: link d0/f20 d0/d1e/f21 0 2024-09-21T08:02:26.429 INFO:tasks.workunit.client.1.smithi129.stdout:5/69: rmdir d2/dc 39 2024-09-21T08:02:26.429 INFO:tasks.workunit.client.1.smithi129.stdout:5/70: write d2/f10 [930881,98869] 0 2024-09-21T08:02:26.429 INFO:tasks.workunit.client.1.smithi129.stdout:5/71: chown d2/dc/f13 2 1 2024-09-21T08:02:26.432 INFO:tasks.workunit.client.1.smithi129.stdout:3/54: symlink d3/l17 0 2024-09-21T08:02:26.433 INFO:tasks.workunit.client.1.smithi129.stdout:4/34: mknod d5/d6/c10 0 2024-09-21T08:02:26.435 INFO:tasks.workunit.client.1.smithi129.stdout:7/80: creat d0/f22 x:0 0 0 2024-09-21T08:02:26.435 INFO:tasks.workunit.client.1.smithi129.stdout:9/69: dwrite f9 [0,4194304] 0 2024-09-21T08:02:26.435 INFO:tasks.workunit.client.1.smithi129.stdout:9/70: creat f16 x:0 0 0 2024-09-21T08:02:26.435 INFO:tasks.workunit.client.1.smithi129.stdout:3/55: dread d3/f5 [0,4194304] 0 2024-09-21T08:02:26.435 INFO:tasks.workunit.client.1.smithi129.stdout:3/56: creat d3/f18 x:0 0 0 2024-09-21T08:02:26.436 INFO:tasks.workunit.client.1.smithi129.stdout:3/57: read - d3/f18 zero size 2024-09-21T08:02:26.436 INFO:tasks.workunit.client.1.smithi129.stdout:6/37: dwrite f5 [0,4194304] 0 2024-09-21T08:02:26.436 INFO:tasks.workunit.client.1.smithi129.stdout:5/72: symlink d2/l16 0 2024-09-21T08:02:26.436 INFO:tasks.workunit.client.1.smithi129.stdout:5/73: stat d2/dc/cd 0 2024-09-21T08:02:26.436 INFO:tasks.workunit.client.1.smithi129.stdout:5/74: write d2/f8 [863599,72690] 0 2024-09-21T08:02:26.438 INFO:tasks.workunit.client.1.smithi129.stdout:8/63: dwrite d0/d6/d7/fb [0,4194304] 0 2024-09-21T08:02:26.438 INFO:tasks.workunit.client.1.smithi129.stdout:7/81: creat d0/d1e/f23 x:0 0 0 2024-09-21T08:02:26.438 INFO:tasks.workunit.client.1.smithi129.stdout:7/82: fdatasync d0/f17 0 2024-09-21T08:02:26.438 INFO:tasks.workunit.client.1.smithi129.stdout:7/83: fsync d0/f17 0 2024-09-21T08:02:26.438 INFO:tasks.workunit.client.1.smithi129.stdout:7/84: chown d0/ld 8 1 2024-09-21T08:02:26.438 INFO:tasks.workunit.client.1.smithi129.stdout:2/82: dread d1/dc/f15 [0,4194304] 0 2024-09-21T08:02:26.439 INFO:tasks.workunit.client.1.smithi129.stdout:0/29: dread f0 [0,4194304] 0 2024-09-21T08:02:26.439 INFO:tasks.workunit.client.1.smithi129.stdout:8/64: read d0/fe [196038,47384] 0 2024-09-21T08:02:26.440 INFO:tasks.workunit.client.1.smithi129.stdout:9/71: mkdir d17 0 2024-09-21T08:02:26.440 INFO:tasks.workunit.client.1.smithi129.stdout:9/72: truncate ff 525377 0 2024-09-21T08:02:26.440 INFO:tasks.workunit.client.1.smithi129.stdout:9/73: write f15 [222625,94904] 0 2024-09-21T08:02:26.455 INFO:tasks.workunit.client.1.smithi129.stdout:5/75: unlink d2/f8 0 2024-09-21T08:02:26.457 INFO:tasks.workunit.client.1.smithi129.stdout:4/35: mkdir d5/d11 0 2024-09-21T08:02:26.458 INFO:tasks.workunit.client.1.smithi129.stdout:0/30: symlink l4 0 2024-09-21T08:02:26.461 INFO:tasks.workunit.client.1.smithi129.stdout:3/58: rename d3/f18 to d3/da/f19 0 2024-09-21T08:02:26.461 INFO:tasks.workunit.client.1.smithi129.stdout:3/59: fsync d3/f5 0 2024-09-21T08:02:26.461 INFO:tasks.workunit.client.1.smithi129.stdout:3/60: chown d3/c12 8486856 1 2024-09-21T08:02:26.461 INFO:tasks.workunit.client.1.smithi129.stdout:6/38: truncate f5 615907 0 2024-09-21T08:02:26.462 INFO:tasks.workunit.client.1.smithi129.stdout:8/65: dread d0/d6/d7/fb [0,4194304] 0 2024-09-21T08:02:26.463 INFO:tasks.workunit.client.1.smithi129.stdout:9/74: truncate f4 3871260 0 2024-09-21T08:02:26.464 INFO:tasks.workunit.client.1.smithi129.stdout:3/61: creat d3/da/f1a x:0 0 0 2024-09-21T08:02:26.464 INFO:tasks.workunit.client.1.smithi129.stdout:8/66: creat d0/f11 x:0 0 0 2024-09-21T08:02:26.465 INFO:tasks.workunit.client.1.smithi129.stdout:4/36: write d5/d6/f7 [2797689,126467] 0 2024-09-21T08:02:26.465 INFO:tasks.workunit.client.1.smithi129.stdout:4/37: truncate d5/d6/f7 4937281 0 2024-09-21T08:02:26.465 INFO:tasks.workunit.client.1.smithi129.stdout:4/38: creat d5/d6/f12 x:0 0 0 2024-09-21T08:02:26.466 INFO:tasks.workunit.client.1.smithi129.stdout:7/85: dwrite d0/f5 [4194304,4194304] 0 2024-09-21T08:02:26.466 INFO:tasks.workunit.client.1.smithi129.stdout:2/83: dwrite d1/dc/f16 [0,4194304] 0 2024-09-21T08:02:26.466 INFO:tasks.workunit.client.1.smithi129.stdout:2/84: write d1/dc/ff [423641,30628] 0 2024-09-21T08:02:26.467 INFO:tasks.workunit.client.1.smithi129.stdout:9/75: rename f9 to d17/f18 0 2024-09-21T08:02:26.469 INFO:tasks.workunit.client.1.smithi129.stdout:7/86: dread d0/f16 [0,4194304] 0 2024-09-21T08:02:26.469 INFO:tasks.workunit.client.1.smithi129.stdout:4/39: creat d5/d11/f13 x:0 0 0 2024-09-21T08:02:26.474 INFO:tasks.workunit.client.1.smithi129.stdout:0/31: getdents . 0 2024-09-21T08:02:26.475 INFO:tasks.workunit.client.1.smithi129.stdout:6/39: write f5 [1327731,58535] 0 2024-09-21T08:02:26.475 INFO:tasks.workunit.client.1.smithi129.stdout:6/40: creat d7/fa x:0 0 0 2024-09-21T08:02:26.475 INFO:tasks.workunit.client.1.smithi129.stdout:6/41: truncate f5 1442203 0 2024-09-21T08:02:26.476 INFO:tasks.workunit.client.1.smithi129.stdout:0/32: dread f0 [0,4194304] 0 2024-09-21T08:02:26.478 INFO:tasks.workunit.client.1.smithi129.stdout:2/85: rename l0 to d1/d13/l20 0 2024-09-21T08:02:26.478 INFO:tasks.workunit.client.1.smithi129.stdout:2/86: creat d1/dc/f21 x:0 0 0 2024-09-21T08:02:26.478 INFO:tasks.workunit.client.1.smithi129.stdout:2/87: stat d1/dc/d19 0 2024-09-21T08:02:26.480 INFO:tasks.workunit.client.1.smithi129.stdout:9/76: link ff d17/f19 0 2024-09-21T08:02:26.482 INFO:tasks.workunit.client.1.smithi129.stdout:8/67: rmdir d0 39 2024-09-21T08:02:26.483 INFO:tasks.workunit.client.1.smithi129.stdout:4/40: creat d5/f14 x:0 0 0 2024-09-21T08:02:26.483 INFO:tasks.workunit.client.1.smithi129.stdout:4/41: write d5/d6/f12 [390741,86033] 0 2024-09-21T08:02:26.484 INFO:tasks.workunit.client.1.smithi129.stdout:8/68: dread d0/fe [0,4194304] 0 2024-09-21T08:02:26.484 INFO:tasks.workunit.client.1.smithi129.stdout:0/33: creat f5 x:0 0 0 2024-09-21T08:02:26.486 INFO:tasks.workunit.client.1.smithi129.stdout:2/88: creat d1/d13/d1b/d1f/f22 x:0 0 0 2024-09-21T08:02:26.486 INFO:tasks.workunit.client.1.smithi129.stdout:2/89: creat d1/d13/d1b/d1f/f23 x:0 0 0 2024-09-21T08:02:26.486 INFO:tasks.workunit.client.1.smithi129.stdout:2/90: creat d1/d13/f24 x:0 0 0 2024-09-21T08:02:26.486 INFO:tasks.workunit.client.1.smithi129.stdout:2/91: truncate d1/d13/d1b/d1f/f22 377197 0 2024-09-21T08:02:26.487 INFO:tasks.workunit.client.1.smithi129.stdout:7/87: rename d0/f15 to d0/f24 0 2024-09-21T08:02:26.487 INFO:tasks.workunit.client.1.smithi129.stdout:5/76: dwrite d2/f10 [0,4194304] 0 2024-09-21T08:02:26.487 INFO:tasks.workunit.client.1.smithi129.stdout:5/77: chown d2/cb 1 1 2024-09-21T08:02:26.488 INFO:tasks.workunit.client.1.smithi129.stdout:3/62: dwrite d3/da/dc/fd [0,4194304] 0 2024-09-21T08:02:26.490 INFO:tasks.workunit.client.1.smithi129.stdout:0/34: rename f5 to f6 0 2024-09-21T08:02:26.490 INFO:tasks.workunit.client.1.smithi129.stdout:8/69: creat d0/d6/d7/d9/f12 x:0 0 0 2024-09-21T08:02:26.493 INFO:tasks.workunit.client.1.smithi129.stdout:0/35: dread f2 [0,4194304] 0 2024-09-21T08:02:26.494 INFO:tasks.workunit.client.1.smithi129.stdout:0/36: creat f7 x:0 0 0 2024-09-21T08:02:26.494 INFO:tasks.workunit.client.1.smithi129.stdout:0/37: creat f8 x:0 0 0 2024-09-21T08:02:26.494 INFO:tasks.workunit.client.1.smithi129.stdout:2/92: truncate d1/dc/f15 307384 0 2024-09-21T08:02:26.496 INFO:tasks.workunit.client.1.smithi129.stdout:0/38: dread f2 [0,4194304] 0 2024-09-21T08:02:26.496 INFO:tasks.workunit.client.1.smithi129.stdout:0/39: dread - f8 zero size 2024-09-21T08:02:26.497 INFO:tasks.workunit.client.1.smithi129.stdout:5/78: rmdir d2/dc 39 2024-09-21T08:02:26.497 INFO:tasks.workunit.client.1.smithi129.stdout:5/79: chown d2/f3 1 1 2024-09-21T08:02:26.497 INFO:tasks.workunit.client.1.smithi129.stdout:5/80: write d2/f4 [340858,69572] 0 2024-09-21T08:02:26.497 INFO:tasks.workunit.client.1.smithi129.stdout:4/42: mknod d5/c15 0 2024-09-21T08:02:26.498 INFO:tasks.workunit.client.1.smithi129.stdout:3/63: dread d3/da/ff [0,4194304] 0 2024-09-21T08:02:26.499 INFO:tasks.workunit.client.1.smithi129.stdout:1/60: sync 2024-09-21T08:02:26.499 INFO:tasks.workunit.client.1.smithi129.stdout:9/77: getdents d17 0 2024-09-21T08:02:26.499 INFO:tasks.workunit.client.1.smithi129.stdout:5/81: write d2/f4 [1052029,31962] 0 2024-09-21T08:02:26.501 INFO:tasks.workunit.client.1.smithi129.stdout:2/93: unlink d1/dc/f12 0 2024-09-21T08:02:26.501 INFO:tasks.workunit.client.1.smithi129.stdout:6/42: fsync d7/fa 0 2024-09-21T08:02:26.502 INFO:tasks.workunit.client.1.smithi129.stdout:6/43: creat d7/fb x:0 0 0 2024-09-21T08:02:26.502 INFO:tasks.workunit.client.1.smithi129.stdout:6/44: dread - d7/fa zero size 2024-09-21T08:02:26.502 INFO:tasks.workunit.client.1.smithi129.stdout:6/45: write d7/fb [11783,4013] 0 2024-09-21T08:02:26.504 INFO:tasks.workunit.client.1.smithi129.stdout:1/61: write d1/f3 [186980,65583] 0 2024-09-21T08:02:26.507 INFO:tasks.workunit.client.1.smithi129.stdout:9/78: symlink d17/l1a 0 2024-09-21T08:02:26.510 INFO:tasks.workunit.client.1.smithi129.stdout:7/88: dwrite d0/f20 [0,4194304] 0 2024-09-21T08:02:26.513 INFO:tasks.workunit.client.1.smithi129.stdout:4/43: mkdir d5/d16 0 2024-09-21T08:02:26.513 INFO:tasks.workunit.client.1.smithi129.stdout:4/44: creat d5/d11/f17 x:0 0 0 2024-09-21T08:02:26.513 INFO:tasks.workunit.client.1.smithi129.stdout:4/45: truncate d5/d6/f12 645359 0 2024-09-21T08:02:26.513 INFO:tasks.workunit.client.1.smithi129.stdout:5/82: write d2/f10 [3566727,4900] 0 2024-09-21T08:02:26.513 INFO:tasks.workunit.client.1.smithi129.stdout:9/79: dread d17/f19 [0,4194304] 0 2024-09-21T08:02:26.513 INFO:tasks.workunit.client.1.smithi129.stdout:9/80: chown le 214350 1 2024-09-21T08:02:26.522 INFO:tasks.workunit.client.1.smithi129.stdout:0/40: getdents . 0 2024-09-21T08:02:26.524 INFO:tasks.workunit.client.1.smithi129.stdout:0/41: mknod c9 0 2024-09-21T08:02:26.526 INFO:tasks.workunit.client.1.smithi129.stdout:0/42: symlink la 0 2024-09-21T08:02:26.538 INFO:tasks.workunit.client.1.smithi129.stdout:0/43: dread f0 [0,4194304] 0 2024-09-21T08:02:26.540 INFO:tasks.workunit.client.1.smithi129.stdout:0/44: creat fb x:0 0 0 2024-09-21T08:02:26.542 INFO:tasks.workunit.client.1.smithi129.stdout:0/45: symlink lc 0 2024-09-21T08:02:26.552 INFO:tasks.workunit.client.1.smithi129.stdout:3/64: dwrite d3/da/ff [0,4194304] 0 2024-09-21T08:02:26.552 INFO:tasks.workunit.client.1.smithi129.stdout:3/65: chown d3/da/dc/d11/l15 12 1 2024-09-21T08:02:26.552 INFO:tasks.workunit.client.1.smithi129.stdout:3/66: write d3/f13 [679818,88770] 0 2024-09-21T08:02:26.554 INFO:tasks.workunit.client.1.smithi129.stdout:3/67: symlink d3/da/dc/d11/l1b 0 2024-09-21T08:02:26.554 INFO:tasks.workunit.client.1.smithi129.stdout:3/68: truncate d3/f5 1384231 0 2024-09-21T08:02:26.557 INFO:tasks.workunit.client.1.smithi129.stdout:3/69: truncate d3/da/ff 955576 0 2024-09-21T08:02:26.557 INFO:tasks.workunit.client.1.smithi129.stdout:3/70: chown d3/da/dc 16161 1 2024-09-21T08:02:26.558 INFO:tasks.workunit.client.1.smithi129.stdout:3/71: link d3/l17 d3/l1c 0 2024-09-21T08:02:26.563 INFO:tasks.workunit.client.1.smithi129.stdout:2/94: dwrite d1/dc/f18 [0,4194304] 0 2024-09-21T08:02:26.563 INFO:tasks.workunit.client.1.smithi129.stdout:2/95: truncate d1/d13/f24 233336 0 2024-09-21T08:02:26.565 INFO:tasks.workunit.client.1.smithi129.stdout:2/96: rmdir d1/d13/d1b 39 2024-09-21T08:02:26.565 INFO:tasks.workunit.client.1.smithi129.stdout:2/97: creat d1/d13/d1b/d1f/f25 x:0 0 0 2024-09-21T08:02:26.565 INFO:tasks.workunit.client.1.smithi129.stdout:6/46: dwrite f5 [0,4194304] 0 2024-09-21T08:02:26.565 INFO:tasks.workunit.client.1.smithi129.stdout:6/47: creat d7/fc x:0 0 0 2024-09-21T08:02:26.566 INFO:tasks.workunit.client.1.smithi129.stdout:7/89: dwrite d0/f1f [0,4194304] 0 2024-09-21T08:02:26.566 INFO:tasks.workunit.client.1.smithi129.stdout:9/81: dwrite f10 [0,4194304] 0 2024-09-21T08:02:26.566 INFO:tasks.workunit.client.1.smithi129.stdout:1/62: dwrite d1/d4/fa [4194304,4194304] 0 2024-09-21T08:02:26.566 INFO:tasks.workunit.client.1.smithi129.stdout:9/82: write ff [874146,93159] 0 2024-09-21T08:02:26.566 INFO:tasks.workunit.client.1.smithi129.stdout:5/83: dwrite d2/dc/ff [0,4194304] 0 2024-09-21T08:02:26.567 INFO:tasks.workunit.client.1.smithi129.stdout:5/84: chown d2/f4 131910476 1 2024-09-21T08:02:26.567 INFO:tasks.workunit.client.1.smithi129.stdout:4/46: dwrite d5/f14 [0,4194304] 0 2024-09-21T08:02:26.567 INFO:tasks.workunit.client.1.smithi129.stdout:4/47: write d5/d6/f7 [4930219,61967] 0 2024-09-21T08:02:26.567 INFO:tasks.workunit.client.1.smithi129.stdout:7/90: dread d0/f16 [0,4194304] 0 2024-09-21T08:02:26.571 INFO:tasks.workunit.client.1.smithi129.stdout:9/83: symlink d17/l1b 0 2024-09-21T08:02:26.571 INFO:tasks.workunit.client.1.smithi129.stdout:5/85: truncate d2/dc/f13 29038 0 2024-09-21T08:02:26.574 INFO:tasks.workunit.client.1.smithi129.stdout:4/48: creat d5/d16/f18 x:0 0 0 2024-09-21T08:02:26.574 INFO:tasks.workunit.client.1.smithi129.stdout:4/49: write d5/d6/f7 [4922254,77147] 0 2024-09-21T08:02:26.575 INFO:tasks.workunit.client.1.smithi129.stdout:1/63: dread d1/d4/fa [0,4194304] 0 2024-09-21T08:02:26.575 INFO:tasks.workunit.client.1.smithi129.stdout:3/72: dwrite d3/da/f1a [0,4194304] 0 2024-09-21T08:02:26.576 INFO:tasks.workunit.client.1.smithi129.stdout:4/50: symlink d5/d11/l19 0 2024-09-21T08:02:26.578 INFO:tasks.workunit.client.1.smithi129.stdout:7/91: rename d0/f1b to d0/f25 0 2024-09-21T08:02:26.580 INFO:tasks.workunit.client.1.smithi129.stdout:1/64: dread d1/d4/fa [0,4194304] 0 2024-09-21T08:02:26.585 INFO:tasks.workunit.client.1.smithi129.stdout:2/98: truncate d1/d13/d1b/d1f/f22 358104 0 2024-09-21T08:02:26.585 INFO:tasks.workunit.client.1.smithi129.stdout:2/99: chown d1/la 4064 1 2024-09-21T08:02:26.586 INFO:tasks.workunit.client.1.smithi129.stdout:9/84: dread d17/f18 [0,4194304] 0 2024-09-21T08:02:26.586 INFO:tasks.workunit.client.1.smithi129.stdout:9/85: fdatasync f15 0 2024-09-21T08:02:26.588 INFO:tasks.workunit.client.1.smithi129.stdout:1/65: truncate d1/f15 3040656 0 2024-09-21T08:02:26.593 INFO:tasks.workunit.client.1.smithi129.stdout:2/100: mkdir d1/dc/d26 0 2024-09-21T08:02:26.593 INFO:tasks.workunit.client.1.smithi129.stdout:2/101: chown d1/dc/d19 114332 1 2024-09-21T08:02:26.593 INFO:tasks.workunit.client.1.smithi129.stdout:9/86: truncate f0 256238 0 2024-09-21T08:02:26.595 INFO:tasks.workunit.client.1.smithi129.stdout:9/87: link d17/f18 d17/f1c 0 2024-09-21T08:02:26.595 INFO:tasks.workunit.client.1.smithi129.stdout:1/66: write d1/f15 [3693185,111022] 0 2024-09-21T08:02:26.595 INFO:tasks.workunit.client.1.smithi129.stdout:1/67: readlink l0 0 2024-09-21T08:02:26.598 INFO:tasks.workunit.client.1.smithi129.stdout:1/68: creat d1/d9/f1a x:0 0 0 2024-09-21T08:02:26.598 INFO:tasks.workunit.client.1.smithi129.stdout:1/69: chown d1/d4/c18 1070749 1 2024-09-21T08:02:26.598 INFO:tasks.workunit.client.1.smithi129.stdout:1/70: stat d1/c13 0 2024-09-21T08:02:26.598 INFO:tasks.workunit.client.1.smithi129.stdout:1/71: dread - d1/d9/fe zero size 2024-09-21T08:02:26.599 INFO:tasks.workunit.client.1.smithi129.stdout:1/72: symlink d1/d16/l1b 0 2024-09-21T08:02:26.599 INFO:tasks.workunit.client.1.smithi129.stdout:1/73: chown d1/d4/c10 2386595 1 2024-09-21T08:02:26.605 INFO:tasks.workunit.client.1.smithi129.stdout:1/74: getdents d1/d9 0 2024-09-21T08:02:26.606 INFO:tasks.workunit.client.1.smithi129.stdout:7/92: write d0/f25 [4953613,121169] 0 2024-09-21T08:02:26.606 INFO:tasks.workunit.client.1.smithi129.stdout:9/88: dread f10 [0,4194304] 0 2024-09-21T08:02:26.606 INFO:tasks.workunit.client.1.smithi129.stdout:1/75: symlink d1/d16/l1c 0 2024-09-21T08:02:26.607 INFO:tasks.workunit.client.1.smithi129.stdout:1/76: mknod d1/c1d 0 2024-09-21T08:02:26.608 INFO:tasks.workunit.client.1.smithi129.stdout:7/93: rmdir d0 39 2024-09-21T08:02:26.608 INFO:tasks.workunit.client.1.smithi129.stdout:7/94: chown d0/f17 0 1 2024-09-21T08:02:26.609 INFO:tasks.workunit.client.1.smithi129.stdout:2/102: dread d1/dc/f10 [0,4194304] 0 2024-09-21T08:02:26.609 INFO:tasks.workunit.client.1.smithi129.stdout:2/103: fsync d1/d13/d1b/d1f/f22 0 2024-09-21T08:02:26.609 INFO:tasks.workunit.client.1.smithi129.stdout:7/95: creat d0/f26 x:0 0 0 2024-09-21T08:02:26.609 INFO:tasks.workunit.client.1.smithi129.stdout:1/77: dread d1/fd [0,4194304] 0 2024-09-21T08:02:26.610 INFO:tasks.workunit.client.1.smithi129.stdout:2/104: creat d1/d13/d1b/f27 x:0 0 0 2024-09-21T08:02:26.610 INFO:tasks.workunit.client.1.smithi129.stdout:2/105: fdatasync d1/d13/f14 0 2024-09-21T08:02:26.610 INFO:tasks.workunit.client.1.smithi129.stdout:9/89: dread d17/f18 [0,4194304] 0 2024-09-21T08:02:26.611 INFO:tasks.workunit.client.1.smithi129.stdout:7/96: link d0/d1e/f23 d0/d1e/f27 0 2024-09-21T08:02:26.612 INFO:tasks.workunit.client.1.smithi129.stdout:1/78: creat d1/d9/f1e x:0 0 0 2024-09-21T08:02:26.612 INFO:tasks.workunit.client.1.smithi129.stdout:1/79: truncate d1/d4/f17 1248473 0 2024-09-21T08:02:26.612 INFO:tasks.workunit.client.1.smithi129.stdout:1/80: stat d1/f3 0 2024-09-21T08:02:26.614 INFO:tasks.workunit.client.1.smithi129.stdout:1/81: rename d1/c6 to d1/d4/c1f 0 2024-09-21T08:02:26.614 INFO:tasks.workunit.client.1.smithi129.stdout:1/82: stat d1/d16/l1c 0 2024-09-21T08:02:26.614 INFO:tasks.workunit.client.1.smithi129.stdout:1/83: dread - d1/d9/f1e zero size 2024-09-21T08:02:26.615 INFO:tasks.workunit.client.1.smithi129.stdout:1/84: link d1/d9/fe d1/d9/f20 0 2024-09-21T08:02:26.615 INFO:tasks.workunit.client.1.smithi129.stdout:1/85: read - d1/d9/f1a zero size 2024-09-21T08:02:26.615 INFO:tasks.workunit.client.1.smithi129.stdout:1/86: chown d1/d4 77460 1 2024-09-21T08:02:26.619 INFO:tasks.workunit.client.1.smithi129.stdout:7/97: write d0/d1e/f21 [3595056,2880] 0 2024-09-21T08:02:26.624 INFO:tasks.workunit.client.1.smithi129.stdout:7/98: dread d0/f17 [0,4194304] 0 2024-09-21T08:02:26.627 INFO:tasks.workunit.client.1.smithi129.stdout:7/99: symlink d0/l28 0 2024-09-21T08:02:26.628 INFO:tasks.workunit.client.1.smithi129.stdout:3/73: dwrite d3/f4 [0,4194304] 0 2024-09-21T08:02:26.629 INFO:tasks.workunit.client.1.smithi129.stdout:5/86: dwrite d2/f3 [0,4194304] 0 2024-09-21T08:02:26.629 INFO:tasks.workunit.client.1.smithi129.stdout:4/51: dwrite d5/f14 [0,4194304] 0 2024-09-21T08:02:26.629 INFO:tasks.workunit.client.1.smithi129.stdout:4/52: write d5/d16/f18 [932080,37059] 0 2024-09-21T08:02:26.629 INFO:tasks.workunit.client.1.smithi129.stdout:4/53: dread - d5/d11/f17 zero size 2024-09-21T08:02:26.629 INFO:tasks.workunit.client.1.smithi129.stdout:4/54: write d5/d16/f18 [1539555,25465] 0 2024-09-21T08:02:26.631 INFO:tasks.workunit.client.1.smithi129.stdout:7/100: rename d0/c10 to d0/d1e/c29 0 2024-09-21T08:02:26.636 INFO:tasks.workunit.client.1.smithi129.stdout:6/48: dwrite d7/fc [0,4194304] 0 2024-09-21T08:02:26.637 INFO:tasks.workunit.client.1.smithi129.stdout:4/55: link l1 d5/d16/l1a 0 2024-09-21T08:02:26.637 INFO:tasks.workunit.client.1.smithi129.stdout:4/56: dread - d5/d11/f17 zero size 2024-09-21T08:02:26.642 INFO:tasks.workunit.client.1.smithi129.stdout:6/49: rename d7/fb to d7/fd 0 2024-09-21T08:02:26.642 INFO:tasks.workunit.client.1.smithi129.stdout:3/74: dread d3/da/f1a [0,4194304] 0 2024-09-21T08:02:26.643 INFO:tasks.workunit.client.1.smithi129.stdout:6/50: link d7/f8 d7/fe 0 2024-09-21T08:02:26.643 INFO:tasks.workunit.client.1.smithi129.stdout:6/51: chown d7/fa 98 1 2024-09-21T08:02:26.644 INFO:tasks.workunit.client.1.smithi129.stdout:3/75: rmdir d3/da/dc/d11 39 2024-09-21T08:02:26.644 INFO:tasks.workunit.client.1.smithi129.stdout:3/76: write d3/da/f19 [681522,129463] 0 2024-09-21T08:02:26.649 INFO:tasks.workunit.client.1.smithi129.stdout:6/52: mknod d7/cf 0 2024-09-21T08:02:26.649 INFO:tasks.workunit.client.1.smithi129.stdout:6/53: chown d7/f9 131192340 1 2024-09-21T08:02:26.650 INFO:tasks.workunit.client.1.smithi129.stdout:7/101: getdents d0/d1e 0 2024-09-21T08:02:26.650 INFO:tasks.workunit.client.1.smithi129.stdout:7/102: chown d0/f16 10636150 1 2024-09-21T08:02:26.650 INFO:tasks.workunit.client.1.smithi129.stdout:7/103: readlink d0/lb 0 2024-09-21T08:02:26.650 INFO:tasks.workunit.client.1.smithi129.stdout:3/77: symlink d3/da/dc/d11/l1d 0 2024-09-21T08:02:26.651 INFO:tasks.workunit.client.1.smithi129.stdout:6/54: mkdir d7/d10 0 2024-09-21T08:02:26.651 INFO:tasks.workunit.client.1.smithi129.stdout:6/55: truncate d7/fd 273098 0 2024-09-21T08:02:26.653 INFO:tasks.workunit.client.1.smithi129.stdout:3/78: mkdir d3/d1e 0 2024-09-21T08:02:26.653 INFO:tasks.workunit.client.1.smithi129.stdout:7/104: symlink d0/l2a 0 2024-09-21T08:02:26.664 INFO:tasks.workunit.client.1.smithi129.stdout:6/56: dread d7/fc [0,4194304] 0 2024-09-21T08:02:26.664 INFO:tasks.workunit.client.1.smithi129.stdout:6/57: dread - d7/f9 zero size 2024-09-21T08:02:26.665 INFO:tasks.workunit.client.1.smithi129.stdout:6/58: symlink d7/l11 0 2024-09-21T08:02:26.666 INFO:tasks.workunit.client.1.smithi129.stdout:6/59: mknod d7/d10/c12 0 2024-09-21T08:02:26.666 INFO:tasks.workunit.client.1.smithi129.stdout:6/60: rename d7 to d7/d10/d13 22 2024-09-21T08:02:26.667 INFO:tasks.workunit.client.1.smithi129.stdout:6/61: rmdir d7/d10 39 2024-09-21T08:02:26.669 INFO:tasks.workunit.client.1.smithi129.stdout:1/87: dwrite d1/fd [0,4194304] 0 2024-09-21T08:02:26.672 INFO:tasks.workunit.client.1.smithi129.stdout:1/88: link d1/d9/f1e d1/d4/f21 0 2024-09-21T08:02:26.672 INFO:tasks.workunit.client.1.smithi129.stdout:1/89: write d1/d9/f1e [1027198,47827] 0 2024-09-21T08:02:26.672 INFO:tasks.workunit.client.1.smithi129.stdout:1/90: chown d1/d9 12132203 1 2024-09-21T08:02:26.672 INFO:tasks.workunit.client.1.smithi129.stdout:1/91: write d1/d4/f17 [1356615,68575] 0 2024-09-21T08:02:26.672 INFO:tasks.workunit.client.1.smithi129.stdout:1/92: write d1/d4/fa [8678358,77065] 0 2024-09-21T08:02:26.678 INFO:tasks.workunit.client.1.smithi129.stdout:2/106: dwrite d1/d13/f1d [0,4194304] 0 2024-09-21T08:02:26.678 INFO:tasks.workunit.client.1.smithi129.stdout:2/107: creat d1/d13/f28 x:0 0 0 2024-09-21T08:02:26.687 INFO:tasks.workunit.client.1.smithi129.stdout:4/57: dwrite d5/d6/f12 [0,4194304] 0 2024-09-21T08:02:26.687 INFO:tasks.workunit.client.1.smithi129.stdout:4/58: chown d5/d16 2 1 2024-09-21T08:02:26.687 INFO:tasks.workunit.client.1.smithi129.stdout:5/87: dwrite d2/dc/ff [0,4194304] 0 2024-09-21T08:02:26.691 INFO:tasks.workunit.client.1.smithi129.stdout:3/79: dwrite d3/f5 [0,4194304] 0 2024-09-21T08:02:26.692 INFO:tasks.workunit.client.1.smithi129.stdout:5/88: link d2/dc/f13 d2/f17 0 2024-09-21T08:02:26.692 INFO:tasks.workunit.client.1.smithi129.stdout:5/89: creat d2/f18 x:0 0 0 2024-09-21T08:02:26.692 INFO:tasks.workunit.client.1.smithi129.stdout:7/105: dwrite d0/f22 [0,4194304] 0 2024-09-21T08:02:26.692 INFO:tasks.workunit.client.1.smithi129.stdout:6/62: dwrite d7/fa [0,4194304] 0 2024-09-21T08:02:26.694 INFO:tasks.workunit.client.1.smithi129.stdout:5/90: truncate d2/f4 786149 0 2024-09-21T08:02:26.695 INFO:tasks.workunit.client.1.smithi129.stdout:5/91: dread - d2/f18 zero size 2024-09-21T08:02:26.696 INFO:tasks.workunit.client.1.smithi129.stdout:4/59: dread d5/d6/f12 [0,4194304] 0 2024-09-21T08:02:26.697 INFO:tasks.workunit.client.1.smithi129.stdout:4/60: dread f2 [0,4194304] 0 2024-09-21T08:02:26.698 INFO:tasks.workunit.client.1.smithi129.stdout:7/106: symlink d0/d1e/l2b 0 2024-09-21T08:02:26.699 INFO:tasks.workunit.client.1.smithi129.stdout:6/63: creat d7/d10/f14 x:0 0 0 2024-09-21T08:02:26.700 INFO:tasks.workunit.client.1.smithi129.stdout:4/61: chown d5/ce 1290 1 2024-09-21T08:02:26.700 INFO:tasks.workunit.client.1.smithi129.stdout:7/107: dread d0/f17 [0,4194304] 0 2024-09-21T08:02:26.701 INFO:tasks.workunit.client.1.smithi129.stdout:6/64: dread d7/fd [0,4194304] 0 2024-09-21T08:02:26.701 INFO:tasks.workunit.client.1.smithi129.stdout:4/62: mkdir d5/d16/d1b 0 2024-09-21T08:02:26.702 INFO:tasks.workunit.client.1.smithi129.stdout:7/108: mknod d0/d1e/c2c 0 2024-09-21T08:02:26.704 INFO:tasks.workunit.client.1.smithi129.stdout:6/65: rename d7/fc to d7/d10/f15 0 2024-09-21T08:02:26.704 INFO:tasks.workunit.client.1.smithi129.stdout:6/66: dread - d7/f9 zero size 2024-09-21T08:02:26.704 INFO:tasks.workunit.client.1.smithi129.stdout:6/67: creat d7/d10/f16 x:0 0 0 2024-09-21T08:02:26.704 INFO:tasks.workunit.client.1.smithi129.stdout:4/63: mknod d5/d6/c1c 0 2024-09-21T08:02:26.705 INFO:tasks.workunit.client.1.smithi129.stdout:2/108: dwrite d1/dc/ff [0,4194304] 0 2024-09-21T08:02:26.706 INFO:tasks.workunit.client.1.smithi129.stdout:7/109: mknod d0/d1e/c2d 0 2024-09-21T08:02:26.711 INFO:tasks.workunit.client.1.smithi129.stdout:1/93: fsync d1/d4/f21 0 2024-09-21T08:02:26.711 INFO:tasks.workunit.client.1.smithi129.stdout:1/94: creat d1/d9/f22 x:0 0 0 2024-09-21T08:02:26.711 INFO:tasks.workunit.client.1.smithi129.stdout:1/95: readlink l0 0 2024-09-21T08:02:26.711 INFO:tasks.workunit.client.1.smithi129.stdout:5/92: dread d2/f3 [0,4194304] 0 2024-09-21T08:02:26.716 INFO:tasks.workunit.client.1.smithi129.stdout:4/64: read d5/f14 [15205,91838] 0 2024-09-21T08:02:26.716 INFO:tasks.workunit.client.1.smithi129.stdout:7/110: mknod d0/d1e/c2e 0 2024-09-21T08:02:26.717 INFO:tasks.workunit.client.1.smithi129.stdout:2/109: getdents d1/d13 0 2024-09-21T08:02:26.721 INFO:tasks.workunit.client.1.smithi129.stdout:2/110: rename d1/c7 to d1/c29 0 2024-09-21T08:02:26.722 INFO:tasks.workunit.client.1.smithi129.stdout:1/96: truncate d1/d4/f21 170394 0 2024-09-21T08:02:26.723 INFO:tasks.workunit.client.1.smithi129.stdout:4/65: mknod d5/c1d 0 2024-09-21T08:02:26.723 INFO:tasks.workunit.client.1.smithi129.stdout:5/93: dread d2/f4 [0,4194304] 0 2024-09-21T08:02:26.724 INFO:tasks.workunit.client.1.smithi129.stdout:7/111: symlink d0/l2f 0 2024-09-21T08:02:26.725 INFO:tasks.workunit.client.1.smithi129.stdout:2/111: rename d1/d13/fe to d1/d13/d1b/d1f/f2a 0 2024-09-21T08:02:26.726 INFO:tasks.workunit.client.1.smithi129.stdout:4/66: chown d5/c8 239 1 2024-09-21T08:02:26.726 INFO:tasks.workunit.client.1.smithi129.stdout:4/67: dread - d5/d11/f13 zero size 2024-09-21T08:02:26.726 INFO:tasks.workunit.client.1.smithi129.stdout:7/112: mknod d0/d1e/c30 0 2024-09-21T08:02:26.727 INFO:tasks.workunit.client.1.smithi129.stdout:4/68: dread f2 [0,4194304] 0 2024-09-21T08:02:26.727 INFO:tasks.workunit.client.1.smithi129.stdout:2/112: mknod d1/d13/d1b/c2b 0 2024-09-21T08:02:26.729 INFO:tasks.workunit.client.1.smithi129.stdout:4/69: symlink d5/d11/l1e 0 2024-09-21T08:02:26.731 INFO:tasks.workunit.client.1.smithi129.stdout:2/113: creat d1/d13/f2c x:0 0 0 2024-09-21T08:02:26.731 INFO:tasks.workunit.client.1.smithi129.stdout:2/114: creat d1/d13/d1b/f2d x:0 0 0 2024-09-21T08:02:26.731 INFO:tasks.workunit.client.1.smithi129.stdout:2/115: creat d1/f2e x:0 0 0 2024-09-21T08:02:26.731 INFO:tasks.workunit.client.1.smithi129.stdout:2/116: stat d1/d13/f24 0 2024-09-21T08:02:26.734 INFO:tasks.workunit.client.1.smithi129.stdout:0/46: sync 2024-09-21T08:02:26.734 INFO:tasks.workunit.client.1.smithi129.stdout:8/70: sync 2024-09-21T08:02:26.734 INFO:tasks.workunit.client.1.smithi129.stdout:9/90: sync 2024-09-21T08:02:26.734 INFO:tasks.workunit.client.1.smithi129.stdout:9/91: chown c2 1704 1 2024-09-21T08:02:26.734 INFO:tasks.workunit.client.1.smithi129.stdout:0/47: chown f7 2366439 1 2024-09-21T08:02:26.734 INFO:tasks.workunit.client.1.smithi129.stdout:9/92: readlink l7 0 2024-09-21T08:02:26.735 INFO:tasks.workunit.client.1.smithi129.stdout:0/48: unlink f8 0 2024-09-21T08:02:26.735 INFO:tasks.workunit.client.1.smithi129.stdout:8/71: mknod d0/d6/d7/d9/c13 0 2024-09-21T08:02:26.736 INFO:tasks.workunit.client.1.smithi129.stdout:8/72: fsync d0/fe 0 2024-09-21T08:02:26.736 INFO:tasks.workunit.client.1.smithi129.stdout:9/93: link f15 d17/f1d 0 2024-09-21T08:02:26.737 INFO:tasks.workunit.client.1.smithi129.stdout:8/73: dread d0/fe [0,4194304] 0 2024-09-21T08:02:26.737 INFO:tasks.workunit.client.1.smithi129.stdout:0/49: rename f2 to fd 0 2024-09-21T08:02:26.738 INFO:tasks.workunit.client.1.smithi129.stdout:9/94: truncate f4 855229 0 2024-09-21T08:02:26.738 INFO:tasks.workunit.client.1.smithi129.stdout:8/74: symlink d0/d6/l14 0 2024-09-21T08:02:26.740 INFO:tasks.workunit.client.1.smithi129.stdout:8/75: link d0/d6/d7/d9/f12 d0/d6/d7/f15 0 2024-09-21T08:02:26.741 INFO:tasks.workunit.client.1.smithi129.stdout:8/76: rmdir d0/d6/d7 39 2024-09-21T08:02:26.741 INFO:tasks.workunit.client.1.smithi129.stdout:8/77: write d0/d6/d7/f15 [405389,83885] 0 2024-09-21T08:02:26.741 INFO:tasks.workunit.client.1.smithi129.stdout:8/78: write d0/fe [736869,127727] 0 2024-09-21T08:02:26.741 INFO:tasks.workunit.client.1.smithi129.stdout:8/79: truncate d0/d6/d7/f15 543436 0 2024-09-21T08:02:26.741 INFO:tasks.workunit.client.1.smithi129.stdout:2/117: dread d1/d13/f1d [0,4194304] 0 2024-09-21T08:02:26.753 INFO:tasks.workunit.client.1.smithi129.stdout:2/118: write d1/dc/f16 [3484081,19945] 0 2024-09-21T08:02:26.762 INFO:tasks.workunit.client.1.smithi129.stdout:2/119: dread d1/f4 [0,4194304] 0 2024-09-21T08:02:26.777 INFO:tasks.workunit.client.1.smithi129.stdout:3/80: dwrite d3/da/f19 [0,4194304] 0 2024-09-21T08:02:26.779 INFO:tasks.workunit.client.1.smithi129.stdout:5/94: write d2/dc/f13 [2705,8606] 0 2024-09-21T08:02:26.782 INFO:tasks.workunit.client.1.smithi129.stdout:2/120: dwrite d1/d13/f24 [0,4194304] 0 2024-09-21T08:02:26.784 INFO:tasks.workunit.client.1.smithi129.stdout:2/121: symlink d1/d13/d1b/l2f 0 2024-09-21T08:02:26.785 INFO:tasks.workunit.client.1.smithi129.stdout:2/122: read - d1/d13/f2c zero size 2024-09-21T08:02:26.785 INFO:tasks.workunit.client.1.smithi129.stdout:2/123: mknod d1/dc/d26/c30 0 2024-09-21T08:02:26.785 INFO:tasks.workunit.client.1.smithi129.stdout:2/124: chown d1/dc/f18 483517684 1 2024-09-21T08:02:26.785 INFO:tasks.workunit.client.1.smithi129.stdout:2/125: rename d1/d13/d1b/d1f to d1/d13/d1b/d1f/d31 22 2024-09-21T08:02:26.794 INFO:tasks.workunit.client.1.smithi129.stdout:1/97: write d1/d9/f1e [210742,96527] 0 2024-09-21T08:02:26.794 INFO:tasks.workunit.client.1.smithi129.stdout:1/98: dread - d1/f12 zero size 2024-09-21T08:02:26.794 INFO:tasks.workunit.client.1.smithi129.stdout:3/81: dread d3/da/f19 [0,4194304] 0 2024-09-21T08:02:26.802 INFO:tasks.workunit.client.1.smithi129.stdout:1/99: dread d1/f3 [0,4194304] 0 2024-09-21T08:02:26.802 INFO:tasks.workunit.client.1.smithi129.stdout:1/100: mknod d1/c23 0 2024-09-21T08:02:26.804 INFO:tasks.workunit.client.1.smithi129.stdout:1/101: link d1/d4/c18 d1/c24 0 2024-09-21T08:02:26.805 INFO:tasks.workunit.client.1.smithi129.stdout:1/102: mkdir d1/d16/d25 0 2024-09-21T08:02:26.806 INFO:tasks.workunit.client.1.smithi129.stdout:0/50: dwrite f6 [0,4194304] 0 2024-09-21T08:02:26.806 INFO:tasks.workunit.client.1.smithi129.stdout:0/51: chown lc 23483755 1 2024-09-21T08:02:26.806 INFO:tasks.workunit.client.1.smithi129.stdout:9/95: dwrite d17/f1c [0,4194304] 0 2024-09-21T08:02:26.806 INFO:tasks.workunit.client.1.smithi129.stdout:4/70: dwrite d5/d11/f13 [0,4194304] 0 2024-09-21T08:02:26.808 INFO:tasks.workunit.client.1.smithi129.stdout:2/126: dwrite d1/d13/f2c [0,4194304] 0 2024-09-21T08:02:26.808 INFO:tasks.workunit.client.1.smithi129.stdout:1/103: dread d1/d4/fa [0,4194304] 0 2024-09-21T08:02:26.809 INFO:tasks.workunit.client.1.smithi129.stdout:0/52: mkdir de 0 2024-09-21T08:02:26.809 INFO:tasks.workunit.client.1.smithi129.stdout:5/95: dread d2/f17 [0,4194304] 0 2024-09-21T08:02:26.809 INFO:tasks.workunit.client.1.smithi129.stdout:5/96: creat d2/f19 x:0 0 0 2024-09-21T08:02:26.809 INFO:tasks.workunit.client.1.smithi129.stdout:5/97: creat d2/f1a x:0 0 0 2024-09-21T08:02:26.810 INFO:tasks.workunit.client.1.smithi129.stdout:3/82: dwrite d3/f13 [0,4194304] 0 2024-09-21T08:02:26.812 INFO:tasks.workunit.client.1.smithi129.stdout:5/98: dread d2/dc/f12 [0,4194304] 0 2024-09-21T08:02:26.813 INFO:tasks.workunit.client.1.smithi129.stdout:4/71: truncate d5/d6/f7 4282732 0 2024-09-21T08:02:26.813 INFO:tasks.workunit.client.1.smithi129.stdout:4/72: creat d5/d16/f1f x:0 0 0 2024-09-21T08:02:26.814 INFO:tasks.workunit.client.1.smithi129.stdout:1/104: dread d1/d4/f21 [0,4194304] 0 2024-09-21T08:02:26.819 INFO:tasks.workunit.client.1.smithi129.stdout:9/96: truncate f4 1272860 0 2024-09-21T08:02:26.819 INFO:tasks.workunit.client.1.smithi129.stdout:9/97: fdatasync f4 0 2024-09-21T08:02:26.819 INFO:tasks.workunit.client.1.smithi129.stdout:9/98: dread - f13 zero size 2024-09-21T08:02:26.824 INFO:tasks.workunit.client.1.smithi129.stdout:3/83: link d3/l1c d3/da/dc/d11/l1f 0 2024-09-21T08:02:26.826 INFO:tasks.workunit.client.1.smithi129.stdout:4/73: mknod d5/d11/c20 0 2024-09-21T08:02:26.829 INFO:tasks.workunit.client.1.smithi129.stdout:9/99: rename ff to d17/f1e 0 2024-09-21T08:02:26.830 INFO:tasks.workunit.client.1.smithi129.stdout:3/84: rename d3/l8 to d3/l20 0 2024-09-21T08:02:26.830 INFO:tasks.workunit.client.1.smithi129.stdout:1/105: getdents d1/d4 0 2024-09-21T08:02:26.831 INFO:tasks.workunit.client.1.smithi129.stdout:4/74: dread d5/f14 [0,4194304] 0 2024-09-21T08:02:26.831 INFO:tasks.workunit.client.1.smithi129.stdout:4/75: write f2 [99397,32867] 0 2024-09-21T08:02:26.831 INFO:tasks.workunit.client.1.smithi129.stdout:4/76: write d5/d11/f17 [845388,93885] 0 2024-09-21T08:02:26.834 INFO:tasks.workunit.client.1.smithi129.stdout:9/100: link c6 d17/c1f 0 2024-09-21T08:02:26.835 INFO:tasks.workunit.client.1.smithi129.stdout:3/85: creat d3/da/dc/f21 x:0 0 0 2024-09-21T08:02:26.835 INFO:tasks.workunit.client.1.smithi129.stdout:3/86: dread - d3/da/dc/f21 zero size 2024-09-21T08:02:26.836 INFO:tasks.workunit.client.1.smithi129.stdout:1/106: unlink d1/f2 0 2024-09-21T08:02:26.837 INFO:tasks.workunit.client.1.smithi129.stdout:1/107: truncate d1/d4/f21 887057 0 2024-09-21T08:02:26.837 INFO:tasks.workunit.client.1.smithi129.stdout:1/108: read - d1/f12 zero size 2024-09-21T08:02:26.837 INFO:tasks.workunit.client.1.smithi129.stdout:1/109: creat d1/d9/f26 x:0 0 0 2024-09-21T08:02:26.837 INFO:tasks.workunit.client.1.smithi129.stdout:1/110: fsync d1/d4/fa 0 2024-09-21T08:02:26.837 INFO:tasks.workunit.client.1.smithi129.stdout:0/53: dwrite f3 [0,4194304] 0 2024-09-21T08:02:26.837 INFO:tasks.workunit.client.1.smithi129.stdout:0/54: truncate fb 765028 0 2024-09-21T08:02:26.838 INFO:tasks.workunit.client.1.smithi129.stdout:2/127: dwrite d1/dc/f16 [0,4194304] 0 2024-09-21T08:02:26.838 INFO:tasks.workunit.client.1.smithi129.stdout:2/128: readlink d1/lb 0 2024-09-21T08:02:26.838 INFO:tasks.workunit.client.1.smithi129.stdout:0/55: write f0 [2863,20485] 0 2024-09-21T08:02:26.838 INFO:tasks.workunit.client.1.smithi129.stdout:5/99: dwrite d2/f10 [0,4194304] 0 2024-09-21T08:02:26.838 INFO:tasks.workunit.client.1.smithi129.stdout:9/101: mknod d17/c20 0 2024-09-21T08:02:26.838 INFO:tasks.workunit.client.1.smithi129.stdout:9/102: write f15 [489497,26780] 0 2024-09-21T08:02:26.839 INFO:tasks.workunit.client.1.smithi129.stdout:1/111: creat d1/d16/f27 x:0 0 0 2024-09-21T08:02:26.841 INFO:tasks.workunit.client.1.smithi129.stdout:1/112: read d1/f3 [3604849,68053] 0 2024-09-21T08:02:26.841 INFO:tasks.workunit.client.1.smithi129.stdout:4/77: truncate d5/d11/f13 3666413 0 2024-09-21T08:02:26.843 INFO:tasks.workunit.client.1.smithi129.stdout:2/129: mkdir d1/d13/d32 0 2024-09-21T08:02:26.843 INFO:tasks.workunit.client.1.smithi129.stdout:2/130: readlink d1/d13/d1b/l2f 0 2024-09-21T08:02:26.847 INFO:tasks.workunit.client.1.smithi129.stdout:9/103: symlink d17/l21 0 2024-09-21T08:02:26.848 INFO:tasks.workunit.client.1.smithi129.stdout:1/113: mkdir d1/d16/d28 0 2024-09-21T08:02:26.849 INFO:tasks.workunit.client.1.smithi129.stdout:1/114: chown d1/d9/f26 6 1 2024-09-21T08:02:26.849 INFO:tasks.workunit.client.1.smithi129.stdout:1/115: creat d1/d16/f29 x:0 0 0 2024-09-21T08:02:26.849 INFO:tasks.workunit.client.1.smithi129.stdout:9/104: dread f0 [0,4194304] 0 2024-09-21T08:02:26.849 INFO:tasks.workunit.client.1.smithi129.stdout:9/105: write d17/f1c [5184225,40333] 0 2024-09-21T08:02:26.849 INFO:tasks.workunit.client.1.smithi129.stdout:9/106: chown c2 133755888 1 2024-09-21T08:02:26.850 INFO:tasks.workunit.client.1.smithi129.stdout:4/78: unlink d5/d6/f12 0 2024-09-21T08:02:26.850 INFO:tasks.workunit.client.1.smithi129.stdout:0/56: write f3 [1550388,51402] 0 2024-09-21T08:02:26.854 INFO:tasks.workunit.client.1.smithi129.stdout:2/131: creat d1/dc/d26/f33 x:0 0 0 2024-09-21T08:02:26.854 INFO:tasks.workunit.client.1.smithi129.stdout:2/132: creat d1/d13/d1b/f34 x:0 0 0 2024-09-21T08:02:26.854 INFO:tasks.workunit.client.1.smithi129.stdout:9/107: mkdir d17/d22 0 2024-09-21T08:02:26.857 INFO:tasks.workunit.client.1.smithi129.stdout:3/87: dwrite d3/f5 [0,4194304] 0 2024-09-21T08:02:26.859 INFO:tasks.workunit.client.1.smithi129.stdout:9/108: mkdir d17/d23 0 2024-09-21T08:02:26.861 INFO:tasks.workunit.client.1.smithi129.stdout:3/88: link d3/da/f1a d3/da/dc/f22 0 2024-09-21T08:02:26.862 INFO:tasks.workunit.client.1.smithi129.stdout:3/89: creat d3/da/dc/f23 x:0 0 0 2024-09-21T08:02:26.862 INFO:tasks.workunit.client.1.smithi129.stdout:5/100: truncate d2/f10 982369 0 2024-09-21T08:02:26.863 INFO:tasks.workunit.client.1.smithi129.stdout:5/101: creat d2/f1b x:0 0 0 2024-09-21T08:02:26.863 INFO:tasks.workunit.client.1.smithi129.stdout:5/102: chown d2/f3 53564748 1 2024-09-21T08:02:26.863 INFO:tasks.workunit.client.1.smithi129.stdout:5/103: write d2/f5 [2882872,65439] 0 2024-09-21T08:02:26.863 INFO:tasks.workunit.client.1.smithi129.stdout:5/104: truncate d2/f5 4333004 0 2024-09-21T08:02:26.864 INFO:tasks.workunit.client.1.smithi129.stdout:9/109: creat d17/d22/f24 x:0 0 0 2024-09-21T08:02:26.866 INFO:tasks.workunit.client.1.smithi129.stdout:3/90: rename d3/da/dc/d11/l1d to d3/da/l24 0 2024-09-21T08:02:26.868 INFO:tasks.workunit.client.1.smithi129.stdout:5/105: mknod d2/c1c 0 2024-09-21T08:02:26.868 INFO:tasks.workunit.client.1.smithi129.stdout:5/106: creat d2/f1d x:0 0 0 2024-09-21T08:02:26.869 INFO:tasks.workunit.client.1.smithi129.stdout:9/110: mknod d17/d23/c25 0 2024-09-21T08:02:26.869 INFO:tasks.workunit.client.1.smithi129.stdout:9/111: dread - f16 zero size 2024-09-21T08:02:26.870 INFO:tasks.workunit.client.1.smithi129.stdout:3/91: rmdir d3/da/dc/d11 39 2024-09-21T08:02:26.871 INFO:tasks.workunit.client.1.smithi129.stdout:1/116: dwrite d1/d4/fa [4194304,4194304] 0 2024-09-21T08:02:26.871 INFO:tasks.workunit.client.1.smithi129.stdout:0/57: dread f3 [0,4194304] 0 2024-09-21T08:02:26.871 INFO:tasks.workunit.client.1.smithi129.stdout:2/133: rmdir d1/d13 39 2024-09-21T08:02:26.873 INFO:tasks.workunit.client.1.smithi129.stdout:5/107: mkdir d2/d1e 0 2024-09-21T08:02:26.873 INFO:tasks.workunit.client.1.smithi129.stdout:3/92: stat d3/da/c10 0 2024-09-21T08:02:26.880 INFO:tasks.workunit.client.1.smithi129.stdout:4/79: dread d5/d11/f13 [0,4194304] 0 2024-09-21T08:02:26.887 INFO:tasks.workunit.client.1.smithi129.stdout:0/58: mknod de/cf 0 2024-09-21T08:02:26.887 INFO:tasks.workunit.client.1.smithi129.stdout:0/59: write f7 [951221,94870] 0 2024-09-21T08:02:26.888 INFO:tasks.workunit.client.1.smithi129.stdout:0/60: write f3 [2519458,63440] 0 2024-09-21T08:02:26.888 INFO:tasks.workunit.client.1.smithi129.stdout:5/108: rmdir d2/dc 39 2024-09-21T08:02:26.889 INFO:tasks.workunit.client.1.smithi129.stdout:3/93: unlink d3/f5 0 2024-09-21T08:02:26.890 INFO:tasks.workunit.client.1.smithi129.stdout:4/80: rename d5/d16/d1b to d5/d11/d21 0 2024-09-21T08:02:26.892 INFO:tasks.workunit.client.1.smithi129.stdout:0/61: symlink de/l10 0 2024-09-21T08:02:26.892 INFO:tasks.workunit.client.1.smithi129.stdout:0/62: truncate f0 640802 0 2024-09-21T08:02:26.893 INFO:tasks.workunit.client.1.smithi129.stdout:5/109: creat d2/d1e/f1f x:0 0 0 2024-09-21T08:02:26.893 INFO:tasks.workunit.client.1.smithi129.stdout:3/94: mkdir d3/da/dc/d25 0 2024-09-21T08:02:26.894 INFO:tasks.workunit.client.1.smithi129.stdout:4/81: dread d5/d11/f13 [0,4194304] 0 2024-09-21T08:02:26.895 INFO:tasks.workunit.client.1.smithi129.stdout:0/63: unlink de/cf 0 2024-09-21T08:02:26.895 INFO:tasks.workunit.client.1.smithi129.stdout:0/64: write f0 [1170317,94376] 0 2024-09-21T08:02:26.897 INFO:tasks.workunit.client.1.smithi129.stdout:5/110: unlink d2/f10 0 2024-09-21T08:02:26.897 INFO:tasks.workunit.client.1.smithi129.stdout:5/111: dread - d2/f19 zero size 2024-09-21T08:02:26.897 INFO:tasks.workunit.client.1.smithi129.stdout:3/95: creat d3/da/dc/d25/f26 x:0 0 0 2024-09-21T08:02:26.899 INFO:tasks.workunit.client.1.smithi129.stdout:1/117: dwrite d1/f3 [4194304,4194304] 0 2024-09-21T08:02:26.899 INFO:tasks.workunit.client.1.smithi129.stdout:9/112: dwrite f0 [0,4194304] 0 2024-09-21T08:02:26.900 INFO:tasks.workunit.client.1.smithi129.stdout:5/112: mknod d2/c20 0 2024-09-21T08:02:26.902 INFO:tasks.workunit.client.1.smithi129.stdout:3/96: mkdir d3/d1e/d27 0 2024-09-21T08:02:26.902 INFO:tasks.workunit.client.1.smithi129.stdout:8/80: sync 2024-09-21T08:02:26.902 INFO:tasks.workunit.client.1.smithi129.stdout:7/113: sync 2024-09-21T08:02:26.902 INFO:tasks.workunit.client.1.smithi129.stdout:7/114: write d0/d1e/f23 [125638,47821] 0 2024-09-21T08:02:26.902 INFO:tasks.workunit.client.1.smithi129.stdout:6/68: sync 2024-09-21T08:02:26.904 INFO:tasks.workunit.client.1.smithi129.stdout:6/69: write d7/f8 [113537,67038] 0 2024-09-21T08:02:26.905 INFO:tasks.workunit.client.1.smithi129.stdout:9/113: read f10 [4068241,101475] 0 2024-09-21T08:02:26.905 INFO:tasks.workunit.client.1.smithi129.stdout:9/114: truncate f16 131585 0 2024-09-21T08:02:26.905 INFO:tasks.workunit.client.1.smithi129.stdout:4/82: getdents d5/d11 0 2024-09-21T08:02:26.907 INFO:tasks.workunit.client.1.smithi129.stdout:3/97: write d3/da/dc/f22 [199107,118077] 0 2024-09-21T08:02:26.907 INFO:tasks.workunit.client.1.smithi129.stdout:8/81: truncate d0/fe 853163 0 2024-09-21T08:02:26.907 INFO:tasks.workunit.client.1.smithi129.stdout:3/98: chown d3/da/f19 675307045 1 2024-09-21T08:02:26.909 INFO:tasks.workunit.client.1.smithi129.stdout:6/70: mknod d7/d10/c17 0 2024-09-21T08:02:26.910 INFO:tasks.workunit.client.1.smithi129.stdout:9/115: creat d17/f26 x:0 0 0 2024-09-21T08:02:26.912 INFO:tasks.workunit.client.1.smithi129.stdout:4/83: symlink d5/d16/l22 0 2024-09-21T08:02:26.920 INFO:tasks.workunit.client.1.smithi129.stdout:4/84: write f2 [92499,77937] 0 2024-09-21T08:02:26.920 INFO:tasks.workunit.client.1.smithi129.stdout:3/99: creat d3/d1e/f28 x:0 0 0 2024-09-21T08:02:26.922 INFO:tasks.workunit.client.1.smithi129.stdout:6/71: mknod d7/d10/c18 0 2024-09-21T08:02:26.922 INFO:tasks.workunit.client.1.smithi129.stdout:6/72: creat d7/d10/f19 x:0 0 0 2024-09-21T08:02:26.922 INFO:tasks.workunit.client.1.smithi129.stdout:6/73: fsync d7/f9 0 2024-09-21T08:02:26.923 INFO:tasks.workunit.client.1.smithi129.stdout:9/116: mkdir d17/d27 0 2024-09-21T08:02:26.927 INFO:tasks.workunit.client.1.smithi129.stdout:4/85: truncate d5/f14 2550004 0 2024-09-21T08:02:26.927 INFO:tasks.workunit.client.1.smithi129.stdout:7/115: read d0/fe [1237981,122901] 0 2024-09-21T08:02:26.929 INFO:tasks.workunit.client.1.smithi129.stdout:6/74: rename d7/d10/c18 to d7/c1a 0 2024-09-21T08:02:26.929 INFO:tasks.workunit.client.1.smithi129.stdout:6/75: chown d7/l11 116250 1 2024-09-21T08:02:26.930 INFO:tasks.workunit.client.1.smithi129.stdout:9/117: mknod d17/d22/c28 0 2024-09-21T08:02:26.930 INFO:tasks.workunit.client.1.smithi129.stdout:9/118: creat d17/d22/f29 x:0 0 0 2024-09-21T08:02:26.932 INFO:tasks.workunit.client.1.smithi129.stdout:7/116: symlink d0/d1e/l31 0 2024-09-21T08:02:26.932 INFO:tasks.workunit.client.1.smithi129.stdout:7/117: stat d0/l28 0 2024-09-21T08:02:26.932 INFO:tasks.workunit.client.1.smithi129.stdout:7/118: dread - d0/f24 zero size 2024-09-21T08:02:26.933 INFO:tasks.workunit.client.1.smithi129.stdout:7/119: write d0/d1e/f23 [920598,49009] 0 2024-09-21T08:02:26.933 INFO:tasks.workunit.client.1.smithi129.stdout:6/76: unlink d7/cf 0 2024-09-21T08:02:26.933 INFO:tasks.workunit.client.1.smithi129.stdout:4/86: rmdir d5/d6 39 2024-09-21T08:02:26.934 INFO:tasks.workunit.client.1.smithi129.stdout:6/77: mkdir d7/d1b 0 2024-09-21T08:02:26.945 INFO:tasks.workunit.client.1.smithi129.stdout:6/78: write d7/fa [3779989,59394] 0 2024-09-21T08:02:26.945 INFO:tasks.workunit.client.1.smithi129.stdout:6/79: fdatasync f4 0 2024-09-21T08:02:26.946 INFO:tasks.workunit.client.1.smithi129.stdout:6/80: write d7/fd [29722,879] 0 2024-09-21T08:02:26.955 INFO:tasks.workunit.client.1.smithi129.stdout:5/113: dwrite d2/f4 [0,4194304] 0 2024-09-21T08:02:26.955 INFO:tasks.workunit.client.1.smithi129.stdout:5/114: stat d2/dc/l15 0 2024-09-21T08:02:26.955 INFO:tasks.workunit.client.1.smithi129.stdout:5/115: chown d2/l16 88143 1 2024-09-21T08:02:26.955 INFO:tasks.workunit.client.1.smithi129.stdout:0/65: dwrite fd [0,4194304] 0 2024-09-21T08:02:26.956 INFO:tasks.workunit.client.1.smithi129.stdout:5/116: getdents d2/dc 0 2024-09-21T08:02:26.957 INFO:tasks.workunit.client.1.smithi129.stdout:5/117: mknod d2/c21 0 2024-09-21T08:02:26.957 INFO:tasks.workunit.client.1.smithi129.stdout:5/118: chown d2/dc/f12 960 1 2024-09-21T08:02:26.958 INFO:tasks.workunit.client.1.smithi129.stdout:5/119: creat d2/dc/f22 x:0 0 0 2024-09-21T08:02:26.964 INFO:tasks.workunit.client.1.smithi129.stdout:1/118: dwrite d1/f15 [4194304,4194304] 0 2024-09-21T08:02:26.964 INFO:tasks.workunit.client.1.smithi129.stdout:1/119: creat d1/d16/f2a x:0 0 0 2024-09-21T08:02:26.964 INFO:tasks.workunit.client.1.smithi129.stdout:1/120: dread - d1/d9/f22 zero size 2024-09-21T08:02:26.964 INFO:tasks.workunit.client.1.smithi129.stdout:1/121: getdents d1/d16/d25 0 2024-09-21T08:02:26.964 INFO:tasks.workunit.client.1.smithi129.stdout:1/122: dread - d1/d16/f2a zero size 2024-09-21T08:02:26.964 INFO:tasks.workunit.client.1.smithi129.stdout:1/123: stat d1/d9/f22 0 2024-09-21T08:02:26.965 INFO:tasks.workunit.client.1.smithi129.stdout:1/124: link d1/c19 d1/d4/c2b 0 2024-09-21T08:02:26.966 INFO:tasks.workunit.client.1.smithi129.stdout:1/125: symlink d1/d4/l2c 0 2024-09-21T08:02:26.967 INFO:tasks.workunit.client.1.smithi129.stdout:1/126: truncate d1/d9/f1e 1531057 0 2024-09-21T08:02:26.967 INFO:tasks.workunit.client.1.smithi129.stdout:3/100: dwrite d3/da/f19 [4194304,4194304] 0 2024-09-21T08:02:26.967 INFO:tasks.workunit.client.1.smithi129.stdout:4/87: dwrite d5/d6/f7 [0,4194304] 0 2024-09-21T08:02:26.967 INFO:tasks.workunit.client.1.smithi129.stdout:0/66: dread f0 [0,4194304] 0 2024-09-21T08:02:26.968 INFO:tasks.workunit.client.1.smithi129.stdout:7/120: dwrite d0/f17 [0,4194304] 0 2024-09-21T08:02:26.972 INFO:tasks.workunit.client.1.smithi129.stdout:0/67: creat de/f11 x:0 0 0 2024-09-21T08:02:26.972 INFO:tasks.workunit.client.1.smithi129.stdout:0/68: chown c9 46123325 1 2024-09-21T08:02:26.972 INFO:tasks.workunit.client.1.smithi129.stdout:0/69: stat de 0 2024-09-21T08:02:26.972 INFO:tasks.workunit.client.1.smithi129.stdout:0/70: chown f0 7775256 1 2024-09-21T08:02:26.972 INFO:tasks.workunit.client.1.smithi129.stdout:5/120: write d2/dc/ff [3564129,69857] 0 2024-09-21T08:02:26.972 INFO:tasks.workunit.client.1.smithi129.stdout:1/127: write d1/d9/f1e [1208401,80242] 0 2024-09-21T08:02:26.972 INFO:tasks.workunit.client.1.smithi129.stdout:1/128: readlink d1/d16/l1c 0 2024-09-21T08:02:26.973 INFO:tasks.workunit.client.1.smithi129.stdout:6/81: dwrite d7/f9 [0,4194304] 0 2024-09-21T08:02:26.973 INFO:tasks.workunit.client.1.smithi129.stdout:6/82: chown c6 1 1 2024-09-21T08:02:26.973 INFO:tasks.workunit.client.1.smithi129.stdout:6/83: chown d7/f9 623202585 1 2024-09-21T08:02:26.974 INFO:tasks.workunit.client.1.smithi129.stdout:5/121: rename d2/f5 to d2/f23 0 2024-09-21T08:02:26.974 INFO:tasks.workunit.client.1.smithi129.stdout:5/122: dread - d2/f1a zero size 2024-09-21T08:02:26.975 INFO:tasks.workunit.client.1.smithi129.stdout:5/123: chown d2/l16 19496912 1 2024-09-21T08:02:26.980 INFO:tasks.workunit.client.1.smithi129.stdout:1/129: mknod d1/d16/d28/c2d 0 2024-09-21T08:02:26.980 INFO:tasks.workunit.client.1.smithi129.stdout:1/130: chown d1/d16 8 1 2024-09-21T08:02:26.984 INFO:tasks.workunit.client.1.smithi129.stdout:3/101: dread d3/f4 [0,4194304] 0 2024-09-21T08:02:26.985 INFO:tasks.workunit.client.1.smithi129.stdout:1/131: write d1/d9/f1e [1391733,116260] 0 2024-09-21T08:02:26.989 INFO:tasks.workunit.client.1.smithi129.stdout:0/71: write f6 [348072,1510] 0 2024-09-21T08:02:26.989 INFO:tasks.workunit.client.1.smithi129.stdout:6/84: mkdir d7/d1b/d1c 0 2024-09-21T08:02:26.990 INFO:tasks.workunit.client.1.smithi129.stdout:4/88: dwrite d5/d16/f18 [0,4194304] 0 2024-09-21T08:02:26.991 INFO:tasks.workunit.client.1.smithi129.stdout:3/102: getdents d3/da/dc/d11 0 2024-09-21T08:02:26.994 INFO:tasks.workunit.client.1.smithi129.stdout:6/85: creat d7/d1b/d1c/f1d x:0 0 0 2024-09-21T08:02:26.997 INFO:tasks.workunit.client.1.smithi129.stdout:6/86: mkdir d7/d1b/d1e 0 2024-09-21T08:02:26.997 INFO:tasks.workunit.client.1.smithi129.stdout:6/87: creat d7/d10/f1f x:0 0 0 2024-09-21T08:02:27.000 INFO:tasks.workunit.client.1.smithi129.stdout:0/72: dread fd [0,4194304] 0 2024-09-21T08:02:27.002 INFO:tasks.workunit.client.1.smithi129.stdout:6/88: symlink d7/l20 0 2024-09-21T08:02:27.002 INFO:tasks.workunit.client.1.smithi129.stdout:6/89: creat d7/d10/f21 x:0 0 0 2024-09-21T08:02:27.002 INFO:tasks.workunit.client.1.smithi129.stdout:6/90: creat d7/d10/f22 x:0 0 0 2024-09-21T08:02:27.002 INFO:tasks.workunit.client.1.smithi129.stdout:6/91: chown d7 60339 1 2024-09-21T08:02:27.002 INFO:tasks.workunit.client.1.smithi129.stdout:6/92: chown d7/d10/f16 0 1 2024-09-21T08:02:27.002 INFO:tasks.workunit.client.1.smithi129.stdout:4/89: dread d5/d16/f18 [0,4194304] 0 2024-09-21T08:02:27.003 INFO:tasks.workunit.client.1.smithi129.stdout:1/132: fdatasync d1/d9/f1e 0 2024-09-21T08:02:27.003 INFO:tasks.workunit.client.1.smithi129.stdout:1/133: read d1/f15 [3324800,44707] 0 2024-09-21T08:02:27.004 INFO:tasks.workunit.client.1.smithi129.stdout:7/121: dwrite d0/d1e/f21 [0,4194304] 0 2024-09-21T08:02:27.004 INFO:tasks.workunit.client.1.smithi129.stdout:7/122: chown d0/d1e/l2b 676967378 1 2024-09-21T08:02:27.004 INFO:tasks.workunit.client.1.smithi129.stdout:7/123: chown d0/fe 0 1 2024-09-21T08:02:27.006 INFO:tasks.workunit.client.1.smithi129.stdout:0/73: getdents de 0 2024-09-21T08:02:27.006 INFO:tasks.workunit.client.1.smithi129.stdout:0/74: write de/f11 [34288,37745] 0 2024-09-21T08:02:27.007 INFO:tasks.workunit.client.1.smithi129.stdout:4/90: write d5/d11/f13 [2536485,103490] 0 2024-09-21T08:02:27.007 INFO:tasks.workunit.client.1.smithi129.stdout:5/124: dwrite f1 [0,4194304] 0 2024-09-21T08:02:27.007 INFO:tasks.workunit.client.1.smithi129.stdout:1/134: creat d1/d16/d28/f2e x:0 0 0 2024-09-21T08:02:27.008 INFO:tasks.workunit.client.1.smithi129.stdout:0/75: read f7 [775133,54799] 0 2024-09-21T08:02:27.009 INFO:tasks.workunit.client.1.smithi129.stdout:7/124: symlink d0/d1e/l32 0 2024-09-21T08:02:27.012 INFO:tasks.workunit.client.1.smithi129.stdout:4/91: link d5/ce d5/d6/c23 0 2024-09-21T08:02:27.012 INFO:tasks.workunit.client.1.smithi129.stdout:4/92: stat d5/d11/l1e 0 2024-09-21T08:02:27.012 INFO:tasks.workunit.client.1.smithi129.stdout:4/93: getdents d5/d11 0 2024-09-21T08:02:27.012 INFO:tasks.workunit.client.1.smithi129.stdout:4/94: readlink d5/d6/l9 0 2024-09-21T08:02:27.013 INFO:tasks.workunit.client.1.smithi129.stdout:0/76: dread f3 [0,4194304] 0 2024-09-21T08:02:27.013 INFO:tasks.workunit.client.1.smithi129.stdout:3/103: dwrite d3/f13 [4194304,4194304] 0 2024-09-21T08:02:27.013 INFO:tasks.workunit.client.1.smithi129.stdout:3/104: write d3/da/f1a [4677691,24773] 0 2024-09-21T08:02:27.014 INFO:tasks.workunit.client.1.smithi129.stdout:3/105: stat d3/da/dc/d11/l1b 0 2024-09-21T08:02:27.014 INFO:tasks.workunit.client.1.smithi129.stdout:3/106: readlink d3/da/le 0 2024-09-21T08:02:27.016 INFO:tasks.workunit.client.1.smithi129.stdout:1/135: unlink d1/c11 0 2024-09-21T08:02:27.016 INFO:tasks.workunit.client.1.smithi129.stdout:3/107: dread d3/da/ff [0,4194304] 0 2024-09-21T08:02:27.017 INFO:tasks.workunit.client.1.smithi129.stdout:3/108: write d3/da/dc/f22 [5510460,72484] 0 2024-09-21T08:02:27.017 INFO:tasks.workunit.client.1.smithi129.stdout:3/109: read - d3/da/dc/d25/f26 zero size 2024-09-21T08:02:27.017 INFO:tasks.workunit.client.1.smithi129.stdout:7/125: symlink d0/d1e/l33 0 2024-09-21T08:02:27.018 INFO:tasks.workunit.client.1.smithi129.stdout:4/95: rmdir d5/d11 39 2024-09-21T08:02:27.020 INFO:tasks.workunit.client.1.smithi129.stdout:1/136: dread d1/d4/f21 [0,4194304] 0 2024-09-21T08:02:27.020 INFO:tasks.workunit.client.1.smithi129.stdout:0/77: creat de/f12 x:0 0 0 2024-09-21T08:02:27.020 INFO:tasks.workunit.client.1.smithi129.stdout:0/78: write f6 [4811783,108186] 0 2024-09-21T08:02:27.020 INFO:tasks.workunit.client.1.smithi129.stdout:0/79: creat de/f13 x:0 0 0 2024-09-21T08:02:27.020 INFO:tasks.workunit.client.1.smithi129.stdout:0/80: readlink la 0 2024-09-21T08:02:27.020 INFO:tasks.workunit.client.1.smithi129.stdout:0/81: fdatasync f3 0 2024-09-21T08:02:27.023 INFO:tasks.workunit.client.1.smithi129.stdout:5/125: rmdir d2 39 2024-09-21T08:02:27.023 INFO:tasks.workunit.client.1.smithi129.stdout:5/126: readlink d2/la 0 2024-09-21T08:02:27.023 INFO:tasks.workunit.client.1.smithi129.stdout:5/127: chown d2/dc/ff 83406417 1 2024-09-21T08:02:27.027 INFO:tasks.workunit.client.1.smithi129.stdout:1/137: mknod d1/c2f 0 2024-09-21T08:02:27.027 INFO:tasks.workunit.client.1.smithi129.stdout:1/138: chown d1/c2f 947 1 2024-09-21T08:02:27.027 INFO:tasks.workunit.client.1.smithi129.stdout:2/134: sync 2024-09-21T08:02:27.027 INFO:tasks.workunit.client.1.smithi129.stdout:1/139: creat d1/f30 x:0 0 0 2024-09-21T08:02:27.028 INFO:tasks.workunit.client.1.smithi129.stdout:4/96: write d5/d16/f18 [4446272,13451] 0 2024-09-21T08:02:27.029 INFO:tasks.workunit.client.1.smithi129.stdout:7/126: write d0/f17 [913808,71469] 0 2024-09-21T08:02:27.029 INFO:tasks.workunit.client.1.smithi129.stdout:5/128: rmdir d2/dc 39 2024-09-21T08:02:27.029 INFO:tasks.workunit.client.1.smithi129.stdout:7/127: fdatasync d0/d1e/f23 0 2024-09-21T08:02:27.029 INFO:tasks.workunit.client.1.smithi129.stdout:5/129: read d2/dc/f12 [136180,24165] 0 2024-09-21T08:02:27.030 INFO:tasks.workunit.client.1.smithi129.stdout:7/128: stat d0/d1e/l31 0 2024-09-21T08:02:27.032 INFO:tasks.workunit.client.1.smithi129.stdout:4/97: write d5/d16/f18 [3921958,77047] 0 2024-09-21T08:02:27.032 INFO:tasks.workunit.client.1.smithi129.stdout:1/140: getdents d1/d4 0 2024-09-21T08:02:27.032 INFO:tasks.workunit.client.1.smithi129.stdout:1/141: stat d1/f30 0 2024-09-21T08:02:27.032 INFO:tasks.workunit.client.1.smithi129.stdout:1/142: truncate d1/d9/f22 850655 0 2024-09-21T08:02:27.033 INFO:tasks.workunit.client.1.smithi129.stdout:1/143: fsync d1/d9/f1e 0 2024-09-21T08:02:27.033 INFO:tasks.workunit.client.1.smithi129.stdout:2/135: rmdir d1/d13/d1b 39 2024-09-21T08:02:27.034 INFO:tasks.workunit.client.1.smithi129.stdout:6/93: getdents d7 0 2024-09-21T08:02:27.034 INFO:tasks.workunit.client.1.smithi129.stdout:6/94: chown c6 494320530 1 2024-09-21T08:02:27.036 INFO:tasks.workunit.client.1.smithi129.stdout:5/130: creat d2/f24 x:0 0 0 2024-09-21T08:02:27.037 INFO:tasks.workunit.client.1.smithi129.stdout:7/129: mknod d0/d1e/c34 0 2024-09-21T08:02:27.037 INFO:tasks.workunit.client.1.smithi129.stdout:7/130: write d0/f20 [5200248,96050] 0 2024-09-21T08:02:27.040 INFO:tasks.workunit.client.1.smithi129.stdout:4/98: rename d5/d11/d21 to d5/d16/d24 0 2024-09-21T08:02:27.040 INFO:tasks.workunit.client.1.smithi129.stdout:4/99: read d5/d11/f13 [2054929,73085] 0 2024-09-21T08:02:27.041 INFO:tasks.workunit.client.1.smithi129.stdout:1/144: mkdir d1/d9/d31 0 2024-09-21T08:02:27.042 INFO:tasks.workunit.client.1.smithi129.stdout:5/131: mkdir d2/dc/d25 0 2024-09-21T08:02:27.044 INFO:tasks.workunit.client.1.smithi129.stdout:3/110: dwrite d3/da/dc/f21 [0,4194304] 0 2024-09-21T08:02:27.044 INFO:tasks.workunit.client.1.smithi129.stdout:3/111: creat d3/f29 x:0 0 0 2024-09-21T08:02:27.044 INFO:tasks.workunit.client.1.smithi129.stdout:3/112: write d3/da/f1a [1470054,127341] 0 2024-09-21T08:02:27.045 INFO:tasks.workunit.client.1.smithi129.stdout:4/100: dread d5/d11/f17 [0,4194304] 0 2024-09-21T08:02:27.045 INFO:tasks.workunit.client.1.smithi129.stdout:1/145: symlink d1/d9/l32 0 2024-09-21T08:02:27.045 INFO:tasks.workunit.client.1.smithi129.stdout:1/146: write d1/d9/f1a [652032,29020] 0 2024-09-21T08:02:27.047 INFO:tasks.workunit.client.1.smithi129.stdout:2/136: write d1/dc/f18 [1619804,449] 0 2024-09-21T08:02:27.047 INFO:tasks.workunit.client.1.smithi129.stdout:2/137: write d1/d13/d1b/f34 [374624,120308] 0 2024-09-21T08:02:27.047 INFO:tasks.workunit.client.1.smithi129.stdout:2/138: write d1/d13/d1b/f2d [901517,105515] 0 2024-09-21T08:02:27.047 INFO:tasks.workunit.client.1.smithi129.stdout:5/132: unlink d2/dc/f13 0 2024-09-21T08:02:27.047 INFO:tasks.workunit.client.1.smithi129.stdout:2/139: chown d1/d13 281 1 2024-09-21T08:02:27.047 INFO:tasks.workunit.client.1.smithi129.stdout:2/140: chown d1/d13/c11 15714296 1 2024-09-21T08:02:27.047 INFO:tasks.workunit.client.1.smithi129.stdout:2/141: chown d1/d13/d1b/d1f/f25 700540289 1 2024-09-21T08:02:27.048 INFO:tasks.workunit.client.1.smithi129.stdout:2/142: getdents d1/d13/d32 0 2024-09-21T08:02:27.048 INFO:tasks.workunit.client.1.smithi129.stdout:2/143: fdatasync d1/d13/d1b/d1f/f25 0 2024-09-21T08:02:27.048 INFO:tasks.workunit.client.1.smithi129.stdout:2/144: stat d1/d13/c1a 0 2024-09-21T08:02:27.048 INFO:tasks.workunit.client.1.smithi129.stdout:7/131: symlink d0/l35 0 2024-09-21T08:02:27.048 INFO:tasks.workunit.client.1.smithi129.stdout:7/132: fdatasync d0/f5 0 2024-09-21T08:02:27.051 INFO:tasks.workunit.client.1.smithi129.stdout:7/133: dread d0/d1e/f23 [0,4194304] 0 2024-09-21T08:02:27.051 INFO:tasks.workunit.client.1.smithi129.stdout:4/101: rmdir d5/d6 39 2024-09-21T08:02:27.051 INFO:tasks.workunit.client.1.smithi129.stdout:0/82: dwrite de/f13 [0,4194304] 0 2024-09-21T08:02:27.053 INFO:tasks.workunit.client.1.smithi129.stdout:5/133: unlink d2/c9 0 2024-09-21T08:02:27.053 INFO:tasks.workunit.client.1.smithi129.stdout:5/134: fsync d2/dc/f12 0 2024-09-21T08:02:27.054 INFO:tasks.workunit.client.1.smithi129.stdout:2/145: creat d1/d13/d1b/d1f/f35 x:0 0 0 2024-09-21T08:02:27.054 INFO:tasks.workunit.client.1.smithi129.stdout:2/146: getdents d1/d13/d32 0 2024-09-21T08:02:27.059 INFO:tasks.workunit.client.1.smithi129.stdout:3/113: dread d3/da/dc/fd [0,4194304] 0 2024-09-21T08:02:27.059 INFO:tasks.workunit.client.1.smithi129.stdout:6/95: dwrite d7/fa [4194304,4194304] 0 2024-09-21T08:02:27.061 INFO:tasks.workunit.client.1.smithi129.stdout:6/96: dread d7/f8 [0,4194304] 0 2024-09-21T08:02:27.062 INFO:tasks.workunit.client.1.smithi129.stdout:4/102: dread d5/d6/f7 [0,4194304] 0 2024-09-21T08:02:27.062 INFO:tasks.workunit.client.1.smithi129.stdout:1/147: dwrite d1/f30 [0,4194304] 0 2024-09-21T08:02:27.062 INFO:tasks.workunit.client.1.smithi129.stdout:1/148: dread - d1/d9/f26 zero size 2024-09-21T08:02:27.062 INFO:tasks.workunit.client.1.smithi129.stdout:1/149: getdents d1/d16/d25 0 2024-09-21T08:02:27.062 INFO:tasks.workunit.client.1.smithi129.stdout:1/150: creat d1/d16/d28/f33 x:0 0 0 2024-09-21T08:02:27.069 INFO:tasks.workunit.client.1.smithi129.stdout:0/83: symlink de/l14 0 2024-09-21T08:02:27.072 INFO:tasks.workunit.client.1.smithi129.stdout:2/147: dwrite d1/d13/d1b/d1f/f22 [0,4194304] 0 2024-09-21T08:02:27.073 INFO:tasks.workunit.client.1.smithi129.stdout:2/148: dread d1/d13/f14 [0,4194304] 0 2024-09-21T08:02:27.074 INFO:tasks.workunit.client.1.smithi129.stdout:6/97: creat d7/d1b/f23 x:0 0 0 2024-09-21T08:02:27.075 INFO:tasks.workunit.client.1.smithi129.stdout:4/103: creat d5/f25 x:0 0 0 2024-09-21T08:02:27.077 INFO:tasks.workunit.client.1.smithi129.stdout:7/134: truncate d0/d1e/f21 1756601 0 2024-09-21T08:02:27.078 INFO:tasks.workunit.client.1.smithi129.stdout:1/151: symlink d1/d9/l34 0 2024-09-21T08:02:27.080 INFO:tasks.workunit.client.1.smithi129.stdout:5/135: mknod d2/c26 0 2024-09-21T08:02:27.082 INFO:tasks.workunit.client.1.smithi129.stdout:3/114: truncate d3/da/dc/f21 2952278 0 2024-09-21T08:02:27.083 INFO:tasks.workunit.client.1.smithi129.stdout:2/149: mkdir d1/dc/d19/d36 0 2024-09-21T08:02:27.083 INFO:tasks.workunit.client.1.smithi129.stdout:2/150: creat d1/dc/f37 x:0 0 0 2024-09-21T08:02:27.085 INFO:tasks.workunit.client.1.smithi129.stdout:6/98: link d7/d10/f21 d7/f24 0 2024-09-21T08:02:27.085 INFO:tasks.workunit.client.1.smithi129.stdout:6/99: readlink d7/l11 0 2024-09-21T08:02:27.086 INFO:tasks.workunit.client.1.smithi129.stdout:4/104: creat d5/d6/f26 x:0 0 0 2024-09-21T08:02:27.088 INFO:tasks.workunit.client.1.smithi129.stdout:0/84: dwrite de/f13 [0,4194304] 0 2024-09-21T08:02:27.088 INFO:tasks.workunit.client.1.smithi129.stdout:7/135: creat d0/d1e/f36 x:0 0 0 2024-09-21T08:02:27.088 INFO:tasks.workunit.client.1.smithi129.stdout:7/136: write d0/d1e/f23 [1308579,84590] 0 2024-09-21T08:02:27.089 INFO:tasks.workunit.client.1.smithi129.stdout:5/136: getdents d2/dc/d25 0 2024-09-21T08:02:27.091 INFO:tasks.workunit.client.1.smithi129.stdout:2/151: creat d1/dc/d19/f38 x:0 0 0 2024-09-21T08:02:27.091 INFO:tasks.workunit.client.1.smithi129.stdout:2/152: creat d1/f39 x:0 0 0 2024-09-21T08:02:27.093 INFO:tasks.workunit.client.1.smithi129.stdout:1/152: getdents d1 0 2024-09-21T08:02:27.094 INFO:tasks.workunit.client.1.smithi129.stdout:7/137: creat d0/f37 x:0 0 0 2024-09-21T08:02:27.095 INFO:tasks.workunit.client.1.smithi129.stdout:0/85: write fd [2921217,65819] 0 2024-09-21T08:02:27.095 INFO:tasks.workunit.client.1.smithi129.stdout:0/86: chown de/f12 7 1 2024-09-21T08:02:27.095 INFO:tasks.workunit.client.1.smithi129.stdout:5/137: symlink d2/dc/l27 0 2024-09-21T08:02:27.099 INFO:tasks.workunit.client.1.smithi129.stdout:2/153: unlink d1/d13/d1b/f2d 0 2024-09-21T08:02:27.099 INFO:tasks.workunit.client.1.smithi129.stdout:2/154: truncate d1/dc/f21 1048316 0 2024-09-21T08:02:27.101 INFO:tasks.workunit.client.1.smithi129.stdout:1/153: mknod d1/d9/d31/c35 0 2024-09-21T08:02:27.101 INFO:tasks.workunit.client.1.smithi129.stdout:1/154: dread - d1/d16/f27 zero size 2024-09-21T08:02:27.101 INFO:tasks.workunit.client.1.smithi129.stdout:1/155: chown d1/d16/d28/f2e 199 1 2024-09-21T08:02:27.101 INFO:tasks.workunit.client.1.smithi129.stdout:1/156: dread d1/d9/f22 [0,4194304] 0 2024-09-21T08:02:27.102 INFO:tasks.workunit.client.1.smithi129.stdout:7/138: truncate d0/f8 2865334 0 2024-09-21T08:02:27.102 INFO:tasks.workunit.client.1.smithi129.stdout:7/139: chown d0/l19 46 1 2024-09-21T08:02:27.103 INFO:tasks.workunit.client.1.smithi129.stdout:0/87: mkdir de/d15 0 2024-09-21T08:02:27.104 INFO:tasks.workunit.client.1.smithi129.stdout:1/157: dread d1/d4/fa [8388608,4194304] 0 2024-09-21T08:02:27.104 INFO:tasks.workunit.client.1.smithi129.stdout:5/138: dread - d2/f1d zero size 2024-09-21T08:02:27.105 INFO:tasks.workunit.client.1.smithi129.stdout:2/155: mkdir d1/d13/d3a 0 2024-09-21T08:02:27.105 INFO:tasks.workunit.client.1.smithi129.stdout:0/88: mknod de/c16 0 2024-09-21T08:02:27.106 INFO:tasks.workunit.client.1.smithi129.stdout:1/158: symlink d1/d16/l36 0 2024-09-21T08:02:27.107 INFO:tasks.workunit.client.1.smithi129.stdout:2/156: creat d1/d13/d32/f3b x:0 0 0 2024-09-21T08:02:27.109 INFO:tasks.workunit.client.1.smithi129.stdout:1/159: link d1/f15 d1/d16/d25/f37 0 2024-09-21T08:02:27.109 INFO:tasks.workunit.client.1.smithi129.stdout:6/100: dwrite d7/fe [0,4194304] 0 2024-09-21T08:02:27.110 INFO:tasks.workunit.client.1.smithi129.stdout:1/160: mknod d1/d16/d25/c38 0 2024-09-21T08:02:27.111 INFO:tasks.workunit.client.1.smithi129.stdout:6/101: mkdir d7/d1b/d25 0 2024-09-21T08:02:27.111 INFO:tasks.workunit.client.1.smithi129.stdout:6/102: dread - d7/d10/f1f zero size 2024-09-21T08:02:27.113 INFO:tasks.workunit.client.1.smithi129.stdout:6/103: mknod d7/c26 0 2024-09-21T08:02:27.113 INFO:tasks.workunit.client.1.smithi129.stdout:4/105: dwrite d5/d16/f1f [0,4194304] 0 2024-09-21T08:02:27.114 INFO:tasks.workunit.client.1.smithi129.stdout:6/104: mknod d7/d10/c27 0 2024-09-21T08:02:27.117 INFO:tasks.workunit.client.1.smithi129.stdout:4/106: creat d5/d16/d24/f27 x:0 0 0 2024-09-21T08:02:27.118 INFO:tasks.workunit.client.1.smithi129.stdout:7/140: dwrite d0/f20 [0,4194304] 0 2024-09-21T08:02:27.118 INFO:tasks.workunit.client.1.smithi129.stdout:6/105: mknod d7/c28 0 2024-09-21T08:02:27.121 INFO:tasks.workunit.client.1.smithi129.stdout:7/141: unlink d0/f5 0 2024-09-21T08:02:27.121 INFO:tasks.workunit.client.1.smithi129.stdout:7/142: stat d0/d1e/l33 0 2024-09-21T08:02:27.123 INFO:tasks.workunit.client.1.smithi129.stdout:6/106: rename d7/d10/c27 to d7/d1b/d25/c29 0 2024-09-21T08:02:27.125 INFO:tasks.workunit.client.1.smithi129.stdout:7/143: unlink d0/d1e/f27 0 2024-09-21T08:02:27.126 INFO:tasks.workunit.client.1.smithi129.stdout:8/82: sync 2024-09-21T08:02:27.127 INFO:tasks.workunit.client.1.smithi129.stdout:9/119: sync 2024-09-21T08:02:27.127 INFO:tasks.workunit.client.1.smithi129.stdout:8/83: fdatasync d0/d6/d7/d9/f12 0 2024-09-21T08:02:27.127 INFO:tasks.workunit.client.1.smithi129.stdout:9/120: write d17/f1d [773037,14438] 0 2024-09-21T08:02:27.127 INFO:tasks.workunit.client.1.smithi129.stdout:6/107: symlink d7/d1b/d25/l2a 0 2024-09-21T08:02:27.128 INFO:tasks.workunit.client.1.smithi129.stdout:8/84: rename d0/fe to d0/f16 0 2024-09-21T08:02:27.129 INFO:tasks.workunit.client.1.smithi129.stdout:1/161: rmdir d1/d9 39 2024-09-21T08:02:27.130 INFO:tasks.workunit.client.1.smithi129.stdout:9/121: rename d17/f18 to d17/d23/f2a 0 2024-09-21T08:02:27.130 INFO:tasks.workunit.client.1.smithi129.stdout:9/122: chown d17/f1e 2082393 1 2024-09-21T08:02:27.134 INFO:tasks.workunit.client.1.smithi129.stdout:7/144: dread d0/f20 [0,4194304] 0 2024-09-21T08:02:27.135 INFO:tasks.workunit.client.1.smithi129.stdout:1/162: creat d1/f39 x:0 0 0 2024-09-21T08:02:27.136 INFO:tasks.workunit.client.1.smithi129.stdout:7/145: rename d0/fe to d0/d1e/f38 0 2024-09-21T08:02:27.138 INFO:tasks.workunit.client.1.smithi129.stdout:7/146: symlink d0/l39 0 2024-09-21T08:02:27.139 INFO:tasks.workunit.client.1.smithi129.stdout:7/147: mknod d0/c3a 0 2024-09-21T08:02:27.182 INFO:tasks.workunit.client.1.smithi129.stdout:7/148: mknod d0/c3b 0 2024-09-21T08:02:27.184 INFO:tasks.workunit.client.1.smithi129.stdout:7/149: mknod d0/c3c 0 2024-09-21T08:02:27.184 INFO:tasks.workunit.client.1.smithi129.stdout:7/150: creat d0/d1e/f3d x:0 0 0 2024-09-21T08:02:27.184 INFO:tasks.workunit.client.1.smithi129.stdout:7/151: creat d0/d1e/f3e x:0 0 0 2024-09-21T08:02:27.186 INFO:tasks.workunit.client.1.smithi129.stdout:4/107: rmdir d5/d16 39 2024-09-21T08:02:27.188 INFO:tasks.workunit.client.1.smithi129.stdout:4/108: symlink d5/d6/l28 0 2024-09-21T08:02:27.190 INFO:tasks.workunit.client.1.smithi129.stdout:4/109: rename d5/f25 to d5/d16/f29 0 2024-09-21T08:02:27.191 INFO:tasks.workunit.client.1.smithi129.stdout:8/85: dwrite d0/f16 [0,4194304] 0 2024-09-21T08:02:27.191 INFO:tasks.workunit.client.1.smithi129.stdout:8/86: chown d0/f11 0 1 2024-09-21T08:02:27.191 INFO:tasks.workunit.client.1.smithi129.stdout:8/87: fdatasync d0/d6/d7/d9/f12 0 2024-09-21T08:02:27.193 INFO:tasks.workunit.client.1.smithi129.stdout:4/110: mknod d5/d16/d24/c2a 0 2024-09-21T08:02:27.194 INFO:tasks.workunit.client.1.smithi129.stdout:8/88: mkdir d0/d6/d7/d9/d17 0 2024-09-21T08:02:27.194 INFO:tasks.workunit.client.1.smithi129.stdout:8/89: dread - d0/f11 zero size 2024-09-21T08:02:27.195 INFO:tasks.workunit.client.1.smithi129.stdout:1/163: write d1/d16/d25/f37 [8123634,95425] 0 2024-09-21T08:02:27.195 INFO:tasks.workunit.client.1.smithi129.stdout:9/123: dwrite f4 [0,4194304] 0 2024-09-21T08:02:27.197 INFO:tasks.workunit.client.1.smithi129.stdout:1/164: symlink d1/d4/l3a 0 2024-09-21T08:02:27.201 INFO:tasks.workunit.client.1.smithi129.stdout:7/152: dwrite d0/d1e/f36 [0,4194304] 0 2024-09-21T08:02:27.206 INFO:tasks.workunit.client.1.smithi129.stdout:4/111: read d5/d16/f1f [1714589,74971] 0 2024-09-21T08:02:27.207 INFO:tasks.workunit.client.1.smithi129.stdout:1/165: dread d1/d16/d25/f37 [0,4194304] 0 2024-09-21T08:02:27.208 INFO:tasks.workunit.client.1.smithi129.stdout:4/112: creat d5/f2b x:0 0 0 2024-09-21T08:02:27.208 INFO:tasks.workunit.client.1.smithi129.stdout:4/113: stat f2 0 2024-09-21T08:02:27.210 INFO:tasks.workunit.client.1.smithi129.stdout:1/166: symlink d1/d16/d25/l3b 0 2024-09-21T08:02:27.210 INFO:tasks.workunit.client.1.smithi129.stdout:4/114: symlink d5/d16/d24/l2c 0 2024-09-21T08:02:27.210 INFO:tasks.workunit.client.1.smithi129.stdout:1/167: mknod d1/d16/d25/c3c 0 2024-09-21T08:02:27.211 INFO:tasks.workunit.client.1.smithi129.stdout:4/115: rename d5/d16/f18 to d5/d6/f2d 0 2024-09-21T08:02:27.212 INFO:tasks.workunit.client.1.smithi129.stdout:1/168: creat d1/d9/f3d x:0 0 0 2024-09-21T08:02:27.212 INFO:tasks.workunit.client.1.smithi129.stdout:1/169: chown d1/d16/l1b 4051 1 2024-09-21T08:02:27.215 INFO:tasks.workunit.client.1.smithi129.stdout:4/116: dread d5/f14 [0,4194304] 0 2024-09-21T08:02:27.216 INFO:tasks.workunit.client.1.smithi129.stdout:4/117: truncate d5/d6/f2d 3928049 0 2024-09-21T08:02:27.217 INFO:tasks.workunit.client.1.smithi129.stdout:4/118: write d5/d11/f17 [319025,41961] 0 2024-09-21T08:02:27.218 INFO:tasks.workunit.client.1.smithi129.stdout:9/124: dwrite d17/f1e [0,4194304] 0 2024-09-21T08:02:27.218 INFO:tasks.workunit.client.1.smithi129.stdout:8/90: dwrite d0/f16 [0,4194304] 0 2024-09-21T08:02:27.218 INFO:tasks.workunit.client.1.smithi129.stdout:8/91: write d0/d6/d7/d9/f12 [1347415,10076] 0 2024-09-21T08:02:27.218 INFO:tasks.workunit.client.1.smithi129.stdout:4/119: mkdir d5/d2e 0 2024-09-21T08:02:27.220 INFO:tasks.workunit.client.1.smithi129.stdout:7/153: link d0/d1e/l2b d0/l3f 0 2024-09-21T08:02:27.221 INFO:tasks.workunit.client.1.smithi129.stdout:7/154: creat d0/d1e/f40 x:0 0 0 2024-09-21T08:02:27.222 INFO:tasks.workunit.client.1.smithi129.stdout:9/125: symlink d17/d27/l2b 0 2024-09-21T08:02:27.222 INFO:tasks.workunit.client.1.smithi129.stdout:9/126: chown d17/f19 27136 1 2024-09-21T08:02:27.222 INFO:tasks.workunit.client.1.smithi129.stdout:9/127: dread - d17/f26 zero size 2024-09-21T08:02:27.223 INFO:tasks.workunit.client.1.smithi129.stdout:4/120: link d5/d6/f7 d5/d6/f2f 0 2024-09-21T08:02:27.226 INFO:tasks.workunit.client.1.smithi129.stdout:1/170: rmdir d1/d9 39 2024-09-21T08:02:27.226 INFO:tasks.workunit.client.1.smithi129.stdout:1/171: stat d1/d16/d25/f37 0 2024-09-21T08:02:27.229 INFO:tasks.workunit.client.1.smithi129.stdout:4/121: link d5/d11/f17 d5/d6/f30 0 2024-09-21T08:02:27.229 INFO:tasks.workunit.client.1.smithi129.stdout:1/172: getdents d1/d4 0 2024-09-21T08:02:27.231 INFO:tasks.workunit.client.1.smithi129.stdout:4/122: unlink d5/d6/c1c 0 2024-09-21T08:02:27.232 INFO:tasks.workunit.client.1.smithi129.stdout:1/173: mknod d1/d16/c3e 0 2024-09-21T08:02:27.233 INFO:tasks.workunit.client.1.smithi129.stdout:9/128: rename d17/d27 to d17/d2c 0 2024-09-21T08:02:27.235 INFO:tasks.workunit.client.1.smithi129.stdout:9/129: unlink d17/f1d 0 2024-09-21T08:02:27.235 INFO:tasks.workunit.client.1.smithi129.stdout:3/115: sync 2024-09-21T08:02:27.235 INFO:tasks.workunit.client.1.smithi129.stdout:4/123: dread d5/d6/f7 [0,4194304] 0 2024-09-21T08:02:27.237 INFO:tasks.workunit.client.1.smithi129.stdout:4/124: creat d5/d11/f31 x:0 0 0 2024-09-21T08:02:27.237 INFO:tasks.workunit.client.1.smithi129.stdout:4/125: write d5/d6/f30 [1861632,83317] 0 2024-09-21T08:02:27.239 INFO:tasks.workunit.client.1.smithi129.stdout:4/126: creat d5/d16/f32 x:0 0 0 2024-09-21T08:02:27.243 INFO:tasks.workunit.client.1.smithi129.stdout:4/127: dread d5/f14 [0,4194304] 0 2024-09-21T08:02:27.243 INFO:tasks.workunit.client.1.smithi129.stdout:4/128: write d5/d6/f26 [897595,48875] 0 2024-09-21T08:02:27.247 INFO:tasks.workunit.client.1.smithi129.stdout:9/130: dread f4 [0,4194304] 0 2024-09-21T08:02:27.248 INFO:tasks.workunit.client.1.smithi129.stdout:9/131: creat d17/d23/f2d x:0 0 0 2024-09-21T08:02:27.257 INFO:tasks.workunit.client.1.smithi129.stdout:9/132: dread d17/f1e [0,4194304] 0 2024-09-21T08:02:27.259 INFO:tasks.workunit.client.1.smithi129.stdout:9/133: symlink d17/l2e 0 2024-09-21T08:02:27.259 INFO:tasks.workunit.client.1.smithi129.stdout:9/134: creat d17/d22/f2f x:0 0 0 2024-09-21T08:02:27.259 INFO:tasks.workunit.client.1.smithi129.stdout:9/135: fsync d17/f19 0 2024-09-21T08:02:27.259 INFO:tasks.workunit.client.1.smithi129.stdout:9/136: creat d17/d22/f30 x:0 0 0 2024-09-21T08:02:27.259 INFO:tasks.workunit.client.1.smithi129.stdout:9/137: fdatasync d17/f19 0 2024-09-21T08:02:27.264 INFO:tasks.workunit.client.1.smithi129.stdout:1/174: dwrite d1/f15 [0,4194304] 0 2024-09-21T08:02:27.264 INFO:tasks.workunit.client.1.smithi129.stdout:1/175: fdatasync d1/d9/f1a 0 2024-09-21T08:02:27.264 INFO:tasks.workunit.client.1.smithi129.stdout:1/176: creat d1/f3f x:0 0 0 2024-09-21T08:02:27.264 INFO:tasks.workunit.client.1.smithi129.stdout:1/177: truncate d1/d9/f1e 1756302 0 2024-09-21T08:02:27.264 INFO:tasks.workunit.client.1.smithi129.stdout:1/178: chown d1/c13 3 1 2024-09-21T08:02:27.264 INFO:tasks.workunit.client.1.smithi129.stdout:1/179: dread - d1/d16/f2a zero size 2024-09-21T08:02:27.266 INFO:tasks.workunit.client.1.smithi129.stdout:1/180: creat d1/d16/d25/f40 x:0 0 0 2024-09-21T08:02:27.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:26 smithi129 ceph-mon[34472]: pgmap v5: 65 pgs: 65 active+clean; 268 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:02:27.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:26 smithi129 ceph-mon[34472]: mgrmap e24: smithi129.wvlmvo(active, since 4s) 2024-09-21T08:02:27.267 INFO:tasks.workunit.client.1.smithi129.stdout:3/116: dwrite d3/da/dc/fd [0,4194304] 0 2024-09-21T08:02:27.267 INFO:tasks.workunit.client.1.smithi129.stdout:1/181: mkdir d1/d16/d25/d41 0 2024-09-21T08:02:27.267 INFO:tasks.workunit.client.1.smithi129.stdout:4/129: dwrite d5/f2b [0,4194304] 0 2024-09-21T08:02:27.267 INFO:tasks.workunit.client.1.smithi129.stdout:3/117: mknod d3/d1e/d27/c2a 0 2024-09-21T08:02:27.269 INFO:tasks.workunit.client.1.smithi129.stdout:1/182: rename d1/f15 to d1/d9/f42 0 2024-09-21T08:02:27.269 INFO:tasks.workunit.client.1.smithi129.stdout:1/183: chown d1 4102 1 2024-09-21T08:02:27.271 INFO:tasks.workunit.client.1.smithi129.stdout:9/138: dread d17/d23/f2a [0,4194304] 0 2024-09-21T08:02:27.271 INFO:tasks.workunit.client.1.smithi129.stdout:9/139: readlink le 0 2024-09-21T08:02:27.271 INFO:tasks.workunit.client.1.smithi129.stdout:3/118: mkdir d3/d2b 0 2024-09-21T08:02:27.271 INFO:tasks.workunit.client.1.smithi129.stdout:1/184: mknod d1/d9/c43 0 2024-09-21T08:02:27.272 INFO:tasks.workunit.client.1.smithi129.stdout:4/130: mkdir d5/d33 0 2024-09-21T08:02:27.273 INFO:tasks.workunit.client.1.smithi129.stdout:9/140: stat c6 0 2024-09-21T08:02:27.274 INFO:tasks.workunit.client.1.smithi129.stdout:9/141: mkdir d17/d2c/d31 0 2024-09-21T08:02:27.276 INFO:tasks.workunit.client.1.smithi129.stdout:9/142: unlink d17/d22/f29 0 2024-09-21T08:02:27.276 INFO:tasks.workunit.client.1.smithi129.stdout:3/119: write d3/f4 [2129143,111075] 0 2024-09-21T08:02:27.277 INFO:tasks.workunit.client.1.smithi129.stdout:9/143: mkdir d17/d23/d32 0 2024-09-21T08:02:27.279 INFO:tasks.workunit.client.1.smithi129.stdout:9/144: mkdir d17/d22/d33 0 2024-09-21T08:02:27.280 INFO:tasks.workunit.client.1.smithi129.stdout:9/145: symlink d17/d22/l34 0 2024-09-21T08:02:27.283 INFO:tasks.workunit.client.1.smithi129.stdout:9/146: mkdir d17/d2c/d31/d35 0 2024-09-21T08:02:27.283 INFO:tasks.workunit.client.1.smithi129.stdout:9/147: readlink d17/l2e 0 2024-09-21T08:02:27.283 INFO:tasks.workunit.client.1.smithi129.stdout:9/148: mkdir d17/d22/d33/d36 0 2024-09-21T08:02:27.286 INFO:tasks.workunit.client.1.smithi129.stdout:4/131: getdents d5 0 2024-09-21T08:02:27.288 INFO:tasks.workunit.client.1.smithi129.stdout:4/132: mknod d5/d33/c34 0 2024-09-21T08:02:27.288 INFO:tasks.workunit.client.1.smithi129.stdout:4/133: read - d5/d16/f29 zero size 2024-09-21T08:02:27.289 INFO:tasks.workunit.client.1.smithi129.stdout:1/185: dwrite d1/d4/f17 [0,4194304] 0 2024-09-21T08:02:27.289 INFO:tasks.workunit.client.1.smithi129.stdout:1/186: write d1/f3f [232381,46953] 0 2024-09-21T08:02:27.289 INFO:tasks.workunit.client.1.smithi129.stdout:1/187: fsync d1/d16/f29 0 2024-09-21T08:02:27.291 INFO:tasks.workunit.client.1.smithi129.stdout:1/188: mkdir d1/d44 0 2024-09-21T08:02:27.292 INFO:tasks.workunit.client.1.smithi129.stdout:1/189: creat d1/d9/f45 x:0 0 0 2024-09-21T08:02:27.292 INFO:tasks.workunit.client.1.smithi129.stdout:1/190: chown d1/d16/l1b 3 1 2024-09-21T08:02:27.293 INFO:tasks.workunit.client.1.smithi129.stdout:1/191: rename d1/d16/d25/f37 to d1/d4/f46 0 2024-09-21T08:02:27.295 INFO:tasks.workunit.client.1.smithi129.stdout:1/192: rename d1/d4/c1f to d1/d44/c47 0 2024-09-21T08:02:27.295 INFO:tasks.workunit.client.1.smithi129.stdout:1/193: truncate d1/d9/f1a 627275 0 2024-09-21T08:02:27.297 INFO:tasks.workunit.client.1.smithi129.stdout:1/194: rename d1/d16/l36 to d1/d9/d31/l48 0 2024-09-21T08:02:27.297 INFO:tasks.workunit.client.1.smithi129.stdout:1/195: write d1/d9/f45 [781716,63561] 0 2024-09-21T08:02:27.297 INFO:tasks.workunit.client.1.smithi129.stdout:1/196: write d1/f3 [8763851,13761] 0 2024-09-21T08:02:27.297 INFO:tasks.workunit.client.1.smithi129.stdout:1/197: write d1/d9/f26 [5749,25736] 0 2024-09-21T08:02:27.297 INFO:tasks.workunit.client.1.smithi129.stdout:1/198: write d1/d9/f1e [451413,63297] 0 2024-09-21T08:02:27.297 INFO:tasks.workunit.client.1.smithi129.stdout:1/199: readlink d1/d9/d31/l48 0 2024-09-21T08:02:27.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:26 smithi107 ceph-mon[27622]: pgmap v5: 65 pgs: 65 active+clean; 268 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:02:27.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:26 smithi107 ceph-mon[27622]: mgrmap e24: smithi129.wvlmvo(active, since 4s) 2024-09-21T08:02:27.314 INFO:tasks.workunit.client.1.smithi129.stdout:9/149: dwrite f16 [0,4194304] 0 2024-09-21T08:02:27.314 INFO:tasks.workunit.client.1.smithi129.stdout:3/120: dwrite d3/da/dc/f21 [0,4194304] 0 2024-09-21T08:02:27.314 INFO:tasks.workunit.client.1.smithi129.stdout:4/134: dwrite d5/d11/f17 [0,4194304] 0 2024-09-21T08:02:27.316 INFO:tasks.workunit.client.1.smithi129.stdout:9/150: rename d17/l1a to d17/d2c/l37 0 2024-09-21T08:02:27.317 INFO:tasks.workunit.client.1.smithi129.stdout:1/200: dread d1/d9/f1e [0,4194304] 0 2024-09-21T08:02:27.318 INFO:tasks.workunit.client.1.smithi129.stdout:3/121: dread d3/da/f19 [0,4194304] 0 2024-09-21T08:02:27.318 INFO:tasks.workunit.client.1.smithi129.stdout:3/122: chown d3/da/dc/d25/f26 58481352 1 2024-09-21T08:02:27.318 INFO:tasks.workunit.client.1.smithi129.stdout:4/135: dread d5/d6/f7 [0,4194304] 0 2024-09-21T08:02:27.322 INFO:tasks.workunit.client.1.smithi129.stdout:9/151: dread f4 [0,4194304] 0 2024-09-21T08:02:27.322 INFO:tasks.workunit.client.1.smithi129.stdout:9/152: write d17/d23/f2d [1011128,16004] 0 2024-09-21T08:02:27.323 INFO:tasks.workunit.client.1.smithi129.stdout:1/201: symlink d1/d44/l49 0 2024-09-21T08:02:27.323 INFO:tasks.workunit.client.1.smithi129.stdout:1/202: chown d1/f39 1956 1 2024-09-21T08:02:27.323 INFO:tasks.workunit.client.1.smithi129.stdout:3/123: symlink d3/da/dc/l2c 0 2024-09-21T08:02:27.324 INFO:tasks.workunit.client.1.smithi129.stdout:9/153: mkdir d17/d38 0 2024-09-21T08:02:27.325 INFO:tasks.workunit.client.1.smithi129.stdout:1/203: link d1/d4/l2c d1/d44/l4a 0 2024-09-21T08:02:27.325 INFO:tasks.workunit.client.1.smithi129.stdout:1/204: write d1/f12 [555301,10575] 0 2024-09-21T08:02:27.326 INFO:tasks.workunit.client.1.smithi129.stdout:3/124: symlink d3/l2d 0 2024-09-21T08:02:27.326 INFO:tasks.workunit.client.1.smithi129.stdout:3/125: getdents d3/da/dc/d11 0 2024-09-21T08:02:27.326 INFO:tasks.workunit.client.1.smithi129.stdout:3/126: chown d3/da/c10 32285 1 2024-09-21T08:02:27.326 INFO:tasks.workunit.client.1.smithi129.stdout:3/127: fdatasync d3/da/dc/f23 0 2024-09-21T08:02:27.326 INFO:tasks.workunit.client.1.smithi129.stdout:3/128: fdatasync d3/da/ff 0 2024-09-21T08:02:27.326 INFO:tasks.workunit.client.1.smithi129.stdout:3/129: write d3/f13 [8751165,3234] 0 2024-09-21T08:02:27.326 INFO:tasks.workunit.client.1.smithi129.stdout:3/130: readlink d3/l1c 0 2024-09-21T08:02:27.333 INFO:tasks.workunit.client.1.smithi129.stdout:0/89: sync 2024-09-21T08:02:27.333 INFO:tasks.workunit.client.1.smithi129.stdout:5/139: sync 2024-09-21T08:02:27.334 INFO:tasks.workunit.client.1.smithi129.stdout:5/140: write d2/d1e/f1f [756507,126325] 0 2024-09-21T08:02:27.334 INFO:tasks.workunit.client.1.smithi129.stdout:5/141: chown d2/dc/f12 4990062 1 2024-09-21T08:02:27.334 INFO:tasks.workunit.client.1.smithi129.stdout:9/154: dread d17/d23/f2d [0,4194304] 0 2024-09-21T08:02:27.335 INFO:tasks.workunit.client.1.smithi129.stdout:0/90: rename f3 to de/f17 0 2024-09-21T08:02:27.335 INFO:tasks.workunit.client.1.smithi129.stdout:0/91: write fb [1161084,13330] 0 2024-09-21T08:02:27.336 INFO:tasks.workunit.client.1.smithi129.stdout:5/142: symlink d2/d1e/l28 0 2024-09-21T08:02:27.336 INFO:tasks.workunit.client.1.smithi129.stdout:5/143: chown d2/f1d 2642195 1 2024-09-21T08:02:27.337 INFO:tasks.workunit.client.1.smithi129.stdout:9/155: creat d17/d23/d32/f39 x:0 0 0 2024-09-21T08:02:27.337 INFO:tasks.workunit.client.1.smithi129.stdout:2/157: sync 2024-09-21T08:02:27.338 INFO:tasks.workunit.client.1.smithi129.stdout:0/92: creat de/d15/f18 x:0 0 0 2024-09-21T08:02:27.340 INFO:tasks.workunit.client.1.smithi129.stdout:9/156: link c1 d17/d2c/d31/d35/c3a 0 2024-09-21T08:02:27.341 INFO:tasks.workunit.client.1.smithi129.stdout:2/158: creat d1/d13/d1b/f3c x:0 0 0 2024-09-21T08:02:27.342 INFO:tasks.workunit.client.1.smithi129.stdout:1/205: rmdir d1 39 2024-09-21T08:02:27.342 INFO:tasks.workunit.client.1.smithi129.stdout:1/206: stat d1/d4/f46 0 2024-09-21T08:02:27.343 INFO:tasks.workunit.client.1.smithi129.stdout:0/93: mkdir de/d19 0 2024-09-21T08:02:27.344 INFO:tasks.workunit.client.1.smithi129.stdout:9/157: mkdir d17/d2c/d3b 0 2024-09-21T08:02:27.345 INFO:tasks.workunit.client.1.smithi129.stdout:1/207: mknod d1/d9/c4b 0 2024-09-21T08:02:27.345 INFO:tasks.workunit.client.1.smithi129.stdout:1/208: truncate d1/f12 856276 0 2024-09-21T08:02:27.345 INFO:tasks.workunit.client.1.smithi129.stdout:7/155: sync 2024-09-21T08:02:27.345 INFO:tasks.workunit.client.1.smithi129.stdout:8/92: sync 2024-09-21T08:02:27.345 INFO:tasks.workunit.client.1.smithi129.stdout:6/108: sync 2024-09-21T08:02:27.347 INFO:tasks.workunit.client.1.smithi129.stdout:3/131: dwrite d3/da/f19 [0,4194304] 0 2024-09-21T08:02:27.347 INFO:tasks.workunit.client.1.smithi129.stdout:3/132: readlink d3/l1c 0 2024-09-21T08:02:27.347 INFO:tasks.workunit.client.1.smithi129.stdout:3/133: readlink d3/da/le 0 2024-09-21T08:02:27.347 INFO:tasks.workunit.client.1.smithi129.stdout:3/134: fdatasync d3/da/ff 0 2024-09-21T08:02:27.347 INFO:tasks.workunit.client.1.smithi129.stdout:0/94: rename lc to de/d15/l1a 0 2024-09-21T08:02:27.349 INFO:tasks.workunit.client.1.smithi129.stdout:1/209: rmdir d1/d16/d25/d41 0 2024-09-21T08:02:27.349 INFO:tasks.workunit.client.1.smithi129.stdout:1/210: write d1/d9/f1a [1125265,54422] 0 2024-09-21T08:02:27.349 INFO:tasks.workunit.client.1.smithi129.stdout:5/144: read d2/f4 [1070617,63062] 0 2024-09-21T08:02:27.350 INFO:tasks.workunit.client.1.smithi129.stdout:6/109: mkdir d7/d1b/d25/d2b 0 2024-09-21T08:02:27.351 INFO:tasks.workunit.client.1.smithi129.stdout:3/135: truncate d3/da/dc/f21 1799410 0 2024-09-21T08:02:27.354 INFO:tasks.workunit.client.1.smithi129.stdout:8/93: rename d0/d6/d7/d9/d17 to d0/d6/d7/d18 0 2024-09-21T08:02:27.354 INFO:tasks.workunit.client.1.smithi129.stdout:8/94: fsync d0/d6/d7/d9/f12 0 2024-09-21T08:02:27.355 INFO:tasks.workunit.client.1.smithi129.stdout:7/156: write d0/f20 [605796,67542] 0 2024-09-21T08:02:27.355 INFO:tasks.workunit.client.1.smithi129.stdout:7/157: readlink d0/d1e/l2b 0 2024-09-21T08:02:27.355 INFO:tasks.workunit.client.1.smithi129.stdout:1/211: creat d1/f4c x:0 0 0 2024-09-21T08:02:27.356 INFO:tasks.workunit.client.1.smithi129.stdout:6/110: creat d7/d1b/d25/f2c x:0 0 0 2024-09-21T08:02:27.356 INFO:tasks.workunit.client.1.smithi129.stdout:5/145: write d2/f24 [238426,24642] 0 2024-09-21T08:02:27.356 INFO:tasks.workunit.client.1.smithi129.stdout:5/146: getdents d2/dc/d25 0 2024-09-21T08:02:27.356 INFO:tasks.workunit.client.1.smithi129.stdout:6/111: dread - d7/d10/f19 zero size 2024-09-21T08:02:27.356 INFO:tasks.workunit.client.1.smithi129.stdout:0/95: dread de/f17 [0,4194304] 0 2024-09-21T08:02:27.356 INFO:tasks.workunit.client.1.smithi129.stdout:0/96: write fb [1599017,19385] 0 2024-09-21T08:02:27.356 INFO:tasks.workunit.client.1.smithi129.stdout:7/158: creat d0/f41 x:0 0 0 2024-09-21T08:02:27.357 INFO:tasks.workunit.client.1.smithi129.stdout:1/212: symlink d1/d16/d28/l4d 0 2024-09-21T08:02:27.357 INFO:tasks.workunit.client.1.smithi129.stdout:5/147: dread - d2/f1b zero size 2024-09-21T08:02:27.358 INFO:tasks.workunit.client.1.smithi129.stdout:5/148: chown d2/f1d 637 1 2024-09-21T08:02:27.359 INFO:tasks.workunit.client.1.smithi129.stdout:0/97: symlink de/d15/l1b 0 2024-09-21T08:02:27.359 INFO:tasks.workunit.client.1.smithi129.stdout:0/98: chown f6 359360360 1 2024-09-21T08:02:27.359 INFO:tasks.workunit.client.1.smithi129.stdout:0/99: write de/f17 [695914,44234] 0 2024-09-21T08:02:27.359 INFO:tasks.workunit.client.1.smithi129.stdout:0/100: creat de/d15/f1c x:0 0 0 2024-09-21T08:02:27.359 INFO:tasks.workunit.client.1.smithi129.stdout:7/159: readlink d0/l39 0 2024-09-21T08:02:27.360 INFO:tasks.workunit.client.1.smithi129.stdout:1/213: mknod d1/c4e 0 2024-09-21T08:02:27.362 INFO:tasks.workunit.client.1.smithi129.stdout:2/159: dwrite d1/dc/d26/f33 [0,4194304] 0 2024-09-21T08:02:27.362 INFO:tasks.workunit.client.1.smithi129.stdout:2/160: truncate d1/d13/d1b/d1f/f23 591906 0 2024-09-21T08:02:27.369 INFO:tasks.workunit.client.1.smithi129.stdout:1/214: rename d1/d9/d31/c35 to d1/d16/d28/c4f 0 2024-09-21T08:02:27.370 INFO:tasks.workunit.client.1.smithi129.stdout:1/215: write d1/d16/d28/f33 [484908,35421] 0 2024-09-21T08:02:27.370 INFO:tasks.workunit.client.1.smithi129.stdout:1/216: write d1/f39 [473964,14901] 0 2024-09-21T08:02:27.375 INFO:tasks.workunit.client.1.smithi129.stdout:3/136: dread d3/f13 [4194304,4194304] 0 2024-09-21T08:02:27.375 INFO:tasks.workunit.client.1.smithi129.stdout:3/137: creat d3/da/f2e x:0 0 0 2024-09-21T08:02:27.375 INFO:tasks.workunit.client.1.smithi129.stdout:3/138: write d3/da/dc/f22 [1037760,103697] 0 2024-09-21T08:02:27.375 INFO:tasks.workunit.client.1.smithi129.stdout:3/139: readlink l0 0 2024-09-21T08:02:27.375 INFO:tasks.workunit.client.1.smithi129.stdout:2/161: creat d1/dc/d19/d36/f3d x:0 0 0 2024-09-21T08:02:27.375 INFO:tasks.workunit.client.1.smithi129.stdout:2/162: readlink d1/la 0 2024-09-21T08:02:27.375 INFO:tasks.workunit.client.1.smithi129.stdout:7/160: symlink d0/l42 0 2024-09-21T08:02:27.376 INFO:tasks.workunit.client.1.smithi129.stdout:7/161: chown d0/d1e/f21 159294559 1 2024-09-21T08:02:27.376 INFO:tasks.workunit.client.1.smithi129.stdout:7/162: read d0/d1e/f38 [4363339,106120] 0 2024-09-21T08:02:27.376 INFO:tasks.workunit.client.1.smithi129.stdout:1/217: rename d1/d16/d25/f40 to d1/f50 0 2024-09-21T08:02:27.376 INFO:tasks.workunit.client.1.smithi129.stdout:1/218: truncate d1/d4/f17 4295550 0 2024-09-21T08:02:27.377 INFO:tasks.workunit.client.1.smithi129.stdout:5/149: rename d2/f3 to d2/f29 0 2024-09-21T08:02:27.379 INFO:tasks.workunit.client.1.smithi129.stdout:2/163: mknod d1/d13/d3a/c3e 0 2024-09-21T08:02:27.381 INFO:tasks.workunit.client.1.smithi129.stdout:7/163: link d0/d1e/f38 d0/f43 0 2024-09-21T08:02:27.381 INFO:tasks.workunit.client.1.smithi129.stdout:0/101: rmdir de/d15 39 2024-09-21T08:02:27.381 INFO:tasks.workunit.client.1.smithi129.stdout:0/102: stat l4 0 2024-09-21T08:02:27.382 INFO:tasks.workunit.client.1.smithi129.stdout:7/164: chown d0/lb 8947372 1 2024-09-21T08:02:27.383 INFO:tasks.workunit.client.1.smithi129.stdout:7/165: dread - d0/f37 zero size 2024-09-21T08:02:27.386 INFO:tasks.workunit.client.1.smithi129.stdout:7/166: link d0/c13 d0/d1e/c44 0 2024-09-21T08:02:27.386 INFO:tasks.workunit.client.1.smithi129.stdout:7/167: fdatasync d0/d1e/f40 0 2024-09-21T08:02:27.387 INFO:tasks.workunit.client.1.smithi129.stdout:7/168: write d0/f20 [4021162,16063] 0 2024-09-21T08:02:27.387 INFO:tasks.workunit.client.1.smithi129.stdout:7/169: truncate d0/d1e/f38 4898326 0 2024-09-21T08:02:27.387 INFO:tasks.workunit.client.1.smithi129.stdout:1/219: write d1/f30 [27095,27512] 0 2024-09-21T08:02:27.389 INFO:tasks.workunit.client.1.smithi129.stdout:1/220: rmdir d1/d16 39 2024-09-21T08:02:27.391 INFO:tasks.workunit.client.1.smithi129.stdout:8/95: dwrite d0/d6/d7/f15 [0,4194304] 0 2024-09-21T08:02:27.391 INFO:tasks.workunit.client.1.smithi129.stdout:9/158: dwrite f10 [0,4194304] 0 2024-09-21T08:02:27.391 INFO:tasks.workunit.client.1.smithi129.stdout:7/170: rename d0/l28 to d0/l45 0 2024-09-21T08:02:27.391 INFO:tasks.workunit.client.1.smithi129.stdout:7/171: chown d0/c13 7 1 2024-09-21T08:02:27.391 INFO:tasks.workunit.client.1.smithi129.stdout:1/221: link d1/d44/c47 d1/d9/c51 0 2024-09-21T08:02:27.392 INFO:tasks.workunit.client.1.smithi129.stdout:1/222: write d1/f39 [353923,102783] 0 2024-09-21T08:02:27.393 INFO:tasks.workunit.client.1.smithi129.stdout:8/96: mknod d0/d6/d7/d9/c19 0 2024-09-21T08:02:27.393 INFO:tasks.workunit.client.1.smithi129.stdout:2/164: dread d1/d13/f24 [0,4194304] 0 2024-09-21T08:02:27.393 INFO:tasks.workunit.client.1.smithi129.stdout:6/112: dwrite d7/d10/f19 [0,4194304] 0 2024-09-21T08:02:27.394 INFO:tasks.workunit.client.1.smithi129.stdout:9/159: link ca d17/d22/c3c 0 2024-09-21T08:02:27.394 INFO:tasks.workunit.client.1.smithi129.stdout:9/160: write d17/d23/d32/f39 [562383,95948] 0 2024-09-21T08:02:27.395 INFO:tasks.workunit.client.1.smithi129.stdout:3/140: dread d3/da/f1a [0,4194304] 0 2024-09-21T08:02:27.395 INFO:tasks.workunit.client.1.smithi129.stdout:1/223: rename d1/d9/c51 to d1/d16/c52 0 2024-09-21T08:02:27.396 INFO:tasks.workunit.client.1.smithi129.stdout:8/97: creat d0/d6/f1a x:0 0 0 2024-09-21T08:02:27.396 INFO:tasks.workunit.client.1.smithi129.stdout:0/103: fsync de/f17 0 2024-09-21T08:02:27.396 INFO:tasks.workunit.client.1.smithi129.stdout:8/98: dread - d0/d6/f1a zero size 2024-09-21T08:02:27.396 INFO:tasks.workunit.client.1.smithi129.stdout:0/104: chown de/f11 96666 1 2024-09-21T08:02:27.396 INFO:tasks.workunit.client.1.smithi129.stdout:5/150: dread d2/f23 [0,4194304] 0 2024-09-21T08:02:27.396 INFO:tasks.workunit.client.1.smithi129.stdout:5/151: chown d2/f29 7 1 2024-09-21T08:02:27.399 INFO:tasks.workunit.client.1.smithi129.stdout:2/165: mkdir d1/d13/d3a/d3f 0 2024-09-21T08:02:27.399 INFO:tasks.workunit.client.1.smithi129.stdout:2/166: chown d1/dc 226229 1 2024-09-21T08:02:27.399 INFO:tasks.workunit.client.1.smithi129.stdout:2/167: chown d1/dc/d19 2 1 2024-09-21T08:02:27.400 INFO:tasks.workunit.client.1.smithi129.stdout:6/113: mknod d7/d1b/d1e/c2d 0 2024-09-21T08:02:27.402 INFO:tasks.workunit.client.1.smithi129.stdout:9/161: symlink d17/d2c/d31/d35/l3d 0 2024-09-21T08:02:27.402 INFO:tasks.workunit.client.1.smithi129.stdout:1/224: dread d1/f3 [4194304,4194304] 0 2024-09-21T08:02:27.402 INFO:tasks.workunit.client.1.smithi129.stdout:1/225: fdatasync d1/f3 0 2024-09-21T08:02:27.402 INFO:tasks.workunit.client.1.smithi129.stdout:7/172: mkdir d0/d46 0 2024-09-21T08:02:27.406 INFO:tasks.workunit.client.1.smithi129.stdout:0/105: creat de/d15/f1d x:0 0 0 2024-09-21T08:02:27.406 INFO:tasks.workunit.client.1.smithi129.stdout:0/106: fsync de/d15/f1c 0 2024-09-21T08:02:27.407 INFO:tasks.workunit.client.1.smithi129.stdout:8/99: symlink d0/d6/l1b 0 2024-09-21T08:02:27.408 INFO:tasks.workunit.client.1.smithi129.stdout:5/152: write d2/f1a [277851,53707] 0 2024-09-21T08:02:27.408 INFO:tasks.workunit.client.1.smithi129.stdout:5/153: truncate d2/f1b 714358 0 2024-09-21T08:02:27.408 INFO:tasks.workunit.client.1.smithi129.stdout:2/168: dread d1/dc/f16 [0,4194304] 0 2024-09-21T08:02:27.408 INFO:tasks.workunit.client.1.smithi129.stdout:2/169: chown d1/d13/d1b/l2f 0 1 2024-09-21T08:02:27.409 INFO:tasks.workunit.client.1.smithi129.stdout:9/162: link d17/d2c/d31/d35/c3a d17/d22/c3e 0 2024-09-21T08:02:27.410 INFO:tasks.workunit.client.1.smithi129.stdout:1/226: creat d1/d44/f53 x:0 0 0 2024-09-21T08:02:27.410 INFO:tasks.workunit.client.1.smithi129.stdout:1/227: dread - d1/d16/f2a zero size 2024-09-21T08:02:27.411 INFO:tasks.workunit.client.1.smithi129.stdout:1/228: chown d1/d9/l34 0 1 2024-09-21T08:02:27.411 INFO:tasks.workunit.client.1.smithi129.stdout:7/173: write d0/f24 [149916,76526] 0 2024-09-21T08:02:27.411 INFO:tasks.workunit.client.1.smithi129.stdout:0/107: mkdir de/d19/d1e 0 2024-09-21T08:02:27.413 INFO:tasks.workunit.client.1.smithi129.stdout:8/100: creat d0/f1c x:0 0 0 2024-09-21T08:02:27.415 INFO:tasks.workunit.client.1.smithi129.stdout:2/170: write d1/dc/ff [2564063,19860] 0 2024-09-21T08:02:27.415 INFO:tasks.workunit.client.1.smithi129.stdout:2/171: write d1/f8 [868259,120194] 0 2024-09-21T08:02:27.416 INFO:tasks.workunit.client.1.smithi129.stdout:2/172: readlink d1/la 0 2024-09-21T08:02:27.416 INFO:tasks.workunit.client.1.smithi129.stdout:2/173: creat d1/d13/d1b/d1f/f40 x:0 0 0 2024-09-21T08:02:27.416 INFO:tasks.workunit.client.1.smithi129.stdout:1/229: getdents d1/d4 0 2024-09-21T08:02:27.417 INFO:tasks.workunit.client.1.smithi129.stdout:3/141: rename d3/d1e to d3/da/dc/d11/d2f 0 2024-09-21T08:02:27.418 INFO:tasks.workunit.client.1.smithi129.stdout:8/101: mknod d0/d6/c1d 0 2024-09-21T08:02:27.418 INFO:tasks.workunit.client.1.smithi129.stdout:0/108: dread f0 [0,4194304] 0 2024-09-21T08:02:27.421 INFO:tasks.workunit.client.1.smithi129.stdout:6/114: dwrite f4 [0,4194304] 0 2024-09-21T08:02:27.425 INFO:tasks.workunit.client.1.smithi129.stdout:9/163: rmdir d17 39 2024-09-21T08:02:27.428 INFO:tasks.workunit.client.1.smithi129.stdout:1/230: creat d1/d16/d28/f54 x:0 0 0 2024-09-21T08:02:27.429 INFO:tasks.workunit.client.1.smithi129.stdout:7/174: dread d0/f8 [0,4194304] 0 2024-09-21T08:02:27.429 INFO:tasks.workunit.client.1.smithi129.stdout:0/109: dread f7 [0,4194304] 0 2024-09-21T08:02:27.430 INFO:tasks.workunit.client.1.smithi129.stdout:9/164: mkdir d17/d2c/d3b/d3f 0 2024-09-21T08:02:27.431 INFO:tasks.workunit.client.1.smithi129.stdout:3/142: write d3/da/f19 [2805498,99757] 0 2024-09-21T08:02:27.432 INFO:tasks.workunit.client.1.smithi129.stdout:2/174: dwrite d1/d13/d1b/d1f/f25 [0,4194304] 0 2024-09-21T08:02:27.433 INFO:tasks.workunit.client.1.smithi129.stdout:1/231: unlink d1/d16/d28/f2e 0 2024-09-21T08:02:27.435 INFO:tasks.workunit.client.1.smithi129.stdout:5/154: rename d2/dc/d25 to d2/d2a 0 2024-09-21T08:02:27.436 INFO:tasks.workunit.client.1.smithi129.stdout:8/102: unlink d0/f1c 0 2024-09-21T08:02:27.437 INFO:tasks.workunit.client.1.smithi129.stdout:7/175: creat d0/d46/f47 x:0 0 0 2024-09-21T08:02:27.438 INFO:tasks.workunit.client.1.smithi129.stdout:0/110: unlink de/c16 0 2024-09-21T08:02:27.440 INFO:tasks.workunit.client.1.smithi129.stdout:9/165: link d17/c20 d17/d22/d33/c40 0 2024-09-21T08:02:27.441 INFO:tasks.workunit.client.1.smithi129.stdout:3/143: mknod d3/da/dc/d25/c30 0 2024-09-21T08:02:27.445 INFO:tasks.workunit.client.1.smithi129.stdout:2/175: creat d1/d13/f41 x:0 0 0 2024-09-21T08:02:27.451 INFO:tasks.workunit.client.1.smithi129.stdout:1/232: rename d1/d9/f1e to d1/f55 0 2024-09-21T08:02:27.451 INFO:tasks.workunit.client.1.smithi129.stdout:0/111: dread de/f13 [0,4194304] 0 2024-09-21T08:02:27.451 INFO:tasks.workunit.client.1.smithi129.stdout:0/112: fsync de/d15/f1c 0 2024-09-21T08:02:27.451 INFO:tasks.workunit.client.1.smithi129.stdout:0/113: write de/d15/f1c [295899,17229] 0 2024-09-21T08:02:27.451 INFO:tasks.workunit.client.1.smithi129.stdout:8/103: mknod d0/d6/d7/d9/c1e 0 2024-09-21T08:02:27.452 INFO:tasks.workunit.client.1.smithi129.stdout:7/176: mknod d0/d1e/c48 0 2024-09-21T08:02:27.453 INFO:tasks.workunit.client.1.smithi129.stdout:9/166: rename d17/d22/c3c to d17/d22/c41 0 2024-09-21T08:02:27.454 INFO:tasks.workunit.client.1.smithi129.stdout:2/176: link d1/d13/f14 d1/dc/d26/f42 0 2024-09-21T08:02:27.455 INFO:tasks.workunit.client.1.smithi129.stdout:1/233: mknod d1/d16/d28/c56 0 2024-09-21T08:02:27.456 INFO:tasks.workunit.client.1.smithi129.stdout:0/114: mkdir de/d1f 0 2024-09-21T08:02:27.456 INFO:tasks.workunit.client.1.smithi129.stdout:8/104: write d0/d6/d7/fb [2676854,75649] 0 2024-09-21T08:02:27.456 INFO:tasks.workunit.client.1.smithi129.stdout:8/105: creat d0/d6/f1f x:0 0 0 2024-09-21T08:02:27.458 INFO:tasks.workunit.client.1.smithi129.stdout:9/167: unlink d17/d2c/l37 0 2024-09-21T08:02:27.459 INFO:tasks.workunit.client.1.smithi129.stdout:5/155: dwrite d2/dc/ff [0,4194304] 0 2024-09-21T08:02:27.460 INFO:tasks.workunit.client.1.smithi129.stdout:2/177: truncate d1/d13/f1d 3633773 0 2024-09-21T08:02:27.461 INFO:tasks.workunit.client.1.smithi129.stdout:1/234: mkdir d1/d16/d57 0 2024-09-21T08:02:27.462 INFO:tasks.workunit.client.1.smithi129.stdout:0/115: creat de/d19/d1e/f20 x:0 0 0 2024-09-21T08:02:27.464 INFO:tasks.workunit.client.1.smithi129.stdout:9/168: dread f4 [0,4194304] 0 2024-09-21T08:02:27.467 INFO:tasks.workunit.client.1.smithi129.stdout:8/106: rename d0/d6/c10 to d0/c20 0 2024-09-21T08:02:27.469 INFO:tasks.workunit.client.1.smithi129.stdout:5/156: unlink d2/dc/c14 0 2024-09-21T08:02:27.470 INFO:tasks.workunit.client.1.smithi129.stdout:2/178: link d1/d13/d1b/d1f/f40 d1/dc/d19/d36/f43 0 2024-09-21T08:02:27.471 INFO:tasks.workunit.client.1.smithi129.stdout:0/116: mknod de/c21 0 2024-09-21T08:02:27.471 INFO:tasks.workunit.client.1.smithi129.stdout:1/235: dread d1/d4/f17 [0,4194304] 0 2024-09-21T08:02:27.471 INFO:tasks.workunit.client.1.smithi129.stdout:9/169: link c1 d17/d2c/d31/d35/c42 0 2024-09-21T08:02:27.473 INFO:tasks.workunit.client.1.smithi129.stdout:5/157: creat d2/dc/f2b x:0 0 0 2024-09-21T08:02:27.473 INFO:tasks.workunit.client.1.smithi129.stdout:5/158: fsync d2/f1a 0 2024-09-21T08:02:27.473 INFO:tasks.workunit.client.1.smithi129.stdout:5/159: chown d2/dc/l15 299503 1 2024-09-21T08:02:27.473 INFO:tasks.workunit.client.1.smithi129.stdout:5/160: write d2/f1b [1048470,41728] 0 2024-09-21T08:02:27.473 INFO:tasks.workunit.client.1.smithi129.stdout:5/161: chown d2/f24 26 1 2024-09-21T08:02:27.473 INFO:tasks.workunit.client.1.smithi129.stdout:2/179: getdents d1/d13/d3a 0 2024-09-21T08:02:27.473 INFO:tasks.workunit.client.1.smithi129.stdout:2/180: creat d1/d13/d1b/d1f/f44 x:0 0 0 2024-09-21T08:02:27.474 INFO:tasks.workunit.client.1.smithi129.stdout:2/181: dread d1/dc/d26/f42 [0,4194304] 0 2024-09-21T08:02:27.474 INFO:tasks.workunit.client.1.smithi129.stdout:2/182: readlink d1/d13/l20 0 2024-09-21T08:02:27.474 INFO:tasks.workunit.client.1.smithi129.stdout:2/183: stat d1/d13/d1b/c2b 0 2024-09-21T08:02:27.474 INFO:tasks.workunit.client.1.smithi129.stdout:8/107: dread d0/f16 [0,4194304] 0 2024-09-21T08:02:27.475 INFO:tasks.workunit.client.1.smithi129.stdout:1/236: creat d1/d9/f58 x:0 0 0 2024-09-21T08:02:27.475 INFO:tasks.workunit.client.1.smithi129.stdout:1/237: chown d1/d16/d28/l4d 0 1 2024-09-21T08:02:27.476 INFO:tasks.workunit.client.1.smithi129.stdout:9/170: creat d17/d2c/f43 x:0 0 0 2024-09-21T08:02:27.476 INFO:tasks.workunit.client.1.smithi129.stdout:7/177: dwrite d0/f17 [0,4194304] 0 2024-09-21T08:02:27.477 INFO:tasks.workunit.client.1.smithi129.stdout:5/162: link d2/f23 d2/dc/f2c 0 2024-09-21T08:02:27.477 INFO:tasks.workunit.client.1.smithi129.stdout:5/163: write d2/dc/f22 [1032010,17065] 0 2024-09-21T08:02:27.479 INFO:tasks.workunit.client.1.smithi129.stdout:5/164: dread d2/f1a [0,4194304] 0 2024-09-21T08:02:27.479 INFO:tasks.workunit.client.1.smithi129.stdout:5/165: dread - d2/dc/f2b zero size 2024-09-21T08:02:27.479 INFO:tasks.workunit.client.1.smithi129.stdout:5/166: write d2/dc/f2c [3507585,30680] 0 2024-09-21T08:02:27.479 INFO:tasks.workunit.client.1.smithi129.stdout:5/167: chown d2/f23 339500 1 2024-09-21T08:02:27.479 INFO:tasks.workunit.client.1.smithi129.stdout:5/168: creat d2/dc/f2d x:0 0 0 2024-09-21T08:02:27.479 INFO:tasks.workunit.client.1.smithi129.stdout:8/108: creat d0/d6/d7/f21 x:0 0 0 2024-09-21T08:02:27.480 INFO:tasks.workunit.client.1.smithi129.stdout:1/238: unlink d1/d4/c2b 0 2024-09-21T08:02:27.481 INFO:tasks.workunit.client.1.smithi129.stdout:7/178: chown d0/l35 63 1 2024-09-21T08:02:27.481 INFO:tasks.workunit.client.1.smithi129.stdout:7/179: chown d0/d46/f47 250537 1 2024-09-21T08:02:27.483 INFO:tasks.workunit.client.1.smithi129.stdout:5/169: creat d2/d2a/f2e x:0 0 0 2024-09-21T08:02:27.485 INFO:tasks.workunit.client.1.smithi129.stdout:8/109: creat d0/d6/d7/d18/f22 x:0 0 0 2024-09-21T08:02:27.485 INFO:tasks.workunit.client.1.smithi129.stdout:5/170: fdatasync d2/f23 0 2024-09-21T08:02:27.486 INFO:tasks.workunit.client.1.smithi129.stdout:1/239: mknod d1/d44/c59 0 2024-09-21T08:02:27.486 INFO:tasks.workunit.client.1.smithi129.stdout:1/240: read d1/d4/f21 [237912,73142] 0 2024-09-21T08:02:27.486 INFO:tasks.workunit.client.1.smithi129.stdout:1/241: read - d1/d16/f2a zero size 2024-09-21T08:02:27.488 INFO:tasks.workunit.client.1.smithi129.stdout:8/110: mknod d0/d6/c23 0 2024-09-21T08:02:27.488 INFO:tasks.workunit.client.1.smithi129.stdout:8/111: fdatasync d0/d6/d7/f15 0 2024-09-21T08:02:27.488 INFO:tasks.workunit.client.1.smithi129.stdout:8/112: chown d0/d6/cd 14 1 2024-09-21T08:02:27.489 INFO:tasks.workunit.client.1.smithi129.stdout:8/113: readlink d0/d6/d7/lf 0 2024-09-21T08:02:27.489 INFO:tasks.workunit.client.1.smithi129.stdout:5/171: creat d2/d1e/f2f x:0 0 0 2024-09-21T08:02:27.489 INFO:tasks.workunit.client.1.smithi129.stdout:5/172: chown d2/d1e 4317291 1 2024-09-21T08:02:27.490 INFO:tasks.workunit.client.1.smithi129.stdout:1/242: link d1/d16/d25/l3b d1/d4/l5a 0 2024-09-21T08:02:27.491 INFO:tasks.workunit.client.1.smithi129.stdout:7/180: truncate d0/f25 6004742 0 2024-09-21T08:02:27.492 INFO:tasks.workunit.client.1.smithi129.stdout:5/173: mknod d2/dc/c30 0 2024-09-21T08:02:27.493 INFO:tasks.workunit.client.1.smithi129.stdout:1/243: mknod d1/d16/d25/c5b 0 2024-09-21T08:02:27.497 INFO:tasks.workunit.client.1.smithi129.stdout:0/117: rename de/d19/d1e to de/d22 0 2024-09-21T08:02:27.497 INFO:tasks.workunit.client.1.smithi129.stdout:2/184: fsync d1/d13/d1b/d1f/f40 0 2024-09-21T08:02:27.497 INFO:tasks.workunit.client.1.smithi129.stdout:2/185: chown d1/dc/ff 387121343 1 2024-09-21T08:02:27.498 INFO:tasks.workunit.client.1.smithi129.stdout:5/174: dread - d2/f18 zero size 2024-09-21T08:02:27.498 INFO:tasks.workunit.client.1.smithi129.stdout:5/175: creat d2/dc/f31 x:0 0 0 2024-09-21T08:02:27.498 INFO:tasks.workunit.client.1.smithi129.stdout:5/176: dread - d2/f18 zero size 2024-09-21T08:02:27.498 INFO:tasks.workunit.client.1.smithi129.stdout:5/177: creat d2/d1e/f32 x:0 0 0 2024-09-21T08:02:27.499 INFO:tasks.workunit.client.1.smithi129.stdout:1/244: truncate d1/f3 7712392 0 2024-09-21T08:02:27.499 INFO:tasks.workunit.client.1.smithi129.stdout:1/245: creat d1/d16/d28/f5c x:0 0 0 2024-09-21T08:02:27.501 INFO:tasks.workunit.client.1.smithi129.stdout:8/114: write d0/d6/d7/f15 [3898077,118617] 0 2024-09-21T08:02:27.504 INFO:tasks.workunit.client.1.smithi129.stdout:9/171: rename cb to d17/d2c/d3b/c44 0 2024-09-21T08:02:27.505 INFO:tasks.workunit.client.1.smithi129.stdout:9/172: fsync d17/d22/f2f 0 2024-09-21T08:02:27.506 INFO:tasks.workunit.client.1.smithi129.stdout:2/186: mkdir d1/dc/d26/d45 0 2024-09-21T08:02:27.506 INFO:tasks.workunit.client.1.smithi129.stdout:2/187: chown d1/d13/d1b 40326 1 2024-09-21T08:02:27.506 INFO:tasks.workunit.client.1.smithi129.stdout:9/173: read d17/d23/f2d [570630,16707] 0 2024-09-21T08:02:27.508 INFO:tasks.workunit.client.1.smithi129.stdout:8/115: dread d0/d6/d7/fb [0,4194304] 0 2024-09-21T08:02:27.508 INFO:tasks.workunit.client.1.smithi129.stdout:8/116: stat d0/d6/d7/f15 0 2024-09-21T08:02:27.510 INFO:tasks.workunit.client.1.smithi129.stdout:5/178: getdents d2 0 2024-09-21T08:02:27.513 INFO:tasks.workunit.client.1.smithi129.stdout:0/118: rename de/c21 to de/d1f/c23 0 2024-09-21T08:02:27.514 INFO:tasks.workunit.client.1.smithi129.stdout:9/174: symlink d17/d2c/d31/l45 0 2024-09-21T08:02:27.515 INFO:tasks.workunit.client.1.smithi129.stdout:9/175: write d17/d22/f24 [648236,91195] 0 2024-09-21T08:02:27.515 INFO:tasks.workunit.client.1.smithi129.stdout:8/117: mkdir d0/d6/d7/d24 0 2024-09-21T08:02:27.516 INFO:tasks.workunit.client.1.smithi129.stdout:8/118: chown d0/d6/d7/f15 260 1 2024-09-21T08:02:27.516 INFO:tasks.workunit.client.1.smithi129.stdout:0/119: write fb [487839,61572] 0 2024-09-21T08:02:27.518 INFO:tasks.workunit.client.1.smithi129.stdout:0/120: dread de/d15/f1c [0,4194304] 0 2024-09-21T08:02:27.518 INFO:tasks.workunit.client.1.smithi129.stdout:0/121: write de/f11 [993424,97188] 0 2024-09-21T08:02:27.521 INFO:tasks.workunit.client.1.smithi129.stdout:9/176: write f4 [1512859,121883] 0 2024-09-21T08:02:27.522 INFO:tasks.workunit.client.1.smithi129.stdout:0/122: getdents de/d15 0 2024-09-21T08:02:27.522 INFO:tasks.workunit.client.1.smithi129.stdout:0/123: chown de/d15/l1b 3 1 2024-09-21T08:02:27.524 INFO:tasks.workunit.client.1.smithi129.stdout:9/177: read d17/d23/d32/f39 [78698,28512] 0 2024-09-21T08:02:27.524 INFO:tasks.workunit.client.1.smithi129.stdout:7/181: dwrite d0/f26 [0,4194304] 0 2024-09-21T08:02:27.524 INFO:tasks.workunit.client.1.smithi129.stdout:7/182: write d0/f24 [722229,5716] 0 2024-09-21T08:02:27.526 INFO:tasks.workunit.client.1.smithi129.stdout:7/183: symlink d0/d1e/l49 0 2024-09-21T08:02:27.527 INFO:tasks.workunit.client.1.smithi129.stdout:7/184: read - d0/f37 zero size 2024-09-21T08:02:27.528 INFO:tasks.workunit.client.1.smithi129.stdout:1/246: dwrite d1/d4/f21 [0,4194304] 0 2024-09-21T08:02:27.528 INFO:tasks.workunit.client.1.smithi129.stdout:7/185: symlink d0/d46/l4a 0 2024-09-21T08:02:27.528 INFO:tasks.workunit.client.1.smithi129.stdout:7/186: dread - d0/d46/f47 zero size 2024-09-21T08:02:27.528 INFO:tasks.workunit.client.1.smithi129.stdout:7/187: creat d0/d1e/f4b x:0 0 0 2024-09-21T08:02:27.528 INFO:tasks.workunit.client.1.smithi129.stdout:2/188: dread d1/d13/f2c [0,4194304] 0 2024-09-21T08:02:27.529 INFO:tasks.workunit.client.1.smithi129.stdout:1/247: creat d1/d4/f5d x:0 0 0 2024-09-21T08:02:27.531 INFO:tasks.workunit.client.1.smithi129.stdout:1/248: creat d1/d9/d31/f5e x:0 0 0 2024-09-21T08:02:27.532 INFO:tasks.workunit.client.1.smithi129.stdout:7/188: rename d0/d1e/f3d to d0/f4c 0 2024-09-21T08:02:27.532 INFO:tasks.workunit.client.1.smithi129.stdout:7/189: creat d0/d46/f4d x:0 0 0 2024-09-21T08:02:27.535 INFO:tasks.workunit.client.1.smithi129.stdout:1/249: write d1/d4/f17 [1138514,31574] 0 2024-09-21T08:02:27.537 INFO:tasks.workunit.client.1.smithi129.stdout:1/250: mkdir d1/d16/d5f 0 2024-09-21T08:02:27.537 INFO:tasks.workunit.client.1.smithi129.stdout:1/251: symlink d1/d16/d57/l60 0 2024-09-21T08:02:27.539 INFO:tasks.workunit.client.1.smithi129.stdout:8/119: dwrite d0/f16 [0,4194304] 0 2024-09-21T08:02:27.539 INFO:tasks.workunit.client.1.smithi129.stdout:5/179: dwrite d2/f1d [0,4194304] 0 2024-09-21T08:02:27.539 INFO:tasks.workunit.client.1.smithi129.stdout:1/252: rename d1/d16/f27 to d1/d16/d25/f61 0 2024-09-21T08:02:27.541 INFO:tasks.workunit.client.1.smithi129.stdout:2/189: write d1/d13/f1d [783346,85041] 0 2024-09-21T08:02:27.541 INFO:tasks.workunit.client.1.smithi129.stdout:2/190: dread - d1/d13/d1b/f27 zero size 2024-09-21T08:02:27.541 INFO:tasks.workunit.client.1.smithi129.stdout:2/191: chown d1/d13/d1b/d1f/f25 60539 1 2024-09-21T08:02:27.541 INFO:tasks.workunit.client.1.smithi129.stdout:1/253: write d1/d9/f22 [747336,119860] 0 2024-09-21T08:02:27.542 INFO:tasks.workunit.client.1.smithi129.stdout:5/180: mkdir d2/dc/d33 0 2024-09-21T08:02:27.542 INFO:tasks.workunit.client.1.smithi129.stdout:5/181: fdatasync d2/f1a 0 2024-09-21T08:02:27.546 INFO:tasks.workunit.client.1.smithi129.stdout:9/178: dread f4 [0,4194304] 0 2024-09-21T08:02:27.546 INFO:tasks.workunit.client.1.smithi129.stdout:1/254: unlink d1/d9/d31/l48 0 2024-09-21T08:02:27.546 INFO:tasks.workunit.client.1.smithi129.stdout:1/255: chown d1/d9/f26 177723 1 2024-09-21T08:02:27.547 INFO:tasks.workunit.client.1.smithi129.stdout:5/182: creat d2/dc/d33/f34 x:0 0 0 2024-09-21T08:02:27.549 INFO:tasks.workunit.client.1.smithi129.stdout:7/190: dread d0/f16 [0,4194304] 0 2024-09-21T08:02:27.549 INFO:tasks.workunit.client.1.smithi129.stdout:2/192: rmdir d1/d13/d1b 39 2024-09-21T08:02:27.552 INFO:tasks.workunit.client.1.smithi129.stdout:9/179: rename d17/d23/d32 to d17/d46 0 2024-09-21T08:02:27.553 INFO:tasks.workunit.client.1.smithi129.stdout:8/120: dread d0/d6/d7/d9/f12 [0,4194304] 0 2024-09-21T08:02:27.553 INFO:tasks.workunit.client.1.smithi129.stdout:8/121: dread - d0/f11 zero size 2024-09-21T08:02:27.553 INFO:tasks.workunit.client.1.smithi129.stdout:8/122: chown d0/f11 27440 1 2024-09-21T08:02:27.553 INFO:tasks.workunit.client.1.smithi129.stdout:7/191: mknod d0/d1e/c4e 0 2024-09-21T08:02:27.554 INFO:tasks.workunit.client.1.smithi129.stdout:2/193: creat d1/dc/d26/d45/f46 x:0 0 0 2024-09-21T08:02:27.555 INFO:tasks.workunit.client.1.smithi129.stdout:0/124: dwrite fb [0,4194304] 0 2024-09-21T08:02:27.556 INFO:tasks.workunit.client.1.smithi129.stdout:1/256: rename d1/d9/f22 to d1/d9/d31/f62 0 2024-09-21T08:02:27.556 INFO:tasks.workunit.client.1.smithi129.stdout:0/125: read de/f11 [119335,122950] 0 2024-09-21T08:02:27.559 INFO:tasks.workunit.client.1.smithi129.stdout:9/180: dread f15 [0,4194304] 0 2024-09-21T08:02:27.559 INFO:tasks.workunit.client.1.smithi129.stdout:9/181: write f15 [1150408,106694] 0 2024-09-21T08:02:27.559 INFO:tasks.workunit.client.1.smithi129.stdout:9/182: fdatasync d17/d23/f2a 0 2024-09-21T08:02:27.559 INFO:tasks.workunit.client.1.smithi129.stdout:9/183: fdatasync d17/f26 0 2024-09-21T08:02:27.571 INFO:tasks.workunit.client.1.smithi129.stdout:7/192: dwrite d0/d1e/f23 [0,4194304] 0 2024-09-21T08:02:27.577 INFO:tasks.workunit.client.1.smithi129.stdout:5/183: rename d2/dc to d2/d1e/d35 0 2024-09-21T08:02:27.579 INFO:tasks.workunit.client.1.smithi129.stdout:2/194: rename d1/d13/d1b to d1/d13/d3a/d47 0 2024-09-21T08:02:27.580 INFO:tasks.workunit.client.1.smithi129.stdout:5/184: mkdir d2/d1e/d35/d33/d36 0 2024-09-21T08:02:27.580 INFO:tasks.workunit.client.1.smithi129.stdout:5/185: fsync d2/f17 0 2024-09-21T08:02:27.581 INFO:tasks.workunit.client.1.smithi129.stdout:0/126: rename de/f11 to de/d1f/f24 0 2024-09-21T08:02:27.582 INFO:tasks.workunit.client.1.smithi129.stdout:9/184: rename c14 to d17/d22/d33/d36/c47 0 2024-09-21T08:02:27.582 INFO:tasks.workunit.client.1.smithi129.stdout:9/185: fdatasync d17/d46/f39 0 2024-09-21T08:02:27.582 INFO:tasks.workunit.client.1.smithi129.stdout:9/186: fdatasync d17/f1c 0 2024-09-21T08:02:27.582 INFO:tasks.workunit.client.1.smithi129.stdout:9/187: fdatasync d17/f26 0 2024-09-21T08:02:27.584 INFO:tasks.workunit.client.1.smithi129.stdout:2/195: rename d1/d13/d3a/d47/d1f/f44 to d1/dc/d26/f48 0 2024-09-21T08:02:27.585 INFO:tasks.workunit.client.1.smithi129.stdout:9/188: rename d17/d2c/d3b to d17/d22/d33/d36/d48 0 2024-09-21T08:02:27.586 INFO:tasks.workunit.client.1.smithi129.stdout:2/196: link d1/c29 d1/d13/d3a/d3f/c49 0 2024-09-21T08:02:27.587 INFO:tasks.workunit.client.1.smithi129.stdout:2/197: mknod d1/dc/d19/c4a 0 2024-09-21T08:02:27.587 INFO:tasks.workunit.client.1.smithi129.stdout:2/198: write d1/d13/d3a/d47/f27 [847682,114710] 0 2024-09-21T08:02:27.587 INFO:tasks.workunit.client.1.smithi129.stdout:7/193: dwrite d0/d1e/f4b [0,4194304] 0 2024-09-21T08:02:27.587 INFO:tasks.workunit.client.1.smithi129.stdout:7/194: read - d0/f37 zero size 2024-09-21T08:02:27.588 INFO:tasks.workunit.client.1.smithi129.stdout:2/199: symlink d1/d13/d32/l4b 0 2024-09-21T08:02:27.591 INFO:tasks.workunit.client.1.smithi129.stdout:2/200: mkdir d1/dc/d19/d4c 0 2024-09-21T08:02:27.592 INFO:tasks.workunit.client.1.smithi129.stdout:2/201: symlink d1/l4d 0 2024-09-21T08:02:27.593 INFO:tasks.workunit.client.1.smithi129.stdout:0/127: getdents de/d1f 0 2024-09-21T08:02:27.593 INFO:tasks.workunit.client.1.smithi129.stdout:0/128: chown de/d15/f1d 347689111 1 2024-09-21T08:02:27.593 INFO:tasks.workunit.client.1.smithi129.stdout:5/186: write d2/f1d [1329306,76396] 0 2024-09-21T08:02:27.594 INFO:tasks.workunit.client.1.smithi129.stdout:2/202: symlink d1/d13/d32/l4e 0 2024-09-21T08:02:27.598 INFO:tasks.workunit.client.1.smithi129.stdout:2/203: mkdir d1/dc/d26/d45/d4f 0 2024-09-21T08:02:27.598 INFO:tasks.workunit.client.1.smithi129.stdout:2/204: write d1/f17 [613424,48597] 0 2024-09-21T08:02:27.599 INFO:tasks.workunit.client.1.smithi129.stdout:2/205: mkdir d1/d13/d3a/d3f/d50 0 2024-09-21T08:02:27.600 INFO:tasks.workunit.client.1.smithi129.stdout:9/189: dwrite d17/f1e [0,4194304] 0 2024-09-21T08:02:27.600 INFO:tasks.workunit.client.1.smithi129.stdout:7/195: read d0/d1e/f23 [2409065,9178] 0 2024-09-21T08:02:27.602 INFO:tasks.workunit.client.1.smithi129.stdout:9/190: creat d17/f49 x:0 0 0 2024-09-21T08:02:27.602 INFO:tasks.workunit.client.1.smithi129.stdout:9/191: chown d17/d22/f24 834 1 2024-09-21T08:02:27.602 INFO:tasks.workunit.client.1.smithi129.stdout:9/192: chown d17/f1e 145955 1 2024-09-21T08:02:27.602 INFO:tasks.workunit.client.1.smithi129.stdout:7/196: rename d0/d46/l4a to d0/l4f 0 2024-09-21T08:02:27.604 INFO:tasks.workunit.client.1.smithi129.stdout:7/197: mknod d0/d1e/c50 0 2024-09-21T08:02:27.607 INFO:tasks.workunit.client.1.smithi129.stdout:7/198: symlink d0/l51 0 2024-09-21T08:02:27.607 INFO:tasks.workunit.client.1.smithi129.stdout:7/199: write d0/d1e/f38 [889996,119321] 0 2024-09-21T08:02:27.608 INFO:tasks.workunit.client.1.smithi129.stdout:7/200: mknod d0/d46/c52 0 2024-09-21T08:02:27.612 INFO:tasks.workunit.client.1.smithi129.stdout:4/136: sync 2024-09-21T08:02:27.612 INFO:tasks.workunit.client.1.smithi129.stdout:6/115: sync 2024-09-21T08:02:27.612 INFO:tasks.workunit.client.1.smithi129.stdout:3/144: sync 2024-09-21T08:02:27.612 INFO:tasks.workunit.client.1.smithi129.stdout:3/145: rename d3/da/dc/d11 to d3/da/dc/d11/d2f/d27/d31 22 2024-09-21T08:02:27.612 INFO:tasks.workunit.client.1.smithi129.stdout:7/201: read d0/f8 [884817,36498] 0 2024-09-21T08:02:27.613 INFO:tasks.workunit.client.1.smithi129.stdout:6/116: link d7/d10/f15 d7/d1b/d25/f2e 0 2024-09-21T08:02:27.615 INFO:tasks.workunit.client.1.smithi129.stdout:4/137: mkdir d5/d35 0 2024-09-21T08:02:27.615 INFO:tasks.workunit.client.1.smithi129.stdout:4/138: write d5/d16/d24/f27 [267151,20566] 0 2024-09-21T08:02:27.615 INFO:tasks.workunit.client.1.smithi129.stdout:7/202: unlink d0/d1e/c50 0 2024-09-21T08:02:27.616 INFO:tasks.workunit.client.1.smithi129.stdout:6/117: creat d7/d1b/d25/d2b/f2f x:0 0 0 2024-09-21T08:02:27.616 INFO:tasks.workunit.client.1.smithi129.stdout:6/118: truncate d7/d10/f19 4750665 0 2024-09-21T08:02:27.616 INFO:tasks.workunit.client.1.smithi129.stdout:6/119: fdatasync d7/d10/f14 0 2024-09-21T08:02:27.617 INFO:tasks.workunit.client.1.smithi129.stdout:4/139: mknod d5/d33/c36 0 2024-09-21T08:02:27.617 INFO:tasks.workunit.client.1.smithi129.stdout:4/140: chown d5/d16/d24/c2a 1690 1 2024-09-21T08:02:27.620 INFO:tasks.workunit.client.1.smithi129.stdout:9/193: dread f0 [0,4194304] 0 2024-09-21T08:02:27.620 INFO:tasks.workunit.client.1.smithi129.stdout:9/194: creat d17/d2c/f4a x:0 0 0 2024-09-21T08:02:27.622 INFO:tasks.workunit.client.1.smithi129.stdout:4/141: rmdir d5/d6 39 2024-09-21T08:02:27.625 INFO:tasks.workunit.client.1.smithi129.stdout:4/142: rename d5/d6/c23 to d5/c37 0 2024-09-21T08:02:27.625 INFO:tasks.workunit.client.1.smithi129.stdout:4/143: chown d5/d6/f2f 235 1 2024-09-21T08:02:27.625 INFO:tasks.workunit.client.1.smithi129.stdout:4/144: chown d5/d16/d24/l2c 806 1 2024-09-21T08:02:27.626 INFO:tasks.workunit.client.1.smithi129.stdout:4/145: rename l1 to d5/d11/l38 0 2024-09-21T08:02:27.626 INFO:tasks.workunit.client.1.smithi129.stdout:9/195: dread d17/d23/f2a [4194304,4194304] 0 2024-09-21T08:02:27.627 INFO:tasks.workunit.client.1.smithi129.stdout:4/146: creat d5/f39 x:0 0 0 2024-09-21T08:02:27.629 INFO:tasks.workunit.client.1.smithi129.stdout:9/196: rename d17/d22/f24 to d17/d46/f4b 0 2024-09-21T08:02:27.632 INFO:tasks.workunit.client.1.smithi129.stdout:4/147: rename d5/d11/l19 to d5/d2e/l3a 0 2024-09-21T08:02:27.633 INFO:tasks.workunit.client.1.smithi129.stdout:4/148: truncate d5/f2b 3217315 0 2024-09-21T08:02:27.633 INFO:tasks.workunit.client.1.smithi129.stdout:4/149: fdatasync d5/d11/f13 0 2024-09-21T08:02:27.635 INFO:tasks.workunit.client.1.smithi129.stdout:4/150: truncate d5/d11/f13 427974 0 2024-09-21T08:02:27.647 INFO:tasks.workunit.client.1.smithi129.stdout:2/206: dwrite d1/f2e [0,4194304] 0 2024-09-21T08:02:27.647 INFO:tasks.workunit.client.1.smithi129.stdout:2/207: chown d1/d13/d3a/d47/d1f/f23 202 1 2024-09-21T08:02:27.648 INFO:tasks.workunit.client.1.smithi129.stdout:2/208: creat d1/dc/d26/f51 x:0 0 0 2024-09-21T08:02:27.648 INFO:tasks.workunit.client.1.smithi129.stdout:0/129: dwrite fd [0,4194304] 0 2024-09-21T08:02:27.650 INFO:tasks.workunit.client.1.smithi129.stdout:0/130: rename de/d15/l1a to de/d19/l25 0 2024-09-21T08:02:27.650 INFO:tasks.workunit.client.1.smithi129.stdout:0/131: fsync de/d22/f20 0 2024-09-21T08:02:27.652 INFO:tasks.workunit.client.1.smithi129.stdout:0/132: creat de/d22/f26 x:0 0 0 2024-09-21T08:02:27.653 INFO:tasks.workunit.client.1.smithi129.stdout:0/133: mkdir de/d22/d27 0 2024-09-21T08:02:27.654 INFO:tasks.workunit.client.1.smithi129.stdout:0/134: creat de/d15/f28 x:0 0 0 2024-09-21T08:02:27.654 INFO:tasks.workunit.client.1.smithi129.stdout:0/135: chown de/d22 1 1 2024-09-21T08:02:27.654 INFO:tasks.workunit.client.1.smithi129.stdout:0/136: dread - de/d15/f1d zero size 2024-09-21T08:02:27.654 INFO:tasks.workunit.client.1.smithi129.stdout:0/137: mkdir de/d15/d29 0 2024-09-21T08:02:27.656 INFO:tasks.workunit.client.1.smithi129.stdout:5/187: dwrite d2/d1e/d35/f12 [0,4194304] 0 2024-09-21T08:02:27.658 INFO:tasks.workunit.client.1.smithi129.stdout:5/188: mkdir d2/d1e/d35/d37 0 2024-09-21T08:02:27.659 INFO:tasks.workunit.client.1.smithi129.stdout:5/189: chown d2/d1e/d35/f22 509133 1 2024-09-21T08:02:27.659 INFO:tasks.workunit.client.1.smithi129.stdout:5/190: read - d2/d2a/f2e zero size 2024-09-21T08:02:27.659 INFO:tasks.workunit.client.1.smithi129.stdout:5/191: stat d2/d1e/d35/cd 0 2024-09-21T08:02:27.661 INFO:tasks.workunit.client.1.smithi129.stdout:4/151: dwrite d5/f39 [0,4194304] 0 2024-09-21T08:02:27.661 INFO:tasks.workunit.client.1.smithi129.stdout:4/152: fdatasync d5/d6/f7 0 2024-09-21T08:02:27.661 INFO:tasks.workunit.client.1.smithi129.stdout:4/153: fdatasync d5/f2b 0 2024-09-21T08:02:27.661 INFO:tasks.workunit.client.1.smithi129.stdout:6/120: dwrite d7/d1b/d25/f2c [0,4194304] 0 2024-09-21T08:02:27.662 INFO:tasks.workunit.client.1.smithi129.stdout:6/121: stat d7/d1b/d1e/c2d 0 2024-09-21T08:02:27.662 INFO:tasks.workunit.client.1.smithi129.stdout:6/122: fdatasync d7/fd 0 2024-09-21T08:02:27.662 INFO:tasks.workunit.client.1.smithi129.stdout:6/123: fdatasync d7/d10/f14 0 2024-09-21T08:02:27.662 INFO:tasks.workunit.client.1.smithi129.stdout:6/124: fsync d7/f24 0 2024-09-21T08:02:27.664 INFO:tasks.workunit.client.1.smithi129.stdout:3/146: dwrite d3/da/dc/fd [0,4194304] 0 2024-09-21T08:02:27.665 INFO:tasks.workunit.client.1.smithi129.stdout:3/147: chown d3/da/dc/f23 1000951 1 2024-09-21T08:02:27.665 INFO:tasks.workunit.client.1.smithi129.stdout:6/125: mknod d7/c30 0 2024-09-21T08:02:27.666 INFO:tasks.workunit.client.1.smithi129.stdout:3/148: mknod d3/c32 0 2024-09-21T08:02:27.667 INFO:tasks.workunit.client.1.smithi129.stdout:9/197: dread d17/f1c [0,4194304] 0 2024-09-21T08:02:27.668 INFO:tasks.workunit.client.1.smithi129.stdout:2/209: dwrite d1/d13/d3a/d47/d1f/f40 [0,4194304] 0 2024-09-21T08:02:27.669 INFO:tasks.workunit.client.1.smithi129.stdout:6/126: rename d7/d10/f21 to d7/d1b/d25/f31 0 2024-09-21T08:02:27.669 INFO:tasks.workunit.client.1.smithi129.stdout:3/149: rename d3 to d3/da/dc/d11/d2f/d33 22 2024-09-21T08:02:27.669 INFO:tasks.workunit.client.1.smithi129.stdout:3/150: truncate d3/da/f2e 63419 0 2024-09-21T08:02:27.671 INFO:tasks.workunit.client.1.smithi129.stdout:9/198: symlink d17/d2c/d31/d35/l4c 0 2024-09-21T08:02:27.672 INFO:tasks.workunit.client.1.smithi129.stdout:3/151: dread d3/da/f1a [0,4194304] 0 2024-09-21T08:02:27.672 INFO:tasks.workunit.client.1.smithi129.stdout:3/152: fsync d3/da/f1a 0 2024-09-21T08:02:27.673 INFO:tasks.workunit.client.1.smithi129.stdout:9/199: symlink d17/d2c/d31/l4d 0 2024-09-21T08:02:27.675 INFO:tasks.workunit.client.1.smithi129.stdout:9/200: symlink d17/d22/l4e 0 2024-09-21T08:02:27.675 INFO:tasks.workunit.client.1.smithi129.stdout:9/201: readlink d17/d2c/d31/d35/l4c 0 2024-09-21T08:02:27.675 INFO:tasks.workunit.client.1.smithi129.stdout:9/202: read f4 [1475118,61538] 0 2024-09-21T08:02:27.677 INFO:tasks.workunit.client.1.smithi129.stdout:9/203: rename d17/d22/f2f to d17/d46/f4f 0 2024-09-21T08:02:27.677 INFO:tasks.workunit.client.1.smithi129.stdout:2/210: dread d1/dc/d26/f33 [0,4194304] 0 2024-09-21T08:02:27.677 INFO:tasks.workunit.client.1.smithi129.stdout:9/204: creat d17/d2c/d31/d35/f50 x:0 0 0 2024-09-21T08:02:27.685 INFO:tasks.workunit.client.1.smithi129.stdout:9/205: write f16 [1272789,67738] 0 2024-09-21T08:02:27.685 INFO:tasks.workunit.client.1.smithi129.stdout:9/206: readlink d17/d2c/d31/d35/l3d 0 2024-09-21T08:02:27.686 INFO:tasks.workunit.client.1.smithi129.stdout:6/127: dread f5 [0,4194304] 0 2024-09-21T08:02:27.687 INFO:tasks.workunit.client.1.smithi129.stdout:9/207: creat d17/d2c/d31/f51 x:0 0 0 2024-09-21T08:02:27.688 INFO:tasks.workunit.client.1.smithi129.stdout:6/128: symlink d7/d1b/d1c/l32 0 2024-09-21T08:02:27.689 INFO:tasks.workunit.client.1.smithi129.stdout:9/208: unlink f4 0 2024-09-21T08:02:27.695 INFO:tasks.workunit.client.1.smithi129.stdout:4/154: dwrite d5/f39 [0,4194304] 0 2024-09-21T08:02:27.695 INFO:tasks.workunit.client.1.smithi129.stdout:4/155: chown d5/d16/f32 0 1 2024-09-21T08:02:27.695 INFO:tasks.workunit.client.1.smithi129.stdout:3/153: dwrite d3/f29 [0,4194304] 0 2024-09-21T08:02:27.696 INFO:tasks.workunit.client.1.smithi129.stdout:3/154: fdatasync d3/f4 0 2024-09-21T08:02:27.697 INFO:tasks.workunit.client.1.smithi129.stdout:4/156: getdents d5/d2e 0 2024-09-21T08:02:27.699 INFO:tasks.workunit.client.1.smithi129.stdout:3/155: creat d3/da/dc/d11/f34 x:0 0 0 2024-09-21T08:02:27.700 INFO:tasks.workunit.client.1.smithi129.stdout:4/157: mkdir d5/d16/d24/d3b 0 2024-09-21T08:02:27.703 INFO:tasks.workunit.client.1.smithi129.stdout:0/138: dwrite de/d22/f20 [0,4194304] 0 2024-09-21T08:02:27.706 INFO:tasks.workunit.client.1.smithi129.stdout:0/139: symlink de/d1f/l2a 0 2024-09-21T08:02:27.714 INFO:tasks.workunit.client.1.smithi129.stdout:4/158: dread d5/d6/f30 [0,4194304] 0 2024-09-21T08:02:27.715 INFO:tasks.workunit.client.1.smithi129.stdout:4/159: write f2 [782201,6127] 0 2024-09-21T08:02:27.715 INFO:tasks.workunit.client.1.smithi129.stdout:4/160: readlink d5/d2e/l3a 0 2024-09-21T08:02:27.719 INFO:tasks.workunit.client.1.smithi129.stdout:0/140: write de/f17 [4052301,111619] 0 2024-09-21T08:02:27.721 INFO:tasks.workunit.client.1.smithi129.stdout:5/192: dwrite d2/d1e/d35/f12 [4194304,4194304] 0 2024-09-21T08:02:27.722 INFO:tasks.workunit.client.1.smithi129.stdout:9/209: dwrite d17/d46/f39 [0,4194304] 0 2024-09-21T08:02:27.725 INFO:tasks.workunit.client.1.smithi129.stdout:6/129: dwrite d7/d10/f16 [0,4194304] 0 2024-09-21T08:02:27.726 INFO:tasks.workunit.client.1.smithi129.stdout:9/210: creat d17/d38/f52 x:0 0 0 2024-09-21T08:02:27.728 INFO:tasks.workunit.client.1.smithi129.stdout:3/156: rmdir d3 39 2024-09-21T08:02:27.728 INFO:tasks.workunit.client.1.smithi129.stdout:3/157: dread - d3/da/dc/d11/d2f/f28 zero size 2024-09-21T08:02:27.730 INFO:tasks.workunit.client.1.smithi129.stdout:9/211: mkdir d17/d22/d33/d36/d48/d3f/d53 0 2024-09-21T08:02:27.731 INFO:tasks.workunit.client.1.smithi129.stdout:3/158: rmdir d3/d2b 0 2024-09-21T08:02:27.733 INFO:tasks.workunit.client.1.smithi129.stdout:3/159: rename d3/c12 to d3/da/dc/d25/c35 0 2024-09-21T08:02:27.736 INFO:tasks.workunit.client.1.smithi129.stdout:3/160: creat d3/da/dc/d11/d2f/d27/f36 x:0 0 0 2024-09-21T08:02:27.736 INFO:tasks.workunit.client.1.smithi129.stdout:3/161: dread - d3/da/dc/d11/d2f/d27/f36 zero size 2024-09-21T08:02:27.743 INFO:tasks.workunit.client.1.smithi129.stdout:0/141: dwrite de/d22/f26 [0,4194304] 0 2024-09-21T08:02:27.743 INFO:tasks.workunit.client.1.smithi129.stdout:0/142: creat de/d22/f2b x:0 0 0 2024-09-21T08:02:27.746 INFO:tasks.workunit.client.1.smithi129.stdout:0/143: mknod de/d22/c2c 0 2024-09-21T08:02:27.757 INFO:tasks.workunit.client.1.smithi129.stdout:0/144: read de/d22/f20 [3035869,127336] 0 2024-09-21T08:02:27.757 INFO:tasks.workunit.client.1.smithi129.stdout:5/193: dwrite d2/d1e/d35/f2d [0,4194304] 0 2024-09-21T08:02:27.757 INFO:tasks.workunit.client.1.smithi129.stdout:4/161: dwrite d5/d16/f1f [0,4194304] 0 2024-09-21T08:02:27.757 INFO:tasks.workunit.client.1.smithi129.stdout:4/162: creat d5/f3c x:0 0 0 2024-09-21T08:02:27.758 INFO:tasks.workunit.client.1.smithi129.stdout:0/145: unlink c9 0 2024-09-21T08:02:27.762 INFO:tasks.workunit.client.1.smithi129.stdout:0/146: rmdir de/d15 39 2024-09-21T08:02:27.762 INFO:tasks.workunit.client.1.smithi129.stdout:0/147: dread - de/d22/f2b zero size 2024-09-21T08:02:27.763 INFO:tasks.workunit.client.1.smithi129.stdout:3/162: dwrite d3/da/f2e [0,4194304] 0 2024-09-21T08:02:27.763 INFO:tasks.workunit.client.1.smithi129.stdout:3/163: chown l0 1 1 2024-09-21T08:02:27.763 INFO:tasks.workunit.client.1.smithi129.stdout:6/130: dwrite d7/d10/f14 [0,4194304] 0 2024-09-21T08:02:27.767 INFO:tasks.workunit.client.1.smithi129.stdout:0/148: dread f6 [0,4194304] 0 2024-09-21T08:02:27.770 INFO:tasks.workunit.client.1.smithi129.stdout:3/164: mknod d3/da/dc/d11/c37 0 2024-09-21T08:02:27.771 INFO:tasks.workunit.client.1.smithi129.stdout:0/149: creat de/d22/d27/f2d x:0 0 0 2024-09-21T08:02:27.774 INFO:tasks.workunit.client.1.smithi129.stdout:5/194: dwrite d2/d1e/d35/f2b [0,4194304] 0 2024-09-21T08:02:27.774 INFO:tasks.workunit.client.1.smithi129.stdout:8/123: sync 2024-09-21T08:02:27.774 INFO:tasks.workunit.client.1.smithi129.stdout:6/131: write d7/f9 [1204287,51952] 0 2024-09-21T08:02:27.775 INFO:tasks.workunit.client.1.smithi129.stdout:1/257: sync 2024-09-21T08:02:27.776 INFO:tasks.workunit.client.1.smithi129.stdout:0/150: dread f0 [0,4194304] 0 2024-09-21T08:02:27.776 INFO:tasks.workunit.client.1.smithi129.stdout:0/151: chown de/d22/d27 3246573 1 2024-09-21T08:02:27.777 INFO:tasks.workunit.client.1.smithi129.stdout:8/124: unlink d0/d6/d7/d9/c13 0 2024-09-21T08:02:27.779 INFO:tasks.workunit.client.1.smithi129.stdout:6/132: link d7/c30 d7/c33 0 2024-09-21T08:02:27.781 INFO:tasks.workunit.client.1.smithi129.stdout:0/152: dread f0 [0,4194304] 0 2024-09-21T08:02:27.782 INFO:tasks.workunit.client.1.smithi129.stdout:5/195: rmdir d2/d2a 39 2024-09-21T08:02:27.783 INFO:tasks.workunit.client.1.smithi129.stdout:2/211: sync 2024-09-21T08:02:27.783 INFO:tasks.workunit.client.1.smithi129.stdout:2/212: readlink d1/d13/d32/l4e 0 2024-09-21T08:02:27.783 INFO:tasks.workunit.client.1.smithi129.stdout:6/133: symlink d7/d1b/d1c/l34 0 2024-09-21T08:02:27.783 INFO:tasks.workunit.client.1.smithi129.stdout:8/125: getdents d0 0 2024-09-21T08:02:27.784 INFO:tasks.workunit.client.1.smithi129.stdout:7/203: sync 2024-09-21T08:02:27.784 INFO:tasks.workunit.client.1.smithi129.stdout:2/213: mknod d1/dc/d19/c52 0 2024-09-21T08:02:27.786 INFO:tasks.workunit.client.1.smithi129.stdout:8/126: rename d0/d6/lc to d0/d6/d7/l25 0 2024-09-21T08:02:27.788 INFO:tasks.workunit.client.1.smithi129.stdout:6/134: dread d7/d1b/d25/f2e [0,4194304] 0 2024-09-21T08:02:27.789 INFO:tasks.workunit.client.1.smithi129.stdout:2/214: mkdir d1/d53 0 2024-09-21T08:02:27.789 INFO:tasks.workunit.client.1.smithi129.stdout:8/127: creat d0/d6/d7/d18/f26 x:0 0 0 2024-09-21T08:02:27.791 INFO:tasks.workunit.client.1.smithi129.stdout:7/204: rmdir d0 39 2024-09-21T08:02:27.792 INFO:tasks.workunit.client.1.smithi129.stdout:0/153: dread fb [0,4194304] 0 2024-09-21T08:02:27.792 INFO:tasks.workunit.client.1.smithi129.stdout:0/154: rename de to de/d1f/d2e 22 2024-09-21T08:02:27.792 INFO:tasks.workunit.client.1.smithi129.stdout:0/155: readlink l4 0 2024-09-21T08:02:27.792 INFO:tasks.workunit.client.1.smithi129.stdout:6/135: mkdir d7/d1b/d25/d35 0 2024-09-21T08:02:27.792 INFO:tasks.workunit.client.1.smithi129.stdout:6/136: getdents d7/d1b/d25/d35 0 2024-09-21T08:02:27.793 INFO:tasks.workunit.client.1.smithi129.stdout:3/165: dwrite d3/da/dc/f23 [0,4194304] 0 2024-09-21T08:02:27.793 INFO:tasks.workunit.client.1.smithi129.stdout:2/215: rmdir d1/d13/d3a/d3f 39 2024-09-21T08:02:27.794 INFO:tasks.workunit.client.1.smithi129.stdout:8/128: mkdir d0/d6/d7/d18/d27 0 2024-09-21T08:02:27.795 INFO:tasks.workunit.client.1.smithi129.stdout:2/216: dread d1/d13/f14 [0,4194304] 0 2024-09-21T08:02:27.796 INFO:tasks.workunit.client.1.smithi129.stdout:0/156: mkdir de/d22/d27/d2f 0 2024-09-21T08:02:27.796 INFO:tasks.workunit.client.1.smithi129.stdout:0/157: fdatasync de/d22/d27/f2d 0 2024-09-21T08:02:27.799 INFO:tasks.workunit.client.1.smithi129.stdout:3/166: link d3/da/dc/d11/l15 d3/l38 0 2024-09-21T08:02:27.799 INFO:tasks.workunit.client.1.smithi129.stdout:3/167: fdatasync d3/da/dc/d11/d2f/f28 0 2024-09-21T08:02:27.800 INFO:tasks.workunit.client.1.smithi129.stdout:2/217: symlink d1/d13/l54 0 2024-09-21T08:02:27.801 INFO:tasks.workunit.client.1.smithi129.stdout:0/158: mkdir de/d22/d27/d30 0 2024-09-21T08:02:27.802 INFO:tasks.workunit.client.1.smithi129.stdout:3/168: symlink d3/da/dc/l39 0 2024-09-21T08:02:27.802 INFO:tasks.workunit.client.1.smithi129.stdout:3/169: creat d3/da/dc/d11/d2f/d27/f3a x:0 0 0 2024-09-21T08:02:27.802 INFO:tasks.workunit.client.1.smithi129.stdout:3/170: readlink d3/da/le 0 2024-09-21T08:02:27.802 INFO:tasks.workunit.client.1.smithi129.stdout:8/129: dread d0/d6/d7/f15 [0,4194304] 0 2024-09-21T08:02:27.803 INFO:tasks.workunit.client.1.smithi129.stdout:1/258: dwrite d1/d4/f17 [0,4194304] 0 2024-09-21T08:02:27.803 INFO:tasks.workunit.client.1.smithi129.stdout:5/196: dwrite d2/f4 [0,4194304] 0 2024-09-21T08:02:27.805 INFO:tasks.workunit.client.1.smithi129.stdout:3/171: symlink d3/l3b 0 2024-09-21T08:02:27.807 INFO:tasks.workunit.client.1.smithi129.stdout:8/130: rename d0/d6/d7/d18/f22 to d0/d6/f28 0 2024-09-21T08:02:27.807 INFO:tasks.workunit.client.1.smithi129.stdout:1/259: rename d1/d16 to d1/d16/d5f/d63 22 2024-09-21T08:02:27.811 INFO:tasks.workunit.client.1.smithi129.stdout:3/172: unlink d3/da/dc/d11/l15 0 2024-09-21T08:02:27.813 INFO:tasks.workunit.client.1.smithi129.stdout:8/131: unlink d0/d6/d7/d9/c19 0 2024-09-21T08:02:27.813 INFO:tasks.workunit.client.1.smithi129.stdout:8/132: chown d0/d6/d7/f21 105829555 1 2024-09-21T08:02:27.813 INFO:tasks.workunit.client.1.smithi129.stdout:8/133: chown d0/d6/c23 1963 1 2024-09-21T08:02:27.814 INFO:tasks.workunit.client.1.smithi129.stdout:1/260: mkdir d1/d64 0 2024-09-21T08:02:27.815 INFO:tasks.workunit.client.1.smithi129.stdout:1/261: stat d1/d16/d28/f54 0 2024-09-21T08:02:27.815 INFO:tasks.workunit.client.1.smithi129.stdout:1/262: dread - d1/d16/f2a zero size 2024-09-21T08:02:27.815 INFO:tasks.workunit.client.1.smithi129.stdout:1/263: stat d1/d16/f2a 0 2024-09-21T08:02:27.815 INFO:tasks.workunit.client.1.smithi129.stdout:8/134: symlink d0/d6/d7/d18/d27/l29 0 2024-09-21T08:02:27.815 INFO:tasks.workunit.client.1.smithi129.stdout:8/135: truncate d0/d6/f28 708356 0 2024-09-21T08:02:27.827 INFO:tasks.workunit.client.1.smithi129.stdout:7/205: dwrite d0/f26 [0,4194304] 0 2024-09-21T08:02:27.827 INFO:tasks.workunit.client.1.smithi129.stdout:7/206: write d0/d1e/f40 [443789,94351] 0 2024-09-21T08:02:27.828 INFO:tasks.workunit.client.1.smithi129.stdout:7/207: creat d0/d46/f53 x:0 0 0 2024-09-21T08:02:27.831 INFO:tasks.workunit.client.1.smithi129.stdout:7/208: dread d0/f8 [0,4194304] 0 2024-09-21T08:02:27.836 INFO:tasks.workunit.client.1.smithi129.stdout:7/209: dread d0/f17 [0,4194304] 0 2024-09-21T08:02:27.837 INFO:tasks.workunit.client.1.smithi129.stdout:7/210: mknod d0/c54 0 2024-09-21T08:02:27.838 INFO:tasks.workunit.client.1.smithi129.stdout:7/211: link d0/d1e/f36 d0/d1e/f55 0 2024-09-21T08:02:27.841 INFO:tasks.workunit.client.1.smithi129.stdout:6/137: dwrite d7/d1b/d1c/f1d [0,4194304] 0 2024-09-21T08:02:27.841 INFO:tasks.workunit.client.1.smithi129.stdout:2/218: dwrite d1/d13/f2c [0,4194304] 0 2024-09-21T08:02:27.841 INFO:tasks.workunit.client.1.smithi129.stdout:2/219: creat d1/d13/d32/f55 x:0 0 0 2024-09-21T08:02:27.841 INFO:tasks.workunit.client.1.smithi129.stdout:8/136: dwrite d0/d6/d7/fb [4194304,4194304] 0 2024-09-21T08:02:27.841 INFO:tasks.workunit.client.1.smithi129.stdout:8/137: fdatasync d0/d6/d7/d9/f12 0 2024-09-21T08:02:27.845 INFO:tasks.workunit.client.1.smithi129.stdout:2/220: symlink d1/dc/d19/d36/l56 0 2024-09-21T08:02:27.846 INFO:tasks.workunit.client.1.smithi129.stdout:2/221: getdents d1/d13/d3a/d3f/d50 0 2024-09-21T08:02:27.846 INFO:tasks.workunit.client.1.smithi129.stdout:5/197: dwrite d2/d1e/f32 [0,4194304] 0 2024-09-21T08:02:27.846 INFO:tasks.workunit.client.1.smithi129.stdout:5/198: dread - d2/d1e/d35/d33/f34 zero size 2024-09-21T08:02:27.847 INFO:tasks.workunit.client.1.smithi129.stdout:2/222: creat d1/d13/d3a/d3f/f57 x:0 0 0 2024-09-21T08:02:27.848 INFO:tasks.workunit.client.1.smithi129.stdout:3/173: dwrite d3/da/dc/f23 [0,4194304] 0 2024-09-21T08:02:27.851 INFO:tasks.workunit.client.1.smithi129.stdout:5/199: rename c0 to d2/d1e/d35/d33/c38 0 2024-09-21T08:02:27.877 INFO:tasks.workunit.client.1.smithi129.stdout:6/138: dwrite d7/fd [0,4194304] 0 2024-09-21T08:02:27.880 INFO:tasks.workunit.client.1.smithi129.stdout:7/212: dwrite d0/d1e/f40 [0,4194304] 0 2024-09-21T08:02:27.884 INFO:tasks.workunit.client.1.smithi129.stdout:7/213: unlink d0/l45 0 2024-09-21T08:02:27.884 INFO:tasks.workunit.client.1.smithi129.stdout:6/139: rmdir d7/d1b/d25/d2b 39 2024-09-21T08:02:27.886 INFO:tasks.workunit.client.1.smithi129.stdout:6/140: creat d7/d1b/d1e/f36 x:0 0 0 2024-09-21T08:02:27.886 INFO:tasks.workunit.client.1.smithi129.stdout:6/141: truncate d7/d1b/d25/d2b/f2f 65088 0 2024-09-21T08:02:27.887 INFO:tasks.workunit.client.1.smithi129.stdout:6/142: truncate d7/d10/f1f 448954 0 2024-09-21T08:02:27.888 INFO:tasks.workunit.client.1.smithi129.stdout:6/143: creat d7/f37 x:0 0 0 2024-09-21T08:02:27.888 INFO:tasks.workunit.client.1.smithi129.stdout:6/144: fdatasync d7/f24 0 2024-09-21T08:02:27.893 INFO:tasks.workunit.client.1.smithi129.stdout:3/174: dwrite d3/f13 [8388608,4194304] 0 2024-09-21T08:02:27.894 INFO:tasks.workunit.client.1.smithi129.stdout:5/200: dwrite d2/f18 [0,4194304] 0 2024-09-21T08:02:27.894 INFO:tasks.workunit.client.1.smithi129.stdout:2/223: dwrite d1/d13/d3a/d47/d1f/f22 [0,4194304] 0 2024-09-21T08:02:27.895 INFO:tasks.workunit.client.1.smithi129.stdout:8/138: dwrite d0/d6/f1f [0,4194304] 0 2024-09-21T08:02:27.898 INFO:tasks.workunit.client.1.smithi129.stdout:7/214: dread d0/d1e/f40 [0,4194304] 0 2024-09-21T08:02:27.900 INFO:tasks.workunit.client.1.smithi129.stdout:6/145: dread d7/fe [0,4194304] 0 2024-09-21T08:02:27.900 INFO:tasks.workunit.client.1.smithi129.stdout:9/212: sync 2024-09-21T08:02:27.900 INFO:tasks.workunit.client.1.smithi129.stdout:6/146: dread - d7/d1b/f23 zero size 2024-09-21T08:02:27.901 INFO:tasks.workunit.client.1.smithi129.stdout:8/139: unlink d0/d6/l14 0 2024-09-21T08:02:27.901 INFO:tasks.workunit.client.1.smithi129.stdout:8/140: creat d0/d6/d7/d9/f2a x:0 0 0 2024-09-21T08:02:27.901 INFO:tasks.workunit.client.1.smithi129.stdout:3/175: mkdir d3/da/d3c 0 2024-09-21T08:02:27.901 INFO:tasks.workunit.client.1.smithi129.stdout:3/176: stat d3/da/dc/d25/c30 0 2024-09-21T08:02:27.902 INFO:tasks.workunit.client.1.smithi129.stdout:7/215: getdents d0/d1e 0 2024-09-21T08:02:27.902 INFO:tasks.workunit.client.1.smithi129.stdout:7/216: fsync d0/d1e/f4b 0 2024-09-21T08:02:27.904 INFO:tasks.workunit.client.1.smithi129.stdout:9/213: unlink d17/d23/f2a 0 2024-09-21T08:02:27.905 INFO:tasks.workunit.client.1.smithi129.stdout:6/147: symlink d7/d1b/d25/d35/l38 0 2024-09-21T08:02:27.906 INFO:tasks.workunit.client.1.smithi129.stdout:2/224: dread d1/d13/d3a/d47/d1f/f40 [0,4194304] 0 2024-09-21T08:02:27.907 INFO:tasks.workunit.client.1.smithi129.stdout:3/177: fsync d3/f29 0 2024-09-21T08:02:27.907 INFO:tasks.workunit.client.1.smithi129.stdout:9/214: dread d17/d23/f2d [0,4194304] 0 2024-09-21T08:02:27.907 INFO:tasks.workunit.client.1.smithi129.stdout:9/215: creat d17/d2c/d31/d35/f54 x:0 0 0 2024-09-21T08:02:27.908 INFO:tasks.workunit.client.1.smithi129.stdout:7/217: mkdir d0/d46/d56 0 2024-09-21T08:02:27.908 INFO:tasks.workunit.client.1.smithi129.stdout:7/218: getdents d0/d46/d56 0 2024-09-21T08:02:27.908 INFO:tasks.workunit.client.1.smithi129.stdout:4/163: sync 2024-09-21T08:02:27.910 INFO:tasks.workunit.client.1.smithi129.stdout:2/225: link d1/d13/f1d d1/d53/f58 0 2024-09-21T08:02:27.911 INFO:tasks.workunit.client.1.smithi129.stdout:0/159: sync 2024-09-21T08:02:27.911 INFO:tasks.workunit.client.1.smithi129.stdout:1/264: sync 2024-09-21T08:02:27.911 INFO:tasks.workunit.client.1.smithi129.stdout:0/160: chown de/d15/l1b 108 1 2024-09-21T08:02:27.911 INFO:tasks.workunit.client.1.smithi129.stdout:0/161: truncate de/d1f/f24 2138938 0 2024-09-21T08:02:27.912 INFO:tasks.workunit.client.1.smithi129.stdout:8/141: getdents d0/d6 0 2024-09-21T08:02:27.913 INFO:tasks.workunit.client.1.smithi129.stdout:3/178: unlink d3/da/l14 0 2024-09-21T08:02:27.914 INFO:tasks.workunit.client.1.smithi129.stdout:3/179: write d3/da/f1a [5737592,86845] 0 2024-09-21T08:02:27.918 INFO:tasks.workunit.client.1.smithi129.stdout:0/162: mkdir de/d15/d31 0 2024-09-21T08:02:27.919 INFO:tasks.workunit.client.1.smithi129.stdout:2/226: mknod d1/d13/d3a/d3f/d50/c59 0 2024-09-21T08:02:27.919 INFO:tasks.workunit.client.1.smithi129.stdout:3/180: write d3/da/dc/f21 [819081,12257] 0 2024-09-21T08:02:27.922 INFO:tasks.workunit.client.1.smithi129.stdout:7/219: dread d0/d1e/f4b [0,4194304] 0 2024-09-21T08:02:27.922 INFO:tasks.workunit.client.1.smithi129.stdout:7/220: write d0/d46/f4d [470379,8928] 0 2024-09-21T08:02:27.923 INFO:tasks.workunit.client.1.smithi129.stdout:2/227: rmdir d1/dc/d19/d36 39 2024-09-21T08:02:27.925 INFO:tasks.workunit.client.1.smithi129.stdout:7/221: unlink d0/d1e/f23 0 2024-09-21T08:02:27.925 INFO:tasks.workunit.client.1.smithi129.stdout:7/222: readlink d0/d1e/l31 0 2024-09-21T08:02:27.925 INFO:tasks.workunit.client.1.smithi129.stdout:7/223: creat d0/d46/f57 x:0 0 0 2024-09-21T08:02:27.925 INFO:tasks.workunit.client.1.smithi129.stdout:7/224: write d0/d1e/f55 [4800046,44255] 0 2024-09-21T08:02:27.928 INFO:tasks.workunit.client.1.smithi129.stdout:2/228: dread d1/d13/d3a/d47/f27 [0,4194304] 0 2024-09-21T08:02:27.930 INFO:tasks.workunit.client.1.smithi129.stdout:9/216: dread d17/f1c [0,4194304] 0 2024-09-21T08:02:27.930 INFO:tasks.workunit.client.1.smithi129.stdout:2/229: rename d1/dc/f21 to d1/d13/d3a/d3f/d50/f5a 0 2024-09-21T08:02:27.933 INFO:tasks.workunit.client.1.smithi129.stdout:4/164: dwrite d5/d6/f7 [0,4194304] 0 2024-09-21T08:02:27.933 INFO:tasks.workunit.client.1.smithi129.stdout:2/230: rename d1/f17 to d1/dc/d19/d4c/f5b 0 2024-09-21T08:02:27.935 INFO:tasks.workunit.client.1.smithi129.stdout:9/217: unlink d17/d2c/f4a 0 2024-09-21T08:02:27.936 INFO:tasks.workunit.client.1.smithi129.stdout:4/165: chown l3 824169 1 2024-09-21T08:02:27.937 INFO:tasks.workunit.client.1.smithi129.stdout:8/142: dwrite d0/f16 [0,4194304] 0 2024-09-21T08:02:27.937 INFO:tasks.workunit.client.1.smithi129.stdout:8/143: read - d0/d6/d7/d18/f26 zero size 2024-09-21T08:02:27.937 INFO:tasks.workunit.client.1.smithi129.stdout:8/144: write d0/d6/d7/f21 [844264,88585] 0 2024-09-21T08:02:27.938 INFO:tasks.workunit.client.1.smithi129.stdout:2/231: symlink d1/dc/l5c 0 2024-09-21T08:02:27.938 INFO:tasks.workunit.client.1.smithi129.stdout:2/232: chown d1/dc/d26/c30 4921 1 2024-09-21T08:02:27.938 INFO:tasks.workunit.client.1.smithi129.stdout:2/233: readlink d1/d13/d32/l4b 0 2024-09-21T08:02:27.940 INFO:tasks.workunit.client.1.smithi129.stdout:2/234: creat d1/d13/d3a/d3f/d50/f5d x:0 0 0 2024-09-21T08:02:27.940 INFO:tasks.workunit.client.1.smithi129.stdout:2/235: chown d1/d13/d3a/d47/d1f/f22 1777830695 1 2024-09-21T08:02:27.942 INFO:tasks.workunit.client.1.smithi129.stdout:1/265: dwrite d1/d44/f53 [0,4194304] 0 2024-09-21T08:02:27.943 INFO:tasks.workunit.client.1.smithi129.stdout:9/218: mkdir d17/d55 0 2024-09-21T08:02:27.948 INFO:tasks.workunit.client.1.smithi129.stdout:1/266: symlink d1/d16/d25/l65 0 2024-09-21T08:02:27.948 INFO:tasks.workunit.client.1.smithi129.stdout:1/267: fsync d1/d16/f2a 0 2024-09-21T08:02:27.954 INFO:tasks.workunit.client.1.smithi129.stdout:1/268: creat d1/d64/f66 x:0 0 0 2024-09-21T08:02:27.956 INFO:tasks.workunit.client.1.smithi129.stdout:1/269: symlink d1/d9/l67 0 2024-09-21T08:02:27.960 INFO:tasks.workunit.client.1.smithi129.stdout:9/219: rename d17/f1c to d17/d2c/d31/f56 0 2024-09-21T08:02:27.962 INFO:tasks.workunit.client.1.smithi129.stdout:9/220: creat d17/d22/d33/d36/d48/d3f/f57 x:0 0 0 2024-09-21T08:02:27.969 INFO:tasks.workunit.client.1.smithi129.stdout:2/236: dwrite d1/d13/f28 [0,4194304] 0 2024-09-21T08:02:27.970 INFO:tasks.workunit.client.1.smithi129.stdout:4/166: dwrite d5/d16/f32 [0,4194304] 0 2024-09-21T08:02:27.971 INFO:tasks.workunit.client.1.smithi129.stdout:2/237: mknod d1/d13/d3a/d47/d1f/c5e 0 2024-09-21T08:02:27.971 INFO:tasks.workunit.client.1.smithi129.stdout:2/238: truncate d1/d13/d3a/d47/d1f/f23 1158816 0 2024-09-21T08:02:27.972 INFO:tasks.workunit.client.1.smithi129.stdout:2/239: rmdir d1/dc/d26/d45/d4f 0 2024-09-21T08:02:27.972 INFO:tasks.workunit.client.1.smithi129.stdout:2/240: truncate d1/dc/f37 588255 0 2024-09-21T08:02:27.972 INFO:tasks.workunit.client.1.smithi129.stdout:2/241: chown d1/dc/d26/f51 21551319 1 2024-09-21T08:02:27.973 INFO:tasks.workunit.client.1.smithi129.stdout:2/242: mkdir d1/d13/d3a/d47/d5f 0 2024-09-21T08:02:27.973 INFO:tasks.workunit.client.1.smithi129.stdout:2/243: chown d1/d13/d3a/d47/f34 101568 1 2024-09-21T08:02:27.979 INFO:tasks.workunit.client.1.smithi129.stdout:2/244: rename d1/d13/f1d to d1/dc/d19/d36/f60 0 2024-09-21T08:02:27.979 INFO:tasks.workunit.client.1.smithi129.stdout:2/245: truncate d1/d13/d3a/d47/f3c 832694 0 2024-09-21T08:02:27.979 INFO:tasks.workunit.client.1.smithi129.stdout:2/246: chown d1/l4d 664548981 1 2024-09-21T08:02:27.981 INFO:tasks.workunit.client.1.smithi129.stdout:2/247: creat d1/d13/d3a/d47/d5f/f61 x:0 0 0 2024-09-21T08:02:27.981 INFO:tasks.workunit.client.1.smithi129.stdout:2/248: creat d1/dc/d26/f62 x:0 0 0 2024-09-21T08:02:27.986 INFO:tasks.workunit.client.1.smithi129.stdout:2/249: creat d1/d13/d3a/d47/f63 x:0 0 0 2024-09-21T08:02:27.987 INFO:tasks.workunit.client.1.smithi129.stdout:2/250: unlink d1/dc/d26/f48 0 2024-09-21T08:02:27.987 INFO:tasks.workunit.client.1.smithi129.stdout:2/251: dread - d1/d13/d32/f55 zero size 2024-09-21T08:02:27.987 INFO:tasks.workunit.client.1.smithi129.stdout:2/252: write d1/d13/d3a/d3f/d50/f5d [427875,67360] 0 2024-09-21T08:02:27.987 INFO:tasks.workunit.client.1.smithi129.stdout:2/253: truncate d1/dc/f37 1326401 0 2024-09-21T08:02:27.988 INFO:tasks.workunit.client.1.smithi129.stdout:2/254: truncate d1/d53/f58 3180300 0 2024-09-21T08:02:27.992 INFO:tasks.workunit.client.1.smithi129.stdout:4/167: dwrite d5/f14 [0,4194304] 0 2024-09-21T08:02:27.993 INFO:tasks.workunit.client.1.smithi129.stdout:2/255: rmdir d1/dc 39 2024-09-21T08:02:28.018 INFO:tasks.workunit.client.1.smithi129.stdout:4/168: dwrite d5/f14 [0,4194304] 0 2024-09-21T08:02:28.018 INFO:tasks.workunit.client.1.smithi129.stdout:4/169: creat d5/d11/f3d x:0 0 0 2024-09-21T08:02:28.018 INFO:tasks.workunit.client.1.smithi129.stdout:2/256: dwrite d1/d13/d3a/d47/f63 [0,4194304] 0 2024-09-21T08:02:28.022 INFO:tasks.workunit.client.1.smithi129.stdout:2/257: symlink d1/d13/d3a/d47/d5f/l64 0 2024-09-21T08:02:28.023 INFO:tasks.workunit.client.1.smithi129.stdout:2/258: unlink d1/d13/c1a 0 2024-09-21T08:02:28.026 INFO:tasks.workunit.client.1.smithi129.stdout:2/259: rename d1/d13/d3a/d3f to d1/dc/d26/d45/d65 0 2024-09-21T08:02:28.042 INFO:tasks.workunit.client.1.smithi129.stdout:4/170: dwrite d5/f39 [0,4194304] 0 2024-09-21T08:02:28.043 INFO:tasks.workunit.client.1.smithi129.stdout:2/260: dwrite d1/d13/d3a/d47/f34 [0,4194304] 0 2024-09-21T08:02:28.045 INFO:tasks.workunit.client.1.smithi129.stdout:2/261: getdents d1/d13/d3a/d47 0 2024-09-21T08:02:28.045 INFO:tasks.workunit.client.1.smithi129.stdout:2/262: symlink d1/l66 0 2024-09-21T08:02:28.047 INFO:tasks.workunit.client.1.smithi129.stdout:2/263: dread d1/dc/d26/d45/d65/d50/f5d [0,4194304] 0 2024-09-21T08:02:28.048 INFO:tasks.workunit.client.1.smithi129.stdout:2/264: unlink d1/dc/d19/c4a 0 2024-09-21T08:02:28.049 INFO:tasks.workunit.client.1.smithi129.stdout:2/265: dread d1/dc/d26/d45/d65/d50/f5a [0,4194304] 0 2024-09-21T08:02:28.050 INFO:tasks.workunit.client.1.smithi129.stdout:2/266: truncate d1/d13/f2c 3150100 0 2024-09-21T08:02:28.051 INFO:tasks.workunit.client.1.smithi129.stdout:2/267: creat d1/dc/d19/d4c/f67 x:0 0 0 2024-09-21T08:02:28.051 INFO:tasks.workunit.client.1.smithi129.stdout:2/268: stat d1/f2e 0 2024-09-21T08:02:28.051 INFO:tasks.workunit.client.1.smithi129.stdout:2/269: chown d1/dc/d26/f42 0 1 2024-09-21T08:02:28.051 INFO:tasks.workunit.client.1.smithi129.stdout:2/270: write d1/d13/d3a/d47/d5f/f61 [307547,91018] 0 2024-09-21T08:02:28.052 INFO:tasks.workunit.client.1.smithi129.stdout:2/271: mkdir d1/d53/d68 0 2024-09-21T08:02:28.052 INFO:tasks.workunit.client.1.smithi129.stdout:2/272: readlink d1/d13/l20 0 2024-09-21T08:02:28.052 INFO:tasks.workunit.client.1.smithi129.stdout:2/273: chown d1/dc/f10 1 1 2024-09-21T08:02:28.053 INFO:tasks.workunit.client.1.smithi129.stdout:4/171: write d5/d16/f1f [2794457,4319] 0 2024-09-21T08:02:28.053 INFO:tasks.workunit.client.1.smithi129.stdout:2/274: unlink d1/dc/d26/d45/d65/d50/f5a 0 2024-09-21T08:02:28.055 INFO:tasks.workunit.client.1.smithi129.stdout:4/172: creat d5/d16/d24/d3b/f3e x:0 0 0 2024-09-21T08:02:28.056 INFO:tasks.workunit.client.1.smithi129.stdout:2/275: truncate d1/d13/d3a/d47/d1f/f25 3655079 0 2024-09-21T08:02:28.057 INFO:tasks.workunit.client.1.smithi129.stdout:4/173: rename d5/d2e to d5/d11/d3f 0 2024-09-21T08:02:28.057 INFO:tasks.workunit.client.1.smithi129.stdout:4/174: readlink d5/d11/l38 0 2024-09-21T08:02:28.058 INFO:tasks.workunit.client.1.smithi129.stdout:2/276: mkdir d1/dc/d19/d36/d69 0 2024-09-21T08:02:28.058 INFO:tasks.workunit.client.1.smithi129.stdout:2/277: read - d1/f1c zero size 2024-09-21T08:02:28.058 INFO:tasks.workunit.client.1.smithi129.stdout:2/278: fdatasync d1/d13/d32/f55 0 2024-09-21T08:02:28.058 INFO:tasks.workunit.client.1.smithi129.stdout:4/175: mknod d5/d11/c40 0 2024-09-21T08:02:28.065 INFO:tasks.workunit.client.1.smithi129.stdout:4/176: write d5/d6/f2f [3622959,14053] 0 2024-09-21T08:02:28.067 INFO:tasks.workunit.client.1.smithi129.stdout:4/177: rename d5/d11/f17 to d5/d11/f41 0 2024-09-21T08:02:28.067 INFO:tasks.workunit.client.1.smithi129.stdout:4/178: chown d5/d16/l22 0 1 2024-09-21T08:02:28.067 INFO:tasks.workunit.client.1.smithi129.stdout:4/179: chown f2 898317250 1 2024-09-21T08:02:28.068 INFO:tasks.workunit.client.1.smithi129.stdout:4/180: rename d5/d11/f13 to d5/d16/d24/f42 0 2024-09-21T08:02:28.075 INFO:tasks.workunit.client.1.smithi129.stdout:2/279: dwrite d1/d13/f24 [0,4194304] 0 2024-09-21T08:02:28.075 INFO:tasks.workunit.client.1.smithi129.stdout:2/280: fsync d1/dc/f18 0 2024-09-21T08:02:28.076 INFO:tasks.workunit.client.1.smithi129.stdout:2/281: dread d1/d13/f14 [0,4194304] 0 2024-09-21T08:02:28.076 INFO:tasks.workunit.client.1.smithi129.stdout:2/282: truncate d1/dc/d19/d4c/f5b 866714 0 2024-09-21T08:02:28.076 INFO:tasks.workunit.client.1.smithi129.stdout:2/283: chown d1/d13/d32/f3b 112 1 2024-09-21T08:02:28.076 INFO:tasks.workunit.client.1.smithi129.stdout:2/284: truncate d1/dc/d26/d45/d65/f57 369512 0 2024-09-21T08:02:28.085 INFO:tasks.workunit.client.1.smithi129.stdout:2/285: dread d1/d13/d3a/d47/d1f/f25 [0,4194304] 0 2024-09-21T08:02:28.085 INFO:tasks.workunit.client.1.smithi129.stdout:2/286: fsync d1/dc/d26/d45/f46 0 2024-09-21T08:02:28.086 INFO:tasks.workunit.client.1.smithi129.stdout:2/287: rename d1/dc/d19/d36 to d1/dc/d19/d4c/d6a 0 2024-09-21T08:02:28.090 INFO:tasks.workunit.client.1.smithi129.stdout:2/288: rmdir d1/dc/d19/d4c/d6a 39 2024-09-21T08:02:28.090 INFO:tasks.workunit.client.1.smithi129.stdout:2/289: mknod d1/dc/d26/d45/d65/d50/c6b 0 2024-09-21T08:02:28.090 INFO:tasks.workunit.client.1.smithi129.stdout:2/290: chown d1/d13/d3a/d47/f63 8 1 2024-09-21T08:02:28.091 INFO:tasks.workunit.client.1.smithi129.stdout:2/291: fsync d1/d13/f41 0 2024-09-21T08:02:28.099 INFO:tasks.workunit.client.1.smithi129.stdout:2/292: dread d1/d13/f24 [0,4194304] 0 2024-09-21T08:02:28.100 INFO:tasks.workunit.client.1.smithi129.stdout:2/293: creat d1/dc/f6c x:0 0 0 2024-09-21T08:02:28.100 INFO:tasks.workunit.client.1.smithi129.stdout:2/294: fdatasync d1/dc/d26/f33 0 2024-09-21T08:02:28.101 INFO:tasks.workunit.client.1.smithi129.stdout:2/295: creat d1/dc/d19/f6d x:0 0 0 2024-09-21T08:02:28.101 INFO:tasks.workunit.client.1.smithi129.stdout:2/296: creat d1/dc/d26/d45/d65/d50/f6e x:0 0 0 2024-09-21T08:02:28.102 INFO:tasks.workunit.client.1.smithi129.stdout:2/297: creat d1/d13/d3a/f6f x:0 0 0 2024-09-21T08:02:28.103 INFO:tasks.workunit.client.1.smithi129.stdout:2/298: mknod d1/dc/d26/d45/d65/c70 0 2024-09-21T08:02:28.103 INFO:tasks.workunit.client.1.smithi129.stdout:2/299: creat d1/dc/d26/d45/d65/d50/f71 x:0 0 0 2024-09-21T08:02:28.108 INFO:tasks.workunit.client.1.smithi129.stdout:2/300: truncate d1/d13/f24 1678292 0 2024-09-21T08:02:28.108 INFO:tasks.workunit.client.1.smithi129.stdout:2/301: dread - d1/dc/d26/d45/f46 zero size 2024-09-21T08:02:28.117 INFO:tasks.workunit.client.1.smithi129.stdout:2/302: write d1/dc/f10 [1014828,47048] 0 2024-09-21T08:02:28.117 INFO:tasks.workunit.client.1.smithi129.stdout:2/303: truncate d1/dc/d19/f6d 220524 0 2024-09-21T08:02:28.119 INFO:tasks.workunit.client.1.smithi129.stdout:2/304: dread d1/f8 [0,4194304] 0 2024-09-21T08:02:28.120 INFO:tasks.workunit.client.1.smithi129.stdout:2/305: creat d1/d13/d3a/d47/f72 x:0 0 0 2024-09-21T08:02:28.120 INFO:tasks.workunit.client.1.smithi129.stdout:2/306: stat d1/dc/d19/d4c/d6a/f43 0 2024-09-21T08:02:28.127 INFO:tasks.workunit.client.1.smithi129.stdout:2/307: read d1/d13/d3a/d47/f63 [2342154,21524] 0 2024-09-21T08:02:28.127 INFO:tasks.workunit.client.1.smithi129.stdout:2/308: truncate d1/d53/f58 3442372 0 2024-09-21T08:02:28.128 INFO:tasks.workunit.client.1.smithi129.stdout:2/309: creat d1/d13/d3a/d47/d1f/f73 x:0 0 0 2024-09-21T08:02:28.128 INFO:tasks.workunit.client.1.smithi129.stdout:2/310: symlink d1/d13/d3a/d47/d5f/l74 0 2024-09-21T08:02:28.143 INFO:tasks.workunit.client.1.smithi129.stdout:2/311: dwrite d1/d13/d3a/d47/f72 [0,4194304] 0 2024-09-21T08:02:28.161 INFO:tasks.workunit.client.1.smithi129.stdout:2/312: dwrite d1/d13/d3a/d47/d1f/f22 [0,4194304] 0 2024-09-21T08:02:28.162 INFO:tasks.workunit.client.1.smithi129.stdout:2/313: symlink d1/dc/d19/l75 0 2024-09-21T08:02:28.163 INFO:tasks.workunit.client.1.smithi129.stdout:2/314: mknod d1/dc/d26/d45/d65/d50/c76 0 2024-09-21T08:02:28.164 INFO:tasks.workunit.client.1.smithi129.stdout:2/315: mkdir d1/d53/d77 0 2024-09-21T08:02:28.164 INFO:tasks.workunit.client.1.smithi129.stdout:2/316: chown d1/d13/d3a/d47/d1f/f25 0 1 2024-09-21T08:02:28.165 INFO:tasks.workunit.client.1.smithi129.stdout:2/317: unlink d1/d13/d3a/c3e 0 2024-09-21T08:02:28.165 INFO:tasks.workunit.client.1.smithi129.stdout:2/318: fdatasync d1/d13/d32/f55 0 2024-09-21T08:02:28.165 INFO:tasks.workunit.client.1.smithi129.stdout:2/319: readlink d1/d13/d3a/d47/d5f/l74 0 2024-09-21T08:02:28.165 INFO:tasks.workunit.client.1.smithi129.stdout:2/320: truncate d1/f4 4500447 0 2024-09-21T08:02:28.165 INFO:tasks.workunit.client.1.smithi129.stdout:2/321: fsync d1/d13/d3a/d47/d1f/f35 0 2024-09-21T08:02:28.166 INFO:tasks.workunit.client.1.smithi129.stdout:2/322: dread d1/d13/d3a/d47/f3c [0,4194304] 0 2024-09-21T08:02:28.167 INFO:tasks.workunit.client.1.smithi129.stdout:2/323: mkdir d1/dc/d19/d78 0 2024-09-21T08:02:28.167 INFO:tasks.workunit.client.1.smithi129.stdout:2/324: dread - d1/dc/d26/d45/f46 zero size 2024-09-21T08:02:28.167 INFO:tasks.workunit.client.1.smithi129.stdout:2/325: truncate d1/dc/d19/d4c/d6a/f43 3693166 0 2024-09-21T08:02:28.167 INFO:tasks.workunit.client.1.smithi129.stdout:2/326: write d1/d13/f41 [608788,77584] 0 2024-09-21T08:02:28.180 INFO:tasks.workunit.client.1.smithi129.stdout:2/327: dwrite d1/d13/d3a/d47/f72 [4194304,4194304] 0 2024-09-21T08:02:28.184 INFO:tasks.workunit.client.1.smithi129.stdout:2/328: read d1/dc/d26/f33 [2900245,73825] 0 2024-09-21T08:02:28.185 INFO:tasks.workunit.client.1.smithi129.stdout:2/329: unlink d1/d13/d3a/d47/d1f/f73 0 2024-09-21T08:02:28.185 INFO:tasks.workunit.client.1.smithi129.stdout:2/330: chown d1/dc/d19/d4c/d6a/l56 313799 1 2024-09-21T08:02:28.192 INFO:tasks.workunit.client.1.smithi129.stdout:6/148: sync 2024-09-21T08:02:28.192 INFO:tasks.workunit.client.1.smithi129.stdout:5/201: sync 2024-09-21T08:02:28.192 INFO:tasks.workunit.client.1.smithi129.stdout:5/202: fsync d2/f19 0 2024-09-21T08:02:28.193 INFO:tasks.workunit.client.1.smithi129.stdout:6/149: mkdir d7/d1b/d1e/d39 0 2024-09-21T08:02:28.194 INFO:tasks.workunit.client.1.smithi129.stdout:5/203: rename d2/c1c to d2/d2a/c39 0 2024-09-21T08:02:28.194 INFO:tasks.workunit.client.1.smithi129.stdout:5/204: dread - d2/d1e/f2f zero size 2024-09-21T08:02:28.195 INFO:tasks.workunit.client.1.smithi129.stdout:5/205: dread d2/f1a [0,4194304] 0 2024-09-21T08:02:28.195 INFO:tasks.workunit.client.1.smithi129.stdout:5/206: write d2/f24 [1048924,70368] 0 2024-09-21T08:02:28.196 INFO:tasks.workunit.client.1.smithi129.stdout:5/207: getdents d2/d1e/d35 0 2024-09-21T08:02:28.201 INFO:tasks.workunit.client.1.smithi129.stdout:2/331: dwrite d1/dc/d26/f42 [0,4194304] 0 2024-09-21T08:02:28.202 INFO:tasks.workunit.client.1.smithi129.stdout:2/332: readlink d1/d13/d3a/d47/d5f/l74 0 2024-09-21T08:02:28.204 INFO:tasks.workunit.client.1.smithi129.stdout:2/333: unlink d1/d13/d3a/d47/f72 0 2024-09-21T08:02:28.204 INFO:tasks.workunit.client.1.smithi129.stdout:2/334: write d1/dc/f10 [3212304,61784] 0 2024-09-21T08:02:28.205 INFO:tasks.workunit.client.1.smithi129.stdout:2/335: getdents d1/d53 0 2024-09-21T08:02:28.206 INFO:tasks.workunit.client.1.smithi129.stdout:6/150: write d7/d10/f19 [3894367,31561] 0 2024-09-21T08:02:28.210 INFO:tasks.workunit.client.1.smithi129.stdout:5/208: write d2/f4 [3557211,35147] 0 2024-09-21T08:02:28.210 INFO:tasks.workunit.client.1.smithi129.stdout:5/209: link d2/c11 d2/d1e/c3a 0 2024-09-21T08:02:28.213 INFO:tasks.workunit.client.1.smithi129.stdout:2/336: dread d1/d13/f2c [0,4194304] 0 2024-09-21T08:02:28.213 INFO:tasks.workunit.client.1.smithi129.stdout:5/210: dread d2/d1e/f1f [0,4194304] 0 2024-09-21T08:02:28.213 INFO:tasks.workunit.client.1.smithi129.stdout:2/337: creat d1/d53/d77/f79 x:0 0 0 2024-09-21T08:02:28.214 INFO:tasks.workunit.client.1.smithi129.stdout:2/338: symlink d1/d13/d3a/d47/l7a 0 2024-09-21T08:02:28.214 INFO:tasks.workunit.client.1.smithi129.stdout:2/339: write d1/d13/d3a/d47/f63 [1283767,114706] 0 2024-09-21T08:02:28.222 INFO:tasks.workunit.client.1.smithi129.stdout:5/211: write d2/f29 [3160541,77175] 0 2024-09-21T08:02:28.224 INFO:tasks.workunit.client.1.smithi129.stdout:5/212: creat d2/d2a/f3b x:0 0 0 2024-09-21T08:02:28.224 INFO:tasks.workunit.client.1.smithi129.stdout:5/213: chown d2/f17 5629 1 2024-09-21T08:02:28.224 INFO:tasks.workunit.client.1.smithi129.stdout:5/214: rmdir d2 39 2024-09-21T08:02:28.229 INFO:tasks.workunit.client.1.smithi129.stdout:6/151: dwrite d7/f8 [0,4194304] 0 2024-09-21T08:02:28.229 INFO:tasks.workunit.client.1.smithi129.stdout:6/152: creat d7/d1b/d1c/f3a x:0 0 0 2024-09-21T08:02:28.232 INFO:tasks.workunit.client.1.smithi129.stdout:6/153: unlink d7/d10/f1f 0 2024-09-21T08:02:28.232 INFO:tasks.workunit.client.1.smithi129.stdout:6/154: write d7/d1b/d25/f31 [249994,24591] 0 2024-09-21T08:02:28.233 INFO:tasks.workunit.client.1.smithi129.stdout:5/215: write d2/d1e/d35/f12 [2173791,58000] 0 2024-09-21T08:02:28.239 INFO:tasks.workunit.client.1.smithi129.stdout:2/340: dwrite d1/dc/ff [0,4194304] 0 2024-09-21T08:02:28.239 INFO:tasks.workunit.client.1.smithi129.stdout:2/341: read - d1/d13/d3a/f6f zero size 2024-09-21T08:02:28.239 INFO:tasks.workunit.client.1.smithi129.stdout:2/342: truncate d1/dc/d19/d4c/f5b 1554118 0 2024-09-21T08:02:28.239 INFO:tasks.workunit.client.1.smithi129.stdout:6/155: fsync d7/f24 0 2024-09-21T08:02:28.239 INFO:tasks.workunit.client.1.smithi129.stdout:6/156: stat d7/l11 0 2024-09-21T08:02:28.241 INFO:tasks.workunit.client.1.smithi129.stdout:5/216: write d2/d1e/d35/f2d [2849386,35612] 0 2024-09-21T08:02:28.243 INFO:tasks.workunit.client.1.smithi129.stdout:6/157: write d7/d1b/d25/f2e [386906,57120] 0 2024-09-21T08:02:28.243 INFO:tasks.workunit.client.1.smithi129.stdout:6/158: truncate d7/d10/f16 4340096 0 2024-09-21T08:02:28.244 INFO:tasks.workunit.client.1.smithi129.stdout:6/159: dread d7/d1b/d25/d2b/f2f [0,4194304] 0 2024-09-21T08:02:28.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:27 smithi129 ceph-mon[34472]: Standby manager daemon smithi107.wzulxb started 2024-09-21T08:02:28.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:27 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.107:0/2981836951' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.wzulxb/crt"}]: dispatch 2024-09-21T08:02:28.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:27 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.107:0/2981836951' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T08:02:28.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:27 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.107:0/2981836951' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.wzulxb/key"}]: dispatch 2024-09-21T08:02:28.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:27 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.107:0/2981836951' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T08:02:28.267 INFO:tasks.workunit.client.1.smithi129.stdout:5/217: dwrite d2/d1e/d35/f2c [0,4194304] 0 2024-09-21T08:02:28.267 INFO:tasks.workunit.client.1.smithi129.stdout:5/218: readlink d2/la 0 2024-09-21T08:02:28.267 INFO:tasks.workunit.client.1.smithi129.stdout:5/219: fsync d2/d1e/d35/f22 0 2024-09-21T08:02:28.267 INFO:tasks.workunit.client.1.smithi129.stdout:6/160: dwrite d7/f24 [0,4194304] 0 2024-09-21T08:02:28.280 INFO:tasks.workunit.client.1.smithi129.stdout:5/220: dwrite d2/f19 [0,4194304] 0 2024-09-21T08:02:28.281 INFO:tasks.workunit.client.1.smithi129.stdout:5/221: symlink d2/d1e/d35/d37/l3c 0 2024-09-21T08:02:28.282 INFO:tasks.workunit.client.1.smithi129.stdout:5/222: mknod d2/d1e/c3d 0 2024-09-21T08:02:28.283 INFO:tasks.workunit.client.1.smithi129.stdout:5/223: creat d2/d1e/d35/d33/f3e x:0 0 0 2024-09-21T08:02:28.283 INFO:tasks.workunit.client.1.smithi129.stdout:5/224: chown d2/f18 2027565 1 2024-09-21T08:02:28.283 INFO:tasks.workunit.client.1.smithi129.stdout:5/225: creat d2/d1e/f3f x:0 0 0 2024-09-21T08:02:28.291 INFO:tasks.workunit.client.1.smithi129.stdout:5/226: write d2/d1e/d35/f2b [664387,53133] 0 2024-09-21T08:02:28.292 INFO:tasks.workunit.client.1.smithi129.stdout:5/227: creat d2/d1e/d35/f40 x:0 0 0 2024-09-21T08:02:28.292 INFO:tasks.workunit.client.1.smithi129.stdout:5/228: fdatasync d2/d2a/f3b 0 2024-09-21T08:02:28.300 INFO:tasks.workunit.client.1.smithi129.stdout:0/163: sync 2024-09-21T08:02:28.300 INFO:tasks.workunit.client.1.smithi129.stdout:0/164: write f7 [113309,69343] 0 2024-09-21T08:02:28.300 INFO:tasks.workunit.client.1.smithi129.stdout:0/165: chown de/d15/d29 199476811 1 2024-09-21T08:02:28.300 INFO:tasks.workunit.client.1.smithi129.stdout:0/166: write de/d22/f2b [85886,64242] 0 2024-09-21T08:02:28.302 INFO:tasks.workunit.client.1.smithi129.stdout:0/167: symlink de/d15/d29/l32 0 2024-09-21T08:02:28.302 INFO:tasks.workunit.client.1.smithi129.stdout:0/168: mknod de/d1f/c33 0 2024-09-21T08:02:28.303 INFO:tasks.workunit.client.1.smithi129.stdout:0/169: creat de/d1f/f34 x:0 0 0 2024-09-21T08:02:28.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:27 smithi107 ceph-mon[27622]: Standby manager daemon smithi107.wzulxb started 2024-09-21T08:02:28.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:27 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.107:0/2981836951' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.wzulxb/crt"}]: dispatch 2024-09-21T08:02:28.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:27 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.107:0/2981836951' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T08:02:28.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:27 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.107:0/2981836951' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.wzulxb/key"}]: dispatch 2024-09-21T08:02:28.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:27 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.107:0/2981836951' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T08:02:28.359 INFO:tasks.workunit.client.1.smithi129.stdout:0/170: write f0 [842847,32035] 0 2024-09-21T08:02:28.359 INFO:tasks.workunit.client.1.smithi129.stdout:5/229: dwrite d2/f1b [0,4194304] 0 2024-09-21T08:02:28.361 INFO:tasks.workunit.client.1.smithi129.stdout:0/171: truncate fd 1319828 0 2024-09-21T08:02:28.361 INFO:tasks.workunit.client.1.smithi129.stdout:5/230: link d2/c21 d2/c41 0 2024-09-21T08:02:28.361 INFO:tasks.workunit.client.1.smithi129.stdout:5/231: fsync d2/d1e/d35/f2b 0 2024-09-21T08:02:28.361 INFO:tasks.workunit.client.1.smithi129.stdout:5/232: fsync d2/d1e/d35/f12 0 2024-09-21T08:02:28.362 INFO:tasks.workunit.client.1.smithi129.stdout:0/172: creat de/d22/d27/d30/f35 x:0 0 0 2024-09-21T08:02:28.363 INFO:tasks.workunit.client.1.smithi129.stdout:0/173: fdatasync de/d15/f1c 0 2024-09-21T08:02:28.363 INFO:tasks.workunit.client.1.smithi129.stdout:0/174: dread - de/d1f/f34 zero size 2024-09-21T08:02:28.363 INFO:tasks.workunit.client.1.smithi129.stdout:0/175: dread - de/f12 zero size 2024-09-21T08:02:28.363 INFO:tasks.workunit.client.1.smithi129.stdout:0/176: stat de/d1f/c23 0 2024-09-21T08:02:28.363 INFO:tasks.workunit.client.1.smithi129.stdout:0/177: write de/d22/d27/d30/f35 [546065,89045] 0 2024-09-21T08:02:28.363 INFO:tasks.workunit.client.1.smithi129.stdout:5/233: unlink d2/d2a/f3b 0 2024-09-21T08:02:28.364 INFO:tasks.workunit.client.1.smithi129.stdout:5/234: stat d2/d2a/c39 0 2024-09-21T08:02:28.364 INFO:tasks.workunit.client.1.smithi129.stdout:5/235: dread - d2/d2a/f2e zero size 2024-09-21T08:02:28.364 INFO:tasks.workunit.client.1.smithi129.stdout:5/236: read - d2/d1e/f3f zero size 2024-09-21T08:02:28.364 INFO:tasks.workunit.client.1.smithi129.stdout:5/237: chown d2/f1a 458396 1 2024-09-21T08:02:28.366 INFO:tasks.workunit.client.1.smithi129.stdout:5/238: dread d2/f1a [0,4194304] 0 2024-09-21T08:02:28.366 INFO:tasks.workunit.client.1.smithi129.stdout:0/178: read fb [1974938,106479] 0 2024-09-21T08:02:28.366 INFO:tasks.workunit.client.1.smithi129.stdout:0/179: chown de/d22/d27/d2f 578 1 2024-09-21T08:02:28.367 INFO:tasks.workunit.client.1.smithi129.stdout:0/180: unlink de/d19/l25 0 2024-09-21T08:02:28.368 INFO:tasks.workunit.client.1.smithi129.stdout:0/181: rmdir de/d15/d29 39 2024-09-21T08:02:28.368 INFO:tasks.workunit.client.1.smithi129.stdout:0/182: write f7 [167823,60099] 0 2024-09-21T08:02:28.368 INFO:tasks.workunit.client.1.smithi129.stdout:0/183: write de/d22/d27/f2d [831546,48271] 0 2024-09-21T08:02:28.368 INFO:tasks.workunit.client.1.smithi129.stdout:0/184: creat de/f36 x:0 0 0 2024-09-21T08:02:28.368 INFO:tasks.workunit.client.1.smithi129.stdout:0/185: dread - de/d15/f28 zero size 2024-09-21T08:02:28.370 INFO:tasks.workunit.client.1.smithi129.stdout:0/186: dread de/d15/f1c [0,4194304] 0 2024-09-21T08:02:28.376 INFO:tasks.workunit.client.1.smithi129.stdout:1/270: sync 2024-09-21T08:02:28.376 INFO:tasks.workunit.client.1.smithi129.stdout:7/225: sync 2024-09-21T08:02:28.376 INFO:tasks.workunit.client.1.smithi129.stdout:9/221: sync 2024-09-21T08:02:28.376 INFO:tasks.workunit.client.1.smithi129.stdout:4/181: sync 2024-09-21T08:02:28.376 INFO:tasks.workunit.client.1.smithi129.stdout:7/226: fsync d0/d1e/f36 0 2024-09-21T08:02:28.376 INFO:tasks.workunit.client.1.smithi129.stdout:7/227: read - d0/d46/f47 zero size 2024-09-21T08:02:28.376 INFO:tasks.workunit.client.1.smithi129.stdout:2/343: sync 2024-09-21T08:02:28.376 INFO:tasks.workunit.client.1.smithi129.stdout:8/145: sync 2024-09-21T08:02:28.377 INFO:tasks.workunit.client.1.smithi129.stdout:1/271: write d1/f3 [6838380,75187] 0 2024-09-21T08:02:28.377 INFO:tasks.workunit.client.1.smithi129.stdout:1/272: readlink d1/d4/l2c 0 2024-09-21T08:02:28.377 INFO:tasks.workunit.client.1.smithi129.stdout:3/181: sync 2024-09-21T08:02:28.377 INFO:tasks.workunit.client.1.smithi129.stdout:1/273: creat d1/d9/d31/f68 x:0 0 0 2024-09-21T08:02:28.377 INFO:tasks.workunit.client.1.smithi129.stdout:1/274: write d1/d4/f46 [7738714,4946] 0 2024-09-21T08:02:28.377 INFO:tasks.workunit.client.1.smithi129.stdout:3/182: write d3/da/dc/d25/f26 [773658,36699] 0 2024-09-21T08:02:28.377 INFO:tasks.workunit.client.1.smithi129.stdout:4/182: symlink d5/d35/l43 0 2024-09-21T08:02:28.381 INFO:tasks.workunit.client.1.smithi129.stdout:7/228: read d0/d1e/f4b [720129,114815] 0 2024-09-21T08:02:28.381 INFO:tasks.workunit.client.1.smithi129.stdout:3/183: symlink d3/da/l3d 0 2024-09-21T08:02:28.382 INFO:tasks.workunit.client.1.smithi129.stdout:3/184: stat d3 0 2024-09-21T08:02:28.382 INFO:tasks.workunit.client.1.smithi129.stdout:4/183: creat d5/d6/f44 x:0 0 0 2024-09-21T08:02:28.389 INFO:tasks.workunit.client.1.smithi129.stdout:9/222: dread d17/f19 [0,4194304] 0 2024-09-21T08:02:28.389 INFO:tasks.workunit.client.1.smithi129.stdout:9/223: fsync d17/d22/d33/d36/d48/d3f/f57 0 2024-09-21T08:02:28.391 INFO:tasks.workunit.client.1.smithi129.stdout:2/344: rmdir d1 39 2024-09-21T08:02:28.391 INFO:tasks.workunit.client.1.smithi129.stdout:2/345: dread - d1/dc/f6c zero size 2024-09-21T08:02:28.392 INFO:tasks.workunit.client.1.smithi129.stdout:3/185: symlink d3/da/dc/d11/d2f/l3e 0 2024-09-21T08:02:28.393 INFO:tasks.workunit.client.1.smithi129.stdout:9/224: truncate d17/d38/f52 466326 0 2024-09-21T08:02:28.394 INFO:tasks.workunit.client.1.smithi129.stdout:2/346: creat d1/dc/d26/d45/f7b x:0 0 0 2024-09-21T08:02:28.395 INFO:tasks.workunit.client.1.smithi129.stdout:3/186: mkdir d3/da/dc/d11/d3f 0 2024-09-21T08:02:28.395 INFO:tasks.workunit.client.1.smithi129.stdout:3/187: fdatasync d3/da/dc/fd 0 2024-09-21T08:02:28.396 INFO:tasks.workunit.client.1.smithi129.stdout:4/184: getdents d5 0 2024-09-21T08:02:28.398 INFO:tasks.workunit.client.1.smithi129.stdout:9/225: stat d17/l1b 0 2024-09-21T08:02:28.401 INFO:tasks.workunit.client.1.smithi129.stdout:2/347: mkdir d1/d13/d32/d7c 0 2024-09-21T08:02:28.401 INFO:tasks.workunit.client.1.smithi129.stdout:4/185: rename d5/d11/f41 to d5/d11/f45 0 2024-09-21T08:02:28.402 INFO:tasks.workunit.client.1.smithi129.stdout:2/348: symlink d1/dc/d26/d45/d65/d50/l7d 0 2024-09-21T08:02:28.404 INFO:tasks.workunit.client.1.smithi129.stdout:0/187: dwrite de/f17 [0,4194304] 0 2024-09-21T08:02:28.405 INFO:tasks.workunit.client.1.smithi129.stdout:5/239: dwrite d2/d1e/d35/f31 [0,4194304] 0 2024-09-21T08:02:28.407 INFO:tasks.workunit.client.1.smithi129.stdout:2/349: write d1/dc/d19/d4c/d6a/f43 [3211404,74701] 0 2024-09-21T08:02:28.408 INFO:tasks.workunit.client.1.smithi129.stdout:5/240: truncate d2/f23 197915 0 2024-09-21T08:02:28.408 INFO:tasks.workunit.client.1.smithi129.stdout:5/241: chown d2/d1e/c3d 78802991 1 2024-09-21T08:02:28.409 INFO:tasks.workunit.client.1.smithi129.stdout:9/226: write f10 [2741757,67041] 0 2024-09-21T08:02:28.409 INFO:tasks.workunit.client.1.smithi129.stdout:9/227: getdents d17/d22/d33/d36/d48/d3f/d53 0 2024-09-21T08:02:28.410 INFO:tasks.workunit.client.1.smithi129.stdout:0/188: link de/d15/f1d de/d15/d29/f37 0 2024-09-21T08:02:28.410 INFO:tasks.workunit.client.1.smithi129.stdout:0/189: chown de/d15 1644 1 2024-09-21T08:02:28.410 INFO:tasks.workunit.client.1.smithi129.stdout:0/190: chown de/d15/d29 1 1 2024-09-21T08:02:28.410 INFO:tasks.workunit.client.1.smithi129.stdout:2/350: creat d1/dc/f7e x:0 0 0 2024-09-21T08:02:28.414 INFO:tasks.workunit.client.1.smithi129.stdout:8/146: dwrite d0/d6/f28 [0,4194304] 0 2024-09-21T08:02:28.414 INFO:tasks.workunit.client.1.smithi129.stdout:5/242: rename d2/d1e/f3f to d2/d1e/d35/d33/d36/f42 0 2024-09-21T08:02:28.415 INFO:tasks.workunit.client.1.smithi129.stdout:5/243: fdatasync d2/f29 0 2024-09-21T08:02:28.415 INFO:tasks.workunit.client.1.smithi129.stdout:5/244: readlink d2/d1e/l28 0 2024-09-21T08:02:28.415 INFO:tasks.workunit.client.1.smithi129.stdout:0/191: creat de/d19/f38 x:0 0 0 2024-09-21T08:02:28.415 INFO:tasks.workunit.client.1.smithi129.stdout:0/192: readlink de/d15/d29/l32 0 2024-09-21T08:02:28.415 INFO:tasks.workunit.client.1.smithi129.stdout:0/193: chown de/d22/d27 58999145 1 2024-09-21T08:02:28.415 INFO:tasks.workunit.client.1.smithi129.stdout:2/351: symlink d1/dc/d19/d4c/d6a/d69/l7f 0 2024-09-21T08:02:28.415 INFO:tasks.workunit.client.1.smithi129.stdout:8/147: creat d0/f2b x:0 0 0 2024-09-21T08:02:28.415 INFO:tasks.workunit.client.1.smithi129.stdout:8/148: fsync d0/d6/d7/d9/f12 0 2024-09-21T08:02:28.415 INFO:tasks.workunit.client.1.smithi129.stdout:8/149: getdents d0/d6/d7/d24 0 2024-09-21T08:02:28.415 INFO:tasks.workunit.client.1.smithi129.stdout:8/150: read - d0/d6/d7/d18/f26 zero size 2024-09-21T08:02:28.416 INFO:tasks.workunit.client.1.smithi129.stdout:9/228: getdents d17/d2c 0 2024-09-21T08:02:28.416 INFO:tasks.workunit.client.1.smithi129.stdout:0/194: mkdir de/d15/d39 0 2024-09-21T08:02:28.417 INFO:tasks.workunit.client.1.smithi129.stdout:2/352: unlink d1/dc/f7e 0 2024-09-21T08:02:28.417 INFO:tasks.workunit.client.1.smithi129.stdout:2/353: fsync d1/d53/f58 0 2024-09-21T08:02:28.417 INFO:tasks.workunit.client.1.smithi129.stdout:8/151: symlink d0/l2c 0 2024-09-21T08:02:28.418 INFO:tasks.workunit.client.1.smithi129.stdout:3/188: dwrite d3/da/dc/fd [0,4194304] 0 2024-09-21T08:02:28.419 INFO:tasks.workunit.client.1.smithi129.stdout:0/195: creat de/d15/d29/f3a x:0 0 0 2024-09-21T08:02:28.420 INFO:tasks.workunit.client.1.smithi129.stdout:7/229: dwrite d0/f22 [4194304,4194304] 0 2024-09-21T08:02:28.420 INFO:tasks.workunit.client.1.smithi129.stdout:2/354: symlink d1/d53/l80 0 2024-09-21T08:02:28.422 INFO:tasks.workunit.client.1.smithi129.stdout:8/152: rename d0/d6/d7/fb to d0/d6/d7/d18/d27/f2d 0 2024-09-21T08:02:28.423 INFO:tasks.workunit.client.1.smithi129.stdout:3/189: creat d3/da/dc/d11/d2f/f40 x:0 0 0 2024-09-21T08:02:28.424 INFO:tasks.workunit.client.1.smithi129.stdout:9/229: getdents d17/d2c/d31/d35 0 2024-09-21T08:02:28.424 INFO:tasks.workunit.client.1.smithi129.stdout:9/230: read - f13 zero size 2024-09-21T08:02:28.424 INFO:tasks.workunit.client.1.smithi129.stdout:9/231: dread - d17/d2c/d31/f51 zero size 2024-09-21T08:02:28.425 INFO:tasks.workunit.client.1.smithi129.stdout:0/196: creat de/d15/f3b x:0 0 0 2024-09-21T08:02:28.426 INFO:tasks.workunit.client.1.smithi129.stdout:7/230: link d0/c13 d0/d46/d56/c58 0 2024-09-21T08:02:28.426 INFO:tasks.workunit.client.1.smithi129.stdout:7/231: chown d0/d1e/c44 0 1 2024-09-21T08:02:28.426 INFO:tasks.workunit.client.1.smithi129.stdout:6/161: sync 2024-09-21T08:02:28.427 INFO:tasks.workunit.client.1.smithi129.stdout:4/186: dwrite d5/d16/d24/f42 [0,4194304] 0 2024-09-21T08:02:28.428 INFO:tasks.workunit.client.1.smithi129.stdout:8/153: mknod d0/d6/d7/d18/d27/c2e 0 2024-09-21T08:02:28.429 INFO:tasks.workunit.client.1.smithi129.stdout:3/190: creat d3/da/dc/d25/f41 x:0 0 0 2024-09-21T08:02:28.429 INFO:tasks.workunit.client.1.smithi129.stdout:3/191: write d3/da/dc/f21 [1551640,28724] 0 2024-09-21T08:02:28.429 INFO:tasks.workunit.client.1.smithi129.stdout:3/192: stat d3/da/dc/d11/d2f/d27/c2a 0 2024-09-21T08:02:28.430 INFO:tasks.workunit.client.1.smithi129.stdout:5/245: dwrite d2/d1e/d35/f40 [0,4194304] 0 2024-09-21T08:02:28.432 INFO:tasks.workunit.client.1.smithi129.stdout:9/232: rename d17/l1b to d17/d22/d33/d36/l58 0 2024-09-21T08:02:28.436 INFO:tasks.workunit.client.1.smithi129.stdout:4/187: link d5/d11/f45 d5/d16/d24/d3b/f46 0 2024-09-21T08:02:28.437 INFO:tasks.workunit.client.1.smithi129.stdout:0/197: write fd [3152709,80596] 0 2024-09-21T08:02:28.437 INFO:tasks.workunit.client.1.smithi129.stdout:0/198: chown de/f12 7082 1 2024-09-21T08:02:28.438 INFO:tasks.workunit.client.1.smithi129.stdout:2/355: truncate d1/dc/d19/d4c/d6a/f43 1098869 0 2024-09-21T08:02:28.442 INFO:tasks.workunit.client.1.smithi129.stdout:3/193: readlink d3/l38 0 2024-09-21T08:02:28.442 INFO:tasks.workunit.client.1.smithi129.stdout:4/188: dread d5/d11/f45 [0,4194304] 0 2024-09-21T08:02:28.445 INFO:tasks.workunit.client.1.smithi129.stdout:9/233: truncate d17/d46/f4f 82384 0 2024-09-21T08:02:28.445 INFO:tasks.workunit.client.1.smithi129.stdout:9/234: write d17/d46/f4b [1079781,34685] 0 2024-09-21T08:02:28.445 INFO:tasks.workunit.client.1.smithi129.stdout:9/235: stat d17/d22/d33/d36/d48/d3f/f57 0 2024-09-21T08:02:28.447 INFO:tasks.workunit.client.1.smithi129.stdout:7/232: write d0/f1f [3111329,81783] 0 2024-09-21T08:02:28.448 INFO:tasks.workunit.client.1.smithi129.stdout:2/356: rmdir d1/dc/d19/d78 0 2024-09-21T08:02:28.448 INFO:tasks.workunit.client.1.smithi129.stdout:2/357: write d1/dc/d26/d45/d65/d50/f5d [724217,41873] 0 2024-09-21T08:02:28.449 INFO:tasks.workunit.client.1.smithi129.stdout:8/154: getdents d0/d6/d7/d9 0 2024-09-21T08:02:28.451 INFO:tasks.workunit.client.1.smithi129.stdout:4/189: mkdir d5/d16/d47 0 2024-09-21T08:02:28.452 INFO:tasks.workunit.client.1.smithi129.stdout:9/236: mknod d17/d22/d33/d36/c59 0 2024-09-21T08:02:28.454 INFO:tasks.workunit.client.1.smithi129.stdout:7/233: creat d0/f59 x:0 0 0 2024-09-21T08:02:28.455 INFO:tasks.workunit.client.1.smithi129.stdout:7/234: fdatasync d0/d1e/f36 0 2024-09-21T08:02:28.456 INFO:tasks.workunit.client.1.smithi129.stdout:2/358: link d1/f4 d1/dc/d26/f81 0 2024-09-21T08:02:28.457 INFO:tasks.workunit.client.1.smithi129.stdout:8/155: symlink d0/d6/d7/l2f 0 2024-09-21T08:02:28.457 INFO:tasks.workunit.client.1.smithi129.stdout:8/156: chown d0/d6/d7/d18/d27/l29 1820 1 2024-09-21T08:02:28.457 INFO:tasks.workunit.client.1.smithi129.stdout:8/157: dread - d0/d6/f1a zero size 2024-09-21T08:02:28.458 INFO:tasks.workunit.client.1.smithi129.stdout:8/158: chown d0/d6/d7/d24 24414 1 2024-09-21T08:02:28.458 INFO:tasks.workunit.client.1.smithi129.stdout:4/190: mkdir d5/d48 0 2024-09-21T08:02:28.460 INFO:tasks.workunit.client.1.smithi129.stdout:2/359: creat d1/dc/d19/d4c/d6a/f82 x:0 0 0 2024-09-21T08:02:28.460 INFO:tasks.workunit.client.1.smithi129.stdout:2/360: dread - d1/f1c zero size 2024-09-21T08:02:28.461 INFO:tasks.workunit.client.1.smithi129.stdout:8/159: mknod d0/d6/d7/d18/d27/c30 0 2024-09-21T08:02:28.461 INFO:tasks.workunit.client.1.smithi129.stdout:8/160: fsync d0/d6/d7/d18/f26 0 2024-09-21T08:02:28.461 INFO:tasks.workunit.client.1.smithi129.stdout:8/161: read d0/d6/d7/d9/f12 [3641504,10442] 0 2024-09-21T08:02:28.461 INFO:tasks.workunit.client.1.smithi129.stdout:6/162: dwrite d7/f24 [0,4194304] 0 2024-09-21T08:02:28.462 INFO:tasks.workunit.client.1.smithi129.stdout:2/361: creat d1/d13/f83 x:0 0 0 2024-09-21T08:02:28.462 INFO:tasks.workunit.client.1.smithi129.stdout:2/362: stat d1/dc/l5c 0 2024-09-21T08:02:28.462 INFO:tasks.workunit.client.1.smithi129.stdout:4/191: dread d5/d16/d24/d3b/f46 [0,4194304] 0 2024-09-21T08:02:28.463 INFO:tasks.workunit.client.1.smithi129.stdout:8/162: mknod d0/d6/d7/c31 0 2024-09-21T08:02:28.463 INFO:tasks.workunit.client.1.smithi129.stdout:9/237: dread d17/f1e [0,4194304] 0 2024-09-21T08:02:28.466 INFO:tasks.workunit.client.1.smithi129.stdout:8/163: mkdir d0/d6/d7/d18/d27/d32 0 2024-09-21T08:02:28.466 INFO:tasks.workunit.client.1.smithi129.stdout:8/164: write d0/f2b [963591,109424] 0 2024-09-21T08:02:28.466 INFO:tasks.workunit.client.1.smithi129.stdout:8/165: chown d0 6275 1 2024-09-21T08:02:28.466 INFO:tasks.workunit.client.1.smithi129.stdout:8/166: write d0/d6/d7/d9/f12 [4229278,11961] 0 2024-09-21T08:02:28.467 INFO:tasks.workunit.client.1.smithi129.stdout:5/246: dwrite d2/f29 [0,4194304] 0 2024-09-21T08:02:28.471 INFO:tasks.workunit.client.1.smithi129.stdout:0/199: dwrite de/d15/f28 [0,4194304] 0 2024-09-21T08:02:28.474 INFO:tasks.workunit.client.1.smithi129.stdout:3/194: dwrite d3/da/dc/f23 [0,4194304] 0 2024-09-21T08:02:28.475 INFO:tasks.workunit.client.1.smithi129.stdout:7/235: write d0/f22 [6108604,125470] 0 2024-09-21T08:02:28.477 INFO:tasks.workunit.client.1.smithi129.stdout:6/163: dread d7/fe [0,4194304] 0 2024-09-21T08:02:28.477 INFO:tasks.workunit.client.1.smithi129.stdout:0/200: rmdir de/d15/d31 0 2024-09-21T08:02:28.478 INFO:tasks.workunit.client.1.smithi129.stdout:3/195: symlink d3/da/dc/d11/l42 0 2024-09-21T08:02:28.479 INFO:tasks.workunit.client.1.smithi129.stdout:3/196: stat d3/f29 0 2024-09-21T08:02:28.479 INFO:tasks.workunit.client.1.smithi129.stdout:3/197: dread - d3/da/dc/d25/f41 zero size 2024-09-21T08:02:28.479 INFO:tasks.workunit.client.1.smithi129.stdout:3/198: fsync d3/da/dc/f23 0 2024-09-21T08:02:28.479 INFO:tasks.workunit.client.1.smithi129.stdout:3/199: chown d3/da/dc/d11/c37 349 1 2024-09-21T08:02:28.481 INFO:tasks.workunit.client.1.smithi129.stdout:7/236: chown d0/c3a 17667091 1 2024-09-21T08:02:28.482 INFO:tasks.workunit.client.1.smithi129.stdout:6/164: mknod d7/c3b 0 2024-09-21T08:02:28.482 INFO:tasks.workunit.client.1.smithi129.stdout:6/165: write d7/f9 [1370963,8486] 0 2024-09-21T08:02:28.482 INFO:tasks.workunit.client.1.smithi129.stdout:6/166: chown d7/d1b/d1c 30902425 1 2024-09-21T08:02:28.484 INFO:tasks.workunit.client.1.smithi129.stdout:2/363: dread d1/d13/d3a/d47/d1f/f25 [0,4194304] 0 2024-09-21T08:02:28.484 INFO:tasks.workunit.client.1.smithi129.stdout:0/201: rename de/d15/d29/f3a to de/f3c 0 2024-09-21T08:02:28.484 INFO:tasks.workunit.client.1.smithi129.stdout:0/202: chown de/d22/f26 57118 1 2024-09-21T08:02:28.485 INFO:tasks.workunit.client.1.smithi129.stdout:3/200: creat d3/da/dc/f43 x:0 0 0 2024-09-21T08:02:28.485 INFO:tasks.workunit.client.1.smithi129.stdout:3/201: getdents d3/da/d3c 0 2024-09-21T08:02:28.485 INFO:tasks.workunit.client.1.smithi129.stdout:3/202: write d3/da/dc/d11/d2f/f28 [1027270,49626] 0 2024-09-21T08:02:28.485 INFO:tasks.workunit.client.1.smithi129.stdout:3/203: write d3/da/dc/f43 [734696,57496] 0 2024-09-21T08:02:28.486 INFO:tasks.workunit.client.1.smithi129.stdout:4/192: dwrite d5/f3c [0,4194304] 0 2024-09-21T08:02:28.490 INFO:tasks.workunit.client.1.smithi129.stdout:6/167: rename d7/d1b/d1c/f3a to d7/d1b/d25/d2b/f3c 0 2024-09-21T08:02:28.492 INFO:tasks.workunit.client.1.smithi129.stdout:7/237: read d0/f26 [250527,50701] 0 2024-09-21T08:02:28.492 INFO:tasks.workunit.client.1.smithi129.stdout:2/364: creat d1/d13/d3a/d47/d1f/f84 x:0 0 0 2024-09-21T08:02:28.492 INFO:tasks.workunit.client.1.smithi129.stdout:2/365: truncate d1/f8 1709567 0 2024-09-21T08:02:28.493 INFO:tasks.workunit.client.1.smithi129.stdout:3/204: chown d3/c7 9486635 1 2024-09-21T08:02:28.497 INFO:tasks.workunit.client.1.smithi129.stdout:0/203: getdents de/d1f 0 2024-09-21T08:02:28.497 INFO:tasks.workunit.client.1.smithi129.stdout:0/204: creat de/d15/f3d x:0 0 0 2024-09-21T08:02:28.497 INFO:tasks.workunit.client.1.smithi129.stdout:0/205: fsync fb 0 2024-09-21T08:02:28.497 INFO:tasks.workunit.client.1.smithi129.stdout:0/206: getdents de/d22/d27/d2f 0 2024-09-21T08:02:28.497 INFO:tasks.workunit.client.1.smithi129.stdout:2/366: write d1/d13/d3a/d47/d1f/f25 [3046250,122944] 0 2024-09-21T08:02:28.500 INFO:tasks.workunit.client.1.smithi129.stdout:3/205: rename d3/da/dc/l2c to d3/da/dc/d11/d2f/d27/l44 0 2024-09-21T08:02:28.500 INFO:tasks.workunit.client.1.smithi129.stdout:7/238: mknod d0/c5a 0 2024-09-21T08:02:28.500 INFO:tasks.workunit.client.1.smithi129.stdout:3/206: fdatasync d3/da/f19 0 2024-09-21T08:02:28.500 INFO:tasks.workunit.client.1.smithi129.stdout:4/193: dread d5/f14 [0,4194304] 0 2024-09-21T08:02:28.500 INFO:tasks.workunit.client.1.smithi129.stdout:8/167: dwrite d0/d6/d7/d18/d27/f2d [8388608,4194304] 0 2024-09-21T08:02:28.504 INFO:tasks.workunit.client.1.smithi129.stdout:2/367: mkdir d1/d13/d3a/d47/d1f/d85 0 2024-09-21T08:02:28.504 INFO:tasks.workunit.client.1.smithi129.stdout:6/168: write d7/fa [6519847,105289] 0 2024-09-21T08:02:28.504 INFO:tasks.workunit.client.1.smithi129.stdout:5/247: dwrite d2/d1e/d35/f40 [0,4194304] 0 2024-09-21T08:02:28.508 INFO:tasks.workunit.client.1.smithi129.stdout:4/194: truncate d5/d6/f2f 3052008 0 2024-09-21T08:02:28.508 INFO:tasks.workunit.client.1.smithi129.stdout:4/195: readlink d5/d16/d24/l2c 0 2024-09-21T08:02:28.509 INFO:tasks.workunit.client.1.smithi129.stdout:6/169: symlink d7/d1b/d25/d35/l3d 0 2024-09-21T08:02:28.513 INFO:tasks.workunit.client.1.smithi129.stdout:5/248: mkdir d2/d1e/d35/d33/d36/d43 0 2024-09-21T08:02:28.514 INFO:tasks.workunit.client.1.smithi129.stdout:5/249: dread - d2/d1e/f2f zero size 2024-09-21T08:02:28.515 INFO:tasks.workunit.client.1.smithi129.stdout:7/239: symlink d0/l5b 0 2024-09-21T08:02:28.517 INFO:tasks.workunit.client.1.smithi129.stdout:5/250: rename d2/d1e/l28 to d2/d1e/d35/d33/d36/d43/l44 0 2024-09-21T08:02:28.518 INFO:tasks.workunit.client.1.smithi129.stdout:7/240: link d0/d46/f47 d0/d46/d56/f5c 0 2024-09-21T08:02:28.521 INFO:tasks.workunit.client.1.smithi129.stdout:5/251: creat d2/f45 x:0 0 0 2024-09-21T08:02:28.521 INFO:tasks.workunit.client.1.smithi129.stdout:6/170: dread d7/f24 [0,4194304] 0 2024-09-21T08:02:28.521 INFO:tasks.workunit.client.1.smithi129.stdout:5/252: write d2/d1e/d35/f31 [4753112,48797] 0 2024-09-21T08:02:28.522 INFO:tasks.workunit.client.1.smithi129.stdout:5/253: creat d2/d1e/d35/d33/d36/f46 x:0 0 0 2024-09-21T08:02:28.523 INFO:tasks.workunit.client.1.smithi129.stdout:7/241: getdents d0/d1e 0 2024-09-21T08:02:28.525 INFO:tasks.workunit.client.1.smithi129.stdout:5/254: creat d2/d1e/d35/d37/f47 x:0 0 0 2024-09-21T08:02:28.525 INFO:tasks.workunit.client.1.smithi129.stdout:5/255: creat d2/d1e/d35/d33/f48 x:0 0 0 2024-09-21T08:02:28.527 INFO:tasks.workunit.client.1.smithi129.stdout:2/368: truncate d1/d13/d3a/d47/d1f/f25 2701842 0 2024-09-21T08:02:28.528 INFO:tasks.workunit.client.1.smithi129.stdout:2/369: unlink d1/d13/d3a/d47/d1f/f84 0 2024-09-21T08:02:28.529 INFO:tasks.workunit.client.1.smithi129.stdout:2/370: stat d1/dc/d19/d4c/d6a/l56 0 2024-09-21T08:02:28.529 INFO:tasks.workunit.client.1.smithi129.stdout:2/371: write d1/dc/d19/f38 [678967,17124] 0 2024-09-21T08:02:28.531 INFO:tasks.workunit.client.1.smithi129.stdout:0/207: dwrite fb [0,4194304] 0 2024-09-21T08:02:28.531 INFO:tasks.workunit.client.1.smithi129.stdout:2/372: link d1/dc/f16 d1/d13/d3a/d47/d5f/f86 0 2024-09-21T08:02:28.531 INFO:tasks.workunit.client.1.smithi129.stdout:2/373: readlink d1/lb 0 2024-09-21T08:02:28.533 INFO:tasks.workunit.client.1.smithi129.stdout:0/208: creat de/d22/d27/d2f/f3e x:0 0 0 2024-09-21T08:02:28.533 INFO:tasks.workunit.client.1.smithi129.stdout:0/209: chown de/d1f 729 1 2024-09-21T08:02:28.534 INFO:tasks.workunit.client.1.smithi129.stdout:3/207: dwrite d3/da/dc/d25/f41 [0,4194304] 0 2024-09-21T08:02:28.534 INFO:tasks.workunit.client.1.smithi129.stdout:8/168: dwrite d0/d6/f1f [0,4194304] 0 2024-09-21T08:02:28.534 INFO:tasks.workunit.client.1.smithi129.stdout:8/169: dread - d0/d6/d7/d9/f2a zero size 2024-09-21T08:02:28.534 INFO:tasks.workunit.client.1.smithi129.stdout:2/374: rename d1/f1c to d1/d13/d32/f87 0 2024-09-21T08:02:28.534 INFO:tasks.workunit.client.1.smithi129.stdout:2/375: dread - d1/dc/d26/f62 zero size 2024-09-21T08:02:28.534 INFO:tasks.workunit.client.1.smithi129.stdout:2/376: fdatasync d1/d13/d3a/d47/d1f/f40 0 2024-09-21T08:02:28.535 INFO:tasks.workunit.client.1.smithi129.stdout:0/210: mknod de/d15/c3f 0 2024-09-21T08:02:28.535 INFO:tasks.workunit.client.1.smithi129.stdout:0/211: readlink de/l14 0 2024-09-21T08:02:28.535 INFO:tasks.workunit.client.1.smithi129.stdout:5/256: fsync d2/d1e/d35/f31 0 2024-09-21T08:02:28.536 INFO:tasks.workunit.client.1.smithi129.stdout:5/257: rename d2/d1e/d35/d33 to d2/d1e/d35/d33/d49 22 2024-09-21T08:02:28.536 INFO:tasks.workunit.client.1.smithi129.stdout:5/258: truncate d2/d1e/d35/d33/f3e 794145 0 2024-09-21T08:02:28.536 INFO:tasks.workunit.client.1.smithi129.stdout:0/212: dread de/d15/f1c [0,4194304] 0 2024-09-21T08:02:28.538 INFO:tasks.workunit.client.1.smithi129.stdout:8/170: rmdir d0/d6/d7/d18 39 2024-09-21T08:02:28.538 INFO:tasks.workunit.client.1.smithi129.stdout:7/242: read d0/d1e/f55 [1429934,117097] 0 2024-09-21T08:02:28.538 INFO:tasks.workunit.client.1.smithi129.stdout:7/243: creat d0/d46/f5d x:0 0 0 2024-09-21T08:02:28.540 INFO:tasks.workunit.client.1.smithi129.stdout:2/377: mkdir d1/dc/d19/d88 0 2024-09-21T08:02:28.541 INFO:tasks.workunit.client.1.smithi129.stdout:6/171: dwrite d7/f37 [0,4194304] 0 2024-09-21T08:02:28.542 INFO:tasks.workunit.client.1.smithi129.stdout:0/213: unlink de/d22/f20 0 2024-09-21T08:02:28.544 INFO:tasks.workunit.client.1.smithi129.stdout:5/259: getdents d2/d1e 0 2024-09-21T08:02:28.544 INFO:tasks.workunit.client.1.smithi129.stdout:5/260: creat d2/d1e/d35/f4a x:0 0 0 2024-09-21T08:02:28.545 INFO:tasks.workunit.client.1.smithi129.stdout:2/378: creat d1/dc/d19/d88/f89 x:0 0 0 2024-09-21T08:02:28.549 INFO:tasks.workunit.client.1.smithi129.stdout:7/244: dread d0/f25 [0,4194304] 0 2024-09-21T08:02:28.549 INFO:tasks.workunit.client.1.smithi129.stdout:7/245: chown d0/d1e/f40 3002374 1 2024-09-21T08:02:28.549 INFO:tasks.workunit.client.1.smithi129.stdout:7/246: write d0/d46/d56/f5c [953220,49946] 0 2024-09-21T08:02:28.549 INFO:tasks.workunit.client.1.smithi129.stdout:7/247: dread - d0/d46/f5d zero size 2024-09-21T08:02:28.549 INFO:tasks.workunit.client.1.smithi129.stdout:7/248: chown d0/lb 16136 1 2024-09-21T08:02:28.550 INFO:tasks.workunit.client.1.smithi129.stdout:0/214: mknod de/d15/c40 0 2024-09-21T08:02:28.550 INFO:tasks.workunit.client.1.smithi129.stdout:0/215: fsync de/d15/f28 0 2024-09-21T08:02:28.550 INFO:tasks.workunit.client.1.smithi129.stdout:0/216: readlink de/d15/d29/l32 0 2024-09-21T08:02:28.552 INFO:tasks.workunit.client.1.smithi129.stdout:5/261: link d2/f4 d2/d1e/d35/d33/f4b 0 2024-09-21T08:02:28.553 INFO:tasks.workunit.client.1.smithi129.stdout:2/379: mknod d1/d13/d3a/c8a 0 2024-09-21T08:02:28.557 INFO:tasks.workunit.client.1.smithi129.stdout:6/172: rmdir d7/d1b 39 2024-09-21T08:02:28.557 INFO:tasks.workunit.client.1.smithi129.stdout:8/171: write d0/f16 [2293023,104329] 0 2024-09-21T08:02:28.557 INFO:tasks.workunit.client.1.smithi129.stdout:6/173: dread - d7/d10/f22 zero size 2024-09-21T08:02:28.557 INFO:tasks.workunit.client.1.smithi129.stdout:8/172: read - d0/d6/d7/d9/f2a zero size 2024-09-21T08:02:28.558 INFO:tasks.workunit.client.1.smithi129.stdout:4/196: dwrite d5/d6/f7 [0,4194304] 0 2024-09-21T08:02:28.558 INFO:tasks.workunit.client.1.smithi129.stdout:7/249: creat d0/f5e x:0 0 0 2024-09-21T08:02:28.558 INFO:tasks.workunit.client.1.smithi129.stdout:3/208: dwrite d3/f4 [4194304,4194304] 0 2024-09-21T08:02:28.561 INFO:tasks.workunit.client.1.smithi129.stdout:2/380: mkdir d1/d53/d77/d8b 0 2024-09-21T08:02:28.561 INFO:tasks.workunit.client.1.smithi129.stdout:6/174: mkdir d7/d1b/d25/d2b/d3e 0 2024-09-21T08:02:28.561 INFO:tasks.workunit.client.1.smithi129.stdout:6/175: chown d7/c1a 14486081 1 2024-09-21T08:02:28.569 INFO:tasks.workunit.client.1.smithi129.stdout:4/197: dread d5/f3c [0,4194304] 0 2024-09-21T08:02:28.569 INFO:tasks.workunit.client.1.smithi129.stdout:3/209: symlink d3/da/dc/d25/l45 0 2024-09-21T08:02:28.571 INFO:tasks.workunit.client.1.smithi129.stdout:2/381: creat d1/f8c x:0 0 0 2024-09-21T08:02:28.571 INFO:tasks.workunit.client.1.smithi129.stdout:2/382: chown d1/d13/d3a/d47/d1f/c5e 3110306 1 2024-09-21T08:02:28.572 INFO:tasks.workunit.client.1.smithi129.stdout:6/176: creat d7/d1b/d1e/d39/f3f x:0 0 0 2024-09-21T08:02:28.573 INFO:tasks.workunit.client.1.smithi129.stdout:4/198: link d5/c15 d5/d16/d24/c49 0 2024-09-21T08:02:28.575 INFO:tasks.workunit.client.1.smithi129.stdout:3/210: link d3/da/dc/d11/d2f/l3e d3/da/dc/d11/d2f/d27/l46 0 2024-09-21T08:02:28.576 INFO:tasks.workunit.client.1.smithi129.stdout:2/383: creat d1/d53/f8d x:0 0 0 2024-09-21T08:02:28.576 INFO:tasks.workunit.client.1.smithi129.stdout:2/384: fdatasync d1/dc/ff 0 2024-09-21T08:02:28.576 INFO:tasks.workunit.client.1.smithi129.stdout:5/262: fsync d2/d1e/d35/f4a 0 2024-09-21T08:02:28.577 INFO:tasks.workunit.client.1.smithi129.stdout:3/211: symlink d3/da/d3c/l47 0 2024-09-21T08:02:28.578 INFO:tasks.workunit.client.1.smithi129.stdout:2/385: creat d1/d13/d32/d7c/f8e x:0 0 0 2024-09-21T08:02:28.579 INFO:tasks.workunit.client.1.smithi129.stdout:5/263: truncate d2/d1e/d35/ff 3452217 0 2024-09-21T08:02:28.579 INFO:tasks.workunit.client.1.smithi129.stdout:5/264: write d2/d1e/d35/d33/f4b [3522447,117165] 0 2024-09-21T08:02:28.579 INFO:tasks.workunit.client.1.smithi129.stdout:5/265: readlink d2/d1e/d35/l27 0 2024-09-21T08:02:28.581 INFO:tasks.workunit.client.1.smithi129.stdout:3/212: rmdir d3/da/dc/d11/d3f 0 2024-09-21T08:02:28.581 INFO:tasks.workunit.client.1.smithi129.stdout:8/173: dwrite d0/d6/f1a [0,4194304] 0 2024-09-21T08:02:28.583 INFO:tasks.workunit.client.1.smithi129.stdout:5/266: unlink d2/d2a/c39 0 2024-09-21T08:02:28.587 INFO:tasks.workunit.client.1.smithi129.stdout:7/250: dwrite d0/d1e/f36 [0,4194304] 0 2024-09-21T08:02:28.589 INFO:tasks.workunit.client.1.smithi129.stdout:5/267: mknod d2/c4c 0 2024-09-21T08:02:28.591 INFO:tasks.workunit.client.1.smithi129.stdout:4/199: read d5/d16/d24/f42 [1316830,61424] 0 2024-09-21T08:02:28.591 INFO:tasks.workunit.client.1.smithi129.stdout:4/200: stat d5/d6/f26 0 2024-09-21T08:02:28.591 INFO:tasks.workunit.client.1.smithi129.stdout:7/251: creat d0/d46/d56/f5f x:0 0 0 2024-09-21T08:02:28.591 INFO:tasks.workunit.client.1.smithi129.stdout:4/201: write d5/d16/d24/d3b/f3e [847072,59116] 0 2024-09-21T08:02:28.592 INFO:tasks.workunit.client.1.smithi129.stdout:7/252: truncate d0/f26 3257489 0 2024-09-21T08:02:28.593 INFO:tasks.workunit.client.1.smithi129.stdout:4/202: rmdir d5/d33 39 2024-09-21T08:02:28.593 INFO:tasks.workunit.client.1.smithi129.stdout:4/203: dread - d5/d6/f44 zero size 2024-09-21T08:02:28.598 INFO:tasks.workunit.client.1.smithi129.stdout:7/253: getdents d0 0 2024-09-21T08:02:28.600 INFO:tasks.workunit.client.1.smithi129.stdout:1/275: sync 2024-09-21T08:02:28.600 INFO:tasks.workunit.client.1.smithi129.stdout:1/276: chown d1/d9/f20 91740 1 2024-09-21T08:02:28.600 INFO:tasks.workunit.client.1.smithi129.stdout:1/277: fsync d1/d16/d28/f33 0 2024-09-21T08:02:28.600 INFO:tasks.workunit.client.1.smithi129.stdout:1/278: read d1/f39 [302825,68631] 0 2024-09-21T08:02:28.602 INFO:tasks.workunit.client.1.smithi129.stdout:6/177: dwrite d7/d10/f14 [0,4194304] 0 2024-09-21T08:02:28.602 INFO:tasks.workunit.client.1.smithi129.stdout:6/178: chown d7/l11 835960 1 2024-09-21T08:02:28.603 INFO:tasks.workunit.client.1.smithi129.stdout:1/279: link d1/c23 d1/d44/c69 0 2024-09-21T08:02:28.607 INFO:tasks.workunit.client.1.smithi129.stdout:5/268: dread d2/d1e/f32 [0,4194304] 0 2024-09-21T08:02:28.607 INFO:tasks.workunit.client.1.smithi129.stdout:5/269: creat d2/d1e/d35/f4d x:0 0 0 2024-09-21T08:02:28.608 INFO:tasks.workunit.client.1.smithi129.stdout:8/174: dwrite d0/d6/d7/d9/f2a [0,4194304] 0 2024-09-21T08:02:28.611 INFO:tasks.workunit.client.1.smithi129.stdout:3/213: dwrite d3/da/dc/d11/d2f/d27/f36 [0,4194304] 0 2024-09-21T08:02:28.615 INFO:tasks.workunit.client.1.smithi129.stdout:8/175: symlink d0/d6/d7/d18/l33 0 2024-09-21T08:02:28.619 INFO:tasks.workunit.client.1.smithi129.stdout:3/214: dread d3/da/dc/f22 [0,4194304] 0 2024-09-21T08:02:28.619 INFO:tasks.workunit.client.1.smithi129.stdout:8/176: creat d0/d6/f34 x:0 0 0 2024-09-21T08:02:28.619 INFO:tasks.workunit.client.1.smithi129.stdout:9/238: sync 2024-09-21T08:02:28.620 INFO:tasks.workunit.client.1.smithi129.stdout:8/177: creat d0/d6/d7/d24/f35 x:0 0 0 2024-09-21T08:02:28.623 INFO:tasks.workunit.client.1.smithi129.stdout:5/270: dread d2/f19 [0,4194304] 0 2024-09-21T08:02:28.623 INFO:tasks.workunit.client.1.smithi129.stdout:1/280: getdents d1/d44 0 2024-09-21T08:02:28.623 INFO:tasks.workunit.client.1.smithi129.stdout:5/271: creat d2/f4e x:0 0 0 2024-09-21T08:02:28.623 INFO:tasks.workunit.client.1.smithi129.stdout:1/281: stat d1/d16/c3e 0 2024-09-21T08:02:28.623 INFO:tasks.workunit.client.1.smithi129.stdout:5/272: write d2/f4 [4491024,79432] 0 2024-09-21T08:02:28.624 INFO:tasks.workunit.client.1.smithi129.stdout:1/282: mkdir d1/d16/d28/d6a 0 2024-09-21T08:02:28.627 INFO:tasks.workunit.client.1.smithi129.stdout:5/273: link d2/d1e/d35/f2b d2/d1e/d35/d33/d36/d43/f4f 0 2024-09-21T08:02:28.628 INFO:tasks.workunit.client.1.smithi129.stdout:1/283: mkdir d1/d9/d6b 0 2024-09-21T08:02:28.628 INFO:tasks.workunit.client.1.smithi129.stdout:1/284: write d1/d16/f29 [219478,82633] 0 2024-09-21T08:02:28.628 INFO:tasks.workunit.client.1.smithi129.stdout:1/285: stat d1/d16/l1b 0 2024-09-21T08:02:28.628 INFO:tasks.workunit.client.1.smithi129.stdout:1/286: creat d1/d9/f6c x:0 0 0 2024-09-21T08:02:28.632 INFO:tasks.workunit.client.1.smithi129.stdout:3/215: dread d3/da/f19 [4194304,4194304] 0 2024-09-21T08:02:28.632 INFO:tasks.workunit.client.1.smithi129.stdout:3/216: write d3/da/dc/d11/d2f/d27/f3a [532516,16432] 0 2024-09-21T08:02:28.632 INFO:tasks.workunit.client.1.smithi129.stdout:3/217: write d3/da/dc/d11/d2f/d27/f3a [901724,75307] 0 2024-09-21T08:02:28.642 INFO:tasks.workunit.client.1.smithi129.stdout:7/254: dwrite d0/f37 [0,4194304] 0 2024-09-21T08:02:28.642 INFO:tasks.workunit.client.1.smithi129.stdout:7/255: chown d0/d46/d56/f5f 3 1 2024-09-21T08:02:28.642 INFO:tasks.workunit.client.1.smithi129.stdout:7/256: chown d0/c3a 1746 1 2024-09-21T08:02:28.643 INFO:tasks.workunit.client.1.smithi129.stdout:6/179: dwrite d7/d1b/d1e/f36 [0,4194304] 0 2024-09-21T08:02:28.646 INFO:tasks.workunit.client.1.smithi129.stdout:3/218: dread d3/f13 [0,4194304] 0 2024-09-21T08:02:28.646 INFO:tasks.workunit.client.1.smithi129.stdout:8/178: dwrite d0/f2b [0,4194304] 0 2024-09-21T08:02:28.646 INFO:tasks.workunit.client.1.smithi129.stdout:8/179: creat d0/d6/d7/d24/f36 x:0 0 0 2024-09-21T08:02:28.647 INFO:tasks.workunit.client.1.smithi129.stdout:7/257: write d0/f16 [1250742,52288] 0 2024-09-21T08:02:28.647 INFO:tasks.workunit.client.1.smithi129.stdout:6/180: mkdir d7/d1b/d25/d35/d40 0 2024-09-21T08:02:28.649 INFO:tasks.workunit.client.1.smithi129.stdout:5/274: rename d2/d1e/d35/d33/d36/d43 to d2/d2a/d50 0 2024-09-21T08:02:28.649 INFO:tasks.workunit.client.1.smithi129.stdout:5/275: write d2/d1e/d35/f4d [840508,39671] 0 2024-09-21T08:02:28.650 INFO:tasks.workunit.client.1.smithi129.stdout:5/276: dread - d2/d1e/d35/d33/f48 zero size 2024-09-21T08:02:28.650 INFO:tasks.workunit.client.1.smithi129.stdout:5/277: creat d2/d1e/d35/f51 x:0 0 0 2024-09-21T08:02:28.652 INFO:tasks.workunit.client.1.smithi129.stdout:6/181: mkdir d7/d1b/d25/d35/d40/d41 0 2024-09-21T08:02:28.652 INFO:tasks.workunit.client.1.smithi129.stdout:6/182: write d7/fa [277761,2273] 0 2024-09-21T08:02:28.655 INFO:tasks.workunit.client.1.smithi129.stdout:6/183: rmdir d7/d1b/d25 39 2024-09-21T08:02:28.658 INFO:tasks.workunit.client.1.smithi129.stdout:8/180: dread d0/d6/d7/f15 [0,4194304] 0 2024-09-21T08:02:28.659 INFO:tasks.workunit.client.1.smithi129.stdout:6/184: rename d7/d1b/d1c/l32 to d7/d1b/l42 0 2024-09-21T08:02:28.663 INFO:tasks.workunit.client.1.smithi129.stdout:8/181: dread d0/f16 [0,4194304] 0 2024-09-21T08:02:28.663 INFO:tasks.workunit.client.1.smithi129.stdout:8/182: chown d0/d6/c1d 1765 1 2024-09-21T08:02:28.665 INFO:tasks.workunit.client.1.smithi129.stdout:5/278: rmdir d2/d1e/d35 39 2024-09-21T08:02:28.665 INFO:tasks.workunit.client.1.smithi129.stdout:5/279: read d2/f1d [3712713,6786] 0 2024-09-21T08:02:28.667 INFO:tasks.workunit.client.1.smithi129.stdout:7/258: dwrite d0/d1e/f4b [4194304,4194304] 0 2024-09-21T08:02:28.667 INFO:tasks.workunit.client.1.smithi129.stdout:7/259: dread - d0/d46/f57 zero size 2024-09-21T08:02:28.669 INFO:tasks.workunit.client.1.smithi129.stdout:7/260: truncate d0/f26 393653 0 2024-09-21T08:02:28.670 INFO:tasks.workunit.client.1.smithi129.stdout:7/261: symlink d0/d46/l60 0 2024-09-21T08:02:28.671 INFO:tasks.workunit.client.1.smithi129.stdout:7/262: write d0/d1e/f4b [4103771,116373] 0 2024-09-21T08:02:28.671 INFO:tasks.workunit.client.1.smithi129.stdout:7/263: fsync d0/f22 0 2024-09-21T08:02:28.671 INFO:tasks.workunit.client.1.smithi129.stdout:7/264: truncate d0/d46/f5d 291400 0 2024-09-21T08:02:28.671 INFO:tasks.workunit.client.1.smithi129.stdout:6/185: dread f5 [0,4194304] 0 2024-09-21T08:02:28.683 INFO:tasks.workunit.client.1.smithi129.stdout:7/265: write d0/f22 [1595216,8535] 0 2024-09-21T08:02:28.683 INFO:tasks.workunit.client.1.smithi129.stdout:7/266: creat d0/d46/f61 x:0 0 0 2024-09-21T08:02:28.683 INFO:tasks.workunit.client.1.smithi129.stdout:7/267: write d0/d46/f5d [473363,37023] 0 2024-09-21T08:02:28.683 INFO:tasks.workunit.client.1.smithi129.stdout:8/183: dwrite d0/d6/d7/f21 [0,4194304] 0 2024-09-21T08:02:28.683 INFO:tasks.workunit.client.1.smithi129.stdout:5/280: truncate d2/d1e/d35/f4d 410846 0 2024-09-21T08:02:28.692 INFO:tasks.workunit.client.1.smithi129.stdout:7/268: write d0/d1e/f55 [2863359,118920] 0 2024-09-21T08:02:28.693 INFO:tasks.workunit.client.1.smithi129.stdout:7/269: fsync d0/f20 0 2024-09-21T08:02:28.693 INFO:tasks.workunit.client.1.smithi129.stdout:3/219: dwrite d3/da/dc/d11/d2f/d27/f3a [0,4194304] 0 2024-09-21T08:02:28.699 INFO:tasks.workunit.client.1.smithi129.stdout:5/281: unlink d2/d1e/d35/d33/d36/f46 0 2024-09-21T08:02:28.701 INFO:tasks.workunit.client.1.smithi129.stdout:7/270: symlink d0/d46/d56/l62 0 2024-09-21T08:02:28.702 INFO:tasks.workunit.client.1.smithi129.stdout:7/271: creat d0/d46/d56/f63 x:0 0 0 2024-09-21T08:02:28.702 INFO:tasks.workunit.client.1.smithi129.stdout:7/272: creat d0/d46/d56/f64 x:0 0 0 2024-09-21T08:02:28.702 INFO:tasks.workunit.client.1.smithi129.stdout:7/273: stat d0/d1e/f21 0 2024-09-21T08:02:28.705 INFO:tasks.workunit.client.1.smithi129.stdout:7/274: rename d0/ld to d0/d1e/l65 0 2024-09-21T08:02:28.706 INFO:tasks.workunit.client.1.smithi129.stdout:6/186: dwrite d7/f24 [0,4194304] 0 2024-09-21T08:02:28.707 INFO:tasks.workunit.client.1.smithi129.stdout:3/220: dread d3/da/dc/d11/d2f/d27/f3a [0,4194304] 0 2024-09-21T08:02:28.707 INFO:tasks.workunit.client.1.smithi129.stdout:7/275: read d0/d46/d56/f5c [228419,124657] 0 2024-09-21T08:02:28.708 INFO:tasks.workunit.client.1.smithi129.stdout:7/276: write d0/f24 [103599,42192] 0 2024-09-21T08:02:28.708 INFO:tasks.workunit.client.1.smithi129.stdout:8/184: dwrite d0/d6/d7/f21 [0,4194304] 0 2024-09-21T08:02:28.708 INFO:tasks.workunit.client.1.smithi129.stdout:8/185: readlink d0/d6/d7/lf 0 2024-09-21T08:02:28.708 INFO:tasks.workunit.client.1.smithi129.stdout:8/186: chown d0/d6/d7/d18/d27/d32 4936 1 2024-09-21T08:02:28.708 INFO:tasks.workunit.client.1.smithi129.stdout:6/187: symlink d7/d1b/l43 0 2024-09-21T08:02:28.711 INFO:tasks.workunit.client.1.smithi129.stdout:7/277: truncate d0/d1e/f55 3079186 0 2024-09-21T08:02:28.711 INFO:tasks.workunit.client.1.smithi129.stdout:7/278: chown d0/f37 65513788 1 2024-09-21T08:02:28.712 INFO:tasks.workunit.client.1.smithi129.stdout:7/279: readlink d0/d1e/l32 0 2024-09-21T08:02:28.712 INFO:tasks.workunit.client.1.smithi129.stdout:8/187: mkdir d0/d6/d7/d18/d27/d32/d37 0 2024-09-21T08:02:28.713 INFO:tasks.workunit.client.1.smithi129.stdout:6/188: mknod d7/d1b/d1c/c44 0 2024-09-21T08:02:28.715 INFO:tasks.workunit.client.1.smithi129.stdout:3/221: dread d3/f4 [0,4194304] 0 2024-09-21T08:02:28.716 INFO:tasks.workunit.client.1.smithi129.stdout:3/222: mknod d3/da/dc/d11/d2f/c48 0 2024-09-21T08:02:28.717 INFO:tasks.workunit.client.1.smithi129.stdout:3/223: rename d3/da/f1a to d3/da/f49 0 2024-09-21T08:02:28.719 INFO:tasks.workunit.client.1.smithi129.stdout:3/224: creat d3/f4a x:0 0 0 2024-09-21T08:02:28.720 INFO:tasks.workunit.client.1.smithi129.stdout:8/188: dread d0/d6/d7/f21 [0,4194304] 0 2024-09-21T08:02:28.721 INFO:tasks.workunit.client.1.smithi129.stdout:3/225: unlink d3/da/dc/f21 0 2024-09-21T08:02:28.721 INFO:tasks.workunit.client.1.smithi129.stdout:3/226: chown d3/da/dc/d11/l42 140428991 1 2024-09-21T08:02:28.722 INFO:tasks.workunit.client.1.smithi129.stdout:8/189: creat d0/d6/d7/d18/d27/f38 x:0 0 0 2024-09-21T08:02:28.722 INFO:tasks.workunit.client.1.smithi129.stdout:8/190: dread - d0/d6/d7/d24/f36 zero size 2024-09-21T08:02:28.722 INFO:tasks.workunit.client.1.smithi129.stdout:8/191: getdents d0/d6/d7/d9 0 2024-09-21T08:02:28.722 INFO:tasks.workunit.client.1.smithi129.stdout:8/192: chown d0/d6/f34 5 1 2024-09-21T08:02:28.723 INFO:tasks.workunit.client.1.smithi129.stdout:3/227: chown d3/l3b 225 1 2024-09-21T08:02:28.725 INFO:tasks.workunit.client.1.smithi129.stdout:3/228: creat d3/da/dc/d11/f4b x:0 0 0 2024-09-21T08:02:28.725 INFO:tasks.workunit.client.1.smithi129.stdout:3/229: chown d3/l3b 54645 1 2024-09-21T08:02:28.728 INFO:tasks.workunit.client.1.smithi129.stdout:3/230: rename d3/da/dc/d11/d2f/d27/f3a to d3/da/f4c 0 2024-09-21T08:02:28.728 INFO:tasks.workunit.client.1.smithi129.stdout:7/280: dread d0/f37 [0,4194304] 0 2024-09-21T08:02:28.728 INFO:tasks.workunit.client.1.smithi129.stdout:7/281: fdatasync d0/f37 0 2024-09-21T08:02:28.729 INFO:tasks.workunit.client.1.smithi129.stdout:3/231: unlink d3/l3b 0 2024-09-21T08:02:28.731 INFO:tasks.workunit.client.1.smithi129.stdout:3/232: getdents d3/da/dc/d11/d2f 0 2024-09-21T08:02:28.731 INFO:tasks.workunit.client.1.smithi129.stdout:3/233: creat d3/da/dc/f4d x:0 0 0 2024-09-21T08:02:28.731 INFO:tasks.workunit.client.1.smithi129.stdout:3/234: stat d3/da/d3c 0 2024-09-21T08:02:28.732 INFO:tasks.workunit.client.1.smithi129.stdout:7/282: dread d0/d46/f5d [0,4194304] 0 2024-09-21T08:02:28.735 INFO:tasks.workunit.client.1.smithi129.stdout:6/189: dwrite d7/d1b/d1c/f1d [0,4194304] 0 2024-09-21T08:02:28.738 INFO:tasks.workunit.client.1.smithi129.stdout:6/190: rename d7/d1b/d25/d2b/f2f to d7/d1b/d1e/d39/f45 0 2024-09-21T08:02:28.738 INFO:tasks.workunit.client.1.smithi129.stdout:3/235: rmdir d3/da/dc 39 2024-09-21T08:02:28.738 INFO:tasks.workunit.client.1.smithi129.stdout:0/217: sync 2024-09-21T08:02:28.738 INFO:tasks.workunit.client.1.smithi129.stdout:0/218: write de/d19/f38 [77065,96952] 0 2024-09-21T08:02:28.738 INFO:tasks.workunit.client.1.smithi129.stdout:0/219: dread - de/d15/d29/f37 zero size 2024-09-21T08:02:28.738 INFO:tasks.workunit.client.1.smithi129.stdout:7/283: dread d0/d1e/f55 [0,4194304] 0 2024-09-21T08:02:28.738 INFO:tasks.workunit.client.1.smithi129.stdout:3/236: rename d3/da/dc/f43 to d3/da/dc/d11/d2f/d27/f4e 0 2024-09-21T08:02:28.739 INFO:tasks.workunit.client.1.smithi129.stdout:7/284: dread d0/d46/f5d [0,4194304] 0 2024-09-21T08:02:28.739 INFO:tasks.workunit.client.1.smithi129.stdout:0/220: creat de/d15/d39/f41 x:0 0 0 2024-09-21T08:02:28.739 INFO:tasks.workunit.client.1.smithi129.stdout:0/221: write de/f13 [4803036,90096] 0 2024-09-21T08:02:28.740 INFO:tasks.workunit.client.1.smithi129.stdout:3/237: creat d3/da/dc/d11/d2f/f4f x:0 0 0 2024-09-21T08:02:28.741 INFO:tasks.workunit.client.1.smithi129.stdout:0/222: dread de/d15/f1c [0,4194304] 0 2024-09-21T08:02:28.741 INFO:tasks.workunit.client.1.smithi129.stdout:0/223: read f7 [13854,30638] 0 2024-09-21T08:02:28.741 INFO:tasks.workunit.client.1.smithi129.stdout:6/191: read d7/fe [497037,23499] 0 2024-09-21T08:02:28.742 INFO:tasks.workunit.client.1.smithi129.stdout:6/192: write f5 [4651208,22363] 0 2024-09-21T08:02:28.742 INFO:tasks.workunit.client.1.smithi129.stdout:3/238: mknod d3/da/dc/d11/d2f/d27/c50 0 2024-09-21T08:02:28.742 INFO:tasks.workunit.client.1.smithi129.stdout:3/239: stat d3/da/dc/d11/l42 0 2024-09-21T08:02:28.742 INFO:tasks.workunit.client.1.smithi129.stdout:7/285: getdents d0/d46/d56 0 2024-09-21T08:02:28.742 INFO:tasks.workunit.client.1.smithi129.stdout:7/286: fsync d0/f5e 0 2024-09-21T08:02:28.743 INFO:tasks.workunit.client.1.smithi129.stdout:0/224: mkdir de/d22/d27/d2f/d42 0 2024-09-21T08:02:28.743 INFO:tasks.workunit.client.1.smithi129.stdout:0/225: creat de/d15/f43 x:0 0 0 2024-09-21T08:02:28.744 INFO:tasks.workunit.client.1.smithi129.stdout:6/193: link d7/d10/f14 d7/d1b/d1e/d39/f46 0 2024-09-21T08:02:28.745 INFO:tasks.workunit.client.1.smithi129.stdout:3/240: mkdir d3/da/dc/d11/d51 0 2024-09-21T08:02:28.748 INFO:tasks.workunit.client.1.smithi129.stdout:0/226: truncate de/d22/f26 3241767 0 2024-09-21T08:02:28.750 INFO:tasks.workunit.client.1.smithi129.stdout:6/194: symlink d7/d1b/d25/d35/d40/l47 0 2024-09-21T08:02:28.752 INFO:tasks.workunit.client.1.smithi129.stdout:3/241: rename d3/da/d3c to d3/da/dc/d11/d2f/d27/d52 0 2024-09-21T08:02:28.753 INFO:tasks.workunit.client.1.smithi129.stdout:0/227: mkdir de/d15/d44 0 2024-09-21T08:02:28.755 INFO:tasks.workunit.client.1.smithi129.stdout:3/242: rmdir d3/da/dc/d11/d51 0 2024-09-21T08:02:28.755 INFO:tasks.workunit.client.1.smithi129.stdout:3/243: fsync d3/f29 0 2024-09-21T08:02:28.756 INFO:tasks.workunit.client.1.smithi129.stdout:0/228: mkdir de/d15/d44/d45 0 2024-09-21T08:02:28.757 INFO:tasks.workunit.client.1.smithi129.stdout:0/229: dread de/d19/f38 [0,4194304] 0 2024-09-21T08:02:28.758 INFO:tasks.workunit.client.1.smithi129.stdout:3/244: rename d3/da/dc/d11/d2f/d27/d52/l47 to d3/da/l53 0 2024-09-21T08:02:28.760 INFO:tasks.workunit.client.1.smithi129.stdout:3/245: dread d3/da/f49 [4194304,4194304] 0 2024-09-21T08:02:28.774 INFO:tasks.workunit.client.1.smithi129.stdout:3/246: dwrite d3/da/f49 [0,4194304] 0 2024-09-21T08:02:28.774 INFO:tasks.workunit.client.1.smithi129.stdout:3/247: chown d3/da/dc/d11 446986 1 2024-09-21T08:02:28.774 INFO:tasks.workunit.client.1.smithi129.stdout:3/248: read - d3/da/dc/f4d zero size 2024-09-21T08:02:28.788 INFO:tasks.workunit.client.1.smithi129.stdout:4/204: sync 2024-09-21T08:02:28.788 INFO:tasks.workunit.client.1.smithi129.stdout:2/386: sync 2024-09-21T08:02:28.788 INFO:tasks.workunit.client.1.smithi129.stdout:3/249: dwrite d3/f4a [0,4194304] 0 2024-09-21T08:02:28.790 INFO:tasks.workunit.client.1.smithi129.stdout:3/250: creat d3/da/f54 x:0 0 0 2024-09-21T08:02:28.791 INFO:tasks.workunit.client.1.smithi129.stdout:2/387: dread d1/dc/d19/d4c/f5b [0,4194304] 0 2024-09-21T08:02:28.792 INFO:tasks.workunit.client.1.smithi129.stdout:3/251: dread d3/da/dc/f22 [4194304,4194304] 0 2024-09-21T08:02:28.792 INFO:tasks.workunit.client.1.smithi129.stdout:2/388: mkdir d1/d13/d3a/d8f 0 2024-09-21T08:02:28.793 INFO:tasks.workunit.client.1.smithi129.stdout:3/252: mkdir d3/da/dc/d11/d55 0 2024-09-21T08:02:28.794 INFO:tasks.workunit.client.1.smithi129.stdout:3/253: dread - d3/da/dc/d11/f34 zero size 2024-09-21T08:02:28.794 INFO:tasks.workunit.client.1.smithi129.stdout:3/254: readlink l2 0 2024-09-21T08:02:28.797 INFO:tasks.workunit.client.1.smithi129.stdout:4/205: dread d5/f39 [0,4194304] 0 2024-09-21T08:02:28.799 INFO:tasks.workunit.client.1.smithi129.stdout:4/206: truncate d5/d6/f30 1558906 0 2024-09-21T08:02:28.799 INFO:tasks.workunit.client.1.smithi129.stdout:4/207: dread - d5/d16/f29 zero size 2024-09-21T08:02:28.801 INFO:tasks.workunit.client.1.smithi129.stdout:2/389: write d1/d13/d3a/d47/d1f/f22 [2666440,22508] 0 2024-09-21T08:02:28.803 INFO:tasks.workunit.client.1.smithi129.stdout:2/390: creat d1/d13/d32/f90 x:0 0 0 2024-09-21T08:02:28.803 INFO:tasks.workunit.client.1.smithi129.stdout:2/391: dread - d1/d13/d32/d7c/f8e zero size 2024-09-21T08:02:28.804 INFO:tasks.workunit.client.1.smithi129.stdout:2/392: mkdir d1/d13/d3a/d47/d1f/d85/d91 0 2024-09-21T08:02:28.805 INFO:tasks.workunit.client.1.smithi129.stdout:2/393: creat d1/dc/d26/d45/d65/f92 x:0 0 0 2024-09-21T08:02:28.806 INFO:tasks.workunit.client.1.smithi129.stdout:2/394: mkdir d1/dc/d26/d45/d65/d93 0 2024-09-21T08:02:28.806 INFO:tasks.workunit.client.1.smithi129.stdout:2/395: dread - d1/dc/d19/d88/f89 zero size 2024-09-21T08:02:28.812 INFO:tasks.workunit.client.1.smithi129.stdout:3/255: dwrite d3/da/dc/d11/f4b [0,4194304] 0 2024-09-21T08:02:28.817 INFO:tasks.workunit.client.1.smithi129.stdout:2/396: dread d1/d13/f28 [0,4194304] 0 2024-09-21T08:02:28.833 INFO:tasks.workunit.client.1.smithi129.stdout:3/256: dwrite d3/da/dc/fd [0,4194304] 0 2024-09-21T08:02:28.840 INFO:tasks.workunit.client.1.smithi129.stdout:2/397: dwrite d1/dc/d26/f81 [0,4194304] 0 2024-09-21T08:02:28.841 INFO:tasks.workunit.client.1.smithi129.stdout:2/398: mkdir d1/dc/d94 0 2024-09-21T08:02:28.843 INFO:tasks.workunit.client.1.smithi129.stdout:2/399: creat d1/d13/d3a/d47/d1f/d85/f95 x:0 0 0 2024-09-21T08:02:28.843 INFO:tasks.workunit.client.1.smithi129.stdout:2/400: fdatasync d1/dc/d26/d45/f46 0 2024-09-21T08:02:28.844 INFO:tasks.workunit.client.1.smithi129.stdout:2/401: mknod d1/dc/d19/d4c/d6a/c96 0 2024-09-21T08:02:28.845 INFO:tasks.workunit.client.1.smithi129.stdout:2/402: getdents d1/d53 0 2024-09-21T08:02:28.846 INFO:tasks.workunit.client.1.smithi129.stdout:2/403: mkdir d1/d13/d32/d97 0 2024-09-21T08:02:28.846 INFO:tasks.workunit.client.1.smithi129.stdout:2/404: dread - d1/d53/d77/f79 zero size 2024-09-21T08:02:28.846 INFO:tasks.workunit.client.1.smithi129.stdout:2/405: fdatasync d1/dc/d19/d4c/d6a/f60 0 2024-09-21T08:02:28.847 INFO:tasks.workunit.client.1.smithi129.stdout:2/406: chown d1/dc/d26/c30 7533055 1 2024-09-21T08:02:28.859 INFO:tasks.workunit.client.1.smithi129.stdout:2/407: write d1/d13/d3a/d47/d1f/f2a [3267610,1466] 0 2024-09-21T08:02:28.859 INFO:tasks.workunit.client.1.smithi129.stdout:3/257: dwrite d3/da/ff [0,4194304] 0 2024-09-21T08:02:28.859 INFO:tasks.workunit.client.1.smithi129.stdout:2/408: write d1/dc/d26/d45/f7b [379500,94489] 0 2024-09-21T08:02:28.859 INFO:tasks.workunit.client.1.smithi129.stdout:3/258: creat d3/da/dc/d11/d2f/f56 x:0 0 0 2024-09-21T08:02:28.859 INFO:tasks.workunit.client.1.smithi129.stdout:3/259: fdatasync d3/da/dc/f4d 0 2024-09-21T08:02:28.861 INFO:tasks.workunit.client.1.smithi129.stdout:2/409: rename d1/f4 to d1/d13/d3a/d47/d1f/f98 0 2024-09-21T08:02:28.862 INFO:tasks.workunit.client.1.smithi129.stdout:2/410: mkdir d1/dc/d26/d45/d65/d99 0 2024-09-21T08:02:28.862 INFO:tasks.workunit.client.1.smithi129.stdout:2/411: dread - d1/d13/d32/d7c/f8e zero size 2024-09-21T08:02:28.863 INFO:tasks.workunit.client.1.smithi129.stdout:8/193: sync 2024-09-21T08:02:28.863 INFO:tasks.workunit.client.1.smithi129.stdout:9/239: sync 2024-09-21T08:02:28.863 INFO:tasks.workunit.client.1.smithi129.stdout:5/282: sync 2024-09-21T08:02:28.863 INFO:tasks.workunit.client.1.smithi129.stdout:1/287: sync 2024-09-21T08:02:28.863 INFO:tasks.workunit.client.1.smithi129.stdout:8/194: write d0/d6/d7/d24/f35 [854795,107836] 0 2024-09-21T08:02:28.863 INFO:tasks.workunit.client.1.smithi129.stdout:2/412: write d1/d13/d3a/d47/f27 [308932,129689] 0 2024-09-21T08:02:28.864 INFO:tasks.workunit.client.1.smithi129.stdout:8/195: write d0/d6/d7/d24/f35 [707190,38289] 0 2024-09-21T08:02:28.864 INFO:tasks.workunit.client.1.smithi129.stdout:5/283: mknod d2/d1e/d35/d33/d36/c52 0 2024-09-21T08:02:28.866 INFO:tasks.workunit.client.1.smithi129.stdout:2/413: unlink d1/d13/f14 0 2024-09-21T08:02:28.866 INFO:tasks.workunit.client.1.smithi129.stdout:9/240: dread f15 [0,4194304] 0 2024-09-21T08:02:28.866 INFO:tasks.workunit.client.1.smithi129.stdout:9/241: chown f10 33496 1 2024-09-21T08:02:28.866 INFO:tasks.workunit.client.1.smithi129.stdout:8/196: unlink d0/d6/d7/d18/d27/c2e 0 2024-09-21T08:02:28.868 INFO:tasks.workunit.client.1.smithi129.stdout:2/414: rmdir d1/d13/d3a/d47/d1f/d85/d91 0 2024-09-21T08:02:28.868 INFO:tasks.workunit.client.1.smithi129.stdout:3/260: dread d3/f4 [4194304,4194304] 0 2024-09-21T08:02:28.868 INFO:tasks.workunit.client.1.smithi129.stdout:3/261: read - d3/da/dc/d11/d2f/f40 zero size 2024-09-21T08:02:28.868 INFO:tasks.workunit.client.1.smithi129.stdout:9/242: write d17/d23/f2d [1209000,63766] 0 2024-09-21T08:02:28.869 INFO:tasks.workunit.client.1.smithi129.stdout:2/415: rename d1/d13/d3a/d47/f3c to d1/dc/d26/d45/f9a 0 2024-09-21T08:02:28.869 INFO:tasks.workunit.client.1.smithi129.stdout:2/416: creat d1/f9b x:0 0 0 2024-09-21T08:02:28.872 INFO:tasks.workunit.client.1.smithi129.stdout:5/284: dread d2/d2a/d50/f4f [0,4194304] 0 2024-09-21T08:02:28.881 INFO:tasks.workunit.client.1.smithi129.stdout:3/262: write d3/da/dc/fd [1411242,66205] 0 2024-09-21T08:02:28.881 INFO:tasks.workunit.client.1.smithi129.stdout:3/263: fsync d3/da/dc/f22 0 2024-09-21T08:02:28.891 INFO:tasks.workunit.client.1.smithi129.stdout:1/288: dwrite d1/f55 [0,4194304] 0 2024-09-21T08:02:28.891 INFO:tasks.workunit.client.1.smithi129.stdout:1/289: chown d1/d16/c52 61801 1 2024-09-21T08:02:28.891 INFO:tasks.workunit.client.1.smithi129.stdout:1/290: readlink d1/d4/l3a 0 2024-09-21T08:02:28.891 INFO:tasks.workunit.client.1.smithi129.stdout:1/291: truncate d1/f4c 925653 0 2024-09-21T08:02:28.897 INFO:tasks.workunit.client.1.smithi129.stdout:3/264: fsync d3/da/dc/d11/d2f/f56 0 2024-09-21T08:02:28.900 INFO:tasks.workunit.client.1.smithi129.stdout:1/292: write d1/d44/f53 [1514205,25864] 0 2024-09-21T08:02:28.900 INFO:tasks.workunit.client.1.smithi129.stdout:1/293: creat d1/d4/f6d x:0 0 0 2024-09-21T08:02:28.905 INFO:tasks.workunit.client.1.smithi129.stdout:1/294: mkdir d1/d4/d6e 0 2024-09-21T08:02:28.907 INFO:tasks.workunit.client.1.smithi129.stdout:7/287: sync 2024-09-21T08:02:28.907 INFO:tasks.workunit.client.1.smithi129.stdout:0/230: sync 2024-09-21T08:02:28.907 INFO:tasks.workunit.client.1.smithi129.stdout:4/208: sync 2024-09-21T08:02:28.907 INFO:tasks.workunit.client.1.smithi129.stdout:6/195: sync 2024-09-21T08:02:28.907 INFO:tasks.workunit.client.1.smithi129.stdout:4/209: dread - d5/d11/f3d zero size 2024-09-21T08:02:28.907 INFO:tasks.workunit.client.1.smithi129.stdout:6/196: truncate d7/d1b/d25/d2b/f3c 924905 0 2024-09-21T08:02:28.907 INFO:tasks.workunit.client.1.smithi129.stdout:6/197: truncate d7/d1b/f23 100287 0 2024-09-21T08:02:28.907 INFO:tasks.workunit.client.1.smithi129.stdout:6/198: chown d7/d1b/d1e/c2d 23 1 2024-09-21T08:02:28.908 INFO:tasks.workunit.client.1.smithi129.stdout:4/210: truncate d5/d16/d24/f42 2881904 0 2024-09-21T08:02:28.909 INFO:tasks.workunit.client.1.smithi129.stdout:9/243: dwrite d17/d2c/d31/d35/f50 [0,4194304] 0 2024-09-21T08:02:28.909 INFO:tasks.workunit.client.1.smithi129.stdout:2/417: dwrite d1/d13/f2c [0,4194304] 0 2024-09-21T08:02:28.909 INFO:tasks.workunit.client.1.smithi129.stdout:9/244: write f13 [5917,33639] 0 2024-09-21T08:02:28.909 INFO:tasks.workunit.client.1.smithi129.stdout:9/245: fsync d17/d2c/d31/f51 0 2024-09-21T08:02:28.910 INFO:tasks.workunit.client.1.smithi129.stdout:3/265: dread d3/f4a [0,4194304] 0 2024-09-21T08:02:28.910 INFO:tasks.workunit.client.1.smithi129.stdout:5/285: dwrite d2/f1d [0,4194304] 0 2024-09-21T08:02:28.910 INFO:tasks.workunit.client.1.smithi129.stdout:5/286: write d2/f19 [5011693,46314] 0 2024-09-21T08:02:28.912 INFO:tasks.workunit.client.1.smithi129.stdout:2/418: getdents d1/dc/d94 0 2024-09-21T08:02:28.914 INFO:tasks.workunit.client.1.smithi129.stdout:9/246: link d17/f1e d17/d2c/d31/f5a 0 2024-09-21T08:02:28.918 INFO:tasks.workunit.client.1.smithi129.stdout:5/287: creat d2/d2a/d50/f53 x:0 0 0 2024-09-21T08:02:28.918 INFO:tasks.workunit.client.1.smithi129.stdout:5/288: chown d2/d1e/d35/d33/d36/c52 72 1 2024-09-21T08:02:28.923 INFO:tasks.workunit.client.1.smithi129.stdout:5/289: unlink d2/d1e/d35/l15 0 2024-09-21T08:02:28.923 INFO:tasks.workunit.client.1.smithi129.stdout:5/290: readlink d2/la 0 2024-09-21T08:02:28.923 INFO:tasks.workunit.client.1.smithi129.stdout:5/291: dread - d2/f4e zero size 2024-09-21T08:02:28.923 INFO:tasks.workunit.client.1.smithi129.stdout:9/247: write d17/d2c/d31/f5a [2372233,6704] 0 2024-09-21T08:02:28.923 INFO:tasks.workunit.client.1.smithi129.stdout:6/199: read d7/d10/f14 [1907715,26219] 0 2024-09-21T08:02:28.924 INFO:tasks.workunit.client.1.smithi129.stdout:2/419: rename d1/d13/f2c to d1/dc/d26/d45/d65/d50/f9c 0 2024-09-21T08:02:28.924 INFO:tasks.workunit.client.1.smithi129.stdout:2/420: chown d1/d13/d3a/d47/d1f/c5e 480660 1 2024-09-21T08:02:28.924 INFO:tasks.workunit.client.1.smithi129.stdout:4/211: dread d5/f39 [0,4194304] 0 2024-09-21T08:02:28.926 INFO:tasks.workunit.client.1.smithi129.stdout:6/200: creat d7/d1b/d25/d35/d40/d41/f48 x:0 0 0 2024-09-21T08:02:28.928 INFO:tasks.workunit.client.1.smithi129.stdout:6/201: truncate d7/d1b/d1c/f1d 2413638 0 2024-09-21T08:02:28.930 INFO:tasks.workunit.client.1.smithi129.stdout:2/421: mkdir d1/dc/d19/d4c/d9d 0 2024-09-21T08:02:28.930 INFO:tasks.workunit.client.1.smithi129.stdout:2/422: write d1/d13/d3a/d47/d1f/d85/f95 [235765,97050] 0 2024-09-21T08:02:28.931 INFO:tasks.workunit.client.1.smithi129.stdout:6/202: creat d7/d1b/f49 x:0 0 0 2024-09-21T08:02:28.933 INFO:tasks.workunit.client.1.smithi129.stdout:2/423: mkdir d1/dc/d19/d4c/d6a/d69/d9e 0 2024-09-21T08:02:28.933 INFO:tasks.workunit.client.1.smithi129.stdout:2/424: creat d1/dc/d26/d45/d65/f9f x:0 0 0 2024-09-21T08:02:28.934 INFO:tasks.workunit.client.1.smithi129.stdout:6/203: mkdir d7/d4a 0 2024-09-21T08:02:28.934 INFO:tasks.workunit.client.1.smithi129.stdout:6/204: dread - d7/d1b/d25/d35/d40/d41/f48 zero size 2024-09-21T08:02:28.936 INFO:tasks.workunit.client.1.smithi129.stdout:2/425: mknod d1/ca0 0 2024-09-21T08:02:28.936 INFO:tasks.workunit.client.1.smithi129.stdout:2/426: creat d1/d13/fa1 x:0 0 0 2024-09-21T08:02:28.936 INFO:tasks.workunit.client.1.smithi129.stdout:4/212: write d5/d6/f2f [1155893,101769] 0 2024-09-21T08:02:28.938 INFO:tasks.workunit.client.1.smithi129.stdout:2/427: mknod d1/d13/d3a/d47/ca2 0 2024-09-21T08:02:28.938 INFO:tasks.workunit.client.1.smithi129.stdout:2/428: dread - d1/f8c zero size 2024-09-21T08:02:28.939 INFO:tasks.workunit.client.1.smithi129.stdout:2/429: truncate d1/f5 1248275 0 2024-09-21T08:02:28.948 INFO:tasks.workunit.client.1.smithi129.stdout:0/231: dwrite de/d15/f3d [0,4194304] 0 2024-09-21T08:02:28.949 INFO:tasks.workunit.client.1.smithi129.stdout:1/295: dwrite d1/f30 [0,4194304] 0 2024-09-21T08:02:28.949 INFO:tasks.workunit.client.1.smithi129.stdout:1/296: readlink d1/d16/d28/l4d 0 2024-09-21T08:02:28.951 INFO:tasks.workunit.client.1.smithi129.stdout:0/232: truncate fd 1799052 0 2024-09-21T08:02:28.951 INFO:tasks.workunit.client.1.smithi129.stdout:0/233: chown de/d22/f26 27450 1 2024-09-21T08:02:28.951 INFO:tasks.workunit.client.1.smithi129.stdout:0/234: readlink de/d1f/l2a 0 2024-09-21T08:02:28.951 INFO:tasks.workunit.client.1.smithi129.stdout:0/235: truncate de/f3c 961184 0 2024-09-21T08:02:28.951 INFO:tasks.workunit.client.1.smithi129.stdout:0/236: chown de/d15 5414 1 2024-09-21T08:02:28.951 INFO:tasks.workunit.client.1.smithi129.stdout:0/237: write de/d22/f2b [669585,78085] 0 2024-09-21T08:02:28.952 INFO:tasks.workunit.client.1.smithi129.stdout:1/297: rmdir d1/d16 39 2024-09-21T08:02:28.953 INFO:tasks.workunit.client.1.smithi129.stdout:1/298: rmdir d1/d16/d5f 0 2024-09-21T08:02:28.953 INFO:tasks.workunit.client.1.smithi129.stdout:9/248: dread d17/f1e [0,4194304] 0 2024-09-21T08:02:28.954 INFO:tasks.workunit.client.1.smithi129.stdout:0/238: rmdir de/d22/d27/d2f 39 2024-09-21T08:02:28.954 INFO:tasks.workunit.client.1.smithi129.stdout:0/239: stat f7 0 2024-09-21T08:02:28.954 INFO:tasks.workunit.client.1.smithi129.stdout:0/240: dread - de/d15/f3b zero size 2024-09-21T08:02:28.954 INFO:tasks.workunit.client.1.smithi129.stdout:0/241: fdatasync f0 0 2024-09-21T08:02:28.955 INFO:tasks.workunit.client.1.smithi129.stdout:9/249: mknod d17/d22/d33/d36/d48/d3f/c5b 0 2024-09-21T08:02:28.955 INFO:tasks.workunit.client.1.smithi129.stdout:1/299: dread d1/d16/d28/f33 [0,4194304] 0 2024-09-21T08:02:28.955 INFO:tasks.workunit.client.1.smithi129.stdout:1/300: readlink d1/d9/l34 0 2024-09-21T08:02:28.956 INFO:tasks.workunit.client.1.smithi129.stdout:1/301: dread d1/f4c [0,4194304] 0 2024-09-21T08:02:28.957 INFO:tasks.workunit.client.1.smithi129.stdout:3/266: dwrite d3/da/f19 [0,4194304] 0 2024-09-21T08:02:28.957 INFO:tasks.workunit.client.1.smithi129.stdout:7/288: dwrite d0/f20 [0,4194304] 0 2024-09-21T08:02:28.958 INFO:tasks.workunit.client.1.smithi129.stdout:6/205: rename d7/d1b/d1c to d7/d1b/d1e/d39/d4b 0 2024-09-21T08:02:28.958 INFO:tasks.workunit.client.1.smithi129.stdout:6/206: read d7/d1b/d1e/d39/f45 [20777,65518] 0 2024-09-21T08:02:28.958 INFO:tasks.workunit.client.1.smithi129.stdout:6/207: creat d7/d1b/d1e/d39/f4c x:0 0 0 2024-09-21T08:02:28.959 INFO:tasks.workunit.client.1.smithi129.stdout:7/289: mkdir d0/d1e/d66 0 2024-09-21T08:02:28.959 INFO:tasks.workunit.client.1.smithi129.stdout:7/290: write d0/f22 [5682589,69605] 0 2024-09-21T08:02:28.960 INFO:tasks.workunit.client.1.smithi129.stdout:5/292: dwrite d2/d1e/d35/f22 [0,4194304] 0 2024-09-21T08:02:28.961 INFO:tasks.workunit.client.1.smithi129.stdout:2/430: rename d1/dc/d26/d45/f9a to d1/d13/d3a/d47/d1f/fa3 0 2024-09-21T08:02:28.963 INFO:tasks.workunit.client.1.smithi129.stdout:4/213: dwrite d5/d16/d24/f42 [0,4194304] 0 2024-09-21T08:02:28.963 INFO:tasks.workunit.client.1.smithi129.stdout:4/214: readlink d5/d6/ld 0 2024-09-21T08:02:28.964 INFO:tasks.workunit.client.1.smithi129.stdout:6/208: creat d7/d1b/d1e/d39/d4b/f4d x:0 0 0 2024-09-21T08:02:28.964 INFO:tasks.workunit.client.1.smithi129.stdout:6/209: write d7/d1b/d1e/d39/d4b/f4d [407772,4771] 0 2024-09-21T08:02:28.965 INFO:tasks.workunit.client.1.smithi129.stdout:3/267: mkdir d3/d57 0 2024-09-21T08:02:28.966 INFO:tasks.workunit.client.1.smithi129.stdout:7/291: truncate d0/d1e/f38 2588947 0 2024-09-21T08:02:28.968 INFO:tasks.workunit.client.1.smithi129.stdout:6/210: dread d7/fe [0,4194304] 0 2024-09-21T08:02:28.968 INFO:tasks.workunit.client.1.smithi129.stdout:1/302: read d1/d4/f17 [386666,8772] 0 2024-09-21T08:02:28.968 INFO:tasks.workunit.client.1.smithi129.stdout:1/303: creat d1/d9/d31/f6f x:0 0 0 2024-09-21T08:02:28.969 INFO:tasks.workunit.client.1.smithi129.stdout:5/293: dread d2/f17 [0,4194304] 0 2024-09-21T08:02:28.970 INFO:tasks.workunit.client.1.smithi129.stdout:2/431: rmdir d1/dc/d19/d4c/d6a/d69/d9e 0 2024-09-21T08:02:28.970 INFO:tasks.workunit.client.1.smithi129.stdout:2/432: write d1/d13/d3a/d47/d1f/f2a [8993,37564] 0 2024-09-21T08:02:28.970 INFO:tasks.workunit.client.1.smithi129.stdout:2/433: dread - d1/d13/d32/f87 zero size 2024-09-21T08:02:28.971 INFO:tasks.workunit.client.1.smithi129.stdout:4/215: rename d5/d6/f26 to d5/d16/d24/d3b/f4a 0 2024-09-21T08:02:28.971 INFO:tasks.workunit.client.1.smithi129.stdout:5/294: dread d2/f23 [0,4194304] 0 2024-09-21T08:02:28.972 INFO:tasks.workunit.client.1.smithi129.stdout:7/292: unlink d0/c3b 0 2024-09-21T08:02:28.974 INFO:tasks.workunit.client.1.smithi129.stdout:9/250: dwrite d17/f1e [0,4194304] 0 2024-09-21T08:02:28.974 INFO:tasks.workunit.client.1.smithi129.stdout:9/251: creat d17/d2c/d31/f5c x:0 0 0 2024-09-21T08:02:28.974 INFO:tasks.workunit.client.1.smithi129.stdout:9/252: write d17/d23/f2d [1390193,75426] 0 2024-09-21T08:02:28.975 INFO:tasks.workunit.client.1.smithi129.stdout:6/211: unlink d7/d1b/d1e/d39/f3f 0 2024-09-21T08:02:28.977 INFO:tasks.workunit.client.1.smithi129.stdout:1/304: creat d1/d16/d25/f70 x:0 0 0 2024-09-21T08:02:28.979 INFO:tasks.workunit.client.1.smithi129.stdout:3/268: dread d3/f29 [0,4194304] 0 2024-09-21T08:02:28.979 INFO:tasks.workunit.client.1.smithi129.stdout:3/269: fsync d3/f13 0 2024-09-21T08:02:28.979 INFO:tasks.workunit.client.1.smithi129.stdout:9/253: dread d17/d46/f4f [0,4194304] 0 2024-09-21T08:02:28.981 INFO:tasks.workunit.client.1.smithi129.stdout:4/216: rename d5/d6/c10 to d5/d11/d3f/c4b 0 2024-09-21T08:02:28.981 INFO:tasks.workunit.client.1.smithi129.stdout:4/217: creat d5/d11/f4c x:0 0 0 2024-09-21T08:02:28.982 INFO:tasks.workunit.client.1.smithi129.stdout:5/295: symlink d2/d1e/d35/d33/l54 0 2024-09-21T08:02:28.982 INFO:tasks.workunit.client.1.smithi129.stdout:5/296: fdatasync f1 0 2024-09-21T08:02:28.982 INFO:tasks.workunit.client.1.smithi129.stdout:5/297: creat d2/f55 x:0 0 0 2024-09-21T08:02:28.985 INFO:tasks.workunit.client.1.smithi129.stdout:0/242: write de/d15/f3d [4173640,61318] 0 2024-09-21T08:02:28.985 INFO:tasks.workunit.client.1.smithi129.stdout:0/243: read - de/d15/f3b zero size 2024-09-21T08:02:28.985 INFO:tasks.workunit.client.1.smithi129.stdout:0/244: chown de/d15/f18 131612914 1 2024-09-21T08:02:28.985 INFO:tasks.workunit.client.1.smithi129.stdout:7/293: rmdir d0/d1e/d66 0 2024-09-21T08:02:28.990 INFO:tasks.workunit.client.1.smithi129.stdout:6/212: read d7/d1b/d25/f31 [2197619,94269] 0 2024-09-21T08:02:28.990 INFO:tasks.workunit.client.1.smithi129.stdout:6/213: stat d7/d1b/f49 0 2024-09-21T08:02:28.993 INFO:tasks.workunit.client.1.smithi129.stdout:3/270: write d3/da/dc/f23 [4103576,65644] 0 2024-09-21T08:02:28.993 INFO:tasks.workunit.client.1.smithi129.stdout:3/271: fdatasync d3/da/f49 0 2024-09-21T08:02:28.994 INFO:tasks.workunit.client.1.smithi129.stdout:2/434: dwrite d1/dc/d19/d4c/f67 [0,4194304] 0 2024-09-21T08:02:28.995 INFO:tasks.workunit.client.1.smithi129.stdout:6/214: unlink d7/d1b/d25/f31 0 2024-09-21T08:02:28.997 INFO:tasks.workunit.client.1.smithi129.stdout:0/245: getdents de/d15 0 2024-09-21T08:02:28.999 INFO:tasks.workunit.client.1.smithi129.stdout:3/272: link d3/da/dc/d25/c35 d3/da/dc/c58 0 2024-09-21T08:02:28.999 INFO:tasks.workunit.client.1.smithi129.stdout:3/273: read - d3/da/dc/d11/d2f/f56 zero size 2024-09-21T08:02:29.015 INFO:tasks.workunit.client.1.smithi129.stdout:4/218: dwrite d5/d6/f30 [0,4194304] 0 2024-09-21T08:02:29.021 INFO:tasks.workunit.client.1.smithi129.stdout:4/219: write d5/f14 [207161,9254] 0 2024-09-21T08:02:29.028 INFO:tasks.workunit.client.1.smithi129.stdout:4/220: dread d5/d6/f2d [0,4194304] 0 2024-09-21T08:02:29.095 INFO:tasks.workunit.client.1.smithi129.stdout:9/254: dwrite f0 [0,4194304] 0 2024-09-21T08:02:29.100 INFO:tasks.workunit.client.1.smithi129.stdout:7/294: getdents d0/d1e 0 2024-09-21T08:02:29.101 INFO:tasks.workunit.client.1.smithi129.stdout:5/298: dwrite d2/d1e/d35/f12 [4194304,4194304] 0 2024-09-21T08:02:29.102 INFO:tasks.workunit.client.1.smithi129.stdout:6/215: dwrite d7/d10/f14 [0,4194304] 0 2024-09-21T08:02:29.102 INFO:tasks.workunit.client.1.smithi129.stdout:6/216: write d7/d10/f15 [4154988,80823] 0 2024-09-21T08:02:29.102 INFO:tasks.workunit.client.1.smithi129.stdout:6/217: write d7/d1b/d1e/d39/d4b/f4d [410906,130219] 0 2024-09-21T08:02:29.103 INFO:tasks.workunit.client.1.smithi129.stdout:2/435: creat d1/d13/d3a/d47/d5f/fa4 x:0 0 0 2024-09-21T08:02:29.103 INFO:tasks.workunit.client.1.smithi129.stdout:2/436: dread - d1/dc/d26/d45/f46 zero size 2024-09-21T08:02:29.103 INFO:tasks.workunit.client.1.smithi129.stdout:2/437: read - d1/d13/fa1 zero size 2024-09-21T08:02:29.106 INFO:tasks.workunit.client.1.smithi129.stdout:0/246: link de/d22/d27/d2f/f3e de/d19/f46 0 2024-09-21T08:02:29.106 INFO:tasks.workunit.client.1.smithi129.stdout:0/247: read - de/d15/f3b zero size 2024-09-21T08:02:29.106 INFO:tasks.workunit.client.1.smithi129.stdout:0/248: stat de/d22/d27/d2f/d42 0 2024-09-21T08:02:29.109 INFO:tasks.workunit.client.1.smithi129.stdout:4/221: unlink d5/d6/ld 0 2024-09-21T08:02:29.111 INFO:tasks.workunit.client.1.smithi129.stdout:7/295: dread d0/f17 [0,4194304] 0 2024-09-21T08:02:29.111 INFO:tasks.workunit.client.1.smithi129.stdout:7/296: readlink d0/d1e/l2b 0 2024-09-21T08:02:29.111 INFO:tasks.workunit.client.1.smithi129.stdout:7/297: chown d0/d1e/l2b 1972296171 1 2024-09-21T08:02:29.111 INFO:tasks.workunit.client.1.smithi129.stdout:7/298: stat d0/c1a 0 2024-09-21T08:02:29.112 INFO:tasks.workunit.client.1.smithi129.stdout:2/438: creat d1/d13/d32/d97/fa5 x:0 0 0 2024-09-21T08:02:29.112 INFO:tasks.workunit.client.1.smithi129.stdout:2/439: creat d1/d13/d3a/d47/d1f/d85/fa6 x:0 0 0 2024-09-21T08:02:29.112 INFO:tasks.workunit.client.1.smithi129.stdout:2/440: stat d1/dc/d26/d45 0 2024-09-21T08:02:29.113 INFO:tasks.workunit.client.1.smithi129.stdout:0/249: symlink de/d22/l47 0 2024-09-21T08:02:29.114 INFO:tasks.workunit.client.1.smithi129.stdout:4/222: creat d5/d33/f4d x:0 0 0 2024-09-21T08:02:29.120 INFO:tasks.workunit.client.1.smithi129.stdout:9/255: dwrite d17/d2c/d31/d35/f50 [0,4194304] 0 2024-09-21T08:02:29.120 INFO:tasks.workunit.client.1.smithi129.stdout:9/256: truncate d17/d2c/d31/f5c 796760 0 2024-09-21T08:02:29.122 INFO:tasks.workunit.client.1.smithi129.stdout:0/250: creat de/d15/d44/f48 x:0 0 0 2024-09-21T08:02:29.124 INFO:tasks.workunit.client.1.smithi129.stdout:9/257: mknod d17/d23/c5d 0 2024-09-21T08:02:29.125 INFO:tasks.workunit.client.1.smithi129.stdout:9/258: getdents d17 0 2024-09-21T08:02:29.126 INFO:tasks.workunit.client.1.smithi129.stdout:4/223: dread d5/d16/f1f [0,4194304] 0 2024-09-21T08:02:29.126 INFO:tasks.workunit.client.1.smithi129.stdout:9/259: mkdir d17/d2c/d31/d5e 0 2024-09-21T08:02:29.126 INFO:tasks.workunit.client.1.smithi129.stdout:4/224: truncate d5/d16/d24/f27 527298 0 2024-09-21T08:02:29.127 INFO:tasks.workunit.client.1.smithi129.stdout:9/260: creat d17/d46/f5f x:0 0 0 2024-09-21T08:02:29.128 INFO:tasks.workunit.client.1.smithi129.stdout:9/261: chown d17/d22/d33/d36/c59 28316127 1 2024-09-21T08:02:29.133 INFO:tasks.workunit.client.1.smithi129.stdout:3/274: dwrite d3/da/dc/f23 [4194304,4194304] 0 2024-09-21T08:02:29.170 INFO:tasks.workunit.client.1.smithi129.stdout:4/225: dread d5/d6/f7 [0,4194304] 0 2024-09-21T08:02:29.171 INFO:tasks.workunit.client.1.smithi129.stdout:4/226: readlink l3 0 2024-09-21T08:02:29.171 INFO:tasks.workunit.client.1.smithi129.stdout:6/218: dwrite d7/f37 [4194304,4194304] 0 2024-09-21T08:02:29.172 INFO:tasks.workunit.client.1.smithi129.stdout:6/219: creat d7/d1b/d25/d2b/d3e/f4e x:0 0 0 2024-09-21T08:02:29.173 INFO:tasks.workunit.client.1.smithi129.stdout:6/220: mkdir d7/d1b/d25/d2b/d4f 0 2024-09-21T08:02:29.175 INFO:tasks.workunit.client.1.smithi129.stdout:6/221: getdents d7/d1b/d25/d35/d40/d41 0 2024-09-21T08:02:29.175 INFO:tasks.workunit.client.1.smithi129.stdout:9/262: dread d17/d2c/d31/f5a [0,4194304] 0 2024-09-21T08:02:29.175 INFO:tasks.workunit.client.1.smithi129.stdout:9/263: write d17/d22/f30 [50478,42861] 0 2024-09-21T08:02:29.175 INFO:tasks.workunit.client.1.smithi129.stdout:9/264: write f16 [2546965,67631] 0 2024-09-21T08:02:29.176 INFO:tasks.workunit.client.1.smithi129.stdout:9/265: stat d17/d23/c25 0 2024-09-21T08:02:29.187 INFO:tasks.workunit.client.1.smithi129.stdout:2/441: dwrite d1/dc/d26/f42 [0,4194304] 0 2024-09-21T08:02:29.187 INFO:tasks.workunit.client.1.smithi129.stdout:3/275: dwrite d3/da/dc/f23 [4194304,4194304] 0 2024-09-21T08:02:29.187 INFO:tasks.workunit.client.1.smithi129.stdout:2/442: readlink d1/d13/d32/l4b 0 2024-09-21T08:02:29.187 INFO:tasks.workunit.client.1.smithi129.stdout:0/251: dwrite de/d15/f28 [0,4194304] 0 2024-09-21T08:02:29.188 INFO:tasks.workunit.client.1.smithi129.stdout:0/252: write de/d15/f18 [413887,124736] 0 2024-09-21T08:02:29.189 INFO:tasks.workunit.client.1.smithi129.stdout:9/266: dread f0 [0,4194304] 0 2024-09-21T08:02:29.189 INFO:tasks.workunit.client.1.smithi129.stdout:9/267: truncate d17/d2c/f43 924288 0 2024-09-21T08:02:29.189 INFO:tasks.workunit.client.1.smithi129.stdout:9/268: truncate d17/d22/f30 457509 0 2024-09-21T08:02:29.191 INFO:tasks.workunit.client.1.smithi129.stdout:2/443: mkdir d1/d13/d32/d97/da7 0 2024-09-21T08:02:29.191 INFO:tasks.workunit.client.1.smithi129.stdout:2/444: creat d1/dc/d26/d45/d65/fa8 x:0 0 0 2024-09-21T08:02:29.191 INFO:tasks.workunit.client.1.smithi129.stdout:2/445: write d1/dc/d19/d4c/d6a/f60 [191926,68656] 0 2024-09-21T08:02:29.191 INFO:tasks.workunit.client.1.smithi129.stdout:0/253: mknod de/d22/d27/d2f/c49 0 2024-09-21T08:02:29.191 INFO:tasks.workunit.client.1.smithi129.stdout:0/254: fsync f0 0 2024-09-21T08:02:29.193 INFO:tasks.workunit.client.1.smithi129.stdout:2/446: symlink d1/la9 0 2024-09-21T08:02:29.193 INFO:tasks.workunit.client.1.smithi129.stdout:8/197: sync 2024-09-21T08:02:29.193 INFO:tasks.workunit.client.1.smithi129.stdout:6/222: dwrite d7/d1b/f49 [0,4194304] 0 2024-09-21T08:02:29.195 INFO:tasks.workunit.client.1.smithi129.stdout:0/255: link de/d15/d44/f48 de/d15/d39/f4a 0 2024-09-21T08:02:29.195 INFO:tasks.workunit.client.1.smithi129.stdout:0/256: readlink de/l10 0 2024-09-21T08:02:29.197 INFO:tasks.workunit.client.1.smithi129.stdout:2/447: mknod d1/d53/d77/d8b/caa 0 2024-09-21T08:02:29.197 INFO:tasks.workunit.client.1.smithi129.stdout:2/448: chown d1/d53/d77/f79 93260 1 2024-09-21T08:02:29.198 INFO:tasks.workunit.client.1.smithi129.stdout:6/223: truncate d7/fe 4064109 0 2024-09-21T08:02:29.199 INFO:tasks.workunit.client.1.smithi129.stdout:6/224: symlink d7/d1b/d25/d35/d40/l50 0 2024-09-21T08:02:29.201 INFO:tasks.workunit.client.1.smithi129.stdout:6/225: symlink d7/d1b/d1e/d39/d4b/l51 0 2024-09-21T08:02:29.202 INFO:tasks.workunit.client.1.smithi129.stdout:6/226: rmdir d7/d1b/d1e/d39/d4b 39 2024-09-21T08:02:29.204 INFO:tasks.workunit.client.1.smithi129.stdout:6/227: mknod d7/d1b/d1e/d39/d4b/c52 0 2024-09-21T08:02:29.204 INFO:tasks.workunit.client.1.smithi129.stdout:6/228: readlink d7/d1b/l42 0 2024-09-21T08:02:29.208 INFO:tasks.workunit.client.1.smithi129.stdout:2/449: dread d1/d13/d3a/d47/d1f/f2a [0,4194304] 0 2024-09-21T08:02:29.212 INFO:tasks.workunit.client.1.smithi129.stdout:2/450: dread - d1/dc/f6c zero size 2024-09-21T08:02:29.214 INFO:tasks.workunit.client.1.smithi129.stdout:3/276: dwrite d3/da/dc/d11/d2f/f4f [0,4194304] 0 2024-09-21T08:02:29.221 INFO:tasks.workunit.client.1.smithi129.stdout:3/277: creat d3/da/dc/d11/d55/f59 x:0 0 0 2024-09-21T08:02:29.242 INFO:tasks.workunit.client.1.smithi129.stdout:8/198: dwrite d0/d6/d7/d18/d27/f2d [4194304,4194304] 0 2024-09-21T08:02:29.242 INFO:tasks.workunit.client.1.smithi129.stdout:8/199: creat d0/d6/d7/d18/d27/f39 x:0 0 0 2024-09-21T08:02:29.243 INFO:tasks.workunit.client.1.smithi129.stdout:9/269: dwrite d17/d22/d33/d36/d48/d3f/f57 [0,4194304] 0 2024-09-21T08:02:29.243 INFO:tasks.workunit.client.1.smithi129.stdout:0/257: dwrite de/d22/d27/d2f/f3e [0,4194304] 0 2024-09-21T08:02:29.244 INFO:tasks.workunit.client.1.smithi129.stdout:6/229: dwrite f4 [0,4194304] 0 2024-09-21T08:02:29.244 INFO:tasks.workunit.client.1.smithi129.stdout:2/451: dwrite d1/d13/d32/f55 [0,4194304] 0 2024-09-21T08:02:29.244 INFO:tasks.workunit.client.1.smithi129.stdout:8/200: mkdir d0/d6/d7/d3a 0 2024-09-21T08:02:29.246 INFO:tasks.workunit.client.1.smithi129.stdout:0/258: mkdir de/d15/d44/d4b 0 2024-09-21T08:02:29.246 INFO:tasks.workunit.client.1.smithi129.stdout:6/230: stat d7/d10/f22 0 2024-09-21T08:02:29.251 INFO:tasks.workunit.client.1.smithi129.stdout:2/452: creat d1/dc/d26/d45/d65/d93/fab x:0 0 0 2024-09-21T08:02:29.252 INFO:tasks.workunit.client.1.smithi129.stdout:8/201: symlink d0/d6/d7/d9/l3b 0 2024-09-21T08:02:29.254 INFO:tasks.workunit.client.1.smithi129.stdout:9/270: mkdir d17/d60 0 2024-09-21T08:02:29.254 INFO:tasks.workunit.client.1.smithi129.stdout:9/271: fsync d17/d2c/d31/f56 0 2024-09-21T08:02:29.255 INFO:tasks.workunit.client.1.smithi129.stdout:9/272: write d17/d46/f4f [56529,7020] 0 2024-09-21T08:02:29.255 INFO:tasks.workunit.client.1.smithi129.stdout:9/273: dread - d17/d46/f5f zero size 2024-09-21T08:02:29.257 INFO:tasks.workunit.client.1.smithi129.stdout:2/453: getdents d1/d13/d32/d7c 0 2024-09-21T08:02:29.258 INFO:tasks.workunit.client.1.smithi129.stdout:9/274: creat d17/f61 x:0 0 0 2024-09-21T08:02:29.259 INFO:tasks.workunit.client.1.smithi129.stdout:2/454: mkdir d1/d13/d3a/d47/dac 0 2024-09-21T08:02:29.260 INFO:tasks.workunit.client.1.smithi129.stdout:2/455: read d1/dc/d19/d4c/f5b [1032134,40474] 0 2024-09-21T08:02:29.260 INFO:tasks.workunit.client.1.smithi129.stdout:6/231: dread d7/d10/f16 [0,4194304] 0 2024-09-21T08:02:29.261 INFO:tasks.workunit.client.1.smithi129.stdout:2/456: rename d1/dc/d19/l75 to d1/d53/d77/lad 0 2024-09-21T08:02:29.261 INFO:tasks.workunit.client.1.smithi129.stdout:2/457: fsync d1/d13/d32/f55 0 2024-09-21T08:02:29.262 INFO:tasks.workunit.client.1.smithi129.stdout:6/232: creat d7/f53 x:0 0 0 2024-09-21T08:02:29.262 INFO:tasks.workunit.client.1.smithi129.stdout:6/233: rename d7 to d7/d1b/d25/d35/d40/d41/d54 22 2024-09-21T08:02:29.263 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:28 smithi107 ceph-mon[27622]: pgmap v6: 65 pgs: 65 active+clean; 389 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 35 MiB/s rd, 43 MiB/s wr, 42 op/s 2024-09-21T08:02:29.263 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:28 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mgr metadata", "who": "smithi107.wzulxb", "id": "smithi107.wzulxb"}]: dispatch 2024-09-21T08:02:29.263 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:28 smithi107 ceph-mon[27622]: mgrmap e25: smithi129.wvlmvo(active, since 6s), standbys: smithi107.wzulxb 2024-09-21T08:02:29.264 INFO:tasks.workunit.client.1.smithi129.stdout:6/234: mknod d7/d1b/d25/d35/c55 0 2024-09-21T08:02:29.265 INFO:tasks.workunit.client.1.smithi129.stdout:6/235: truncate d7/f9 5004891 0 2024-09-21T08:02:29.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:28 smithi129 ceph-mon[34472]: pgmap v6: 65 pgs: 65 active+clean; 389 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 35 MiB/s rd, 43 MiB/s wr, 42 op/s 2024-09-21T08:02:29.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:28 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mgr metadata", "who": "smithi107.wzulxb", "id": "smithi107.wzulxb"}]: dispatch 2024-09-21T08:02:29.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:28 smithi129 ceph-mon[34472]: mgrmap e25: smithi129.wvlmvo(active, since 6s), standbys: smithi107.wzulxb 2024-09-21T08:02:29.267 INFO:tasks.workunit.client.1.smithi129.stdout:2/458: dread d1/dc/d26/d45/f7b [0,4194304] 0 2024-09-21T08:02:29.267 INFO:tasks.workunit.client.1.smithi129.stdout:2/459: write d1/dc/d26/d45/d65/d50/f5d [436155,63343] 0 2024-09-21T08:02:29.267 INFO:tasks.workunit.client.1.smithi129.stdout:2/460: stat d1/d53/d77/d8b/caa 0 2024-09-21T08:02:29.268 INFO:tasks.workunit.client.1.smithi129.stdout:6/236: symlink d7/d4a/l56 0 2024-09-21T08:02:29.269 INFO:tasks.workunit.client.1.smithi129.stdout:0/259: dwrite de/f13 [0,4194304] 0 2024-09-21T08:02:29.270 INFO:tasks.workunit.client.1.smithi129.stdout:0/260: dread - de/d15/f43 zero size 2024-09-21T08:02:29.270 INFO:tasks.workunit.client.1.smithi129.stdout:6/237: mkdir d7/d1b/d57 0 2024-09-21T08:02:29.270 INFO:tasks.workunit.client.1.smithi129.stdout:6/238: write d7/fe [1928273,125894] 0 2024-09-21T08:02:29.271 INFO:tasks.workunit.client.1.smithi129.stdout:1/305: sync 2024-09-21T08:02:29.271 INFO:tasks.workunit.client.1.smithi129.stdout:1/306: write d1/d4/f5d [356303,130571] 0 2024-09-21T08:02:29.274 INFO:tasks.workunit.client.1.smithi129.stdout:1/307: rename d1/f4c to d1/d16/f71 0 2024-09-21T08:02:29.274 INFO:tasks.workunit.client.1.smithi129.stdout:1/308: write d1/f39 [777041,89380] 0 2024-09-21T08:02:29.275 INFO:tasks.workunit.client.1.smithi129.stdout:0/261: getdents de/d15/d44 0 2024-09-21T08:02:29.275 INFO:tasks.workunit.client.1.smithi129.stdout:6/239: write d7/d10/f16 [680664,34957] 0 2024-09-21T08:02:29.276 INFO:tasks.workunit.client.1.smithi129.stdout:0/262: rename de/f17 to de/d22/d27/f4c 0 2024-09-21T08:02:29.276 INFO:tasks.workunit.client.1.smithi129.stdout:0/263: fsync f6 0 2024-09-21T08:02:29.277 INFO:tasks.workunit.client.1.smithi129.stdout:6/240: mknod d7/d10/c58 0 2024-09-21T08:02:29.277 INFO:tasks.workunit.client.1.smithi129.stdout:0/264: symlink de/d22/d27/d2f/l4d 0 2024-09-21T08:02:29.278 INFO:tasks.workunit.client.1.smithi129.stdout:0/265: dread - de/d15/f3b zero size 2024-09-21T08:02:29.278 INFO:tasks.workunit.client.1.smithi129.stdout:0/266: stat de/d22/d27/f4c 0 2024-09-21T08:02:29.278 INFO:tasks.workunit.client.1.smithi129.stdout:0/267: creat de/d19/f4e x:0 0 0 2024-09-21T08:02:29.286 INFO:tasks.workunit.client.1.smithi129.stdout:8/202: dwrite d0/d6/d7/f15 [0,4194304] 0 2024-09-21T08:02:29.287 INFO:tasks.workunit.client.1.smithi129.stdout:8/203: unlink d0/c20 0 2024-09-21T08:02:29.288 INFO:tasks.workunit.client.1.smithi129.stdout:8/204: creat d0/d6/d7/d18/d27/f3c x:0 0 0 2024-09-21T08:02:29.288 INFO:tasks.workunit.client.1.smithi129.stdout:8/205: write d0/f16 [2381472,66523] 0 2024-09-21T08:02:29.290 INFO:tasks.workunit.client.1.smithi129.stdout:9/275: dwrite d17/d2c/d31/f51 [0,4194304] 0 2024-09-21T08:02:29.294 INFO:tasks.workunit.client.1.smithi129.stdout:8/206: mkdir d0/d6/d7/d18/d27/d32/d3d 0 2024-09-21T08:02:29.298 INFO:tasks.workunit.client.1.smithi129.stdout:9/276: rmdir d17/d22/d33/d36/d48/d3f 39 2024-09-21T08:02:29.299 INFO:tasks.workunit.client.1.smithi129.stdout:2/461: dwrite d1/dc/d19/d4c/d6a/f82 [0,4194304] 0 2024-09-21T08:02:29.299 INFO:tasks.workunit.client.1.smithi129.stdout:2/462: stat d1/ca0 0 2024-09-21T08:02:29.307 INFO:tasks.workunit.client.1.smithi129.stdout:1/309: dwrite d1/f50 [0,4194304] 0 2024-09-21T08:02:29.307 INFO:tasks.workunit.client.1.smithi129.stdout:1/310: write d1/d9/d31/f68 [934108,54813] 0 2024-09-21T08:02:29.308 INFO:tasks.workunit.client.1.smithi129.stdout:2/463: write d1/dc/d26/f81 [638358,99414] 0 2024-09-21T08:02:29.308 INFO:tasks.workunit.client.1.smithi129.stdout:2/464: chown d1/d53/l80 5 1 2024-09-21T08:02:29.308 INFO:tasks.workunit.client.1.smithi129.stdout:2/465: write d1/dc/d26/f33 [3247586,52769] 0 2024-09-21T08:02:29.308 INFO:tasks.workunit.client.1.smithi129.stdout:2/466: creat d1/dc/d26/d45/d65/d93/fae x:0 0 0 2024-09-21T08:02:29.309 INFO:tasks.workunit.client.1.smithi129.stdout:1/311: mknod d1/d16/d28/c72 0 2024-09-21T08:02:29.313 INFO:tasks.workunit.client.1.smithi129.stdout:2/467: rmdir d1/d13/d3a/d47/d5f 39 2024-09-21T08:02:29.314 INFO:tasks.workunit.client.1.smithi129.stdout:1/312: getdents d1/d9 0 2024-09-21T08:02:29.314 INFO:tasks.workunit.client.1.smithi129.stdout:1/313: chown d1/d9/f3d 8355430 1 2024-09-21T08:02:29.315 INFO:tasks.workunit.client.1.smithi129.stdout:2/468: creat d1/d13/d32/d97/da7/faf x:0 0 0 2024-09-21T08:02:29.315 INFO:tasks.workunit.client.1.smithi129.stdout:2/469: write d1/d13/d32/d7c/f8e [672655,24897] 0 2024-09-21T08:02:29.316 INFO:tasks.workunit.client.1.smithi129.stdout:1/314: mkdir d1/d16/d25/d73 0 2024-09-21T08:02:29.316 INFO:tasks.workunit.client.1.smithi129.stdout:1/315: chown d1/d9 6490 1 2024-09-21T08:02:29.316 INFO:tasks.workunit.client.1.smithi129.stdout:1/316: write d1/d9/d31/f5e [183454,6439] 0 2024-09-21T08:02:29.317 INFO:tasks.workunit.client.1.smithi129.stdout:2/470: unlink d1/dc/d26/d45/d65/d50/f71 0 2024-09-21T08:02:29.317 INFO:tasks.workunit.client.1.smithi129.stdout:8/207: dread d0/f16 [0,4194304] 0 2024-09-21T08:02:29.317 INFO:tasks.workunit.client.1.smithi129.stdout:1/317: creat d1/d4/d6e/f74 x:0 0 0 2024-09-21T08:02:29.318 INFO:tasks.workunit.client.1.smithi129.stdout:1/318: chown d1/d16/d57 365627 1 2024-09-21T08:02:29.318 INFO:tasks.workunit.client.1.smithi129.stdout:2/471: creat d1/d53/d77/d8b/fb0 x:0 0 0 2024-09-21T08:02:29.319 INFO:tasks.workunit.client.1.smithi129.stdout:1/319: truncate d1/f3 6190481 0 2024-09-21T08:02:29.321 INFO:tasks.workunit.client.1.smithi129.stdout:6/241: dwrite d7/d1b/d1e/f36 [0,4194304] 0 2024-09-21T08:02:29.321 INFO:tasks.workunit.client.1.smithi129.stdout:6/242: write d7/f9 [581884,57278] 0 2024-09-21T08:02:29.322 INFO:tasks.workunit.client.1.smithi129.stdout:6/243: read d7/fa [3503263,120842] 0 2024-09-21T08:02:29.322 INFO:tasks.workunit.client.1.smithi129.stdout:6/244: symlink d7/d1b/d25/d35/l59 0 2024-09-21T08:02:29.324 INFO:tasks.workunit.client.1.smithi129.stdout:8/208: dread d0/f16 [0,4194304] 0 2024-09-21T08:02:29.324 INFO:tasks.workunit.client.1.smithi129.stdout:2/472: rmdir d1/d13/d32 39 2024-09-21T08:02:29.324 INFO:tasks.workunit.client.1.smithi129.stdout:9/277: dwrite d17/f19 [0,4194304] 0 2024-09-21T08:02:29.325 INFO:tasks.workunit.client.1.smithi129.stdout:8/209: mknod d0/d6/c3e 0 2024-09-21T08:02:29.325 INFO:tasks.workunit.client.1.smithi129.stdout:8/210: truncate d0/d6/d7/d9/f2a 4857755 0 2024-09-21T08:02:29.326 INFO:tasks.workunit.client.1.smithi129.stdout:1/320: getdents d1/d4/d6e 0 2024-09-21T08:02:29.328 INFO:tasks.workunit.client.1.smithi129.stdout:6/245: write f5 [3069885,11959] 0 2024-09-21T08:02:29.330 INFO:tasks.workunit.client.1.smithi129.stdout:2/473: symlink d1/dc/d19/d4c/lb1 0 2024-09-21T08:02:29.333 INFO:tasks.workunit.client.1.smithi129.stdout:8/211: rename d0/d6/d7/d18/f26 to d0/f3f 0 2024-09-21T08:02:29.333 INFO:tasks.workunit.client.1.smithi129.stdout:8/212: creat d0/d6/d7/f40 x:0 0 0 2024-09-21T08:02:29.333 INFO:tasks.workunit.client.1.smithi129.stdout:1/321: rename d1/d44/c69 to d1/d44/c75 0 2024-09-21T08:02:29.335 INFO:tasks.workunit.client.1.smithi129.stdout:9/278: creat d17/d55/f62 x:0 0 0 2024-09-21T08:02:29.335 INFO:tasks.workunit.client.1.smithi129.stdout:9/279: chown d17/d2c/d31/f51 98131 1 2024-09-21T08:02:29.336 INFO:tasks.workunit.client.1.smithi129.stdout:8/213: mknod d0/d6/d7/d18/d27/d32/c41 0 2024-09-21T08:02:29.338 INFO:tasks.workunit.client.1.smithi129.stdout:1/322: symlink d1/d64/l76 0 2024-09-21T08:02:29.339 INFO:tasks.workunit.client.1.smithi129.stdout:6/246: rmdir d7/d10 39 2024-09-21T08:02:29.339 INFO:tasks.workunit.client.1.smithi129.stdout:6/247: fdatasync d7/d1b/d25/d2b/d3e/f4e 0 2024-09-21T08:02:29.341 INFO:tasks.workunit.client.1.smithi129.stdout:5/299: sync 2024-09-21T08:02:29.343 INFO:tasks.workunit.client.1.smithi129.stdout:6/248: symlink d7/d1b/d25/d35/d40/l5a 0 2024-09-21T08:02:29.343 INFO:tasks.workunit.client.1.smithi129.stdout:6/249: write d7/f9 [5910858,105943] 0 2024-09-21T08:02:29.343 INFO:tasks.workunit.client.1.smithi129.stdout:6/250: fdatasync d7/d1b/d25/f2e 0 2024-09-21T08:02:29.343 INFO:tasks.workunit.client.1.smithi129.stdout:6/251: write d7/fa [9306814,97836] 0 2024-09-21T08:02:29.344 INFO:tasks.workunit.client.1.smithi129.stdout:9/280: rmdir d17/d2c/d31 39 2024-09-21T08:02:29.344 INFO:tasks.workunit.client.1.smithi129.stdout:8/214: write d0/d6/f28 [2095739,55774] 0 2024-09-21T08:02:29.345 INFO:tasks.workunit.client.1.smithi129.stdout:5/300: rename d2/f19 to d2/d1e/f56 0 2024-09-21T08:02:29.345 INFO:tasks.workunit.client.1.smithi129.stdout:5/301: write d2/d1e/d35/d37/f47 [560155,100778] 0 2024-09-21T08:02:29.346 INFO:tasks.workunit.client.1.smithi129.stdout:1/323: rmdir d1/d4 39 2024-09-21T08:02:29.348 INFO:tasks.workunit.client.1.smithi129.stdout:9/281: truncate d17/d2c/d31/f5c 86386 0 2024-09-21T08:02:29.351 INFO:tasks.workunit.client.1.smithi129.stdout:8/215: unlink d0/d6/c3e 0 2024-09-21T08:02:29.351 INFO:tasks.workunit.client.1.smithi129.stdout:8/216: fdatasync d0/d6/d7/d9/f2a 0 2024-09-21T08:02:29.352 INFO:tasks.workunit.client.1.smithi129.stdout:8/217: fsync d0/d6/d7/d9/f12 0 2024-09-21T08:02:29.352 INFO:tasks.workunit.client.1.smithi129.stdout:8/218: write d0/f11 [611786,112451] 0 2024-09-21T08:02:29.352 INFO:tasks.workunit.client.1.smithi129.stdout:8/219: chown d0/d6/d7/d18 14862769 1 2024-09-21T08:02:29.352 INFO:tasks.workunit.client.1.smithi129.stdout:4/227: sync 2024-09-21T08:02:29.352 INFO:tasks.workunit.client.1.smithi129.stdout:7/299: sync 2024-09-21T08:02:29.352 INFO:tasks.workunit.client.1.smithi129.stdout:5/302: mknod d2/d2a/d50/c57 0 2024-09-21T08:02:29.352 INFO:tasks.workunit.client.1.smithi129.stdout:5/303: write d2/d1e/d35/d33/d36/f42 [449765,39752] 0 2024-09-21T08:02:29.353 INFO:tasks.workunit.client.1.smithi129.stdout:3/278: sync 2024-09-21T08:02:29.353 INFO:tasks.workunit.client.1.smithi129.stdout:3/279: read - d3/da/dc/d11/d2f/f40 zero size 2024-09-21T08:02:29.353 INFO:tasks.workunit.client.1.smithi129.stdout:1/324: creat d1/d44/f77 x:0 0 0 2024-09-21T08:02:29.353 INFO:tasks.workunit.client.1.smithi129.stdout:3/280: truncate d3/da/dc/d11/d2f/d27/f36 2740896 0 2024-09-21T08:02:29.354 INFO:tasks.workunit.client.1.smithi129.stdout:8/220: creat d0/d6/d7/d18/d27/d32/d37/f42 x:0 0 0 2024-09-21T08:02:29.355 INFO:tasks.workunit.client.1.smithi129.stdout:8/221: chown d0/d6/d7/d18/d27/f38 11072 1 2024-09-21T08:02:29.355 INFO:tasks.workunit.client.1.smithi129.stdout:8/222: readlink d0/d6/l1b 0 2024-09-21T08:02:29.356 INFO:tasks.workunit.client.1.smithi129.stdout:8/223: rename d0/d6/d7/l2f to d0/d6/d7/d9/l43 0 2024-09-21T08:02:29.365 INFO:tasks.workunit.client.1.smithi129.stdout:4/228: dread d5/d11/f45 [0,4194304] 0 2024-09-21T08:02:29.366 INFO:tasks.workunit.client.1.smithi129.stdout:4/229: truncate d5/d16/f1f 1600343 0 2024-09-21T08:02:29.366 INFO:tasks.workunit.client.1.smithi129.stdout:4/230: chown d5/f3c 12001 1 2024-09-21T08:02:29.368 INFO:tasks.workunit.client.1.smithi129.stdout:7/300: write d0/d1e/f21 [1482240,52967] 0 2024-09-21T08:02:29.368 INFO:tasks.workunit.client.1.smithi129.stdout:7/301: mknod d0/d46/d56/c67 0 2024-09-21T08:02:29.370 INFO:tasks.workunit.client.1.smithi129.stdout:7/302: unlink d0/d1e/l2b 0 2024-09-21T08:02:29.371 INFO:tasks.workunit.client.1.smithi129.stdout:7/303: write d0/f16 [3090375,128595] 0 2024-09-21T08:02:29.371 INFO:tasks.workunit.client.1.smithi129.stdout:7/304: write d0/d1e/f55 [2082998,884] 0 2024-09-21T08:02:29.371 INFO:tasks.workunit.client.1.smithi129.stdout:7/305: truncate d0/d46/d56/f5c 1038779 0 2024-09-21T08:02:29.371 INFO:tasks.workunit.client.1.smithi129.stdout:7/306: chown d0/f41 6645 1 2024-09-21T08:02:29.374 INFO:tasks.workunit.client.1.smithi129.stdout:3/281: write d3/da/f2e [2838091,123530] 0 2024-09-21T08:02:29.375 INFO:tasks.workunit.client.1.smithi129.stdout:3/282: mkdir d3/d5a 0 2024-09-21T08:02:29.376 INFO:tasks.workunit.client.1.smithi129.stdout:6/252: dwrite d7/fa [0,4194304] 0 2024-09-21T08:02:29.378 INFO:tasks.workunit.client.1.smithi129.stdout:3/283: link d3/da/l53 d3/da/dc/d25/l5b 0 2024-09-21T08:02:29.381 INFO:tasks.workunit.client.1.smithi129.stdout:5/304: dwrite d2/f1a [0,4194304] 0 2024-09-21T08:02:29.381 INFO:tasks.workunit.client.1.smithi129.stdout:5/305: write d2/d1e/d35/f2d [2380331,48600] 0 2024-09-21T08:02:29.381 INFO:tasks.workunit.client.1.smithi129.stdout:1/325: dwrite d1/d9/f3d [0,4194304] 0 2024-09-21T08:02:29.385 INFO:tasks.workunit.client.1.smithi129.stdout:4/231: write d5/d16/f1f [2235984,74642] 0 2024-09-21T08:02:29.388 INFO:tasks.workunit.client.1.smithi129.stdout:7/307: dread d0/d1e/f36 [0,4194304] 0 2024-09-21T08:02:29.388 INFO:tasks.workunit.client.1.smithi129.stdout:7/308: write d0/f59 [752903,65269] 0 2024-09-21T08:02:29.388 INFO:tasks.workunit.client.1.smithi129.stdout:7/309: fdatasync d0/f5e 0 2024-09-21T08:02:29.391 INFO:tasks.workunit.client.1.smithi129.stdout:5/306: symlink d2/d2a/l58 0 2024-09-21T08:02:29.391 INFO:tasks.workunit.client.1.smithi129.stdout:4/232: mkdir d5/d33/d4e 0 2024-09-21T08:02:29.391 INFO:tasks.workunit.client.1.smithi129.stdout:4/233: chown d5/d11/c40 10946791 1 2024-09-21T08:02:29.391 INFO:tasks.workunit.client.1.smithi129.stdout:4/234: write d5/d16/f1f [6264,113221] 0 2024-09-21T08:02:29.392 INFO:tasks.workunit.client.1.smithi129.stdout:8/224: dwrite d0/d6/d7/d18/d27/d32/d37/f42 [0,4194304] 0 2024-09-21T08:02:29.393 INFO:tasks.workunit.client.1.smithi129.stdout:1/326: getdents d1/d64 0 2024-09-21T08:02:29.393 INFO:tasks.workunit.client.1.smithi129.stdout:7/310: truncate d0/f1f 1911522 0 2024-09-21T08:02:29.393 INFO:tasks.workunit.client.1.smithi129.stdout:7/311: fsync d0/f43 0 2024-09-21T08:02:29.393 INFO:tasks.workunit.client.1.smithi129.stdout:1/327: write d1/d16/f2a [288723,57478] 0 2024-09-21T08:02:29.394 INFO:tasks.workunit.client.1.smithi129.stdout:5/307: creat d2/d1e/d35/d33/d36/f59 x:0 0 0 2024-09-21T08:02:29.394 INFO:tasks.workunit.client.1.smithi129.stdout:5/308: truncate d2/d2a/f2e 733444 0 2024-09-21T08:02:29.395 INFO:tasks.workunit.client.1.smithi129.stdout:7/312: dread d0/f26 [0,4194304] 0 2024-09-21T08:02:29.396 INFO:tasks.workunit.client.1.smithi129.stdout:4/235: truncate d5/d6/f7 697484 0 2024-09-21T08:02:29.397 INFO:tasks.workunit.client.1.smithi129.stdout:8/225: link d0/d6/c1d d0/d6/d7/d18/d27/d32/c44 0 2024-09-21T08:02:29.397 INFO:tasks.workunit.client.1.smithi129.stdout:8/226: dread - d0/d6/d7/d18/d27/f38 zero size 2024-09-21T08:02:29.397 INFO:tasks.workunit.client.1.smithi129.stdout:8/227: fdatasync d0/d6/d7/f40 0 2024-09-21T08:02:29.397 INFO:tasks.workunit.client.1.smithi129.stdout:8/228: chown d0/d6 0 1 2024-09-21T08:02:29.398 INFO:tasks.workunit.client.1.smithi129.stdout:1/328: creat d1/d64/f78 x:0 0 0 2024-09-21T08:02:29.399 INFO:tasks.workunit.client.1.smithi129.stdout:5/309: mkdir d2/d1e/d35/d33/d36/d5a 0 2024-09-21T08:02:29.400 INFO:tasks.workunit.client.1.smithi129.stdout:7/313: symlink d0/d1e/l68 0 2024-09-21T08:02:29.401 INFO:tasks.workunit.client.1.smithi129.stdout:8/229: creat d0/d6/d7/d18/f45 x:0 0 0 2024-09-21T08:02:29.401 INFO:tasks.workunit.client.1.smithi129.stdout:8/230: readlink d0/d6/d7/d18/l33 0 2024-09-21T08:02:29.403 INFO:tasks.workunit.client.1.smithi129.stdout:1/329: rename d1/d16/d25/c38 to d1/d4/c79 0 2024-09-21T08:02:29.404 INFO:tasks.workunit.client.1.smithi129.stdout:5/310: link d2/d1e/d35/d33/d36/f42 d2/d1e/d35/d33/d36/d5a/f5b 0 2024-09-21T08:02:29.404 INFO:tasks.workunit.client.1.smithi129.stdout:5/311: chown d2/d1e/d35/f22 7 1 2024-09-21T08:02:29.406 INFO:tasks.workunit.client.1.smithi129.stdout:8/231: truncate d0/d6/f1a 3115273 0 2024-09-21T08:02:29.406 INFO:tasks.workunit.client.1.smithi129.stdout:8/232: creat d0/d6/d7/d24/f46 x:0 0 0 2024-09-21T08:02:29.406 INFO:tasks.workunit.client.1.smithi129.stdout:8/233: creat d0/d6/d7/d24/f47 x:0 0 0 2024-09-21T08:02:29.407 INFO:tasks.workunit.client.1.smithi129.stdout:8/234: creat d0/d6/d7/d18/f48 x:0 0 0 2024-09-21T08:02:29.408 INFO:tasks.workunit.client.1.smithi129.stdout:6/253: dwrite d7/d1b/f49 [0,4194304] 0 2024-09-21T08:02:29.408 INFO:tasks.workunit.client.1.smithi129.stdout:6/254: chown d7/d1b/d1e/d39/d4b/f1d 3 1 2024-09-21T08:02:29.408 INFO:tasks.workunit.client.1.smithi129.stdout:7/314: rename d0/d46/d56/l62 to d0/d1e/l69 0 2024-09-21T08:02:29.409 INFO:tasks.workunit.client.1.smithi129.stdout:1/330: mkdir d1/d7a 0 2024-09-21T08:02:29.409 INFO:tasks.workunit.client.1.smithi129.stdout:5/312: write d2/d1e/f56 [3871303,79954] 0 2024-09-21T08:02:29.409 INFO:tasks.workunit.client.1.smithi129.stdout:5/313: read d2/f17 [10089,16244] 0 2024-09-21T08:02:29.415 INFO:tasks.workunit.client.1.smithi129.stdout:6/255: symlink d7/d1b/d25/d35/d40/d41/l5b 0 2024-09-21T08:02:29.415 INFO:tasks.workunit.client.1.smithi129.stdout:6/256: truncate d7/d1b/d25/d35/d40/d41/f48 420638 0 2024-09-21T08:02:29.415 INFO:tasks.workunit.client.1.smithi129.stdout:7/315: write d0/f8 [2451169,49692] 0 2024-09-21T08:02:29.417 INFO:tasks.workunit.client.1.smithi129.stdout:3/284: dwrite d3/da/dc/f4d [0,4194304] 0 2024-09-21T08:02:29.417 INFO:tasks.workunit.client.1.smithi129.stdout:1/331: symlink d1/d16/d25/l7b 0 2024-09-21T08:02:29.417 INFO:tasks.workunit.client.1.smithi129.stdout:3/285: chown d3/da/f54 1538 1 2024-09-21T08:02:29.417 INFO:tasks.workunit.client.1.smithi129.stdout:4/236: dwrite d5/f2b [0,4194304] 0 2024-09-21T08:02:29.419 INFO:tasks.workunit.client.1.smithi129.stdout:5/314: creat d2/d1e/d35/d33/d36/d5a/f5c x:0 0 0 2024-09-21T08:02:29.419 INFO:tasks.workunit.client.1.smithi129.stdout:6/257: symlink d7/d1b/d57/l5c 0 2024-09-21T08:02:29.420 INFO:tasks.workunit.client.1.smithi129.stdout:5/315: write d2/d1e/f1f [100361,125099] 0 2024-09-21T08:02:29.421 INFO:tasks.workunit.client.1.smithi129.stdout:7/316: dread d0/d1e/f36 [0,4194304] 0 2024-09-21T08:02:29.424 INFO:tasks.workunit.client.1.smithi129.stdout:1/332: creat d1/d7a/f7c x:0 0 0 2024-09-21T08:02:29.424 INFO:tasks.workunit.client.1.smithi129.stdout:1/333: chown d1/c4e 1525904 1 2024-09-21T08:02:29.424 INFO:tasks.workunit.client.1.smithi129.stdout:1/334: fsync d1/d16/d28/f5c 0 2024-09-21T08:02:29.425 INFO:tasks.workunit.client.1.smithi129.stdout:1/335: write d1/f12 [650287,39284] 0 2024-09-21T08:02:29.425 INFO:tasks.workunit.client.1.smithi129.stdout:1/336: chown d1/d16/d57/l60 78 1 2024-09-21T08:02:29.426 INFO:tasks.workunit.client.1.smithi129.stdout:4/237: mkdir d5/d16/d24/d4f 0 2024-09-21T08:02:29.431 INFO:tasks.workunit.client.1.smithi129.stdout:7/317: chown d0/d46/d56/f5c 1466869586 1 2024-09-21T08:02:29.433 INFO:tasks.workunit.client.1.smithi129.stdout:6/258: dread d7/d10/f19 [0,4194304] 0 2024-09-21T08:02:29.434 INFO:tasks.workunit.client.1.smithi129.stdout:6/259: truncate d7/d1b/d1e/d39/f4c 857712 0 2024-09-21T08:02:29.434 INFO:tasks.workunit.client.1.smithi129.stdout:6/260: write d7/d10/f14 [4641158,5547] 0 2024-09-21T08:02:29.436 INFO:tasks.workunit.client.1.smithi129.stdout:4/238: mkdir d5/d11/d3f/d50 0 2024-09-21T08:02:29.437 INFO:tasks.workunit.client.1.smithi129.stdout:1/337: symlink d1/d64/l7d 0 2024-09-21T08:02:29.439 INFO:tasks.workunit.client.1.smithi129.stdout:1/338: unlink d1/f30 0 2024-09-21T08:02:29.440 INFO:tasks.workunit.client.1.smithi129.stdout:1/339: read d1/f12 [539315,111332] 0 2024-09-21T08:02:29.440 INFO:tasks.workunit.client.1.smithi129.stdout:1/340: dread - d1/d16/d28/f5c zero size 2024-09-21T08:02:29.442 INFO:tasks.workunit.client.1.smithi129.stdout:3/286: dwrite d3/da/dc/d11/d55/f59 [0,4194304] 0 2024-09-21T08:02:29.446 INFO:tasks.workunit.client.1.smithi129.stdout:5/316: dwrite d2/d1e/d35/f51 [0,4194304] 0 2024-09-21T08:02:29.449 INFO:tasks.workunit.client.1.smithi129.stdout:5/317: symlink d2/d2a/d50/l5d 0 2024-09-21T08:02:29.452 INFO:tasks.workunit.client.1.smithi129.stdout:1/341: dread d1/d4/fa [4194304,4194304] 0 2024-09-21T08:02:29.452 INFO:tasks.workunit.client.1.smithi129.stdout:1/342: readlink d1/d16/d25/l65 0 2024-09-21T08:02:29.452 INFO:tasks.workunit.client.1.smithi129.stdout:1/343: truncate d1/d4/f5d 700520 0 2024-09-21T08:02:29.452 INFO:tasks.workunit.client.1.smithi129.stdout:1/344: dread - d1/d9/f20 zero size 2024-09-21T08:02:29.452 INFO:tasks.workunit.client.1.smithi129.stdout:1/345: stat d1/d44/f77 0 2024-09-21T08:02:29.452 INFO:tasks.workunit.client.1.smithi129.stdout:1/346: chown d1/c19 12749 1 2024-09-21T08:02:29.452 INFO:tasks.workunit.client.1.smithi129.stdout:1/347: truncate d1/d7a/f7c 373159 0 2024-09-21T08:02:29.452 INFO:tasks.workunit.client.1.smithi129.stdout:1/348: stat d1/d64/f78 0 2024-09-21T08:02:29.452 INFO:tasks.workunit.client.1.smithi129.stdout:1/349: write d1/d9/f20 [954613,105880] 0 2024-09-21T08:02:29.453 INFO:tasks.workunit.client.1.smithi129.stdout:7/318: truncate d0/d46/f47 492013 0 2024-09-21T08:02:29.453 INFO:tasks.workunit.client.1.smithi129.stdout:6/261: dread d7/f8 [0,4194304] 0 2024-09-21T08:02:29.453 INFO:tasks.workunit.client.1.smithi129.stdout:1/350: unlink d1/d9/c43 0 2024-09-21T08:02:29.453 INFO:tasks.workunit.client.1.smithi129.stdout:7/319: truncate d0/f41 277767 0 2024-09-21T08:02:29.455 INFO:tasks.workunit.client.1.smithi129.stdout:0/268: sync 2024-09-21T08:02:29.455 INFO:tasks.workunit.client.1.smithi129.stdout:7/320: write d0/f26 [420360,5490] 0 2024-09-21T08:02:29.456 INFO:tasks.workunit.client.1.smithi129.stdout:6/262: unlink d7/c30 0 2024-09-21T08:02:29.464 INFO:tasks.workunit.client.1.smithi129.stdout:4/239: dwrite d5/d16/f1f [0,4194304] 0 2024-09-21T08:02:29.465 INFO:tasks.workunit.client.1.smithi129.stdout:3/287: dwrite d3/f4a [0,4194304] 0 2024-09-21T08:02:29.470 INFO:tasks.workunit.client.1.smithi129.stdout:5/318: write d2/d1e/d35/f22 [2628877,63147] 0 2024-09-21T08:02:29.482 INFO:tasks.workunit.client.1.smithi129.stdout:1/351: dwrite d1/fd [0,4194304] 0 2024-09-21T08:02:29.485 INFO:tasks.workunit.client.1.smithi129.stdout:0/269: truncate de/f3c 656969 0 2024-09-21T08:02:29.488 INFO:tasks.workunit.client.1.smithi129.stdout:6/263: rename d7/d1b/d25/f2c to d7/d1b/d25/d35/d40/d41/f5d 0 2024-09-21T08:02:29.489 INFO:tasks.workunit.client.1.smithi129.stdout:4/240: creat d5/d11/d3f/d50/f51 x:0 0 0 2024-09-21T08:02:29.495 INFO:tasks.workunit.client.1.smithi129.stdout:3/288: mknod d3/da/dc/d11/d55/c5c 0 2024-09-21T08:02:29.505 INFO:tasks.workunit.client.1.smithi129.stdout:1/352: rmdir d1/d16/d28/d6a 0 2024-09-21T08:02:29.505 INFO:tasks.workunit.client.1.smithi129.stdout:1/353: write d1/d16/f2a [429535,92650] 0 2024-09-21T08:02:29.506 INFO:tasks.workunit.client.1.smithi129.stdout:0/270: mkdir de/d15/d4f 0 2024-09-21T08:02:29.507 INFO:tasks.workunit.client.1.smithi129.stdout:7/321: unlink d0/f59 0 2024-09-21T08:02:29.509 INFO:tasks.workunit.client.1.smithi129.stdout:6/264: mkdir d7/d1b/d25/d2b/d3e/d5e 0 2024-09-21T08:02:29.512 INFO:tasks.workunit.client.1.smithi129.stdout:4/241: dwrite d5/d16/d24/f27 [0,4194304] 0 2024-09-21T08:02:29.513 INFO:tasks.workunit.client.1.smithi129.stdout:5/319: getdents d2 0 2024-09-21T08:02:29.515 INFO:tasks.workunit.client.1.smithi129.stdout:0/271: mknod de/d1f/c50 0 2024-09-21T08:02:29.516 INFO:tasks.workunit.client.1.smithi129.stdout:7/322: symlink d0/d1e/l6a 0 2024-09-21T08:02:29.517 INFO:tasks.workunit.client.1.smithi129.stdout:3/289: dwrite d3/f4a [0,4194304] 0 2024-09-21T08:02:29.519 INFO:tasks.workunit.client.1.smithi129.stdout:6/265: rename d7/d1b/d25/f2e to d7/d1b/d1e/d39/f5f 0 2024-09-21T08:02:29.522 INFO:tasks.workunit.client.1.smithi129.stdout:4/242: creat d5/d11/d3f/f52 x:0 0 0 2024-09-21T08:02:29.523 INFO:tasks.workunit.client.1.smithi129.stdout:5/320: symlink d2/l5e 0 2024-09-21T08:02:29.525 INFO:tasks.workunit.client.1.smithi129.stdout:0/272: mkdir de/d15/d51 0 2024-09-21T08:02:29.525 INFO:tasks.workunit.client.1.smithi129.stdout:0/273: chown de 0 1 2024-09-21T08:02:29.525 INFO:tasks.workunit.client.1.smithi129.stdout:0/274: readlink de/d1f/l2a 0 2024-09-21T08:02:29.525 INFO:tasks.workunit.client.1.smithi129.stdout:0/275: chown de/d22/d27/d2f/f3e 8149249 1 2024-09-21T08:02:29.525 INFO:tasks.workunit.client.1.smithi129.stdout:0/276: creat de/d22/d27/d30/f52 x:0 0 0 2024-09-21T08:02:29.525 INFO:tasks.workunit.client.1.smithi129.stdout:1/354: dwrite d1/d9/d31/f68 [0,4194304] 0 2024-09-21T08:02:29.526 INFO:tasks.workunit.client.1.smithi129.stdout:7/323: chown d0/f16 31 1 2024-09-21T08:02:29.528 INFO:tasks.workunit.client.1.smithi129.stdout:3/290: mkdir d3/da/d5d 0 2024-09-21T08:02:29.529 INFO:tasks.workunit.client.1.smithi129.stdout:6/266: mkdir d7/d1b/d1e/d60 0 2024-09-21T08:02:29.530 INFO:tasks.workunit.client.1.smithi129.stdout:4/243: creat d5/d16/d24/f53 x:0 0 0 2024-09-21T08:02:29.534 INFO:tasks.workunit.client.1.smithi129.stdout:5/321: mknod d2/d2a/c5f 0 2024-09-21T08:02:29.537 INFO:tasks.workunit.client.1.smithi129.stdout:1/355: truncate d1/f50 2257227 0 2024-09-21T08:02:29.538 INFO:tasks.workunit.client.1.smithi129.stdout:3/291: creat d3/da/dc/d11/d2f/d27/d52/f5e x:0 0 0 2024-09-21T08:02:29.539 INFO:tasks.workunit.client.1.smithi129.stdout:6/267: creat d7/d1b/d25/d35/d40/d41/f61 x:0 0 0 2024-09-21T08:02:29.541 INFO:tasks.workunit.client.1.smithi129.stdout:4/244: truncate d5/d11/f45 1554112 0 2024-09-21T08:02:29.541 INFO:tasks.workunit.client.1.smithi129.stdout:0/277: dwrite de/d15/d29/f37 [0,4194304] 0 2024-09-21T08:02:29.542 INFO:tasks.workunit.client.1.smithi129.stdout:5/322: creat d2/f60 x:0 0 0 2024-09-21T08:02:29.542 INFO:tasks.workunit.client.1.smithi129.stdout:5/323: chown d2/c20 1634953880 1 2024-09-21T08:02:29.546 INFO:tasks.workunit.client.1.smithi129.stdout:1/356: rename d1/d4/c10 to d1/d16/d25/d73/c7e 0 2024-09-21T08:02:29.546 INFO:tasks.workunit.client.1.smithi129.stdout:1/357: fdatasync d1/d16/d28/f5c 0 2024-09-21T08:02:29.546 INFO:tasks.workunit.client.1.smithi129.stdout:1/358: write d1/d64/f78 [208597,8535] 0 2024-09-21T08:02:29.546 INFO:tasks.workunit.client.1.smithi129.stdout:1/359: chown d1/d16/d28/f54 9357240 1 2024-09-21T08:02:29.546 INFO:tasks.workunit.client.1.smithi129.stdout:4/245: truncate d5/f39 3611895 0 2024-09-21T08:02:29.548 INFO:tasks.workunit.client.1.smithi129.stdout:6/268: read d7/f9 [5677409,45417] 0 2024-09-21T08:02:29.548 INFO:tasks.workunit.client.1.smithi129.stdout:6/269: creat d7/d1b/d25/d35/d40/d41/f62 x:0 0 0 2024-09-21T08:02:29.551 INFO:tasks.workunit.client.1.smithi129.stdout:0/278: rmdir de/d15/d4f 0 2024-09-21T08:02:29.551 INFO:tasks.workunit.client.1.smithi129.stdout:0/279: readlink de/d22/l47 0 2024-09-21T08:02:29.553 INFO:tasks.workunit.client.1.smithi129.stdout:3/292: write d3/da/dc/f4d [2964353,22826] 0 2024-09-21T08:02:29.557 INFO:tasks.workunit.client.1.smithi129.stdout:1/360: mkdir d1/d64/d7f 0 2024-09-21T08:02:29.558 INFO:tasks.workunit.client.1.smithi129.stdout:3/293: creat d3/da/dc/f5f x:0 0 0 2024-09-21T08:02:29.559 INFO:tasks.workunit.client.1.smithi129.stdout:1/361: mknod d1/d16/d25/c80 0 2024-09-21T08:02:29.560 INFO:tasks.workunit.client.1.smithi129.stdout:7/324: dwrite d0/f22 [0,4194304] 0 2024-09-21T08:02:29.561 INFO:tasks.workunit.client.1.smithi129.stdout:3/294: rename d3/f4a to d3/da/d5d/f60 0 2024-09-21T08:02:29.561 INFO:tasks.workunit.client.1.smithi129.stdout:1/362: mknod d1/d7a/c81 0 2024-09-21T08:02:29.563 INFO:tasks.workunit.client.1.smithi129.stdout:3/295: rename d3/da/dc/d11/d2f/f28 to d3/da/dc/d11/d55/f61 0 2024-09-21T08:02:29.564 INFO:tasks.workunit.client.1.smithi129.stdout:1/363: mknod d1/d64/d7f/c82 0 2024-09-21T08:02:29.565 INFO:tasks.workunit.client.1.smithi129.stdout:7/325: symlink d0/l6b 0 2024-09-21T08:02:29.566 INFO:tasks.workunit.client.1.smithi129.stdout:1/364: getdents d1/d16 0 2024-09-21T08:02:29.568 INFO:tasks.workunit.client.1.smithi129.stdout:7/326: link d0/l42 d0/d46/l6c 0 2024-09-21T08:02:29.568 INFO:tasks.workunit.client.1.smithi129.stdout:7/327: read d0/d1e/f36 [2154731,103512] 0 2024-09-21T08:02:29.568 INFO:tasks.workunit.client.1.smithi129.stdout:0/280: write de/d15/f28 [4021700,127403] 0 2024-09-21T08:02:29.569 INFO:tasks.workunit.client.1.smithi129.stdout:7/328: creat d0/d46/d56/f6d x:0 0 0 2024-09-21T08:02:29.572 INFO:tasks.workunit.client.1.smithi129.stdout:7/329: chown d0/f25 1384750 1 2024-09-21T08:02:29.572 INFO:tasks.workunit.client.1.smithi129.stdout:7/330: dread - d0/d46/f53 zero size 2024-09-21T08:02:29.576 INFO:tasks.workunit.client.1.smithi129.stdout:3/296: write d3/da/dc/d11/d2f/d27/f4e [576052,48011] 0 2024-09-21T08:02:29.576 INFO:tasks.workunit.client.1.smithi129.stdout:3/297: write d3/da/dc/f5f [938946,78895] 0 2024-09-21T08:02:29.578 INFO:tasks.workunit.client.1.smithi129.stdout:6/270: dread d7/d10/f14 [0,4194304] 0 2024-09-21T08:02:29.580 INFO:tasks.workunit.client.1.smithi129.stdout:5/324: dwrite d2/d1e/f2f [0,4194304] 0 2024-09-21T08:02:29.580 INFO:tasks.workunit.client.1.smithi129.stdout:4/246: dwrite d5/d11/d3f/d50/f51 [0,4194304] 0 2024-09-21T08:02:29.581 INFO:tasks.workunit.client.1.smithi129.stdout:6/271: rmdir d7/d1b/d25/d2b/d4f 0 2024-09-21T08:02:29.581 INFO:tasks.workunit.client.1.smithi129.stdout:6/272: chown d7/d1b/l42 39943526 1 2024-09-21T08:02:29.586 INFO:tasks.workunit.client.1.smithi129.stdout:1/365: dwrite d1/d16/d28/f33 [0,4194304] 0 2024-09-21T08:02:29.587 INFO:tasks.workunit.client.1.smithi129.stdout:4/247: creat d5/d16/d24/d4f/f54 x:0 0 0 2024-09-21T08:02:29.587 INFO:tasks.workunit.client.1.smithi129.stdout:4/248: write d5/d33/f4d [417471,21602] 0 2024-09-21T08:02:29.588 INFO:tasks.workunit.client.1.smithi129.stdout:6/273: symlink d7/d1b/d25/d2b/d3e/l63 0 2024-09-21T08:02:29.590 INFO:tasks.workunit.client.1.smithi129.stdout:2/474: sync 2024-09-21T08:02:29.590 INFO:tasks.workunit.client.1.smithi129.stdout:2/475: chown d1/dc/d19/c52 9635 1 2024-09-21T08:02:29.591 INFO:tasks.workunit.client.1.smithi129.stdout:1/366: mkdir d1/d44/d83 0 2024-09-21T08:02:29.591 INFO:tasks.workunit.client.1.smithi129.stdout:4/249: symlink d5/d16/d24/l55 0 2024-09-21T08:02:29.592 INFO:tasks.workunit.client.1.smithi129.stdout:6/274: mknod d7/d1b/d25/d35/d40/d41/c64 0 2024-09-21T08:02:29.592 INFO:tasks.workunit.client.1.smithi129.stdout:6/275: write d7/d10/f15 [2056675,94495] 0 2024-09-21T08:02:29.592 INFO:tasks.workunit.client.1.smithi129.stdout:6/276: write d7/d10/f16 [1147689,20772] 0 2024-09-21T08:02:29.593 INFO:tasks.workunit.client.1.smithi129.stdout:2/476: mknod d1/d13/d3a/d47/d1f/cb2 0 2024-09-21T08:02:29.593 INFO:tasks.workunit.client.1.smithi129.stdout:2/477: chown d1/dc/d26/d45/d65/d50/l7d 19303 1 2024-09-21T08:02:29.593 INFO:tasks.workunit.client.1.smithi129.stdout:2/478: fdatasync d1/dc/d26/d45/d65/fa8 0 2024-09-21T08:02:29.594 INFO:tasks.workunit.client.1.smithi129.stdout:2/479: truncate d1/dc/d19/d4c/d6a/f3d 731443 0 2024-09-21T08:02:29.601 INFO:tasks.workunit.client.1.smithi129.stdout:3/298: dwrite d3/da/dc/d11/d2f/d27/d52/f5e [0,4194304] 0 2024-09-21T08:02:29.601 INFO:tasks.workunit.client.1.smithi129.stdout:5/325: dwrite d2/d1e/d35/f4a [0,4194304] 0 2024-09-21T08:02:29.741 INFO:tasks.workunit.client.1.smithi129.stdout:1/367: unlink d1/d9/c4b 0 2024-09-21T08:02:29.741 INFO:tasks.workunit.client.1.smithi129.stdout:1/368: fsync d1/d4/d6e/f74 0 2024-09-21T08:02:29.742 INFO:tasks.workunit.client.1.smithi129.stdout:4/250: symlink d5/d6/l56 0 2024-09-21T08:02:29.742 INFO:tasks.workunit.client.1.smithi129.stdout:4/251: creat d5/d11/f57 x:0 0 0 2024-09-21T08:02:29.743 INFO:tasks.workunit.client.1.smithi129.stdout:8/235: sync 2024-09-21T08:02:29.743 INFO:tasks.workunit.client.1.smithi129.stdout:9/282: sync 2024-09-21T08:02:29.744 INFO:tasks.workunit.client.1.smithi129.stdout:2/480: creat d1/d53/fb3 x:0 0 0 2024-09-21T08:02:29.746 INFO:tasks.workunit.client.1.smithi129.stdout:3/299: stat d3/l2d 0 2024-09-21T08:02:29.750 INFO:tasks.workunit.client.1.smithi129.stdout:5/326: mkdir d2/d2a/d50/d61 0 2024-09-21T08:02:29.750 INFO:tasks.workunit.client.1.smithi129.stdout:1/369: creat d1/d4/f84 x:0 0 0 2024-09-21T08:02:29.751 INFO:tasks.workunit.client.1.smithi129.stdout:6/277: write d7/fd [3493913,124469] 0 2024-09-21T08:02:29.753 INFO:tasks.workunit.client.1.smithi129.stdout:4/252: rename d5/d11/l1e to d5/d33/l58 0 2024-09-21T08:02:29.753 INFO:tasks.workunit.client.1.smithi129.stdout:9/283: rmdir d17/d22/d33/d36/d48/d3f 39 2024-09-21T08:02:29.754 INFO:tasks.workunit.client.1.smithi129.stdout:9/284: fsync d17/f49 0 2024-09-21T08:02:29.754 INFO:tasks.workunit.client.1.smithi129.stdout:9/285: stat d17/d22/d33/d36/d48/d3f/c5b 0 2024-09-21T08:02:29.754 INFO:tasks.workunit.client.1.smithi129.stdout:2/481: getdents d1/d13/d32 0 2024-09-21T08:02:29.757 INFO:tasks.workunit.client.1.smithi129.stdout:5/327: mkdir d2/d1e/d35/d62 0 2024-09-21T08:02:29.757 INFO:tasks.workunit.client.1.smithi129.stdout:5/328: creat d2/d2a/d50/f63 x:0 0 0 2024-09-21T08:02:29.757 INFO:tasks.workunit.client.1.smithi129.stdout:1/370: truncate d1/d64/f66 88266 0 2024-09-21T08:02:29.761 INFO:tasks.workunit.client.1.smithi129.stdout:8/236: rename d0/d6/c23 to d0/d6/d7/d18/c49 0 2024-09-21T08:02:29.762 INFO:tasks.workunit.client.1.smithi129.stdout:4/253: dread d5/d16/d24/f27 [0,4194304] 0 2024-09-21T08:02:29.762 INFO:tasks.workunit.client.1.smithi129.stdout:4/254: truncate d5/d6/f7 1297192 0 2024-09-21T08:02:29.763 INFO:tasks.workunit.client.1.smithi129.stdout:9/286: creat d17/d22/d33/d36/f63 x:0 0 0 2024-09-21T08:02:29.765 INFO:tasks.workunit.client.1.smithi129.stdout:1/371: symlink d1/d16/d57/l85 0 2024-09-21T08:02:29.765 INFO:tasks.workunit.client.1.smithi129.stdout:1/372: dread - d1/d9/d31/f6f zero size 2024-09-21T08:02:29.766 INFO:tasks.workunit.client.1.smithi129.stdout:1/373: write d1/d9/d31/f5e [109353,124429] 0 2024-09-21T08:02:29.766 INFO:tasks.workunit.client.1.smithi129.stdout:1/374: dread - d1/d9/f58 zero size 2024-09-21T08:02:29.766 INFO:tasks.workunit.client.1.smithi129.stdout:1/375: truncate d1/f3 6498735 0 2024-09-21T08:02:29.766 INFO:tasks.workunit.client.1.smithi129.stdout:4/255: creat d5/d35/f59 x:0 0 0 2024-09-21T08:02:29.767 INFO:tasks.workunit.client.1.smithi129.stdout:2/482: dread d1/dc/d26/d45/d65/d50/f9c [0,4194304] 0 2024-09-21T08:02:29.768 INFO:tasks.workunit.client.1.smithi129.stdout:1/376: creat d1/d16/d57/f86 x:0 0 0 2024-09-21T08:02:29.768 INFO:tasks.workunit.client.1.smithi129.stdout:1/377: truncate d1/d4/f5d 1700795 0 2024-09-21T08:02:29.768 INFO:tasks.workunit.client.1.smithi129.stdout:5/329: dread d2/d1e/d35/d33/f4b [0,4194304] 0 2024-09-21T08:02:29.769 INFO:tasks.workunit.client.1.smithi129.stdout:4/256: symlink d5/d16/d24/l5a 0 2024-09-21T08:02:29.770 INFO:tasks.workunit.client.1.smithi129.stdout:6/278: getdents d7/d1b/d1e 0 2024-09-21T08:02:29.770 INFO:tasks.workunit.client.1.smithi129.stdout:6/279: stat d7/d1b/d1e/d60 0 2024-09-21T08:02:29.773 INFO:tasks.workunit.client.1.smithi129.stdout:9/287: write f0 [3726202,45191] 0 2024-09-21T08:02:29.773 INFO:tasks.workunit.client.1.smithi129.stdout:9/288: chown d17/d2c/d31/l45 168538 1 2024-09-21T08:02:29.773 INFO:tasks.workunit.client.1.smithi129.stdout:1/378: symlink d1/d64/d7f/l87 0 2024-09-21T08:02:29.775 INFO:tasks.workunit.client.1.smithi129.stdout:5/330: symlink d2/d1e/d35/l64 0 2024-09-21T08:02:29.777 INFO:tasks.workunit.client.1.smithi129.stdout:6/280: symlink d7/d1b/d25/d35/l65 0 2024-09-21T08:02:29.780 INFO:tasks.workunit.client.1.smithi129.stdout:9/289: rename d17/d2c/d31/d35/l3d to d17/d22/d33/l64 0 2024-09-21T08:02:29.781 INFO:tasks.workunit.client.1.smithi129.stdout:0/281: getdents de/d22/d27/d30 0 2024-09-21T08:02:29.781 INFO:tasks.workunit.client.1.smithi129.stdout:0/282: truncate de/d19/f38 1009018 0 2024-09-21T08:02:29.781 INFO:tasks.workunit.client.1.smithi129.stdout:0/283: truncate de/d1f/f24 2525417 0 2024-09-21T08:02:29.782 INFO:tasks.workunit.client.1.smithi129.stdout:1/379: unlink d1/d44/f77 0 2024-09-21T08:02:29.783 INFO:tasks.workunit.client.1.smithi129.stdout:5/331: mkdir d2/d1e/d35/d37/d65 0 2024-09-21T08:02:29.785 INFO:tasks.workunit.client.1.smithi129.stdout:6/281: mkdir d7/d1b/d1e/d66 0 2024-09-21T08:02:29.785 INFO:tasks.workunit.client.1.smithi129.stdout:6/282: fsync d7/d10/f19 0 2024-09-21T08:02:29.785 INFO:tasks.workunit.client.1.smithi129.stdout:2/483: write d1/dc/f15 [3640146,79116] 0 2024-09-21T08:02:29.790 INFO:tasks.workunit.client.1.smithi129.stdout:0/284: rename de/d22/l47 to de/d22/d27/l53 0 2024-09-21T08:02:29.790 INFO:tasks.workunit.client.1.smithi129.stdout:0/285: read - de/d1f/f34 zero size 2024-09-21T08:02:29.790 INFO:tasks.workunit.client.1.smithi129.stdout:9/290: read d17/d2c/d31/f5a [1653457,105951] 0 2024-09-21T08:02:29.790 INFO:tasks.workunit.client.1.smithi129.stdout:9/291: fdatasync d17/d22/d33/d36/d48/d3f/f57 0 2024-09-21T08:02:29.791 INFO:tasks.workunit.client.1.smithi129.stdout:2/484: symlink d1/d13/d32/d97/da7/lb4 0 2024-09-21T08:02:29.792 INFO:tasks.workunit.client.1.smithi129.stdout:2/485: mknod d1/d53/d68/cb5 0 2024-09-21T08:02:29.792 INFO:tasks.workunit.client.1.smithi129.stdout:9/292: read d17/d2c/d31/f5c [34649,75610] 0 2024-09-21T08:02:29.793 INFO:tasks.workunit.client.1.smithi129.stdout:9/293: creat d17/d22/d33/d36/f65 x:0 0 0 2024-09-21T08:02:29.793 INFO:tasks.workunit.client.1.smithi129.stdout:9/294: write f0 [2075968,13609] 0 2024-09-21T08:02:29.793 INFO:tasks.workunit.client.1.smithi129.stdout:9/295: fdatasync f15 0 2024-09-21T08:02:29.795 INFO:tasks.workunit.client.1.smithi129.stdout:5/332: write d2/f18 [2430675,116924] 0 2024-09-21T08:02:29.795 INFO:tasks.workunit.client.1.smithi129.stdout:1/380: dread d1/d9/d31/f5e [0,4194304] 0 2024-09-21T08:02:29.795 INFO:tasks.workunit.client.1.smithi129.stdout:1/381: stat d1/d4/f21 0 2024-09-21T08:02:29.795 INFO:tasks.workunit.client.1.smithi129.stdout:1/382: read d1/f3f [235664,93083] 0 2024-09-21T08:02:29.795 INFO:tasks.workunit.client.1.smithi129.stdout:1/383: creat d1/d16/d57/f88 x:0 0 0 2024-09-21T08:02:29.795 INFO:tasks.workunit.client.1.smithi129.stdout:8/237: dwrite d0/d6/f1f [0,4194304] 0 2024-09-21T08:02:29.796 INFO:tasks.workunit.client.1.smithi129.stdout:8/238: chown d0/d6/d7/d24/f36 534 1 2024-09-21T08:02:29.796 INFO:tasks.workunit.client.1.smithi129.stdout:8/239: getdents d0/d6/d7/d3a 0 2024-09-21T08:02:29.796 INFO:tasks.workunit.client.1.smithi129.stdout:8/240: chown d0/d6/d7/d18/d27/c30 1041526365 1 2024-09-21T08:02:29.796 INFO:tasks.workunit.client.1.smithi129.stdout:8/241: chown d0 81 1 2024-09-21T08:02:29.796 INFO:tasks.workunit.client.1.smithi129.stdout:8/242: readlink d0/l2c 0 2024-09-21T08:02:29.797 INFO:tasks.workunit.client.1.smithi129.stdout:0/286: read de/d1f/f24 [690913,80238] 0 2024-09-21T08:02:29.797 INFO:tasks.workunit.client.1.smithi129.stdout:2/486: dread d1/dc/d26/d45/f7b [0,4194304] 0 2024-09-21T08:02:29.798 INFO:tasks.workunit.client.1.smithi129.stdout:0/287: read de/d15/f1c [289240,48893] 0 2024-09-21T08:02:29.799 INFO:tasks.workunit.client.1.smithi129.stdout:1/384: link d1/d4/cf d1/d16/c89 0 2024-09-21T08:02:29.804 INFO:tasks.workunit.client.1.smithi129.stdout:3/300: getdents d3/da/dc/d11/d2f 0 2024-09-21T08:02:29.804 INFO:tasks.workunit.client.1.smithi129.stdout:3/301: write d3/da/dc/d11/d55/f61 [1926160,128166] 0 2024-09-21T08:02:29.805 INFO:tasks.workunit.client.1.smithi129.stdout:2/487: mknod d1/dc/d26/d45/d65/d50/cb6 0 2024-09-21T08:02:29.807 INFO:tasks.workunit.client.1.smithi129.stdout:0/288: creat de/d15/d44/d4b/f54 x:0 0 0 2024-09-21T08:02:29.807 INFO:tasks.workunit.client.1.smithi129.stdout:0/289: write fd [2362005,35387] 0 2024-09-21T08:02:29.814 INFO:tasks.workunit.client.1.smithi129.stdout:3/302: rename d3/da/dc/f5f to d3/da/dc/f62 0 2024-09-21T08:02:29.814 INFO:tasks.workunit.client.1.smithi129.stdout:3/303: dread - d3/da/dc/d11/d2f/f56 zero size 2024-09-21T08:02:29.815 INFO:tasks.workunit.client.1.smithi129.stdout:0/290: symlink de/l55 0 2024-09-21T08:02:29.815 INFO:tasks.workunit.client.1.smithi129.stdout:2/488: dread d1/d13/d3a/d47/d1f/f22 [0,4194304] 0 2024-09-21T08:02:29.815 INFO:tasks.workunit.client.1.smithi129.stdout:7/331: rename d0/d46/d56 to d0/d46/d6e 0 2024-09-21T08:02:29.817 INFO:tasks.workunit.client.1.smithi129.stdout:6/283: dwrite d7/d1b/f49 [4194304,4194304] 0 2024-09-21T08:02:29.818 INFO:tasks.workunit.client.1.smithi129.stdout:2/489: link d1/dc/d26/d45/d65/d50/f9c d1/dc/d26/d45/d65/d99/fb7 0 2024-09-21T08:02:29.818 INFO:tasks.workunit.client.1.smithi129.stdout:7/332: stat d0/f4c 0 2024-09-21T08:02:29.821 INFO:tasks.workunit.client.1.smithi129.stdout:0/291: dread de/d15/f3d [0,4194304] 0 2024-09-21T08:02:29.822 INFO:tasks.workunit.client.1.smithi129.stdout:2/490: mknod d1/d13/d3a/d47/d1f/cb8 0 2024-09-21T08:02:29.823 INFO:tasks.workunit.client.1.smithi129.stdout:2/491: dread - d1/d13/d32/d97/da7/faf zero size 2024-09-21T08:02:29.823 INFO:tasks.workunit.client.1.smithi129.stdout:2/492: readlink d1/la9 0 2024-09-21T08:02:29.823 INFO:tasks.workunit.client.1.smithi129.stdout:0/292: mkdir de/d15/d39/d56 0 2024-09-21T08:02:29.823 INFO:tasks.workunit.client.1.smithi129.stdout:1/385: dwrite d1/d4/f84 [0,4194304] 0 2024-09-21T08:02:29.824 INFO:tasks.workunit.client.1.smithi129.stdout:2/493: mkdir d1/d53/d68/db9 0 2024-09-21T08:02:29.832 INFO:tasks.workunit.client.1.smithi129.stdout:1/386: dread d1/f50 [0,4194304] 0 2024-09-21T08:02:29.834 INFO:tasks.workunit.client.1.smithi129.stdout:0/293: write de/d22/f2b [397361,74026] 0 2024-09-21T08:02:29.834 INFO:tasks.workunit.client.1.smithi129.stdout:0/294: stat de/d22/d27/d30 0 2024-09-21T08:02:29.834 INFO:tasks.workunit.client.1.smithi129.stdout:0/295: write de/d15/f28 [763855,81200] 0 2024-09-21T08:02:29.834 INFO:tasks.workunit.client.1.smithi129.stdout:0/296: truncate de/d1f/f34 147376 0 2024-09-21T08:02:29.835 INFO:tasks.workunit.client.1.smithi129.stdout:8/243: rmdir d0/d6 39 2024-09-21T08:02:29.837 INFO:tasks.workunit.client.1.smithi129.stdout:1/387: creat d1/d9/d6b/f8a x:0 0 0 2024-09-21T08:02:29.839 INFO:tasks.workunit.client.1.smithi129.stdout:1/388: write d1/d4/f5d [831997,119131] 0 2024-09-21T08:02:29.841 INFO:tasks.workunit.client.1.smithi129.stdout:8/244: creat d0/d6/d7/d18/d27/d32/f4a x:0 0 0 2024-09-21T08:02:29.842 INFO:tasks.workunit.client.1.smithi129.stdout:3/304: dwrite d3/da/f49 [4194304,4194304] 0 2024-09-21T08:02:29.843 INFO:tasks.workunit.client.1.smithi129.stdout:3/305: write d3/da/dc/f22 [8747988,125825] 0 2024-09-21T08:02:29.850 INFO:tasks.workunit.client.1.smithi129.stdout:1/389: getdents d1/d16 0 2024-09-21T08:02:29.852 INFO:tasks.workunit.client.1.smithi129.stdout:9/296: truncate f0 1379324 0 2024-09-21T08:02:29.852 INFO:tasks.workunit.client.1.smithi129.stdout:9/297: write d17/d22/f30 [1260535,68507] 0 2024-09-21T08:02:29.852 INFO:tasks.workunit.client.1.smithi129.stdout:9/298: fdatasync d17/f49 0 2024-09-21T08:02:29.854 INFO:tasks.workunit.client.1.smithi129.stdout:1/390: symlink d1/d16/d28/l8b 0 2024-09-21T08:02:29.854 INFO:tasks.workunit.client.1.smithi129.stdout:1/391: chown d1/d4/d6e/f74 20 1 2024-09-21T08:02:29.859 INFO:tasks.workunit.client.1.smithi129.stdout:6/284: dwrite d7/d10/f16 [0,4194304] 0 2024-09-21T08:02:29.860 INFO:tasks.workunit.client.1.smithi129.stdout:7/333: dwrite d0/f25 [4194304,4194304] 0 2024-09-21T08:02:29.860 INFO:tasks.workunit.client.1.smithi129.stdout:7/334: dread - d0/d46/f61 zero size 2024-09-21T08:02:29.863 INFO:tasks.workunit.client.1.smithi129.stdout:0/297: dwrite de/d15/d44/d4b/f54 [0,4194304] 0 2024-09-21T08:02:29.866 INFO:tasks.workunit.client.1.smithi129.stdout:9/299: link d17/d38/f52 d17/d2c/f66 0 2024-09-21T08:02:29.867 INFO:tasks.workunit.client.1.smithi129.stdout:6/285: truncate d7/d10/f14 2083972 0 2024-09-21T08:02:29.869 INFO:tasks.workunit.client.1.smithi129.stdout:8/245: dwrite d0/d6/d7/d9/f2a [0,4194304] 0 2024-09-21T08:02:29.871 INFO:tasks.workunit.client.1.smithi129.stdout:0/298: symlink de/d19/l57 0 2024-09-21T08:02:29.871 INFO:tasks.workunit.client.1.smithi129.stdout:0/299: chown de/l14 1146009 1 2024-09-21T08:02:29.871 INFO:tasks.workunit.client.1.smithi129.stdout:0/300: fdatasync f6 0 2024-09-21T08:02:29.871 INFO:tasks.workunit.client.1.smithi129.stdout:0/301: creat de/d15/d44/d4b/f58 x:0 0 0 2024-09-21T08:02:29.872 INFO:tasks.workunit.client.1.smithi129.stdout:9/300: creat d17/d22/d33/d36/d48/d3f/f67 x:0 0 0 2024-09-21T08:02:29.872 INFO:tasks.workunit.client.1.smithi129.stdout:9/301: truncate f16 5071106 0 2024-09-21T08:02:29.873 INFO:tasks.workunit.client.1.smithi129.stdout:0/302: write de/d1f/f24 [1707876,73996] 0 2024-09-21T08:02:29.874 INFO:tasks.workunit.client.1.smithi129.stdout:7/335: link d0/d1e/f3e d0/f6f 0 2024-09-21T08:02:29.874 INFO:tasks.workunit.client.1.smithi129.stdout:1/392: dwrite d1/d4/fa [0,4194304] 0 2024-09-21T08:02:29.874 INFO:tasks.workunit.client.1.smithi129.stdout:1/393: dread - d1/d9/f58 zero size 2024-09-21T08:02:29.875 INFO:tasks.workunit.client.1.smithi129.stdout:1/394: chown d1/d4 2176254 1 2024-09-21T08:02:29.875 INFO:tasks.workunit.client.1.smithi129.stdout:1/395: write d1/d44/f53 [5053929,122711] 0 2024-09-21T08:02:29.875 INFO:tasks.workunit.client.1.smithi129.stdout:8/246: creat d0/d6/d7/d18/d27/d32/d37/f4b x:0 0 0 2024-09-21T08:02:29.877 INFO:tasks.workunit.client.1.smithi129.stdout:0/303: creat de/d15/f59 x:0 0 0 2024-09-21T08:02:29.877 INFO:tasks.workunit.client.1.smithi129.stdout:0/304: truncate de/d15/f1c 421487 0 2024-09-21T08:02:29.879 INFO:tasks.workunit.client.1.smithi129.stdout:7/336: write d0/f20 [4694940,59613] 0 2024-09-21T08:02:29.881 INFO:tasks.workunit.client.1.smithi129.stdout:1/396: truncate d1/d4/f84 204529 0 2024-09-21T08:02:29.882 INFO:tasks.workunit.client.1.smithi129.stdout:7/337: truncate d0/d1e/f40 2250415 0 2024-09-21T08:02:29.882 INFO:tasks.workunit.client.1.smithi129.stdout:7/338: fdatasync d0/d46/d6e/f5f 0 2024-09-21T08:02:29.882 INFO:tasks.workunit.client.1.smithi129.stdout:7/339: dread - d0/d46/f61 zero size 2024-09-21T08:02:29.883 INFO:tasks.workunit.client.1.smithi129.stdout:7/340: creat d0/f70 x:0 0 0 2024-09-21T08:02:29.883 INFO:tasks.workunit.client.1.smithi129.stdout:7/341: chown d0/f24 19227796 1 2024-09-21T08:02:29.884 INFO:tasks.workunit.client.1.smithi129.stdout:7/342: dread - d0/d46/f57 zero size 2024-09-21T08:02:29.885 INFO:tasks.workunit.client.1.smithi129.stdout:7/343: mkdir d0/d71 0 2024-09-21T08:02:29.889 INFO:tasks.workunit.client.1.smithi129.stdout:0/305: dread f6 [0,4194304] 0 2024-09-21T08:02:29.891 INFO:tasks.workunit.client.1.smithi129.stdout:3/306: dwrite d3/da/dc/d11/d2f/f40 [0,4194304] 0 2024-09-21T08:02:29.891 INFO:tasks.workunit.client.1.smithi129.stdout:1/397: dread d1/d9/f3d [0,4194304] 0 2024-09-21T08:02:29.892 INFO:tasks.workunit.client.1.smithi129.stdout:9/302: dwrite d17/d2c/f43 [0,4194304] 0 2024-09-21T08:02:29.892 INFO:tasks.workunit.client.1.smithi129.stdout:9/303: fsync f13 0 2024-09-21T08:02:29.892 INFO:tasks.workunit.client.1.smithi129.stdout:9/304: write f0 [525372,61160] 0 2024-09-21T08:02:29.898 INFO:tasks.workunit.client.1.smithi129.stdout:9/305: mknod d17/d38/c68 0 2024-09-21T08:02:29.898 INFO:tasks.workunit.client.1.smithi129.stdout:9/306: stat d17 0 2024-09-21T08:02:29.898 INFO:tasks.workunit.client.1.smithi129.stdout:3/307: rmdir d3/da/dc/d11/d2f/d27/d52 39 2024-09-21T08:02:29.899 INFO:tasks.workunit.client.1.smithi129.stdout:9/307: getdents d17/d22 0 2024-09-21T08:02:29.904 INFO:tasks.workunit.client.1.smithi129.stdout:7/344: getdents d0 0 2024-09-21T08:02:29.905 INFO:tasks.workunit.client.1.smithi129.stdout:1/398: read d1/d4/fa [7736918,36513] 0 2024-09-21T08:02:29.905 INFO:tasks.workunit.client.1.smithi129.stdout:1/399: creat d1/d44/f8c x:0 0 0 2024-09-21T08:02:29.905 INFO:tasks.workunit.client.1.smithi129.stdout:1/400: truncate d1/d9/f58 19100 0 2024-09-21T08:02:29.907 INFO:tasks.workunit.client.1.smithi129.stdout:7/345: link d0/l4f d0/l72 0 2024-09-21T08:02:29.907 INFO:tasks.workunit.client.1.smithi129.stdout:7/346: write d0/d46/d6e/f5c [852034,113628] 0 2024-09-21T08:02:29.907 INFO:tasks.workunit.client.1.smithi129.stdout:7/347: truncate d0/f43 3499233 0 2024-09-21T08:02:29.907 INFO:tasks.workunit.client.1.smithi129.stdout:7/348: chown d0/d1e/f36 1104 1 2024-09-21T08:02:29.907 INFO:tasks.workunit.client.1.smithi129.stdout:7/349: read - d0/d46/d6e/f5f zero size 2024-09-21T08:02:29.907 INFO:tasks.workunit.client.1.smithi129.stdout:7/350: dread - d0/f6f zero size 2024-09-21T08:02:29.908 INFO:tasks.workunit.client.1.smithi129.stdout:0/306: dread de/f13 [0,4194304] 0 2024-09-21T08:02:29.908 INFO:tasks.workunit.client.1.smithi129.stdout:7/351: symlink d0/d46/l73 0 2024-09-21T08:02:29.909 INFO:tasks.workunit.client.1.smithi129.stdout:1/401: dread d1/f39 [0,4194304] 0 2024-09-21T08:02:29.909 INFO:tasks.workunit.client.1.smithi129.stdout:1/402: dread - d1/d4/d6e/f74 zero size 2024-09-21T08:02:29.909 INFO:tasks.workunit.client.1.smithi129.stdout:0/307: truncate de/d15/f28 593025 0 2024-09-21T08:02:29.910 INFO:tasks.workunit.client.1.smithi129.stdout:0/308: creat de/d22/d27/d2f/f5a x:0 0 0 2024-09-21T08:02:29.914 INFO:tasks.workunit.client.1.smithi129.stdout:0/309: dread de/d22/d27/f4c [0,4194304] 0 2024-09-21T08:02:29.915 INFO:tasks.workunit.client.1.smithi129.stdout:9/308: write d17/d22/d33/d36/d48/d3f/f57 [1699062,121131] 0 2024-09-21T08:02:29.915 INFO:tasks.workunit.client.1.smithi129.stdout:0/310: truncate de/d22/d27/d30/f52 429363 0 2024-09-21T08:02:29.915 INFO:tasks.workunit.client.1.smithi129.stdout:9/309: chown d17/d2c/d31/l4d 77 1 2024-09-21T08:02:29.921 INFO:tasks.workunit.client.1.smithi129.stdout:7/352: read d0/f25 [5588764,6808] 0 2024-09-21T08:02:29.921 INFO:tasks.workunit.client.1.smithi129.stdout:7/353: chown d0/c3c 4 1 2024-09-21T08:02:29.921 INFO:tasks.workunit.client.1.smithi129.stdout:0/311: mkdir de/d15/d39/d5b 0 2024-09-21T08:02:29.921 INFO:tasks.workunit.client.1.smithi129.stdout:0/312: creat de/d15/d44/d4b/f5c x:0 0 0 2024-09-21T08:02:29.922 INFO:tasks.workunit.client.1.smithi129.stdout:7/354: link d0/d1e/l69 d0/d46/l74 0 2024-09-21T08:02:29.922 INFO:tasks.workunit.client.1.smithi129.stdout:7/355: write d0/d46/d6e/f63 [606986,53228] 0 2024-09-21T08:02:29.922 INFO:tasks.workunit.client.1.smithi129.stdout:7/356: chown d0/d1e/c2c 7988620 1 2024-09-21T08:02:29.941 INFO:tasks.workunit.client.1.smithi129.stdout:3/308: dwrite d3/da/dc/f62 [0,4194304] 0 2024-09-21T08:02:29.942 INFO:tasks.workunit.client.1.smithi129.stdout:8/247: dwrite d0/d6/d7/d24/f47 [0,4194304] 0 2024-09-21T08:02:29.952 INFO:tasks.workunit.client.1.smithi129.stdout:1/403: dwrite d1/f3f [0,4194304] 0 2024-09-21T08:02:29.954 INFO:tasks.workunit.client.1.smithi129.stdout:7/357: dwrite d0/f8 [0,4194304] 0 2024-09-21T08:02:29.954 INFO:tasks.workunit.client.1.smithi129.stdout:8/248: dread d0/f2b [0,4194304] 0 2024-09-21T08:02:29.954 INFO:tasks.workunit.client.1.smithi129.stdout:8/249: truncate d0/d6/d7/d18/d27/d32/d37/f4b 230873 0 2024-09-21T08:02:29.955 INFO:tasks.workunit.client.1.smithi129.stdout:1/404: symlink d1/d9/d6b/l8d 0 2024-09-21T08:02:29.955 INFO:tasks.workunit.client.1.smithi129.stdout:1/405: write d1/d64/f78 [415312,27197] 0 2024-09-21T08:02:29.955 INFO:tasks.workunit.client.1.smithi129.stdout:9/310: dwrite d17/d46/f4f [0,4194304] 0 2024-09-21T08:02:29.955 INFO:tasks.workunit.client.1.smithi129.stdout:3/309: write d3/da/dc/d11/d2f/d27/d52/f5e [3906473,61600] 0 2024-09-21T08:02:29.955 INFO:tasks.workunit.client.1.smithi129.stdout:0/313: dwrite de/f13 [0,4194304] 0 2024-09-21T08:02:29.955 INFO:tasks.workunit.client.1.smithi129.stdout:9/311: creat d17/d22/d33/d36/d48/d3f/f69 x:0 0 0 2024-09-21T08:02:29.955 INFO:tasks.workunit.client.1.smithi129.stdout:7/358: creat d0/f75 x:0 0 0 2024-09-21T08:02:29.956 INFO:tasks.workunit.client.1.smithi129.stdout:7/359: truncate d0/d46/f61 808833 0 2024-09-21T08:02:29.956 INFO:tasks.workunit.client.1.smithi129.stdout:8/250: creat d0/d6/f4c x:0 0 0 2024-09-21T08:02:29.957 INFO:tasks.workunit.client.1.smithi129.stdout:1/406: dread d1/d9/f1a [0,4194304] 0 2024-09-21T08:02:29.958 INFO:tasks.workunit.client.1.smithi129.stdout:1/407: dread - d1/d16/d25/f61 zero size 2024-09-21T08:02:29.966 INFO:tasks.workunit.client.1.smithi129.stdout:3/310: creat d3/f63 x:0 0 0 2024-09-21T08:02:29.969 INFO:tasks.workunit.client.1.smithi129.stdout:0/314: creat de/d15/d51/f5d x:0 0 0 2024-09-21T08:02:29.971 INFO:tasks.workunit.client.1.smithi129.stdout:7/360: symlink d0/d46/l76 0 2024-09-21T08:02:29.971 INFO:tasks.workunit.client.1.smithi129.stdout:7/361: stat d0/d46/d6e/f6d 0 2024-09-21T08:02:29.971 INFO:tasks.workunit.client.1.smithi129.stdout:7/362: creat d0/f77 x:0 0 0 2024-09-21T08:02:29.972 INFO:tasks.workunit.client.1.smithi129.stdout:8/251: rename d0/d6/cd to d0/d6/d7/d18/c4d 0 2024-09-21T08:02:29.972 INFO:tasks.workunit.client.1.smithi129.stdout:9/312: symlink d17/l6a 0 2024-09-21T08:02:29.974 INFO:tasks.workunit.client.1.smithi129.stdout:7/363: mknod d0/d46/d6e/c78 0 2024-09-21T08:02:29.975 INFO:tasks.workunit.client.1.smithi129.stdout:7/364: creat d0/f79 x:0 0 0 2024-09-21T08:02:29.975 INFO:tasks.workunit.client.1.smithi129.stdout:7/365: dread - d0/f5e zero size 2024-09-21T08:02:29.975 INFO:tasks.workunit.client.1.smithi129.stdout:7/366: write d0/d1e/f55 [2304388,107867] 0 2024-09-21T08:02:29.975 INFO:tasks.workunit.client.1.smithi129.stdout:8/252: link d0/d6/d7/d18/d27/l29 d0/d6/d7/d24/l4e 0 2024-09-21T08:02:29.977 INFO:tasks.workunit.client.1.smithi129.stdout:9/313: mkdir d17/d2c/d31/d5e/d6b 0 2024-09-21T08:02:29.980 INFO:tasks.workunit.client.1.smithi129.stdout:7/367: creat d0/d1e/f7a x:0 0 0 2024-09-21T08:02:29.981 INFO:tasks.workunit.client.1.smithi129.stdout:7/368: symlink d0/l7b 0 2024-09-21T08:02:29.983 INFO:tasks.workunit.client.1.smithi129.stdout:7/369: link d0/d1e/c4e d0/c7c 0 2024-09-21T08:02:29.984 INFO:tasks.workunit.client.1.smithi129.stdout:1/408: dwrite d1/d9/f42 [4194304,4194304] 0 2024-09-21T08:02:29.984 INFO:tasks.workunit.client.1.smithi129.stdout:1/409: creat d1/f8e x:0 0 0 2024-09-21T08:02:29.984 INFO:tasks.workunit.client.1.smithi129.stdout:1/410: truncate d1/d4/f21 4995303 0 2024-09-21T08:02:29.984 INFO:tasks.workunit.client.1.smithi129.stdout:1/411: chown d1/d44/c75 7345 1 2024-09-21T08:02:30.002 INFO:tasks.workunit.client.1.smithi129.stdout:9/314: dwrite d17/f49 [0,4194304] 0 2024-09-21T08:02:30.004 INFO:tasks.workunit.client.1.smithi129.stdout:9/315: dread f13 [0,4194304] 0 2024-09-21T08:02:30.004 INFO:tasks.workunit.client.1.smithi129.stdout:9/316: truncate d17/d22/d33/d36/d48/d3f/f67 211982 0 2024-09-21T08:02:30.005 INFO:tasks.workunit.client.1.smithi129.stdout:9/317: link d17/d2c/d31/l45 d17/d2c/d31/d5e/d6b/l6c 0 2024-09-21T08:02:30.006 INFO:tasks.workunit.client.1.smithi129.stdout:9/318: mknod d17/d46/c6d 0 2024-09-21T08:02:30.006 INFO:tasks.workunit.client.1.smithi129.stdout:9/319: mknod d17/d38/c6e 0 2024-09-21T08:02:30.012 INFO:tasks.workunit.client.1.smithi129.stdout:9/320: dread d17/d46/f4b [0,4194304] 0 2024-09-21T08:02:30.051 INFO:tasks.workunit.client.1.smithi129.stdout:7/370: write d0/f22 [3190230,120281] 0 2024-09-21T08:02:30.052 INFO:tasks.workunit.client.1.smithi129.stdout:7/371: dread - d0/f75 zero size 2024-09-21T08:02:30.052 INFO:tasks.workunit.client.1.smithi129.stdout:7/372: creat d0/d46/d6e/f7d x:0 0 0 2024-09-21T08:02:30.052 INFO:tasks.workunit.client.1.smithi129.stdout:7/373: write d0/f79 [159796,31706] 0 2024-09-21T08:02:30.052 INFO:tasks.workunit.client.1.smithi129.stdout:7/374: chown d0/l4f 102 1 2024-09-21T08:02:30.052 INFO:tasks.workunit.client.1.smithi129.stdout:7/375: readlink d0/d1e/l49 0 2024-09-21T08:02:30.053 INFO:tasks.workunit.client.1.smithi129.stdout:1/412: read d1/d16/d28/f33 [3938789,57133] 0 2024-09-21T08:02:30.053 INFO:tasks.workunit.client.1.smithi129.stdout:7/376: link d0/d1e/f21 d0/d46/d6e/f7e 0 2024-09-21T08:02:30.053 INFO:tasks.workunit.client.1.smithi129.stdout:7/377: read d0/d46/d6e/f7e [678089,2419] 0 2024-09-21T08:02:30.053 INFO:tasks.workunit.client.1.smithi129.stdout:1/413: stat d1/d44/c47 0 2024-09-21T08:02:30.054 INFO:tasks.workunit.client.1.smithi129.stdout:7/378: creat d0/d71/f7f x:0 0 0 2024-09-21T08:02:30.055 INFO:tasks.workunit.client.1.smithi129.stdout:1/414: rename d1/d16/d25/d73 to d1/d16/d8f 0 2024-09-21T08:02:30.055 INFO:tasks.workunit.client.1.smithi129.stdout:1/415: readlink d1/d16/d28/l8b 0 2024-09-21T08:02:30.057 INFO:tasks.workunit.client.1.smithi129.stdout:8/253: dwrite d0/d6/d7/d24/f36 [0,4194304] 0 2024-09-21T08:02:30.057 INFO:tasks.workunit.client.1.smithi129.stdout:1/416: dread d1/f39 [0,4194304] 0 2024-09-21T08:02:30.057 INFO:tasks.workunit.client.1.smithi129.stdout:1/417: fdatasync d1/f50 0 2024-09-21T08:02:30.058 INFO:tasks.workunit.client.1.smithi129.stdout:1/418: stat d1/d9/f26 0 2024-09-21T08:02:30.059 INFO:tasks.workunit.client.1.smithi129.stdout:1/419: mknod d1/d9/c90 0 2024-09-21T08:02:30.059 INFO:tasks.workunit.client.1.smithi129.stdout:1/420: fdatasync d1/f39 0 2024-09-21T08:02:30.059 INFO:tasks.workunit.client.1.smithi129.stdout:1/421: creat d1/d9/d6b/f91 x:0 0 0 2024-09-21T08:02:30.060 INFO:tasks.workunit.client.1.smithi129.stdout:1/422: mknod d1/d64/d7f/c92 0 2024-09-21T08:02:30.061 INFO:tasks.workunit.client.1.smithi129.stdout:1/423: stat d1/d4/c7 0 2024-09-21T08:02:30.061 INFO:tasks.workunit.client.1.smithi129.stdout:1/424: truncate d1/d64/f66 490316 0 2024-09-21T08:02:30.061 INFO:tasks.workunit.client.1.smithi129.stdout:1/425: chown d1/d9/l67 18 1 2024-09-21T08:02:30.061 INFO:tasks.workunit.client.1.smithi129.stdout:1/426: creat d1/d16/d28/f93 x:0 0 0 2024-09-21T08:02:30.061 INFO:tasks.workunit.client.1.smithi129.stdout:1/427: chown d1/d9/d31/f5e 13 1 2024-09-21T08:02:30.065 INFO:tasks.workunit.client.1.smithi129.stdout:9/321: dwrite d17/d22/d33/d36/d48/d3f/f69 [0,4194304] 0 2024-09-21T08:02:30.065 INFO:tasks.workunit.client.1.smithi129.stdout:9/322: write d17/d38/f52 [231572,117788] 0 2024-09-21T08:02:30.066 INFO:tasks.workunit.client.1.smithi129.stdout:9/323: write d17/d2c/d31/f5c [288760,109759] 0 2024-09-21T08:02:30.067 INFO:tasks.workunit.client.1.smithi129.stdout:0/315: dwrite de/d22/d27/f4c [0,4194304] 0 2024-09-21T08:02:30.067 INFO:tasks.workunit.client.1.smithi129.stdout:0/316: chown de/d15/d44/d45 3157441 1 2024-09-21T08:02:30.071 INFO:tasks.workunit.client.1.smithi129.stdout:9/324: rmdir d17/d2c/d31/d5e/d6b 39 2024-09-21T08:02:30.074 INFO:tasks.workunit.client.1.smithi129.stdout:0/317: mkdir de/d19/d5e 0 2024-09-21T08:02:30.075 INFO:tasks.workunit.client.1.smithi129.stdout:9/325: creat d17/d2c/d31/d35/f6f x:0 0 0 2024-09-21T08:02:30.076 INFO:tasks.workunit.client.1.smithi129.stdout:0/318: creat de/d15/d39/d56/f5f x:0 0 0 2024-09-21T08:02:30.076 INFO:tasks.workunit.client.1.smithi129.stdout:9/326: rmdir d17/d2c/d31/d5e/d6b 39 2024-09-21T08:02:30.078 INFO:tasks.workunit.client.1.smithi129.stdout:0/319: symlink de/d15/l60 0 2024-09-21T08:02:30.078 INFO:tasks.workunit.client.1.smithi129.stdout:0/320: read de/d1f/f34 [144864,26169] 0 2024-09-21T08:02:30.078 INFO:tasks.workunit.client.1.smithi129.stdout:0/321: write de/d15/d39/f41 [81789,21296] 0 2024-09-21T08:02:30.078 INFO:tasks.workunit.client.1.smithi129.stdout:9/327: mknod d17/d22/c70 0 2024-09-21T08:02:30.079 INFO:tasks.workunit.client.1.smithi129.stdout:5/333: sync 2024-09-21T08:02:30.079 INFO:tasks.workunit.client.1.smithi129.stdout:4/257: sync 2024-09-21T08:02:30.079 INFO:tasks.workunit.client.1.smithi129.stdout:4/258: chown d5/d16/d24/d4f 2034 1 2024-09-21T08:02:30.079 INFO:tasks.workunit.client.1.smithi129.stdout:5/334: truncate d2/d2a/d50/f63 787594 0 2024-09-21T08:02:30.080 INFO:tasks.workunit.client.1.smithi129.stdout:4/259: dread - d5/d6/f44 zero size 2024-09-21T08:02:30.080 INFO:tasks.workunit.client.1.smithi129.stdout:5/335: chown d2/c21 0 1 2024-09-21T08:02:30.080 INFO:tasks.workunit.client.1.smithi129.stdout:5/336: stat d2/d1e 0 2024-09-21T08:02:30.080 INFO:tasks.workunit.client.1.smithi129.stdout:2/494: sync 2024-09-21T08:02:30.080 INFO:tasks.workunit.client.1.smithi129.stdout:2/495: readlink d1/dc/d26/d45/d65/d50/l7d 0 2024-09-21T08:02:30.080 INFO:tasks.workunit.client.1.smithi129.stdout:2/496: dread - d1/dc/d26/f62 zero size 2024-09-21T08:02:30.080 INFO:tasks.workunit.client.1.smithi129.stdout:1/428: dwrite d1/d4/f6d [0,4194304] 0 2024-09-21T08:02:30.080 INFO:tasks.workunit.client.1.smithi129.stdout:1/429: chown d1/d9/d31/f62 3980177 1 2024-09-21T08:02:30.081 INFO:tasks.workunit.client.1.smithi129.stdout:4/260: mknod d5/d11/d3f/c5b 0 2024-09-21T08:02:30.081 INFO:tasks.workunit.client.1.smithi129.stdout:4/261: chown d5/f14 459291838 1 2024-09-21T08:02:30.081 INFO:tasks.workunit.client.1.smithi129.stdout:4/262: chown d5/d16/d47 2 1 2024-09-21T08:02:30.081 INFO:tasks.workunit.client.1.smithi129.stdout:2/497: unlink d1/d13/d3a/d47/d1f/f35 0 2024-09-21T08:02:30.087 INFO:tasks.workunit.client.1.smithi129.stdout:4/263: link d5/d16/d24/d3b/f4a d5/f5c 0 2024-09-21T08:02:30.087 INFO:tasks.workunit.client.1.smithi129.stdout:4/264: chown d5/d16/f32 6 1 2024-09-21T08:02:30.087 INFO:tasks.workunit.client.1.smithi129.stdout:2/498: fsync d1/dc/f10 0 2024-09-21T08:02:30.089 INFO:tasks.workunit.client.1.smithi129.stdout:0/322: write de/d22/d27/f4c [1110323,36137] 0 2024-09-21T08:02:30.089 INFO:tasks.workunit.client.1.smithi129.stdout:7/379: dwrite d0/d1e/f21 [4194304,4194304] 0 2024-09-21T08:02:30.090 INFO:tasks.workunit.client.1.smithi129.stdout:2/499: unlink d1/d13/d3a/d47/d1f/fa3 0 2024-09-21T08:02:30.090 INFO:tasks.workunit.client.1.smithi129.stdout:2/500: chown d1/la 0 1 2024-09-21T08:02:30.091 INFO:tasks.workunit.client.1.smithi129.stdout:4/265: rmdir d5/d35 39 2024-09-21T08:02:30.094 INFO:tasks.workunit.client.1.smithi129.stdout:7/380: mknod d0/d46/c80 0 2024-09-21T08:02:30.095 INFO:tasks.workunit.client.1.smithi129.stdout:2/501: mknod d1/dc/d26/d45/d65/d93/cba 0 2024-09-21T08:02:30.095 INFO:tasks.workunit.client.1.smithi129.stdout:2/502: chown d1/ca0 149179902 1 2024-09-21T08:02:30.097 INFO:tasks.workunit.client.1.smithi129.stdout:4/266: symlink d5/l5d 0 2024-09-21T08:02:30.097 INFO:tasks.workunit.client.1.smithi129.stdout:4/267: write d5/f14 [4832037,81347] 0 2024-09-21T08:02:30.099 INFO:tasks.workunit.client.1.smithi129.stdout:4/268: mknod d5/d16/d24/c5e 0 2024-09-21T08:02:30.104 INFO:tasks.workunit.client.1.smithi129.stdout:2/503: dread d1/dc/d26/f33 [0,4194304] 0 2024-09-21T08:02:30.106 INFO:tasks.workunit.client.1.smithi129.stdout:2/504: rename d1/d13/f24 to d1/d13/d32/d97/fbb 0 2024-09-21T08:02:30.106 INFO:tasks.workunit.client.1.smithi129.stdout:5/337: dwrite d2/f60 [0,4194304] 0 2024-09-21T08:02:30.107 INFO:tasks.workunit.client.1.smithi129.stdout:6/286: sync 2024-09-21T08:02:30.107 INFO:tasks.workunit.client.1.smithi129.stdout:6/287: chown d7/d1b/d25/d35/l65 55022 1 2024-09-21T08:02:30.108 INFO:tasks.workunit.client.1.smithi129.stdout:7/381: dread d0/d1e/f40 [0,4194304] 0 2024-09-21T08:02:30.108 INFO:tasks.workunit.client.1.smithi129.stdout:7/382: creat d0/d1e/f81 x:0 0 0 2024-09-21T08:02:30.108 INFO:tasks.workunit.client.1.smithi129.stdout:2/505: symlink d1/d53/d68/lbc 0 2024-09-21T08:02:30.111 INFO:tasks.workunit.client.1.smithi129.stdout:9/328: dwrite d17/d22/d33/d36/f65 [0,4194304] 0 2024-09-21T08:02:30.111 INFO:tasks.workunit.client.1.smithi129.stdout:5/338: creat d2/d1e/d35/d62/f66 x:0 0 0 2024-09-21T08:02:30.111 INFO:tasks.workunit.client.1.smithi129.stdout:5/339: write d2/d1e/f1f [781747,96788] 0 2024-09-21T08:02:30.111 INFO:tasks.workunit.client.1.smithi129.stdout:6/288: mkdir d7/d1b/d1e/d39/d4b/d67 0 2024-09-21T08:02:30.112 INFO:tasks.workunit.client.1.smithi129.stdout:7/383: mknod d0/d71/c82 0 2024-09-21T08:02:30.112 INFO:tasks.workunit.client.1.smithi129.stdout:7/384: chown d0/d1e/f3e 5729358 1 2024-09-21T08:02:30.112 INFO:tasks.workunit.client.1.smithi129.stdout:7/385: creat d0/d46/d6e/f83 x:0 0 0 2024-09-21T08:02:30.114 INFO:tasks.workunit.client.1.smithi129.stdout:6/289: symlink d7/d1b/d25/d2b/d3e/d5e/l68 0 2024-09-21T08:02:30.114 INFO:tasks.workunit.client.1.smithi129.stdout:6/290: write d7/d1b/d1e/d39/d4b/f4d [698740,116122] 0 2024-09-21T08:02:30.116 INFO:tasks.workunit.client.1.smithi129.stdout:7/386: rename d0/d46/l6c to d0/d46/d6e/l84 0 2024-09-21T08:02:30.116 INFO:tasks.workunit.client.1.smithi129.stdout:7/387: chown d0/lb 509210000 1 2024-09-21T08:02:30.116 INFO:tasks.workunit.client.1.smithi129.stdout:7/388: chown d0/l2a 565 1 2024-09-21T08:02:30.117 INFO:tasks.workunit.client.1.smithi129.stdout:7/389: creat d0/d46/d6e/f85 x:0 0 0 2024-09-21T08:02:30.117 INFO:tasks.workunit.client.1.smithi129.stdout:7/390: creat d0/d46/f86 x:0 0 0 2024-09-21T08:02:30.119 INFO:tasks.workunit.client.1.smithi129.stdout:0/323: dwrite de/d15/f43 [0,4194304] 0 2024-09-21T08:02:30.119 INFO:tasks.workunit.client.1.smithi129.stdout:0/324: fsync de/d22/d27/f2d 0 2024-09-21T08:02:30.119 INFO:tasks.workunit.client.1.smithi129.stdout:0/325: chown de/d15/d39/d56 33 1 2024-09-21T08:02:30.119 INFO:tasks.workunit.client.1.smithi129.stdout:0/326: creat de/d22/d27/d2f/f61 x:0 0 0 2024-09-21T08:02:30.121 INFO:tasks.workunit.client.1.smithi129.stdout:0/327: creat de/d15/d44/d45/f62 x:0 0 0 2024-09-21T08:02:30.123 INFO:tasks.workunit.client.1.smithi129.stdout:0/328: rmdir de/d1f 39 2024-09-21T08:02:30.125 INFO:tasks.workunit.client.1.smithi129.stdout:0/329: rename de/d15/d44/d4b/f54 to de/d15/d39/d56/f63 0 2024-09-21T08:02:30.125 INFO:tasks.workunit.client.1.smithi129.stdout:0/330: chown de/d22/d27/d30/f35 53 1 2024-09-21T08:02:30.125 INFO:tasks.workunit.client.1.smithi129.stdout:0/331: write de/d15/d44/d45/f62 [633484,127279] 0 2024-09-21T08:02:30.125 INFO:tasks.workunit.client.1.smithi129.stdout:0/332: creat de/f64 x:0 0 0 2024-09-21T08:02:30.125 INFO:tasks.workunit.client.1.smithi129.stdout:0/333: write de/d15/f3d [4126844,81458] 0 2024-09-21T08:02:30.125 INFO:tasks.workunit.client.1.smithi129.stdout:0/334: fdatasync f6 0 2024-09-21T08:02:30.135 INFO:tasks.workunit.client.1.smithi129.stdout:1/430: dwrite d1/d16/d57/f88 [0,4194304] 0 2024-09-21T08:02:30.135 INFO:tasks.workunit.client.1.smithi129.stdout:1/431: readlink d1/d9/l32 0 2024-09-21T08:02:30.135 INFO:tasks.workunit.client.1.smithi129.stdout:1/432: mknod d1/d16/d28/c94 0 2024-09-21T08:02:30.135 INFO:tasks.workunit.client.1.smithi129.stdout:1/433: fsync d1/d16/d25/f61 0 2024-09-21T08:02:30.151 INFO:tasks.workunit.client.1.smithi129.stdout:4/269: dwrite d5/d16/f29 [0,4194304] 0 2024-09-21T08:02:30.152 INFO:tasks.workunit.client.1.smithi129.stdout:4/270: write d5/d16/d24/d3b/f4a [592215,76687] 0 2024-09-21T08:02:30.154 INFO:tasks.workunit.client.1.smithi129.stdout:4/271: mkdir d5/d16/d47/d5f 0 2024-09-21T08:02:30.154 INFO:tasks.workunit.client.1.smithi129.stdout:4/272: stat d5/d33/d4e 0 2024-09-21T08:02:30.160 INFO:tasks.workunit.client.1.smithi129.stdout:2/506: dwrite d1/dc/d26/d45/d65/fa8 [0,4194304] 0 2024-09-21T08:02:30.161 INFO:tasks.workunit.client.1.smithi129.stdout:6/291: dwrite f4 [0,4194304] 0 2024-09-21T08:02:30.163 INFO:tasks.workunit.client.1.smithi129.stdout:9/329: dwrite d17/d2c/d31/f5a [4194304,4194304] 0 2024-09-21T08:02:30.163 INFO:tasks.workunit.client.1.smithi129.stdout:5/340: dwrite d2/f1d [0,4194304] 0 2024-09-21T08:02:30.164 INFO:tasks.workunit.client.1.smithi129.stdout:9/330: truncate d17/d22/d33/d36/f63 396783 0 2024-09-21T08:02:30.164 INFO:tasks.workunit.client.1.smithi129.stdout:9/331: fsync d17/d46/f5f 0 2024-09-21T08:02:30.164 INFO:tasks.workunit.client.1.smithi129.stdout:0/335: dwrite de/d1f/f24 [0,4194304] 0 2024-09-21T08:02:30.164 INFO:tasks.workunit.client.1.smithi129.stdout:0/336: fsync de/d22/d27/d30/f52 0 2024-09-21T08:02:30.164 INFO:tasks.workunit.client.1.smithi129.stdout:2/507: mknod d1/dc/d19/cbd 0 2024-09-21T08:02:30.164 INFO:tasks.workunit.client.1.smithi129.stdout:2/508: chown d1/dc/d26/f33 5778 1 2024-09-21T08:02:30.164 INFO:tasks.workunit.client.1.smithi129.stdout:2/509: truncate d1/d13/d3a/f6f 923332 0 2024-09-21T08:02:30.164 INFO:tasks.workunit.client.1.smithi129.stdout:2/510: stat d1/d53/d68 0 2024-09-21T08:02:30.166 INFO:tasks.workunit.client.1.smithi129.stdout:7/391: dwrite d0/d46/d6e/f5c [0,4194304] 0 2024-09-21T08:02:30.169 INFO:tasks.workunit.client.1.smithi129.stdout:0/337: symlink de/l65 0 2024-09-21T08:02:30.170 INFO:tasks.workunit.client.1.smithi129.stdout:0/338: creat de/d19/f66 x:0 0 0 2024-09-21T08:02:30.170 INFO:tasks.workunit.client.1.smithi129.stdout:6/292: mkdir d7/d4a/d69 0 2024-09-21T08:02:30.173 INFO:tasks.workunit.client.1.smithi129.stdout:4/273: dwrite d5/d6/f2f [0,4194304] 0 2024-09-21T08:02:30.173 INFO:tasks.workunit.client.1.smithi129.stdout:4/274: creat d5/d11/d3f/d50/f60 x:0 0 0 2024-09-21T08:02:30.176 INFO:tasks.workunit.client.1.smithi129.stdout:1/434: truncate d1/d16/d57/f88 2213401 0 2024-09-21T08:02:30.181 INFO:tasks.workunit.client.1.smithi129.stdout:2/511: dread d1/dc/f18 [0,4194304] 0 2024-09-21T08:02:30.194 INFO:tasks.workunit.client.1.smithi129.stdout:5/341: dwrite d2/d1e/d35/f40 [0,4194304] 0 2024-09-21T08:02:30.200 INFO:tasks.workunit.client.1.smithi129.stdout:9/332: dwrite d17/d46/f4b [0,4194304] 0 2024-09-21T08:02:30.200 INFO:tasks.workunit.client.1.smithi129.stdout:9/333: write d17/d23/f2d [345778,53639] 0 2024-09-21T08:02:30.200 INFO:tasks.workunit.client.1.smithi129.stdout:7/392: dwrite d0/d46/d6e/f5c [0,4194304] 0 2024-09-21T08:02:30.211 INFO:tasks.workunit.client.1.smithi129.stdout:9/334: write d17/d46/f4f [2814453,20846] 0 2024-09-21T08:02:30.211 INFO:tasks.workunit.client.1.smithi129.stdout:9/335: truncate d17/d2c/f43 4540275 0 2024-09-21T08:02:30.211 INFO:tasks.workunit.client.1.smithi129.stdout:6/293: symlink d7/d1b/d1e/d39/d4b/d67/l6a 0 2024-09-21T08:02:30.212 INFO:tasks.workunit.client.1.smithi129.stdout:6/294: dread d7/d1b/d25/d35/d40/d41/f48 [0,4194304] 0 2024-09-21T08:02:30.217 INFO:tasks.workunit.client.1.smithi129.stdout:1/435: truncate d1/fd 1635706 0 2024-09-21T08:02:30.218 INFO:tasks.workunit.client.1.smithi129.stdout:7/393: dwrite d0/d71/f7f [0,4194304] 0 2024-09-21T08:02:30.218 INFO:tasks.workunit.client.1.smithi129.stdout:7/394: chown d0/d46/l74 263926 1 2024-09-21T08:02:30.218 INFO:tasks.workunit.client.1.smithi129.stdout:7/395: write d0/f22 [6346424,15170] 0 2024-09-21T08:02:30.219 INFO:tasks.workunit.client.1.smithi129.stdout:2/512: rename d1/dc/d26/d45/d65/d50/c59 to d1/d53/d68/cbe 0 2024-09-21T08:02:30.220 INFO:tasks.workunit.client.1.smithi129.stdout:5/342: unlink d2/f18 0 2024-09-21T08:02:30.224 INFO:tasks.workunit.client.1.smithi129.stdout:9/336: mkdir d17/d22/d33/d36/d48/d3f/d71 0 2024-09-21T08:02:30.224 INFO:tasks.workunit.client.1.smithi129.stdout:3/311: sync 2024-09-21T08:02:30.224 INFO:tasks.workunit.client.1.smithi129.stdout:8/254: sync 2024-09-21T08:02:30.225 INFO:tasks.workunit.client.1.smithi129.stdout:3/312: fdatasync d3/da/dc/d11/f34 0 2024-09-21T08:02:30.225 INFO:tasks.workunit.client.1.smithi129.stdout:3/313: read d3/da/dc/d11/d2f/d27/f4e [661212,117748] 0 2024-09-21T08:02:30.225 INFO:tasks.workunit.client.1.smithi129.stdout:6/295: truncate d7/d1b/d25/d35/d40/d41/f5d 3939462 0 2024-09-21T08:02:30.226 INFO:tasks.workunit.client.1.smithi129.stdout:0/339: rmdir de/d19 39 2024-09-21T08:02:30.226 INFO:tasks.workunit.client.1.smithi129.stdout:0/340: chown de/f3c 0 1 2024-09-21T08:02:30.226 INFO:tasks.workunit.client.1.smithi129.stdout:0/341: dread - de/d15/d44/d4b/f5c zero size 2024-09-21T08:02:30.226 INFO:tasks.workunit.client.1.smithi129.stdout:0/342: fsync de/d22/f26 0 2024-09-21T08:02:30.226 INFO:tasks.workunit.client.1.smithi129.stdout:0/343: write de/d22/d27/f2d [1125499,96041] 0 2024-09-21T08:02:30.230 INFO:tasks.workunit.client.1.smithi129.stdout:1/436: truncate d1/d4/f21 2415185 0 2024-09-21T08:02:30.231 INFO:tasks.workunit.client.1.smithi129.stdout:1/437: dread d1/d7a/f7c [0,4194304] 0 2024-09-21T08:02:30.231 INFO:tasks.workunit.client.1.smithi129.stdout:7/396: symlink d0/d71/l87 0 2024-09-21T08:02:30.231 INFO:tasks.workunit.client.1.smithi129.stdout:7/397: write d0/d46/d6e/f7e [3032543,22970] 0 2024-09-21T08:02:30.232 INFO:tasks.workunit.client.1.smithi129.stdout:4/275: rmdir d5/d11/d3f/d50 39 2024-09-21T08:02:30.233 INFO:tasks.workunit.client.1.smithi129.stdout:5/343: mknod d2/d1e/d35/d33/c67 0 2024-09-21T08:02:30.233 INFO:tasks.workunit.client.1.smithi129.stdout:5/344: chown d2/d1e/d35/d33/d36/d5a/f5b 85800715 1 2024-09-21T08:02:30.234 INFO:tasks.workunit.client.1.smithi129.stdout:8/255: mknod d0/d6/d7/d18/d27/d32/d37/c4f 0 2024-09-21T08:02:30.235 INFO:tasks.workunit.client.1.smithi129.stdout:0/344: creat de/d22/d27/d30/f67 x:0 0 0 2024-09-21T08:02:30.235 INFO:tasks.workunit.client.1.smithi129.stdout:0/345: chown de/d15/d39/d56 18 1 2024-09-21T08:02:30.236 INFO:tasks.workunit.client.1.smithi129.stdout:1/438: link d1/d16/d28/f54 d1/d7a/f95 0 2024-09-21T08:02:30.236 INFO:tasks.workunit.client.1.smithi129.stdout:2/513: dwrite d1/d53/fb3 [0,4194304] 0 2024-09-21T08:02:30.237 INFO:tasks.workunit.client.1.smithi129.stdout:3/314: dread d3/da/dc/d25/f41 [0,4194304] 0 2024-09-21T08:02:30.238 INFO:tasks.workunit.client.1.smithi129.stdout:4/276: mkdir d5/d16/d47/d61 0 2024-09-21T08:02:30.239 INFO:tasks.workunit.client.1.smithi129.stdout:5/345: rename f1 to d2/d2a/f68 0 2024-09-21T08:02:30.240 INFO:tasks.workunit.client.1.smithi129.stdout:9/337: getdents d17/d2c/d31/d35 0 2024-09-21T08:02:30.243 INFO:tasks.workunit.client.1.smithi129.stdout:0/346: mknod de/d19/d5e/c68 0 2024-09-21T08:02:30.243 INFO:tasks.workunit.client.1.smithi129.stdout:1/439: mkdir d1/d4/d96 0 2024-09-21T08:02:30.243 INFO:tasks.workunit.client.1.smithi129.stdout:1/440: stat d1/d16/f29 0 2024-09-21T08:02:30.243 INFO:tasks.workunit.client.1.smithi129.stdout:1/441: truncate d1/d7a/f95 876380 0 2024-09-21T08:02:30.245 INFO:tasks.workunit.client.1.smithi129.stdout:1/442: dread d1/d9/d31/f62 [0,4194304] 0 2024-09-21T08:02:30.246 INFO:tasks.workunit.client.1.smithi129.stdout:2/514: creat d1/dc/d94/fbf x:0 0 0 2024-09-21T08:02:30.247 INFO:tasks.workunit.client.1.smithi129.stdout:9/338: dread f15 [0,4194304] 0 2024-09-21T08:02:30.248 INFO:tasks.workunit.client.1.smithi129.stdout:7/398: rmdir d0/d1e 39 2024-09-21T08:02:30.248 INFO:tasks.workunit.client.1.smithi129.stdout:7/399: write d0/f5e [1021547,75029] 0 2024-09-21T08:02:30.248 INFO:tasks.workunit.client.1.smithi129.stdout:7/400: write d0/d1e/f3e [639327,115288] 0 2024-09-21T08:02:30.249 INFO:tasks.workunit.client.1.smithi129.stdout:3/315: mknod d3/da/d5d/c64 0 2024-09-21T08:02:30.249 INFO:tasks.workunit.client.1.smithi129.stdout:3/316: write d3/da/dc/d11/d2f/d27/f4e [1747483,71744] 0 2024-09-21T08:02:30.252 INFO:tasks.workunit.client.1.smithi129.stdout:7/401: dread d0/d1e/f4b [0,4194304] 0 2024-09-21T08:02:30.255 INFO:tasks.workunit.client.1.smithi129.stdout:5/346: creat d2/d1e/d35/d33/f69 x:0 0 0 2024-09-21T08:02:30.255 INFO:tasks.workunit.client.1.smithi129.stdout:5/347: readlink d2/d2a/l58 0 2024-09-21T08:02:30.256 INFO:tasks.workunit.client.1.smithi129.stdout:8/256: rmdir d0/d6/d7/d18/d27/d32 39 2024-09-21T08:02:30.256 INFO:tasks.workunit.client.1.smithi129.stdout:3/317: dread d3/da/dc/d25/f26 [0,4194304] 0 2024-09-21T08:02:30.256 INFO:tasks.workunit.client.1.smithi129.stdout:3/318: chown d3/c7 719443 1 2024-09-21T08:02:30.260 INFO:tasks.workunit.client.1.smithi129.stdout:2/515: link d1/dc/f18 d1/dc/d26/d45/d65/fc0 0 2024-09-21T08:02:30.261 INFO:tasks.workunit.client.1.smithi129.stdout:8/257: mknod d0/d6/d7/c50 0 2024-09-21T08:02:30.263 INFO:tasks.workunit.client.1.smithi129.stdout:0/347: rmdir de/d15/d39 39 2024-09-21T08:02:30.263 INFO:tasks.workunit.client.1.smithi129.stdout:0/348: stat de/d15/d44/d45 0 2024-09-21T08:02:30.263 INFO:tasks.workunit.client.1.smithi129.stdout:1/443: getdents d1/d4 0 2024-09-21T08:02:30.263 INFO:tasks.workunit.client.1.smithi129.stdout:9/339: read d17/f49 [1952396,62689] 0 2024-09-21T08:02:30.263 INFO:tasks.workunit.client.1.smithi129.stdout:4/277: dwrite f2 [0,4194304] 0 2024-09-21T08:02:30.264 INFO:tasks.workunit.client.1.smithi129.stdout:8/258: symlink d0/d6/d7/d24/l51 0 2024-09-21T08:02:30.264 INFO:tasks.workunit.client.1.smithi129.stdout:8/259: read - d0/d6/d7/d18/d27/f3c zero size 2024-09-21T08:02:30.269 INFO:tasks.workunit.client.1.smithi129.stdout:3/319: rmdir d3/da 39 2024-09-21T08:02:30.270 INFO:tasks.workunit.client.1.smithi129.stdout:0/349: mknod de/d22/d27/d2f/d42/c69 0 2024-09-21T08:02:30.271 INFO:tasks.workunit.client.1.smithi129.stdout:1/444: mknod d1/d4/c97 0 2024-09-21T08:02:30.272 INFO:tasks.workunit.client.1.smithi129.stdout:9/340: rmdir d17/d2c/d31/d35 39 2024-09-21T08:02:30.272 INFO:tasks.workunit.client.1.smithi129.stdout:9/341: chown d17/d2c/d31/d35/l4c 0 1 2024-09-21T08:02:30.273 INFO:tasks.workunit.client.1.smithi129.stdout:4/278: creat d5/d35/f62 x:0 0 0 2024-09-21T08:02:30.275 INFO:tasks.workunit.client.1.smithi129.stdout:2/516: rmdir d1/dc/d26/d45/d65 39 2024-09-21T08:02:30.276 INFO:tasks.workunit.client.1.smithi129.stdout:1/445: fdatasync d1/d4/f84 0 2024-09-21T08:02:30.277 INFO:tasks.workunit.client.1.smithi129.stdout:2/517: mkdir d1/d13/d3a/dc1 0 2024-09-21T08:02:30.277 INFO:tasks.workunit.client.1.smithi129.stdout:2/518: dread - d1/dc/d26/d45/d65/f92 zero size 2024-09-21T08:02:30.278 INFO:tasks.workunit.client.1.smithi129.stdout:3/320: symlink d3/da/l65 0 2024-09-21T08:02:30.278 INFO:tasks.workunit.client.1.smithi129.stdout:3/321: chown d3/da/dc/f62 7 1 2024-09-21T08:02:30.280 INFO:tasks.workunit.client.1.smithi129.stdout:2/519: link d1/dc/d19/d4c/d6a/c96 d1/d53/cc2 0 2024-09-21T08:02:30.280 INFO:tasks.workunit.client.1.smithi129.stdout:2/520: dread - d1/dc/d26/d45/d65/f9f zero size 2024-09-21T08:02:30.281 INFO:tasks.workunit.client.1.smithi129.stdout:2/521: fdatasync d1/d53/d77/f79 0 2024-09-21T08:02:30.281 INFO:tasks.workunit.client.1.smithi129.stdout:2/522: creat d1/fc3 x:0 0 0 2024-09-21T08:02:30.281 INFO:tasks.workunit.client.1.smithi129.stdout:1/446: symlink d1/d64/l98 0 2024-09-21T08:02:30.281 INFO:tasks.workunit.client.1.smithi129.stdout:1/447: read - d1/f8e zero size 2024-09-21T08:02:30.281 INFO:tasks.workunit.client.1.smithi129.stdout:1/448: creat d1/d16/d28/f99 x:0 0 0 2024-09-21T08:02:30.284 INFO:tasks.workunit.client.1.smithi129.stdout:1/449: symlink d1/d4/d96/l9a 0 2024-09-21T08:02:30.287 INFO:tasks.workunit.client.1.smithi129.stdout:7/402: dwrite d0/d1e/f55 [0,4194304] 0 2024-09-21T08:02:30.287 INFO:tasks.workunit.client.1.smithi129.stdout:7/403: fsync d0/d46/d6e/f85 0 2024-09-21T08:02:30.287 INFO:tasks.workunit.client.1.smithi129.stdout:7/404: write d0/d46/f5d [524582,103123] 0 2024-09-21T08:02:30.287 INFO:tasks.workunit.client.1.smithi129.stdout:5/348: dwrite d2/d1e/d35/d33/d36/f59 [0,4194304] 0 2024-09-21T08:02:30.287 INFO:tasks.workunit.client.1.smithi129.stdout:2/523: dread d1/d13/d3a/d47/d1f/f22 [0,4194304] 0 2024-09-21T08:02:30.288 INFO:tasks.workunit.client.1.smithi129.stdout:0/350: dwrite de/f3c [0,4194304] 0 2024-09-21T08:02:30.289 INFO:tasks.workunit.client.1.smithi129.stdout:0/351: dread - de/d22/d27/d30/f67 zero size 2024-09-21T08:02:30.291 INFO:tasks.workunit.client.1.smithi129.stdout:5/349: truncate d2/d1e/d35/ff 2621378 0 2024-09-21T08:02:30.292 INFO:tasks.workunit.client.1.smithi129.stdout:5/350: stat d2/d2a/d50/f53 0 2024-09-21T08:02:30.292 INFO:tasks.workunit.client.1.smithi129.stdout:5/351: fsync d2/d2a/d50/f63 0 2024-09-21T08:02:30.292 INFO:tasks.workunit.client.1.smithi129.stdout:5/352: creat d2/d1e/d35/d33/d36/d5a/f6a x:0 0 0 2024-09-21T08:02:30.292 INFO:tasks.workunit.client.1.smithi129.stdout:5/353: readlink d2/d2a/l58 0 2024-09-21T08:02:30.293 INFO:tasks.workunit.client.1.smithi129.stdout:2/524: creat d1/dc/d26/d45/d65/d93/fc4 x:0 0 0 2024-09-21T08:02:30.293 INFO:tasks.workunit.client.1.smithi129.stdout:4/279: write d5/d16/f32 [131567,46345] 0 2024-09-21T08:02:30.294 INFO:tasks.workunit.client.1.smithi129.stdout:2/525: rmdir d1/dc/d26/d45/d65 39 2024-09-21T08:02:30.295 INFO:tasks.workunit.client.1.smithi129.stdout:0/352: dread f7 [0,4194304] 0 2024-09-21T08:02:30.296 INFO:tasks.workunit.client.1.smithi129.stdout:2/526: symlink d1/dc/d19/d4c/d6a/d69/lc5 0 2024-09-21T08:02:30.296 INFO:tasks.workunit.client.1.smithi129.stdout:2/527: write d1/dc/d26/d45/d65/d93/fae [794115,6791] 0 2024-09-21T08:02:30.296 INFO:tasks.workunit.client.1.smithi129.stdout:2/528: chown d1/dc/d19/d4c/lb1 7 1 2024-09-21T08:02:30.304 INFO:tasks.workunit.client.1.smithi129.stdout:5/354: dread d2/d1e/d35/d33/d36/f59 [0,4194304] 0 2024-09-21T08:02:30.305 INFO:tasks.workunit.client.1.smithi129.stdout:5/355: unlink d2/d1e/d35/c30 0 2024-09-21T08:02:30.308 INFO:tasks.workunit.client.1.smithi129.stdout:5/356: rename d2/d1e/d35/d62 to d2/d1e/d6b 0 2024-09-21T08:02:30.309 INFO:tasks.workunit.client.1.smithi129.stdout:5/357: symlink d2/d1e/d6b/l6c 0 2024-09-21T08:02:30.310 INFO:tasks.workunit.client.1.smithi129.stdout:5/358: symlink d2/d1e/d35/d37/d65/l6d 0 2024-09-21T08:02:30.311 INFO:tasks.workunit.client.1.smithi129.stdout:2/529: write d1/d13/f28 [2102603,125964] 0 2024-09-21T08:02:30.311 INFO:tasks.workunit.client.1.smithi129.stdout:0/353: dread de/d19/f46 [0,4194304] 0 2024-09-21T08:02:30.312 INFO:tasks.workunit.client.1.smithi129.stdout:0/354: mknod de/d15/d39/d5b/c6a 0 2024-09-21T08:02:30.313 INFO:tasks.workunit.client.1.smithi129.stdout:0/355: symlink de/d15/d39/d56/l6b 0 2024-09-21T08:02:30.313 INFO:tasks.workunit.client.1.smithi129.stdout:0/356: write de/d22/d27/d2f/f61 [355508,87675] 0 2024-09-21T08:02:30.325 INFO:tasks.workunit.client.1.smithi129.stdout:2/530: dread d1/dc/d26/d45/d65/fa8 [0,4194304] 0 2024-09-21T08:02:30.328 INFO:tasks.workunit.client.1.smithi129.stdout:2/531: creat d1/d13/d3a/d47/d5f/fc6 x:0 0 0 2024-09-21T08:02:30.330 INFO:tasks.workunit.client.1.smithi129.stdout:1/450: dwrite d1/f3 [0,4194304] 0 2024-09-21T08:02:30.330 INFO:tasks.workunit.client.1.smithi129.stdout:1/451: truncate d1/d9/d6b/f8a 917916 0 2024-09-21T08:02:30.330 INFO:tasks.workunit.client.1.smithi129.stdout:1/452: chown d1/d9/d6b 28461451 1 2024-09-21T08:02:30.330 INFO:tasks.workunit.client.1.smithi129.stdout:3/322: dwrite d3/da/dc/d11/d55/f61 [0,4194304] 0 2024-09-21T08:02:30.330 INFO:tasks.workunit.client.1.smithi129.stdout:3/323: getdents d3/d57 0 2024-09-21T08:02:30.330 INFO:tasks.workunit.client.1.smithi129.stdout:3/324: dread - d3/da/f54 zero size 2024-09-21T08:02:30.332 INFO:tasks.workunit.client.1.smithi129.stdout:1/453: mkdir d1/d16/d9b 0 2024-09-21T08:02:30.343 INFO:tasks.workunit.client.1.smithi129.stdout:2/532: read d1/dc/d19/d4c/d6a/f82 [797882,54925] 0 2024-09-21T08:02:30.343 INFO:tasks.workunit.client.1.smithi129.stdout:2/533: fdatasync d1/d53/f8d 0 2024-09-21T08:02:30.344 INFO:tasks.workunit.client.1.smithi129.stdout:2/534: getdents d1/dc/d26/d45/d65 0 2024-09-21T08:02:30.344 INFO:tasks.workunit.client.1.smithi129.stdout:2/535: write d1/dc/d26/d45/d65/f92 [204042,56893] 0 2024-09-21T08:02:30.345 INFO:tasks.workunit.client.1.smithi129.stdout:2/536: symlink d1/d13/d3a/d47/lc7 0 2024-09-21T08:02:30.345 INFO:tasks.workunit.client.1.smithi129.stdout:2/537: readlink d1/l4d 0 2024-09-21T08:02:30.346 INFO:tasks.workunit.client.1.smithi129.stdout:3/325: write d3/da/f49 [2425180,21142] 0 2024-09-21T08:02:30.347 INFO:tasks.workunit.client.1.smithi129.stdout:3/326: mknod d3/da/d5d/c66 0 2024-09-21T08:02:30.356 INFO:tasks.workunit.client.1.smithi129.stdout:2/538: write d1/f2e [267287,72918] 0 2024-09-21T08:02:30.356 INFO:tasks.workunit.client.1.smithi129.stdout:0/357: dwrite de/d22/d27/f2d [0,4194304] 0 2024-09-21T08:02:30.357 INFO:tasks.workunit.client.1.smithi129.stdout:5/359: dwrite d2/d1e/d35/f12 [0,4194304] 0 2024-09-21T08:02:30.357 INFO:tasks.workunit.client.1.smithi129.stdout:5/360: write d2/d1e/d35/f4d [585929,62635] 0 2024-09-21T08:02:30.358 INFO:tasks.workunit.client.1.smithi129.stdout:1/454: dwrite d1/d4/fa [0,4194304] 0 2024-09-21T08:02:30.358 INFO:tasks.workunit.client.1.smithi129.stdout:2/539: link d1/d13/d3a/d47/d5f/l64 d1/d13/d3a/lc8 0 2024-09-21T08:02:30.359 INFO:tasks.workunit.client.1.smithi129.stdout:4/280: dwrite d5/d6/f2d [0,4194304] 0 2024-09-21T08:02:30.359 INFO:tasks.workunit.client.1.smithi129.stdout:0/358: mknod de/d19/c6c 0 2024-09-21T08:02:30.359 INFO:tasks.workunit.client.1.smithi129.stdout:4/281: write d5/f5c [855733,18820] 0 2024-09-21T08:02:30.365 INFO:tasks.workunit.client.1.smithi129.stdout:3/327: dwrite d3/da/dc/d11/f4b [0,4194304] 0 2024-09-21T08:02:30.365 INFO:tasks.workunit.client.1.smithi129.stdout:5/361: write d2/d1e/f32 [1485240,82367] 0 2024-09-21T08:02:30.365 INFO:tasks.workunit.client.1.smithi129.stdout:3/328: write d3/f63 [986634,49049] 0 2024-09-21T08:02:30.365 INFO:tasks.workunit.client.1.smithi129.stdout:2/540: mknod d1/d13/d3a/d47/d1f/d85/cc9 0 2024-09-21T08:02:30.368 INFO:tasks.workunit.client.1.smithi129.stdout:1/455: rmdir d1/d9/d6b 39 2024-09-21T08:02:30.370 INFO:tasks.workunit.client.1.smithi129.stdout:3/329: rename d3/da/l65 to d3/da/dc/d11/d2f/d27/l67 0 2024-09-21T08:02:30.372 INFO:tasks.workunit.client.1.smithi129.stdout:5/362: creat d2/d2a/d50/d61/f6e x:0 0 0 2024-09-21T08:02:30.372 INFO:tasks.workunit.client.1.smithi129.stdout:5/363: chown d2/d1e/d35/d33/d36/f59 1707626 1 2024-09-21T08:02:30.373 INFO:tasks.workunit.client.1.smithi129.stdout:2/541: mknod d1/d13/d3a/d47/d1f/cca 0 2024-09-21T08:02:30.374 INFO:tasks.workunit.client.1.smithi129.stdout:1/456: symlink d1/d9/d6b/l9c 0 2024-09-21T08:02:30.374 INFO:tasks.workunit.client.1.smithi129.stdout:1/457: write d1/d9/fe [1577111,111779] 0 2024-09-21T08:02:30.375 INFO:tasks.workunit.client.1.smithi129.stdout:5/364: mkdir d2/d2a/d6f 0 2024-09-21T08:02:30.376 INFO:tasks.workunit.client.1.smithi129.stdout:2/542: creat d1/dc/d19/d4c/d9d/fcb x:0 0 0 2024-09-21T08:02:30.376 INFO:tasks.workunit.client.1.smithi129.stdout:2/543: dread - d1/d13/d32/d97/da7/faf zero size 2024-09-21T08:02:30.376 INFO:tasks.workunit.client.1.smithi129.stdout:2/544: write d1/d13/d32/f3b [984082,64266] 0 2024-09-21T08:02:30.377 INFO:tasks.workunit.client.1.smithi129.stdout:1/458: mknod d1/d16/d9b/c9d 0 2024-09-21T08:02:30.377 INFO:tasks.workunit.client.1.smithi129.stdout:1/459: stat d1/d9 0 2024-09-21T08:02:30.381 INFO:tasks.workunit.client.1.smithi129.stdout:5/365: rename d2/f1a to d2/d1e/d35/d33/d36/d5a/f70 0 2024-09-21T08:02:30.382 INFO:tasks.workunit.client.1.smithi129.stdout:1/460: creat d1/d4/f9e x:0 0 0 2024-09-21T08:02:30.383 INFO:tasks.workunit.client.1.smithi129.stdout:5/366: mkdir d2/d2a/d6f/d71 0 2024-09-21T08:02:30.383 INFO:tasks.workunit.client.1.smithi129.stdout:5/367: chown d2/d1e/d35/d33/d36/c52 2592045 1 2024-09-21T08:02:30.387 INFO:tasks.workunit.client.1.smithi129.stdout:2/545: dread d1/dc/f10 [0,4194304] 0 2024-09-21T08:02:30.387 INFO:tasks.workunit.client.1.smithi129.stdout:2/546: creat d1/dc/d19/d88/fcc x:0 0 0 2024-09-21T08:02:30.389 INFO:tasks.workunit.client.1.smithi129.stdout:6/296: sync 2024-09-21T08:02:30.396 INFO:tasks.workunit.client.1.smithi129.stdout:4/282: dwrite d5/d11/f3d [0,4194304] 0 2024-09-21T08:02:30.399 INFO:tasks.workunit.client.1.smithi129.stdout:4/283: creat d5/f63 x:0 0 0 2024-09-21T08:02:30.400 INFO:tasks.workunit.client.1.smithi129.stdout:4/284: mkdir d5/d16/d47/d5f/d64 0 2024-09-21T08:02:30.401 INFO:tasks.workunit.client.1.smithi129.stdout:5/368: dread d2/d1e/d35/f4a [0,4194304] 0 2024-09-21T08:02:30.401 INFO:tasks.workunit.client.1.smithi129.stdout:5/369: chown d2/d1e/d35/d33/d36/c52 21118 1 2024-09-21T08:02:30.401 INFO:tasks.workunit.client.1.smithi129.stdout:5/370: creat d2/d2a/d50/d61/f72 x:0 0 0 2024-09-21T08:02:30.405 INFO:tasks.workunit.client.1.smithi129.stdout:0/359: dwrite f6 [0,4194304] 0 2024-09-21T08:02:30.405 INFO:tasks.workunit.client.1.smithi129.stdout:0/360: read de/d1f/f34 [55966,29158] 0 2024-09-21T08:02:30.406 INFO:tasks.workunit.client.1.smithi129.stdout:0/361: rename de/d15/c40 to de/d1f/c6d 0 2024-09-21T08:02:30.406 INFO:tasks.workunit.client.1.smithi129.stdout:0/362: fdatasync f6 0 2024-09-21T08:02:30.406 INFO:tasks.workunit.client.1.smithi129.stdout:0/363: rename de/d15/d44/d4b to de/d15/d44/d4b/d6e 22 2024-09-21T08:02:30.410 INFO:tasks.workunit.client.1.smithi129.stdout:3/330: dwrite d3/da/dc/f23 [0,4194304] 0 2024-09-21T08:02:30.411 INFO:tasks.workunit.client.1.smithi129.stdout:1/461: dwrite d1/d16/f71 [0,4194304] 0 2024-09-21T08:02:30.411 INFO:tasks.workunit.client.1.smithi129.stdout:1/462: chown d1/f39 12 1 2024-09-21T08:02:30.411 INFO:tasks.workunit.client.1.smithi129.stdout:1/463: stat d1/d44/c47 0 2024-09-21T08:02:30.411 INFO:tasks.workunit.client.1.smithi129.stdout:5/371: dread d2/d1e/d35/f31 [0,4194304] 0 2024-09-21T08:02:30.412 INFO:tasks.workunit.client.1.smithi129.stdout:5/372: chown d2/d1e 702603 1 2024-09-21T08:02:30.412 INFO:tasks.workunit.client.1.smithi129.stdout:2/547: dwrite d1/d13/d3a/d47/f27 [0,4194304] 0 2024-09-21T08:02:30.417 INFO:tasks.workunit.client.1.smithi129.stdout:3/331: truncate d3/da/dc/d11/d2f/f40 2872917 0 2024-09-21T08:02:30.424 INFO:tasks.workunit.client.1.smithi129.stdout:2/548: link d1/d53/cc2 d1/d13/d3a/d47/ccd 0 2024-09-21T08:02:30.424 INFO:tasks.workunit.client.1.smithi129.stdout:2/549: write d1/d13/d3a/d47/d1f/f40 [1532305,2474] 0 2024-09-21T08:02:30.424 INFO:tasks.workunit.client.1.smithi129.stdout:0/364: dwrite de/d19/f66 [0,4194304] 0 2024-09-21T08:02:30.425 INFO:tasks.workunit.client.1.smithi129.stdout:3/332: mkdir d3/da/dc/d11/d55/d68 0 2024-09-21T08:02:30.427 INFO:tasks.workunit.client.1.smithi129.stdout:7/405: sync 2024-09-21T08:02:30.427 INFO:tasks.workunit.client.1.smithi129.stdout:8/260: sync 2024-09-21T08:02:30.427 INFO:tasks.workunit.client.1.smithi129.stdout:9/342: sync 2024-09-21T08:02:30.427 INFO:tasks.workunit.client.1.smithi129.stdout:8/261: truncate d0/d6/d7/d18/d27/f3c 772072 0 2024-09-21T08:02:30.431 INFO:tasks.workunit.client.1.smithi129.stdout:1/464: rmdir d1 39 2024-09-21T08:02:30.433 INFO:tasks.workunit.client.1.smithi129.stdout:5/373: rmdir d2/d2a/d50 39 2024-09-21T08:02:30.433 INFO:tasks.workunit.client.1.smithi129.stdout:2/550: mkdir d1/d53/dce 0 2024-09-21T08:02:30.434 INFO:tasks.workunit.client.1.smithi129.stdout:3/333: unlink d3/da/dc/d11/d2f/d27/c50 0 2024-09-21T08:02:30.435 INFO:tasks.workunit.client.1.smithi129.stdout:9/343: rename d17/d22/d33/d36/d48/d3f/c5b to d17/d2c/d31/d35/c72 0 2024-09-21T08:02:30.435 INFO:tasks.workunit.client.1.smithi129.stdout:9/344: write d17/d2c/d31/d35/f54 [674399,77736] 0 2024-09-21T08:02:30.435 INFO:tasks.workunit.client.1.smithi129.stdout:9/345: chown d17/d22/d33/d36/f65 361054385 1 2024-09-21T08:02:30.436 INFO:tasks.workunit.client.1.smithi129.stdout:1/465: symlink d1/d16/d8f/l9f 0 2024-09-21T08:02:30.437 INFO:tasks.workunit.client.1.smithi129.stdout:8/262: write d0/f2b [3623289,2045] 0 2024-09-21T08:02:30.437 INFO:tasks.workunit.client.1.smithi129.stdout:2/551: link d1/lb d1/d53/d77/d8b/lcf 0 2024-09-21T08:02:30.438 INFO:tasks.workunit.client.1.smithi129.stdout:9/346: link d17/d46/f5f d17/d22/d33/d36/d48/d3f/f73 0 2024-09-21T08:02:30.439 INFO:tasks.workunit.client.1.smithi129.stdout:1/466: mkdir d1/d16/d25/da0 0 2024-09-21T08:02:30.439 INFO:tasks.workunit.client.1.smithi129.stdout:0/365: dwrite de/d15/d44/d4b/f5c [0,4194304] 0 2024-09-21T08:02:30.442 INFO:tasks.workunit.client.1.smithi129.stdout:2/552: link d1/dc/f6c d1/d53/d68/fd0 0 2024-09-21T08:02:30.442 INFO:tasks.workunit.client.1.smithi129.stdout:2/553: stat d1/dc/d19 0 2024-09-21T08:02:30.442 INFO:tasks.workunit.client.1.smithi129.stdout:3/334: mkdir d3/d69 0 2024-09-21T08:02:30.442 INFO:tasks.workunit.client.1.smithi129.stdout:9/347: mknod d17/d2c/d31/d5e/d6b/c74 0 2024-09-21T08:02:30.442 INFO:tasks.workunit.client.1.smithi129.stdout:9/348: fsync d17/d22/d33/d36/f65 0 2024-09-21T08:02:30.446 INFO:tasks.workunit.client.1.smithi129.stdout:0/366: creat de/d15/d39/d56/f6f x:0 0 0 2024-09-21T08:02:30.448 INFO:tasks.workunit.client.1.smithi129.stdout:2/554: dread d1/f5 [0,4194304] 0 2024-09-21T08:02:30.448 INFO:tasks.workunit.client.1.smithi129.stdout:2/555: write d1/d53/d68/fd0 [334106,19247] 0 2024-09-21T08:02:30.454 INFO:tasks.workunit.client.1.smithi129.stdout:7/406: dwrite d0/d46/d6e/f63 [0,4194304] 0 2024-09-21T08:02:30.457 INFO:tasks.workunit.client.1.smithi129.stdout:7/407: link d0/d1e/c4e d0/d46/c88 0 2024-09-21T08:02:30.468 INFO:tasks.workunit.client.1.smithi129.stdout:9/349: rmdir d17/d22/d33/d36/d48/d3f 39 2024-09-21T08:02:30.468 INFO:tasks.workunit.client.1.smithi129.stdout:9/350: truncate d17/d22/f30 1882262 0 2024-09-21T08:02:30.468 INFO:tasks.workunit.client.1.smithi129.stdout:9/351: readlink d17/d22/d33/l64 0 2024-09-21T08:02:30.468 INFO:tasks.workunit.client.1.smithi129.stdout:9/352: chown d17/d23/c25 435 1 2024-09-21T08:02:30.469 INFO:tasks.workunit.client.1.smithi129.stdout:9/353: write f13 [640650,74206] 0 2024-09-21T08:02:30.470 INFO:tasks.workunit.client.1.smithi129.stdout:1/467: dwrite d1/f3f [0,4194304] 0 2024-09-21T08:02:30.470 INFO:tasks.workunit.client.1.smithi129.stdout:7/408: dread d0/d46/d6e/f5c [0,4194304] 0 2024-09-21T08:02:30.470 INFO:tasks.workunit.client.1.smithi129.stdout:5/374: dwrite d2/d1e/d35/d33/d36/f59 [0,4194304] 0 2024-09-21T08:02:30.472 INFO:tasks.workunit.client.1.smithi129.stdout:8/263: dwrite d0/d6/d7/d18/d27/f3c [0,4194304] 0 2024-09-21T08:02:30.472 INFO:tasks.workunit.client.1.smithi129.stdout:8/264: write d0/d6/d7/d18/d27/f2d [2756906,99161] 0 2024-09-21T08:02:30.472 INFO:tasks.workunit.client.1.smithi129.stdout:8/265: chown d0/d6/d7/d18/d27 18 1 2024-09-21T08:02:30.472 INFO:tasks.workunit.client.1.smithi129.stdout:3/335: dwrite d3/da/dc/f23 [0,4194304] 0 2024-09-21T08:02:30.472 INFO:tasks.workunit.client.1.smithi129.stdout:3/336: truncate d3/da/dc/d11/d2f/d27/f36 3507751 0 2024-09-21T08:02:30.473 INFO:tasks.workunit.client.1.smithi129.stdout:1/468: link d1/d9/f6c d1/d16/d57/fa1 0 2024-09-21T08:02:30.473 INFO:tasks.workunit.client.1.smithi129.stdout:1/469: dread - d1/d16/d25/f61 zero size 2024-09-21T08:02:30.473 INFO:tasks.workunit.client.1.smithi129.stdout:5/375: creat d2/d1e/d35/d37/f73 x:0 0 0 2024-09-21T08:02:30.475 INFO:tasks.workunit.client.1.smithi129.stdout:2/556: dread d1/d13/d3a/d47/d1f/f40 [0,4194304] 0 2024-09-21T08:02:30.475 INFO:tasks.workunit.client.1.smithi129.stdout:2/557: getdents d1/d13/d3a/d47/dac 0 2024-09-21T08:02:30.479 INFO:tasks.workunit.client.1.smithi129.stdout:1/470: creat d1/d16/d9b/fa2 x:0 0 0 2024-09-21T08:02:30.481 INFO:tasks.workunit.client.1.smithi129.stdout:3/337: rename d3/da/dc/d11/d2f/f56 to d3/f6a 0 2024-09-21T08:02:30.482 INFO:tasks.workunit.client.1.smithi129.stdout:9/354: dread d17/f19 [4194304,4194304] 0 2024-09-21T08:02:30.482 INFO:tasks.workunit.client.1.smithi129.stdout:9/355: readlink l7 0 2024-09-21T08:02:30.482 INFO:tasks.workunit.client.1.smithi129.stdout:9/356: fsync d17/d23/f2d 0 2024-09-21T08:02:30.486 INFO:tasks.workunit.client.1.smithi129.stdout:8/266: dread d0/d6/f28 [0,4194304] 0 2024-09-21T08:02:30.486 INFO:tasks.workunit.client.1.smithi129.stdout:7/409: dread d0/f20 [4194304,4194304] 0 2024-09-21T08:02:30.486 INFO:tasks.workunit.client.1.smithi129.stdout:8/267: stat d0/f3f 0 2024-09-21T08:02:30.486 INFO:tasks.workunit.client.1.smithi129.stdout:3/338: symlink d3/d69/l6b 0 2024-09-21T08:02:30.493 INFO:tasks.workunit.client.1.smithi129.stdout:9/357: mkdir d17/d22/d33/d36/d48/d75 0 2024-09-21T08:02:30.493 INFO:tasks.workunit.client.1.smithi129.stdout:9/358: fdatasync f16 0 2024-09-21T08:02:30.495 INFO:tasks.workunit.client.1.smithi129.stdout:9/359: mkdir d17/d22/d33/d36/d76 0 2024-09-21T08:02:30.497 INFO:tasks.workunit.client.1.smithi129.stdout:7/410: dread d0/d46/f47 [0,4194304] 0 2024-09-21T08:02:30.497 INFO:tasks.workunit.client.1.smithi129.stdout:7/411: truncate d0/d1e/f55 4438888 0 2024-09-21T08:02:30.497 INFO:tasks.workunit.client.1.smithi129.stdout:9/360: creat d17/d2c/d31/d5e/d6b/f77 x:0 0 0 2024-09-21T08:02:30.497 INFO:tasks.workunit.client.1.smithi129.stdout:9/361: fdatasync d17/d2c/d31/f5a 0 2024-09-21T08:02:30.497 INFO:tasks.workunit.client.1.smithi129.stdout:9/362: read f16 [2492333,112752] 0 2024-09-21T08:02:30.497 INFO:tasks.workunit.client.1.smithi129.stdout:3/339: dread d3/f63 [0,4194304] 0 2024-09-21T08:02:30.499 INFO:tasks.workunit.client.1.smithi129.stdout:9/363: rename d17/d2c/d31/d35/c3a to d17/d22/d33/d36/d48/c78 0 2024-09-21T08:02:30.499 INFO:tasks.workunit.client.1.smithi129.stdout:9/364: creat d17/d2c/d31/d5e/d6b/f79 x:0 0 0 2024-09-21T08:02:30.500 INFO:tasks.workunit.client.1.smithi129.stdout:9/365: dread - d17/f61 zero size 2024-09-21T08:02:30.500 INFO:tasks.workunit.client.1.smithi129.stdout:3/340: mknod d3/da/dc/d11/d2f/d27/d52/c6c 0 2024-09-21T08:02:30.501 INFO:tasks.workunit.client.1.smithi129.stdout:7/412: rmdir d0/d71 39 2024-09-21T08:02:30.504 INFO:tasks.workunit.client.1.smithi129.stdout:3/341: mknod d3/da/dc/d11/d2f/d27/c6d 0 2024-09-21T08:02:30.506 INFO:tasks.workunit.client.1.smithi129.stdout:7/413: mknod d0/d46/d6e/c89 0 2024-09-21T08:02:30.511 INFO:tasks.workunit.client.1.smithi129.stdout:6/297: sync 2024-09-21T08:02:30.511 INFO:tasks.workunit.client.1.smithi129.stdout:4/285: sync 2024-09-21T08:02:30.511 INFO:tasks.workunit.client.1.smithi129.stdout:4/286: stat d5/l5d 0 2024-09-21T08:02:30.511 INFO:tasks.workunit.client.1.smithi129.stdout:4/287: creat d5/d16/d24/d3b/f65 x:0 0 0 2024-09-21T08:02:30.511 INFO:tasks.workunit.client.1.smithi129.stdout:4/288: fdatasync d5/d11/d3f/d50/f60 0 2024-09-21T08:02:30.511 INFO:tasks.workunit.client.1.smithi129.stdout:4/289: dread - d5/f63 zero size 2024-09-21T08:02:30.513 INFO:tasks.workunit.client.1.smithi129.stdout:6/298: unlink d7/d1b/d1e/d39/d4b/l51 0 2024-09-21T08:02:30.514 INFO:tasks.workunit.client.1.smithi129.stdout:4/290: truncate d5/d16/d24/f42 3112974 0 2024-09-21T08:02:30.516 INFO:tasks.workunit.client.1.smithi129.stdout:3/342: dread d3/da/f49 [4194304,4194304] 0 2024-09-21T08:02:30.519 INFO:tasks.workunit.client.1.smithi129.stdout:2/558: dwrite d1/d13/d3a/d47/d1f/f25 [0,4194304] 0 2024-09-21T08:02:30.519 INFO:tasks.workunit.client.1.smithi129.stdout:2/559: chown d1/ca0 13044 1 2024-09-21T08:02:30.519 INFO:tasks.workunit.client.1.smithi129.stdout:7/414: write d0/f24 [278777,124336] 0 2024-09-21T08:02:30.526 INFO:tasks.workunit.client.1.smithi129.stdout:5/376: dwrite d2/d1e/d35/d33/d36/f59 [0,4194304] 0 2024-09-21T08:02:30.526 INFO:tasks.workunit.client.1.smithi129.stdout:8/268: dwrite d0/d6/d7/f21 [0,4194304] 0 2024-09-21T08:02:30.527 INFO:tasks.workunit.client.1.smithi129.stdout:5/377: rmdir d2/d1e 39 2024-09-21T08:02:30.529 INFO:tasks.workunit.client.1.smithi129.stdout:8/269: mknod d0/d6/c52 0 2024-09-21T08:02:30.529 INFO:tasks.workunit.client.1.smithi129.stdout:8/270: dread - d0/f3f zero size 2024-09-21T08:02:30.532 INFO:tasks.workunit.client.1.smithi129.stdout:8/271: getdents d0/d6/d7/d18 0 2024-09-21T08:02:30.532 INFO:tasks.workunit.client.1.smithi129.stdout:8/272: dread - d0/d6/d7/f40 zero size 2024-09-21T08:02:30.532 INFO:tasks.workunit.client.1.smithi129.stdout:8/273: write d0/f16 [2865272,110085] 0 2024-09-21T08:02:30.532 INFO:tasks.workunit.client.1.smithi129.stdout:9/366: dwrite d17/d22/d33/d36/f63 [0,4194304] 0 2024-09-21T08:02:30.532 INFO:tasks.workunit.client.1.smithi129.stdout:9/367: chown d17/d22 8663553 1 2024-09-21T08:02:30.532 INFO:tasks.workunit.client.1.smithi129.stdout:1/471: dwrite d1/f8e [0,4194304] 0 2024-09-21T08:02:30.532 INFO:tasks.workunit.client.1.smithi129.stdout:8/274: read d0/d6/d7/d18/d27/d32/d37/f4b [110891,18787] 0 2024-09-21T08:02:30.541 INFO:tasks.workunit.client.1.smithi129.stdout:9/368: mkdir d17/d22/d33/d7a 0 2024-09-21T08:02:30.541 INFO:tasks.workunit.client.1.smithi129.stdout:9/369: write d17/d2c/d31/d35/f6f [798939,129067] 0 2024-09-21T08:02:30.541 INFO:tasks.workunit.client.1.smithi129.stdout:9/370: write f16 [3927403,1779] 0 2024-09-21T08:02:30.544 INFO:tasks.workunit.client.1.smithi129.stdout:1/472: symlink d1/d9/la3 0 2024-09-21T08:02:30.544 INFO:tasks.workunit.client.1.smithi129.stdout:1/473: write d1/d9/f26 [5773,43731] 0 2024-09-21T08:02:30.544 INFO:tasks.workunit.client.1.smithi129.stdout:1/474: fdatasync d1/f55 0 2024-09-21T08:02:30.545 INFO:tasks.workunit.client.1.smithi129.stdout:8/275: rmdir d0/d6/d7/d24 39 2024-09-21T08:02:30.546 INFO:tasks.workunit.client.1.smithi129.stdout:1/475: chown d1/d4/l3a 99283650 1 2024-09-21T08:02:30.546 INFO:tasks.workunit.client.1.smithi129.stdout:1/476: fsync d1/d16/f29 0 2024-09-21T08:02:30.546 INFO:tasks.workunit.client.1.smithi129.stdout:9/371: dread d17/d38/f52 [0,4194304] 0 2024-09-21T08:02:30.547 INFO:tasks.workunit.client.1.smithi129.stdout:8/276: symlink d0/d6/d7/l53 0 2024-09-21T08:02:30.547 INFO:tasks.workunit.client.1.smithi129.stdout:1/477: mkdir d1/d7a/da4 0 2024-09-21T08:02:30.548 INFO:tasks.workunit.client.1.smithi129.stdout:9/372: mkdir d17/d60/d7b 0 2024-09-21T08:02:30.549 INFO:tasks.workunit.client.1.smithi129.stdout:9/373: chown d17/d22/f30 6034 1 2024-09-21T08:02:30.549 INFO:tasks.workunit.client.1.smithi129.stdout:9/374: readlink d17/l2e 0 2024-09-21T08:02:30.549 INFO:tasks.workunit.client.1.smithi129.stdout:9/375: chown d17/d22/d33/d36/d48/d75 438 1 2024-09-21T08:02:30.549 INFO:tasks.workunit.client.1.smithi129.stdout:8/277: rmdir d0/d6/d7/d18/d27/d32 39 2024-09-21T08:02:30.549 INFO:tasks.workunit.client.1.smithi129.stdout:8/278: dread - d0/d6/d7/d18/f45 zero size 2024-09-21T08:02:30.549 INFO:tasks.workunit.client.1.smithi129.stdout:8/279: write d0/d6/d7/d18/d27/d32/f4a [627574,88386] 0 2024-09-21T08:02:30.549 INFO:tasks.workunit.client.1.smithi129.stdout:1/478: link d1/d16/d8f/l9f d1/d9/d31/la5 0 2024-09-21T08:02:30.551 INFO:tasks.workunit.client.1.smithi129.stdout:9/376: link d17/d22/d33/d36/c59 d17/d2c/d31/c7c 0 2024-09-21T08:02:30.552 INFO:tasks.workunit.client.1.smithi129.stdout:8/280: link d0/d6/f1f d0/d6/d7/d18/d27/d32/f54 0 2024-09-21T08:02:30.555 INFO:tasks.workunit.client.1.smithi129.stdout:9/377: truncate d17/d22/d33/d36/d48/d3f/f69 4109923 0 2024-09-21T08:02:30.570 INFO:tasks.workunit.client.1.smithi129.stdout:8/281: write d0/d6/d7/f21 [2889039,50579] 0 2024-09-21T08:02:30.570 INFO:tasks.workunit.client.1.smithi129.stdout:4/291: dwrite d5/d6/f44 [0,4194304] 0 2024-09-21T08:02:30.570 INFO:tasks.workunit.client.1.smithi129.stdout:4/292: chown d5/d6/l28 16112 1 2024-09-21T08:02:30.572 INFO:tasks.workunit.client.1.smithi129.stdout:4/293: rmdir d5/d11/d3f 39 2024-09-21T08:02:30.573 INFO:tasks.workunit.client.1.smithi129.stdout:4/294: mkdir d5/d33/d66 0 2024-09-21T08:02:30.573 INFO:tasks.workunit.client.1.smithi129.stdout:4/295: readlink d5/d6/l28 0 2024-09-21T08:02:30.575 INFO:tasks.workunit.client.1.smithi129.stdout:2/560: dwrite d1/dc/d26/d45/d65/fc0 [0,4194304] 0 2024-09-21T08:02:30.577 INFO:tasks.workunit.client.1.smithi129.stdout:5/378: dwrite d2/d1e/d35/d33/d36/d5a/f5c [0,4194304] 0 2024-09-21T08:02:30.578 INFO:tasks.workunit.client.1.smithi129.stdout:7/415: dwrite d0/d1e/f36 [4194304,4194304] 0 2024-09-21T08:02:30.578 INFO:tasks.workunit.client.1.smithi129.stdout:7/416: chown d0/d46/f53 2568314 1 2024-09-21T08:02:30.578 INFO:tasks.workunit.client.1.smithi129.stdout:7/417: truncate d0/f4c 356332 0 2024-09-21T08:02:30.578 INFO:tasks.workunit.client.1.smithi129.stdout:7/418: chown d0/d46/d6e/f83 1960287 1 2024-09-21T08:02:30.579 INFO:tasks.workunit.client.1.smithi129.stdout:3/343: dwrite d3/da/dc/d11/d55/f59 [4194304,4194304] 0 2024-09-21T08:02:30.579 INFO:tasks.workunit.client.1.smithi129.stdout:3/344: write d3/da/dc/d11/d2f/f4f [5217449,30808] 0 2024-09-21T08:02:30.579 INFO:tasks.workunit.client.1.smithi129.stdout:6/299: dwrite d7/fe [0,4194304] 0 2024-09-21T08:02:30.579 INFO:tasks.workunit.client.1.smithi129.stdout:2/561: read d1/f8 [1608590,89921] 0 2024-09-21T08:02:30.581 INFO:tasks.workunit.client.1.smithi129.stdout:9/378: dwrite d17/d2c/d31/f56 [0,4194304] 0 2024-09-21T08:02:30.581 INFO:tasks.workunit.client.1.smithi129.stdout:9/379: stat d17/d22/d33/d7a 0 2024-09-21T08:02:30.584 INFO:tasks.workunit.client.1.smithi129.stdout:4/296: dread d5/d16/f1f [0,4194304] 0 2024-09-21T08:02:30.584 INFO:tasks.workunit.client.1.smithi129.stdout:4/297: getdents d5/d33/d66 0 2024-09-21T08:02:30.585 INFO:tasks.workunit.client.1.smithi129.stdout:7/419: creat d0/d1e/f8a x:0 0 0 2024-09-21T08:02:30.587 INFO:tasks.workunit.client.1.smithi129.stdout:0/367: sync 2024-09-21T08:02:30.590 INFO:tasks.workunit.client.1.smithi129.stdout:6/300: unlink d7/d1b/d1e/d39/f45 0 2024-09-21T08:02:30.591 INFO:tasks.workunit.client.1.smithi129.stdout:6/301: chown d7/d1b/d1e 27154751 1 2024-09-21T08:02:30.591 INFO:tasks.workunit.client.1.smithi129.stdout:6/302: stat d7/d1b/d25/d2b 0 2024-09-21T08:02:30.591 INFO:tasks.workunit.client.1.smithi129.stdout:2/562: creat d1/d53/d77/fd1 x:0 0 0 2024-09-21T08:02:30.599 INFO:tasks.workunit.client.1.smithi129.stdout:4/298: link d5/d35/f62 d5/d35/f67 0 2024-09-21T08:02:30.607 INFO:tasks.workunit.client.1.smithi129.stdout:2/563: creat d1/d13/d3a/d8f/fd2 x:0 0 0 2024-09-21T08:02:30.607 INFO:tasks.workunit.client.1.smithi129.stdout:2/564: fsync d1/f8 0 2024-09-21T08:02:30.607 INFO:tasks.workunit.client.1.smithi129.stdout:2/565: creat d1/dc/d19/d88/fd3 x:0 0 0 2024-09-21T08:02:30.607 INFO:tasks.workunit.client.1.smithi129.stdout:2/566: stat d1/dc/f15 0 2024-09-21T08:02:30.608 INFO:tasks.workunit.client.1.smithi129.stdout:8/282: rmdir d0/d6 39 2024-09-21T08:02:30.609 INFO:tasks.workunit.client.1.smithi129.stdout:8/283: read d0/d6/d7/d24/f35 [296220,81451] 0 2024-09-21T08:02:30.609 INFO:tasks.workunit.client.1.smithi129.stdout:9/380: link d17/d22/d33/d36/f63 d17/d22/d33/d36/d48/d75/f7d 0 2024-09-21T08:02:30.610 INFO:tasks.workunit.client.1.smithi129.stdout:5/379: dwrite d2/f60 [0,4194304] 0 2024-09-21T08:02:30.610 INFO:tasks.workunit.client.1.smithi129.stdout:5/380: creat d2/d1e/d35/d33/d36/d5a/f74 x:0 0 0 2024-09-21T08:02:30.611 INFO:tasks.workunit.client.1.smithi129.stdout:4/299: rename d5/d6/f44 to d5/d33/d66/f68 0 2024-09-21T08:02:30.611 INFO:tasks.workunit.client.1.smithi129.stdout:4/300: truncate d5/f63 546624 0 2024-09-21T08:02:30.612 INFO:tasks.workunit.client.1.smithi129.stdout:0/368: rmdir de/d22/d27/d2f 39 2024-09-21T08:02:30.613 INFO:tasks.workunit.client.1.smithi129.stdout:2/567: mknod d1/dc/d26/d45/d65/d99/cd4 0 2024-09-21T08:02:30.613 INFO:tasks.workunit.client.1.smithi129.stdout:2/568: write d1/f2e [1526745,85149] 0 2024-09-21T08:02:30.613 INFO:tasks.workunit.client.1.smithi129.stdout:2/569: fsync d1/d13/d3a/f6f 0 2024-09-21T08:02:30.614 INFO:tasks.workunit.client.1.smithi129.stdout:8/284: link d0/d6/d7/d18/f48 d0/d6/d7/d18/d27/d32/d37/f55 0 2024-09-21T08:02:30.615 INFO:tasks.workunit.client.1.smithi129.stdout:5/381: rmdir d2/d2a/d50 39 2024-09-21T08:02:30.615 INFO:tasks.workunit.client.1.smithi129.stdout:5/382: stat d2/d2a/l58 0 2024-09-21T08:02:30.617 INFO:tasks.workunit.client.1.smithi129.stdout:0/369: rename de/d15/l60 to de/d15/d39/d56/l70 0 2024-09-21T08:02:30.617 INFO:tasks.workunit.client.1.smithi129.stdout:0/370: fsync de/d15/d39/f41 0 2024-09-21T08:02:30.617 INFO:tasks.workunit.client.1.smithi129.stdout:0/371: creat de/d22/d27/d30/f71 x:0 0 0 2024-09-21T08:02:30.617 INFO:tasks.workunit.client.1.smithi129.stdout:0/372: readlink de/l65 0 2024-09-21T08:02:30.618 INFO:tasks.workunit.client.1.smithi129.stdout:0/373: readlink de/d15/d29/l32 0 2024-09-21T08:02:30.618 INFO:tasks.workunit.client.1.smithi129.stdout:2/570: mkdir d1/dc/d19/d4c/dd5 0 2024-09-21T08:02:30.619 INFO:tasks.workunit.client.1.smithi129.stdout:7/420: dwrite d0/d46/d6e/f7e [4194304,4194304] 0 2024-09-21T08:02:30.620 INFO:tasks.workunit.client.1.smithi129.stdout:3/345: dwrite d3/da/dc/d11/d2f/d27/f36 [0,4194304] 0 2024-09-21T08:02:30.620 INFO:tasks.workunit.client.1.smithi129.stdout:5/383: symlink d2/l75 0 2024-09-21T08:02:30.621 INFO:tasks.workunit.client.1.smithi129.stdout:7/421: dread d0/f79 [0,4194304] 0 2024-09-21T08:02:30.621 INFO:tasks.workunit.client.1.smithi129.stdout:7/422: creat d0/d1e/f8b x:0 0 0 2024-09-21T08:02:30.621 INFO:tasks.workunit.client.1.smithi129.stdout:7/423: chown d0/d1e/f3e 2311236 1 2024-09-21T08:02:30.622 INFO:tasks.workunit.client.1.smithi129.stdout:0/374: rename de/d15/d44/d4b/f5c to de/d19/f72 0 2024-09-21T08:02:30.623 INFO:tasks.workunit.client.1.smithi129.stdout:2/571: rmdir d1/d53/dce 0 2024-09-21T08:02:30.623 INFO:tasks.workunit.client.1.smithi129.stdout:4/301: dread d5/d11/f3d [0,4194304] 0 2024-09-21T08:02:30.626 INFO:tasks.workunit.client.1.smithi129.stdout:3/346: rename d3/da/d5d/c66 to d3/d69/c6e 0 2024-09-21T08:02:30.626 INFO:tasks.workunit.client.1.smithi129.stdout:8/285: write d0/d6/d7/d24/f47 [3846117,9731] 0 2024-09-21T08:02:30.627 INFO:tasks.workunit.client.1.smithi129.stdout:0/375: unlink de/d22/d27/d30/f67 0 2024-09-21T08:02:30.628 INFO:tasks.workunit.client.1.smithi129.stdout:5/384: read d2/d1e/d35/f4a [3548136,58253] 0 2024-09-21T08:02:30.628 INFO:tasks.workunit.client.1.smithi129.stdout:2/572: creat d1/dc/d19/d4c/dd5/fd6 x:0 0 0 2024-09-21T08:02:30.629 INFO:tasks.workunit.client.1.smithi129.stdout:4/302: creat d5/d33/d66/f69 x:0 0 0 2024-09-21T08:02:30.629 INFO:tasks.workunit.client.1.smithi129.stdout:4/303: truncate d5/d16/f29 4510693 0 2024-09-21T08:02:30.630 INFO:tasks.workunit.client.1.smithi129.stdout:3/347: unlink d3/da/dc/d11/f34 0 2024-09-21T08:02:30.631 INFO:tasks.workunit.client.1.smithi129.stdout:8/286: rename d0/d6/d7/d18/d27/d32/d37/f4b to d0/d6/d7/d24/f56 0 2024-09-21T08:02:30.631 INFO:tasks.workunit.client.1.smithi129.stdout:7/424: dread d0/f17 [0,4194304] 0 2024-09-21T08:02:30.632 INFO:tasks.workunit.client.1.smithi129.stdout:0/376: symlink de/d15/l73 0 2024-09-21T08:02:30.632 INFO:tasks.workunit.client.1.smithi129.stdout:5/385: getdents d2/d1e 0 2024-09-21T08:02:30.633 INFO:tasks.workunit.client.1.smithi129.stdout:2/573: symlink d1/dc/d26/d45/ld7 0 2024-09-21T08:02:30.633 INFO:tasks.workunit.client.1.smithi129.stdout:2/574: chown d1/la 2 1 2024-09-21T08:02:30.634 INFO:tasks.workunit.client.1.smithi129.stdout:4/304: mknod d5/d11/c6a 0 2024-09-21T08:02:30.634 INFO:tasks.workunit.client.1.smithi129.stdout:3/348: truncate d3/f29 889594 0 2024-09-21T08:02:30.634 INFO:tasks.workunit.client.1.smithi129.stdout:3/349: fsync d3/da/dc/fd 0 2024-09-21T08:02:30.635 INFO:tasks.workunit.client.1.smithi129.stdout:8/287: mknod d0/d6/d7/d18/d27/d32/d37/c57 0 2024-09-21T08:02:30.635 INFO:tasks.workunit.client.1.smithi129.stdout:7/425: mknod d0/d71/c8c 0 2024-09-21T08:02:30.636 INFO:tasks.workunit.client.1.smithi129.stdout:7/426: write d0/f8 [5020782,69502] 0 2024-09-21T08:02:30.637 INFO:tasks.workunit.client.1.smithi129.stdout:2/575: mknod d1/dc/d19/d4c/d6a/d69/cd8 0 2024-09-21T08:02:30.638 INFO:tasks.workunit.client.1.smithi129.stdout:4/305: creat d5/d16/d47/d5f/f6b x:0 0 0 2024-09-21T08:02:30.639 INFO:tasks.workunit.client.1.smithi129.stdout:8/288: dread d0/d6/d7/d18/d27/d32/f4a [0,4194304] 0 2024-09-21T08:02:30.640 INFO:tasks.workunit.client.1.smithi129.stdout:3/350: creat d3/da/dc/d11/d55/d68/f6f x:0 0 0 2024-09-21T08:02:30.640 INFO:tasks.workunit.client.1.smithi129.stdout:3/351: fdatasync d3/da/dc/d11/f4b 0 2024-09-21T08:02:30.640 INFO:tasks.workunit.client.1.smithi129.stdout:3/352: stat d3/da/dc/d11/c37 0 2024-09-21T08:02:30.640 INFO:tasks.workunit.client.1.smithi129.stdout:3/353: chown d3/da/dc/f62 21 1 2024-09-21T08:02:30.644 INFO:tasks.workunit.client.1.smithi129.stdout:3/354: dread d3/da/f49 [0,4194304] 0 2024-09-21T08:02:30.646 INFO:tasks.workunit.client.1.smithi129.stdout:2/576: symlink d1/dc/d19/d88/ld9 0 2024-09-21T08:02:30.646 INFO:tasks.workunit.client.1.smithi129.stdout:2/577: write d1/d13/f83 [78504,87385] 0 2024-09-21T08:02:30.646 INFO:tasks.workunit.client.1.smithi129.stdout:2/578: creat d1/d13/d3a/d47/d1f/fda x:0 0 0 2024-09-21T08:02:30.646 INFO:tasks.workunit.client.1.smithi129.stdout:4/306: symlink d5/d16/l6c 0 2024-09-21T08:02:30.648 INFO:tasks.workunit.client.1.smithi129.stdout:3/355: mkdir d3/d57/d70 0 2024-09-21T08:02:30.649 INFO:tasks.workunit.client.1.smithi129.stdout:8/289: dread d0/d6/d7/f15 [0,4194304] 0 2024-09-21T08:02:30.650 INFO:tasks.workunit.client.1.smithi129.stdout:2/579: symlink d1/dc/d19/d4c/d9d/ldb 0 2024-09-21T08:02:30.650 INFO:tasks.workunit.client.1.smithi129.stdout:2/580: read d1/d13/d3a/d47/d1f/f23 [897947,20347] 0 2024-09-21T08:02:30.650 INFO:tasks.workunit.client.1.smithi129.stdout:3/356: symlink d3/da/d5d/l71 0 2024-09-21T08:02:30.651 INFO:tasks.workunit.client.1.smithi129.stdout:2/581: mknod d1/d53/cdc 0 2024-09-21T08:02:30.652 INFO:tasks.workunit.client.1.smithi129.stdout:3/357: creat d3/da/dc/d11/d2f/d27/f72 x:0 0 0 2024-09-21T08:02:30.653 INFO:tasks.workunit.client.1.smithi129.stdout:2/582: unlink d1/dc/d26/f51 0 2024-09-21T08:02:30.655 INFO:tasks.workunit.client.1.smithi129.stdout:3/358: link d3/da/dc/f4d d3/da/dc/f73 0 2024-09-21T08:02:30.655 INFO:tasks.workunit.client.1.smithi129.stdout:3/359: chown d3/da/c10 9 1 2024-09-21T08:02:30.655 INFO:tasks.workunit.client.1.smithi129.stdout:0/377: dwrite fd [0,4194304] 0 2024-09-21T08:02:30.661 INFO:tasks.workunit.client.1.smithi129.stdout:8/290: write d0/d6/d7/d18/d27/d32/d37/f42 [2949639,49555] 0 2024-09-21T08:02:30.662 INFO:tasks.workunit.client.1.smithi129.stdout:0/378: symlink de/d22/l74 0 2024-09-21T08:02:30.664 INFO:tasks.workunit.client.1.smithi129.stdout:8/291: symlink d0/d6/d7/d3a/l58 0 2024-09-21T08:02:30.664 INFO:tasks.workunit.client.1.smithi129.stdout:8/292: write d0/f2b [4915270,126737] 0 2024-09-21T08:02:30.665 INFO:tasks.workunit.client.1.smithi129.stdout:0/379: mknod de/d22/d27/c75 0 2024-09-21T08:02:30.666 INFO:tasks.workunit.client.1.smithi129.stdout:3/360: dread d3/da/dc/d11/d55/f61 [0,4194304] 0 2024-09-21T08:02:30.667 INFO:tasks.workunit.client.1.smithi129.stdout:3/361: unlink d3/da/dc/d11/d2f/d27/f36 0 2024-09-21T08:02:30.669 INFO:tasks.workunit.client.1.smithi129.stdout:3/362: rename d3/da/d5d/l71 to d3/l74 0 2024-09-21T08:02:30.671 INFO:tasks.workunit.client.1.smithi129.stdout:3/363: unlink d3/da/dc/d11/d55/f61 0 2024-09-21T08:02:30.672 INFO:tasks.workunit.client.1.smithi129.stdout:3/364: unlink d3/da/dc/d11/d55/f59 0 2024-09-21T08:02:30.672 INFO:tasks.workunit.client.1.smithi129.stdout:3/365: truncate d3/da/f54 418841 0 2024-09-21T08:02:30.673 INFO:tasks.workunit.client.1.smithi129.stdout:4/307: dwrite d5/f2b [0,4194304] 0 2024-09-21T08:02:30.674 INFO:tasks.workunit.client.1.smithi129.stdout:2/583: dwrite d1/dc/d19/d4c/d9d/fcb [0,4194304] 0 2024-09-21T08:02:30.676 INFO:tasks.workunit.client.1.smithi129.stdout:4/308: mkdir d5/d33/d6d 0 2024-09-21T08:02:30.676 INFO:tasks.workunit.client.1.smithi129.stdout:2/584: read d1/d13/d32/f3b [612781,121561] 0 2024-09-21T08:02:30.676 INFO:tasks.workunit.client.1.smithi129.stdout:2/585: readlink d1/d53/l80 0 2024-09-21T08:02:30.676 INFO:tasks.workunit.client.1.smithi129.stdout:5/386: rmdir d2 39 2024-09-21T08:02:30.679 INFO:tasks.workunit.client.1.smithi129.stdout:4/309: symlink d5/d35/l6e 0 2024-09-21T08:02:30.679 INFO:tasks.workunit.client.1.smithi129.stdout:0/380: dread de/d22/d27/f4c [0,4194304] 0 2024-09-21T08:02:30.680 INFO:tasks.workunit.client.1.smithi129.stdout:5/387: mknod d2/c76 0 2024-09-21T08:02:30.691 INFO:tasks.workunit.client.1.smithi129.stdout:4/310: mknod d5/c6f 0 2024-09-21T08:02:30.693 INFO:tasks.workunit.client.1.smithi129.stdout:0/381: truncate de/f3c 310797 0 2024-09-21T08:02:30.694 INFO:tasks.workunit.client.1.smithi129.stdout:5/388: getdents d2/d2a/d6f 0 2024-09-21T08:02:30.694 INFO:tasks.workunit.client.1.smithi129.stdout:5/389: chown d2/c21 113584228 1 2024-09-21T08:02:30.694 INFO:tasks.workunit.client.1.smithi129.stdout:5/390: fsync d2/d1e/f32 0 2024-09-21T08:02:30.694 INFO:tasks.workunit.client.1.smithi129.stdout:3/366: dwrite d3/da/d5d/f60 [0,4194304] 0 2024-09-21T08:02:30.697 INFO:tasks.workunit.client.1.smithi129.stdout:4/311: rename d5/d16/d24/f53 to d5/d16/d47/f70 0 2024-09-21T08:02:30.698 INFO:tasks.workunit.client.1.smithi129.stdout:3/367: symlink d3/da/dc/l75 0 2024-09-21T08:02:30.700 INFO:tasks.workunit.client.1.smithi129.stdout:3/368: symlink d3/l76 0 2024-09-21T08:02:30.700 INFO:tasks.workunit.client.1.smithi129.stdout:3/369: chown d3/da/dc/d11/c16 72 1 2024-09-21T08:02:30.701 INFO:tasks.workunit.client.1.smithi129.stdout:3/370: truncate d3/da/dc/d11/d2f/d27/d52/f5e 1731278 0 2024-09-21T08:02:30.702 INFO:tasks.workunit.client.1.smithi129.stdout:2/586: dwrite d1/dc/d26/d45/d65/d50/f6e [0,4194304] 0 2024-09-21T08:02:30.702 INFO:tasks.workunit.client.1.smithi129.stdout:3/371: creat d3/da/d5d/f77 x:0 0 0 2024-09-21T08:02:30.706 INFO:tasks.workunit.client.1.smithi129.stdout:3/372: creat d3/da/f78 x:0 0 0 2024-09-21T08:02:30.706 INFO:tasks.workunit.client.1.smithi129.stdout:3/373: stat d3 0 2024-09-21T08:02:30.707 INFO:tasks.workunit.client.1.smithi129.stdout:5/391: write d2/d1e/d35/d33/d36/f59 [3765309,75568] 0 2024-09-21T08:02:30.707 INFO:tasks.workunit.client.1.smithi129.stdout:2/587: link d1/d13/d3a/d47/d5f/fc6 d1/dc/fdd 0 2024-09-21T08:02:30.709 INFO:tasks.workunit.client.1.smithi129.stdout:5/392: mkdir d2/d1e/d35/d33/d36/d5a/d77 0 2024-09-21T08:02:30.709 INFO:tasks.workunit.client.1.smithi129.stdout:5/393: dread - d2/d2a/d50/d61/f6e zero size 2024-09-21T08:02:30.709 INFO:tasks.workunit.client.1.smithi129.stdout:2/588: rmdir d1/d13/d32/d7c 39 2024-09-21T08:02:30.710 INFO:tasks.workunit.client.1.smithi129.stdout:4/312: dread d5/d6/f2d [0,4194304] 0 2024-09-21T08:02:30.711 INFO:tasks.workunit.client.1.smithi129.stdout:2/589: rename d1/d13/d3a/d47/c2b to d1/dc/d19/d4c/d9d/cde 0 2024-09-21T08:02:30.713 INFO:tasks.workunit.client.1.smithi129.stdout:2/590: getdents d1/d13 0 2024-09-21T08:02:30.715 INFO:tasks.workunit.client.1.smithi129.stdout:5/394: dread d2/d1e/f32 [0,4194304] 0 2024-09-21T08:02:30.715 INFO:tasks.workunit.client.1.smithi129.stdout:5/395: write d2/d1e/f1f [210614,52489] 0 2024-09-21T08:02:30.715 INFO:tasks.workunit.client.1.smithi129.stdout:5/396: readlink d2/d1e/d35/d37/d65/l6d 0 2024-09-21T08:02:30.715 INFO:tasks.workunit.client.1.smithi129.stdout:2/591: unlink d1/d13/d3a/d47/d1f/c5e 0 2024-09-21T08:02:30.715 INFO:tasks.workunit.client.1.smithi129.stdout:2/592: write d1/dc/d94/fbf [478583,55656] 0 2024-09-21T08:02:30.715 INFO:tasks.workunit.client.1.smithi129.stdout:2/593: dread - d1/dc/d19/d88/fcc zero size 2024-09-21T08:02:30.715 INFO:tasks.workunit.client.1.smithi129.stdout:2/594: truncate d1/d13/f41 774991 0 2024-09-21T08:02:30.716 INFO:tasks.workunit.client.1.smithi129.stdout:5/397: write d2/d1e/d35/d33/d36/f42 [167565,82985] 0 2024-09-21T08:02:30.716 INFO:tasks.workunit.client.1.smithi129.stdout:5/398: write d2/d2a/d50/d61/f72 [663792,103364] 0 2024-09-21T08:02:30.716 INFO:tasks.workunit.client.1.smithi129.stdout:5/399: write d2/d1e/d35/ff [3159705,100886] 0 2024-09-21T08:02:30.716 INFO:tasks.workunit.client.1.smithi129.stdout:2/595: mkdir d1/dc/d26/d45/d65/ddf 0 2024-09-21T08:02:30.716 INFO:tasks.workunit.client.1.smithi129.stdout:2/596: stat d1/d13/d32/f3b 0 2024-09-21T08:02:30.717 INFO:tasks.workunit.client.1.smithi129.stdout:5/400: link d2/d1e/d35/d33/l54 d2/d1e/d35/d37/l78 0 2024-09-21T08:02:30.717 INFO:tasks.workunit.client.1.smithi129.stdout:5/401: chown d2/le 11 1 2024-09-21T08:02:30.717 INFO:tasks.workunit.client.1.smithi129.stdout:5/402: stat d2/d1e/d35/d33/f69 0 2024-09-21T08:02:30.722 INFO:tasks.workunit.client.1.smithi129.stdout:1/479: sync 2024-09-21T08:02:30.736 INFO:tasks.workunit.client.1.smithi129.stdout:5/403: dwrite d2/d1e/d35/f22 [0,4194304] 0 2024-09-21T08:02:30.756 INFO:tasks.workunit.client.1.smithi129.stdout:3/374: dwrite d3/da/dc/d11/d2f/d27/d52/f5e [0,4194304] 0 2024-09-21T08:02:30.756 INFO:tasks.workunit.client.1.smithi129.stdout:5/404: dwrite d2/d1e/f32 [4194304,4194304] 0 2024-09-21T08:02:30.757 INFO:tasks.workunit.client.1.smithi129.stdout:3/375: creat d3/da/dc/f79 x:0 0 0 2024-09-21T08:02:30.757 INFO:tasks.workunit.client.1.smithi129.stdout:3/376: dread - d3/da/d5d/f77 zero size 2024-09-21T08:02:30.759 INFO:tasks.workunit.client.1.smithi129.stdout:3/377: rename d3/da/dc/d11/d2f/d27/c2a to d3/da/dc/d11/d2f/d27/d52/c7a 0 2024-09-21T08:02:30.760 INFO:tasks.workunit.client.1.smithi129.stdout:3/378: mknod d3/d5a/c7b 0 2024-09-21T08:02:30.761 INFO:tasks.workunit.client.1.smithi129.stdout:3/379: mknod d3/da/c7c 0 2024-09-21T08:02:30.761 INFO:tasks.workunit.client.1.smithi129.stdout:3/380: write d3/da/dc/f79 [941543,2114] 0 2024-09-21T08:02:30.761 INFO:tasks.workunit.client.1.smithi129.stdout:3/381: mknod d3/da/dc/d11/d2f/c7d 0 2024-09-21T08:02:30.761 INFO:tasks.workunit.client.1.smithi129.stdout:3/382: fdatasync d3/f6a 0 2024-09-21T08:02:30.762 INFO:tasks.workunit.client.1.smithi129.stdout:3/383: symlink d3/da/dc/d11/l7e 0 2024-09-21T08:02:30.763 INFO:tasks.workunit.client.1.smithi129.stdout:3/384: mkdir d3/da/dc/d7f 0 2024-09-21T08:02:30.763 INFO:tasks.workunit.client.1.smithi129.stdout:3/385: stat d3/da/dc/d25/c30 0 2024-09-21T08:02:30.763 INFO:tasks.workunit.client.1.smithi129.stdout:5/405: dread d2/d1e/d35/d33/d36/d5a/f70 [0,4194304] 0 2024-09-21T08:02:30.763 INFO:tasks.workunit.client.1.smithi129.stdout:3/386: mkdir d3/d57/d80 0 2024-09-21T08:02:30.764 INFO:tasks.workunit.client.1.smithi129.stdout:5/406: rmdir d2 39 2024-09-21T08:02:30.764 INFO:tasks.workunit.client.1.smithi129.stdout:5/407: chown d2/d1e 5966 1 2024-09-21T08:02:30.764 INFO:tasks.workunit.client.1.smithi129.stdout:5/408: write d2/f4 [1492650,1922] 0 2024-09-21T08:02:30.765 INFO:tasks.workunit.client.1.smithi129.stdout:3/387: rename d3/da/dc/c58 to d3/da/d5d/c81 0 2024-09-21T08:02:30.773 INFO:tasks.workunit.client.1.smithi129.stdout:3/388: read d3/da/dc/f23 [7424255,69347] 0 2024-09-21T08:02:30.774 INFO:tasks.workunit.client.1.smithi129.stdout:3/389: creat d3/da/dc/d11/d2f/d27/d52/f82 x:0 0 0 2024-09-21T08:02:30.780 INFO:tasks.workunit.client.1.smithi129.stdout:3/390: read d3/f29 [696942,111214] 0 2024-09-21T08:02:30.780 INFO:tasks.workunit.client.1.smithi129.stdout:3/391: fsync d3/da/d5d/f60 0 2024-09-21T08:02:30.780 INFO:tasks.workunit.client.1.smithi129.stdout:5/409: dwrite d2/d1e/f1f [0,4194304] 0 2024-09-21T08:02:30.785 INFO:tasks.workunit.client.1.smithi129.stdout:3/392: dread d3/f29 [0,4194304] 0 2024-09-21T08:02:30.786 INFO:tasks.workunit.client.1.smithi129.stdout:3/393: symlink d3/da/dc/d11/d2f/l83 0 2024-09-21T08:02:30.790 INFO:tasks.workunit.client.1.smithi129.stdout:5/410: write d2/d1e/f2f [809537,88096] 0 2024-09-21T08:02:30.794 INFO:tasks.workunit.client.1.smithi129.stdout:3/394: write d3/da/dc/d11/d2f/d27/d52/f5e [3922257,99704] 0 2024-09-21T08:02:30.796 INFO:tasks.workunit.client.1.smithi129.stdout:5/411: getdents d2/d2a/d50 0 2024-09-21T08:02:30.797 INFO:tasks.workunit.client.1.smithi129.stdout:3/395: read d3/da/dc/f22 [8261317,18645] 0 2024-09-21T08:02:30.797 INFO:tasks.workunit.client.1.smithi129.stdout:3/396: readlink d3/da/dc/d25/l45 0 2024-09-21T08:02:30.797 INFO:tasks.workunit.client.1.smithi129.stdout:5/412: rename d2/d1e/f2f to d2/f79 0 2024-09-21T08:02:30.798 INFO:tasks.workunit.client.1.smithi129.stdout:3/397: symlink d3/da/l84 0 2024-09-21T08:02:30.798 INFO:tasks.workunit.client.1.smithi129.stdout:3/398: write d3/da/dc/d11/d2f/d27/f4e [2306421,117603] 0 2024-09-21T08:02:30.798 INFO:tasks.workunit.client.1.smithi129.stdout:5/413: truncate d2/f1d 3439641 0 2024-09-21T08:02:30.799 INFO:tasks.workunit.client.1.smithi129.stdout:3/399: creat d3/da/dc/d11/d2f/f85 x:0 0 0 2024-09-21T08:02:30.799 INFO:tasks.workunit.client.1.smithi129.stdout:3/400: creat d3/da/dc/d11/d2f/d27/f86 x:0 0 0 2024-09-21T08:02:30.799 INFO:tasks.workunit.client.1.smithi129.stdout:3/401: dread - d3/da/dc/d11/d55/d68/f6f zero size 2024-09-21T08:02:30.800 INFO:tasks.workunit.client.1.smithi129.stdout:3/402: link d3/da/dc/f23 d3/da/dc/d11/d55/d68/f87 0 2024-09-21T08:02:30.801 INFO:tasks.workunit.client.1.smithi129.stdout:3/403: symlink d3/d69/l88 0 2024-09-21T08:02:30.802 INFO:tasks.workunit.client.1.smithi129.stdout:3/404: chown d3/da/dc/d11/d2f/d27/d52/f5e 4 1 2024-09-21T08:02:30.802 INFO:tasks.workunit.client.1.smithi129.stdout:3/405: fsync d3/da/dc/d11/f4b 0 2024-09-21T08:02:30.802 INFO:tasks.workunit.client.1.smithi129.stdout:3/406: symlink d3/d57/l89 0 2024-09-21T08:02:30.803 INFO:tasks.workunit.client.1.smithi129.stdout:3/407: creat d3/f8a x:0 0 0 2024-09-21T08:02:30.806 INFO:tasks.workunit.client.1.smithi129.stdout:5/414: dread d2/d2a/d50/f4f [0,4194304] 0 2024-09-21T08:02:30.806 INFO:tasks.workunit.client.1.smithi129.stdout:5/415: fsync d2/d1e/d35/d33/d36/d5a/f6a 0 2024-09-21T08:02:30.806 INFO:tasks.workunit.client.1.smithi129.stdout:3/408: rename d3/l20 to d3/l8b 0 2024-09-21T08:02:30.806 INFO:tasks.workunit.client.1.smithi129.stdout:3/409: read - d3/f8a zero size 2024-09-21T08:02:30.807 INFO:tasks.workunit.client.1.smithi129.stdout:3/410: symlink d3/d5a/l8c 0 2024-09-21T08:02:30.815 INFO:tasks.workunit.client.1.smithi129.stdout:3/411: write d3/da/dc/f62 [2592067,95399] 0 2024-09-21T08:02:30.815 INFO:tasks.workunit.client.1.smithi129.stdout:5/416: write d2/f1b [1124240,122495] 0 2024-09-21T08:02:30.815 INFO:tasks.workunit.client.1.smithi129.stdout:3/412: chown d3/l1c 14349147 1 2024-09-21T08:02:30.816 INFO:tasks.workunit.client.1.smithi129.stdout:5/417: mknod d2/d1e/d35/d37/d65/c7a 0 2024-09-21T08:02:30.816 INFO:tasks.workunit.client.1.smithi129.stdout:5/418: write d2/d1e/d35/d33/d36/f59 [1126620,79929] 0 2024-09-21T08:02:30.817 INFO:tasks.workunit.client.1.smithi129.stdout:5/419: mknod d2/d1e/d35/c7b 0 2024-09-21T08:02:30.817 INFO:tasks.workunit.client.1.smithi129.stdout:6/303: sync 2024-09-21T08:02:30.820 INFO:tasks.workunit.client.1.smithi129.stdout:5/420: dread d2/d2a/d50/d61/f72 [0,4194304] 0 2024-09-21T08:02:30.822 INFO:tasks.workunit.client.1.smithi129.stdout:5/421: creat d2/d1e/d35/f7c x:0 0 0 2024-09-21T08:02:30.822 INFO:tasks.workunit.client.1.smithi129.stdout:5/422: chown d2/d1e/f32 47391249 1 2024-09-21T08:02:30.823 INFO:tasks.workunit.client.1.smithi129.stdout:5/423: getdents d2/d1e/d35/d37 0 2024-09-21T08:02:30.824 INFO:tasks.workunit.client.1.smithi129.stdout:5/424: write d2/f4e [704450,96805] 0 2024-09-21T08:02:30.825 INFO:tasks.workunit.client.1.smithi129.stdout:3/413: write d3/da/dc/d11/d55/d68/f87 [2674275,88037] 0 2024-09-21T08:02:30.825 INFO:tasks.workunit.client.1.smithi129.stdout:5/425: mkdir d2/d1e/d35/d37/d7d 0 2024-09-21T08:02:30.826 INFO:tasks.workunit.client.1.smithi129.stdout:3/414: truncate d3/da/dc/d25/f26 332813 0 2024-09-21T08:02:30.827 INFO:tasks.workunit.client.1.smithi129.stdout:5/426: symlink d2/d1e/d35/d33/l7e 0 2024-09-21T08:02:30.827 INFO:tasks.workunit.client.1.smithi129.stdout:6/304: write d7/f8 [1165033,4760] 0 2024-09-21T08:02:30.829 INFO:tasks.workunit.client.1.smithi129.stdout:6/305: creat d7/d1b/d25/d35/f6b x:0 0 0 2024-09-21T08:02:30.829 INFO:tasks.workunit.client.1.smithi129.stdout:6/306: write d7/fe [2116526,106277] 0 2024-09-21T08:02:30.829 INFO:tasks.workunit.client.1.smithi129.stdout:6/307: rmdir d7/d10 39 2024-09-21T08:02:30.830 INFO:tasks.workunit.client.1.smithi129.stdout:6/308: write d7/d10/f22 [488396,118566] 0 2024-09-21T08:02:30.835 INFO:tasks.workunit.client.1.smithi129.stdout:6/309: mkdir d7/d1b/d57/d6c 0 2024-09-21T08:02:30.835 INFO:tasks.workunit.client.1.smithi129.stdout:6/310: chown d7/d1b/d1e 436784741 1 2024-09-21T08:02:30.835 INFO:tasks.workunit.client.1.smithi129.stdout:5/427: dread d2/d1e/d35/f31 [0,4194304] 0 2024-09-21T08:02:30.835 INFO:tasks.workunit.client.1.smithi129.stdout:5/428: fsync d2/d1e/d35/f40 0 2024-09-21T08:02:30.836 INFO:tasks.workunit.client.1.smithi129.stdout:6/311: symlink d7/d1b/d57/l6d 0 2024-09-21T08:02:30.837 INFO:tasks.workunit.client.1.smithi129.stdout:5/429: link d2/d2a/l58 d2/d2a/l7f 0 2024-09-21T08:02:30.837 INFO:tasks.workunit.client.1.smithi129.stdout:6/312: stat d7/f24 0 2024-09-21T08:02:30.839 INFO:tasks.workunit.client.1.smithi129.stdout:5/430: mknod d2/d1e/d6b/c80 0 2024-09-21T08:02:30.839 INFO:tasks.workunit.client.1.smithi129.stdout:5/431: write d2/f4e [1531425,114337] 0 2024-09-21T08:02:30.839 INFO:tasks.workunit.client.1.smithi129.stdout:5/432: fsync d2/d2a/f68 0 2024-09-21T08:02:30.839 INFO:tasks.workunit.client.1.smithi129.stdout:5/433: dread - d2/d1e/d35/d33/d36/d5a/f6a zero size 2024-09-21T08:02:30.843 INFO:tasks.workunit.client.1.smithi129.stdout:3/415: dwrite d3/da/f49 [4194304,4194304] 0 2024-09-21T08:02:30.844 INFO:tasks.workunit.client.1.smithi129.stdout:3/416: symlink d3/d57/d70/l8d 0 2024-09-21T08:02:30.844 INFO:tasks.workunit.client.1.smithi129.stdout:3/417: creat d3/da/dc/d11/d2f/d27/d52/f8e x:0 0 0 2024-09-21T08:02:30.846 INFO:tasks.workunit.client.1.smithi129.stdout:3/418: unlink d3/da/l84 0 2024-09-21T08:02:30.848 INFO:tasks.workunit.client.1.smithi129.stdout:6/313: dread d7/f8 [0,4194304] 0 2024-09-21T08:02:30.848 INFO:tasks.workunit.client.1.smithi129.stdout:3/419: symlink d3/l8f 0 2024-09-21T08:02:30.848 INFO:tasks.workunit.client.1.smithi129.stdout:3/420: write d3/f29 [892538,75867] 0 2024-09-21T08:02:30.849 INFO:tasks.workunit.client.1.smithi129.stdout:6/314: fdatasync d7/f37 0 2024-09-21T08:02:30.852 INFO:tasks.workunit.client.1.smithi129.stdout:6/315: rename d7/d1b/d1e/d60 to d7/d1b/d1e/d39/d4b/d6e 0 2024-09-21T08:02:30.853 INFO:tasks.workunit.client.1.smithi129.stdout:3/421: mkdir d3/d90 0 2024-09-21T08:02:30.853 INFO:tasks.workunit.client.1.smithi129.stdout:3/422: creat d3/da/dc/d11/d2f/d27/f91 x:0 0 0 2024-09-21T08:02:30.855 INFO:tasks.workunit.client.1.smithi129.stdout:6/316: mknod d7/d1b/d25/d35/d40/d41/c6f 0 2024-09-21T08:02:30.855 INFO:tasks.workunit.client.1.smithi129.stdout:6/317: creat d7/d1b/d25/d35/d40/d41/f70 x:0 0 0 2024-09-21T08:02:30.856 INFO:tasks.workunit.client.1.smithi129.stdout:5/434: dwrite d2/d1e/d35/f4a [0,4194304] 0 2024-09-21T08:02:30.857 INFO:tasks.workunit.client.1.smithi129.stdout:3/423: symlink d3/d5a/l92 0 2024-09-21T08:02:30.859 INFO:tasks.workunit.client.1.smithi129.stdout:5/435: unlink d2/l75 0 2024-09-21T08:02:30.859 INFO:tasks.workunit.client.1.smithi129.stdout:5/436: getdents d2/d1e/d35/d33/d36/d5a/d77 0 2024-09-21T08:02:30.860 INFO:tasks.workunit.client.1.smithi129.stdout:5/437: mkdir d2/d1e/d35/d33/d36/d5a/d77/d81 0 2024-09-21T08:02:30.868 INFO:tasks.workunit.client.1.smithi129.stdout:5/438: getdents d2/d1e/d35/d33/d36/d5a/d77 0 2024-09-21T08:02:30.868 INFO:tasks.workunit.client.1.smithi129.stdout:5/439: fsync d2/d1e/d35/f4a 0 2024-09-21T08:02:30.869 INFO:tasks.workunit.client.1.smithi129.stdout:5/440: creat d2/d1e/d35/d33/d36/f82 x:0 0 0 2024-09-21T08:02:30.871 INFO:tasks.workunit.client.1.smithi129.stdout:6/318: read d7/d1b/f49 [3821268,41530] 0 2024-09-21T08:02:30.871 INFO:tasks.workunit.client.1.smithi129.stdout:5/441: symlink d2/d2a/d50/l83 0 2024-09-21T08:02:30.871 INFO:tasks.workunit.client.1.smithi129.stdout:5/442: chown d2/d1e/f1f 73039184 1 2024-09-21T08:02:30.874 INFO:tasks.workunit.client.1.smithi129.stdout:6/319: dread d7/d1b/d1e/d39/d4b/f4d [0,4194304] 0 2024-09-21T08:02:30.875 INFO:tasks.workunit.client.1.smithi129.stdout:6/320: mknod d7/d1b/d1e/d39/d4b/d67/c71 0 2024-09-21T08:02:30.875 INFO:tasks.workunit.client.1.smithi129.stdout:6/321: read d7/f8 [3880693,93288] 0 2024-09-21T08:02:30.875 INFO:tasks.workunit.client.1.smithi129.stdout:6/322: mknod d7/d10/c72 0 2024-09-21T08:02:30.876 INFO:tasks.workunit.client.1.smithi129.stdout:6/323: creat d7/d1b/d1e/d39/d4b/d6e/f73 x:0 0 0 2024-09-21T08:02:30.880 INFO:tasks.workunit.client.1.smithi129.stdout:5/443: dread d2/d1e/d35/f2d [0,4194304] 0 2024-09-21T08:02:30.881 INFO:tasks.workunit.client.1.smithi129.stdout:5/444: symlink d2/d1e/d35/d33/d36/d5a/d77/d81/l84 0 2024-09-21T08:02:30.881 INFO:tasks.workunit.client.1.smithi129.stdout:5/445: fdatasync d2/f55 0 2024-09-21T08:02:30.889 INFO:tasks.workunit.client.1.smithi129.stdout:3/424: dwrite d3/da/dc/d11/d2f/d27/d52/f82 [0,4194304] 0 2024-09-21T08:02:30.891 INFO:tasks.workunit.client.1.smithi129.stdout:5/446: write d2/d1e/f32 [8005314,33093] 0 2024-09-21T08:02:30.891 INFO:tasks.workunit.client.1.smithi129.stdout:5/447: fsync d2/d1e/d35/d33/f48 0 2024-09-21T08:02:30.892 INFO:tasks.workunit.client.1.smithi129.stdout:3/425: unlink d3/l74 0 2024-09-21T08:02:30.893 INFO:tasks.workunit.client.1.smithi129.stdout:5/448: mknod d2/d2a/d6f/c85 0 2024-09-21T08:02:30.896 INFO:tasks.workunit.client.1.smithi129.stdout:6/324: dwrite d7/d1b/d1e/d39/f4c [0,4194304] 0 2024-09-21T08:02:30.896 INFO:tasks.workunit.client.1.smithi129.stdout:5/449: rename d2/d2a/l58 to d2/d1e/d35/d33/d36/d5a/l86 0 2024-09-21T08:02:30.899 INFO:tasks.workunit.client.1.smithi129.stdout:8/293: sync 2024-09-21T08:02:30.899 INFO:tasks.workunit.client.1.smithi129.stdout:7/427: sync 2024-09-21T08:02:30.899 INFO:tasks.workunit.client.1.smithi129.stdout:9/381: sync 2024-09-21T08:02:30.899 INFO:tasks.workunit.client.1.smithi129.stdout:8/294: dread - d0/d6/d7/d18/f45 zero size 2024-09-21T08:02:30.899 INFO:tasks.workunit.client.1.smithi129.stdout:8/295: stat d0/d6/d7/d18/l33 0 2024-09-21T08:02:30.899 INFO:tasks.workunit.client.1.smithi129.stdout:8/296: stat d0/d6/d7/d9/f2a 0 2024-09-21T08:02:30.899 INFO:tasks.workunit.client.1.smithi129.stdout:7/428: creat d0/f8d x:0 0 0 2024-09-21T08:02:30.899 INFO:tasks.workunit.client.1.smithi129.stdout:8/297: fsync d0/d6/f1f 0 2024-09-21T08:02:30.899 INFO:tasks.workunit.client.1.smithi129.stdout:8/298: chown d0/f2b 181467233 1 2024-09-21T08:02:30.900 INFO:tasks.workunit.client.1.smithi129.stdout:5/450: symlink d2/d1e/d35/d33/d36/d5a/d77/l87 0 2024-09-21T08:02:30.902 INFO:tasks.workunit.client.1.smithi129.stdout:9/382: creat d17/d22/d33/d36/d48/d3f/d53/f7e x:0 0 0 2024-09-21T08:02:30.904 INFO:tasks.workunit.client.1.smithi129.stdout:7/429: unlink d0/d1e/l33 0 2024-09-21T08:02:30.904 INFO:tasks.workunit.client.1.smithi129.stdout:7/430: truncate d0/f24 1094789 0 2024-09-21T08:02:30.904 INFO:tasks.workunit.client.1.smithi129.stdout:7/431: write d0/d46/f5d [1385474,67570] 0 2024-09-21T08:02:30.905 INFO:tasks.workunit.client.1.smithi129.stdout:9/383: truncate d17/d22/d33/d36/d48/d3f/f57 2544401 0 2024-09-21T08:02:30.905 INFO:tasks.workunit.client.1.smithi129.stdout:1/480: sync 2024-09-21T08:02:30.905 INFO:tasks.workunit.client.1.smithi129.stdout:0/382: sync 2024-09-21T08:02:30.905 INFO:tasks.workunit.client.1.smithi129.stdout:2/597: sync 2024-09-21T08:02:30.906 INFO:tasks.workunit.client.1.smithi129.stdout:4/313: sync 2024-09-21T08:02:30.909 INFO:tasks.workunit.client.1.smithi129.stdout:9/384: unlink d17/d2c/d31/d35/f6f 0 2024-09-21T08:02:30.909 INFO:tasks.workunit.client.1.smithi129.stdout:7/432: mkdir d0/d46/d8e 0 2024-09-21T08:02:30.909 INFO:tasks.workunit.client.1.smithi129.stdout:0/383: rename de/d22/d27/d2f/c49 to de/d15/d39/d56/c76 0 2024-09-21T08:02:30.909 INFO:tasks.workunit.client.1.smithi129.stdout:7/433: write d0/d46/f53 [31781,115136] 0 2024-09-21T08:02:30.909 INFO:tasks.workunit.client.1.smithi129.stdout:7/434: fdatasync d0/f25 0 2024-09-21T08:02:30.909 INFO:tasks.workunit.client.1.smithi129.stdout:4/314: mknod d5/d33/d4e/c71 0 2024-09-21T08:02:30.909 INFO:tasks.workunit.client.1.smithi129.stdout:4/315: dread - d5/d16/d47/d5f/f6b zero size 2024-09-21T08:02:30.910 INFO:tasks.workunit.client.1.smithi129.stdout:5/451: dread d2/d1e/d35/f22 [0,4194304] 0 2024-09-21T08:02:30.911 INFO:tasks.workunit.client.1.smithi129.stdout:9/385: rename d17/f19 to d17/d22/d33/f7f 0 2024-09-21T08:02:30.911 INFO:tasks.workunit.client.1.smithi129.stdout:9/386: stat d17/d23/f2d 0 2024-09-21T08:02:30.911 INFO:tasks.workunit.client.1.smithi129.stdout:6/325: write d7/fa [2604814,37048] 0 2024-09-21T08:02:30.911 INFO:tasks.workunit.client.1.smithi129.stdout:9/387: readlink d17/d2c/d31/d5e/d6b/l6c 0 2024-09-21T08:02:30.911 INFO:tasks.workunit.client.1.smithi129.stdout:7/435: mkdir d0/d46/d8e/d8f 0 2024-09-21T08:02:30.912 INFO:tasks.workunit.client.1.smithi129.stdout:9/388: creat d17/f80 x:0 0 0 2024-09-21T08:02:30.914 INFO:tasks.workunit.client.1.smithi129.stdout:6/326: symlink d7/d1b/d25/d35/d40/d41/l74 0 2024-09-21T08:02:30.914 INFO:tasks.workunit.client.1.smithi129.stdout:6/327: readlink d7/d1b/d25/d35/l65 0 2024-09-21T08:02:30.914 INFO:tasks.workunit.client.1.smithi129.stdout:0/384: rename de/d15/f1d to de/d22/d27/d2f/d42/f77 0 2024-09-21T08:02:30.916 INFO:tasks.workunit.client.1.smithi129.stdout:7/436: mkdir d0/d46/d8e/d90 0 2024-09-21T08:02:30.916 INFO:tasks.workunit.client.1.smithi129.stdout:4/316: rmdir d5/d6 39 2024-09-21T08:02:30.916 INFO:tasks.workunit.client.1.smithi129.stdout:4/317: creat d5/d16/d24/d4f/f72 x:0 0 0 2024-09-21T08:02:30.916 INFO:tasks.workunit.client.1.smithi129.stdout:4/318: chown d5/d16/f1f 17740 1 2024-09-21T08:02:30.916 INFO:tasks.workunit.client.1.smithi129.stdout:4/319: creat d5/d35/f73 x:0 0 0 2024-09-21T08:02:30.917 INFO:tasks.workunit.client.1.smithi129.stdout:6/328: link d7/d1b/d25/d35/d40/l5a d7/d1b/d57/l75 0 2024-09-21T08:02:30.917 INFO:tasks.workunit.client.1.smithi129.stdout:0/385: rmdir de/d19 39 2024-09-21T08:02:30.920 INFO:tasks.workunit.client.1.smithi129.stdout:6/329: getdents d7/d1b/d25/d35/d40 0 2024-09-21T08:02:30.920 INFO:tasks.workunit.client.1.smithi129.stdout:6/330: truncate d7/d1b/d25/d35/d40/d41/f61 773579 0 2024-09-21T08:02:30.920 INFO:tasks.workunit.client.1.smithi129.stdout:6/331: fdatasync d7/d1b/d25/d2b/f3c 0 2024-09-21T08:02:30.920 INFO:tasks.workunit.client.1.smithi129.stdout:6/332: write d7/d1b/d25/d35/d40/d41/f48 [1209246,109777] 0 2024-09-21T08:02:30.922 INFO:tasks.workunit.client.1.smithi129.stdout:0/386: mknod de/d22/d27/d2f/d42/c78 0 2024-09-21T08:02:30.923 INFO:tasks.workunit.client.1.smithi129.stdout:9/389: rename d17/d38 to d17/d55/d81 0 2024-09-21T08:02:30.923 INFO:tasks.workunit.client.1.smithi129.stdout:0/387: mknod de/d15/d51/c79 0 2024-09-21T08:02:30.923 INFO:tasks.workunit.client.1.smithi129.stdout:0/388: creat de/d15/d44/d4b/f7a x:0 0 0 2024-09-21T08:02:30.923 INFO:tasks.workunit.client.1.smithi129.stdout:0/389: write de/d19/f66 [5162991,99324] 0 2024-09-21T08:02:30.924 INFO:tasks.workunit.client.1.smithi129.stdout:0/390: creat de/f7b x:0 0 0 2024-09-21T08:02:30.924 INFO:tasks.workunit.client.1.smithi129.stdout:0/391: fdatasync de/f12 0 2024-09-21T08:02:30.924 INFO:tasks.workunit.client.1.smithi129.stdout:0/392: creat de/d15/d29/f7c x:0 0 0 2024-09-21T08:02:30.924 INFO:tasks.workunit.client.1.smithi129.stdout:9/390: mknod d17/d22/d33/d36/d48/d3f/c82 0 2024-09-21T08:02:30.924 INFO:tasks.workunit.client.1.smithi129.stdout:9/391: stat d17/d2c/d31/d5e/d6b/c74 0 2024-09-21T08:02:30.927 INFO:tasks.workunit.client.1.smithi129.stdout:0/393: link de/d15/f18 de/d15/d39/d56/f7d 0 2024-09-21T08:02:30.928 INFO:tasks.workunit.client.1.smithi129.stdout:4/320: dread d5/d6/f30 [0,4194304] 0 2024-09-21T08:02:30.928 INFO:tasks.workunit.client.1.smithi129.stdout:0/394: mkdir de/d22/d7e 0 2024-09-21T08:02:30.929 INFO:tasks.workunit.client.1.smithi129.stdout:9/392: link d17/d2c/d31/d5e/d6b/f79 d17/f83 0 2024-09-21T08:02:30.930 INFO:tasks.workunit.client.1.smithi129.stdout:6/333: dread d7/fe [0,4194304] 0 2024-09-21T08:02:30.930 INFO:tasks.workunit.client.1.smithi129.stdout:6/334: fsync d7/d1b/d1e/d39/f5f 0 2024-09-21T08:02:30.930 INFO:tasks.workunit.client.1.smithi129.stdout:0/395: mkdir de/d15/d39/d7f 0 2024-09-21T08:02:30.930 INFO:tasks.workunit.client.1.smithi129.stdout:6/335: mknod d7/d4a/d69/c76 0 2024-09-21T08:02:30.931 INFO:tasks.workunit.client.1.smithi129.stdout:0/396: mknod de/d15/d39/c80 0 2024-09-21T08:02:30.932 INFO:tasks.workunit.client.1.smithi129.stdout:0/397: mkdir de/d81 0 2024-09-21T08:02:30.933 INFO:tasks.workunit.client.1.smithi129.stdout:0/398: creat de/d19/f82 x:0 0 0 2024-09-21T08:02:30.934 INFO:tasks.workunit.client.1.smithi129.stdout:0/399: mknod de/d15/d39/d56/c83 0 2024-09-21T08:02:30.936 INFO:tasks.workunit.client.1.smithi129.stdout:0/400: unlink de/d22/d27/f4c 0 2024-09-21T08:02:30.937 INFO:tasks.workunit.client.1.smithi129.stdout:0/401: mkdir de/d15/d44/d45/d84 0 2024-09-21T08:02:30.938 INFO:tasks.workunit.client.1.smithi129.stdout:0/402: rmdir de/d15/d39/d5b 39 2024-09-21T08:02:30.938 INFO:tasks.workunit.client.1.smithi129.stdout:0/403: readlink de/d22/l74 0 2024-09-21T08:02:30.939 INFO:tasks.workunit.client.1.smithi129.stdout:0/404: mkdir de/d22/d27/d85 0 2024-09-21T08:02:30.944 INFO:tasks.workunit.client.1.smithi129.stdout:8/299: dwrite d0/d6/d7/d24/f36 [0,4194304] 0 2024-09-21T08:02:30.946 INFO:tasks.workunit.client.1.smithi129.stdout:4/321: write d5/d11/f3d [506813,91347] 0 2024-09-21T08:02:30.946 INFO:tasks.workunit.client.1.smithi129.stdout:8/300: mknod d0/d6/d7/d18/d27/d32/d3d/c59 0 2024-09-21T08:02:30.948 INFO:tasks.workunit.client.1.smithi129.stdout:4/322: link d5/d16/d24/c49 d5/d16/c74 0 2024-09-21T08:02:30.961 INFO:tasks.workunit.client.1.smithi129.stdout:4/323: read d5/d6/f2f [564474,40055] 0 2024-09-21T08:02:30.961 INFO:tasks.workunit.client.1.smithi129.stdout:1/481: dwrite d1/d64/f66 [0,4194304] 0 2024-09-21T08:02:30.963 INFO:tasks.workunit.client.1.smithi129.stdout:2/598: dwrite d1/d13/d3a/d47/f34 [0,4194304] 0 2024-09-21T08:02:30.963 INFO:tasks.workunit.client.1.smithi129.stdout:2/599: write d1/dc/d19/d88/fcc [275315,126326] 0 2024-09-21T08:02:30.963 INFO:tasks.workunit.client.1.smithi129.stdout:9/393: dwrite d17/d46/f4f [0,4194304] 0 2024-09-21T08:02:30.963 INFO:tasks.workunit.client.1.smithi129.stdout:9/394: chown d17/f26 53216901 1 2024-09-21T08:02:30.963 INFO:tasks.workunit.client.1.smithi129.stdout:5/452: dwrite d2/d1e/d35/f4d [0,4194304] 0 2024-09-21T08:02:30.963 INFO:tasks.workunit.client.1.smithi129.stdout:0/405: dwrite de/f12 [0,4194304] 0 2024-09-21T08:02:30.963 INFO:tasks.workunit.client.1.smithi129.stdout:7/437: dwrite d0/f8 [0,4194304] 0 2024-09-21T08:02:30.963 INFO:tasks.workunit.client.1.smithi129.stdout:7/438: readlink d0/d46/l76 0 2024-09-21T08:02:30.963 INFO:tasks.workunit.client.1.smithi129.stdout:7/439: chown d0/d46/l73 393626298 1 2024-09-21T08:02:30.964 INFO:tasks.workunit.client.1.smithi129.stdout:1/482: readlink d1/d4/l5a 0 2024-09-21T08:02:30.964 INFO:tasks.workunit.client.1.smithi129.stdout:1/483: read - d1/d9/d31/f6f zero size 2024-09-21T08:02:30.966 INFO:tasks.workunit.client.1.smithi129.stdout:9/395: mknod d17/d2c/c84 0 2024-09-21T08:02:30.966 INFO:tasks.workunit.client.1.smithi129.stdout:9/396: dread - d17/f26 zero size 2024-09-21T08:02:30.969 INFO:tasks.workunit.client.1.smithi129.stdout:5/453: getdents d2/d2a/d50/d61 0 2024-09-21T08:02:30.976 INFO:tasks.workunit.client.1.smithi129.stdout:9/397: rename d17/d2c/d31/f5c to d17/d2c/d31/f85 0 2024-09-21T08:02:30.976 INFO:tasks.workunit.client.1.smithi129.stdout:9/398: write d17/d55/f62 [1031762,7968] 0 2024-09-21T08:02:30.977 INFO:tasks.workunit.client.1.smithi129.stdout:9/399: write d17/d22/d33/f7f [8704304,80631] 0 2024-09-21T08:02:30.981 INFO:tasks.workunit.client.1.smithi129.stdout:5/454: dread d2/d1e/d35/f4d [0,4194304] 0 2024-09-21T08:02:30.981 INFO:tasks.workunit.client.1.smithi129.stdout:5/455: truncate d2/f23 322208 0 2024-09-21T08:02:30.981 INFO:tasks.workunit.client.1.smithi129.stdout:5/456: write d2/f4 [2695083,79432] 0 2024-09-21T08:02:30.981 INFO:tasks.workunit.client.1.smithi129.stdout:5/457: chown d2/d2a/d50/c57 480 1 2024-09-21T08:02:30.982 INFO:tasks.workunit.client.1.smithi129.stdout:4/324: rename d5/d35 to d5/d16/d47/d5f/d64/d75 0 2024-09-21T08:02:30.986 INFO:tasks.workunit.client.1.smithi129.stdout:5/458: rmdir d2/d1e/d35/d33/d36 39 2024-09-21T08:02:30.987 INFO:tasks.workunit.client.1.smithi129.stdout:1/484: rename d1/d16/d28/f99 to d1/d64/fa6 0 2024-09-21T08:02:30.988 INFO:tasks.workunit.client.1.smithi129.stdout:7/440: dread d0/f25 [4194304,4194304] 0 2024-09-21T08:02:30.988 INFO:tasks.workunit.client.1.smithi129.stdout:1/485: unlink d1/d9/d6b/f8a 0 2024-09-21T08:02:30.989 INFO:tasks.workunit.client.1.smithi129.stdout:1/486: stat d1/f12 0 2024-09-21T08:02:30.990 INFO:tasks.workunit.client.1.smithi129.stdout:1/487: symlink d1/d9/d31/la7 0 2024-09-21T08:02:30.991 INFO:tasks.workunit.client.1.smithi129.stdout:1/488: unlink d1/d64/l7d 0 2024-09-21T08:02:30.992 INFO:tasks.workunit.client.1.smithi129.stdout:2/600: dwrite d1/dc/d94/fbf [0,4194304] 0 2024-09-21T08:02:30.993 INFO:tasks.workunit.client.1.smithi129.stdout:1/489: symlink d1/d16/d25/da0/la8 0 2024-09-21T08:02:30.993 INFO:tasks.workunit.client.1.smithi129.stdout:1/490: write d1/d7a/f95 [1470037,31929] 0 2024-09-21T08:02:30.993 INFO:tasks.workunit.client.1.smithi129.stdout:1/491: write d1/d9/f3d [4745145,23643] 0 2024-09-21T08:02:30.993 INFO:tasks.workunit.client.1.smithi129.stdout:1/492: write d1/d16/d28/f54 [1553881,83382] 0 2024-09-21T08:02:30.993 INFO:tasks.workunit.client.1.smithi129.stdout:0/406: dwrite de/d15/d39/f4a [0,4194304] 0 2024-09-21T08:02:30.995 INFO:tasks.workunit.client.1.smithi129.stdout:6/336: truncate d7/d1b/d25/d35/d40/d41/f61 580311 0 2024-09-21T08:02:30.997 INFO:tasks.workunit.client.1.smithi129.stdout:2/601: mknod d1/dc/d26/d45/ce0 0 2024-09-21T08:02:30.997 INFO:tasks.workunit.client.1.smithi129.stdout:5/459: dread d2/f79 [0,4194304] 0 2024-09-21T08:02:31.000 INFO:tasks.workunit.client.1.smithi129.stdout:8/301: truncate d0/d6/d7/d24/f36 456883 0 2024-09-21T08:02:31.003 INFO:tasks.workunit.client.1.smithi129.stdout:0/407: unlink de/d15/l73 0 2024-09-21T08:02:31.007 INFO:tasks.workunit.client.1.smithi129.stdout:4/325: dwrite d5/d16/d24/d3b/f46 [0,4194304] 0 2024-09-21T08:02:31.007 INFO:tasks.workunit.client.1.smithi129.stdout:4/326: fdatasync d5/d16/d24/d4f/f72 0 2024-09-21T08:02:31.007 INFO:tasks.workunit.client.1.smithi129.stdout:4/327: stat d5/d16/d24/f42 0 2024-09-21T08:02:31.009 INFO:tasks.workunit.client.1.smithi129.stdout:6/337: rename d7/d1b/d25/d35/l3d to d7/d1b/d1e/d39/d4b/d6e/l77 0 2024-09-21T08:02:31.009 INFO:tasks.workunit.client.1.smithi129.stdout:6/338: chown d7/d1b/d25/d35/d40 0 1 2024-09-21T08:02:31.009 INFO:tasks.workunit.client.1.smithi129.stdout:6/339: write d7/d1b/d25/d35/d40/d41/f62 [544992,48314] 0 2024-09-21T08:02:31.009 INFO:tasks.workunit.client.1.smithi129.stdout:6/340: truncate d7/d1b/d1e/d39/f4c 4967467 0 2024-09-21T08:02:31.009 INFO:tasks.workunit.client.1.smithi129.stdout:6/341: fsync f4 0 2024-09-21T08:02:31.009 INFO:tasks.workunit.client.1.smithi129.stdout:2/602: truncate d1/dc/d26/d45/d65/fc0 3807730 0 2024-09-21T08:02:31.010 INFO:tasks.workunit.client.1.smithi129.stdout:5/460: creat d2/d1e/d35/d33/f88 x:0 0 0 2024-09-21T08:02:31.010 INFO:tasks.workunit.client.1.smithi129.stdout:5/461: chown d2/d2a/d6f/c85 90609182 1 2024-09-21T08:02:31.010 INFO:tasks.workunit.client.1.smithi129.stdout:0/408: link de/d15/d29/f37 de/d19/f86 0 2024-09-21T08:02:31.011 INFO:tasks.workunit.client.1.smithi129.stdout:4/328: creat d5/d33/d4e/f76 x:0 0 0 2024-09-21T08:02:31.012 INFO:tasks.workunit.client.1.smithi129.stdout:0/409: rmdir de/d15/d39/d5b 39 2024-09-21T08:02:31.012 INFO:tasks.workunit.client.1.smithi129.stdout:0/410: chown de/d22/d27/d85 7 1 2024-09-21T08:02:31.012 INFO:tasks.workunit.client.1.smithi129.stdout:6/342: dread d7/d1b/f23 [0,4194304] 0 2024-09-21T08:02:31.012 INFO:tasks.workunit.client.1.smithi129.stdout:6/343: chown d7/d1b/d1e/d39/d4b/c44 1 1 2024-09-21T08:02:31.013 INFO:tasks.workunit.client.1.smithi129.stdout:4/329: mkdir d5/d11/d77 0 2024-09-21T08:02:31.013 INFO:tasks.workunit.client.1.smithi129.stdout:0/411: mkdir de/d15/d87 0 2024-09-21T08:02:31.014 INFO:tasks.workunit.client.1.smithi129.stdout:4/330: link d5/d16/l22 d5/d48/l78 0 2024-09-21T08:02:31.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:30 smithi129 ceph-mon[34472]: pgmap v7: 65 pgs: 65 active+clean; 613 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 74 MiB/s rd, 84 MiB/s wr, 158 op/s 2024-09-21T08:02:31.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:30 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:31.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:30 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:31.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:30 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:31.024 INFO:tasks.workunit.client.1.smithi129.stdout:7/441: dwrite d0/d1e/f4b [8388608,4194304] 0 2024-09-21T08:02:31.025 INFO:tasks.workunit.client.1.smithi129.stdout:7/442: truncate d0/f37 3695571 0 2024-09-21T08:02:31.025 INFO:tasks.workunit.client.1.smithi129.stdout:7/443: dread - d0/d1e/f7a zero size 2024-09-21T08:02:31.025 INFO:tasks.workunit.client.1.smithi129.stdout:7/444: chown d0/lb 816666 1 2024-09-21T08:02:31.028 INFO:tasks.workunit.client.1.smithi129.stdout:2/603: read d1/d13/d3a/d47/f27 [4093541,129864] 0 2024-09-21T08:02:31.028 INFO:tasks.workunit.client.1.smithi129.stdout:2/604: truncate d1/d13/d3a/d47/d1f/d85/fa6 381684 0 2024-09-21T08:02:31.028 INFO:tasks.workunit.client.1.smithi129.stdout:2/605: truncate d1/dc/d26/d45/d65/f57 805073 0 2024-09-21T08:02:31.028 INFO:tasks.workunit.client.1.smithi129.stdout:2/606: truncate d1/dc/d19/d88/fd3 850020 0 2024-09-21T08:02:31.028 INFO:tasks.workunit.client.1.smithi129.stdout:2/607: write d1/d13/d32/d97/fa5 [16408,101141] 0 2024-09-21T08:02:31.028 INFO:tasks.workunit.client.1.smithi129.stdout:2/608: chown d1/dc/d26/d45/d65/f92 637213 1 2024-09-21T08:02:31.029 INFO:tasks.workunit.client.1.smithi129.stdout:2/609: write d1/dc/d19/d4c/d6a/f3d [570763,85649] 0 2024-09-21T08:02:31.029 INFO:tasks.workunit.client.1.smithi129.stdout:2/610: fdatasync d1/d13/d32/d7c/f8e 0 2024-09-21T08:02:31.029 INFO:tasks.workunit.client.1.smithi129.stdout:2/611: dread - d1/d13/d3a/d47/d5f/fc6 zero size 2024-09-21T08:02:31.030 INFO:tasks.workunit.client.1.smithi129.stdout:4/331: write d5/d6/f30 [3145159,11038] 0 2024-09-21T08:02:31.031 INFO:tasks.workunit.client.1.smithi129.stdout:4/332: write d5/d16/d47/f70 [33962,90971] 0 2024-09-21T08:02:31.032 INFO:tasks.workunit.client.1.smithi129.stdout:8/302: dwrite d0/d6/d7/d24/f35 [0,4194304] 0 2024-09-21T08:02:31.032 INFO:tasks.workunit.client.1.smithi129.stdout:2/612: creat d1/d13/d3a/dc1/fe1 x:0 0 0 2024-09-21T08:02:31.032 INFO:tasks.workunit.client.1.smithi129.stdout:2/613: write d1/f39 [740291,99745] 0 2024-09-21T08:02:31.033 INFO:tasks.workunit.client.1.smithi129.stdout:2/614: write d1/d13/d32/f3b [1669783,77411] 0 2024-09-21T08:02:31.034 INFO:tasks.workunit.client.1.smithi129.stdout:4/333: mknod d5/d33/d66/c79 0 2024-09-21T08:02:31.037 INFO:tasks.workunit.client.1.smithi129.stdout:8/303: mkdir d0/d6/d7/d5a 0 2024-09-21T08:02:31.037 INFO:tasks.workunit.client.1.smithi129.stdout:8/304: write d0/d6/d7/d18/d27/d32/d37/f42 [2711373,53861] 0 2024-09-21T08:02:31.040 INFO:tasks.workunit.client.1.smithi129.stdout:2/615: rmdir d1/dc/d19/d4c/d6a 39 2024-09-21T08:02:31.040 INFO:tasks.workunit.client.1.smithi129.stdout:2/616: stat d1/d53/d68/cb5 0 2024-09-21T08:02:31.040 INFO:tasks.workunit.client.1.smithi129.stdout:4/334: getdents d5/d16 0 2024-09-21T08:02:31.040 INFO:tasks.workunit.client.1.smithi129.stdout:4/335: dread - d5/d16/d47/d5f/d64/d75/f59 zero size 2024-09-21T08:02:31.042 INFO:tasks.workunit.client.1.smithi129.stdout:2/617: unlink d1/d13/d3a/d47/d1f/f23 0 2024-09-21T08:02:31.044 INFO:tasks.workunit.client.1.smithi129.stdout:3/426: sync 2024-09-21T08:02:31.045 INFO:tasks.workunit.client.1.smithi129.stdout:8/305: dread d0/d6/d7/d24/f47 [0,4194304] 0 2024-09-21T08:02:31.046 INFO:tasks.workunit.client.1.smithi129.stdout:3/427: creat d3/f93 x:0 0 0 2024-09-21T08:02:31.046 INFO:tasks.workunit.client.1.smithi129.stdout:3/428: truncate d3/f93 1031130 0 2024-09-21T08:02:31.046 INFO:tasks.workunit.client.1.smithi129.stdout:3/429: stat d3/da/dc/d11/d2f/d27/d52/c6c 0 2024-09-21T08:02:31.048 INFO:tasks.workunit.client.1.smithi129.stdout:7/445: dwrite d0/d1e/f8a [0,4194304] 0 2024-09-21T08:02:31.048 INFO:tasks.workunit.client.1.smithi129.stdout:7/446: chown d0/d71 12 1 2024-09-21T08:02:31.048 INFO:tasks.workunit.client.1.smithi129.stdout:8/306: creat d0/d6/d7/d18/d27/d32/f5b x:0 0 0 2024-09-21T08:02:31.049 INFO:tasks.workunit.client.1.smithi129.stdout:6/344: dwrite d7/d1b/d25/d2b/f3c [0,4194304] 0 2024-09-21T08:02:31.051 INFO:tasks.workunit.client.1.smithi129.stdout:8/307: creat d0/d6/d7/d5a/f5c x:0 0 0 2024-09-21T08:02:31.053 INFO:tasks.workunit.client.1.smithi129.stdout:8/308: mkdir d0/d6/d7/d5d 0 2024-09-21T08:02:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:30 smithi107 ceph-mon[27622]: pgmap v7: 65 pgs: 65 active+clean; 613 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 74 MiB/s rd, 84 MiB/s wr, 158 op/s 2024-09-21T08:02:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:30 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:30 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:30 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:31.056 INFO:tasks.workunit.client.1.smithi129.stdout:8/309: creat d0/d6/d7/d24/f5e x:0 0 0 2024-09-21T08:02:31.059 INFO:tasks.workunit.client.1.smithi129.stdout:7/447: write d0/d46/d6e/f5c [1114173,91453] 0 2024-09-21T08:02:31.061 INFO:tasks.workunit.client.1.smithi129.stdout:3/430: dread d3/da/dc/fd [0,4194304] 0 2024-09-21T08:02:31.061 INFO:tasks.workunit.client.1.smithi129.stdout:0/412: dwrite de/d15/d39/d56/f5f [0,4194304] 0 2024-09-21T08:02:31.061 INFO:tasks.workunit.client.1.smithi129.stdout:0/413: chown de/d15/l1b 1387955 1 2024-09-21T08:02:31.061 INFO:tasks.workunit.client.1.smithi129.stdout:3/431: write d3/da/dc/d11/d55/d68/f87 [8435931,25123] 0 2024-09-21T08:02:31.062 INFO:tasks.workunit.client.1.smithi129.stdout:6/345: write d7/d10/f14 [1754146,108897] 0 2024-09-21T08:02:31.062 INFO:tasks.workunit.client.1.smithi129.stdout:5/462: dwrite d2/d1e/d35/d33/d36/f59 [0,4194304] 0 2024-09-21T08:02:31.063 INFO:tasks.workunit.client.1.smithi129.stdout:0/414: truncate de/d15/d39/f4a 430760 0 2024-09-21T08:02:31.065 INFO:tasks.workunit.client.1.smithi129.stdout:6/346: rename d7/d1b/d57/d6c to d7/d1b/d25/d35/d40/d78 0 2024-09-21T08:02:31.065 INFO:tasks.workunit.client.1.smithi129.stdout:6/347: chown d7/d1b/d25/d35/l59 15 1 2024-09-21T08:02:31.067 INFO:tasks.workunit.client.1.smithi129.stdout:0/415: unlink de/d1f/c6d 0 2024-09-21T08:02:31.067 INFO:tasks.workunit.client.1.smithi129.stdout:0/416: truncate de/d15/f59 278951 0 2024-09-21T08:02:31.067 INFO:tasks.workunit.client.1.smithi129.stdout:0/417: chown de/f13 3 1 2024-09-21T08:02:31.071 INFO:tasks.workunit.client.1.smithi129.stdout:8/310: dread d0/d6/f1a [0,4194304] 0 2024-09-21T08:02:31.074 INFO:tasks.workunit.client.1.smithi129.stdout:8/311: rename d0/d6/d7/f15 to d0/d6/d7/d9/f5f 0 2024-09-21T08:02:31.076 INFO:tasks.workunit.client.1.smithi129.stdout:4/336: dwrite d5/d33/f4d [0,4194304] 0 2024-09-21T08:02:31.076 INFO:tasks.workunit.client.1.smithi129.stdout:7/448: dread d0/d46/d6e/f63 [0,4194304] 0 2024-09-21T08:02:31.082 INFO:tasks.workunit.client.1.smithi129.stdout:4/337: truncate d5/d11/f3d 1923562 0 2024-09-21T08:02:31.082 INFO:tasks.workunit.client.1.smithi129.stdout:4/338: creat d5/f7a x:0 0 0 2024-09-21T08:02:31.082 INFO:tasks.workunit.client.1.smithi129.stdout:2/618: dwrite d1/dc/d26/d45/f7b [0,4194304] 0 2024-09-21T08:02:31.082 INFO:tasks.workunit.client.1.smithi129.stdout:6/348: dread f4 [0,4194304] 0 2024-09-21T08:02:31.082 INFO:tasks.workunit.client.1.smithi129.stdout:8/312: dread d0/d6/d7/d24/f36 [0,4194304] 0 2024-09-21T08:02:31.082 INFO:tasks.workunit.client.1.smithi129.stdout:8/313: fdatasync d0/d6/d7/d18/d27/d32/f54 0 2024-09-21T08:02:31.087 INFO:tasks.workunit.client.1.smithi129.stdout:7/449: dread d0/d71/f7f [0,4194304] 0 2024-09-21T08:02:31.087 INFO:tasks.workunit.client.1.smithi129.stdout:7/450: write d0/d46/d6e/f83 [12425,80653] 0 2024-09-21T08:02:31.088 INFO:tasks.workunit.client.1.smithi129.stdout:2/619: creat d1/d13/d32/d7c/fe2 x:0 0 0 2024-09-21T08:02:31.089 INFO:tasks.workunit.client.1.smithi129.stdout:6/349: mkdir d7/d1b/d1e/d39/d79 0 2024-09-21T08:02:31.090 INFO:tasks.workunit.client.1.smithi129.stdout:8/314: mkdir d0/d6/d7/d18/d27/d60 0 2024-09-21T08:02:31.091 INFO:tasks.workunit.client.1.smithi129.stdout:7/451: mknod d0/d46/d8e/c91 0 2024-09-21T08:02:31.091 INFO:tasks.workunit.client.1.smithi129.stdout:8/315: mkdir d0/d6/d7/d18/d61 0 2024-09-21T08:02:31.093 INFO:tasks.workunit.client.1.smithi129.stdout:7/452: creat d0/d46/d8e/d90/f92 x:0 0 0 2024-09-21T08:02:31.093 INFO:tasks.workunit.client.1.smithi129.stdout:7/453: write d0/f8d [23172,33500] 0 2024-09-21T08:02:31.093 INFO:tasks.workunit.client.1.smithi129.stdout:3/432: dwrite d3/da/dc/d11/d2f/f40 [0,4194304] 0 2024-09-21T08:02:31.093 INFO:tasks.workunit.client.1.smithi129.stdout:7/454: readlink d0/d71/l87 0 2024-09-21T08:02:31.094 INFO:tasks.workunit.client.1.smithi129.stdout:8/316: mknod d0/d6/d7/c62 0 2024-09-21T08:02:31.097 INFO:tasks.workunit.client.1.smithi129.stdout:0/418: rmdir de/d1f 39 2024-09-21T08:02:31.102 INFO:tasks.workunit.client.1.smithi129.stdout:0/419: rmdir de/d22/d7e 0 2024-09-21T08:02:31.103 INFO:tasks.workunit.client.1.smithi129.stdout:0/420: link de/d1f/c33 de/d15/d39/c88 0 2024-09-21T08:02:31.104 INFO:tasks.workunit.client.1.smithi129.stdout:3/433: write d3/da/dc/f22 [6370724,48168] 0 2024-09-21T08:02:31.104 INFO:tasks.workunit.client.1.smithi129.stdout:3/434: chown d3/da/dc/d11/d2f/l83 383965 1 2024-09-21T08:02:31.104 INFO:tasks.workunit.client.1.smithi129.stdout:3/435: fdatasync d3/f13 0 2024-09-21T08:02:31.105 INFO:tasks.workunit.client.1.smithi129.stdout:4/339: dwrite d5/f63 [0,4194304] 0 2024-09-21T08:02:31.105 INFO:tasks.workunit.client.1.smithi129.stdout:4/340: creat d5/d33/d4e/f7b x:0 0 0 2024-09-21T08:02:31.105 INFO:tasks.workunit.client.1.smithi129.stdout:9/400: sync 2024-09-21T08:02:31.105 INFO:tasks.workunit.client.1.smithi129.stdout:9/401: read d17/d55/d81/f52 [229509,15466] 0 2024-09-21T08:02:31.106 INFO:tasks.workunit.client.1.smithi129.stdout:3/436: truncate d3/da/f54 380578 0 2024-09-21T08:02:31.111 INFO:tasks.workunit.client.1.smithi129.stdout:2/620: dwrite d1/d13/d3a/d47/f63 [0,4194304] 0 2024-09-21T08:02:31.111 INFO:tasks.workunit.client.1.smithi129.stdout:2/621: fsync d1/d13/d32/d7c/f8e 0 2024-09-21T08:02:31.111 INFO:tasks.workunit.client.1.smithi129.stdout:2/622: dread - d1/d13/d32/f90 zero size 2024-09-21T08:02:31.111 INFO:tasks.workunit.client.1.smithi129.stdout:4/341: link d5/d16/d24/l2c d5/d16/l7c 0 2024-09-21T08:02:31.112 INFO:tasks.workunit.client.1.smithi129.stdout:8/317: getdents d0/d6/d7/d18 0 2024-09-21T08:02:31.115 INFO:tasks.workunit.client.1.smithi129.stdout:8/318: rename d0/d6/d7/d18/f45 to d0/d6/d7/d18/d27/d32/d37/f63 0 2024-09-21T08:02:31.117 INFO:tasks.workunit.client.1.smithi129.stdout:8/319: mknod d0/d6/d7/d9/c64 0 2024-09-21T08:02:31.117 INFO:tasks.workunit.client.1.smithi129.stdout:8/320: write d0/d6/d7/d24/f46 [968329,43964] 0 2024-09-21T08:02:31.117 INFO:tasks.workunit.client.1.smithi129.stdout:8/321: write d0/d6/f4c [476028,80913] 0 2024-09-21T08:02:31.118 INFO:tasks.workunit.client.1.smithi129.stdout:8/322: symlink d0/d6/d7/d3a/l65 0 2024-09-21T08:02:31.119 INFO:tasks.workunit.client.1.smithi129.stdout:4/342: dread d5/d16/d24/d3b/f46 [0,4194304] 0 2024-09-21T08:02:31.120 INFO:tasks.workunit.client.1.smithi129.stdout:4/343: getdents d5/d16/d47/d5f 0 2024-09-21T08:02:31.121 INFO:tasks.workunit.client.1.smithi129.stdout:4/344: link d5/d16/d24/l5a d5/d16/d47/d61/l7d 0 2024-09-21T08:02:31.123 INFO:tasks.workunit.client.1.smithi129.stdout:4/345: link d5/d33/d66/f68 d5/d11/d77/f7e 0 2024-09-21T08:02:31.123 INFO:tasks.workunit.client.1.smithi129.stdout:4/346: fsync d5/d33/d66/f69 0 2024-09-21T08:02:31.123 INFO:tasks.workunit.client.1.smithi129.stdout:8/323: dread d0/f11 [0,4194304] 0 2024-09-21T08:02:31.124 INFO:tasks.workunit.client.1.smithi129.stdout:4/347: creat d5/d6/f7f x:0 0 0 2024-09-21T08:02:31.124 INFO:tasks.workunit.client.1.smithi129.stdout:4/348: dread - d5/d16/d24/d4f/f72 zero size 2024-09-21T08:02:31.124 INFO:tasks.workunit.client.1.smithi129.stdout:4/349: write d5/d11/d3f/d50/f60 [938493,94520] 0 2024-09-21T08:02:31.124 INFO:tasks.workunit.client.1.smithi129.stdout:8/324: symlink d0/d6/d7/d5a/l66 0 2024-09-21T08:02:31.128 INFO:tasks.workunit.client.1.smithi129.stdout:2/623: write d1/dc/f16 [1408793,75584] 0 2024-09-21T08:02:31.128 INFO:tasks.workunit.client.1.smithi129.stdout:0/421: dwrite de/d15/d29/f37 [0,4194304] 0 2024-09-21T08:02:31.131 INFO:tasks.workunit.client.1.smithi129.stdout:9/402: dwrite d17/d55/f62 [0,4194304] 0 2024-09-21T08:02:31.132 INFO:tasks.workunit.client.1.smithi129.stdout:9/403: stat d17/f26 0 2024-09-21T08:02:31.134 INFO:tasks.workunit.client.1.smithi129.stdout:9/404: dread f13 [0,4194304] 0 2024-09-21T08:02:31.136 INFO:tasks.workunit.client.1.smithi129.stdout:9/405: symlink d17/d22/d33/d36/d76/l86 0 2024-09-21T08:02:31.136 INFO:tasks.workunit.client.1.smithi129.stdout:9/406: chown d17 679 1 2024-09-21T08:02:31.139 INFO:tasks.workunit.client.1.smithi129.stdout:8/325: dread d0/d6/d7/d9/f5f [0,4194304] 0 2024-09-21T08:02:31.139 INFO:tasks.workunit.client.1.smithi129.stdout:8/326: write d0/f2b [3074289,1453] 0 2024-09-21T08:02:31.140 INFO:tasks.workunit.client.1.smithi129.stdout:8/327: fsync d0/d6/d7/d18/d27/d32/f5b 0 2024-09-21T08:02:31.140 INFO:tasks.workunit.client.1.smithi129.stdout:8/328: creat d0/f67 x:0 0 0 2024-09-21T08:02:31.141 INFO:tasks.workunit.client.1.smithi129.stdout:8/329: truncate d0/d6/f34 212076 0 2024-09-21T08:02:31.141 INFO:tasks.workunit.client.1.smithi129.stdout:8/330: dread - d0/d6/d7/d18/d27/d32/f5b zero size 2024-09-21T08:02:31.144 INFO:tasks.workunit.client.1.smithi129.stdout:0/422: read de/d15/f43 [2080352,63013] 0 2024-09-21T08:02:31.149 INFO:tasks.workunit.client.1.smithi129.stdout:0/423: dread f7 [0,4194304] 0 2024-09-21T08:02:31.149 INFO:tasks.workunit.client.1.smithi129.stdout:0/424: readlink de/d22/d27/l53 0 2024-09-21T08:02:31.149 INFO:tasks.workunit.client.1.smithi129.stdout:0/425: chown de/d15/d39/d7f 1634 1 2024-09-21T08:02:31.150 INFO:tasks.workunit.client.1.smithi129.stdout:0/426: creat de/d15/d87/f89 x:0 0 0 2024-09-21T08:02:31.150 INFO:tasks.workunit.client.1.smithi129.stdout:0/427: getdents de/d15/d44/d45/d84 0 2024-09-21T08:02:31.151 INFO:tasks.workunit.client.1.smithi129.stdout:2/624: dwrite d1/dc/d26/d45/d65/fa8 [0,4194304] 0 2024-09-21T08:02:31.151 INFO:tasks.workunit.client.1.smithi129.stdout:2/625: write d1/d13/d3a/d47/d1f/f98 [2205316,115998] 0 2024-09-21T08:02:31.151 INFO:tasks.workunit.client.1.smithi129.stdout:2/626: stat d1/dc/d19/cbd 0 2024-09-21T08:02:31.151 INFO:tasks.workunit.client.1.smithi129.stdout:4/350: dwrite d5/d16/d24/d3b/f65 [0,4194304] 0 2024-09-21T08:02:31.153 INFO:tasks.workunit.client.1.smithi129.stdout:2/627: creat d1/dc/d26/d45/d65/fe3 x:0 0 0 2024-09-21T08:02:31.153 INFO:tasks.workunit.client.1.smithi129.stdout:2/628: write d1/d13/d3a/d47/d5f/fc6 [11383,78617] 0 2024-09-21T08:02:31.155 INFO:tasks.workunit.client.1.smithi129.stdout:4/351: symlink d5/d11/d3f/d50/l80 0 2024-09-21T08:02:31.156 INFO:tasks.workunit.client.1.smithi129.stdout:2/629: mknod d1/d13/d3a/d8f/ce4 0 2024-09-21T08:02:31.156 INFO:tasks.workunit.client.1.smithi129.stdout:0/428: dread fd [0,4194304] 0 2024-09-21T08:02:31.157 INFO:tasks.workunit.client.1.smithi129.stdout:2/630: mkdir d1/dc/d26/d45/d65/ddf/de5 0 2024-09-21T08:02:31.158 INFO:tasks.workunit.client.1.smithi129.stdout:0/429: creat de/d15/d39/f8a x:0 0 0 2024-09-21T08:02:31.161 INFO:tasks.workunit.client.1.smithi129.stdout:9/407: dwrite d17/f61 [0,4194304] 0 2024-09-21T08:02:31.162 INFO:tasks.workunit.client.1.smithi129.stdout:8/331: dwrite d0/d6/d7/f40 [0,4194304] 0 2024-09-21T08:02:31.162 INFO:tasks.workunit.client.1.smithi129.stdout:0/430: write de/d15/d39/f4a [151571,15529] 0 2024-09-21T08:02:31.162 INFO:tasks.workunit.client.1.smithi129.stdout:0/431: creat de/d15/d51/f8b x:0 0 0 2024-09-21T08:02:31.162 INFO:tasks.workunit.client.1.smithi129.stdout:0/432: fsync de/d15/f43 0 2024-09-21T08:02:31.166 INFO:tasks.workunit.client.1.smithi129.stdout:9/408: creat d17/d2c/d31/f87 x:0 0 0 2024-09-21T08:02:31.167 INFO:tasks.workunit.client.1.smithi129.stdout:9/409: mknod d17/d22/d33/d36/d48/d3f/d71/c88 0 2024-09-21T08:02:31.169 INFO:tasks.workunit.client.1.smithi129.stdout:0/433: getdents de/d15 0 2024-09-21T08:02:31.169 INFO:tasks.workunit.client.1.smithi129.stdout:1/493: sync 2024-09-21T08:02:31.169 INFO:tasks.workunit.client.1.smithi129.stdout:9/410: write f15 [660549,13166] 0 2024-09-21T08:02:31.171 INFO:tasks.workunit.client.1.smithi129.stdout:1/494: mkdir d1/d4/d6e/da9 0 2024-09-21T08:02:31.174 INFO:tasks.workunit.client.1.smithi129.stdout:1/495: truncate d1/d4/f17 1332084 0 2024-09-21T08:02:31.175 INFO:tasks.workunit.client.1.smithi129.stdout:1/496: stat d1/d4/c7 0 2024-09-21T08:02:31.176 INFO:tasks.workunit.client.1.smithi129.stdout:1/497: symlink d1/d7a/laa 0 2024-09-21T08:02:31.185 INFO:tasks.workunit.client.1.smithi129.stdout:4/352: dwrite d5/d33/f4d [4194304,4194304] 0 2024-09-21T08:02:31.187 INFO:tasks.workunit.client.1.smithi129.stdout:4/353: symlink d5/d33/d4e/l81 0 2024-09-21T08:02:31.187 INFO:tasks.workunit.client.1.smithi129.stdout:4/354: fsync d5/d11/f4c 0 2024-09-21T08:02:31.187 INFO:tasks.workunit.client.1.smithi129.stdout:4/355: chown d5/d11/d77 4045 1 2024-09-21T08:02:31.188 INFO:tasks.workunit.client.1.smithi129.stdout:4/356: truncate d5/f2b 116753 0 2024-09-21T08:02:31.199 INFO:tasks.workunit.client.1.smithi129.stdout:2/631: dwrite d1/d53/d77/fd1 [0,4194304] 0 2024-09-21T08:02:31.199 INFO:tasks.workunit.client.1.smithi129.stdout:8/332: dwrite d0/d6/d7/f21 [0,4194304] 0 2024-09-21T08:02:31.199 INFO:tasks.workunit.client.1.smithi129.stdout:2/632: chown d1/dc/d26/d45/d65/d99 1047190 1 2024-09-21T08:02:31.200 INFO:tasks.workunit.client.1.smithi129.stdout:0/434: dwrite de/d22/f2b [0,4194304] 0 2024-09-21T08:02:31.201 INFO:tasks.workunit.client.1.smithi129.stdout:1/498: dwrite d1/d9/d6b/f91 [0,4194304] 0 2024-09-21T08:02:31.201 INFO:tasks.workunit.client.1.smithi129.stdout:0/435: chown de/d15/f1c 1 1 2024-09-21T08:02:31.201 INFO:tasks.workunit.client.1.smithi129.stdout:0/436: chown de/d15/d39/d56/f5f 1 1 2024-09-21T08:02:31.201 INFO:tasks.workunit.client.1.smithi129.stdout:1/499: chown d1/c1d 57534810 1 2024-09-21T08:02:31.201 INFO:tasks.workunit.client.1.smithi129.stdout:1/500: truncate d1/d16/d28/f5c 638746 0 2024-09-21T08:02:31.201 INFO:tasks.workunit.client.1.smithi129.stdout:1/501: chown d1/d16/d25/l65 646836045 1 2024-09-21T08:02:31.201 INFO:tasks.workunit.client.1.smithi129.stdout:4/357: write f2 [273185,99636] 0 2024-09-21T08:02:31.201 INFO:tasks.workunit.client.1.smithi129.stdout:4/358: write d5/d16/d47/d5f/d64/d75/f73 [466161,14839] 0 2024-09-21T08:02:31.206 INFO:tasks.workunit.client.1.smithi129.stdout:2/633: rmdir d1/dc 39 2024-09-21T08:02:31.206 INFO:tasks.workunit.client.1.smithi129.stdout:2/634: write d1/d13/d3a/d47/d5f/fa4 [510829,38296] 0 2024-09-21T08:02:31.206 INFO:tasks.workunit.client.1.smithi129.stdout:2/635: read d1/d13/d3a/d47/d1f/f22 [2972661,81166] 0 2024-09-21T08:02:31.207 INFO:tasks.workunit.client.1.smithi129.stdout:8/333: mkdir d0/d6/d7/d3a/d68 0 2024-09-21T08:02:31.209 INFO:tasks.workunit.client.1.smithi129.stdout:7/455: sync 2024-09-21T08:02:31.209 INFO:tasks.workunit.client.1.smithi129.stdout:3/437: sync 2024-09-21T08:02:31.211 INFO:tasks.workunit.client.1.smithi129.stdout:6/350: sync 2024-09-21T08:02:31.217 INFO:tasks.workunit.client.1.smithi129.stdout:0/437: creat de/d81/f8c x:0 0 0 2024-09-21T08:02:31.217 INFO:tasks.workunit.client.1.smithi129.stdout:0/438: creat de/d81/f8d x:0 0 0 2024-09-21T08:02:31.218 INFO:tasks.workunit.client.1.smithi129.stdout:5/463: sync 2024-09-21T08:02:31.218 INFO:tasks.workunit.client.1.smithi129.stdout:5/464: write d2/d2a/d50/f53 [421655,91539] 0 2024-09-21T08:02:31.220 INFO:tasks.workunit.client.1.smithi129.stdout:4/359: dwrite d5/d16/d47/d5f/d64/d75/f73 [0,4194304] 0 2024-09-21T08:02:31.221 INFO:tasks.workunit.client.1.smithi129.stdout:8/334: mknod d0/d6/d7/d3a/c69 0 2024-09-21T08:02:31.223 INFO:tasks.workunit.client.1.smithi129.stdout:3/438: mkdir d3/da/d5d/d94 0 2024-09-21T08:02:31.224 INFO:tasks.workunit.client.1.smithi129.stdout:7/456: symlink d0/d46/l93 0 2024-09-21T08:02:31.224 INFO:tasks.workunit.client.1.smithi129.stdout:7/457: chown d0/d1e/f8b 190092424 1 2024-09-21T08:02:31.224 INFO:tasks.workunit.client.1.smithi129.stdout:6/351: mkdir d7/d4a/d7a 0 2024-09-21T08:02:31.227 INFO:tasks.workunit.client.1.smithi129.stdout:1/502: rename d1/d4/c18 to d1/d9/d31/cab 0 2024-09-21T08:02:31.227 INFO:tasks.workunit.client.1.smithi129.stdout:1/503: write d1/fd [2074584,129386] 0 2024-09-21T08:02:31.227 INFO:tasks.workunit.client.1.smithi129.stdout:1/504: dread - d1/d9/d31/f6f zero size 2024-09-21T08:02:31.228 INFO:tasks.workunit.client.1.smithi129.stdout:5/465: symlink d2/l89 0 2024-09-21T08:02:31.229 INFO:tasks.workunit.client.1.smithi129.stdout:2/636: dwrite d1/d13/f41 [0,4194304] 0 2024-09-21T08:02:31.229 INFO:tasks.workunit.client.1.smithi129.stdout:2/637: creat d1/dc/d26/d45/fe6 x:0 0 0 2024-09-21T08:02:31.230 INFO:tasks.workunit.client.1.smithi129.stdout:4/360: rmdir d5/d11/d3f/d50 39 2024-09-21T08:02:31.230 INFO:tasks.workunit.client.1.smithi129.stdout:7/458: mknod d0/c94 0 2024-09-21T08:02:31.232 INFO:tasks.workunit.client.1.smithi129.stdout:6/352: unlink d7/d1b/d25/d2b/d3e/f4e 0 2024-09-21T08:02:31.232 INFO:tasks.workunit.client.1.smithi129.stdout:6/353: creat d7/d1b/f7b x:0 0 0 2024-09-21T08:02:31.232 INFO:tasks.workunit.client.1.smithi129.stdout:6/354: chown d7/d1b/d1e/c2d 12682958 1 2024-09-21T08:02:31.234 INFO:tasks.workunit.client.1.smithi129.stdout:5/466: creat d2/d1e/d35/d33/d36/f8a x:0 0 0 2024-09-21T08:02:31.238 INFO:tasks.workunit.client.1.smithi129.stdout:2/638: truncate d1/d13/d3a/d47/d1f/f2a 996358 0 2024-09-21T08:02:31.239 INFO:tasks.workunit.client.1.smithi129.stdout:7/459: creat d0/d46/d8e/d8f/f95 x:0 0 0 2024-09-21T08:02:31.239 INFO:tasks.workunit.client.1.smithi129.stdout:7/460: chown d0/d1e/l31 1412586 1 2024-09-21T08:02:31.241 INFO:tasks.workunit.client.1.smithi129.stdout:6/355: mkdir d7/d1b/d1e/d66/d7c 0 2024-09-21T08:02:31.241 INFO:tasks.workunit.client.1.smithi129.stdout:5/467: dread d2/d2a/d50/f4f [0,4194304] 0 2024-09-21T08:02:31.241 INFO:tasks.workunit.client.1.smithi129.stdout:6/356: fdatasync d7/d1b/d1e/d39/f5f 0 2024-09-21T08:02:31.242 INFO:tasks.workunit.client.1.smithi129.stdout:7/461: write d0/f8 [4295636,26833] 0 2024-09-21T08:02:31.242 INFO:tasks.workunit.client.1.smithi129.stdout:7/462: write d0/d1e/f81 [121735,59301] 0 2024-09-21T08:02:31.242 INFO:tasks.workunit.client.1.smithi129.stdout:7/463: fdatasync d0/d46/f53 0 2024-09-21T08:02:31.244 INFO:tasks.workunit.client.1.smithi129.stdout:6/357: unlink d7/d1b/f23 0 2024-09-21T08:02:31.245 INFO:tasks.workunit.client.1.smithi129.stdout:3/439: rename d3/da/dc/d11/d2f/d27 to d3/d69/d95 0 2024-09-21T08:02:31.246 INFO:tasks.workunit.client.1.smithi129.stdout:7/464: symlink d0/d71/l96 0 2024-09-21T08:02:31.246 INFO:tasks.workunit.client.1.smithi129.stdout:7/465: creat d0/d46/d8e/d90/f97 x:0 0 0 2024-09-21T08:02:31.246 INFO:tasks.workunit.client.1.smithi129.stdout:7/466: write d0/d1e/f81 [620173,86211] 0 2024-09-21T08:02:31.247 INFO:tasks.workunit.client.1.smithi129.stdout:6/358: mknod d7/d1b/d25/d35/d40/d41/c7d 0 2024-09-21T08:02:31.249 INFO:tasks.workunit.client.1.smithi129.stdout:6/359: symlink d7/d1b/d25/d2b/l7e 0 2024-09-21T08:02:31.249 INFO:tasks.workunit.client.1.smithi129.stdout:1/505: rename d1/d16/f29 to d1/d64/fac 0 2024-09-21T08:02:31.249 INFO:tasks.workunit.client.1.smithi129.stdout:1/506: chown d1/d16/d25/c80 12716 1 2024-09-21T08:02:31.249 INFO:tasks.workunit.client.1.smithi129.stdout:1/507: chown d1/d7a/c81 111469 1 2024-09-21T08:02:31.251 INFO:tasks.workunit.client.1.smithi129.stdout:6/360: rename d7/d1b/d1e/d39/d4b/d67 to d7/d7f 0 2024-09-21T08:02:31.252 INFO:tasks.workunit.client.1.smithi129.stdout:6/361: write f5 [2963044,35178] 0 2024-09-21T08:02:31.252 INFO:tasks.workunit.client.1.smithi129.stdout:6/362: chown d7/d1b/d57/l5c 21116132 1 2024-09-21T08:02:31.252 INFO:tasks.workunit.client.1.smithi129.stdout:6/363: fsync d7/d1b/d1e/d39/f4c 0 2024-09-21T08:02:31.252 INFO:tasks.workunit.client.1.smithi129.stdout:1/508: mkdir d1/d4/dad 0 2024-09-21T08:02:31.253 INFO:tasks.workunit.client.1.smithi129.stdout:6/364: rmdir d7/d1b/d57 39 2024-09-21T08:02:31.253 INFO:tasks.workunit.client.1.smithi129.stdout:6/365: fsync d7/f9 0 2024-09-21T08:02:31.253 INFO:tasks.workunit.client.1.smithi129.stdout:3/440: dread d3/da/dc/d11/d55/d68/f87 [0,4194304] 0 2024-09-21T08:02:31.253 INFO:tasks.workunit.client.1.smithi129.stdout:5/468: dread d2/d1e/d35/f40 [0,4194304] 0 2024-09-21T08:02:31.253 INFO:tasks.workunit.client.1.smithi129.stdout:1/509: symlink d1/d44/d83/lae 0 2024-09-21T08:02:31.254 INFO:tasks.workunit.client.1.smithi129.stdout:6/366: dread d7/d1b/d25/d35/d40/d41/f61 [0,4194304] 0 2024-09-21T08:02:31.254 INFO:tasks.workunit.client.1.smithi129.stdout:3/441: rename d3/d57/d70/l8d to d3/d69/d95/d52/l96 0 2024-09-21T08:02:31.255 INFO:tasks.workunit.client.1.smithi129.stdout:1/510: truncate d1/f12 390657 0 2024-09-21T08:02:31.256 INFO:tasks.workunit.client.1.smithi129.stdout:8/335: dwrite d0/d6/f1f [0,4194304] 0 2024-09-21T08:02:31.257 INFO:tasks.workunit.client.1.smithi129.stdout:6/367: creat d7/d1b/d57/f80 x:0 0 0 2024-09-21T08:02:31.257 INFO:tasks.workunit.client.1.smithi129.stdout:3/442: truncate d3/da/dc/f73 3461411 0 2024-09-21T08:02:31.257 INFO:tasks.workunit.client.1.smithi129.stdout:3/443: dread - d3/da/f78 zero size 2024-09-21T08:02:31.258 INFO:tasks.workunit.client.1.smithi129.stdout:1/511: creat d1/d9/d6b/faf x:0 0 0 2024-09-21T08:02:31.259 INFO:tasks.workunit.client.1.smithi129.stdout:1/512: readlink d1/d16/l1b 0 2024-09-21T08:02:31.259 INFO:tasks.workunit.client.1.smithi129.stdout:2/639: dwrite d1/d13/d3a/d47/f27 [0,4194304] 0 2024-09-21T08:02:31.259 INFO:tasks.workunit.client.1.smithi129.stdout:6/368: mknod d7/d1b/d25/d2b/d3e/d5e/c81 0 2024-09-21T08:02:31.260 INFO:tasks.workunit.client.1.smithi129.stdout:3/444: mknod d3/d69/d95/c97 0 2024-09-21T08:02:31.260 INFO:tasks.workunit.client.1.smithi129.stdout:8/336: dread d0/d6/d7/d24/f46 [0,4194304] 0 2024-09-21T08:02:31.261 INFO:tasks.workunit.client.1.smithi129.stdout:1/513: symlink d1/d9/d31/lb0 0 2024-09-21T08:02:31.262 INFO:tasks.workunit.client.1.smithi129.stdout:3/445: dread d3/da/dc/d11/d2f/f4f [4194304,4194304] 0 2024-09-21T08:02:31.264 INFO:tasks.workunit.client.1.smithi129.stdout:2/640: rename d1/d53/d68/fd0 to d1/dc/d19/d88/fe7 0 2024-09-21T08:02:31.264 INFO:tasks.workunit.client.1.smithi129.stdout:7/467: rmdir d0/d46/d8e/d8f 39 2024-09-21T08:02:31.265 INFO:tasks.workunit.client.1.smithi129.stdout:7/468: dread - d0/f75 zero size 2024-09-21T08:02:31.267 INFO:tasks.workunit.client.1.smithi129.stdout:6/369: creat d7/f82 x:0 0 0 2024-09-21T08:02:31.268 INFO:tasks.workunit.client.1.smithi129.stdout:8/337: symlink d0/d6/d7/d18/d27/l6a 0 2024-09-21T08:02:31.269 INFO:tasks.workunit.client.1.smithi129.stdout:3/446: mkdir d3/d69/d98 0 2024-09-21T08:02:31.269 INFO:tasks.workunit.client.1.smithi129.stdout:3/447: write d3/da/f2e [3965604,22509] 0 2024-09-21T08:02:31.269 INFO:tasks.workunit.client.1.smithi129.stdout:3/448: fsync d3/da/f4c 0 2024-09-21T08:02:31.270 INFO:tasks.workunit.client.1.smithi129.stdout:3/449: chown d3/d69/d95/c97 1439764611 1 2024-09-21T08:02:31.271 INFO:tasks.workunit.client.1.smithi129.stdout:2/641: creat d1/d13/d3a/d47/dac/fe8 x:0 0 0 2024-09-21T08:02:31.273 INFO:tasks.workunit.client.1.smithi129.stdout:7/469: creat d0/d46/d8e/d8f/f98 x:0 0 0 2024-09-21T08:02:31.273 INFO:tasks.workunit.client.1.smithi129.stdout:7/470: fsync d0/f5e 0 2024-09-21T08:02:31.275 INFO:tasks.workunit.client.1.smithi129.stdout:1/514: rename d1/d16/d28/c72 to d1/d64/cb1 0 2024-09-21T08:02:31.275 INFO:tasks.workunit.client.1.smithi129.stdout:1/515: write d1/d7a/f7c [431974,3811] 0 2024-09-21T08:02:31.277 INFO:tasks.workunit.client.1.smithi129.stdout:1/516: creat d1/d44/d83/fb2 x:0 0 0 2024-09-21T08:02:31.280 INFO:tasks.workunit.client.1.smithi129.stdout:8/338: rename d0/d6/d7/d18/d27/d32/c44 to d0/d6/d7/d3a/c6b 0 2024-09-21T08:02:31.283 INFO:tasks.workunit.client.1.smithi129.stdout:3/450: rename d3/da/dc/d25/l45 to d3/d69/l99 0 2024-09-21T08:02:31.283 INFO:tasks.workunit.client.1.smithi129.stdout:3/451: write d3/da/f78 [57464,37604] 0 2024-09-21T08:02:31.285 INFO:tasks.workunit.client.1.smithi129.stdout:6/370: dwrite d7/d1b/d1e/d39/d4b/f4d [0,4194304] 0 2024-09-21T08:02:31.289 INFO:tasks.workunit.client.1.smithi129.stdout:5/469: dwrite d2/f29 [0,4194304] 0 2024-09-21T08:02:31.291 INFO:tasks.workunit.client.1.smithi129.stdout:8/339: dread d0/d6/d7/d24/f35 [0,4194304] 0 2024-09-21T08:02:31.293 INFO:tasks.workunit.client.1.smithi129.stdout:6/371: rename d7/d1b/d25/d35/d40/d41/l5b to d7/d1b/d25/d35/d40/d78/l83 0 2024-09-21T08:02:31.298 INFO:tasks.workunit.client.1.smithi129.stdout:5/470: symlink d2/d1e/l8b 0 2024-09-21T08:02:31.298 INFO:tasks.workunit.client.1.smithi129.stdout:8/340: mkdir d0/d6/d7/d6c 0 2024-09-21T08:02:31.299 INFO:tasks.workunit.client.1.smithi129.stdout:3/452: write d3/da/dc/d11/d2f/f40 [1856391,63191] 0 2024-09-21T08:02:31.299 INFO:tasks.workunit.client.1.smithi129.stdout:3/453: chown d3/l2d 164816 1 2024-09-21T08:02:31.299 INFO:tasks.workunit.client.1.smithi129.stdout:3/454: chown d3/f6a 13586 1 2024-09-21T08:02:31.309 INFO:tasks.workunit.client.1.smithi129.stdout:1/517: dwrite d1/d9/fe [0,4194304] 0 2024-09-21T08:02:31.309 INFO:tasks.workunit.client.1.smithi129.stdout:1/518: chown d1/c19 700029479 1 2024-09-21T08:02:31.309 INFO:tasks.workunit.client.1.smithi129.stdout:2/642: dwrite d1/dc/d19/f6d [0,4194304] 0 2024-09-21T08:02:31.312 INFO:tasks.workunit.client.1.smithi129.stdout:7/471: dwrite d0/d1e/f81 [0,4194304] 0 2024-09-21T08:02:31.314 INFO:tasks.workunit.client.1.smithi129.stdout:2/643: symlink d1/d13/d3a/d47/d1f/le9 0 2024-09-21T08:02:31.318 INFO:tasks.workunit.client.1.smithi129.stdout:7/472: rename d0/d1e/l69 to d0/d71/l99 0 2024-09-21T08:02:31.322 INFO:tasks.workunit.client.1.smithi129.stdout:2/644: creat d1/d13/d3a/d47/fea x:0 0 0 2024-09-21T08:02:31.323 INFO:tasks.workunit.client.1.smithi129.stdout:2/645: symlink d1/d13/leb 0 2024-09-21T08:02:31.324 INFO:tasks.workunit.client.1.smithi129.stdout:2/646: symlink d1/dc/d26/d45/d65/d50/lec 0 2024-09-21T08:02:31.324 INFO:tasks.workunit.client.1.smithi129.stdout:5/471: dwrite d2/f79 [0,4194304] 0 2024-09-21T08:02:31.324 INFO:tasks.workunit.client.1.smithi129.stdout:2/647: mknod d1/d13/d3a/dc1/ced 0 2024-09-21T08:02:31.327 INFO:tasks.workunit.client.1.smithi129.stdout:5/472: creat d2/d1e/d6b/f8c x:0 0 0 2024-09-21T08:02:31.327 INFO:tasks.workunit.client.1.smithi129.stdout:5/473: chown d2/d1e/d35/f22 1 1 2024-09-21T08:02:31.329 INFO:tasks.workunit.client.1.smithi129.stdout:5/474: symlink d2/d1e/d35/d33/d36/d5a/d77/d81/l8d 0 2024-09-21T08:02:31.329 INFO:tasks.workunit.client.1.smithi129.stdout:3/455: dwrite d3/d69/d95/f86 [0,4194304] 0 2024-09-21T08:02:31.330 INFO:tasks.workunit.client.1.smithi129.stdout:2/648: getdents d1/dc/d26/d45/d65 0 2024-09-21T08:02:31.331 INFO:tasks.workunit.client.1.smithi129.stdout:2/649: stat d1/f5 0 2024-09-21T08:02:31.331 INFO:tasks.workunit.client.1.smithi129.stdout:2/650: stat d1/dc/d19/d4c/d6a/l56 0 2024-09-21T08:02:31.337 INFO:tasks.workunit.client.1.smithi129.stdout:1/519: dwrite d1/d9/f3d [0,4194304] 0 2024-09-21T08:02:31.339 INFO:tasks.workunit.client.1.smithi129.stdout:7/473: dwrite d0/f5e [0,4194304] 0 2024-09-21T08:02:31.339 INFO:tasks.workunit.client.1.smithi129.stdout:7/474: truncate d0/d46/d6e/f5f 677017 0 2024-09-21T08:02:31.340 INFO:tasks.workunit.client.1.smithi129.stdout:1/520: dread d1/d7a/f7c [0,4194304] 0 2024-09-21T08:02:31.342 INFO:tasks.workunit.client.1.smithi129.stdout:7/475: mkdir d0/d1e/d9a 0 2024-09-21T08:02:31.343 INFO:tasks.workunit.client.1.smithi129.stdout:1/521: mkdir d1/d16/db3 0 2024-09-21T08:02:31.344 INFO:tasks.workunit.client.1.smithi129.stdout:7/476: mkdir d0/d46/d6e/d9b 0 2024-09-21T08:02:31.345 INFO:tasks.workunit.client.1.smithi129.stdout:7/477: truncate d0/d1e/f8a 3044049 0 2024-09-21T08:02:31.347 INFO:tasks.workunit.client.1.smithi129.stdout:7/478: link d0/l4f d0/d71/l9c 0 2024-09-21T08:02:31.348 INFO:tasks.workunit.client.1.smithi129.stdout:7/479: symlink d0/d46/d6e/d9b/l9d 0 2024-09-21T08:02:31.350 INFO:tasks.workunit.client.1.smithi129.stdout:7/480: symlink d0/d46/l9e 0 2024-09-21T08:02:31.350 INFO:tasks.workunit.client.1.smithi129.stdout:7/481: readlink d0/d1e/l31 0 2024-09-21T08:02:31.351 INFO:tasks.workunit.client.1.smithi129.stdout:7/482: mkdir d0/d1e/d9a/d9f 0 2024-09-21T08:02:31.352 INFO:tasks.workunit.client.1.smithi129.stdout:7/483: creat d0/d46/fa0 x:0 0 0 2024-09-21T08:02:31.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.365+0000 7fb38e1fc640 1 -- 172.21.15.107:0/3893240496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3880fc520 msgr2=0x7fb3880fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:31.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.365+0000 7fb38e1fc640 1 --2- 172.21.15.107:0/3893240496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3880fc520 0x7fb3880fc930 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb3780048d0 tx=0x7fb378009da0 comp rx=0 tx=0).stop 2024-09-21T08:02:31.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.365+0000 7fb38e1fc640 1 -- 172.21.15.107:0/3893240496 shutdown_connections 2024-09-21T08:02:31.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.365+0000 7fb38e1fc640 1 --2- 172.21.15.107:0/3893240496 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb3880fd7f0 0x7fb3880fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:31.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.365+0000 7fb38e1fc640 1 --2- 172.21.15.107:0/3893240496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3880fc520 0x7fb3880fc930 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:31.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.365+0000 7fb38e1fc640 1 -- 172.21.15.107:0/3893240496 >> 172.21.15.107:0/3893240496 conn(0x7fb3880f7ce0 msgr2=0x7fb3880fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:31.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.365+0000 7fb38e1fc640 1 -- 172.21.15.107:0/3893240496 shutdown_connections 2024-09-21T08:02:31.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.365+0000 7fb38e1fc640 1 -- 172.21.15.107:0/3893240496 wait complete. 2024-09-21T08:02:31.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.365+0000 7fb38e1fc640 1 Processor -- start 2024-09-21T08:02:31.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.366+0000 7fb38e1fc640 1 -- start start 2024-09-21T08:02:31.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.366+0000 7fb38e1fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3880fc520 0x7fb388071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:31.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.366+0000 7fb38e1fc640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb3880fd7f0 0x7fb38806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:31.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.366+0000 7fb38e1fc640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38806fff0 con 0x7fb3880fc520 2024-09-21T08:02:31.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.366+0000 7fb38e1fc640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb388070130 con 0x7fb3880fd7f0 2024-09-21T08:02:31.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.366+0000 7fb3877fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3880fc520 0x7fb388071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:31.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.366+0000 7fb3877fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3880fc520 0x7fb388071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53730/0 (socket says 172.21.15.107:53730) 2024-09-21T08:02:31.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.366+0000 7fb3877fe640 1 -- 172.21.15.107:0/2353674312 learned_addr learned my addr 172.21.15.107:0/2353674312 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:02:31.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.366+0000 7fb386ffd640 1 --2- 172.21.15.107:0/2353674312 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb3880fd7f0 0x7fb38806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:31.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.366+0000 7fb3877fe640 1 -- 172.21.15.107:0/2353674312 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb3880fd7f0 msgr2=0x7fb38806fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:31.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.366+0000 7fb3877fe640 1 --2- 172.21.15.107:0/2353674312 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb3880fd7f0 0x7fb38806fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:31.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.366+0000 7fb3877fe640 1 -- 172.21.15.107:0/2353674312 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb378005040 con 0x7fb3880fc520 2024-09-21T08:02:31.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.367+0000 7fb3877fe640 1 --2- 172.21.15.107:0/2353674312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3880fc520 0x7fb388071570 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb3780043d0 tx=0x7fb378009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:31.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.367+0000 7fb36ffff640 1 -- 172.21.15.107:0/2353674312 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb378038070 con 0x7fb3880fc520 2024-09-21T08:02:31.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.367+0000 7fb38e1fc640 1 -- 172.21.15.107:0/2353674312 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3880703b0 con 0x7fb3880fc520 2024-09-21T08:02:31.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.367+0000 7fb36ffff640 1 -- 172.21.15.107:0/2353674312 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb378009800 con 0x7fb3880fc520 2024-09-21T08:02:31.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.367+0000 7fb36ffff640 1 -- 172.21.15.107:0/2353674312 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb37803e670 con 0x7fb3880fc520 2024-09-21T08:02:31.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.367+0000 7fb38e1fc640 1 -- 172.21.15.107:0/2353674312 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb388115100 con 0x7fb3880fc520 2024-09-21T08:02:31.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.368+0000 7fb38e1fc640 1 -- 172.21.15.107:0/2353674312 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3880fb980 con 0x7fb3880fc520 2024-09-21T08:02:31.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.368+0000 7fb36ffff640 1 -- 172.21.15.107:0/2353674312 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fb378030020 con 0x7fb3880fc520 2024-09-21T08:02:31.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.369+0000 7fb36ffff640 1 --2- 172.21.15.107:0/2353674312 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fb37006e6e0 0x7fb370070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:31.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.369+0000 7fb36ffff640 1 -- 172.21.15.107:0/2353674312 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb3780ae050 con 0x7fb3880fc520 2024-09-21T08:02:31.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.369+0000 7fb386ffd640 1 --2- 172.21.15.107:0/2353674312 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fb37006e6e0 0x7fb370070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:31.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.370+0000 7fb386ffd640 1 --2- 172.21.15.107:0/2353674312 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fb37006e6e0 0x7fb370070b90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb37c004ed0 tx=0x7fb37c00b040 comp rx=0 tx=0).ready entity=mgr.24311 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:31.373 INFO:tasks.workunit.client.1.smithi129.stdout:5/475: dwrite d2/d2a/d50/d61/f6e [0,4194304] 0 2024-09-21T08:02:31.373 INFO:tasks.workunit.client.1.smithi129.stdout:3/456: dwrite d3/da/f2e [0,4194304] 0 2024-09-21T08:02:31.373 INFO:tasks.workunit.client.1.smithi129.stdout:1/522: dwrite d1/d7a/f7c [0,4194304] 0 2024-09-21T08:02:31.373 INFO:tasks.workunit.client.1.smithi129.stdout:1/523: readlink d1/d4/l3a 0 2024-09-21T08:02:31.373 INFO:tasks.workunit.client.1.smithi129.stdout:2/651: dwrite d1/d13/d3a/d8f/fd2 [0,4194304] 0 2024-09-21T08:02:31.373 INFO:tasks.workunit.client.1.smithi129.stdout:2/652: creat d1/d53/d77/d8b/fee x:0 0 0 2024-09-21T08:02:31.375 INFO:tasks.workunit.client.1.smithi129.stdout:5/476: symlink d2/l8e 0 2024-09-21T08:02:31.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.374+0000 7fb36ffff640 1 -- 172.21.15.107:0/2353674312 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fb378077a90 con 0x7fb3880fc520 2024-09-21T08:02:31.377 INFO:tasks.workunit.client.1.smithi129.stdout:3/457: mknod d3/da/dc/d11/d55/d68/c9a 0 2024-09-21T08:02:31.377 INFO:tasks.workunit.client.1.smithi129.stdout:3/458: stat d3/da/dc/d11/l42 0 2024-09-21T08:02:31.377 INFO:tasks.workunit.client.1.smithi129.stdout:3/459: readlink d3/d69/l88 0 2024-09-21T08:02:31.379 INFO:tasks.workunit.client.1.smithi129.stdout:1/524: creat d1/d44/fb4 x:0 0 0 2024-09-21T08:02:31.379 INFO:tasks.workunit.client.1.smithi129.stdout:1/525: read d1/d16/d28/f33 [1870016,17215] 0 2024-09-21T08:02:31.379 INFO:tasks.workunit.client.1.smithi129.stdout:1/526: fdatasync d1/f12 0 2024-09-21T08:02:31.381 INFO:tasks.workunit.client.1.smithi129.stdout:7/484: getdents d0/d1e/d9a 0 2024-09-21T08:02:31.382 INFO:tasks.workunit.client.1.smithi129.stdout:7/485: chown d0/f43 1127685 1 2024-09-21T08:02:31.384 INFO:tasks.workunit.client.1.smithi129.stdout:2/653: dread d1/dc/d26/f42 [0,4194304] 0 2024-09-21T08:02:31.384 INFO:tasks.workunit.client.1.smithi129.stdout:3/460: symlink d3/d90/l9b 0 2024-09-21T08:02:31.384 INFO:tasks.workunit.client.1.smithi129.stdout:2/654: write d1/d13/d3a/d47/dac/fe8 [980933,15789] 0 2024-09-21T08:02:31.386 INFO:tasks.workunit.client.1.smithi129.stdout:1/527: unlink d1/d16/d25/l65 0 2024-09-21T08:02:31.387 INFO:tasks.workunit.client.1.smithi129.stdout:7/486: truncate d0/f20 8388433 0 2024-09-21T08:02:31.387 INFO:tasks.workunit.client.1.smithi129.stdout:7/487: fsync d0/d1e/f40 0 2024-09-21T08:02:31.387 INFO:tasks.workunit.client.1.smithi129.stdout:1/528: dread - d1/d4/d6e/f74 zero size 2024-09-21T08:02:31.387 INFO:tasks.workunit.client.1.smithi129.stdout:5/477: getdents d2/d1e/d35/d33/d36 0 2024-09-21T08:02:31.389 INFO:tasks.workunit.client.1.smithi129.stdout:5/478: creat d2/d2a/f8f x:0 0 0 2024-09-21T08:02:31.392 INFO:tasks.workunit.client.1.smithi129.stdout:2/655: dread d1/dc/f16 [0,4194304] 0 2024-09-21T08:02:31.392 INFO:tasks.workunit.client.1.smithi129.stdout:5/479: link d2/d1e/d35/l27 d2/d2a/d6f/l90 0 2024-09-21T08:02:31.394 INFO:tasks.workunit.client.1.smithi129.stdout:2/656: link d1/dc/d19/d4c/d6a/d69/lc5 d1/dc/d19/d4c/dd5/lef 0 2024-09-21T08:02:31.394 INFO:tasks.workunit.client.1.smithi129.stdout:2/657: write d1/dc/d19/d88/f89 [104981,124482] 0 2024-09-21T08:02:31.394 INFO:tasks.workunit.client.1.smithi129.stdout:2/658: creat d1/dc/d19/d88/ff0 x:0 0 0 2024-09-21T08:02:31.394 INFO:tasks.workunit.client.1.smithi129.stdout:2/659: dread - d1/fc3 zero size 2024-09-21T08:02:31.394 INFO:tasks.workunit.client.1.smithi129.stdout:2/660: write d1/d53/f58 [1167976,73279] 0 2024-09-21T08:02:31.394 INFO:tasks.workunit.client.1.smithi129.stdout:2/661: readlink d1/d13/leb 0 2024-09-21T08:02:31.394 INFO:tasks.workunit.client.1.smithi129.stdout:7/488: dread d0/f17 [0,4194304] 0 2024-09-21T08:02:31.395 INFO:tasks.workunit.client.1.smithi129.stdout:5/480: dread - d2/d1e/d35/d37/f73 zero size 2024-09-21T08:02:31.395 INFO:tasks.workunit.client.1.smithi129.stdout:0/439: sync 2024-09-21T08:02:31.395 INFO:tasks.workunit.client.1.smithi129.stdout:9/411: sync 2024-09-21T08:02:31.397 INFO:tasks.workunit.client.1.smithi129.stdout:2/662: creat d1/dc/d26/d45/d65/d99/ff1 x:0 0 0 2024-09-21T08:02:31.399 INFO:tasks.workunit.client.1.smithi129.stdout:5/481: creat d2/d2a/d50/d61/f91 x:0 0 0 2024-09-21T08:02:31.401 INFO:tasks.workunit.client.1.smithi129.stdout:0/440: link de/d15/d39/d56/f7d de/d22/d27/d2f/f8e 0 2024-09-21T08:02:31.401 INFO:tasks.workunit.client.1.smithi129.stdout:0/441: read - de/d19/f4e zero size 2024-09-21T08:02:31.401 INFO:tasks.workunit.client.1.smithi129.stdout:0/442: readlink de/d15/l1b 0 2024-09-21T08:02:31.401 INFO:tasks.workunit.client.1.smithi129.stdout:0/443: write de/d15/d51/f5d [543696,120615] 0 2024-09-21T08:02:31.403 INFO:tasks.workunit.client.1.smithi129.stdout:9/412: mkdir d17/d22/d33/d7a/d89 0 2024-09-21T08:02:31.404 INFO:tasks.workunit.client.1.smithi129.stdout:2/663: mknod d1/dc/d26/d45/cf2 0 2024-09-21T08:02:31.406 INFO:tasks.workunit.client.1.smithi129.stdout:0/444: rename de/d1f/c33 to de/d15/c8f 0 2024-09-21T08:02:31.408 INFO:tasks.workunit.client.1.smithi129.stdout:9/413: rmdir d17/d55 39 2024-09-21T08:02:31.410 INFO:tasks.workunit.client.1.smithi129.stdout:9/414: mknod d17/d55/c8a 0 2024-09-21T08:02:31.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.575+0000 7fb38e1fc640 1 -- 172.21.15.107:0/2353674312 --> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb388101c50 con 0x7fb37006e6e0 2024-09-21T08:02:31.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.577+0000 7fb36ffff640 1 -- 172.21.15.107:0/2353674312 <== mgr.24311 v2:172.21.15.129:6828/1054385200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fb388101c50 con 0x7fb37006e6e0 2024-09-21T08:02:31.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.579+0000 7fb38e1fc640 1 -- 172.21.15.107:0/2353674312 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fb37006e6e0 msgr2=0x7fb370070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:31.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.579+0000 7fb38e1fc640 1 --2- 172.21.15.107:0/2353674312 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fb37006e6e0 0x7fb370070b90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb37c004ed0 tx=0x7fb37c00b040 comp rx=0 tx=0).stop 2024-09-21T08:02:31.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.579+0000 7fb38e1fc640 1 -- 172.21.15.107:0/2353674312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3880fc520 msgr2=0x7fb388071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:31.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.579+0000 7fb38e1fc640 1 --2- 172.21.15.107:0/2353674312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3880fc520 0x7fb388071570 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb3780043d0 tx=0x7fb378009da0 comp rx=0 tx=0).stop 2024-09-21T08:02:31.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.579+0000 7fb38e1fc640 1 -- 172.21.15.107:0/2353674312 shutdown_connections 2024-09-21T08:02:31.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.579+0000 7fb38e1fc640 1 --2- 172.21.15.107:0/2353674312 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fb37006e6e0 0x7fb370070b90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:31.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.579+0000 7fb38e1fc640 1 --2- 172.21.15.107:0/2353674312 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb3880fd7f0 0x7fb38806fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:31.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.579+0000 7fb38e1fc640 1 --2- 172.21.15.107:0/2353674312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3880fc520 0x7fb388071570 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:31.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.579+0000 7fb38e1fc640 1 -- 172.21.15.107:0/2353674312 >> 172.21.15.107:0/2353674312 conn(0x7fb3880f7ce0 msgr2=0x7fb3880f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:31.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.579+0000 7fb38e1fc640 1 -- 172.21.15.107:0/2353674312 shutdown_connections 2024-09-21T08:02:31.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.579+0000 7fb38e1fc640 1 -- 172.21.15.107:0/2353674312 wait complete. 2024-09-21T08:02:31.589 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:02:31.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.659+0000 7f94e1c2a640 1 -- 172.21.15.107:0/3898721860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94dc0fc6f0 msgr2=0x7f94dc0fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:31.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.659+0000 7f94e1c2a640 1 --2- 172.21.15.107:0/3898721860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94dc0fc6f0 0x7f94dc0fcb60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f94d00048d0 tx=0x7f94d0009da0 comp rx=0 tx=0).stop 2024-09-21T08:02:31.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.659+0000 7f94e1c2a640 1 -- 172.21.15.107:0/3898721860 shutdown_connections 2024-09-21T08:02:31.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.659+0000 7f94e1c2a640 1 --2- 172.21.15.107:0/3898721860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94dc0fc6f0 0x7f94dc0fcb60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:31.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.659+0000 7f94e1c2a640 1 --2- 172.21.15.107:0/3898721860 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94dc0fb420 0x7f94dc0fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:31.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.659+0000 7f94e1c2a640 1 -- 172.21.15.107:0/3898721860 >> 172.21.15.107:0/3898721860 conn(0x7f94dc0f6c00 msgr2=0x7f94dc0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:31.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.659+0000 7f94e1c2a640 1 -- 172.21.15.107:0/3898721860 shutdown_connections 2024-09-21T08:02:31.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.659+0000 7f94e1c2a640 1 -- 172.21.15.107:0/3898721860 wait complete. 2024-09-21T08:02:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.660+0000 7f94e1c2a640 1 Processor -- start 2024-09-21T08:02:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.660+0000 7f94e1c2a640 1 -- start start 2024-09-21T08:02:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.660+0000 7f94e1c2a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94dc0fb420 0x7f94dc10fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.660+0000 7f94e1c2a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94dc0fc6f0 0x7f94dc1122e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.660+0000 7f94e1c2a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc066510 con 0x7f94dc0fb420 2024-09-21T08:02:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.660+0000 7f94e1c2a640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc066680 con 0x7f94dc0fc6f0 2024-09-21T08:02:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.660+0000 7f94db7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94dc0fb420 0x7f94dc10fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.660+0000 7f94db7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94dc0fb420 0x7f94dc10fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53760/0 (socket says 172.21.15.107:53760) 2024-09-21T08:02:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.660+0000 7f94db7fe640 1 -- 172.21.15.107:0/4095902564 learned_addr learned my addr 172.21.15.107:0/4095902564 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:02:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.660+0000 7f94daffd640 1 --2- 172.21.15.107:0/4095902564 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94dc0fc6f0 0x7f94dc1122e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.661+0000 7f94db7fe640 1 -- 172.21.15.107:0/4095902564 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94dc0fc6f0 msgr2=0x7f94dc1122e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.661+0000 7f94db7fe640 1 --2- 172.21.15.107:0/4095902564 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94dc0fc6f0 0x7f94dc1122e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:31.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.661+0000 7f94db7fe640 1 -- 172.21.15.107:0/4095902564 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d0005040 con 0x7f94dc0fb420 2024-09-21T08:02:31.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.661+0000 7f94daffd640 1 --2- 172.21.15.107:0/4095902564 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94dc0fc6f0 0x7f94dc1122e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:02:31.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.661+0000 7f94db7fe640 1 --2- 172.21.15.107:0/4095902564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94dc0fb420 0x7f94dc10fd90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f94cc00c790 tx=0x7f94cc0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:31.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.661+0000 7f94c3fff640 1 -- 172.21.15.107:0/4095902564 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94cc00a820 con 0x7f94dc0fb420 2024-09-21T08:02:31.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.661+0000 7f94e1c2a640 1 -- 172.21.15.107:0/4095902564 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94dc112880 con 0x7f94dc0fb420 2024-09-21T08:02:31.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.661+0000 7f94c3fff640 1 -- 172.21.15.107:0/4095902564 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f94cc00ae20 con 0x7f94dc0fb420 2024-09-21T08:02:31.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.661+0000 7f94c3fff640 1 -- 172.21.15.107:0/4095902564 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94cc0113a0 con 0x7f94dc0fb420 2024-09-21T08:02:31.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.661+0000 7f94e1c2a640 1 -- 172.21.15.107:0/4095902564 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94dc112e20 con 0x7f94dc0fb420 2024-09-21T08:02:31.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.662+0000 7f94e1c2a640 1 -- 172.21.15.107:0/4095902564 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94dc0fa880 con 0x7f94dc0fb420 2024-09-21T08:02:31.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.663+0000 7f94c3fff640 1 -- 172.21.15.107:0/4095902564 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f94cc012400 con 0x7f94dc0fb420 2024-09-21T08:02:31.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.663+0000 7f94c3fff640 1 --2- 172.21.15.107:0/4095902564 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f94c406e6e0 0x7f94c4070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:31.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.663+0000 7f94c3fff640 1 -- 172.21.15.107:0/4095902564 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f94cc08dfb0 con 0x7f94dc0fb420 2024-09-21T08:02:31.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.663+0000 7f94daffd640 1 --2- 172.21.15.107:0/4095902564 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f94c406e6e0 0x7f94c4070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:31.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.664+0000 7f94daffd640 1 --2- 172.21.15.107:0/4095902564 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f94c406e6e0 0x7f94c4070b90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f94d0004540 tx=0x7f94d0035040 comp rx=0 tx=0).ready entity=mgr.24311 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:31.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.668+0000 7f94c3fff640 1 -- 172.21.15.107:0/4095902564 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f94cc0579c0 con 0x7f94dc0fb420 2024-09-21T08:02:31.681 INFO:tasks.workunit.client.1.smithi129.stdout:3/461: dwrite d3/da/dc/d25/f41 [0,4194304] 0 2024-09-21T08:02:31.682 INFO:tasks.workunit.client.1.smithi129.stdout:1/529: dwrite d1/d44/fb4 [0,4194304] 0 2024-09-21T08:02:31.683 INFO:tasks.workunit.client.1.smithi129.stdout:3/462: creat d3/d69/d95/d52/f9c x:0 0 0 2024-09-21T08:02:31.685 INFO:tasks.workunit.client.1.smithi129.stdout:0/445: dwrite de/d22/d27/d2f/f5a [0,4194304] 0 2024-09-21T08:02:31.686 INFO:tasks.workunit.client.1.smithi129.stdout:0/446: getdents de/d22/d27/d85 0 2024-09-21T08:02:31.687 INFO:tasks.workunit.client.1.smithi129.stdout:1/530: mknod d1/d9/cb5 0 2024-09-21T08:02:31.688 INFO:tasks.workunit.client.1.smithi129.stdout:3/463: rename d3/da/dc/d25/l5b to d3/d90/l9d 0 2024-09-21T08:02:31.688 INFO:tasks.workunit.client.1.smithi129.stdout:3/464: chown d3/da/d5d/f77 15821 1 2024-09-21T08:02:31.689 INFO:tasks.workunit.client.1.smithi129.stdout:0/447: mkdir de/d15/d51/d90 0 2024-09-21T08:02:31.690 INFO:tasks.workunit.client.1.smithi129.stdout:1/531: mkdir d1/d4/dad/db6 0 2024-09-21T08:02:31.690 INFO:tasks.workunit.client.1.smithi129.stdout:3/465: rmdir d3/d90 39 2024-09-21T08:02:31.692 INFO:tasks.workunit.client.1.smithi129.stdout:0/448: symlink de/d15/d44/d45/l91 0 2024-09-21T08:02:31.692 INFO:tasks.workunit.client.1.smithi129.stdout:0/449: write de/d15/f43 [2895401,105406] 0 2024-09-21T08:02:31.694 INFO:tasks.workunit.client.1.smithi129.stdout:0/450: symlink de/d15/d51/l92 0 2024-09-21T08:02:31.694 INFO:tasks.workunit.client.1.smithi129.stdout:0/451: dread - de/d15/d39/d56/f6f zero size 2024-09-21T08:02:31.695 INFO:tasks.workunit.client.1.smithi129.stdout:0/452: link de/d19/f66 de/d22/d27/d30/f93 0 2024-09-21T08:02:31.698 INFO:tasks.workunit.client.1.smithi129.stdout:7/489: dwrite d0/f16 [0,4194304] 0 2024-09-21T08:02:31.698 INFO:tasks.workunit.client.1.smithi129.stdout:0/453: mkdir de/d81/d94 0 2024-09-21T08:02:31.701 INFO:tasks.workunit.client.1.smithi129.stdout:5/482: dwrite d2/d1e/d35/f31 [0,4194304] 0 2024-09-21T08:02:31.702 INFO:tasks.workunit.client.1.smithi129.stdout:2/664: dwrite d1/d13/d3a/dc1/fe1 [0,4194304] 0 2024-09-21T08:02:31.702 INFO:tasks.workunit.client.1.smithi129.stdout:4/361: sync 2024-09-21T08:02:31.702 INFO:tasks.workunit.client.1.smithi129.stdout:6/372: sync 2024-09-21T08:02:31.709 INFO:tasks.workunit.client.1.smithi129.stdout:2/665: mknod d1/d13/d3a/d47/d1f/cf3 0 2024-09-21T08:02:31.711 INFO:tasks.workunit.client.1.smithi129.stdout:3/466: read d3/d69/d95/d52/f82 [684716,121401] 0 2024-09-21T08:02:31.711 INFO:tasks.workunit.client.1.smithi129.stdout:3/467: fdatasync d3/da/dc/f79 0 2024-09-21T08:02:31.711 INFO:tasks.workunit.client.1.smithi129.stdout:1/532: dwrite d1/d9/f1a [0,4194304] 0 2024-09-21T08:02:31.714 INFO:tasks.workunit.client.1.smithi129.stdout:4/362: rename d5/d33/c36 to d5/d16/d24/d3b/c82 0 2024-09-21T08:02:31.714 INFO:tasks.workunit.client.1.smithi129.stdout:4/363: stat d5/d33/d66 0 2024-09-21T08:02:31.714 INFO:tasks.workunit.client.1.smithi129.stdout:1/533: read d1/d7a/f95 [1127230,1166] 0 2024-09-21T08:02:31.714 INFO:tasks.workunit.client.1.smithi129.stdout:1/534: write d1/d4/d6e/f74 [331812,75156] 0 2024-09-21T08:02:31.714 INFO:tasks.workunit.client.1.smithi129.stdout:1/535: readlink d1/d64/d7f/l87 0 2024-09-21T08:02:31.714 INFO:tasks.workunit.client.1.smithi129.stdout:1/536: read d1/f39 [111888,32064] 0 2024-09-21T08:02:31.714 INFO:tasks.workunit.client.1.smithi129.stdout:1/537: read - d1/d4/f9e zero size 2024-09-21T08:02:31.715 INFO:tasks.workunit.client.1.smithi129.stdout:6/373: link d7/d1b/d25/d35/d40/d41/c64 d7/d4a/d69/c84 0 2024-09-21T08:02:31.717 INFO:tasks.workunit.client.1.smithi129.stdout:8/341: sync 2024-09-21T08:02:31.718 INFO:tasks.workunit.client.1.smithi129.stdout:8/342: chown d0 1 1 2024-09-21T08:02:31.719 INFO:tasks.workunit.client.1.smithi129.stdout:4/364: mknod d5/d16/d47/d5f/c83 0 2024-09-21T08:02:31.720 INFO:tasks.workunit.client.1.smithi129.stdout:1/538: getdents d1/d16/d8f 0 2024-09-21T08:02:31.720 INFO:tasks.workunit.client.1.smithi129.stdout:1/539: chown d1/d9/la3 25906985 1 2024-09-21T08:02:31.721 INFO:tasks.workunit.client.1.smithi129.stdout:6/374: creat d7/d1b/d1e/d39/d79/f85 x:0 0 0 2024-09-21T08:02:31.721 INFO:tasks.workunit.client.1.smithi129.stdout:1/540: dread d1/d16/d28/f5c [0,4194304] 0 2024-09-21T08:02:31.721 INFO:tasks.workunit.client.1.smithi129.stdout:6/375: write d7/f24 [1975618,49152] 0 2024-09-21T08:02:31.722 INFO:tasks.workunit.client.1.smithi129.stdout:3/468: dread d3/d69/d95/f86 [0,4194304] 0 2024-09-21T08:02:31.722 INFO:tasks.workunit.client.1.smithi129.stdout:2/666: link d1/dc/ff d1/d13/d3a/ff4 0 2024-09-21T08:02:31.724 INFO:tasks.workunit.client.1.smithi129.stdout:8/343: link d0/d6/d7/d24/f56 d0/d6/d7/d3a/f6d 0 2024-09-21T08:02:31.725 INFO:tasks.workunit.client.1.smithi129.stdout:4/365: symlink d5/d48/l84 0 2024-09-21T08:02:31.726 INFO:tasks.workunit.client.1.smithi129.stdout:4/366: dread - d5/d33/d4e/f76 zero size 2024-09-21T08:02:31.727 INFO:tasks.workunit.client.1.smithi129.stdout:1/541: creat d1/d9/d31/fb7 x:0 0 0 2024-09-21T08:02:31.729 INFO:tasks.workunit.client.1.smithi129.stdout:6/376: symlink d7/d1b/d25/d35/d40/d41/l86 0 2024-09-21T08:02:31.731 INFO:tasks.workunit.client.1.smithi129.stdout:2/667: mknod d1/d53/d77/d8b/cf5 0 2024-09-21T08:02:31.731 INFO:tasks.workunit.client.1.smithi129.stdout:2/668: dread - d1/dc/d26/d45/d65/d93/fab zero size 2024-09-21T08:02:31.732 INFO:tasks.workunit.client.1.smithi129.stdout:8/344: dread d0/d6/d7/d9/f12 [0,4194304] 0 2024-09-21T08:02:31.733 INFO:tasks.workunit.client.1.smithi129.stdout:8/345: truncate d0/d6/d7/d3a/f6d 1175057 0 2024-09-21T08:02:31.733 INFO:tasks.workunit.client.1.smithi129.stdout:4/367: mkdir d5/d16/d85 0 2024-09-21T08:02:31.733 INFO:tasks.workunit.client.1.smithi129.stdout:3/469: getdents d3/da/dc/d11/d55 0 2024-09-21T08:02:31.733 INFO:tasks.workunit.client.1.smithi129.stdout:3/470: write d3/da/f78 [319176,18427] 0 2024-09-21T08:02:31.734 INFO:tasks.workunit.client.1.smithi129.stdout:3/471: chown d3/d69/d95/f91 17717466 1 2024-09-21T08:02:31.734 INFO:tasks.workunit.client.1.smithi129.stdout:3/472: stat d3/d69/l88 0 2024-09-21T08:02:31.734 INFO:tasks.workunit.client.1.smithi129.stdout:2/669: chown d1/dc/l5c 8419307 1 2024-09-21T08:02:31.735 INFO:tasks.workunit.client.1.smithi129.stdout:2/670: write d1/d13/d3a/f6f [882631,24597] 0 2024-09-21T08:02:31.736 INFO:tasks.workunit.client.1.smithi129.stdout:5/483: dwrite d2/d1e/d35/f4a [0,4194304] 0 2024-09-21T08:02:31.736 INFO:tasks.workunit.client.1.smithi129.stdout:5/484: write d2/d1e/d35/f2d [3208607,76428] 0 2024-09-21T08:02:31.736 INFO:tasks.workunit.client.1.smithi129.stdout:8/346: getdents d0/d6/d7/d18/d27/d32/d37 0 2024-09-21T08:02:31.736 INFO:tasks.workunit.client.1.smithi129.stdout:8/347: readlink d0/d6/d7/d3a/l65 0 2024-09-21T08:02:31.737 INFO:tasks.workunit.client.1.smithi129.stdout:4/368: creat d5/d16/d47/f86 x:0 0 0 2024-09-21T08:02:31.737 INFO:tasks.workunit.client.1.smithi129.stdout:4/369: write d5/d11/d3f/d50/f51 [4921910,64108] 0 2024-09-21T08:02:31.737 INFO:tasks.workunit.client.1.smithi129.stdout:4/370: write d5/d6/f30 [5223002,58162] 0 2024-09-21T08:02:31.738 INFO:tasks.workunit.client.1.smithi129.stdout:8/348: dread d0/d6/d7/d24/f36 [0,4194304] 0 2024-09-21T08:02:31.739 INFO:tasks.workunit.client.1.smithi129.stdout:7/490: dwrite d0/f75 [0,4194304] 0 2024-09-21T08:02:31.740 INFO:tasks.workunit.client.1.smithi129.stdout:2/671: symlink d1/dc/d26/d45/d65/d50/lf6 0 2024-09-21T08:02:31.743 INFO:tasks.workunit.client.1.smithi129.stdout:5/485: mknod d2/c92 0 2024-09-21T08:02:31.745 INFO:tasks.workunit.client.1.smithi129.stdout:8/349: truncate d0/d6/f4c 43584 0 2024-09-21T08:02:31.746 INFO:tasks.workunit.client.1.smithi129.stdout:8/350: write d0/d6/d7/d18/d27/f39 [882633,117010] 0 2024-09-21T08:02:31.751 INFO:tasks.workunit.client.1.smithi129.stdout:7/491: symlink d0/la1 0 2024-09-21T08:02:31.751 INFO:tasks.workunit.client.1.smithi129.stdout:4/371: read d5/d16/d24/d3b/f65 [454379,28188] 0 2024-09-21T08:02:31.753 INFO:tasks.workunit.client.1.smithi129.stdout:3/473: rmdir d3/d57/d70 0 2024-09-21T08:02:31.753 INFO:tasks.workunit.client.1.smithi129.stdout:5/486: getdents d2/d1e/d6b 0 2024-09-21T08:02:31.754 INFO:tasks.workunit.client.1.smithi129.stdout:4/372: dread d5/f14 [4194304,4194304] 0 2024-09-21T08:02:31.754 INFO:tasks.workunit.client.1.smithi129.stdout:4/373: creat d5/d6/f87 x:0 0 0 2024-09-21T08:02:31.754 INFO:tasks.workunit.client.1.smithi129.stdout:4/374: readlink d5/d16/d24/l2c 0 2024-09-21T08:02:31.757 INFO:tasks.workunit.client.1.smithi129.stdout:4/375: unlink d5/d33/d4e/l81 0 2024-09-21T08:02:31.760 INFO:tasks.workunit.client.1.smithi129.stdout:3/474: dread d3/d69/d95/f4e [0,4194304] 0 2024-09-21T08:02:31.760 INFO:tasks.workunit.client.1.smithi129.stdout:3/475: fsync d3/da/dc/d25/f26 0 2024-09-21T08:02:31.771 INFO:tasks.workunit.client.1.smithi129.stdout:2/672: dwrite d1/d13/d3a/ff4 [0,4194304] 0 2024-09-21T08:02:31.782 INFO:tasks.workunit.client.1.smithi129.stdout:1/542: dwrite d1/d16/d57/f86 [0,4194304] 0 2024-09-21T08:02:31.783 INFO:tasks.workunit.client.1.smithi129.stdout:6/377: dwrite d7/d1b/d1e/f36 [4194304,4194304] 0 2024-09-21T08:02:31.783 INFO:tasks.workunit.client.1.smithi129.stdout:6/378: dread - d7/d1b/d25/d35/d40/d41/f70 zero size 2024-09-21T08:02:31.783 INFO:tasks.workunit.client.1.smithi129.stdout:1/543: write d1/d64/fa6 [231914,106383] 0 2024-09-21T08:02:31.783 INFO:tasks.workunit.client.1.smithi129.stdout:6/379: stat d7/d7f/l6a 0 2024-09-21T08:02:31.785 INFO:tasks.workunit.client.1.smithi129.stdout:1/544: creat d1/d64/fb8 x:0 0 0 2024-09-21T08:02:31.785 INFO:tasks.workunit.client.1.smithi129.stdout:1/545: dread - d1/d16/d9b/fa2 zero size 2024-09-21T08:02:31.786 INFO:tasks.workunit.client.1.smithi129.stdout:1/546: mkdir d1/d44/db9 0 2024-09-21T08:02:31.787 INFO:tasks.workunit.client.1.smithi129.stdout:1/547: symlink d1/d4/d96/lba 0 2024-09-21T08:02:31.787 INFO:tasks.workunit.client.1.smithi129.stdout:1/548: dread - d1/d4/f9e zero size 2024-09-21T08:02:31.787 INFO:tasks.workunit.client.1.smithi129.stdout:1/549: link d1/c24 d1/d7a/da4/cbb 0 2024-09-21T08:02:31.792 INFO:tasks.workunit.client.1.smithi129.stdout:7/492: dwrite d0/f8 [0,4194304] 0 2024-09-21T08:02:31.792 INFO:tasks.workunit.client.1.smithi129.stdout:7/493: stat d0/l6b 0 2024-09-21T08:02:31.793 INFO:tasks.workunit.client.1.smithi129.stdout:6/380: dread d7/f8 [0,4194304] 0 2024-09-21T08:02:31.793 INFO:tasks.workunit.client.1.smithi129.stdout:3/476: dwrite d3/f29 [0,4194304] 0 2024-09-21T08:02:31.793 INFO:tasks.workunit.client.1.smithi129.stdout:3/477: dread - d3/da/d5d/f77 zero size 2024-09-21T08:02:31.793 INFO:tasks.workunit.client.1.smithi129.stdout:2/673: dwrite d1/dc/d26/f62 [0,4194304] 0 2024-09-21T08:02:31.793 INFO:tasks.workunit.client.1.smithi129.stdout:7/494: creat d0/d1e/d9a/fa2 x:0 0 0 2024-09-21T08:02:31.793 INFO:tasks.workunit.client.1.smithi129.stdout:7/495: stat d0/d1e/l31 0 2024-09-21T08:02:31.794 INFO:tasks.workunit.client.1.smithi129.stdout:6/381: creat d7/d4a/d69/f87 x:0 0 0 2024-09-21T08:02:31.798 INFO:tasks.workunit.client.1.smithi129.stdout:3/478: unlink d3/da/dc/fd 0 2024-09-21T08:02:31.803 INFO:tasks.workunit.client.1.smithi129.stdout:7/496: link d0/l3f d0/d1e/d9a/d9f/la3 0 2024-09-21T08:02:31.803 INFO:tasks.workunit.client.1.smithi129.stdout:7/497: creat d0/d1e/fa4 x:0 0 0 2024-09-21T08:02:31.804 INFO:tasks.workunit.client.1.smithi129.stdout:3/479: creat d3/d5a/f9e x:0 0 0 2024-09-21T08:02:31.808 INFO:tasks.workunit.client.1.smithi129.stdout:1/550: getdents d1/d7a/da4 0 2024-09-21T08:02:31.811 INFO:tasks.workunit.client.1.smithi129.stdout:2/674: rmdir d1/d13/d3a/d47/dac 39 2024-09-21T08:02:31.813 INFO:tasks.workunit.client.1.smithi129.stdout:6/382: dwrite d7/f37 [0,4194304] 0 2024-09-21T08:02:31.815 INFO:tasks.workunit.client.1.smithi129.stdout:3/480: mknod d3/da/dc/d11/d55/d68/c9f 0 2024-09-21T08:02:31.815 INFO:tasks.workunit.client.1.smithi129.stdout:3/481: fdatasync d3/f63 0 2024-09-21T08:02:31.815 INFO:tasks.workunit.client.1.smithi129.stdout:3/482: creat d3/da/d5d/fa0 x:0 0 0 2024-09-21T08:02:31.816 INFO:tasks.workunit.client.1.smithi129.stdout:6/383: truncate d7/d10/f15 3532924 0 2024-09-21T08:02:31.819 INFO:tasks.workunit.client.1.smithi129.stdout:3/483: link d3/da/dc/d11/l42 d3/da/d5d/d94/la1 0 2024-09-21T08:02:31.822 INFO:tasks.workunit.client.1.smithi129.stdout:6/384: symlink d7/d1b/d25/d35/l88 0 2024-09-21T08:02:31.823 INFO:tasks.workunit.client.1.smithi129.stdout:2/675: rename d1/dc/d26 to d1/d13/d3a/d47/d1f/d85/df7 0 2024-09-21T08:02:31.824 INFO:tasks.workunit.client.1.smithi129.stdout:6/385: mkdir d7/d4a/d69/d89 0 2024-09-21T08:02:31.825 INFO:tasks.workunit.client.1.smithi129.stdout:6/386: mknod d7/d1b/d1e/d39/d79/c8a 0 2024-09-21T08:02:31.828 INFO:tasks.workunit.client.1.smithi129.stdout:3/484: dread d3/da/d5d/f60 [0,4194304] 0 2024-09-21T08:02:31.829 INFO:tasks.workunit.client.1.smithi129.stdout:2/676: dread d1/f39 [0,4194304] 0 2024-09-21T08:02:31.829 INFO:tasks.workunit.client.1.smithi129.stdout:3/485: mkdir d3/d57/da2 0 2024-09-21T08:02:31.839 INFO:tasks.workunit.client.1.smithi129.stdout:3/486: dread d3/da/ff [0,4194304] 0 2024-09-21T08:02:31.839 INFO:tasks.workunit.client.1.smithi129.stdout:3/487: write d3/da/dc/d11/d2f/f85 [363375,110992] 0 2024-09-21T08:02:31.840 INFO:tasks.workunit.client.1.smithi129.stdout:3/488: mkdir d3/da/dc/da3 0 2024-09-21T08:02:31.845 INFO:tasks.workunit.client.1.smithi129.stdout:1/551: dwrite d1/fd [0,4194304] 0 2024-09-21T08:02:31.855 INFO:tasks.workunit.client.1.smithi129.stdout:2/677: dwrite d1/d13/d3a/d47/d1f/f40 [0,4194304] 0 2024-09-21T08:02:31.855 INFO:tasks.workunit.client.1.smithi129.stdout:2/678: chown d1/d13/d32/d7c 73629532 1 2024-09-21T08:02:31.857 INFO:tasks.workunit.client.1.smithi129.stdout:2/679: dread d1/dc/f37 [0,4194304] 0 2024-09-21T08:02:31.857 INFO:tasks.workunit.client.1.smithi129.stdout:2/680: getdents d1/d13/d3a/d47/d1f/d85/df7/d45/d65 0 2024-09-21T08:02:31.857 INFO:tasks.workunit.client.1.smithi129.stdout:2/681: fsync d1/dc/d19/d4c/f5b 0 2024-09-21T08:02:31.858 INFO:tasks.workunit.client.1.smithi129.stdout:2/682: creat d1/dc/d19/d4c/ff8 x:0 0 0 2024-09-21T08:02:31.858 INFO:tasks.workunit.client.1.smithi129.stdout:2/683: read d1/dc/f37 [916201,65912] 0 2024-09-21T08:02:31.866 INFO:tasks.workunit.client.1.smithi129.stdout:3/489: dwrite d3/da/dc/d11/d55/d68/f87 [0,4194304] 0 2024-09-21T08:02:31.866 INFO:tasks.workunit.client.1.smithi129.stdout:1/552: dwrite d1/d9/f3d [4194304,4194304] 0 2024-09-21T08:02:31.867 INFO:tasks.workunit.client.1.smithi129.stdout:1/553: rmdir d1/d16 39 2024-09-21T08:02:31.868 INFO:tasks.workunit.client.1.smithi129.stdout:2/684: dread d1/d13/d32/f55 [0,4194304] 0 2024-09-21T08:02:31.868 INFO:tasks.workunit.client.1.smithi129.stdout:1/554: creat d1/d9/fbc x:0 0 0 2024-09-21T08:02:31.868 INFO:tasks.workunit.client.1.smithi129.stdout:1/555: fdatasync d1/d9/f45 0 2024-09-21T08:02:31.868 INFO:tasks.workunit.client.1.smithi129.stdout:1/556: mknod d1/d16/d28/cbd 0 2024-09-21T08:02:31.869 INFO:tasks.workunit.client.1.smithi129.stdout:2/685: rename d1/dc/f6c to d1/dc/ff9 0 2024-09-21T08:02:31.870 INFO:tasks.workunit.client.1.smithi129.stdout:2/686: write d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d99/ff1 [672214,111980] 0 2024-09-21T08:02:31.870 INFO:tasks.workunit.client.1.smithi129.stdout:2/687: getdents d1/d53 0 2024-09-21T08:02:31.871 INFO:tasks.workunit.client.1.smithi129.stdout:2/688: write d1/dc/d19/d4c/d6a/f60 [1634513,99811] 0 2024-09-21T08:02:31.884 INFO:tasks.workunit.client.1.smithi129.stdout:3/490: dread d3/da/dc/d11/d55/d68/f87 [0,4194304] 0 2024-09-21T08:02:31.884 INFO:tasks.workunit.client.1.smithi129.stdout:1/557: dread d1/d9/f3d [0,4194304] 0 2024-09-21T08:02:31.908 INFO:tasks.workunit.client.1.smithi129.stdout:9/415: sync 2024-09-21T08:02:31.909 INFO:tasks.workunit.client.1.smithi129.stdout:9/416: chown d17/d22/d33/d36/l58 707 1 2024-09-21T08:02:31.909 INFO:tasks.workunit.client.1.smithi129.stdout:9/417: read - d17/d46/f5f zero size 2024-09-21T08:02:31.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.913+0000 7f94e1c2a640 1 -- 172.21.15.107:0/4095902564 --> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f94dc100b10 con 0x7f94c406e6e0 2024-09-21T08:02:31.914 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:31 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:31.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.914+0000 7f94c3fff640 1 -- 172.21.15.107:0/4095902564 <== mgr.24311 v2:172.21.15.129:6828/1054385200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f94dc100b10 con 0x7f94c406e6e0 2024-09-21T08:02:31.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.916+0000 7f94e1c2a640 1 -- 172.21.15.107:0/4095902564 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f94c406e6e0 msgr2=0x7f94c4070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:31.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.916+0000 7f94e1c2a640 1 --2- 172.21.15.107:0/4095902564 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f94c406e6e0 0x7f94c4070b90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f94d0004540 tx=0x7f94d0035040 comp rx=0 tx=0).stop 2024-09-21T08:02:31.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.916+0000 7f94e1c2a640 1 -- 172.21.15.107:0/4095902564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94dc0fb420 msgr2=0x7f94dc10fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:31.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.916+0000 7f94e1c2a640 1 --2- 172.21.15.107:0/4095902564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94dc0fb420 0x7f94dc10fd90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f94cc00c790 tx=0x7f94cc0043c0 comp rx=0 tx=0).stop 2024-09-21T08:02:31.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.916+0000 7f94e1c2a640 1 -- 172.21.15.107:0/4095902564 shutdown_connections 2024-09-21T08:02:31.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.916+0000 7f94e1c2a640 1 --2- 172.21.15.107:0/4095902564 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f94c406e6e0 0x7f94c4070b90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:31.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.916+0000 7f94e1c2a640 1 --2- 172.21.15.107:0/4095902564 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94dc0fc6f0 0x7f94dc1122e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:31.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.916+0000 7f94e1c2a640 1 --2- 172.21.15.107:0/4095902564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94dc0fb420 0x7f94dc10fd90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:31.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.916+0000 7f94e1c2a640 1 -- 172.21.15.107:0/4095902564 >> 172.21.15.107:0/4095902564 conn(0x7f94dc0f6c00 msgr2=0x7f94dc0f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:31.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.917+0000 7f94e1c2a640 1 -- 172.21.15.107:0/4095902564 shutdown_connections 2024-09-21T08:02:31.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.917+0000 7f94e1c2a640 1 -- 172.21.15.107:0/4095902564 wait complete. 2024-09-21T08:02:31.968 INFO:tasks.workunit.client.1.smithi129.stdout:2/689: getdents d1/dc/d19/d4c/d6a/d69 0 2024-09-21T08:02:31.969 INFO:tasks.workunit.client.1.smithi129.stdout:1/558: unlink d1/d9/d31/cab 0 2024-09-21T08:02:31.971 INFO:tasks.workunit.client.1.smithi129.stdout:9/418: dwrite d17/d55/f62 [0,4194304] 0 2024-09-21T08:02:31.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.995+0000 7fda22500640 1 -- 172.21.15.107:0/3639348264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda1c0fc570 msgr2=0x7fda1c0fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:31.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.995+0000 7fda22500640 1 --2- 172.21.15.107:0/3639348264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda1c0fc570 0x7fda1c0fc980 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fda0c004a10 tx=0x7fda0c009d40 comp rx=0 tx=0).stop 2024-09-21T08:02:31.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.995+0000 7fda22500640 1 -- 172.21.15.107:0/3639348264 shutdown_connections 2024-09-21T08:02:31.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.995+0000 7fda22500640 1 --2- 172.21.15.107:0/3639348264 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fda1c0fd840 0x7fda1c0fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:31.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.995+0000 7fda22500640 1 --2- 172.21.15.107:0/3639348264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda1c0fc570 0x7fda1c0fc980 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:31.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.995+0000 7fda22500640 1 -- 172.21.15.107:0/3639348264 >> 172.21.15.107:0/3639348264 conn(0x7fda1c0f7d30 msgr2=0x7fda1c0fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:31.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.996+0000 7fda22500640 1 -- 172.21.15.107:0/3639348264 shutdown_connections 2024-09-21T08:02:31.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.996+0000 7fda22500640 1 -- 172.21.15.107:0/3639348264 wait complete. 2024-09-21T08:02:31.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.996+0000 7fda22500640 1 Processor -- start 2024-09-21T08:02:31.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.996+0000 7fda22500640 1 -- start start 2024-09-21T08:02:31.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.996+0000 7fda22500640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda1c0fc570 0x7fda1c071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:31.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.996+0000 7fda22500640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fda1c0fd840 0x7fda1c06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:31.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.996+0000 7fda22500640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c06fff0 con 0x7fda1c0fc570 2024-09-21T08:02:31.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.996+0000 7fda22500640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c070130 con 0x7fda1c0fd840 2024-09-21T08:02:31.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.996+0000 7fda1bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda1c0fc570 0x7fda1c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:32.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.996+0000 7fda1bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda1c0fc570 0x7fda1c071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53780/0 (socket says 172.21.15.107:53780) 2024-09-21T08:02:32.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.996+0000 7fda1bfff640 1 -- 172.21.15.107:0/2337416135 learned_addr learned my addr 172.21.15.107:0/2337416135 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:02:32.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.996+0000 7fda13fff640 1 --2- 172.21.15.107:0/2337416135 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fda1c0fd840 0x7fda1c06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:32.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.997+0000 7fda1bfff640 1 -- 172.21.15.107:0/2337416135 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fda1c0fd840 msgr2=0x7fda1c06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:32.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.997+0000 7fda1bfff640 1 --2- 172.21.15.107:0/2337416135 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fda1c0fd840 0x7fda1c06fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:32.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.997+0000 7fda1bfff640 1 -- 172.21.15.107:0/2337416135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c0045d0 con 0x7fda1c0fc570 2024-09-21T08:02:32.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.997+0000 7fda1bfff640 1 --2- 172.21.15.107:0/2337416135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda1c0fc570 0x7fda1c071570 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fda0c02d040 tx=0x7fda0c009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:32.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.997+0000 7fda197fa640 1 -- 172.21.15.107:0/2337416135 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda0c038070 con 0x7fda1c0fc570 2024-09-21T08:02:32.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.997+0000 7fda197fa640 1 -- 172.21.15.107:0/2337416135 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fda0c02adf0 con 0x7fda1c0fc570 2024-09-21T08:02:32.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.997+0000 7fda22500640 1 -- 172.21.15.107:0/2337416135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1c0703b0 con 0x7fda1c0fc570 2024-09-21T08:02:32.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.997+0000 7fda197fa640 1 -- 172.21.15.107:0/2337416135 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda0c03c920 con 0x7fda1c0fc570 2024-09-21T08:02:32.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.997+0000 7fda22500640 1 -- 172.21.15.107:0/2337416135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1c115080 con 0x7fda1c0fc570 2024-09-21T08:02:32.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.998+0000 7fda22500640 1 -- 172.21.15.107:0/2337416135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1c0fb9d0 con 0x7fda1c0fc570 2024-09-21T08:02:32.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.999+0000 7fda197fa640 1 -- 172.21.15.107:0/2337416135 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fda0c030020 con 0x7fda1c0fc570 2024-09-21T08:02:32.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.999+0000 7fda197fa640 1 --2- 172.21.15.107:0/2337416135 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fda0806e6e0 0x7fda08070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:32.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.999+0000 7fda197fa640 1 -- 172.21.15.107:0/2337416135 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fda0c0addf0 con 0x7fda1c0fc570 2024-09-21T08:02:32.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:31.999+0000 7fda13fff640 1 --2- 172.21.15.107:0/2337416135 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fda0806e6e0 0x7fda08070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:32.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.000+0000 7fda13fff640 1 --2- 172.21.15.107:0/2337416135 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fda0806e6e0 0x7fda08070b90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fda040041d0 tx=0x7fda04004330 comp rx=0 tx=0).ready entity=mgr.24311 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:32.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.003+0000 7fda197fa640 1 -- 172.21.15.107:0/2337416135 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fda0c0778b0 con 0x7fda1c0fc570 2024-09-21T08:02:32.006 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:31 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:32.014 INFO:tasks.workunit.client.1.smithi129.stdout:2/690: symlink d1/d53/lfa 0 2024-09-21T08:02:32.016 INFO:tasks.workunit.client.1.smithi129.stdout:3/491: getdents d3/da/dc/d11 0 2024-09-21T08:02:32.017 INFO:tasks.workunit.client.1.smithi129.stdout:1/559: mknod d1/d16/db3/cbe 0 2024-09-21T08:02:32.019 INFO:tasks.workunit.client.1.smithi129.stdout:9/419: creat d17/d23/f8b x:0 0 0 2024-09-21T08:02:32.020 INFO:tasks.workunit.client.1.smithi129.stdout:3/492: mknod d3/da/dc/ca4 0 2024-09-21T08:02:32.020 INFO:tasks.workunit.client.1.smithi129.stdout:3/493: write d3/da/dc/d11/d55/d68/f6f [848985,116276] 0 2024-09-21T08:02:32.023 INFO:tasks.workunit.client.1.smithi129.stdout:9/420: truncate d17/d2c/d31/f51 3952274 0 2024-09-21T08:02:32.024 INFO:tasks.workunit.client.1.smithi129.stdout:2/691: dread d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d50/f6e [0,4194304] 0 2024-09-21T08:02:32.024 INFO:tasks.workunit.client.1.smithi129.stdout:3/494: rename d3/d69/d95/f72 to d3/da/dc/d25/fa5 0 2024-09-21T08:02:32.024 INFO:tasks.workunit.client.1.smithi129.stdout:3/495: truncate d3/f4 8627171 0 2024-09-21T08:02:32.025 INFO:tasks.workunit.client.1.smithi129.stdout:9/421: mkdir d17/d60/d7b/d8c 0 2024-09-21T08:02:32.026 INFO:tasks.workunit.client.1.smithi129.stdout:2/692: mknod d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d99/cfb 0 2024-09-21T08:02:32.028 INFO:tasks.workunit.client.1.smithi129.stdout:3/496: unlink d3/da/dc/l75 0 2024-09-21T08:02:32.029 INFO:tasks.workunit.client.1.smithi129.stdout:9/422: truncate d17/d2c/f43 2252332 0 2024-09-21T08:02:32.029 INFO:tasks.workunit.client.1.smithi129.stdout:9/423: read d17/d55/d81/f52 [213697,122613] 0 2024-09-21T08:02:32.032 INFO:tasks.workunit.client.1.smithi129.stdout:2/693: rename d1/d13/d3a/d47/d1f/d85/df7/f42 to d1/d13/d32/d7c/ffc 0 2024-09-21T08:02:32.034 INFO:tasks.workunit.client.1.smithi129.stdout:0/454: sync 2024-09-21T08:02:32.034 INFO:tasks.workunit.client.1.smithi129.stdout:8/351: sync 2024-09-21T08:02:32.034 INFO:tasks.workunit.client.1.smithi129.stdout:6/387: sync 2024-09-21T08:02:32.034 INFO:tasks.workunit.client.1.smithi129.stdout:4/376: sync 2024-09-21T08:02:32.034 INFO:tasks.workunit.client.1.smithi129.stdout:5/487: sync 2024-09-21T08:02:32.034 INFO:tasks.workunit.client.1.smithi129.stdout:0/455: write de/d19/f86 [4363887,23574] 0 2024-09-21T08:02:32.034 INFO:tasks.workunit.client.1.smithi129.stdout:7/498: sync 2024-09-21T08:02:32.034 INFO:tasks.workunit.client.1.smithi129.stdout:7/499: chown d0/d46/l93 1575346881 1 2024-09-21T08:02:32.035 INFO:tasks.workunit.client.1.smithi129.stdout:9/424: rename d17/d2c/d31/c7c to d17/d2c/c8d 0 2024-09-21T08:02:32.035 INFO:tasks.workunit.client.1.smithi129.stdout:2/694: mknod d1/d53/d77/d8b/cfd 0 2024-09-21T08:02:32.035 INFO:tasks.workunit.client.1.smithi129.stdout:2/695: write d1/dc/f10 [3339476,30405] 0 2024-09-21T08:02:32.035 INFO:tasks.workunit.client.1.smithi129.stdout:4/377: creat d5/d11/d3f/f88 x:0 0 0 2024-09-21T08:02:32.037 INFO:tasks.workunit.client.1.smithi129.stdout:5/488: creat d2/d2a/d6f/d71/f93 x:0 0 0 2024-09-21T08:02:32.037 INFO:tasks.workunit.client.1.smithi129.stdout:0/456: symlink de/d22/l95 0 2024-09-21T08:02:32.039 INFO:tasks.workunit.client.1.smithi129.stdout:7/500: mkdir d0/d46/d6e/d9b/da5 0 2024-09-21T08:02:32.039 INFO:tasks.workunit.client.1.smithi129.stdout:7/501: creat d0/d46/d8e/d8f/fa6 x:0 0 0 2024-09-21T08:02:32.041 INFO:tasks.workunit.client.1.smithi129.stdout:4/378: mkdir d5/d11/d77/d89 0 2024-09-21T08:02:32.043 INFO:tasks.workunit.client.1.smithi129.stdout:1/560: dwrite d1/d44/f53 [0,4194304] 0 2024-09-21T08:02:32.043 INFO:tasks.workunit.client.1.smithi129.stdout:0/457: rename de/d15/d44/f48 to de/d15/d39/f96 0 2024-09-21T08:02:32.046 INFO:tasks.workunit.client.1.smithi129.stdout:7/502: truncate d0/f25 765488 0 2024-09-21T08:02:32.047 INFO:tasks.workunit.client.1.smithi129.stdout:0/458: getdents de/d22/d27/d2f/d42 0 2024-09-21T08:02:32.047 INFO:tasks.workunit.client.1.smithi129.stdout:0/459: fsync de/d19/f46 0 2024-09-21T08:02:32.047 INFO:tasks.workunit.client.1.smithi129.stdout:0/460: fdatasync de/d19/f66 0 2024-09-21T08:02:32.047 INFO:tasks.workunit.client.1.smithi129.stdout:0/461: write de/d22/f2b [5216931,34412] 0 2024-09-21T08:02:32.049 INFO:tasks.workunit.client.1.smithi129.stdout:1/561: mkdir d1/d16/d9b/dbf 0 2024-09-21T08:02:32.049 INFO:tasks.workunit.client.1.smithi129.stdout:6/388: dread d7/d10/f16 [0,4194304] 0 2024-09-21T08:02:32.049 INFO:tasks.workunit.client.1.smithi129.stdout:0/462: creat de/d15/d44/f97 x:0 0 0 2024-09-21T08:02:32.049 INFO:tasks.workunit.client.1.smithi129.stdout:0/463: creat de/d15/d29/f98 x:0 0 0 2024-09-21T08:02:32.049 INFO:tasks.workunit.client.1.smithi129.stdout:0/464: chown de/d1f/f34 20 1 2024-09-21T08:02:32.052 INFO:tasks.workunit.client.1.smithi129.stdout:1/562: creat d1/d4/fc0 x:0 0 0 2024-09-21T08:02:32.052 INFO:tasks.workunit.client.1.smithi129.stdout:1/563: fsync d1/d16/d28/f33 0 2024-09-21T08:02:32.052 INFO:tasks.workunit.client.1.smithi129.stdout:5/489: write d2/d1e/d35/f51 [3141193,2565] 0 2024-09-21T08:02:32.054 INFO:tasks.workunit.client.1.smithi129.stdout:5/490: creat d2/d1e/d35/d33/d36/d5a/d77/d81/f94 x:0 0 0 2024-09-21T08:02:32.055 INFO:tasks.workunit.client.1.smithi129.stdout:1/564: link d1/d9/f6c d1/d4/dad/db6/fc1 0 2024-09-21T08:02:32.057 INFO:tasks.workunit.client.1.smithi129.stdout:5/491: rename d2/c6 to d2/d1e/d35/d33/d36/d5a/d77/d81/c95 0 2024-09-21T08:02:32.057 INFO:tasks.workunit.client.1.smithi129.stdout:4/379: dread d5/f14 [0,4194304] 0 2024-09-21T08:02:32.057 INFO:tasks.workunit.client.1.smithi129.stdout:4/380: write d5/d11/d3f/d50/f60 [1420983,96199] 0 2024-09-21T08:02:32.057 INFO:tasks.workunit.client.1.smithi129.stdout:4/381: creat d5/d11/f8a x:0 0 0 2024-09-21T08:02:32.057 INFO:tasks.workunit.client.1.smithi129.stdout:4/382: fsync d5/d11/f3d 0 2024-09-21T08:02:32.057 INFO:tasks.workunit.client.1.smithi129.stdout:4/383: fdatasync d5/d16/d24/d3b/f65 0 2024-09-21T08:02:32.057 INFO:tasks.workunit.client.1.smithi129.stdout:4/384: dread - d5/d16/d47/d5f/f6b zero size 2024-09-21T08:02:32.058 INFO:tasks.workunit.client.1.smithi129.stdout:4/385: dread - d5/d16/d47/d5f/d64/d75/f59 zero size 2024-09-21T08:02:32.058 INFO:tasks.workunit.client.1.smithi129.stdout:1/565: unlink d1/d16/d25/da0/la8 0 2024-09-21T08:02:32.061 INFO:tasks.workunit.client.1.smithi129.stdout:1/566: mkdir d1/d4/dc2 0 2024-09-21T08:02:32.064 INFO:tasks.workunit.client.1.smithi129.stdout:3/497: dwrite d3/da/d5d/f77 [0,4194304] 0 2024-09-21T08:02:32.066 INFO:tasks.workunit.client.1.smithi129.stdout:5/492: dread d2/d1e/d35/f2d [0,4194304] 0 2024-09-21T08:02:32.066 INFO:tasks.workunit.client.1.smithi129.stdout:5/493: truncate d2/f79 4460454 0 2024-09-21T08:02:32.067 INFO:tasks.workunit.client.1.smithi129.stdout:3/498: creat d3/da/dc/d11/fa6 x:0 0 0 2024-09-21T08:02:32.067 INFO:tasks.workunit.client.1.smithi129.stdout:3/499: creat d3/da/dc/fa7 x:0 0 0 2024-09-21T08:02:32.075 INFO:tasks.workunit.client.1.smithi129.stdout:2/696: dwrite d1/d13/f41 [4194304,4194304] 0 2024-09-21T08:02:32.075 INFO:tasks.workunit.client.1.smithi129.stdout:9/425: dwrite d17/d22/d33/d36/d48/d3f/f67 [0,4194304] 0 2024-09-21T08:02:32.075 INFO:tasks.workunit.client.1.smithi129.stdout:9/426: creat d17/d46/f8e x:0 0 0 2024-09-21T08:02:32.077 INFO:tasks.workunit.client.1.smithi129.stdout:9/427: symlink d17/d60/d7b/l8f 0 2024-09-21T08:02:32.078 INFO:tasks.workunit.client.1.smithi129.stdout:9/428: mkdir d17/d22/d33/d7a/d89/d90 0 2024-09-21T08:02:32.078 INFO:tasks.workunit.client.1.smithi129.stdout:9/429: creat d17/d2c/d31/f91 x:0 0 0 2024-09-21T08:02:32.079 INFO:tasks.workunit.client.1.smithi129.stdout:1/567: dread d1/d4/f6d [0,4194304] 0 2024-09-21T08:02:32.080 INFO:tasks.workunit.client.1.smithi129.stdout:9/430: rmdir d17/d22/d33/d36/d48/d75 39 2024-09-21T08:02:32.080 INFO:tasks.workunit.client.1.smithi129.stdout:9/431: write f0 [708385,9107] 0 2024-09-21T08:02:32.080 INFO:tasks.workunit.client.1.smithi129.stdout:1/568: chown d1/d64/fa6 5432 1 2024-09-21T08:02:32.081 INFO:tasks.workunit.client.1.smithi129.stdout:9/432: link d17/d2c/d31/d5e/d6b/l6c d17/d22/d33/d36/d48/l92 0 2024-09-21T08:02:32.082 INFO:tasks.workunit.client.1.smithi129.stdout:1/569: unlink d1/d9/d31/lb0 0 2024-09-21T08:02:32.082 INFO:tasks.workunit.client.1.smithi129.stdout:5/494: dread d2/d1e/d35/d33/d36/d5a/f70 [0,4194304] 0 2024-09-21T08:02:32.083 INFO:tasks.workunit.client.1.smithi129.stdout:1/570: creat d1/d44/fc3 x:0 0 0 2024-09-21T08:02:32.084 INFO:tasks.workunit.client.1.smithi129.stdout:5/495: unlink d2/d1e/d6b/c80 0 2024-09-21T08:02:32.085 INFO:tasks.workunit.client.1.smithi129.stdout:8/352: dwrite d0/d6/d7/d24/f47 [0,4194304] 0 2024-09-21T08:02:32.085 INFO:tasks.workunit.client.1.smithi129.stdout:8/353: readlink d0/d6/d7/d18/d27/l6a 0 2024-09-21T08:02:32.086 INFO:tasks.workunit.client.1.smithi129.stdout:5/496: mkdir d2/d1e/d35/d37/d96 0 2024-09-21T08:02:32.086 INFO:tasks.workunit.client.1.smithi129.stdout:5/497: stat d2/d1e/d35/d33/d36/d5a/d77 0 2024-09-21T08:02:32.087 INFO:tasks.workunit.client.1.smithi129.stdout:8/354: creat d0/d6/d7/d6c/f6e x:0 0 0 2024-09-21T08:02:32.087 INFO:tasks.workunit.client.1.smithi129.stdout:8/355: getdents d0/d6/d7/d18/d27/d60 0 2024-09-21T08:02:32.087 INFO:tasks.workunit.client.1.smithi129.stdout:5/498: mknod d2/d2a/c97 0 2024-09-21T08:02:32.087 INFO:tasks.workunit.client.1.smithi129.stdout:3/500: dread d3/da/d5d/f77 [0,4194304] 0 2024-09-21T08:02:32.087 INFO:tasks.workunit.client.1.smithi129.stdout:5/499: rename d2 to d2/d1e/d35/d98 22 2024-09-21T08:02:32.088 INFO:tasks.workunit.client.1.smithi129.stdout:8/356: symlink d0/d6/d7/d18/d27/l6f 0 2024-09-21T08:02:32.090 INFO:tasks.workunit.client.1.smithi129.stdout:5/500: truncate d2/d1e/f56 2262301 0 2024-09-21T08:02:32.092 INFO:tasks.workunit.client.1.smithi129.stdout:8/357: read d0/d6/d7/d18/d27/f39 [22211,57325] 0 2024-09-21T08:02:32.096 INFO:tasks.workunit.client.1.smithi129.stdout:4/386: dwrite d5/d6/f7 [4194304,4194304] 0 2024-09-21T08:02:32.098 INFO:tasks.workunit.client.1.smithi129.stdout:4/387: symlink d5/d11/d77/d89/l8b 0 2024-09-21T08:02:32.103 INFO:tasks.workunit.client.1.smithi129.stdout:4/388: getdents d5/d16/d24/d4f 0 2024-09-21T08:02:32.104 INFO:tasks.workunit.client.1.smithi129.stdout:4/389: symlink d5/d33/l8c 0 2024-09-21T08:02:32.104 INFO:tasks.workunit.client.1.smithi129.stdout:4/390: fsync d5/d6/f7 0 2024-09-21T08:02:32.109 INFO:tasks.workunit.client.1.smithi129.stdout:4/391: rename d5/d11/d3f/l3a to d5/d33/d66/l8d 0 2024-09-21T08:02:32.109 INFO:tasks.workunit.client.1.smithi129.stdout:2/697: dwrite d1/dc/d19/d4c/f67 [0,4194304] 0 2024-09-21T08:02:32.114 INFO:tasks.workunit.client.1.smithi129.stdout:2/698: dread d1/dc/d19/f38 [0,4194304] 0 2024-09-21T08:02:32.114 INFO:tasks.workunit.client.1.smithi129.stdout:2/699: truncate d1/d13/f28 4840958 0 2024-09-21T08:02:32.115 INFO:tasks.workunit.client.1.smithi129.stdout:2/700: mknod d1/d13/d3a/d47/d5f/cfe 0 2024-09-21T08:02:32.137 INFO:tasks.workunit.client.1.smithi129.stdout:1/571: dwrite d1/d4/f84 [0,4194304] 0 2024-09-21T08:02:32.138 INFO:tasks.workunit.client.1.smithi129.stdout:1/572: rmdir d1/d16/d28 39 2024-09-21T08:02:32.139 INFO:tasks.workunit.client.1.smithi129.stdout:9/433: dwrite d17/d2c/f66 [0,4194304] 0 2024-09-21T08:02:32.139 INFO:tasks.workunit.client.1.smithi129.stdout:3/501: dwrite d3/da/f19 [4194304,4194304] 0 2024-09-21T08:02:32.139 INFO:tasks.workunit.client.1.smithi129.stdout:8/358: dwrite d0/d6/f4c [0,4194304] 0 2024-09-21T08:02:32.139 INFO:tasks.workunit.client.1.smithi129.stdout:4/392: dwrite d5/d11/f4c [0,4194304] 0 2024-09-21T08:02:32.139 INFO:tasks.workunit.client.1.smithi129.stdout:5/501: dwrite d2/f24 [0,4194304] 0 2024-09-21T08:02:32.142 INFO:tasks.workunit.client.1.smithi129.stdout:9/434: link d17/d22/c3e d17/d22/c93 0 2024-09-21T08:02:32.144 INFO:tasks.workunit.client.1.smithi129.stdout:3/502: creat d3/da/dc/d7f/fa8 x:0 0 0 2024-09-21T08:02:32.153 INFO:tasks.workunit.client.1.smithi129.stdout:1/573: rmdir d1/d9/d31 39 2024-09-21T08:02:32.153 INFO:tasks.workunit.client.1.smithi129.stdout:1/574: write d1/d44/d83/fb2 [690011,36666] 0 2024-09-21T08:02:32.154 INFO:tasks.workunit.client.1.smithi129.stdout:8/359: mkdir d0/d6/d7/d18/d27/d32/d70 0 2024-09-21T08:02:32.154 INFO:tasks.workunit.client.1.smithi129.stdout:8/360: chown d0/d6/d7/f21 0 1 2024-09-21T08:02:32.154 INFO:tasks.workunit.client.1.smithi129.stdout:8/361: write d0/d6/f28 [2656998,68093] 0 2024-09-21T08:02:32.155 INFO:tasks.workunit.client.1.smithi129.stdout:8/362: fdatasync d0/d6/d7/d9/f2a 0 2024-09-21T08:02:32.156 INFO:tasks.workunit.client.1.smithi129.stdout:4/393: creat d5/d48/f8e x:0 0 0 2024-09-21T08:02:32.157 INFO:tasks.workunit.client.1.smithi129.stdout:5/502: symlink d2/l99 0 2024-09-21T08:02:32.157 INFO:tasks.workunit.client.1.smithi129.stdout:5/503: write d2/d1e/d35/d33/f69 [400976,88335] 0 2024-09-21T08:02:32.157 INFO:tasks.workunit.client.1.smithi129.stdout:5/504: stat d2/d1e/d35/d33/d36/f59 0 2024-09-21T08:02:32.158 INFO:tasks.workunit.client.1.smithi129.stdout:1/575: link d1/d64/cb1 d1/d9/d31/cc4 0 2024-09-21T08:02:32.159 INFO:tasks.workunit.client.1.smithi129.stdout:8/363: link d0/d6/d7/d9/f12 d0/d6/d7/d9/f71 0 2024-09-21T08:02:32.159 INFO:tasks.workunit.client.1.smithi129.stdout:8/364: readlink d0/d6/d7/d9/l43 0 2024-09-21T08:02:32.159 INFO:tasks.workunit.client.1.smithi129.stdout:4/394: creat d5/d16/d47/d5f/d64/d75/f8f x:0 0 0 2024-09-21T08:02:32.159 INFO:tasks.workunit.client.1.smithi129.stdout:4/395: creat d5/d16/d24/d3b/f90 x:0 0 0 2024-09-21T08:02:32.161 INFO:tasks.workunit.client.1.smithi129.stdout:5/505: rename d2/d1e/d35/c7b to d2/d1e/d35/d37/d7d/c9a 0 2024-09-21T08:02:32.161 INFO:tasks.workunit.client.1.smithi129.stdout:5/506: dread - d2/d1e/d35/d37/f73 zero size 2024-09-21T08:02:32.161 INFO:tasks.workunit.client.1.smithi129.stdout:8/365: creat d0/d6/d7/d18/d27/d32/d37/f72 x:0 0 0 2024-09-21T08:02:32.163 INFO:tasks.workunit.client.1.smithi129.stdout:9/435: dwrite d17/d23/f8b [0,4194304] 0 2024-09-21T08:02:32.163 INFO:tasks.workunit.client.1.smithi129.stdout:9/436: write d17/d46/f4b [5068019,26754] 0 2024-09-21T08:02:32.163 INFO:tasks.workunit.client.1.smithi129.stdout:4/396: link d5/d11/d3f/d50/f60 d5/d16/d47/d61/f91 0 2024-09-21T08:02:32.164 INFO:tasks.workunit.client.1.smithi129.stdout:5/507: creat d2/d1e/d35/d37/f9b x:0 0 0 2024-09-21T08:02:32.165 INFO:tasks.workunit.client.1.smithi129.stdout:1/576: unlink d1/d4/f5d 0 2024-09-21T08:02:32.166 INFO:tasks.workunit.client.1.smithi129.stdout:8/366: mknod d0/d6/d7/d9/c73 0 2024-09-21T08:02:32.169 INFO:tasks.workunit.client.1.smithi129.stdout:9/437: unlink c6 0 2024-09-21T08:02:32.170 INFO:tasks.workunit.client.1.smithi129.stdout:5/508: mknod d2/d2a/d50/c9c 0 2024-09-21T08:02:32.170 INFO:tasks.workunit.client.1.smithi129.stdout:5/509: write d2/d1e/d35/d33/f3e [1508751,79957] 0 2024-09-21T08:02:32.171 INFO:tasks.workunit.client.1.smithi129.stdout:3/503: dwrite d3/d69/d95/f91 [0,4194304] 0 2024-09-21T08:02:32.171 INFO:tasks.workunit.client.1.smithi129.stdout:1/577: rmdir d1/d9/d31 39 2024-09-21T08:02:32.172 INFO:tasks.workunit.client.1.smithi129.stdout:8/367: getdents d0/d6 0 2024-09-21T08:02:32.172 INFO:tasks.workunit.client.1.smithi129.stdout:8/368: truncate d0/d6/d7/d9/f12 4439911 0 2024-09-21T08:02:32.172 INFO:tasks.workunit.client.1.smithi129.stdout:8/369: readlink d0/d6/l1b 0 2024-09-21T08:02:32.172 INFO:tasks.workunit.client.1.smithi129.stdout:8/370: chown d0/d6/d7 10 1 2024-09-21T08:02:32.172 INFO:tasks.workunit.client.1.smithi129.stdout:8/371: write d0/d6/d7/d18/d27/f3c [5067008,77520] 0 2024-09-21T08:02:32.172 INFO:tasks.workunit.client.1.smithi129.stdout:9/438: link d17/d22/d33/d36/l58 d17/d55/l94 0 2024-09-21T08:02:32.177 INFO:tasks.workunit.client.1.smithi129.stdout:8/372: symlink d0/d6/d7/d3a/l74 0 2024-09-21T08:02:32.178 INFO:tasks.workunit.client.1.smithi129.stdout:3/504: truncate d3/f4 5127079 0 2024-09-21T08:02:32.181 INFO:tasks.workunit.client.1.smithi129.stdout:4/397: dwrite d5/d16/d47/f86 [0,4194304] 0 2024-09-21T08:02:32.181 INFO:tasks.workunit.client.1.smithi129.stdout:4/398: chown d5/d11/d77 5546014 1 2024-09-21T08:02:32.182 INFO:tasks.workunit.client.1.smithi129.stdout:8/373: creat d0/d6/d7/d18/d27/d32/d70/f75 x:0 0 0 2024-09-21T08:02:32.184 INFO:tasks.workunit.client.1.smithi129.stdout:4/399: mknod d5/d6/c92 0 2024-09-21T08:02:32.186 INFO:tasks.workunit.client.1.smithi129.stdout:8/374: mkdir d0/d6/d7/d24/d76 0 2024-09-21T08:02:32.187 INFO:tasks.workunit.client.1.smithi129.stdout:8/375: chown d0/d6/c52 60036 1 2024-09-21T08:02:32.190 INFO:tasks.workunit.client.1.smithi129.stdout:1/578: dread d1/f3 [4194304,4194304] 0 2024-09-21T08:02:32.190 INFO:tasks.workunit.client.1.smithi129.stdout:1/579: fdatasync d1/d9/d31/f62 0 2024-09-21T08:02:32.198 INFO:tasks.workunit.client.1.smithi129.stdout:1/580: dread d1/d16/f2a [0,4194304] 0 2024-09-21T08:02:32.198 INFO:tasks.workunit.client.1.smithi129.stdout:1/581: write d1/d64/fac [977049,94252] 0 2024-09-21T08:02:32.202 INFO:tasks.workunit.client.1.smithi129.stdout:8/376: dread d0/d6/f1f [0,4194304] 0 2024-09-21T08:02:32.202 INFO:tasks.workunit.client.1.smithi129.stdout:8/377: write d0/f3f [323101,43011] 0 2024-09-21T08:02:32.202 INFO:tasks.workunit.client.1.smithi129.stdout:8/378: chown d0/d6/d7/d24/d76 653 1 2024-09-21T08:02:32.203 INFO:tasks.workunit.client.1.smithi129.stdout:8/379: dread - d0/d6/d7/d18/f48 zero size 2024-09-21T08:02:32.207 INFO:tasks.workunit.client.1.smithi129.stdout:8/380: write d0/d6/d7/d24/f35 [2819184,109577] 0 2024-09-21T08:02:32.207 INFO:tasks.workunit.client.1.smithi129.stdout:8/381: readlink d0/d6/d7/d24/l4e 0 2024-09-21T08:02:32.207 INFO:tasks.workunit.client.1.smithi129.stdout:8/382: creat d0/d6/d7/d18/d27/d32/d37/f77 x:0 0 0 2024-09-21T08:02:32.208 INFO:tasks.workunit.client.1.smithi129.stdout:8/383: mknod d0/c78 0 2024-09-21T08:02:32.208 INFO:tasks.workunit.client.1.smithi129.stdout:8/384: chown d0/d6/d7/l25 335019787 1 2024-09-21T08:02:32.212 INFO:tasks.workunit.client.1.smithi129.stdout:8/385: rename d0/d6/f34 to d0/d6/d7/d18/d27/d32/d3d/f79 0 2024-09-21T08:02:32.212 INFO:tasks.workunit.client.1.smithi129.stdout:8/386: chown d0/d6/d7/d18/d27/d32/d70/f75 42511 1 2024-09-21T08:02:32.213 INFO:tasks.workunit.client.1.smithi129.stdout:1/582: dread d1/d9/fe [0,4194304] 0 2024-09-21T08:02:32.213 INFO:tasks.workunit.client.1.smithi129.stdout:8/387: symlink d0/d6/d7/d3a/d68/l7a 0 2024-09-21T08:02:32.214 INFO:tasks.workunit.client.1.smithi129.stdout:5/510: dwrite d2/d1e/d35/d33/d36/d5a/f70 [0,4194304] 0 2024-09-21T08:02:32.214 INFO:tasks.workunit.client.1.smithi129.stdout:1/583: unlink d1/d9/l34 0 2024-09-21T08:02:32.215 INFO:tasks.workunit.client.1.smithi129.stdout:8/388: mkdir d0/d6/d7/d18/d27/d32/d3d/d7b 0 2024-09-21T08:02:32.215 INFO:tasks.workunit.client.1.smithi129.stdout:8/389: fdatasync d0/d6/d7/d9/f2a 0 2024-09-21T08:02:32.215 INFO:tasks.workunit.client.1.smithi129.stdout:8/390: fdatasync d0/d6/d7/d18/d27/d32/f5b 0 2024-09-21T08:02:32.216 INFO:tasks.workunit.client.1.smithi129.stdout:8/391: dread - d0/d6/d7/d18/d27/d32/d70/f75 zero size 2024-09-21T08:02:32.216 INFO:tasks.workunit.client.1.smithi129.stdout:5/511: unlink d2/c26 0 2024-09-21T08:02:32.217 INFO:tasks.workunit.client.1.smithi129.stdout:9/439: dwrite d17/d22/d33/d36/d48/d3f/f57 [0,4194304] 0 2024-09-21T08:02:32.217 INFO:tasks.workunit.client.1.smithi129.stdout:1/584: mkdir d1/d44/d83/dc5 0 2024-09-21T08:02:32.217 INFO:tasks.workunit.client.1.smithi129.stdout:3/505: dwrite d3/da/dc/fa7 [0,4194304] 0 2024-09-21T08:02:32.218 INFO:tasks.workunit.client.1.smithi129.stdout:3/506: stat d3/d5a/c7b 0 2024-09-21T08:02:32.218 INFO:tasks.workunit.client.1.smithi129.stdout:4/400: dwrite d5/d16/d24/d4f/f54 [0,4194304] 0 2024-09-21T08:02:32.219 INFO:tasks.workunit.client.1.smithi129.stdout:5/512: rename d2/d2a/f8f to d2/d2a/d50/d61/f9d 0 2024-09-21T08:02:32.219 INFO:tasks.workunit.client.1.smithi129.stdout:4/401: dread d5/d16/d47/f70 [0,4194304] 0 2024-09-21T08:02:32.222 INFO:tasks.workunit.client.1.smithi129.stdout:8/392: symlink d0/d6/d7/d18/l7c 0 2024-09-21T08:02:32.225 INFO:tasks.workunit.client.1.smithi129.stdout:3/507: mkdir d3/d5a/da9 0 2024-09-21T08:02:32.230 INFO:tasks.workunit.client.1.smithi129.stdout:5/513: read d2/f79 [155346,18954] 0 2024-09-21T08:02:32.234 INFO:tasks.workunit.client.1.smithi129.stdout:4/402: mknod d5/d33/c93 0 2024-09-21T08:02:32.236 INFO:tasks.workunit.client.1.smithi129.stdout:9/440: creat d17/d22/d33/d36/d48/f95 x:0 0 0 2024-09-21T08:02:32.236 INFO:tasks.workunit.client.1.smithi129.stdout:9/441: truncate d17/d22/d33/d36/d48/d3f/d53/f7e 278940 0 2024-09-21T08:02:32.238 INFO:tasks.workunit.client.1.smithi129.stdout:8/393: creat d0/d6/d7/d9/f7d x:0 0 0 2024-09-21T08:02:32.242 INFO:tasks.workunit.client.1.smithi129.stdout:4/403: dread f2 [0,4194304] 0 2024-09-21T08:02:32.242 INFO:tasks.workunit.client.1.smithi129.stdout:4/404: chown d5/d16/d24/d4f 69898638 1 2024-09-21T08:02:32.242 INFO:tasks.workunit.client.1.smithi129.stdout:9/442: symlink d17/d22/d33/d36/d48/d3f/d53/l96 0 2024-09-21T08:02:32.242 INFO:tasks.workunit.client.1.smithi129.stdout:8/394: creat d0/d6/d7/f7e x:0 0 0 2024-09-21T08:02:32.243 INFO:tasks.workunit.client.1.smithi129.stdout:3/508: rmdir d3/da/dc/d7f 39 2024-09-21T08:02:32.244 INFO:tasks.workunit.client.1.smithi129.stdout:1/585: rename d1/d64 to d1/d4/dc2/dc6 0 2024-09-21T08:02:32.244 INFO:tasks.workunit.client.1.smithi129.stdout:1/586: creat d1/d9/fc7 x:0 0 0 2024-09-21T08:02:32.245 INFO:tasks.workunit.client.1.smithi129.stdout:4/405: creat d5/d11/d77/f94 x:0 0 0 2024-09-21T08:02:32.245 INFO:tasks.workunit.client.1.smithi129.stdout:4/406: read - d5/d16/d47/d5f/f6b zero size 2024-09-21T08:02:32.246 INFO:tasks.workunit.client.1.smithi129.stdout:5/514: dwrite d2/d1e/f56 [0,4194304] 0 2024-09-21T08:02:32.246 INFO:tasks.workunit.client.1.smithi129.stdout:5/515: truncate d2/f45 777686 0 2024-09-21T08:02:32.247 INFO:tasks.workunit.client.1.smithi129.stdout:3/509: truncate d3/da/f78 200175 0 2024-09-21T08:02:32.248 INFO:tasks.workunit.client.1.smithi129.stdout:4/407: symlink d5/d16/d85/l95 0 2024-09-21T08:02:32.248 INFO:tasks.workunit.client.1.smithi129.stdout:4/408: chown d5/f7a 14784313 1 2024-09-21T08:02:32.249 INFO:tasks.workunit.client.1.smithi129.stdout:5/516: symlink d2/d2a/d50/d61/l9e 0 2024-09-21T08:02:32.250 INFO:tasks.workunit.client.1.smithi129.stdout:9/443: mkdir d17/d60/d97 0 2024-09-21T08:02:32.251 INFO:tasks.workunit.client.1.smithi129.stdout:8/395: mkdir d0/d6/d7/d18/d61/d7f 0 2024-09-21T08:02:32.251 INFO:tasks.workunit.client.1.smithi129.stdout:8/396: truncate d0/d6/d7/d24/f56 1380705 0 2024-09-21T08:02:32.251 INFO:tasks.workunit.client.1.smithi129.stdout:3/510: creat d3/faa x:0 0 0 2024-09-21T08:02:32.252 INFO:tasks.workunit.client.1.smithi129.stdout:5/517: symlink d2/d1e/d35/d33/l9f 0 2024-09-21T08:02:32.256 INFO:tasks.workunit.client.1.smithi129.stdout:1/587: dread d1/d4/fa [0,4194304] 0 2024-09-21T08:02:32.256 INFO:tasks.workunit.client.1.smithi129.stdout:1/588: write d1/d9/fc7 [642216,114199] 0 2024-09-21T08:02:32.257 INFO:tasks.workunit.client.1.smithi129.stdout:1/589: dread d1/d9/d31/f5e [0,4194304] 0 2024-09-21T08:02:32.257 INFO:tasks.workunit.client.1.smithi129.stdout:3/511: unlink d3/da/dc/d11/c16 0 2024-09-21T08:02:32.259 INFO:tasks.workunit.client.1.smithi129.stdout:9/444: rename d17/d23/c5d to d17/d22/d33/d36/d48/c98 0 2024-09-21T08:02:32.261 INFO:tasks.workunit.client.1.smithi129.stdout:8/397: mknod d0/d6/d7/d18/c80 0 2024-09-21T08:02:32.261 INFO:tasks.workunit.client.1.smithi129.stdout:8/398: fdatasync d0/f67 0 2024-09-21T08:02:32.262 INFO:tasks.workunit.client.1.smithi129.stdout:8/399: write d0/d6/f1a [3809754,118525] 0 2024-09-21T08:02:32.262 INFO:tasks.workunit.client.1.smithi129.stdout:8/400: write d0/d6/d7/d9/f7d [262720,79439] 0 2024-09-21T08:02:32.262 INFO:tasks.workunit.client.1.smithi129.stdout:8/401: write d0/d6/d7/d18/d27/f2d [2965814,87368] 0 2024-09-21T08:02:32.262 INFO:tasks.workunit.client.1.smithi129.stdout:8/402: stat d0/d6/d7/d3a/d68 0 2024-09-21T08:02:32.262 INFO:tasks.workunit.client.1.smithi129.stdout:1/590: write d1/f55 [3037449,19892] 0 2024-09-21T08:02:32.262 INFO:tasks.workunit.client.1.smithi129.stdout:1/591: dread - d1/d16/d9b/fa2 zero size 2024-09-21T08:02:32.262 INFO:tasks.workunit.client.1.smithi129.stdout:1/592: creat d1/d44/d83/fc8 x:0 0 0 2024-09-21T08:02:32.262 INFO:tasks.workunit.client.1.smithi129.stdout:1/593: dread - d1/d9/f6c zero size 2024-09-21T08:02:32.263 INFO:tasks.workunit.client.1.smithi129.stdout:5/518: write d2/d1e/d35/d33/d36/f59 [1569859,4732] 0 2024-09-21T08:02:32.263 INFO:tasks.workunit.client.1.smithi129.stdout:4/409: dwrite d5/d11/d3f/d50/f60 [0,4194304] 0 2024-09-21T08:02:32.263 INFO:tasks.workunit.client.1.smithi129.stdout:4/410: chown d5/d16/d24/d4f/f54 4 1 2024-09-21T08:02:32.263 INFO:tasks.workunit.client.1.smithi129.stdout:4/411: write d5/d16/d24/f27 [4537679,63128] 0 2024-09-21T08:02:32.263 INFO:tasks.workunit.client.1.smithi129.stdout:3/512: rename d3/da/d5d/f60 to d3/da/d5d/d94/fab 0 2024-09-21T08:02:32.263 INFO:tasks.workunit.client.1.smithi129.stdout:3/513: write d3/da/dc/f4d [2244508,48682] 0 2024-09-21T08:02:32.263 INFO:tasks.workunit.client.1.smithi129.stdout:3/514: write d3/da/dc/d11/d2f/f40 [4965419,110147] 0 2024-09-21T08:02:32.265 INFO:tasks.workunit.client.1.smithi129.stdout:1/594: creat d1/d44/db9/fc9 x:0 0 0 2024-09-21T08:02:32.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.274+0000 7fda22500640 1 -- 172.21.15.107:0/2337416135 --> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fda1c101c20 con 0x7fda0806e6e0 2024-09-21T08:02:32.276 INFO:tasks.workunit.client.1.smithi129.stdout:4/412: mknod d5/d16/d24/d4f/c96 0 2024-09-21T08:02:32.278 INFO:tasks.workunit.client.1.smithi129.stdout:3/515: mkdir d3/da/d5d/d94/dac 0 2024-09-21T08:02:32.278 INFO:tasks.workunit.client.1.smithi129.stdout:3/516: creat d3/d69/d95/d52/fad x:0 0 0 2024-09-21T08:02:32.278 INFO:tasks.workunit.client.1.smithi129.stdout:3/517: fdatasync d3/da/dc/d11/d55/d68/f6f 0 2024-09-21T08:02:32.279 INFO:tasks.workunit.client.1.smithi129.stdout:1/595: creat d1/d4/dc2/dc6/fca x:0 0 0 2024-09-21T08:02:32.279 INFO:tasks.workunit.client.1.smithi129.stdout:1/596: dread - d1/d16/d57/fa1 zero size 2024-09-21T08:02:32.280 INFO:tasks.workunit.client.1.smithi129.stdout:4/413: rename d5/d11/d77/f94 to d5/d16/d24/d3b/f97 0 2024-09-21T08:02:32.283 INFO:tasks.workunit.client.1.smithi129.stdout:4/414: link d5/d16/d47/d5f/d64/d75/l43 d5/d11/l98 0 2024-09-21T08:02:32.284 INFO:tasks.workunit.client.1.smithi129.stdout:4/415: creat d5/d16/d47/f99 x:0 0 0 2024-09-21T08:02:32.284 INFO:tasks.workunit.client.1.smithi129.stdout:4/416: readlink d5/d16/l1a 0 2024-09-21T08:02:32.285 INFO:tasks.workunit.client.1.smithi129.stdout:1/597: unlink d1/f50 0 2024-09-21T08:02:32.285 INFO:tasks.workunit.client.1.smithi129.stdout:1/598: dread - d1/d4/dc2/dc6/fb8 zero size 2024-09-21T08:02:32.285 INFO:tasks.workunit.client.1.smithi129.stdout:1/599: stat d1/d16/d25 0 2024-09-21T08:02:32.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.284+0000 7fda197fa640 1 -- 172.21.15.107:0/2337416135 <== mgr.24311 v2:172.21.15.129:6828/1054385200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fda1c101c20 con 0x7fda0806e6e0 2024-09-21T08:02:32.286 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:02:32.286 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (6m) 118s ago 7m 24.7M - 0.25.0 c8568f914cd2 2b63428d7be3 2024-09-21T08:02:32.286 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (7m) 118s ago 7m 6899k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 4557b307c7dd 2024-09-21T08:02:32.286 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (6m) 2s ago 6m 6895k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be e74e9385abdf 2024-09-21T08:02:32.286 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (6m) 118s ago 7m 86.8M - 9.4.7 954c08fa6188 8571a453fdc8 2024-09-21T08:02:32.286 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (2m) 118s ago 2m 13.9M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 3bc779f88228 2024-09-21T08:02:32.286 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (2m) 118s ago 2m 11.0M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be ea8f140aade7 2024-09-21T08:02:32.286 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (2m) 2s ago 2m 14.9M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 329346c3afec 2024-09-21T08:02:32.286 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (2m) 2s ago 2m 16.9M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be baf87f32bfbc 2024-09-21T08:02:32.286 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:9283,8765,8443 running (8m) 118s ago 8m 448M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be d8e1cda67b5b 2024-09-21T08:02:32.286 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283 running (31s) 2s ago 6m 479M - 19.1.1-367-g9e2ac70b cc9251b744a3 303933eb1c8b 2024-09-21T08:02:32.286 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (8m) 118s ago 9m 45.5M 2048M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7702e48722c8 2024-09-21T08:02:32.286 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (6m) 2s ago 6m 38.1M 2048M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be d9680c5a5b92 2024-09-21T08:02:32.286 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 running (7m) 118s ago 7m 16.0M - 1.5.0 0da6a335fe13 05e3175edba6 2024-09-21T08:02:32.287 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (6m) 2s ago 6m 16.2M - 1.5.0 0da6a335fe13 7285c04552f9 2024-09-21T08:02:32.287 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (6m) 118s ago 6m 43.9M 4287M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 6799bdf55207 2024-09-21T08:02:32.287 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (5m) 118s ago 5m 44.6M 4287M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 29d8ce3f3a52 2024-09-21T08:02:32.287 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (5m) 118s ago 5m 44.3M 4287M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be c9e1c4756c02 2024-09-21T08:02:32.287 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (4m) 2s ago 4m 143M 5312M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7d58f70b105c 2024-09-21T08:02:32.287 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (4m) 2s ago 4m 136M 5312M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 2f916ef76d22 2024-09-21T08:02:32.287 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (3m) 2s ago 3m 129M 5312M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 0f25d9454304 2024-09-21T08:02:32.287 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (6m) 118s ago 7m 58.6M - 2.43.0 a07b618ecd1d 36fd24c0b07b 2024-09-21T08:02:32.287 INFO:tasks.workunit.client.1.smithi129.stdout:7/503: sync 2024-09-21T08:02:32.289 INFO:tasks.workunit.client.1.smithi129.stdout:7/504: creat d0/d46/d6e/d9b/fa7 x:0 0 0 2024-09-21T08:02:32.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.287+0000 7fda22500640 1 -- 172.21.15.107:0/2337416135 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fda0806e6e0 msgr2=0x7fda08070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:32.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.287+0000 7fda22500640 1 --2- 172.21.15.107:0/2337416135 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fda0806e6e0 0x7fda08070b90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fda040041d0 tx=0x7fda04004330 comp rx=0 tx=0).stop 2024-09-21T08:02:32.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.287+0000 7fda22500640 1 -- 172.21.15.107:0/2337416135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda1c0fc570 msgr2=0x7fda1c071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:32.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.287+0000 7fda22500640 1 --2- 172.21.15.107:0/2337416135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda1c0fc570 0x7fda1c071570 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fda0c02d040 tx=0x7fda0c009d40 comp rx=0 tx=0).stop 2024-09-21T08:02:32.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.287+0000 7fda22500640 1 -- 172.21.15.107:0/2337416135 shutdown_connections 2024-09-21T08:02:32.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.287+0000 7fda22500640 1 --2- 172.21.15.107:0/2337416135 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fda0806e6e0 0x7fda08070b90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:32.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.287+0000 7fda22500640 1 --2- 172.21.15.107:0/2337416135 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fda1c0fd840 0x7fda1c06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:32.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.287+0000 7fda22500640 1 --2- 172.21.15.107:0/2337416135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda1c0fc570 0x7fda1c071570 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:32.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.287+0000 7fda22500640 1 -- 172.21.15.107:0/2337416135 >> 172.21.15.107:0/2337416135 conn(0x7fda1c0f7d30 msgr2=0x7fda1c0f9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:32.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.287+0000 7fda22500640 1 -- 172.21.15.107:0/2337416135 shutdown_connections 2024-09-21T08:02:32.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.287+0000 7fda22500640 1 -- 172.21.15.107:0/2337416135 wait complete. 2024-09-21T08:02:32.291 INFO:tasks.workunit.client.1.smithi129.stdout:3/518: dread d3/d69/d95/d52/f5e [0,4194304] 0 2024-09-21T08:02:32.292 INFO:tasks.workunit.client.1.smithi129.stdout:7/505: dread d0/f26 [0,4194304] 0 2024-09-21T08:02:32.292 INFO:tasks.workunit.client.1.smithi129.stdout:7/506: chown d0/d1e/f38 6 1 2024-09-21T08:02:32.293 INFO:tasks.workunit.client.1.smithi129.stdout:3/519: symlink d3/d69/d98/lae 0 2024-09-21T08:02:32.293 INFO:tasks.workunit.client.1.smithi129.stdout:3/520: truncate d3/da/dc/d25/fa5 794181 0 2024-09-21T08:02:32.294 INFO:tasks.workunit.client.1.smithi129.stdout:7/507: creat d0/d46/d8e/fa8 x:0 0 0 2024-09-21T08:02:32.294 INFO:tasks.workunit.client.1.smithi129.stdout:7/508: dread - d0/d1e/fa4 zero size 2024-09-21T08:02:32.294 INFO:tasks.workunit.client.1.smithi129.stdout:7/509: creat d0/d46/d6e/fa9 x:0 0 0 2024-09-21T08:02:32.294 INFO:tasks.workunit.client.1.smithi129.stdout:3/521: symlink d3/da/dc/d25/laf 0 2024-09-21T08:02:32.296 INFO:tasks.workunit.client.1.smithi129.stdout:3/522: symlink d3/da/dc/d11/d2f/lb0 0 2024-09-21T08:02:32.299 INFO:tasks.workunit.client.1.smithi129.stdout:4/417: dwrite d5/d11/d77/f7e [0,4194304] 0 2024-09-21T08:02:32.303 INFO:tasks.workunit.client.1.smithi129.stdout:7/510: rmdir d0/d46/d6e 39 2024-09-21T08:02:32.303 INFO:tasks.workunit.client.1.smithi129.stdout:7/511: write d0/f77 [808460,27546] 0 2024-09-21T08:02:32.304 INFO:tasks.workunit.client.1.smithi129.stdout:7/512: dread d0/d46/f61 [0,4194304] 0 2024-09-21T08:02:32.311 INFO:tasks.workunit.client.1.smithi129.stdout:4/418: dread d5/d16/f29 [0,4194304] 0 2024-09-21T08:02:32.317 INFO:tasks.workunit.client.1.smithi129.stdout:1/600: dread d1/d4/d6e/f74 [0,4194304] 0 2024-09-21T08:02:32.317 INFO:tasks.workunit.client.1.smithi129.stdout:5/519: dwrite d2/d1e/d35/f2d [0,4194304] 0 2024-09-21T08:02:32.317 INFO:tasks.workunit.client.1.smithi129.stdout:5/520: readlink d2/le 0 2024-09-21T08:02:32.317 INFO:tasks.workunit.client.1.smithi129.stdout:5/521: write d2/d2a/d6f/d71/f93 [276642,17842] 0 2024-09-21T08:02:32.317 INFO:tasks.workunit.client.1.smithi129.stdout:5/522: write d2/d1e/d35/d33/f34 [798643,17167] 0 2024-09-21T08:02:32.318 INFO:tasks.workunit.client.1.smithi129.stdout:5/523: fsync d2/d2a/d50/f53 0 2024-09-21T08:02:32.318 INFO:tasks.workunit.client.1.smithi129.stdout:5/524: creat d2/d1e/d35/d33/d36/d5a/d77/d81/fa0 x:0 0 0 2024-09-21T08:02:32.319 INFO:tasks.workunit.client.1.smithi129.stdout:5/525: dread d2/f45 [0,4194304] 0 2024-09-21T08:02:32.341 INFO:tasks.workunit.client.1.smithi129.stdout:7/513: dwrite d0/d46/f4d [0,4194304] 0 2024-09-21T08:02:32.342 INFO:tasks.workunit.client.1.smithi129.stdout:4/419: dwrite d5/f7a [0,4194304] 0 2024-09-21T08:02:32.342 INFO:tasks.workunit.client.1.smithi129.stdout:4/420: readlink d5/l5d 0 2024-09-21T08:02:32.342 INFO:tasks.workunit.client.1.smithi129.stdout:3/523: dwrite d3/da/dc/d25/f26 [0,4194304] 0 2024-09-21T08:02:32.342 INFO:tasks.workunit.client.1.smithi129.stdout:3/524: readlink d3/da/l24 0 2024-09-21T08:02:32.342 INFO:tasks.workunit.client.1.smithi129.stdout:5/526: dwrite d2/d1e/d35/d33/d36/d5a/f70 [0,4194304] 0 2024-09-21T08:02:32.342 INFO:tasks.workunit.client.1.smithi129.stdout:5/527: read d2/d1e/d35/d33/d36/f59 [1178113,32669] 0 2024-09-21T08:02:32.343 INFO:tasks.workunit.client.1.smithi129.stdout:7/514: mkdir d0/d71/daa 0 2024-09-21T08:02:32.347 INFO:tasks.workunit.client.1.smithi129.stdout:4/421: symlink d5/d16/d85/l9a 0 2024-09-21T08:02:32.350 INFO:tasks.workunit.client.1.smithi129.stdout:7/515: dread d0/d1e/f38 [0,4194304] 0 2024-09-21T08:02:32.351 INFO:tasks.workunit.client.1.smithi129.stdout:7/516: creat d0/d46/d8e/d90/fab x:0 0 0 2024-09-21T08:02:32.351 INFO:tasks.workunit.client.1.smithi129.stdout:7/517: fsync d0/d46/d6e/f5f 0 2024-09-21T08:02:32.351 INFO:tasks.workunit.client.1.smithi129.stdout:4/422: write d5/d16/f29 [213005,125541] 0 2024-09-21T08:02:32.351 INFO:tasks.workunit.client.1.smithi129.stdout:4/423: truncate d5/d33/d4e/f7b 148963 0 2024-09-21T08:02:32.353 INFO:tasks.workunit.client.1.smithi129.stdout:5/528: getdents d2/d1e/d35/d37/d65 0 2024-09-21T08:02:32.354 INFO:tasks.workunit.client.1.smithi129.stdout:3/525: dread d3/da/f2e [0,4194304] 0 2024-09-21T08:02:32.357 INFO:tasks.workunit.client.1.smithi129.stdout:0/465: sync 2024-09-21T08:02:32.357 INFO:tasks.workunit.client.1.smithi129.stdout:6/389: sync 2024-09-21T08:02:32.357 INFO:tasks.workunit.client.1.smithi129.stdout:2/701: sync 2024-09-21T08:02:32.357 INFO:tasks.workunit.client.1.smithi129.stdout:6/390: chown d7/d1b/d1e/d39/d4b/d6e 61 1 2024-09-21T08:02:32.357 INFO:tasks.workunit.client.1.smithi129.stdout:2/702: write d1/d13/d3a/d47/d5f/f86 [2544923,47943] 0 2024-09-21T08:02:32.359 INFO:tasks.workunit.client.1.smithi129.stdout:7/518: write d0/d1e/f8a [631695,87741] 0 2024-09-21T08:02:32.361 INFO:tasks.workunit.client.1.smithi129.stdout:2/703: getdents d1/dc/d19/d4c/d9d 0 2024-09-21T08:02:32.370 INFO:tasks.workunit.client.1.smithi129.stdout:5/529: write d2/d2a/d50/d61/f6e [1222360,110357] 0 2024-09-21T08:02:32.370 INFO:tasks.workunit.client.1.smithi129.stdout:5/530: write d2/d1e/d35/d33/f88 [683401,8202] 0 2024-09-21T08:02:32.370 INFO:tasks.workunit.client.1.smithi129.stdout:5/531: readlink d2/d2a/d50/l83 0 2024-09-21T08:02:32.370 INFO:tasks.workunit.client.1.smithi129.stdout:5/532: chown d2/d1e/d35/d33/f34 4 1 2024-09-21T08:02:32.370 INFO:tasks.workunit.client.1.smithi129.stdout:7/519: dread d0/f4c [0,4194304] 0 2024-09-21T08:02:32.370 INFO:tasks.workunit.client.1.smithi129.stdout:0/466: write de/d19/f66 [630438,57583] 0 2024-09-21T08:02:32.372 INFO:tasks.workunit.client.1.smithi129.stdout:0/467: read de/d15/d39/d56/f7d [351890,56826] 0 2024-09-21T08:02:32.372 INFO:tasks.workunit.client.1.smithi129.stdout:0/468: readlink de/l14 0 2024-09-21T08:02:32.373 INFO:tasks.workunit.client.1.smithi129.stdout:5/533: unlink d2/f55 0 2024-09-21T08:02:32.374 INFO:tasks.workunit.client.1.smithi129.stdout:5/534: write d2/f4e [199409,105158] 0 2024-09-21T08:02:32.374 INFO:tasks.workunit.client.1.smithi129.stdout:7/520: creat d0/d71/fac x:0 0 0 2024-09-21T08:02:32.374 INFO:tasks.workunit.client.1.smithi129.stdout:5/535: chown d2/d1e/d35/d33/d36/c52 4 1 2024-09-21T08:02:32.375 INFO:tasks.workunit.client.1.smithi129.stdout:5/536: truncate d2/d1e/d35/d33/d36/d5a/d77/d81/f94 331216 0 2024-09-21T08:02:32.375 INFO:tasks.workunit.client.1.smithi129.stdout:0/469: creat de/d15/d51/d90/f99 x:0 0 0 2024-09-21T08:02:32.376 INFO:tasks.workunit.client.1.smithi129.stdout:5/537: mkdir d2/d1e/d35/d33/da1 0 2024-09-21T08:02:32.377 INFO:tasks.workunit.client.1.smithi129.stdout:0/470: truncate de/d19/f72 1698266 0 2024-09-21T08:02:32.380 INFO:tasks.workunit.client.1.smithi129.stdout:5/538: dread d2/d1e/d35/f4d [0,4194304] 0 2024-09-21T08:02:32.391 INFO:tasks.workunit.client.1.smithi129.stdout:4/424: dwrite d5/d11/d77/f7e [0,4194304] 0 2024-09-21T08:02:32.391 INFO:tasks.workunit.client.1.smithi129.stdout:4/425: read d5/d16/d24/d3b/f4a [172514,37113] 0 2024-09-21T08:02:32.391 INFO:tasks.workunit.client.1.smithi129.stdout:4/426: readlink d5/d11/d3f/d50/l80 0 2024-09-21T08:02:32.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.390+0000 7f67c0ed9640 1 -- 172.21.15.107:0/3675485578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67bc0fd840 msgr2=0x7f67bc0fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:32.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.390+0000 7f67c0ed9640 1 --2- 172.21.15.107:0/3675485578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67bc0fd840 0x7f67bc0fdcb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f67b00048d0 tx=0x7f67b0009da0 comp rx=0 tx=0).stop 2024-09-21T08:02:32.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.391+0000 7f67c0ed9640 1 -- 172.21.15.107:0/3675485578 shutdown_connections 2024-09-21T08:02:32.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.391+0000 7f67c0ed9640 1 --2- 172.21.15.107:0/3675485578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67bc0fd840 0x7f67bc0fdcb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:32.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.391+0000 7f67c0ed9640 1 --2- 172.21.15.107:0/3675485578 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f67bc0fc570 0x7f67bc0fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:32.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.391+0000 7f67c0ed9640 1 -- 172.21.15.107:0/3675485578 >> 172.21.15.107:0/3675485578 conn(0x7f67bc0f7d30 msgr2=0x7f67bc0fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:32.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.391+0000 7f67c0ed9640 1 -- 172.21.15.107:0/3675485578 shutdown_connections 2024-09-21T08:02:32.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.391+0000 7f67c0ed9640 1 -- 172.21.15.107:0/3675485578 wait complete. 2024-09-21T08:02:32.394 INFO:tasks.workunit.client.1.smithi129.stdout:7/521: read d0/d1e/f55 [1276566,10162] 0 2024-09-21T08:02:32.394 INFO:tasks.workunit.client.1.smithi129.stdout:4/427: unlink d5/d33/d66/c79 0 2024-09-21T08:02:32.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.392+0000 7f67c0ed9640 1 Processor -- start 2024-09-21T08:02:32.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.392+0000 7f67c0ed9640 1 -- start start 2024-09-21T08:02:32.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.392+0000 7f67c0ed9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f67bc0fc570 0x7f67bc071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:32.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.392+0000 7f67c0ed9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67bc0fd840 0x7f67bc06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:32.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.392+0000 7f67c0ed9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc070030 con 0x7f67bc0fd840 2024-09-21T08:02:32.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.392+0000 7f67c0ed9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc070170 con 0x7f67bc0fc570 2024-09-21T08:02:32.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.392+0000 7f67b9d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67bc0fd840 0x7f67bc06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:32.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.392+0000 7f67b9d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67bc0fd840 0x7f67bc06fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53798/0 (socket says 172.21.15.107:53798) 2024-09-21T08:02:32.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.392+0000 7f67b9d9b640 1 -- 172.21.15.107:0/211850711 learned_addr learned my addr 172.21.15.107:0/211850711 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:02:32.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.392+0000 7f67ba59c640 1 --2- 172.21.15.107:0/211850711 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f67bc0fc570 0x7f67bc071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:32.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.393+0000 7f67ba59c640 1 -- 172.21.15.107:0/211850711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67bc0fd840 msgr2=0x7f67bc06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:32.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.393+0000 7f67ba59c640 1 --2- 172.21.15.107:0/211850711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67bc0fd840 0x7f67bc06fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:32.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.393+0000 7f67ba59c640 1 -- 172.21.15.107:0/211850711 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b0005040 con 0x7f67bc0fc570 2024-09-21T08:02:32.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.393+0000 7f67ba59c640 1 --2- 172.21.15.107:0/211850711 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f67bc0fc570 0x7f67bc071520 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f67ac009fd0 tx=0x7f67ac009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:32.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.394+0000 7f67aaffd640 1 -- 172.21.15.107:0/211850711 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67ac00f6f0 con 0x7f67bc0fc570 2024-09-21T08:02:32.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.394+0000 7f67aaffd640 1 -- 172.21.15.107:0/211850711 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f67ac00fcf0 con 0x7f67bc0fc570 2024-09-21T08:02:32.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.394+0000 7f67aaffd640 1 -- 172.21.15.107:0/211850711 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67ac011de0 con 0x7f67bc0fc570 2024-09-21T08:02:32.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.394+0000 7f67c0ed9640 1 -- 172.21.15.107:0/211850711 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67bc070450 con 0x7f67bc0fc570 2024-09-21T08:02:32.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.394+0000 7f67c0ed9640 1 -- 172.21.15.107:0/211850711 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67bc1151a0 con 0x7f67bc0fc570 2024-09-21T08:02:32.397 INFO:tasks.workunit.client.1.smithi129.stdout:4/428: dread d5/d33/d4e/f7b [0,4194304] 0 2024-09-21T08:02:32.397 INFO:tasks.workunit.client.1.smithi129.stdout:4/429: creat d5/d33/d66/f9b x:0 0 0 2024-09-21T08:02:32.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.396+0000 7f67c0ed9640 1 -- 172.21.15.107:0/211850711 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67bc0fb9d0 con 0x7f67bc0fc570 2024-09-21T08:02:32.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.397+0000 7f67aaffd640 1 -- 172.21.15.107:0/211850711 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f67ac011590 con 0x7f67bc0fc570 2024-09-21T08:02:32.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.397+0000 7f67aaffd640 1 --2- 172.21.15.107:0/211850711 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f67a406e7b0 0x7f67a4070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:32.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.398+0000 7f67aaffd640 1 -- 172.21.15.107:0/211850711 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f67ac08da00 con 0x7f67bc0fc570 2024-09-21T08:02:32.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.398+0000 7f67b9d9b640 1 --2- 172.21.15.107:0/211850711 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f67a406e7b0 0x7f67a4070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:32.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.399+0000 7f67b9d9b640 1 --2- 172.21.15.107:0/211850711 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f67a406e7b0 0x7f67a4070c60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f67b0009ac0 tx=0x7f67b0035040 comp rx=0 tx=0).ready entity=mgr.24311 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:32.402 INFO:tasks.workunit.client.1.smithi129.stdout:7/522: dread d0/d1e/f36 [4194304,4194304] 0 2024-09-21T08:02:32.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.403+0000 7f67aaffd640 1 -- 172.21.15.107:0/211850711 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f67ac0574d0 con 0x7f67bc0fc570 2024-09-21T08:02:32.405 INFO:tasks.workunit.client.1.smithi129.stdout:7/523: rmdir d0/d1e 39 2024-09-21T08:02:32.410 INFO:tasks.workunit.client.1.smithi129.stdout:2/704: dwrite d1/d13/d3a/d47/d5f/fc6 [0,4194304] 0 2024-09-21T08:02:32.411 INFO:tasks.workunit.client.1.smithi129.stdout:3/526: dwrite d3/da/d5d/f77 [0,4194304] 0 2024-09-21T08:02:32.411 INFO:tasks.workunit.client.1.smithi129.stdout:3/527: creat d3/da/dc/d11/d2f/fb1 x:0 0 0 2024-09-21T08:02:32.412 INFO:tasks.workunit.client.1.smithi129.stdout:5/539: dwrite d2/d1e/d35/d33/f34 [0,4194304] 0 2024-09-21T08:02:32.413 INFO:tasks.workunit.client.1.smithi129.stdout:0/471: dwrite de/d15/d39/f41 [0,4194304] 0 2024-09-21T08:02:32.413 INFO:tasks.workunit.client.1.smithi129.stdout:0/472: stat de/d15/d29 0 2024-09-21T08:02:32.413 INFO:tasks.workunit.client.1.smithi129.stdout:6/391: dwrite d7/d1b/d57/f80 [0,4194304] 0 2024-09-21T08:02:32.414 INFO:tasks.workunit.client.1.smithi129.stdout:2/705: mknod d1/d53/d77/d8b/cff 0 2024-09-21T08:02:32.417 INFO:tasks.workunit.client.1.smithi129.stdout:5/540: mknod d2/d1e/d35/d37/d7d/ca2 0 2024-09-21T08:02:32.421 INFO:tasks.workunit.client.1.smithi129.stdout:7/524: dwrite d0/d46/d8e/d8f/f95 [0,4194304] 0 2024-09-21T08:02:32.421 INFO:tasks.workunit.client.1.smithi129.stdout:7/525: truncate d0/d46/d6e/f85 834174 0 2024-09-21T08:02:32.421 INFO:tasks.workunit.client.1.smithi129.stdout:7/526: write d0/d1e/f21 [3653872,64901] 0 2024-09-21T08:02:32.424 INFO:tasks.workunit.client.1.smithi129.stdout:3/528: write d3/da/dc/d25/f26 [1571493,121067] 0 2024-09-21T08:02:32.424 INFO:tasks.workunit.client.1.smithi129.stdout:0/473: symlink de/d19/d5e/l9a 0 2024-09-21T08:02:32.424 INFO:tasks.workunit.client.1.smithi129.stdout:0/474: write de/d15/d51/f8b [443874,98471] 0 2024-09-21T08:02:32.424 INFO:tasks.workunit.client.1.smithi129.stdout:0/475: stat de/d22/d27/d30/f52 0 2024-09-21T08:02:32.425 INFO:tasks.workunit.client.1.smithi129.stdout:6/392: creat d7/d1b/d1e/d66/f8b x:0 0 0 2024-09-21T08:02:32.426 INFO:tasks.workunit.client.1.smithi129.stdout:2/706: symlink d1/d13/d3a/d47/d1f/l100 0 2024-09-21T08:02:32.429 INFO:tasks.workunit.client.1.smithi129.stdout:5/541: rename d2/d1e/d35/d33/l9f to d2/d2a/d6f/la3 0 2024-09-21T08:02:32.429 INFO:tasks.workunit.client.1.smithi129.stdout:5/542: dread - d2/d1e/d6b/f8c zero size 2024-09-21T08:02:32.432 INFO:tasks.workunit.client.1.smithi129.stdout:3/529: creat d3/da/dc/da3/fb2 x:0 0 0 2024-09-21T08:02:32.433 INFO:tasks.workunit.client.1.smithi129.stdout:3/530: write d3/da/dc/d7f/fa8 [492014,79225] 0 2024-09-21T08:02:32.433 INFO:tasks.workunit.client.1.smithi129.stdout:3/531: readlink d3/da/dc/d11/d2f/lb0 0 2024-09-21T08:02:32.433 INFO:tasks.workunit.client.1.smithi129.stdout:0/476: dread de/d15/f3d [0,4194304] 0 2024-09-21T08:02:32.433 INFO:tasks.workunit.client.1.smithi129.stdout:0/477: dread - de/d15/d29/f98 zero size 2024-09-21T08:02:32.435 INFO:tasks.workunit.client.1.smithi129.stdout:5/543: unlink d2/f17 0 2024-09-21T08:02:32.435 INFO:tasks.workunit.client.1.smithi129.stdout:5/544: write d2/d1e/d35/d37/f73 [247552,39651] 0 2024-09-21T08:02:32.435 INFO:tasks.workunit.client.1.smithi129.stdout:5/545: chown d2/d1e/d35/d33 1849155 1 2024-09-21T08:02:32.436 INFO:tasks.workunit.client.1.smithi129.stdout:3/532: mkdir d3/da/d5d/d94/db3 0 2024-09-21T08:02:32.436 INFO:tasks.workunit.client.1.smithi129.stdout:3/533: fdatasync d3/da/dc/da3/fb2 0 2024-09-21T08:02:32.436 INFO:tasks.workunit.client.1.smithi129.stdout:3/534: fdatasync d3/da/dc/d11/d55/d68/f87 0 2024-09-21T08:02:32.437 INFO:tasks.workunit.client.1.smithi129.stdout:0/478: creat de/d1f/f9b x:0 0 0 2024-09-21T08:02:32.438 INFO:tasks.workunit.client.1.smithi129.stdout:6/393: link d7/d1b/d25/d35/l88 d7/l8c 0 2024-09-21T08:02:32.438 INFO:tasks.workunit.client.1.smithi129.stdout:5/546: dread d2/d1e/d35/f40 [0,4194304] 0 2024-09-21T08:02:32.439 INFO:tasks.workunit.client.1.smithi129.stdout:3/535: unlink l0 0 2024-09-21T08:02:32.440 INFO:tasks.workunit.client.1.smithi129.stdout:2/707: dread d1/d13/d3a/dc1/fe1 [0,4194304] 0 2024-09-21T08:02:32.441 INFO:tasks.workunit.client.1.smithi129.stdout:0/479: unlink de/d22/d27/d2f/l4d 0 2024-09-21T08:02:32.442 INFO:tasks.workunit.client.1.smithi129.stdout:6/394: mkdir d7/d1b/d8d 0 2024-09-21T08:02:32.443 INFO:tasks.workunit.client.1.smithi129.stdout:7/527: dwrite d0/f4c [0,4194304] 0 2024-09-21T08:02:32.443 INFO:tasks.workunit.client.1.smithi129.stdout:2/708: symlink d1/d53/d77/l101 0 2024-09-21T08:02:32.443 INFO:tasks.workunit.client.1.smithi129.stdout:2/709: dread - d1/d13/d3a/d47/d1f/d85/df7/d45/d65/f9f zero size 2024-09-21T08:02:32.444 INFO:tasks.workunit.client.1.smithi129.stdout:6/395: mknod d7/d4a/c8e 0 2024-09-21T08:02:32.446 INFO:tasks.workunit.client.1.smithi129.stdout:7/528: rename d0/d71/daa to d0/d46/d6e/dad 0 2024-09-21T08:02:32.447 INFO:tasks.workunit.client.1.smithi129.stdout:3/536: read d3/da/d5d/f77 [1216172,72292] 0 2024-09-21T08:02:32.448 INFO:tasks.workunit.client.1.smithi129.stdout:2/710: creat d1/d13/f102 x:0 0 0 2024-09-21T08:02:32.449 INFO:tasks.workunit.client.1.smithi129.stdout:0/480: getdents de/d19 0 2024-09-21T08:02:32.452 INFO:tasks.workunit.client.1.smithi129.stdout:3/537: rename d3/d69/d95/d52/f82 to d3/d69/d95/d52/fb4 0 2024-09-21T08:02:32.452 INFO:tasks.workunit.client.1.smithi129.stdout:3/538: creat d3/da/dc/fb5 x:0 0 0 2024-09-21T08:02:32.452 INFO:tasks.workunit.client.1.smithi129.stdout:3/539: creat d3/da/dc/d11/d2f/fb6 x:0 0 0 2024-09-21T08:02:32.454 INFO:tasks.workunit.client.1.smithi129.stdout:2/711: rename d1/dc/f10 to d1/dc/d19/d4c/f103 0 2024-09-21T08:02:32.454 INFO:tasks.workunit.client.1.smithi129.stdout:2/712: chown d1/d13/d3a 27123 1 2024-09-21T08:02:32.454 INFO:tasks.workunit.client.1.smithi129.stdout:2/713: fdatasync d1/dc/d19/d88/fd3 0 2024-09-21T08:02:32.456 INFO:tasks.workunit.client.1.smithi129.stdout:6/396: write d7/d1b/d25/d2b/f3c [3164013,54695] 0 2024-09-21T08:02:32.456 INFO:tasks.workunit.client.1.smithi129.stdout:5/547: dwrite d2/d2a/d50/f53 [0,4194304] 0 2024-09-21T08:02:32.459 INFO:tasks.workunit.client.1.smithi129.stdout:3/540: symlink d3/da/d5d/d94/lb7 0 2024-09-21T08:02:32.461 INFO:tasks.workunit.client.1.smithi129.stdout:2/714: link d1/d53/cdc d1/d13/d3a/d47/d1f/d85/df7/d45/d65/c104 0 2024-09-21T08:02:32.465 INFO:tasks.workunit.client.1.smithi129.stdout:5/548: link d2/d1e/d35/f4d d2/d2a/d50/d61/fa4 0 2024-09-21T08:02:32.465 INFO:tasks.workunit.client.1.smithi129.stdout:6/397: symlink d7/d1b/d1e/d39/d4b/l8f 0 2024-09-21T08:02:32.468 INFO:tasks.workunit.client.1.smithi129.stdout:5/549: symlink d2/la5 0 2024-09-21T08:02:32.469 INFO:tasks.workunit.client.1.smithi129.stdout:5/550: readlink d2/d1e/d35/d37/l3c 0 2024-09-21T08:02:32.469 INFO:tasks.workunit.client.1.smithi129.stdout:5/551: write d2/d1e/f32 [2166114,77449] 0 2024-09-21T08:02:32.469 INFO:tasks.workunit.client.1.smithi129.stdout:3/541: dread d3/d69/d95/d52/fb4 [0,4194304] 0 2024-09-21T08:02:32.473 INFO:tasks.workunit.client.1.smithi129.stdout:3/542: rename d3/da/dc/f22 to d3/d57/da2/fb8 0 2024-09-21T08:02:32.473 INFO:tasks.workunit.client.1.smithi129.stdout:3/543: dread - d3/d69/d95/d52/fad zero size 2024-09-21T08:02:32.474 INFO:tasks.workunit.client.1.smithi129.stdout:3/544: mkdir d3/da/dc/d11/db9 0 2024-09-21T08:02:32.474 INFO:tasks.workunit.client.1.smithi129.stdout:3/545: stat d3/da/dc/f23 0 2024-09-21T08:02:32.476 INFO:tasks.workunit.client.1.smithi129.stdout:2/715: dread d1/d13/f41 [0,4194304] 0 2024-09-21T08:02:32.480 INFO:tasks.workunit.client.1.smithi129.stdout:7/529: dwrite d0/d46/d6e/fa9 [0,4194304] 0 2024-09-21T08:02:32.480 INFO:tasks.workunit.client.1.smithi129.stdout:7/530: rename d0/d71 to d0/d71/dae 22 2024-09-21T08:02:32.480 INFO:tasks.workunit.client.1.smithi129.stdout:0/481: dwrite de/d15/d44/d45/f62 [0,4194304] 0 2024-09-21T08:02:32.481 INFO:tasks.workunit.client.1.smithi129.stdout:0/482: readlink de/d15/d29/l32 0 2024-09-21T08:02:32.490 INFO:tasks.workunit.client.1.smithi129.stdout:7/531: symlink d0/d46/d6e/d9b/da5/laf 0 2024-09-21T08:02:32.490 INFO:tasks.workunit.client.1.smithi129.stdout:7/532: creat d0/d46/d8e/fb0 x:0 0 0 2024-09-21T08:02:32.491 INFO:tasks.workunit.client.1.smithi129.stdout:0/483: symlink de/d15/d39/d56/l9c 0 2024-09-21T08:02:32.492 INFO:tasks.workunit.client.1.smithi129.stdout:0/484: creat de/d15/d39/d56/f9d x:0 0 0 2024-09-21T08:02:32.492 INFO:tasks.workunit.client.1.smithi129.stdout:0/485: truncate de/d15/d29/f98 909861 0 2024-09-21T08:02:32.492 INFO:tasks.workunit.client.1.smithi129.stdout:0/486: write de/d15/d29/f7c [513390,104203] 0 2024-09-21T08:02:32.492 INFO:tasks.workunit.client.1.smithi129.stdout:7/533: mkdir d0/d1e/db1 0 2024-09-21T08:02:32.492 INFO:tasks.workunit.client.1.smithi129.stdout:7/534: stat d0/c3c 0 2024-09-21T08:02:32.494 INFO:tasks.workunit.client.1.smithi129.stdout:0/487: mkdir de/d15/d39/d9e 0 2024-09-21T08:02:32.494 INFO:tasks.workunit.client.1.smithi129.stdout:0/488: chown l4 2816 1 2024-09-21T08:02:32.494 INFO:tasks.workunit.client.1.smithi129.stdout:7/535: mknod d0/d46/d8e/d8f/cb2 0 2024-09-21T08:02:32.494 INFO:tasks.workunit.client.1.smithi129.stdout:7/536: write d0/d46/d8e/d90/f97 [91754,79502] 0 2024-09-21T08:02:32.494 INFO:tasks.workunit.client.1.smithi129.stdout:7/537: fsync d0/d46/f53 0 2024-09-21T08:02:32.495 INFO:tasks.workunit.client.1.smithi129.stdout:0/489: truncate de/d15/d39/f96 327054 0 2024-09-21T08:02:32.495 INFO:tasks.workunit.client.1.smithi129.stdout:0/490: dread - de/d81/f8d zero size 2024-09-21T08:02:32.495 INFO:tasks.workunit.client.1.smithi129.stdout:0/491: fsync de/d15/d51/f5d 0 2024-09-21T08:02:32.513 INFO:tasks.workunit.client.1.smithi129.stdout:9/445: sync 2024-09-21T08:02:32.513 INFO:tasks.workunit.client.1.smithi129.stdout:8/403: sync 2024-09-21T08:02:32.513 INFO:tasks.workunit.client.1.smithi129.stdout:8/404: chown d0/d6/d7/d9/f12 51681 1 2024-09-21T08:02:32.516 INFO:tasks.workunit.client.1.smithi129.stdout:9/446: write f15 [885541,81411] 0 2024-09-21T08:02:32.516 INFO:tasks.workunit.client.1.smithi129.stdout:9/447: stat d17/d2c/d31/d35/l4c 0 2024-09-21T08:02:32.519 INFO:tasks.workunit.client.1.smithi129.stdout:3/546: write d3/da/dc/d11/f4b [4098270,49676] 0 2024-09-21T08:02:32.520 INFO:tasks.workunit.client.1.smithi129.stdout:3/547: rename d3/f6a to d3/d5a/da9/fba 0 2024-09-21T08:02:32.529 INFO:tasks.workunit.client.1.smithi129.stdout:8/405: dread d0/d6/f4c [0,4194304] 0 2024-09-21T08:02:32.529 INFO:tasks.workunit.client.1.smithi129.stdout:8/406: chown d0/d6/d7/f40 11157 1 2024-09-21T08:02:32.529 INFO:tasks.workunit.client.1.smithi129.stdout:8/407: chown d0/d6/d7/d3a/l65 4 1 2024-09-21T08:02:32.529 INFO:tasks.workunit.client.1.smithi129.stdout:8/408: stat d0/d6/d7/d18/d27/d32/d37/c4f 0 2024-09-21T08:02:32.530 INFO:tasks.workunit.client.1.smithi129.stdout:3/548: write d3/da/dc/d11/d55/d68/f87 [3218133,44638] 0 2024-09-21T08:02:32.530 INFO:tasks.workunit.client.1.smithi129.stdout:3/549: dread - d3/d5a/da9/fba zero size 2024-09-21T08:02:32.530 INFO:tasks.workunit.client.1.smithi129.stdout:8/409: mkdir d0/d6/d7/d5d/d81 0 2024-09-21T08:02:32.531 INFO:tasks.workunit.client.1.smithi129.stdout:3/550: symlink d3/d69/d95/lbb 0 2024-09-21T08:02:32.531 INFO:tasks.workunit.client.1.smithi129.stdout:3/551: creat d3/d5a/fbc x:0 0 0 2024-09-21T08:02:32.531 INFO:tasks.workunit.client.1.smithi129.stdout:8/410: rename d0/d6/d7/d18/d27/l6a to d0/d6/d7/d3a/d68/l82 0 2024-09-21T08:02:32.533 INFO:tasks.workunit.client.1.smithi129.stdout:8/411: mkdir d0/d6/d7/d18/d27/d32/d3d/d83 0 2024-09-21T08:02:32.535 INFO:tasks.workunit.client.1.smithi129.stdout:8/412: rmdir d0/d6/d7/d24/d76 0 2024-09-21T08:02:32.535 INFO:tasks.workunit.client.1.smithi129.stdout:8/413: symlink d0/d6/d7/d24/l84 0 2024-09-21T08:02:32.536 INFO:tasks.workunit.client.1.smithi129.stdout:8/414: mkdir d0/d6/d7/d18/d27/d60/d85 0 2024-09-21T08:02:32.536 INFO:tasks.workunit.client.1.smithi129.stdout:8/415: readlink d0/d6/d7/l25 0 2024-09-21T08:02:32.536 INFO:tasks.workunit.client.1.smithi129.stdout:8/416: dread - d0/d6/d7/d18/d27/f38 zero size 2024-09-21T08:02:32.539 INFO:tasks.workunit.client.1.smithi129.stdout:0/492: dwrite f6 [0,4194304] 0 2024-09-21T08:02:32.539 INFO:tasks.workunit.client.1.smithi129.stdout:0/493: fsync de/d81/f8d 0 2024-09-21T08:02:32.539 INFO:tasks.workunit.client.1.smithi129.stdout:0/494: write de/d81/f8d [989779,36312] 0 2024-09-21T08:02:32.539 INFO:tasks.workunit.client.1.smithi129.stdout:0/495: truncate de/d15/d87/f89 956418 0 2024-09-21T08:02:32.541 INFO:tasks.workunit.client.1.smithi129.stdout:0/496: getdents de/d22 0 2024-09-21T08:02:32.541 INFO:tasks.workunit.client.1.smithi129.stdout:0/497: creat de/d15/d29/f9f x:0 0 0 2024-09-21T08:02:32.541 INFO:tasks.workunit.client.1.smithi129.stdout:0/498: stat de/d15/d44/d4b/f58 0 2024-09-21T08:02:32.543 INFO:tasks.workunit.client.1.smithi129.stdout:3/552: write d3/f29 [2081771,75929] 0 2024-09-21T08:02:32.544 INFO:tasks.workunit.client.1.smithi129.stdout:5/552: dwrite d2/d1e/f1f [0,4194304] 0 2024-09-21T08:02:32.544 INFO:tasks.workunit.client.1.smithi129.stdout:5/553: truncate d2/d2a/d6f/d71/f93 721267 0 2024-09-21T08:02:32.544 INFO:tasks.workunit.client.1.smithi129.stdout:9/448: dwrite d17/d2c/d31/f85 [0,4194304] 0 2024-09-21T08:02:32.545 INFO:tasks.workunit.client.1.smithi129.stdout:5/554: creat d2/d1e/d35/d33/da1/fa6 x:0 0 0 2024-09-21T08:02:32.546 INFO:tasks.workunit.client.1.smithi129.stdout:6/398: dwrite d7/d10/f16 [0,4194304] 0 2024-09-21T08:02:32.546 INFO:tasks.workunit.client.1.smithi129.stdout:8/417: dread d0/d6/f1a [0,4194304] 0 2024-09-21T08:02:32.546 INFO:tasks.workunit.client.1.smithi129.stdout:7/538: dwrite d0/f16 [0,4194304] 0 2024-09-21T08:02:32.546 INFO:tasks.workunit.client.1.smithi129.stdout:6/399: chown d7/d1b/l42 5 1 2024-09-21T08:02:32.546 INFO:tasks.workunit.client.1.smithi129.stdout:7/539: write d0/d46/fa0 [115808,125466] 0 2024-09-21T08:02:32.546 INFO:tasks.workunit.client.1.smithi129.stdout:7/540: dread - d0/d1e/f8b zero size 2024-09-21T08:02:32.547 INFO:tasks.workunit.client.1.smithi129.stdout:5/555: dread d2/d1e/d35/d33/d36/d5a/d77/d81/f94 [0,4194304] 0 2024-09-21T08:02:32.547 INFO:tasks.workunit.client.1.smithi129.stdout:5/556: fsync d2/d1e/d35/d33/d36/d5a/d77/d81/fa0 0 2024-09-21T08:02:32.554 INFO:tasks.workunit.client.1.smithi129.stdout:8/418: dread d0/d6/d7/d24/f35 [0,4194304] 0 2024-09-21T08:02:32.558 INFO:tasks.workunit.client.1.smithi129.stdout:7/541: read d0/f8 [362745,33837] 0 2024-09-21T08:02:32.558 INFO:tasks.workunit.client.1.smithi129.stdout:7/542: fsync d0/f79 0 2024-09-21T08:02:32.559 INFO:tasks.workunit.client.1.smithi129.stdout:6/400: stat d7/l11 0 2024-09-21T08:02:32.559 INFO:tasks.workunit.client.1.smithi129.stdout:5/557: mknod d2/d2a/d6f/ca7 0 2024-09-21T08:02:32.559 INFO:tasks.workunit.client.1.smithi129.stdout:6/401: chown d7/d1b/d8d 838622009 1 2024-09-21T08:02:32.560 INFO:tasks.workunit.client.1.smithi129.stdout:9/449: mknod d17/d55/d81/c99 0 2024-09-21T08:02:32.561 INFO:tasks.workunit.client.1.smithi129.stdout:8/419: mknod d0/d6/d7/d3a/d68/c86 0 2024-09-21T08:02:32.562 INFO:tasks.workunit.client.1.smithi129.stdout:7/543: mkdir d0/d46/d6e/d9b/da5/db3 0 2024-09-21T08:02:32.562 INFO:tasks.workunit.client.1.smithi129.stdout:7/544: fdatasync d0/f20 0 2024-09-21T08:02:32.563 INFO:tasks.workunit.client.1.smithi129.stdout:6/402: mknod d7/d1b/d25/d2b/c90 0 2024-09-21T08:02:32.564 INFO:tasks.workunit.client.1.smithi129.stdout:6/403: creat d7/d1b/d25/d35/f91 x:0 0 0 2024-09-21T08:02:32.564 INFO:tasks.workunit.client.1.smithi129.stdout:6/404: truncate d7/f82 950807 0 2024-09-21T08:02:32.565 INFO:tasks.workunit.client.1.smithi129.stdout:9/450: dread - d17/f83 zero size 2024-09-21T08:02:32.566 INFO:tasks.workunit.client.1.smithi129.stdout:0/499: dwrite de/d22/d27/d2f/f8e [0,4194304] 0 2024-09-21T08:02:32.566 INFO:tasks.workunit.client.1.smithi129.stdout:0/500: fsync de/d81/f8c 0 2024-09-21T08:02:32.567 INFO:tasks.workunit.client.1.smithi129.stdout:0/501: write de/d15/d39/d56/f6f [320129,109698] 0 2024-09-21T08:02:32.567 INFO:tasks.workunit.client.1.smithi129.stdout:7/545: mkdir d0/d1e/db4 0 2024-09-21T08:02:32.568 INFO:tasks.workunit.client.1.smithi129.stdout:3/553: dwrite d3/d69/d95/f91 [0,4194304] 0 2024-09-21T08:02:32.569 INFO:tasks.workunit.client.1.smithi129.stdout:9/451: write d17/f1e [8401570,124665] 0 2024-09-21T08:02:32.575 INFO:tasks.workunit.client.1.smithi129.stdout:7/546: truncate d0/d1e/f8a 2939692 0 2024-09-21T08:02:32.575 INFO:tasks.workunit.client.1.smithi129.stdout:7/547: fsync d0/f75 0 2024-09-21T08:02:32.575 INFO:tasks.workunit.client.1.smithi129.stdout:7/548: chown d0/l2f 261 1 2024-09-21T08:02:32.575 INFO:tasks.workunit.client.1.smithi129.stdout:7/549: truncate d0/d46/d8e/fa8 281776 0 2024-09-21T08:02:32.576 INFO:tasks.workunit.client.1.smithi129.stdout:6/405: mknod d7/c92 0 2024-09-21T08:02:32.576 INFO:tasks.workunit.client.1.smithi129.stdout:1/601: sync 2024-09-21T08:02:32.576 INFO:tasks.workunit.client.1.smithi129.stdout:4/430: sync 2024-09-21T08:02:32.576 INFO:tasks.workunit.client.1.smithi129.stdout:4/431: creat d5/d16/d47/d5f/d64/d75/f9c x:0 0 0 2024-09-21T08:02:32.576 INFO:tasks.workunit.client.1.smithi129.stdout:4/432: write d5/f14 [655947,124127] 0 2024-09-21T08:02:32.578 INFO:tasks.workunit.client.1.smithi129.stdout:3/554: write d3/da/f2e [2347719,79245] 0 2024-09-21T08:02:32.578 INFO:tasks.workunit.client.1.smithi129.stdout:3/555: chown d3/f13 579789 1 2024-09-21T08:02:32.580 INFO:tasks.workunit.client.1.smithi129.stdout:1/602: mkdir d1/d44/d83/dcb 0 2024-09-21T08:02:32.582 INFO:tasks.workunit.client.1.smithi129.stdout:4/433: symlink d5/l9d 0 2024-09-21T08:02:32.583 INFO:tasks.workunit.client.1.smithi129.stdout:3/556: link d3/d5a/fbc d3/da/dc/fbd 0 2024-09-21T08:02:32.586 INFO:tasks.workunit.client.1.smithi129.stdout:3/557: creat d3/da/dc/d25/fbe x:0 0 0 2024-09-21T08:02:32.588 INFO:tasks.workunit.client.1.smithi129.stdout:3/558: rename d3/da/dc/f23 to d3/da/dc/d11/d2f/fbf 0 2024-09-21T08:02:32.588 INFO:tasks.workunit.client.1.smithi129.stdout:3/559: write d3/da/dc/d25/fbe [372759,36045] 0 2024-09-21T08:02:32.591 INFO:tasks.workunit.client.1.smithi129.stdout:3/560: rmdir d3/da/dc/d11/db9 0 2024-09-21T08:02:32.591 INFO:tasks.workunit.client.1.smithi129.stdout:3/561: dread - d3/da/dc/d11/fa6 zero size 2024-09-21T08:02:32.592 INFO:tasks.workunit.client.1.smithi129.stdout:3/562: creat d3/da/dc/da3/fc0 x:0 0 0 2024-09-21T08:02:32.592 INFO:tasks.workunit.client.1.smithi129.stdout:3/563: truncate d3/da/dc/d11/fa6 972394 0 2024-09-21T08:02:32.592 INFO:tasks.workunit.client.1.smithi129.stdout:3/564: write d3/da/dc/d11/fa6 [1401202,122850] 0 2024-09-21T08:02:32.595 INFO:tasks.workunit.client.1.smithi129.stdout:3/565: dread d3/d69/d95/f86 [0,4194304] 0 2024-09-21T08:02:32.597 INFO:tasks.workunit.client.1.smithi129.stdout:1/603: dread d1/fd [0,4194304] 0 2024-09-21T08:02:32.597 INFO:tasks.workunit.client.1.smithi129.stdout:1/604: fsync d1/d16/d25/f70 0 2024-09-21T08:02:32.597 INFO:tasks.workunit.client.1.smithi129.stdout:1/605: write d1/d4/dc2/dc6/fb8 [255810,75783] 0 2024-09-21T08:02:32.597 INFO:tasks.workunit.client.1.smithi129.stdout:1/606: read d1/d9/d31/f5e [42372,83824] 0 2024-09-21T08:02:32.597 INFO:tasks.workunit.client.1.smithi129.stdout:1/607: getdents d1/d44/d83/dc5 0 2024-09-21T08:02:32.598 INFO:tasks.workunit.client.1.smithi129.stdout:1/608: mknod d1/d4/dad/db6/ccc 0 2024-09-21T08:02:32.598 INFO:tasks.workunit.client.1.smithi129.stdout:5/558: dwrite d2/d1e/d35/d33/f48 [0,4194304] 0 2024-09-21T08:02:32.598 INFO:tasks.workunit.client.1.smithi129.stdout:5/559: fsync d2/d1e/d35/d33/d36/f8a 0 2024-09-21T08:02:32.599 INFO:tasks.workunit.client.1.smithi129.stdout:1/609: creat d1/d16/fcd x:0 0 0 2024-09-21T08:02:32.600 INFO:tasks.workunit.client.1.smithi129.stdout:3/566: dread d3/da/dc/f62 [0,4194304] 0 2024-09-21T08:02:32.602 INFO:tasks.workunit.client.1.smithi129.stdout:0/502: dwrite de/d22/d27/d30/f35 [0,4194304] 0 2024-09-21T08:02:32.603 INFO:tasks.workunit.client.1.smithi129.stdout:5/560: creat d2/d1e/d35/d33/d36/d5a/fa8 x:0 0 0 2024-09-21T08:02:32.603 INFO:tasks.workunit.client.1.smithi129.stdout:9/452: dwrite d17/d2c/f43 [0,4194304] 0 2024-09-21T08:02:32.603 INFO:tasks.workunit.client.1.smithi129.stdout:9/453: chown d17/d22/d33/d36/d48/d3f/d53/f7e 5 1 2024-09-21T08:02:32.603 INFO:tasks.workunit.client.1.smithi129.stdout:8/420: dwrite d0/d6/d7/d18/d27/d32/f4a [0,4194304] 0 2024-09-21T08:02:32.603 INFO:tasks.workunit.client.1.smithi129.stdout:6/406: dwrite d7/d1b/d1e/d39/d4b/f1d [0,4194304] 0 2024-09-21T08:02:32.603 INFO:tasks.workunit.client.1.smithi129.stdout:6/407: fsync d7/f82 0 2024-09-21T08:02:32.607 INFO:tasks.workunit.client.1.smithi129.stdout:3/567: symlink d3/da/dc/d11/d55/d68/lc1 0 2024-09-21T08:02:32.607 INFO:tasks.workunit.client.1.smithi129.stdout:3/568: write d3/da/dc/d11/d55/d68/f87 [35928,40537] 0 2024-09-21T08:02:32.612 INFO:tasks.workunit.client.1.smithi129.stdout:5/561: mkdir d2/d2a/d6f/d71/da9 0 2024-09-21T08:02:32.612 INFO:tasks.workunit.client.1.smithi129.stdout:4/434: rmdir d5/d16/d47/d5f/d64/d75 39 2024-09-21T08:02:32.613 INFO:tasks.workunit.client.1.smithi129.stdout:6/408: dread d7/d10/f19 [0,4194304] 0 2024-09-21T08:02:32.613 INFO:tasks.workunit.client.1.smithi129.stdout:6/409: chown d7/d1b/d1e/d39/d4b/l8f 9122 1 2024-09-21T08:02:32.615 INFO:tasks.workunit.client.1.smithi129.stdout:4/435: dread d5/d16/d24/d3b/f4a [0,4194304] 0 2024-09-21T08:02:32.615 INFO:tasks.workunit.client.1.smithi129.stdout:4/436: creat d5/d33/f9e x:0 0 0 2024-09-21T08:02:32.619 INFO:tasks.workunit.client.1.smithi129.stdout:1/610: symlink d1/lce 0 2024-09-21T08:02:32.621 INFO:tasks.workunit.client.1.smithi129.stdout:3/569: mknod d3/d69/d95/cc2 0 2024-09-21T08:02:32.629 INFO:tasks.workunit.client.1.smithi129.stdout:6/410: mkdir d7/d1b/d25/d2b/d3e/d93 0 2024-09-21T08:02:32.629 INFO:tasks.workunit.client.1.smithi129.stdout:6/411: chown d7/d1b/d1e/d39/d4b/f1d 1 1 2024-09-21T08:02:32.631 INFO:tasks.workunit.client.1.smithi129.stdout:4/437: mknod d5/d16/d47/d5f/c9f 0 2024-09-21T08:02:32.631 INFO:tasks.workunit.client.1.smithi129.stdout:4/438: write d5/d16/d47/f99 [709029,8490] 0 2024-09-21T08:02:32.632 INFO:tasks.workunit.client.1.smithi129.stdout:1/611: rmdir d1/d4/d96 39 2024-09-21T08:02:32.632 INFO:tasks.workunit.client.1.smithi129.stdout:3/570: mkdir d3/da/d5d/d94/db3/dc3 0 2024-09-21T08:02:32.633 INFO:tasks.workunit.client.1.smithi129.stdout:0/503: rename de/d15/d51/d90 to de/d15/d44/d45/da0 0 2024-09-21T08:02:32.633 INFO:tasks.workunit.client.1.smithi129.stdout:9/454: dwrite d17/f61 [0,4194304] 0 2024-09-21T08:02:32.634 INFO:tasks.workunit.client.1.smithi129.stdout:5/562: dread d2/d1e/d35/d37/f47 [0,4194304] 0 2024-09-21T08:02:32.634 INFO:tasks.workunit.client.1.smithi129.stdout:9/455: fdatasync d17/d2c/d31/f56 0 2024-09-21T08:02:32.634 INFO:tasks.workunit.client.1.smithi129.stdout:9/456: fsync d17/d2c/d31/f85 0 2024-09-21T08:02:32.635 INFO:tasks.workunit.client.1.smithi129.stdout:9/457: write d17/d2c/d31/f91 [868067,129462] 0 2024-09-21T08:02:32.635 INFO:tasks.workunit.client.1.smithi129.stdout:1/612: chown d1/d7a/c81 154633361 1 2024-09-21T08:02:32.635 INFO:tasks.workunit.client.1.smithi129.stdout:1/613: fdatasync d1/d7a/f7c 0 2024-09-21T08:02:32.637 INFO:tasks.workunit.client.1.smithi129.stdout:8/421: rename d0/d6/d7/d18/d27/d32/d3d/f79 to d0/d6/d7/d18/d27/d32/d3d/d83/f87 0 2024-09-21T08:02:32.638 INFO:tasks.workunit.client.1.smithi129.stdout:9/458: write d17/f26 [757827,45533] 0 2024-09-21T08:02:32.639 INFO:tasks.workunit.client.1.smithi129.stdout:1/614: symlink d1/d7a/da4/lcf 0 2024-09-21T08:02:32.639 INFO:tasks.workunit.client.1.smithi129.stdout:1/615: write d1/d7a/f95 [2557461,90996] 0 2024-09-21T08:02:32.644 INFO:tasks.workunit.client.1.smithi129.stdout:9/459: symlink d17/d22/d33/d36/l9a 0 2024-09-21T08:02:32.644 INFO:tasks.workunit.client.1.smithi129.stdout:9/460: creat d17/d2c/d31/d5e/d6b/f9b x:0 0 0 2024-09-21T08:02:32.645 INFO:tasks.workunit.client.1.smithi129.stdout:3/571: dread d3/da/dc/fa7 [0,4194304] 0 2024-09-21T08:02:32.646 INFO:tasks.workunit.client.1.smithi129.stdout:1/616: creat d1/d4/dad/fd0 x:0 0 0 2024-09-21T08:02:32.653 INFO:tasks.workunit.client.1.smithi129.stdout:3/572: rename d3/da/f4c to d3/d57/fc4 0 2024-09-21T08:02:32.653 INFO:tasks.workunit.client.1.smithi129.stdout:9/461: mkdir d17/d46/d9c 0 2024-09-21T08:02:32.653 INFO:tasks.workunit.client.1.smithi129.stdout:3/573: truncate d3/da/f49 9514034 0 2024-09-21T08:02:32.654 INFO:tasks.workunit.client.1.smithi129.stdout:3/574: symlink d3/da/dc/d7f/lc5 0 2024-09-21T08:02:32.656 INFO:tasks.workunit.client.1.smithi129.stdout:9/462: creat d17/d22/d33/d7a/f9d x:0 0 0 2024-09-21T08:02:32.656 INFO:tasks.workunit.client.1.smithi129.stdout:6/412: dwrite d7/d1b/d1e/d39/f46 [0,4194304] 0 2024-09-21T08:02:32.658 INFO:tasks.workunit.client.1.smithi129.stdout:6/413: link d7/d1b/d25/d35/c55 d7/d1b/d25/d35/d40/d78/c94 0 2024-09-21T08:02:32.659 INFO:tasks.workunit.client.1.smithi129.stdout:6/414: rmdir d7/d1b/d25/d35/d40/d78 39 2024-09-21T08:02:32.672 INFO:tasks.workunit.client.1.smithi129.stdout:6/415: dread d7/d1b/d25/d35/d40/d41/f5d [0,4194304] 0 2024-09-21T08:02:32.672 INFO:tasks.workunit.client.1.smithi129.stdout:6/416: fdatasync d7/d10/f15 0 2024-09-21T08:02:32.672 INFO:tasks.workunit.client.1.smithi129.stdout:6/417: write d7/d1b/d1e/d39/d79/f85 [219448,54831] 0 2024-09-21T08:02:32.673 INFO:tasks.workunit.client.1.smithi129.stdout:6/418: mknod d7/d4a/d69/c95 0 2024-09-21T08:02:32.673 INFO:tasks.workunit.client.1.smithi129.stdout:6/419: fdatasync d7/f24 0 2024-09-21T08:02:32.673 INFO:tasks.workunit.client.1.smithi129.stdout:6/420: dread d7/d10/f16 [4194304,4194304] 0 2024-09-21T08:02:32.674 INFO:tasks.workunit.client.1.smithi129.stdout:4/439: dwrite d5/f5c [0,4194304] 0 2024-09-21T08:02:32.674 INFO:tasks.workunit.client.1.smithi129.stdout:4/440: chown d5/c15 400033 1 2024-09-21T08:02:32.674 INFO:tasks.workunit.client.1.smithi129.stdout:4/441: chown d5/d33/d66/f69 52 1 2024-09-21T08:02:32.674 INFO:tasks.workunit.client.1.smithi129.stdout:4/442: chown d5/d6/f2d 0 1 2024-09-21T08:02:32.675 INFO:tasks.workunit.client.1.smithi129.stdout:4/443: chown d5/c6f 1396 1 2024-09-21T08:02:32.676 INFO:tasks.workunit.client.1.smithi129.stdout:4/444: unlink d5/d11/d3f/d50/f60 0 2024-09-21T08:02:32.686 INFO:tasks.workunit.client.1.smithi129.stdout:3/575: dwrite d3/d69/d95/d52/f8e [0,4194304] 0 2024-09-21T08:02:32.686 INFO:tasks.workunit.client.1.smithi129.stdout:3/576: fsync d3/da/dc/f4d 0 2024-09-21T08:02:32.686 INFO:tasks.workunit.client.1.smithi129.stdout:3/577: stat d3/f29 0 2024-09-21T08:02:32.687 INFO:tasks.workunit.client.1.smithi129.stdout:1/617: dwrite d1/d9/fc7 [0,4194304] 0 2024-09-21T08:02:32.687 INFO:tasks.workunit.client.1.smithi129.stdout:1/618: chown d1/d16/d25/c3c 3 1 2024-09-21T08:02:32.687 INFO:tasks.workunit.client.1.smithi129.stdout:5/563: dwrite d2/d1e/d35/d33/d36/f8a [0,4194304] 0 2024-09-21T08:02:32.687 INFO:tasks.workunit.client.1.smithi129.stdout:8/422: dwrite d0/f3f [0,4194304] 0 2024-09-21T08:02:32.688 INFO:tasks.workunit.client.1.smithi129.stdout:9/463: dwrite d17/d2c/d31/f85 [0,4194304] 0 2024-09-21T08:02:32.688 INFO:tasks.workunit.client.1.smithi129.stdout:9/464: readlink d17/d22/d33/d36/l58 0 2024-09-21T08:02:32.688 INFO:tasks.workunit.client.1.smithi129.stdout:3/578: symlink d3/da/dc/da3/lc6 0 2024-09-21T08:02:32.690 INFO:tasks.workunit.client.1.smithi129.stdout:1/619: mkdir d1/d16/dd1 0 2024-09-21T08:02:32.695 INFO:tasks.workunit.client.1.smithi129.stdout:8/423: mknod d0/d6/d7/d18/d61/c88 0 2024-09-21T08:02:32.696 INFO:tasks.workunit.client.1.smithi129.stdout:9/465: dread - d17/f80 zero size 2024-09-21T08:02:32.698 INFO:tasks.workunit.client.1.smithi129.stdout:1/620: creat d1/d4/d6e/da9/fd2 x:0 0 0 2024-09-21T08:02:32.698 INFO:tasks.workunit.client.1.smithi129.stdout:1/621: dread - d1/d44/d83/fc8 zero size 2024-09-21T08:02:32.701 INFO:tasks.workunit.client.1.smithi129.stdout:9/466: link d17/d2c/d31/f91 d17/d22/d33/f9e 0 2024-09-21T08:02:32.702 INFO:tasks.workunit.client.1.smithi129.stdout:1/622: link d1/d44/f53 d1/d4/d6e/fd3 0 2024-09-21T08:02:32.703 INFO:tasks.workunit.client.1.smithi129.stdout:9/467: creat d17/d22/d33/f9f x:0 0 0 2024-09-21T08:02:32.704 INFO:tasks.workunit.client.1.smithi129.stdout:1/623: link d1/d9/d31/f6f d1/d16/d28/fd4 0 2024-09-21T08:02:32.705 INFO:tasks.workunit.client.1.smithi129.stdout:1/624: write d1/d4/d6e/f74 [414348,38121] 0 2024-09-21T08:02:32.706 INFO:tasks.workunit.client.1.smithi129.stdout:9/468: link d17/d22/d33/d36/d48/c98 d17/d2c/ca0 0 2024-09-21T08:02:32.707 INFO:tasks.workunit.client.1.smithi129.stdout:9/469: getdents d17/d60/d97 0 2024-09-21T08:02:32.707 INFO:tasks.workunit.client.1.smithi129.stdout:9/470: fdatasync d17/d2c/d31/d5e/d6b/f79 0 2024-09-21T08:02:32.711 INFO:tasks.workunit.client.1.smithi129.stdout:1/625: rename d1/d44/c59 to d1/d4/d6e/da9/cd5 0 2024-09-21T08:02:32.711 INFO:tasks.workunit.client.1.smithi129.stdout:1/626: link d1/d16/d28/f93 d1/d44/d83/dc5/fd6 0 2024-09-21T08:02:32.711 INFO:tasks.workunit.client.1.smithi129.stdout:3/579: dwrite d3/d69/d95/f4e [0,4194304] 0 2024-09-21T08:02:32.711 INFO:tasks.workunit.client.1.smithi129.stdout:5/564: dwrite d2/d2a/d50/d61/f6e [0,4194304] 0 2024-09-21T08:02:32.711 INFO:tasks.workunit.client.1.smithi129.stdout:3/580: chown d3/da/dc/d25/f41 32625505 1 2024-09-21T08:02:32.712 INFO:tasks.workunit.client.1.smithi129.stdout:5/565: chown d2/d1e/d35/f2d 0 1 2024-09-21T08:02:32.712 INFO:tasks.workunit.client.1.smithi129.stdout:3/581: link d3/d69/d95/lbb d3/da/d5d/lc7 0 2024-09-21T08:02:32.714 INFO:tasks.workunit.client.1.smithi129.stdout:5/566: rename d2/d1e/f1f to d2/d1e/d35/faa 0 2024-09-21T08:02:32.714 INFO:tasks.workunit.client.1.smithi129.stdout:5/567: stat d2/d2a/d6f 0 2024-09-21T08:02:32.715 INFO:tasks.workunit.client.1.smithi129.stdout:4/445: rmdir d5/d11 39 2024-09-21T08:02:32.717 INFO:tasks.workunit.client.1.smithi129.stdout:4/446: creat d5/d16/d24/fa0 x:0 0 0 2024-09-21T08:02:32.720 INFO:tasks.workunit.client.1.smithi129.stdout:4/447: rmdir d5/d48 39 2024-09-21T08:02:32.723 INFO:tasks.workunit.client.1.smithi129.stdout:4/448: rename d5/d16/d47/d5f/d64/d75 to d5/d16/d24/d4f/da1 0 2024-09-21T08:02:32.724 INFO:tasks.workunit.client.1.smithi129.stdout:1/627: dread d1/d4/dc2/dc6/f66 [0,4194304] 0 2024-09-21T08:02:32.724 INFO:tasks.workunit.client.1.smithi129.stdout:4/449: symlink d5/d6/la2 0 2024-09-21T08:02:32.724 INFO:tasks.workunit.client.1.smithi129.stdout:4/450: fsync d5/d16/d24/d4f/f72 0 2024-09-21T08:02:32.725 INFO:tasks.workunit.client.1.smithi129.stdout:4/451: chown d5/d16/l7c 37491231 1 2024-09-21T08:02:32.726 INFO:tasks.workunit.client.1.smithi129.stdout:5/568: dread d2/d2a/d50/d61/f6e [0,4194304] 0 2024-09-21T08:02:32.726 INFO:tasks.workunit.client.1.smithi129.stdout:4/452: creat d5/d16/d24/d4f/da1/fa3 x:0 0 0 2024-09-21T08:02:32.728 INFO:tasks.workunit.client.1.smithi129.stdout:1/628: symlink d1/ld7 0 2024-09-21T08:02:32.728 INFO:tasks.workunit.client.1.smithi129.stdout:1/629: write d1/d16/d28/f93 [503136,81676] 0 2024-09-21T08:02:32.728 INFO:tasks.workunit.client.1.smithi129.stdout:1/630: readlink d1/d16/d25/l3b 0 2024-09-21T08:02:32.728 INFO:tasks.workunit.client.1.smithi129.stdout:1/631: chown d1/d9/d6b/faf 2055753 1 2024-09-21T08:02:32.728 INFO:tasks.workunit.client.1.smithi129.stdout:1/632: write d1/d16/fcd [129719,110460] 0 2024-09-21T08:02:32.728 INFO:tasks.workunit.client.1.smithi129.stdout:1/633: stat d1/d7a/f95 0 2024-09-21T08:02:32.729 INFO:tasks.workunit.client.1.smithi129.stdout:1/634: truncate d1/d9/f45 1604985 0 2024-09-21T08:02:32.729 INFO:tasks.workunit.client.1.smithi129.stdout:4/453: creat d5/d11/d3f/d50/fa4 x:0 0 0 2024-09-21T08:02:32.732 INFO:tasks.workunit.client.1.smithi129.stdout:1/635: rename d1/d9/fe to d1/d4/d6e/da9/fd8 0 2024-09-21T08:02:32.732 INFO:tasks.workunit.client.1.smithi129.stdout:1/636: fdatasync d1/d9/f58 0 2024-09-21T08:02:32.733 INFO:tasks.workunit.client.1.smithi129.stdout:1/637: dread d1/d9/f58 [0,4194304] 0 2024-09-21T08:02:32.733 INFO:tasks.workunit.client.1.smithi129.stdout:1/638: chown d1/d9/c90 4858 1 2024-09-21T08:02:32.738 INFO:tasks.workunit.client.1.smithi129.stdout:9/471: dwrite d17/d23/f2d [0,4194304] 0 2024-09-21T08:02:32.738 INFO:tasks.workunit.client.1.smithi129.stdout:9/472: chown d17/d23 802 1 2024-09-21T08:02:32.738 INFO:tasks.workunit.client.1.smithi129.stdout:9/473: write d17/d22/d33/d36/d48/d3f/f57 [4748123,92823] 0 2024-09-21T08:02:32.741 INFO:tasks.workunit.client.1.smithi129.stdout:1/639: dread d1/d16/d28/f54 [0,4194304] 0 2024-09-21T08:02:32.747 INFO:tasks.workunit.client.1.smithi129.stdout:1/640: symlink d1/d44/d83/dcb/ld9 0 2024-09-21T08:02:32.747 INFO:tasks.workunit.client.1.smithi129.stdout:1/641: read d1/d4/fa [8051477,97346] 0 2024-09-21T08:02:32.749 INFO:tasks.workunit.client.1.smithi129.stdout:1/642: unlink d1/d9/c90 0 2024-09-21T08:02:32.749 INFO:tasks.workunit.client.1.smithi129.stdout:3/582: dwrite d3/da/dc/d11/f4b [0,4194304] 0 2024-09-21T08:02:32.749 INFO:tasks.workunit.client.1.smithi129.stdout:3/583: chown d3/da/dc/d11/l1f 127943 1 2024-09-21T08:02:32.749 INFO:tasks.workunit.client.1.smithi129.stdout:5/569: dwrite d2/d1e/d35/d33/d36/d5a/f70 [0,4194304] 0 2024-09-21T08:02:32.752 INFO:tasks.workunit.client.1.smithi129.stdout:1/643: mknod d1/d4/dad/cda 0 2024-09-21T08:02:32.752 INFO:tasks.workunit.client.1.smithi129.stdout:1/644: read d1/d4/dc2/dc6/fa6 [274356,1803] 0 2024-09-21T08:02:32.752 INFO:tasks.workunit.client.1.smithi129.stdout:1/645: creat d1/d16/fdb x:0 0 0 2024-09-21T08:02:32.752 INFO:tasks.workunit.client.1.smithi129.stdout:4/454: dwrite d5/d16/d47/f86 [4194304,4194304] 0 2024-09-21T08:02:32.761 INFO:tasks.workunit.client.1.smithi129.stdout:1/646: symlink d1/d16/dd1/ldc 0 2024-09-21T08:02:32.766 INFO:tasks.workunit.client.1.smithi129.stdout:1/647: truncate d1/f39 119723 0 2024-09-21T08:02:32.768 INFO:tasks.workunit.client.1.smithi129.stdout:1/648: mkdir d1/d9/d6b/ddd 0 2024-09-21T08:02:32.768 INFO:tasks.workunit.client.1.smithi129.stdout:4/455: read d5/d16/d24/d4f/da1/f73 [2901203,79261] 0 2024-09-21T08:02:32.768 INFO:tasks.workunit.client.1.smithi129.stdout:9/474: dwrite d17/f83 [0,4194304] 0 2024-09-21T08:02:32.770 INFO:tasks.workunit.client.1.smithi129.stdout:4/456: mkdir d5/da5 0 2024-09-21T08:02:32.772 INFO:tasks.workunit.client.1.smithi129.stdout:9/475: unlink d17/d55/l94 0 2024-09-21T08:02:32.773 INFO:tasks.workunit.client.1.smithi129.stdout:9/476: symlink d17/d60/d97/la1 0 2024-09-21T08:02:32.777 INFO:tasks.workunit.client.1.smithi129.stdout:5/570: dwrite d2/f24 [0,4194304] 0 2024-09-21T08:02:32.779 INFO:tasks.workunit.client.1.smithi129.stdout:5/571: getdents d2/d1e 0 2024-09-21T08:02:32.782 INFO:tasks.workunit.client.1.smithi129.stdout:9/477: dread d17/d2c/d31/d35/f54 [0,4194304] 0 2024-09-21T08:02:32.784 INFO:tasks.workunit.client.1.smithi129.stdout:1/649: write d1/d9/d31/f68 [18028,110704] 0 2024-09-21T08:02:32.784 INFO:tasks.workunit.client.1.smithi129.stdout:3/584: dwrite d3/da/dc/d7f/fa8 [0,4194304] 0 2024-09-21T08:02:32.786 INFO:tasks.workunit.client.1.smithi129.stdout:7/550: sync 2024-09-21T08:02:32.787 INFO:tasks.workunit.client.1.smithi129.stdout:1/650: link d1/d9/f6c d1/d4/dc2/dc6/d7f/fde 0 2024-09-21T08:02:32.789 INFO:tasks.workunit.client.1.smithi129.stdout:2/716: sync 2024-09-21T08:02:32.789 INFO:tasks.workunit.client.1.smithi129.stdout:2/717: fsync d1/d13/d3a/d47/d1f/f25 0 2024-09-21T08:02:32.789 INFO:tasks.workunit.client.1.smithi129.stdout:3/585: mknod d3/d69/d95/cc8 0 2024-09-21T08:02:32.789 INFO:tasks.workunit.client.1.smithi129.stdout:3/586: chown d3 3 1 2024-09-21T08:02:32.789 INFO:tasks.workunit.client.1.smithi129.stdout:0/504: sync 2024-09-21T08:02:32.790 INFO:tasks.workunit.client.1.smithi129.stdout:6/421: sync 2024-09-21T08:02:32.790 INFO:tasks.workunit.client.1.smithi129.stdout:3/587: mknod d3/da/d5d/d94/db3/dc3/cc9 0 2024-09-21T08:02:32.791 INFO:tasks.workunit.client.1.smithi129.stdout:3/588: write d3/da/dc/d11/d2f/fbf [8710030,78033] 0 2024-09-21T08:02:32.791 INFO:tasks.workunit.client.1.smithi129.stdout:3/589: write d3/d69/d95/d52/fad [165563,69060] 0 2024-09-21T08:02:32.791 INFO:tasks.workunit.client.1.smithi129.stdout:6/422: mkdir d7/d1b/d57/d96 0 2024-09-21T08:02:32.792 INFO:tasks.workunit.client.1.smithi129.stdout:2/718: dread d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d93/fae [0,4194304] 0 2024-09-21T08:02:32.792 INFO:tasks.workunit.client.1.smithi129.stdout:2/719: chown d1/d13/l54 4445 1 2024-09-21T08:02:32.794 INFO:tasks.workunit.client.1.smithi129.stdout:6/423: creat d7/d1b/d1e/d66/d7c/f97 x:0 0 0 2024-09-21T08:02:32.794 INFO:tasks.workunit.client.1.smithi129.stdout:0/505: dread de/d22/f2b [4194304,4194304] 0 2024-09-21T08:02:32.794 INFO:tasks.workunit.client.1.smithi129.stdout:0/506: chown de/f7b 135414 1 2024-09-21T08:02:32.795 INFO:tasks.workunit.client.1.smithi129.stdout:0/507: chown de/d1f/f24 22219580 1 2024-09-21T08:02:32.795 INFO:tasks.workunit.client.1.smithi129.stdout:9/478: read d17/d22/d33/d36/d48/d3f/f69 [404771,116176] 0 2024-09-21T08:02:32.796 INFO:tasks.workunit.client.1.smithi129.stdout:3/590: rename d3/f4 to d3/fca 0 2024-09-21T08:02:32.796 INFO:tasks.workunit.client.1.smithi129.stdout:3/591: truncate d3/da/dc/da3/fb2 716690 0 2024-09-21T08:02:32.796 INFO:tasks.workunit.client.1.smithi129.stdout:0/508: mknod de/d22/d27/d2f/d42/ca1 0 2024-09-21T08:02:32.799 INFO:tasks.workunit.client.1.smithi129.stdout:9/479: rename d17/d22/d33/d36/d48/d3f/f67 to d17/d46/fa2 0 2024-09-21T08:02:32.800 INFO:tasks.workunit.client.1.smithi129.stdout:9/480: creat d17/d22/d33/d36/d48/d3f/d53/fa3 x:0 0 0 2024-09-21T08:02:32.800 INFO:tasks.workunit.client.1.smithi129.stdout:0/509: mknod de/d15/d39/d7f/ca2 0 2024-09-21T08:02:32.800 INFO:tasks.workunit.client.1.smithi129.stdout:0/510: chown de/d15/d44/d4b/f58 3142358 1 2024-09-21T08:02:32.803 INFO:tasks.workunit.client.1.smithi129.stdout:0/511: symlink de/la3 0 2024-09-21T08:02:32.803 INFO:tasks.workunit.client.1.smithi129.stdout:0/512: fsync f0 0 2024-09-21T08:02:32.803 INFO:tasks.workunit.client.1.smithi129.stdout:0/513: chown de/d22/d27 2544 1 2024-09-21T08:02:32.803 INFO:tasks.workunit.client.1.smithi129.stdout:0/514: chown de/d15/f28 513 1 2024-09-21T08:02:32.804 INFO:tasks.workunit.client.1.smithi129.stdout:0/515: rmdir de/d15/d44/d45/da0 39 2024-09-21T08:02:32.805 INFO:tasks.workunit.client.1.smithi129.stdout:4/457: dwrite d5/d16/d24/d4f/da1/f8f [0,4194304] 0 2024-09-21T08:02:32.807 INFO:tasks.workunit.client.1.smithi129.stdout:0/516: unlink de/d15/d39/d56/l6b 0 2024-09-21T08:02:32.807 INFO:tasks.workunit.client.1.smithi129.stdout:0/517: chown de/d1f 30119364 1 2024-09-21T08:02:32.809 INFO:tasks.workunit.client.1.smithi129.stdout:2/720: write d1/dc/d19/d4c/d9d/fcb [1349591,3605] 0 2024-09-21T08:02:32.809 INFO:tasks.workunit.client.1.smithi129.stdout:2/721: read d1/dc/d19/d4c/d9d/fcb [3362362,79279] 0 2024-09-21T08:02:32.810 INFO:tasks.workunit.client.1.smithi129.stdout:4/458: mknod d5/d33/d6d/ca6 0 2024-09-21T08:02:32.810 INFO:tasks.workunit.client.1.smithi129.stdout:6/424: dread d7/f9 [0,4194304] 0 2024-09-21T08:02:32.812 INFO:tasks.workunit.client.1.smithi129.stdout:2/722: getdents d1/d53/d77 0 2024-09-21T08:02:32.812 INFO:tasks.workunit.client.1.smithi129.stdout:2/723: creat d1/d53/d77/d8b/f105 x:0 0 0 2024-09-21T08:02:32.812 INFO:tasks.workunit.client.1.smithi129.stdout:2/724: chown d1/d13/d3a/d47/d1f/d85/df7/f33 117572771 1 2024-09-21T08:02:32.813 INFO:tasks.workunit.client.1.smithi129.stdout:2/725: rmdir d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d99 39 2024-09-21T08:02:32.814 INFO:tasks.workunit.client.1.smithi129.stdout:5/572: dwrite d2/d1e/d35/f40 [0,4194304] 0 2024-09-21T08:02:32.815 INFO:tasks.workunit.client.1.smithi129.stdout:2/726: creat d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d99/f106 x:0 0 0 2024-09-21T08:02:32.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.814+0000 7f67c0ed9640 1 -- 172.21.15.107:0/211850711 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f67bc105010 con 0x7f67bc0fc570 2024-09-21T08:02:32.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.815+0000 7f67aaffd640 1 -- 172.21.15.107:0/211850711 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7f67ac05ab90 con 0x7f67bc0fc570 2024-09-21T08:02:32.816 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:02:32.816 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": { 2024-09-21T08:02:32.816 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 2 2024-09-21T08:02:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:02:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": { 2024-09-21T08:02:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 1, 2024-09-21T08:02:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 1 2024-09-21T08:02:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:02:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": { 2024-09-21T08:02:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 6 2024-09-21T08:02:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:02:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-21T08:02:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 4 2024-09-21T08:02:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:02:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: "overall": { 2024-09-21T08:02:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 13, 2024-09-21T08:02:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 1 2024-09-21T08:02:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-21T08:02:32.818 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:02:32.818 INFO:tasks.workunit.client.1.smithi129.stdout:5/573: symlink d2/d1e/d35/d33/d36/d5a/lab 0 2024-09-21T08:02:32.818 INFO:tasks.workunit.client.1.smithi129.stdout:5/574: chown d2/c20 0 1 2024-09-21T08:02:32.819 INFO:tasks.workunit.client.1.smithi129.stdout:2/727: rmdir d1/d13/d3a/dc1 39 2024-09-21T08:02:32.819 INFO:tasks.workunit.client.1.smithi129.stdout:2/728: chown d1/dc/d19/d4c/d6a/l56 432264 1 2024-09-21T08:02:32.820 INFO:tasks.workunit.client.1.smithi129.stdout:9/481: dread d17/d22/d33/f7f [0,4194304] 0 2024-09-21T08:02:32.820 INFO:tasks.workunit.client.1.smithi129.stdout:9/482: write d17/d46/f4b [5239460,1074] 0 2024-09-21T08:02:32.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.819+0000 7f67c0ed9640 1 -- 172.21.15.107:0/211850711 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f67a406e7b0 msgr2=0x7f67a4070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:32.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.819+0000 7f67c0ed9640 1 --2- 172.21.15.107:0/211850711 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f67a406e7b0 0x7f67a4070c60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f67b0009ac0 tx=0x7f67b0035040 comp rx=0 tx=0).stop 2024-09-21T08:02:32.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.819+0000 7f67c0ed9640 1 -- 172.21.15.107:0/211850711 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f67bc0fc570 msgr2=0x7f67bc071520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:32.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.819+0000 7f67c0ed9640 1 --2- 172.21.15.107:0/211850711 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f67bc0fc570 0x7f67bc071520 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f67ac009fd0 tx=0x7f67ac009060 comp rx=0 tx=0).stop 2024-09-21T08:02:32.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.819+0000 7f67c0ed9640 1 -- 172.21.15.107:0/211850711 shutdown_connections 2024-09-21T08:02:32.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.819+0000 7f67c0ed9640 1 --2- 172.21.15.107:0/211850711 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f67a406e7b0 0x7f67a4070c60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:32.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.819+0000 7f67c0ed9640 1 --2- 172.21.15.107:0/211850711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67bc0fd840 0x7f67bc06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:32.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.819+0000 7f67c0ed9640 1 --2- 172.21.15.107:0/211850711 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f67bc0fc570 0x7f67bc071520 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:32.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.819+0000 7f67c0ed9640 1 -- 172.21.15.107:0/211850711 >> 172.21.15.107:0/211850711 conn(0x7f67bc0f7d30 msgr2=0x7f67bc0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:32.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.819+0000 7f67c0ed9640 1 -- 172.21.15.107:0/211850711 shutdown_connections 2024-09-21T08:02:32.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.819+0000 7f67c0ed9640 1 -- 172.21.15.107:0/211850711 wait complete. 2024-09-21T08:02:32.822 INFO:tasks.workunit.client.1.smithi129.stdout:9/483: mkdir d17/d22/d33/d36/d48/d3f/d71/da4 0 2024-09-21T08:02:32.823 INFO:tasks.workunit.client.1.smithi129.stdout:6/425: dread d7/f9 [0,4194304] 0 2024-09-21T08:02:32.823 INFO:tasks.workunit.client.1.smithi129.stdout:7/551: dwrite d0/f4c [0,4194304] 0 2024-09-21T08:02:32.824 INFO:tasks.workunit.client.1.smithi129.stdout:4/459: dwrite d5/d11/d77/f7e [0,4194304] 0 2024-09-21T08:02:32.826 INFO:tasks.workunit.client.1.smithi129.stdout:4/460: mkdir d5/d33/d4e/da7 0 2024-09-21T08:02:32.826 INFO:tasks.workunit.client.1.smithi129.stdout:4/461: write d5/d33/d66/f9b [259038,117381] 0 2024-09-21T08:02:32.828 INFO:tasks.workunit.client.1.smithi129.stdout:4/462: mkdir d5/d11/d77/da8 0 2024-09-21T08:02:32.829 INFO:tasks.workunit.client.1.smithi129.stdout:8/424: sync 2024-09-21T08:02:32.833 INFO:tasks.workunit.client.1.smithi129.stdout:3/592: dwrite d3/da/f78 [0,4194304] 0 2024-09-21T08:02:32.835 INFO:tasks.workunit.client.1.smithi129.stdout:6/426: dread d7/fe [0,4194304] 0 2024-09-21T08:02:32.835 INFO:tasks.workunit.client.1.smithi129.stdout:6/427: fsync d7/d1b/d25/d35/f91 0 2024-09-21T08:02:32.837 INFO:tasks.workunit.client.1.smithi129.stdout:3/593: symlink d3/d69/lcb 0 2024-09-21T08:02:32.840 INFO:tasks.workunit.client.1.smithi129.stdout:6/428: creat d7/d1b/d25/d2b/d3e/d93/f98 x:0 0 0 2024-09-21T08:02:32.840 INFO:tasks.workunit.client.1.smithi129.stdout:6/429: fdatasync d7/fa 0 2024-09-21T08:02:32.841 INFO:tasks.workunit.client.1.smithi129.stdout:3/594: symlink d3/d90/lcc 0 2024-09-21T08:02:32.843 INFO:tasks.workunit.client.1.smithi129.stdout:3/595: symlink d3/d90/lcd 0 2024-09-21T08:02:32.845 INFO:tasks.workunit.client.1.smithi129.stdout:3/596: rename d3/d5a/c7b to d3/da/dc/d7f/cce 0 2024-09-21T08:02:32.845 INFO:tasks.workunit.client.1.smithi129.stdout:3/597: creat d3/da/dc/d11/d2f/fcf x:0 0 0 2024-09-21T08:02:32.845 INFO:tasks.workunit.client.1.smithi129.stdout:3/598: readlink d3/l8f 0 2024-09-21T08:02:32.848 INFO:tasks.workunit.client.1.smithi129.stdout:3/599: link d3/da/dc/da3/fb2 d3/da/dc/d7f/fd0 0 2024-09-21T08:02:32.848 INFO:tasks.workunit.client.1.smithi129.stdout:3/600: creat d3/da/dc/da3/fd1 x:0 0 0 2024-09-21T08:02:32.856 INFO:tasks.workunit.client.1.smithi129.stdout:6/430: write d7/d1b/d1e/d39/f46 [2765315,87353] 0 2024-09-21T08:02:32.856 INFO:tasks.workunit.client.1.smithi129.stdout:6/431: truncate d7/d1b/d1e/d39/d4b/d6e/f73 288546 0 2024-09-21T08:02:32.863 INFO:tasks.workunit.client.1.smithi129.stdout:7/552: dwrite d0/f79 [0,4194304] 0 2024-09-21T08:02:32.863 INFO:tasks.workunit.client.1.smithi129.stdout:8/425: dwrite d0/d6/d7/d18/d27/f38 [0,4194304] 0 2024-09-21T08:02:32.864 INFO:tasks.workunit.client.1.smithi129.stdout:9/484: dwrite f13 [0,4194304] 0 2024-09-21T08:02:32.864 INFO:tasks.workunit.client.1.smithi129.stdout:7/553: write d0/d1e/f38 [2816865,64646] 0 2024-09-21T08:02:32.867 INFO:tasks.workunit.client.1.smithi129.stdout:5/575: dwrite d2/d1e/d35/f31 [0,4194304] 0 2024-09-21T08:02:32.867 INFO:tasks.workunit.client.1.smithi129.stdout:2/729: dwrite d1/dc/ff9 [0,4194304] 0 2024-09-21T08:02:32.871 INFO:tasks.workunit.client.1.smithi129.stdout:5/576: dread d2/d1e/d35/d33/f69 [0,4194304] 0 2024-09-21T08:02:32.872 INFO:tasks.workunit.client.1.smithi129.stdout:9/485: mkdir d17/d22/d33/da5 0 2024-09-21T08:02:32.872 INFO:tasks.workunit.client.1.smithi129.stdout:9/486: readlink l7 0 2024-09-21T08:02:32.872 INFO:tasks.workunit.client.1.smithi129.stdout:9/487: write d17/f80 [53488,59829] 0 2024-09-21T08:02:32.872 INFO:tasks.workunit.client.1.smithi129.stdout:9/488: fdatasync d17/d46/f4b 0 2024-09-21T08:02:32.872 INFO:tasks.workunit.client.1.smithi129.stdout:9/489: write d17/d46/f5f [743781,15307] 0 2024-09-21T08:02:32.872 INFO:tasks.workunit.client.1.smithi129.stdout:9/490: read d17/f1e [3434970,87818] 0 2024-09-21T08:02:32.885 INFO:tasks.workunit.client.1.smithi129.stdout:9/491: dread d17/f80 [0,4194304] 0 2024-09-21T08:02:32.885 INFO:tasks.workunit.client.1.smithi129.stdout:9/492: chown d17/d23/c25 28 1 2024-09-21T08:02:32.885 INFO:tasks.workunit.client.1.smithi129.stdout:9/493: fdatasync d17/d2c/d31/f5a 0 2024-09-21T08:02:32.894 INFO:tasks.workunit.client.1.smithi129.stdout:6/432: dwrite f4 [0,4194304] 0 2024-09-21T08:02:32.895 INFO:tasks.workunit.client.1.smithi129.stdout:6/433: getdents d7/d4a/d69/d89 0 2024-09-21T08:02:32.896 INFO:tasks.workunit.client.1.smithi129.stdout:5/577: symlink d2/d1e/d35/d33/da1/lac 0 2024-09-21T08:02:32.897 INFO:tasks.workunit.client.1.smithi129.stdout:3/601: fsync d3/da/dc/da3/fd1 0 2024-09-21T08:02:32.899 INFO:tasks.workunit.client.1.smithi129.stdout:6/434: creat d7/d1b/d1e/f99 x:0 0 0 2024-09-21T08:02:32.902 INFO:tasks.workunit.client.1.smithi129.stdout:3/602: dread d3/d69/d95/d52/fad [0,4194304] 0 2024-09-21T08:02:32.902 INFO:tasks.workunit.client.1.smithi129.stdout:9/494: write d17/d2c/d31/f85 [3750662,3898] 0 2024-09-21T08:02:32.902 INFO:tasks.workunit.client.1.smithi129.stdout:9/495: truncate d17/d22/f30 2190937 0 2024-09-21T08:02:32.902 INFO:tasks.workunit.client.1.smithi129.stdout:9/496: chown d17/d2c/d31/l4d 413210 1 2024-09-21T08:02:32.903 INFO:tasks.workunit.client.1.smithi129.stdout:3/603: mknod d3/da/cd2 0 2024-09-21T08:02:32.904 INFO:tasks.workunit.client.1.smithi129.stdout:3/604: creat d3/d90/fd3 x:0 0 0 2024-09-21T08:02:32.905 INFO:tasks.workunit.client.1.smithi129.stdout:6/435: dread d7/f8 [0,4194304] 0 2024-09-21T08:02:32.905 INFO:tasks.workunit.client.1.smithi129.stdout:5/578: dread d2/d1e/d35/ff [0,4194304] 0 2024-09-21T08:02:32.906 INFO:tasks.workunit.client.1.smithi129.stdout:5/579: creat d2/d2a/d50/d61/fad x:0 0 0 2024-09-21T08:02:32.909 INFO:tasks.workunit.client.1.smithi129.stdout:8/426: dwrite d0/f16 [4194304,4194304] 0 2024-09-21T08:02:32.914 INFO:tasks.workunit.client.1.smithi129.stdout:7/554: dwrite d0/d46/d8e/fa8 [0,4194304] 0 2024-09-21T08:02:32.917 INFO:tasks.workunit.client.1.smithi129.stdout:5/580: dread d2/d1e/d35/d33/d36/d5a/f5c [0,4194304] 0 2024-09-21T08:02:32.917 INFO:tasks.workunit.client.1.smithi129.stdout:3/605: read d3/d57/fc4 [1833468,22966] 0 2024-09-21T08:02:32.926 INFO:tasks.workunit.client.1.smithi129.stdout:3/606: mknod d3/da/cd4 0 2024-09-21T08:02:32.926 INFO:tasks.workunit.client.1.smithi129.stdout:3/607: dread - d3/da/dc/d11/d2f/fcf zero size 2024-09-21T08:02:32.927 INFO:tasks.workunit.client.1.smithi129.stdout:3/608: mknod d3/da/dc/d11/d2f/cd5 0 2024-09-21T08:02:32.927 INFO:tasks.workunit.client.1.smithi129.stdout:3/609: chown d3/da/dc/da3/fc0 304427 1 2024-09-21T08:02:32.928 INFO:tasks.workunit.client.1.smithi129.stdout:3/610: mkdir d3/da/dc/d7f/dd6 0 2024-09-21T08:02:32.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.931+0000 7ff5c228d640 1 -- 172.21.15.107:0/167679709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5bc0ff6e0 msgr2=0x7ff5bc101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:32.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.931+0000 7ff5c228d640 1 --2- 172.21.15.107:0/167679709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5bc0ff6e0 0x7ff5bc101ac0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff5b00048d0 tx=0x7ff5b0009da0 comp rx=0 tx=0).stop 2024-09-21T08:02:32.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.931+0000 7ff5c228d640 1 -- 172.21.15.107:0/167679709 shutdown_connections 2024-09-21T08:02:32.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.931+0000 7ff5c228d640 1 --2- 172.21.15.107:0/167679709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5bc0ff6e0 0x7ff5bc101ac0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:32.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.931+0000 7ff5c228d640 1 --2- 172.21.15.107:0/167679709 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5bc065be0 0x7ff5bc0ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:32.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.931+0000 7ff5c228d640 1 -- 172.21.15.107:0/167679709 >> 172.21.15.107:0/167679709 conn(0x7ff5bc0f6c10 msgr2=0x7ff5bc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:32.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.931+0000 7ff5c228d640 1 -- 172.21.15.107:0/167679709 shutdown_connections 2024-09-21T08:02:32.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.931+0000 7ff5c228d640 1 -- 172.21.15.107:0/167679709 wait complete. 2024-09-21T08:02:32.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.932+0000 7ff5c228d640 1 Processor -- start 2024-09-21T08:02:32.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.932+0000 7ff5c228d640 1 -- start start 2024-09-21T08:02:32.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.932+0000 7ff5c228d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5bc065be0 0x7ff5bc0fcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:32.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.932+0000 7ff5c228d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5bc0ff6e0 0x7ff5bc0fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:32.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.932+0000 7ff5c228d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc0fb5e0 con 0x7ff5bc0ff6e0 2024-09-21T08:02:32.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.932+0000 7ff5c228d640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc0fb750 con 0x7ff5bc065be0 2024-09-21T08:02:32.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.932+0000 7ff5bb7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5bc0ff6e0 0x7ff5bc0fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:32.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.932+0000 7ff5bb7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5bc0ff6e0 0x7ff5bc0fb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53820/0 (socket says 172.21.15.107:53820) 2024-09-21T08:02:32.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.932+0000 7ff5bb7fe640 1 -- 172.21.15.107:0/23369953 learned_addr learned my addr 172.21.15.107:0/23369953 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:02:32.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.933+0000 7ff5bb7fe640 1 -- 172.21.15.107:0/23369953 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5bc065be0 msgr2=0x7ff5bc0fcaf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T08:02:32.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.933+0000 7ff5bb7fe640 1 --2- 172.21.15.107:0/23369953 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5bc065be0 0x7ff5bc0fcaf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:32.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.933+0000 7ff5bb7fe640 1 -- 172.21.15.107:0/23369953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b0005040 con 0x7ff5bc0ff6e0 2024-09-21T08:02:32.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.933+0000 7ff5bb7fe640 1 --2- 172.21.15.107:0/23369953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5bc0ff6e0 0x7ff5bc0fb0a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0009ac0 tx=0x7ff5b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:32.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.933+0000 7ff5b8ff9640 1 -- 172.21.15.107:0/23369953 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5b0038070 con 0x7ff5bc0ff6e0 2024-09-21T08:02:32.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.933+0000 7ff5c228d640 1 -- 172.21.15.107:0/23369953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5bc0fb9d0 con 0x7ff5bc0ff6e0 2024-09-21T08:02:32.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.933+0000 7ff5b8ff9640 1 -- 172.21.15.107:0/23369953 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff5b0032d30 con 0x7ff5bc0ff6e0 2024-09-21T08:02:32.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.933+0000 7ff5b8ff9640 1 -- 172.21.15.107:0/23369953 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5b003db50 con 0x7ff5bc0ff6e0 2024-09-21T08:02:32.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.934+0000 7ff5c228d640 1 -- 172.21.15.107:0/23369953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5bc0fbf10 con 0x7ff5bc0ff6e0 2024-09-21T08:02:32.937 INFO:tasks.workunit.client.1.smithi129.stdout:5/581: dread d2/d1e/d35/d33/d36/f8a [0,4194304] 0 2024-09-21T08:02:32.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.935+0000 7ff5c228d640 1 -- 172.21.15.107:0/23369953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5bc0fa890 con 0x7ff5bc0ff6e0 2024-09-21T08:02:32.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.936+0000 7ff5b8ff9640 1 -- 172.21.15.107:0/23369953 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7ff5b0030020 con 0x7ff5bc0ff6e0 2024-09-21T08:02:32.938 INFO:tasks.workunit.client.1.smithi129.stdout:5/582: symlink d2/d2a/d6f/d71/lae 0 2024-09-21T08:02:32.938 INFO:tasks.workunit.client.1.smithi129.stdout:7/555: dwrite d0/d46/d6e/f85 [0,4194304] 0 2024-09-21T08:02:32.938 INFO:tasks.workunit.client.1.smithi129.stdout:6/436: dwrite d7/d1b/d1e/d39/d4b/f4d [0,4194304] 0 2024-09-21T08:02:32.938 INFO:tasks.workunit.client.1.smithi129.stdout:8/427: dwrite d0/d6/f1a [0,4194304] 0 2024-09-21T08:02:32.938 INFO:tasks.workunit.client.1.smithi129.stdout:8/428: creat d0/d6/d7/d18/d27/d32/d37/f89 x:0 0 0 2024-09-21T08:02:32.939 INFO:tasks.workunit.client.1.smithi129.stdout:5/583: symlink d2/d1e/d35/d33/laf 0 2024-09-21T08:02:32.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.936+0000 7ff5b8ff9640 1 --2- 172.21.15.107:0/23369953 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7ff5a406e730 0x7ff5a4070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:32.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.937+0000 7ff5b8ff9640 1 -- 172.21.15.107:0/23369953 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ff5b00ae8b0 con 0x7ff5bc0ff6e0 2024-09-21T08:02:32.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.937+0000 7ff5bbfff640 1 --2- 172.21.15.107:0/23369953 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7ff5a406e730 0x7ff5a4070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:32.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.937+0000 7ff5bbfff640 1 --2- 172.21.15.107:0/23369953 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7ff5a406e730 0x7ff5a4070be0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0041d0 tx=0x7ff5ac004160 comp rx=0 tx=0).ready entity=mgr.24311 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:32.941 INFO:tasks.workunit.client.1.smithi129.stdout:7/556: mkdir d0/d1e/d9a/db5 0 2024-09-21T08:02:32.942 INFO:tasks.workunit.client.1.smithi129.stdout:6/437: creat d7/f9a x:0 0 0 2024-09-21T08:02:32.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:32.944+0000 7ff5b8ff9640 1 -- 172.21.15.107:0/23369953 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7ff5b00781c0 con 0x7ff5bc0ff6e0 2024-09-21T08:02:32.947 INFO:tasks.workunit.client.1.smithi129.stdout:7/557: rename d0/d46/d6e/f7e to d0/d46/d8e/d90/fb6 0 2024-09-21T08:02:32.947 INFO:tasks.workunit.client.1.smithi129.stdout:7/558: readlink d0/l35 0 2024-09-21T08:02:32.947 INFO:tasks.workunit.client.1.smithi129.stdout:8/429: rmdir d0/d6/d7/d5a 39 2024-09-21T08:02:32.949 INFO:tasks.workunit.client.1.smithi129.stdout:8/430: creat d0/d6/d7/d5a/f8a x:0 0 0 2024-09-21T08:02:32.949 INFO:tasks.workunit.client.1.smithi129.stdout:3/611: dwrite d3/da/f49 [4194304,4194304] 0 2024-09-21T08:02:32.949 INFO:tasks.workunit.client.1.smithi129.stdout:3/612: fdatasync d3/faa 0 2024-09-21T08:02:32.949 INFO:tasks.workunit.client.1.smithi129.stdout:3/613: fdatasync d3/f63 0 2024-09-21T08:02:32.953 INFO:tasks.workunit.client.1.smithi129.stdout:5/584: write d2/d1e/d35/f31 [1964396,90762] 0 2024-09-21T08:02:32.953 INFO:tasks.workunit.client.1.smithi129.stdout:5/585: chown d2/f1b 34 1 2024-09-21T08:02:32.953 INFO:tasks.workunit.client.1.smithi129.stdout:3/614: creat d3/d69/d98/fd7 x:0 0 0 2024-09-21T08:02:32.953 INFO:tasks.workunit.client.1.smithi129.stdout:3/615: truncate d3/d5a/fbc 383381 0 2024-09-21T08:02:32.964 INFO:tasks.workunit.client.1.smithi129.stdout:8/431: rmdir d0/d6/d7 39 2024-09-21T08:02:32.972 INFO:tasks.workunit.client.1.smithi129.stdout:6/438: dwrite d7/d1b/f49 [4194304,4194304] 0 2024-09-21T08:02:32.973 INFO:tasks.workunit.client.1.smithi129.stdout:6/439: rmdir d7/d10 39 2024-09-21T08:02:32.973 INFO:tasks.workunit.client.1.smithi129.stdout:6/440: readlink d7/d1b/d25/d35/d40/l47 0 2024-09-21T08:02:32.973 INFO:tasks.workunit.client.1.smithi129.stdout:6/441: chown d7/d1b/d57/l5c 76 1 2024-09-21T08:02:32.973 INFO:tasks.workunit.client.1.smithi129.stdout:6/442: fsync d7/d1b/d1e/d66/d7c/f97 0 2024-09-21T08:02:32.974 INFO:tasks.workunit.client.1.smithi129.stdout:6/443: mknod d7/d1b/d1e/d39/d4b/d6e/c9b 0 2024-09-21T08:02:32.974 INFO:tasks.workunit.client.1.smithi129.stdout:6/444: readlink d7/d1b/d25/d35/d40/d41/l74 0 2024-09-21T08:02:32.974 INFO:tasks.workunit.client.1.smithi129.stdout:6/445: chown d7/d1b/d1e/d39/f5f 0 1 2024-09-21T08:02:32.978 INFO:tasks.workunit.client.1.smithi129.stdout:7/559: dwrite d0/d46/d8e/d8f/f95 [0,4194304] 0 2024-09-21T08:02:32.978 INFO:tasks.workunit.client.1.smithi129.stdout:3/616: dwrite d3/fca [4194304,4194304] 0 2024-09-21T08:02:32.978 INFO:tasks.workunit.client.1.smithi129.stdout:5/586: dwrite d2/d2a/d50/f4f [0,4194304] 0 2024-09-21T08:02:32.979 INFO:tasks.workunit.client.1.smithi129.stdout:5/587: creat d2/d2a/fb0 x:0 0 0 2024-09-21T08:02:32.979 INFO:tasks.workunit.client.1.smithi129.stdout:7/560: rmdir d0/d1e/d9a 39 2024-09-21T08:02:32.983 INFO:tasks.workunit.client.1.smithi129.stdout:7/561: mkdir d0/d46/d6e/d9b/da5/db7 0 2024-09-21T08:02:32.985 INFO:tasks.workunit.client.1.smithi129.stdout:5/588: rename d2/d2a/d6f to d2/d2a/d50/db1 0 2024-09-21T08:02:32.986 INFO:tasks.workunit.client.1.smithi129.stdout:7/562: mknod d0/d71/cb8 0 2024-09-21T08:02:32.987 INFO:tasks.workunit.client.1.smithi129.stdout:7/563: creat d0/d46/d6e/dad/fb9 x:0 0 0 2024-09-21T08:02:32.989 INFO:tasks.workunit.client.1.smithi129.stdout:7/564: mkdir d0/d1e/db1/dba 0 2024-09-21T08:02:32.989 INFO:tasks.workunit.client.1.smithi129.stdout:7/565: fdatasync d0/d46/d8e/d90/f92 0 2024-09-21T08:02:32.994 INFO:tasks.workunit.client.1.smithi129.stdout:3/617: dwrite d3/f13 [0,4194304] 0 2024-09-21T08:02:32.997 INFO:tasks.workunit.client.1.smithi129.stdout:3/618: rename d3/da/dc/d11/f4b to d3/d57/d80/fd8 0 2024-09-21T08:02:32.998 INFO:tasks.workunit.client.1.smithi129.stdout:3/619: creat d3/d69/d95/fd9 x:0 0 0 2024-09-21T08:02:32.999 INFO:tasks.workunit.client.1.smithi129.stdout:3/620: creat d3/da/dc/d11/fda x:0 0 0 2024-09-21T08:02:32.999 INFO:tasks.workunit.client.1.smithi129.stdout:7/566: dread d0/d1e/f8a [0,4194304] 0 2024-09-21T08:02:33.002 INFO:tasks.workunit.client.1.smithi129.stdout:7/567: dread d0/d46/d8e/d90/fb6 [0,4194304] 0 2024-09-21T08:02:33.004 INFO:tasks.workunit.client.1.smithi129.stdout:3/621: mkdir d3/da/d5d/d94/db3/dc3/ddb 0 2024-09-21T08:02:33.007 INFO:tasks.workunit.client.1.smithi129.stdout:7/568: rename d0/d46/d8e/d8f/f95 to d0/d46/d6e/d9b/da5/db3/fbb 0 2024-09-21T08:02:33.009 INFO:tasks.workunit.client.1.smithi129.stdout:3/622: mknod d3/d57/d80/cdc 0 2024-09-21T08:02:33.009 INFO:tasks.workunit.client.1.smithi129.stdout:3/623: fdatasync d3/da/dc/d11/d55/d68/f6f 0 2024-09-21T08:02:33.009 INFO:tasks.workunit.client.1.smithi129.stdout:3/624: write d3/d5a/da9/fba [211061,97921] 0 2024-09-21T08:02:33.009 INFO:tasks.workunit.client.1.smithi129.stdout:3/625: readlink d3/da/dc/d11/l7e 0 2024-09-21T08:02:33.009 INFO:tasks.workunit.client.1.smithi129.stdout:7/569: dread d0/d46/d8e/d90/f97 [0,4194304] 0 2024-09-21T08:02:33.009 INFO:tasks.workunit.client.1.smithi129.stdout:3/626: symlink d3/da/dc/d7f/dd6/ldd 0 2024-09-21T08:02:33.010 INFO:tasks.workunit.client.1.smithi129.stdout:7/570: mkdir d0/d46/d6e/d9b/da5/dbc 0 2024-09-21T08:02:33.013 INFO:tasks.workunit.client.1.smithi129.stdout:3/627: rmdir d3/da/d5d/d94/db3/dc3/ddb 0 2024-09-21T08:02:33.013 INFO:tasks.workunit.client.1.smithi129.stdout:3/628: readlink d3/d69/l6b 0 2024-09-21T08:02:33.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:32 smithi129 ceph-mon[34472]: pgmap v8: 65 pgs: 65 active+clean; 613 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 57 MiB/s rd, 65 MiB/s wr, 123 op/s 2024-09-21T08:02:33.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:32 smithi129 ceph-mon[34472]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:33.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:32 smithi129 ceph-mon[34472]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:33.024 INFO:tasks.workunit.client.1.smithi129.stdout:7/571: dwrite d0/d46/d6e/f85 [0,4194304] 0 2024-09-21T08:02:33.024 INFO:tasks.workunit.client.1.smithi129.stdout:7/572: link d0/d46/d6e/c78 d0/d1e/db1/dba/cbd 0 2024-09-21T08:02:33.025 INFO:tasks.workunit.client.1.smithi129.stdout:7/573: rename d0/f8d to d0/fbe 0 2024-09-21T08:02:33.026 INFO:tasks.workunit.client.1.smithi129.stdout:7/574: rename d0/d46/c80 to d0/d71/cbf 0 2024-09-21T08:02:33.044 INFO:tasks.workunit.client.1.smithi129.stdout:7/575: dwrite d0/d1e/f38 [0,4194304] 0 2024-09-21T08:02:33.044 INFO:tasks.workunit.client.1.smithi129.stdout:7/576: readlink d0/l39 0 2024-09-21T08:02:33.045 INFO:tasks.workunit.client.1.smithi129.stdout:7/577: read d0/d46/d8e/d90/f97 [608,35289] 0 2024-09-21T08:02:33.045 INFO:tasks.workunit.client.1.smithi129.stdout:7/578: chown d0/d1e/c30 6702 1 2024-09-21T08:02:33.045 INFO:tasks.workunit.client.1.smithi129.stdout:7/579: readlink d0/l35 0 2024-09-21T08:02:33.045 INFO:tasks.workunit.client.1.smithi129.stdout:7/580: chown d0/d46/d6e/c89 1 1 2024-09-21T08:02:33.045 INFO:tasks.workunit.client.1.smithi129.stdout:7/581: fdatasync d0/f16 0 2024-09-21T08:02:33.046 INFO:tasks.workunit.client.1.smithi129.stdout:7/582: creat d0/d1e/d9a/d9f/fc0 x:0 0 0 2024-09-21T08:02:33.046 INFO:tasks.workunit.client.1.smithi129.stdout:7/583: getdents d0/d46/d6e/d9b/da5/dbc 0 2024-09-21T08:02:33.046 INFO:tasks.workunit.client.1.smithi129.stdout:7/584: fsync d0/f22 0 2024-09-21T08:02:33.053 INFO:tasks.workunit.client.1.smithi129.stdout:7/585: write d0/d46/d6e/f85 [2342510,11476] 0 2024-09-21T08:02:33.053 INFO:tasks.workunit.client.1.smithi129.stdout:7/586: dread - d0/d1e/d9a/d9f/fc0 zero size 2024-09-21T08:02:33.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:32 smithi107 ceph-mon[27622]: pgmap v8: 65 pgs: 65 active+clean; 613 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 57 MiB/s rd, 65 MiB/s wr, 123 op/s 2024-09-21T08:02:33.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:32 smithi107 ceph-mon[27622]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:33.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:32 smithi107 ceph-mon[27622]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:33.054 INFO:tasks.workunit.client.1.smithi129.stdout:7/587: unlink d0/f75 0 2024-09-21T08:02:33.059 INFO:tasks.workunit.client.1.smithi129.stdout:7/588: dread d0/d1e/f40 [0,4194304] 0 2024-09-21T08:02:33.059 INFO:tasks.workunit.client.1.smithi129.stdout:7/589: chown d0/d46/c52 11 1 2024-09-21T08:02:33.060 INFO:tasks.workunit.client.1.smithi129.stdout:7/590: mkdir d0/d1e/db1/dba/dc1 0 2024-09-21T08:02:33.081 INFO:tasks.workunit.client.1.smithi129.stdout:7/591: dwrite d0/d46/d6e/d9b/fa7 [0,4194304] 0 2024-09-21T08:02:33.095 INFO:tasks.workunit.client.1.smithi129.stdout:7/592: dwrite d0/d46/d6e/f7d [0,4194304] 0 2024-09-21T08:02:33.095 INFO:tasks.workunit.client.1.smithi129.stdout:7/593: fsync d0/d1e/f40 0 2024-09-21T08:02:33.099 INFO:tasks.workunit.client.1.smithi129.stdout:7/594: creat d0/d1e/d9a/db5/fc2 x:0 0 0 2024-09-21T08:02:33.099 INFO:tasks.workunit.client.1.smithi129.stdout:7/595: write d0/d46/f57 [590377,86894] 0 2024-09-21T08:02:33.101 INFO:tasks.workunit.client.1.smithi129.stdout:7/596: truncate d0/d46/d8e/fa8 2595164 0 2024-09-21T08:02:33.101 INFO:tasks.workunit.client.1.smithi129.stdout:7/597: dread - d0/d46/d6e/f6d zero size 2024-09-21T08:02:33.104 INFO:tasks.workunit.client.1.smithi129.stdout:7/598: rename d0/d1e/d9a/d9f/fc0 to d0/d46/d6e/d9b/fc3 0 2024-09-21T08:02:33.104 INFO:tasks.workunit.client.1.smithi129.stdout:7/599: chown d0/c54 8340 1 2024-09-21T08:02:33.105 INFO:tasks.workunit.client.1.smithi129.stdout:7/600: mkdir d0/d1e/db1/dba/dc1/dc4 0 2024-09-21T08:02:33.113 INFO:tasks.workunit.client.1.smithi129.stdout:1/651: sync 2024-09-21T08:02:33.124 INFO:tasks.workunit.client.1.smithi129.stdout:1/652: mknod d1/d44/cdf 0 2024-09-21T08:02:33.128 INFO:tasks.workunit.client.1.smithi129.stdout:7/601: truncate d0/d46/f57 630227 0 2024-09-21T08:02:33.131 INFO:tasks.workunit.client.1.smithi129.stdout:1/653: write d1/d9/d6b/f91 [399368,56367] 0 2024-09-21T08:02:33.131 INFO:tasks.workunit.client.1.smithi129.stdout:1/654: read - d1/d4/d6e/da9/fd2 zero size 2024-09-21T08:02:33.132 INFO:tasks.workunit.client.1.smithi129.stdout:7/602: dread d0/d1e/f8a [0,4194304] 0 2024-09-21T08:02:33.132 INFO:tasks.workunit.client.1.smithi129.stdout:7/603: dread - d0/d46/f86 zero size 2024-09-21T08:02:33.134 INFO:tasks.workunit.client.1.smithi129.stdout:1/655: mknod d1/d4/d6e/ce0 0 2024-09-21T08:02:33.134 INFO:tasks.workunit.client.1.smithi129.stdout:1/656: truncate d1/d9/f58 489276 0 2024-09-21T08:02:33.135 INFO:tasks.workunit.client.1.smithi129.stdout:7/604: dread d0/d46/d6e/f85 [0,4194304] 0 2024-09-21T08:02:33.135 INFO:tasks.workunit.client.1.smithi129.stdout:7/605: chown d0/d46/d6e/c89 965562 1 2024-09-21T08:02:33.137 INFO:tasks.workunit.client.1.smithi129.stdout:1/657: truncate d1/d4/d6e/da9/fd8 2528412 0 2024-09-21T08:02:33.137 INFO:tasks.workunit.client.1.smithi129.stdout:1/658: write d1/d44/db9/fc9 [470037,55242] 0 2024-09-21T08:02:33.137 INFO:tasks.workunit.client.1.smithi129.stdout:1/659: getdents d1/d16/d8f 0 2024-09-21T08:02:33.138 INFO:tasks.workunit.client.1.smithi129.stdout:7/606: mkdir d0/dc5 0 2024-09-21T08:02:33.140 INFO:tasks.workunit.client.1.smithi129.stdout:1/660: creat d1/d16/db3/fe1 x:0 0 0 2024-09-21T08:02:33.141 INFO:tasks.workunit.client.1.smithi129.stdout:1/661: symlink d1/d4/dad/db6/le2 0 2024-09-21T08:02:33.154 INFO:tasks.workunit.client.1.smithi129.stdout:9/497: sync 2024-09-21T08:02:33.154 INFO:tasks.workunit.client.1.smithi129.stdout:8/432: sync 2024-09-21T08:02:33.154 INFO:tasks.workunit.client.1.smithi129.stdout:5/589: sync 2024-09-21T08:02:33.155 INFO:tasks.workunit.client.1.smithi129.stdout:4/463: sync 2024-09-21T08:02:33.155 INFO:tasks.workunit.client.1.smithi129.stdout:9/498: chown d17/d22/d33/d36/f65 23756 1 2024-09-21T08:02:33.155 INFO:tasks.workunit.client.1.smithi129.stdout:0/518: sync 2024-09-21T08:02:33.155 INFO:tasks.workunit.client.1.smithi129.stdout:6/446: sync 2024-09-21T08:02:33.155 INFO:tasks.workunit.client.1.smithi129.stdout:2/730: sync 2024-09-21T08:02:33.155 INFO:tasks.workunit.client.1.smithi129.stdout:0/519: read de/d15/d39/f4a [22712,37641] 0 2024-09-21T08:02:33.155 INFO:tasks.workunit.client.1.smithi129.stdout:6/447: write f5 [3331699,105028] 0 2024-09-21T08:02:33.155 INFO:tasks.workunit.client.1.smithi129.stdout:3/629: sync 2024-09-21T08:02:33.155 INFO:tasks.workunit.client.1.smithi129.stdout:4/464: dread d5/d16/d47/f70 [0,4194304] 0 2024-09-21T08:02:33.158 INFO:tasks.workunit.client.1.smithi129.stdout:5/590: rename d2/c11 to d2/d1e/d35/d33/d36/d5a/d77/d81/cb2 0 2024-09-21T08:02:33.160 INFO:tasks.workunit.client.1.smithi129.stdout:9/499: link d17/d22/d33/d36/f65 d17/d22/d33/d7a/d89/fa6 0 2024-09-21T08:02:33.163 INFO:tasks.workunit.client.1.smithi129.stdout:2/731: dread d1/d13/d3a/d47/d1f/d85/df7/d45/f7b [0,4194304] 0 2024-09-21T08:02:33.163 INFO:tasks.workunit.client.1.smithi129.stdout:2/732: fdatasync d1/d13/d32/f90 0 2024-09-21T08:02:33.163 INFO:tasks.workunit.client.1.smithi129.stdout:0/520: symlink de/d22/d27/la4 0 2024-09-21T08:02:33.165 INFO:tasks.workunit.client.1.smithi129.stdout:4/465: mkdir d5/d48/da9 0 2024-09-21T08:02:33.167 INFO:tasks.workunit.client.1.smithi129.stdout:8/433: rename d0/d6/d7/d18/d27/d32/c41 to d0/d6/d7/d18/d27/d32/d3d/d83/c8b 0 2024-09-21T08:02:33.168 INFO:tasks.workunit.client.1.smithi129.stdout:8/434: chown d0/d6/d7/d18/d61/c88 0 1 2024-09-21T08:02:33.168 INFO:tasks.workunit.client.1.smithi129.stdout:8/435: readlink d0/d6/d7/d18/d27/l29 0 2024-09-21T08:02:33.169 INFO:tasks.workunit.client.1.smithi129.stdout:2/733: getdents d1/d13/d3a/d47/d1f/d85/df7 0 2024-09-21T08:02:33.170 INFO:tasks.workunit.client.1.smithi129.stdout:0/521: mknod de/d22/d27/d2f/ca5 0 2024-09-21T08:02:33.172 INFO:tasks.workunit.client.1.smithi129.stdout:4/466: creat d5/d11/d77/faa x:0 0 0 2024-09-21T08:02:33.176 INFO:tasks.workunit.client.1.smithi129.stdout:6/448: rename d7/d10/c58 to d7/d1b/d25/d2b/c9c 0 2024-09-21T08:02:33.176 INFO:tasks.workunit.client.1.smithi129.stdout:6/449: write d7/d1b/d1e/d66/f8b [433203,62263] 0 2024-09-21T08:02:33.176 INFO:tasks.workunit.client.1.smithi129.stdout:7/607: dwrite d0/f43 [0,4194304] 0 2024-09-21T08:02:33.176 INFO:tasks.workunit.client.1.smithi129.stdout:6/450: chown d7/d1b/d25/d35/d40 65053576 1 2024-09-21T08:02:33.176 INFO:tasks.workunit.client.1.smithi129.stdout:7/608: chown d0/d46/d6e/fa9 112596320 1 2024-09-21T08:02:33.176 INFO:tasks.workunit.client.1.smithi129.stdout:1/662: dwrite d1/d9/f58 [0,4194304] 0 2024-09-21T08:02:33.176 INFO:tasks.workunit.client.1.smithi129.stdout:1/663: getdents d1/d9/d6b/ddd 0 2024-09-21T08:02:33.176 INFO:tasks.workunit.client.1.smithi129.stdout:1/664: creat d1/d4/d6e/da9/fe3 x:0 0 0 2024-09-21T08:02:33.176 INFO:tasks.workunit.client.1.smithi129.stdout:9/500: dread d17/d2c/d31/d5e/d6b/f79 [0,4194304] 0 2024-09-21T08:02:33.176 INFO:tasks.workunit.client.1.smithi129.stdout:9/501: chown d17/d2c/f43 16298 1 2024-09-21T08:02:33.177 INFO:tasks.workunit.client.1.smithi129.stdout:3/630: dwrite d3/f8a [0,4194304] 0 2024-09-21T08:02:33.177 INFO:tasks.workunit.client.1.smithi129.stdout:8/436: creat d0/d6/d7/d18/d27/d32/d70/f8c x:0 0 0 2024-09-21T08:02:33.179 INFO:tasks.workunit.client.1.smithi129.stdout:0/522: mkdir de/d15/d44/da6 0 2024-09-21T08:02:33.179 INFO:tasks.workunit.client.1.smithi129.stdout:0/523: creat de/d81/fa7 x:0 0 0 2024-09-21T08:02:33.179 INFO:tasks.workunit.client.1.smithi129.stdout:0/524: read de/d15/f43 [4040143,68476] 0 2024-09-21T08:02:33.179 INFO:tasks.workunit.client.1.smithi129.stdout:0/525: write de/d15/d29/f98 [1460142,101398] 0 2024-09-21T08:02:33.183 INFO:tasks.workunit.client.1.smithi129.stdout:4/467: rename d5/d6/f2f to d5/d16/d47/fab 0 2024-09-21T08:02:33.189 INFO:tasks.workunit.client.1.smithi129.stdout:6/451: mknod d7/d1b/d1e/c9d 0 2024-09-21T08:02:33.191 INFO:tasks.workunit.client.1.smithi129.stdout:7/609: symlink d0/d1e/db1/dba/dc1/lc6 0 2024-09-21T08:02:33.194 INFO:tasks.workunit.client.1.smithi129.stdout:8/437: dwrite d0/f2b [0,4194304] 0 2024-09-21T08:02:33.195 INFO:tasks.workunit.client.1.smithi129.stdout:1/665: mknod d1/d16/d28/ce4 0 2024-09-21T08:02:33.196 INFO:tasks.workunit.client.1.smithi129.stdout:1/666: write d1/d16/d57/fa1 [875162,76584] 0 2024-09-21T08:02:33.197 INFO:tasks.workunit.client.1.smithi129.stdout:9/502: mknod d17/d22/d33/d36/d48/d3f/d71/ca7 0 2024-09-21T08:02:33.211 INFO:tasks.workunit.client.1.smithi129.stdout:6/452: creat d7/d1b/d8d/f9e x:0 0 0 2024-09-21T08:02:33.211 INFO:tasks.workunit.client.1.smithi129.stdout:6/453: fdatasync d7/d1b/d1e/d39/d79/f85 0 2024-09-21T08:02:33.213 INFO:tasks.workunit.client.1.smithi129.stdout:7/610: mkdir d0/d1e/db1/dc7 0 2024-09-21T08:02:33.213 INFO:tasks.workunit.client.1.smithi129.stdout:7/611: write d0/d1e/f38 [4227624,48354] 0 2024-09-21T08:02:33.213 INFO:tasks.workunit.client.1.smithi129.stdout:7/612: write d0/d71/fac [319508,70395] 0 2024-09-21T08:02:33.214 INFO:tasks.workunit.client.1.smithi129.stdout:8/438: symlink d0/d6/d7/d9/l8d 0 2024-09-21T08:02:33.217 INFO:tasks.workunit.client.1.smithi129.stdout:6/454: rename d7/d1b/d25/d35/d40/d41/c6f to d7/d7f/c9f 0 2024-09-21T08:02:33.219 INFO:tasks.workunit.client.1.smithi129.stdout:6/455: read d7/d10/f22 [432070,84382] 0 2024-09-21T08:02:33.219 INFO:tasks.workunit.client.1.smithi129.stdout:6/456: chown d7/f24 80 1 2024-09-21T08:02:33.221 INFO:tasks.workunit.client.1.smithi129.stdout:7/613: creat d0/d1e/db4/fc8 x:0 0 0 2024-09-21T08:02:33.222 INFO:tasks.workunit.client.1.smithi129.stdout:4/468: dwrite d5/d16/f32 [0,4194304] 0 2024-09-21T08:02:33.223 INFO:tasks.workunit.client.1.smithi129.stdout:9/503: dwrite d17/d22/d33/d36/d48/d3f/f73 [0,4194304] 0 2024-09-21T08:02:33.223 INFO:tasks.workunit.client.1.smithi129.stdout:1/667: dwrite d1/d9/f20 [0,4194304] 0 2024-09-21T08:02:33.224 INFO:tasks.workunit.client.1.smithi129.stdout:6/457: creat d7/d1b/d25/d2b/d3e/d5e/fa0 x:0 0 0 2024-09-21T08:02:33.224 INFO:tasks.workunit.client.1.smithi129.stdout:6/458: write d7/d10/f22 [272184,78234] 0 2024-09-21T08:02:33.224 INFO:tasks.workunit.client.1.smithi129.stdout:6/459: fsync d7/f8 0 2024-09-21T08:02:33.224 INFO:tasks.workunit.client.1.smithi129.stdout:6/460: write d7/d1b/d8d/f9e [61185,109745] 0 2024-09-21T08:02:33.225 INFO:tasks.workunit.client.1.smithi129.stdout:7/614: symlink d0/d1e/d9a/db5/lc9 0 2024-09-21T08:02:33.226 INFO:tasks.workunit.client.1.smithi129.stdout:7/615: write d0/d46/f53 [945662,45375] 0 2024-09-21T08:02:33.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:33.226+0000 7ff5c228d640 1 -- 172.21.15.107:0/23369953 --> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5bc0fbf10 con 0x7ff5a406e730 2024-09-21T08:02:33.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:33.228+0000 7ff5b8ff9640 1 -- 172.21.15.107:0/23369953 <== mgr.24311 v2:172.21.15.129:6828/1054385200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7ff5bc0fbf10 con 0x7ff5a406e730 2024-09-21T08:02:33.229 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:02:33.229 INFO:teuthology.orchestra.run.smithi107.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5", 2024-09-21T08:02:33.230 INFO:teuthology.orchestra.run.smithi107.stdout: "in_progress": true, 2024-09-21T08:02:33.230 INFO:teuthology.orchestra.run.smithi107.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T08:02:33.230 INFO:teuthology.orchestra.run.smithi107.stdout: "services_complete": [], 2024-09-21T08:02:33.230 INFO:teuthology.orchestra.run.smithi107.stdout: "progress": "1/2 daemons upgraded", 2024-09-21T08:02:33.230 INFO:teuthology.orchestra.run.smithi107.stdout: "message": "", 2024-09-21T08:02:33.230 INFO:teuthology.orchestra.run.smithi107.stdout: "is_paused": false 2024-09-21T08:02:33.230 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:02:33.231 INFO:tasks.workunit.client.1.smithi129.stdout:9/504: creat d17/d22/d33/d36/d48/d75/fa8 x:0 0 0 2024-09-21T08:02:33.233 INFO:tasks.workunit.client.1.smithi129.stdout:8/439: dwrite d0/d6/d7/d18/d27/d32/d37/f77 [0,4194304] 0 2024-09-21T08:02:33.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:33.232+0000 7ff5c228d640 1 -- 172.21.15.107:0/23369953 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7ff5a406e730 msgr2=0x7ff5a4070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:33.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:33.232+0000 7ff5c228d640 1 --2- 172.21.15.107:0/23369953 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7ff5a406e730 0x7ff5a4070be0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0041d0 tx=0x7ff5ac004160 comp rx=0 tx=0).stop 2024-09-21T08:02:33.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:33.232+0000 7ff5c228d640 1 -- 172.21.15.107:0/23369953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5bc0ff6e0 msgr2=0x7ff5bc0fb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:33.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:33.232+0000 7ff5c228d640 1 --2- 172.21.15.107:0/23369953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5bc0ff6e0 0x7ff5bc0fb0a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0009ac0 tx=0x7ff5b0009da0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:33.232+0000 7ff5c228d640 1 -- 172.21.15.107:0/23369953 shutdown_connections 2024-09-21T08:02:33.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:33.232+0000 7ff5c228d640 1 --2- 172.21.15.107:0/23369953 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7ff5a406e730 0x7ff5a4070be0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:33.232+0000 7ff5c228d640 1 --2- 172.21.15.107:0/23369953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5bc0ff6e0 0x7ff5bc0fb0a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:33.232+0000 7ff5c228d640 1 --2- 172.21.15.107:0/23369953 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5bc065be0 0x7ff5bc0fcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:33.232+0000 7ff5c228d640 1 -- 172.21.15.107:0/23369953 >> 172.21.15.107:0/23369953 conn(0x7ff5bc0f6c10 msgr2=0x7ff5bc0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:33.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:33.232+0000 7ff5c228d640 1 -- 172.21.15.107:0/23369953 shutdown_connections 2024-09-21T08:02:33.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:02:33.232+0000 7ff5c228d640 1 -- 172.21.15.107:0/23369953 wait complete. 2024-09-21T08:02:33.235 INFO:tasks.workunit.client.1.smithi129.stdout:1/668: mknod d1/d7a/da4/ce5 0 2024-09-21T08:02:33.235 INFO:tasks.workunit.client.1.smithi129.stdout:4/469: write d5/f63 [2149423,15177] 0 2024-09-21T08:02:33.236 INFO:tasks.workunit.client.1.smithi129.stdout:4/470: fsync d5/d6/f30 0 2024-09-21T08:02:33.238 INFO:tasks.workunit.client.1.smithi129.stdout:6/461: symlink d7/d4a/d7a/la1 0 2024-09-21T08:02:33.244 INFO:tasks.workunit.client.1.smithi129.stdout:7/616: dwrite d0/f20 [0,4194304] 0 2024-09-21T08:02:33.244 INFO:tasks.workunit.client.1.smithi129.stdout:7/617: chown d0/d46/l9e 4 1 2024-09-21T08:02:33.247 INFO:tasks.workunit.client.1.smithi129.stdout:9/505: read d17/d23/f8b [3676639,32757] 0 2024-09-21T08:02:33.247 INFO:tasks.workunit.client.1.smithi129.stdout:9/506: write f0 [2294607,125503] 0 2024-09-21T08:02:33.249 INFO:tasks.workunit.client.1.smithi129.stdout:8/440: getdents d0/d6/d7/d6c 0 2024-09-21T08:02:33.249 INFO:tasks.workunit.client.1.smithi129.stdout:8/441: chown d0/d6/d7/d18/d27/f3c 28234891 1 2024-09-21T08:02:33.250 INFO:tasks.workunit.client.1.smithi129.stdout:8/442: write d0/f11 [299147,97755] 0 2024-09-21T08:02:33.251 INFO:tasks.workunit.client.1.smithi129.stdout:1/669: rename d1/d44/d83/dcb/ld9 to d1/d9/le6 0 2024-09-21T08:02:33.255 INFO:tasks.workunit.client.1.smithi129.stdout:4/471: mkdir d5/d33/d6d/dac 0 2024-09-21T08:02:33.255 INFO:tasks.workunit.client.1.smithi129.stdout:4/472: fsync d5/d33/f4d 0 2024-09-21T08:02:33.255 INFO:tasks.workunit.client.1.smithi129.stdout:7/618: dread d0/d46/d6e/fa9 [0,4194304] 0 2024-09-21T08:02:33.256 INFO:tasks.workunit.client.1.smithi129.stdout:6/462: creat d7/d1b/d1e/d39/d4b/fa2 x:0 0 0 2024-09-21T08:02:33.256 INFO:tasks.workunit.client.1.smithi129.stdout:6/463: chown d7/d1b/d1e/d39/f46 11 1 2024-09-21T08:02:33.257 INFO:tasks.workunit.client.1.smithi129.stdout:9/507: creat d17/d2c/d31/d5e/fa9 x:0 0 0 2024-09-21T08:02:33.259 INFO:tasks.workunit.client.1.smithi129.stdout:8/443: dread d0/d6/d7/d18/d27/d32/d37/f77 [0,4194304] 0 2024-09-21T08:02:33.259 INFO:tasks.workunit.client.1.smithi129.stdout:8/444: chown d0/d6/d7/d18/d61/d7f 1050160 1 2024-09-21T08:02:33.259 INFO:tasks.workunit.client.1.smithi129.stdout:1/670: mknod d1/d44/d83/dc5/ce7 0 2024-09-21T08:02:33.259 INFO:tasks.workunit.client.1.smithi129.stdout:1/671: fsync d1/fd 0 2024-09-21T08:02:33.259 INFO:tasks.workunit.client.1.smithi129.stdout:1/672: fdatasync d1/fd 0 2024-09-21T08:02:33.259 INFO:tasks.workunit.client.1.smithi129.stdout:1/673: chown d1/d9/d6b/ddd 1191 1 2024-09-21T08:02:33.265 INFO:tasks.workunit.client.1.smithi129.stdout:6/464: truncate d7/d1b/d57/f80 3199841 0 2024-09-21T08:02:33.267 INFO:tasks.workunit.client.1.smithi129.stdout:9/508: getdents d17/d60 0 2024-09-21T08:02:33.274 INFO:tasks.workunit.client.1.smithi129.stdout:8/445: dwrite d0/d6/d7/d18/d27/d32/d37/f63 [0,4194304] 0 2024-09-21T08:02:33.280 INFO:tasks.workunit.client.1.smithi129.stdout:9/509: write d17/d2c/d31/f56 [2999915,74428] 0 2024-09-21T08:02:33.281 INFO:tasks.workunit.client.1.smithi129.stdout:6/465: dwrite d7/d1b/d1e/d39/d4b/d6e/f73 [0,4194304] 0 2024-09-21T08:02:33.281 INFO:tasks.workunit.client.1.smithi129.stdout:6/466: creat d7/d1b/d8d/fa3 x:0 0 0 2024-09-21T08:02:33.281 INFO:tasks.workunit.client.1.smithi129.stdout:6/467: write d7/d1b/d25/d2b/d3e/d93/f98 [226439,58720] 0 2024-09-21T08:02:33.283 INFO:tasks.workunit.client.1.smithi129.stdout:4/473: rmdir d5 39 2024-09-21T08:02:33.285 INFO:tasks.workunit.client.1.smithi129.stdout:1/674: getdents d1/d4 0 2024-09-21T08:02:33.290 INFO:tasks.workunit.client.1.smithi129.stdout:8/446: chown d0/d6/d7/d18/c4d 304530 1 2024-09-21T08:02:33.296 INFO:tasks.workunit.client.1.smithi129.stdout:4/474: dwrite d5/d11/d3f/d50/fa4 [0,4194304] 0 2024-09-21T08:02:33.296 INFO:tasks.workunit.client.1.smithi129.stdout:4/475: dread - d5/d16/d24/d3b/f90 zero size 2024-09-21T08:02:33.308 INFO:tasks.workunit.client.1.smithi129.stdout:6/468: creat d7/d1b/d57/d96/fa4 x:0 0 0 2024-09-21T08:02:33.308 INFO:tasks.workunit.client.1.smithi129.stdout:6/469: creat d7/d1b/d25/d2b/d3e/fa5 x:0 0 0 2024-09-21T08:02:33.309 INFO:tasks.workunit.client.1.smithi129.stdout:7/619: rename d0/d1e/db4 to d0/d1e/d9a/dca 0 2024-09-21T08:02:33.310 INFO:tasks.workunit.client.1.smithi129.stdout:8/447: mkdir d0/d6/d7/d3a/d8e 0 2024-09-21T08:02:33.314 INFO:tasks.workunit.client.1.smithi129.stdout:4/476: fdatasync d5/d16/d47/d61/f91 0 2024-09-21T08:02:33.315 INFO:tasks.workunit.client.1.smithi129.stdout:4/477: write d5/d6/f30 [616158,24179] 0 2024-09-21T08:02:33.317 INFO:tasks.workunit.client.1.smithi129.stdout:6/470: symlink d7/d4a/la6 0 2024-09-21T08:02:33.321 INFO:tasks.workunit.client.1.smithi129.stdout:9/510: rename d17/d55/f62 to d17/d22/d33/d36/d48/faa 0 2024-09-21T08:02:33.322 INFO:tasks.workunit.client.1.smithi129.stdout:8/448: mknod d0/d6/d7/c8f 0 2024-09-21T08:02:33.324 INFO:tasks.workunit.client.1.smithi129.stdout:1/675: rename d1/d9/l32 to d1/d16/d28/le8 0 2024-09-21T08:02:33.326 INFO:tasks.workunit.client.1.smithi129.stdout:7/620: dwrite d0/d1e/fa4 [0,4194304] 0 2024-09-21T08:02:33.326 INFO:tasks.workunit.client.1.smithi129.stdout:7/621: chown d0/d46/l74 24 1 2024-09-21T08:02:33.327 INFO:tasks.workunit.client.1.smithi129.stdout:8/449: unlink d0/d6/d7/d3a/c6b 0 2024-09-21T08:02:33.328 INFO:tasks.workunit.client.1.smithi129.stdout:4/478: dwrite d5/d16/d47/f70 [0,4194304] 0 2024-09-21T08:02:33.330 INFO:tasks.workunit.client.1.smithi129.stdout:6/471: dread d7/f24 [0,4194304] 0 2024-09-21T08:02:33.330 INFO:tasks.workunit.client.1.smithi129.stdout:6/472: chown d7/d4a/d7a 30105 1 2024-09-21T08:02:33.330 INFO:tasks.workunit.client.1.smithi129.stdout:6/473: chown d7/d1b/d25/d2b/d3e/d93 1009 1 2024-09-21T08:02:33.330 INFO:tasks.workunit.client.1.smithi129.stdout:1/676: dread d1/d9/f26 [0,4194304] 0 2024-09-21T08:02:33.332 INFO:tasks.workunit.client.1.smithi129.stdout:9/511: dread d17/d2c/d31/f91 [0,4194304] 0 2024-09-21T08:02:33.332 INFO:tasks.workunit.client.1.smithi129.stdout:8/450: creat d0/d6/d7/d18/d27/f90 x:0 0 0 2024-09-21T08:02:33.333 INFO:tasks.workunit.client.1.smithi129.stdout:3/631: sync 2024-09-21T08:02:33.333 INFO:tasks.workunit.client.1.smithi129.stdout:2/734: sync 2024-09-21T08:02:33.333 INFO:tasks.workunit.client.1.smithi129.stdout:0/526: sync 2024-09-21T08:02:33.333 INFO:tasks.workunit.client.1.smithi129.stdout:5/591: sync 2024-09-21T08:02:33.334 INFO:tasks.workunit.client.1.smithi129.stdout:0/527: stat de/d22/d27/la4 0 2024-09-21T08:02:33.334 INFO:tasks.workunit.client.1.smithi129.stdout:2/735: fsync d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d50/f9c 0 2024-09-21T08:02:33.334 INFO:tasks.workunit.client.1.smithi129.stdout:5/592: chown d2/d1e/f56 44180667 1 2024-09-21T08:02:33.334 INFO:tasks.workunit.client.1.smithi129.stdout:0/528: stat de/d22/d27/d2f 0 2024-09-21T08:02:33.338 INFO:tasks.workunit.client.1.smithi129.stdout:4/479: creat d5/d33/d6d/dac/fad x:0 0 0 2024-09-21T08:02:33.338 INFO:tasks.workunit.client.1.smithi129.stdout:4/480: stat d5/d33/d6d/ca6 0 2024-09-21T08:02:33.339 INFO:tasks.workunit.client.1.smithi129.stdout:6/474: dread d7/d10/f15 [0,4194304] 0 2024-09-21T08:02:33.342 INFO:tasks.workunit.client.1.smithi129.stdout:9/512: rename f13 to d17/d22/d33/d7a/d89/d90/fab 0 2024-09-21T08:02:33.346 INFO:tasks.workunit.client.1.smithi129.stdout:8/451: creat d0/d6/d7/d18/d27/d32/f91 x:0 0 0 2024-09-21T08:02:33.348 INFO:tasks.workunit.client.1.smithi129.stdout:2/736: creat d1/d53/d68/db9/f107 x:0 0 0 2024-09-21T08:02:33.350 INFO:tasks.workunit.client.1.smithi129.stdout:6/475: mknod d7/d7f/ca7 0 2024-09-21T08:02:33.352 INFO:tasks.workunit.client.1.smithi129.stdout:9/513: dread f15 [0,4194304] 0 2024-09-21T08:02:33.352 INFO:tasks.workunit.client.1.smithi129.stdout:9/514: fdatasync d17/f80 0 2024-09-21T08:02:33.353 INFO:tasks.workunit.client.1.smithi129.stdout:4/481: dread d5/d11/d3f/d50/f51 [0,4194304] 0 2024-09-21T08:02:33.353 INFO:tasks.workunit.client.1.smithi129.stdout:7/622: dwrite d0/d46/d8e/d8f/f98 [0,4194304] 0 2024-09-21T08:02:33.355 INFO:tasks.workunit.client.1.smithi129.stdout:0/529: rename de/d22/f26 to de/d15/d44/d4b/fa8 0 2024-09-21T08:02:33.357 INFO:tasks.workunit.client.1.smithi129.stdout:8/452: link d0/d6/d7/d9/l43 d0/d6/d7/d3a/l92 0 2024-09-21T08:02:33.357 INFO:tasks.workunit.client.1.smithi129.stdout:8/453: stat d0/d6/d7/d9/c1e 0 2024-09-21T08:02:33.357 INFO:tasks.workunit.client.1.smithi129.stdout:8/454: fdatasync d0/d6/d7/d24/f56 0 2024-09-21T08:02:33.358 INFO:tasks.workunit.client.1.smithi129.stdout:2/737: symlink d1/d13/d32/d97/l108 0 2024-09-21T08:02:33.360 INFO:tasks.workunit.client.1.smithi129.stdout:6/476: creat d7/d10/fa8 x:0 0 0 2024-09-21T08:02:33.363 INFO:tasks.workunit.client.1.smithi129.stdout:4/482: creat d5/d16/d24/d4f/fae x:0 0 0 2024-09-21T08:02:33.367 INFO:tasks.workunit.client.1.smithi129.stdout:7/623: creat d0/d46/d6e/d9b/fcb x:0 0 0 2024-09-21T08:02:33.367 INFO:tasks.workunit.client.1.smithi129.stdout:7/624: write d0/d46/d6e/f85 [5115740,111512] 0 2024-09-21T08:02:33.371 INFO:tasks.workunit.client.1.smithi129.stdout:1/677: dwrite d1/d44/d83/dc5/fd6 [0,4194304] 0 2024-09-21T08:02:33.371 INFO:tasks.workunit.client.1.smithi129.stdout:2/738: link d1/d53/d77/d8b/lcf d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d99/l109 0 2024-09-21T08:02:33.371 INFO:tasks.workunit.client.1.smithi129.stdout:2/739: truncate d1/f9b 683049 0 2024-09-21T08:02:33.371 INFO:tasks.workunit.client.1.smithi129.stdout:2/740: creat d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d99/f10a x:0 0 0 2024-09-21T08:02:33.376 INFO:tasks.workunit.client.1.smithi129.stdout:2/741: unlink d1/dc/l5c 0 2024-09-21T08:02:33.378 INFO:tasks.workunit.client.1.smithi129.stdout:0/530: rename de/d15/d29 to de/d1f/da9 0 2024-09-21T08:02:33.378 INFO:tasks.workunit.client.1.smithi129.stdout:2/742: mknod d1/dc/d19/d4c/d9d/c10b 0 2024-09-21T08:02:33.380 INFO:tasks.workunit.client.1.smithi129.stdout:5/593: dwrite d2/d1e/d35/f40 [4194304,4194304] 0 2024-09-21T08:02:33.380 INFO:tasks.workunit.client.1.smithi129.stdout:5/594: creat d2/d2a/d50/d61/fb3 x:0 0 0 2024-09-21T08:02:33.380 INFO:tasks.workunit.client.1.smithi129.stdout:9/515: dwrite d17/d22/f30 [0,4194304] 0 2024-09-21T08:02:33.381 INFO:tasks.workunit.client.1.smithi129.stdout:8/455: rename d0/d6/d7/d3a/d68/l82 to d0/d6/d7/d24/l93 0 2024-09-21T08:02:33.381 INFO:tasks.workunit.client.1.smithi129.stdout:7/625: rename d0 to d0/d46/d6e/d9b/da5/db3/dcc 22 2024-09-21T08:02:33.381 INFO:tasks.workunit.client.1.smithi129.stdout:8/456: dread - d0/d6/d7/d6c/f6e zero size 2024-09-21T08:02:33.383 INFO:tasks.workunit.client.1.smithi129.stdout:6/477: dwrite d7/d1b/d25/d35/d40/d41/f70 [0,4194304] 0 2024-09-21T08:02:33.383 INFO:tasks.workunit.client.1.smithi129.stdout:6/478: truncate d7/d1b/f49 8838896 0 2024-09-21T08:02:33.383 INFO:tasks.workunit.client.1.smithi129.stdout:0/531: link de/d22/d27/d2f/f5a de/d15/d39/d7f/faa 0 2024-09-21T08:02:33.383 INFO:tasks.workunit.client.1.smithi129.stdout:0/532: stat de/d15/f3b 0 2024-09-21T08:02:33.383 INFO:tasks.workunit.client.1.smithi129.stdout:2/743: dread d1/dc/d19/f38 [0,4194304] 0 2024-09-21T08:02:33.383 INFO:tasks.workunit.client.1.smithi129.stdout:2/744: stat d1/d13/d3a/c8a 0 2024-09-21T08:02:33.383 INFO:tasks.workunit.client.1.smithi129.stdout:8/457: dread d0/d6/d7/d3a/f6d [0,4194304] 0 2024-09-21T08:02:33.383 INFO:tasks.workunit.client.1.smithi129.stdout:2/745: write d1/d13/d3a/d47/d1f/f98 [2799578,101667] 0 2024-09-21T08:02:33.385 INFO:tasks.workunit.client.1.smithi129.stdout:1/678: rename d1/d44/fc3 to d1/d16/dd1/fe9 0 2024-09-21T08:02:33.386 INFO:tasks.workunit.client.1.smithi129.stdout:3/632: dwrite d3/da/ff [0,4194304] 0 2024-09-21T08:02:33.387 INFO:tasks.workunit.client.1.smithi129.stdout:3/633: creat d3/da/dc/d11/fde x:0 0 0 2024-09-21T08:02:33.387 INFO:tasks.workunit.client.1.smithi129.stdout:3/634: creat d3/da/dc/fdf x:0 0 0 2024-09-21T08:02:33.389 INFO:tasks.workunit.client.1.smithi129.stdout:9/516: dread f16 [0,4194304] 0 2024-09-21T08:02:33.389 INFO:tasks.workunit.client.1.smithi129.stdout:9/517: truncate d17/d22/d33/d36/d48/d75/fa8 441982 0 2024-09-21T08:02:33.389 INFO:tasks.workunit.client.1.smithi129.stdout:4/483: dwrite d5/d11/f31 [0,4194304] 0 2024-09-21T08:02:33.389 INFO:tasks.workunit.client.1.smithi129.stdout:4/484: fsync d5/f39 0 2024-09-21T08:02:33.389 INFO:tasks.workunit.client.1.smithi129.stdout:5/595: dread d2/d1e/d35/d33/f3e [0,4194304] 0 2024-09-21T08:02:33.389 INFO:tasks.workunit.client.1.smithi129.stdout:7/626: mknod d0/d46/ccd 0 2024-09-21T08:02:33.389 INFO:tasks.workunit.client.1.smithi129.stdout:5/596: stat d2/d1e/d35/d33/d36/d5a/d77/d81 0 2024-09-21T08:02:33.390 INFO:tasks.workunit.client.1.smithi129.stdout:0/533: link de/d1f/c50 de/d22/d27/d85/cab 0 2024-09-21T08:02:33.393 INFO:tasks.workunit.client.1.smithi129.stdout:8/458: rmdir d0/d6/d7/d3a 39 2024-09-21T08:02:33.393 INFO:tasks.workunit.client.1.smithi129.stdout:8/459: dread - d0/d6/d7/d5a/f5c zero size 2024-09-21T08:02:33.395 INFO:tasks.workunit.client.1.smithi129.stdout:2/746: symlink d1/dc/d19/d4c/l10c 0 2024-09-21T08:02:33.399 INFO:tasks.workunit.client.1.smithi129.stdout:6/479: rename d7/d1b/d25/d2b/l7e to d7/d1b/d1e/d66/la9 0 2024-09-21T08:02:33.403 INFO:tasks.workunit.client.1.smithi129.stdout:3/635: dread d3/da/dc/f4d [0,4194304] 0 2024-09-21T08:02:33.403 INFO:tasks.workunit.client.1.smithi129.stdout:3/636: fsync d3/da/dc/d25/f26 0 2024-09-21T08:02:33.407 INFO:tasks.workunit.client.1.smithi129.stdout:9/518: dread d17/d22/d33/d7a/d89/fa6 [0,4194304] 0 2024-09-21T08:02:33.409 INFO:tasks.workunit.client.1.smithi129.stdout:2/747: dread d1/dc/d19/d4c/f103 [0,4194304] 0 2024-09-21T08:02:33.409 INFO:tasks.workunit.client.1.smithi129.stdout:2/748: dread - d1/d53/f8d zero size 2024-09-21T08:02:33.413 INFO:tasks.workunit.client.1.smithi129.stdout:3/637: dread d3/da/dc/d11/fa6 [0,4194304] 0 2024-09-21T08:02:33.415 INFO:tasks.workunit.client.1.smithi129.stdout:1/679: dwrite d1/d44/f8c [0,4194304] 0 2024-09-21T08:02:33.415 INFO:tasks.workunit.client.1.smithi129.stdout:1/680: write d1/d9/d31/fb7 [979191,128702] 0 2024-09-21T08:02:33.416 INFO:tasks.workunit.client.1.smithi129.stdout:5/597: mknod d2/d2a/d50/db1/d71/cb4 0 2024-09-21T08:02:33.420 INFO:tasks.workunit.client.1.smithi129.stdout:0/534: mkdir de/d15/d39/d9e/dac 0 2024-09-21T08:02:33.422 INFO:tasks.workunit.client.1.smithi129.stdout:2/749: creat d1/d53/d77/f10d x:0 0 0 2024-09-21T08:02:33.424 INFO:tasks.workunit.client.1.smithi129.stdout:2/750: write d1/f39 [289609,21369] 0 2024-09-21T08:02:33.424 INFO:tasks.workunit.client.1.smithi129.stdout:2/751: fdatasync d1/d13/d32/d97/fbb 0 2024-09-21T08:02:33.424 INFO:tasks.workunit.client.1.smithi129.stdout:3/638: symlink d3/da/dc/d11/d2f/le0 0 2024-09-21T08:02:33.424 INFO:tasks.workunit.client.1.smithi129.stdout:3/639: chown d3/d69/d95/d52/c7a 7338 1 2024-09-21T08:02:33.432 INFO:tasks.workunit.client.1.smithi129.stdout:5/598: mknod d2/d2a/d50/cb5 0 2024-09-21T08:02:33.432 INFO:tasks.workunit.client.1.smithi129.stdout:5/599: chown d2/l8e 111897 1 2024-09-21T08:02:33.433 INFO:tasks.workunit.client.1.smithi129.stdout:5/600: dread d2/f45 [0,4194304] 0 2024-09-21T08:02:33.433 INFO:tasks.workunit.client.1.smithi129.stdout:8/460: dwrite d0/d6/d7/d6c/f6e [0,4194304] 0 2024-09-21T08:02:33.433 INFO:tasks.workunit.client.1.smithi129.stdout:8/461: truncate d0/d6/d7/d18/d27/d32/d37/f63 4910908 0 2024-09-21T08:02:33.433 INFO:tasks.workunit.client.1.smithi129.stdout:0/535: dread de/d19/f66 [0,4194304] 0 2024-09-21T08:02:33.434 INFO:tasks.workunit.client.1.smithi129.stdout:6/480: dwrite d7/f37 [0,4194304] 0 2024-09-21T08:02:33.434 INFO:tasks.workunit.client.1.smithi129.stdout:4/485: dwrite d5/d11/d3f/d50/fa4 [0,4194304] 0 2024-09-21T08:02:33.434 INFO:tasks.workunit.client.1.smithi129.stdout:4/486: readlink l3 0 2024-09-21T08:02:33.434 INFO:tasks.workunit.client.1.smithi129.stdout:7/627: dwrite d0/d46/d6e/d9b/fc3 [0,4194304] 0 2024-09-21T08:02:33.440 INFO:tasks.workunit.client.1.smithi129.stdout:0/536: mkdir de/d19/dad 0 2024-09-21T08:02:33.440 INFO:tasks.workunit.client.1.smithi129.stdout:0/537: stat de/d22/d27/d2f/f61 0 2024-09-21T08:02:33.440 INFO:tasks.workunit.client.1.smithi129.stdout:0/538: write de/d15/d39/f96 [1252296,128246] 0 2024-09-21T08:02:33.441 INFO:tasks.workunit.client.1.smithi129.stdout:0/539: dread - de/d15/d44/f97 zero size 2024-09-21T08:02:33.442 INFO:tasks.workunit.client.1.smithi129.stdout:8/462: dread d0/d6/d7/f21 [0,4194304] 0 2024-09-21T08:02:33.447 INFO:tasks.workunit.client.1.smithi129.stdout:6/481: truncate d7/d1b/d8d/f9e 29190 0 2024-09-21T08:02:33.447 INFO:tasks.workunit.client.1.smithi129.stdout:6/482: dread - d7/d1b/d8d/fa3 zero size 2024-09-21T08:02:33.449 INFO:tasks.workunit.client.1.smithi129.stdout:4/487: symlink d5/d11/d3f/laf 0 2024-09-21T08:02:33.449 INFO:tasks.workunit.client.1.smithi129.stdout:4/488: write d5/d16/d47/d5f/f6b [992011,113219] 0 2024-09-21T08:02:33.449 INFO:tasks.workunit.client.1.smithi129.stdout:4/489: read - d5/d6/f87 zero size 2024-09-21T08:02:33.450 INFO:tasks.workunit.client.1.smithi129.stdout:1/681: getdents d1/d16/dd1 0 2024-09-21T08:02:33.450 INFO:tasks.workunit.client.1.smithi129.stdout:1/682: creat d1/d44/d83/fea x:0 0 0 2024-09-21T08:02:33.463 INFO:tasks.workunit.client.1.smithi129.stdout:7/628: link d0/f20 d0/d46/d6e/dad/fce 0 2024-09-21T08:02:33.466 INFO:tasks.workunit.client.1.smithi129.stdout:5/601: symlink d2/d1e/d35/d37/lb6 0 2024-09-21T08:02:33.469 INFO:tasks.workunit.client.1.smithi129.stdout:0/540: mknod de/d15/d39/d5b/cae 0 2024-09-21T08:02:33.472 INFO:tasks.workunit.client.1.smithi129.stdout:8/463: rename d0/d6/d7/d5d/d81 to d0/d6/d7/d9/d94 0 2024-09-21T08:02:33.474 INFO:tasks.workunit.client.1.smithi129.stdout:6/483: creat d7/d1b/d25/d35/d40/d78/faa x:0 0 0 2024-09-21T08:02:33.474 INFO:tasks.workunit.client.1.smithi129.stdout:6/484: write d7/fa [1727007,40108] 0 2024-09-21T08:02:33.477 INFO:tasks.workunit.client.1.smithi129.stdout:4/490: symlink d5/d16/d24/d3b/lb0 0 2024-09-21T08:02:33.477 INFO:tasks.workunit.client.1.smithi129.stdout:4/491: write d5/d16/d24/f42 [3909996,115575] 0 2024-09-21T08:02:33.477 INFO:tasks.workunit.client.1.smithi129.stdout:4/492: write d5/d16/f29 [1670817,86636] 0 2024-09-21T08:02:33.482 INFO:tasks.workunit.client.1.smithi129.stdout:7/629: dwrite d0/d46/d8e/d90/f97 [0,4194304] 0 2024-09-21T08:02:33.483 INFO:tasks.workunit.client.1.smithi129.stdout:1/683: mkdir d1/d7a/deb 0 2024-09-21T08:02:33.484 INFO:tasks.workunit.client.1.smithi129.stdout:6/485: dread d7/d1b/d1e/d39/d4b/f4d [0,4194304] 0 2024-09-21T08:02:33.484 INFO:tasks.workunit.client.1.smithi129.stdout:6/486: readlink d7/d1b/d25/d35/d40/d78/l83 0 2024-09-21T08:02:33.496 INFO:tasks.workunit.client.1.smithi129.stdout:8/464: dwrite d0/d6/f1a [0,4194304] 0 2024-09-21T08:02:33.498 INFO:tasks.workunit.client.1.smithi129.stdout:5/602: mknod d2/d1e/d35/d33/da1/cb7 0 2024-09-21T08:02:33.498 INFO:tasks.workunit.client.1.smithi129.stdout:7/630: dwrite d0/f79 [4194304,4194304] 0 2024-09-21T08:02:33.500 INFO:tasks.workunit.client.1.smithi129.stdout:0/541: truncate de/d22/d27/d30/f52 236176 0 2024-09-21T08:02:33.502 INFO:tasks.workunit.client.1.smithi129.stdout:4/493: mkdir d5/da5/db1 0 2024-09-21T08:02:33.509 INFO:tasks.workunit.client.1.smithi129.stdout:6/487: symlink d7/d1b/d25/d2b/lab 0 2024-09-21T08:02:33.513 INFO:tasks.workunit.client.1.smithi129.stdout:1/684: dread d1/f3f [0,4194304] 0 2024-09-21T08:02:33.515 INFO:tasks.workunit.client.1.smithi129.stdout:8/465: mkdir d0/d6/d7/d18/d27/d60/d85/d95 0 2024-09-21T08:02:33.515 INFO:tasks.workunit.client.1.smithi129.stdout:8/466: chown d0/d6/d7/d9/l43 3 1 2024-09-21T08:02:33.515 INFO:tasks.workunit.client.1.smithi129.stdout:8/467: chown d0/d6/l1b 24 1 2024-09-21T08:02:33.515 INFO:tasks.workunit.client.1.smithi129.stdout:8/468: write d0/d6/d7/d5a/f8a [334588,113832] 0 2024-09-21T08:02:33.518 INFO:tasks.workunit.client.1.smithi129.stdout:5/603: creat d2/d2a/d50/db1/d71/da9/fb8 x:0 0 0 2024-09-21T08:02:33.522 INFO:tasks.workunit.client.1.smithi129.stdout:7/631: rename d0/lf to d0/d46/d6e/d9b/da5/lcf 0 2024-09-21T08:02:33.522 INFO:tasks.workunit.client.1.smithi129.stdout:7/632: read d0/d46/d6e/f5c [909796,111113] 0 2024-09-21T08:02:33.522 INFO:tasks.workunit.client.1.smithi129.stdout:8/469: write d0/f2b [1489716,5452] 0 2024-09-21T08:02:33.523 INFO:tasks.workunit.client.1.smithi129.stdout:7/633: dread d0/d46/d6e/f83 [0,4194304] 0 2024-09-21T08:02:33.524 INFO:tasks.workunit.client.1.smithi129.stdout:0/542: creat de/d15/faf x:0 0 0 2024-09-21T08:02:33.524 INFO:tasks.workunit.client.1.smithi129.stdout:0/543: stat de/d15/d39/d7f/ca2 0 2024-09-21T08:02:33.526 INFO:tasks.workunit.client.1.smithi129.stdout:6/488: creat d7/d4a/fac x:0 0 0 2024-09-21T08:02:33.526 INFO:tasks.workunit.client.1.smithi129.stdout:6/489: fdatasync d7/d1b/d1e/d39/d4b/fa2 0 2024-09-21T08:02:33.529 INFO:tasks.workunit.client.1.smithi129.stdout:4/494: rename d5/d6/c92 to d5/da5/cb2 0 2024-09-21T08:02:33.530 INFO:tasks.workunit.client.1.smithi129.stdout:1/685: dwrite d1/d44/f8c [0,4194304] 0 2024-09-21T08:02:33.530 INFO:tasks.workunit.client.1.smithi129.stdout:1/686: chown d1/d9/f45 1347 1 2024-09-21T08:02:33.530 INFO:tasks.workunit.client.1.smithi129.stdout:5/604: write d2/d2a/d50/f53 [1434596,85963] 0 2024-09-21T08:02:33.531 INFO:tasks.workunit.client.1.smithi129.stdout:7/634: creat d0/d46/d6e/fd0 x:0 0 0 2024-09-21T08:02:33.532 INFO:tasks.workunit.client.1.smithi129.stdout:0/544: symlink de/lb0 0 2024-09-21T08:02:33.534 INFO:tasks.workunit.client.1.smithi129.stdout:5/605: write d2/d1e/d35/d33/f3e [77435,128845] 0 2024-09-21T08:02:33.534 INFO:tasks.workunit.client.1.smithi129.stdout:5/606: write d2/d1e/d35/d33/f69 [1094764,45007] 0 2024-09-21T08:02:33.534 INFO:tasks.workunit.client.1.smithi129.stdout:6/490: fsync d7/f53 0 2024-09-21T08:02:33.538 INFO:tasks.workunit.client.1.smithi129.stdout:8/470: write d0/d6/d7/f40 [843884,14033] 0 2024-09-21T08:02:33.538 INFO:tasks.workunit.client.1.smithi129.stdout:8/471: chown d0/d6/d7/d3a/c69 233765 1 2024-09-21T08:02:33.540 INFO:tasks.workunit.client.1.smithi129.stdout:4/495: write d5/d16/d47/d61/f91 [198941,113236] 0 2024-09-21T08:02:33.543 INFO:tasks.workunit.client.1.smithi129.stdout:0/545: dread de/d22/f2b [0,4194304] 0 2024-09-21T08:02:33.553 INFO:tasks.workunit.client.1.smithi129.stdout:1/687: dwrite d1/d9/d31/f68 [0,4194304] 0 2024-09-21T08:02:33.560 INFO:tasks.workunit.client.1.smithi129.stdout:7/635: creat d0/d46/d6e/d9b/da5/db7/fd1 x:0 0 0 2024-09-21T08:02:33.562 INFO:tasks.workunit.client.1.smithi129.stdout:5/607: truncate d2/d1e/d35/d33/d36/d5a/f70 1603260 0 2024-09-21T08:02:33.562 INFO:tasks.workunit.client.1.smithi129.stdout:5/608: chown d2/f1d 947978734 1 2024-09-21T08:02:33.566 INFO:tasks.workunit.client.1.smithi129.stdout:4/496: rename d5/d11/f8a to d5/da5/fb3 0 2024-09-21T08:02:33.567 INFO:tasks.workunit.client.1.smithi129.stdout:4/497: dread - d5/d16/d24/d3b/f90 zero size 2024-09-21T08:02:33.571 INFO:tasks.workunit.client.1.smithi129.stdout:6/491: dwrite d7/fd [0,4194304] 0 2024-09-21T08:02:33.571 INFO:tasks.workunit.client.1.smithi129.stdout:6/492: chown d7/d1b/d25/d2b/d3e/d5e/c81 77511282 1 2024-09-21T08:02:33.571 INFO:tasks.workunit.client.1.smithi129.stdout:0/546: dwrite de/d15/d39/d56/f63 [0,4194304] 0 2024-09-21T08:02:33.571 INFO:tasks.workunit.client.1.smithi129.stdout:6/493: write d7/d1b/d25/d2b/d3e/fa5 [876104,13037] 0 2024-09-21T08:02:33.572 INFO:tasks.workunit.client.1.smithi129.stdout:1/688: unlink d1/d16/db3/cbe 0 2024-09-21T08:02:33.579 INFO:tasks.workunit.client.1.smithi129.stdout:7/636: unlink d0/d1e/f8a 0 2024-09-21T08:02:33.579 INFO:tasks.workunit.client.1.smithi129.stdout:7/637: truncate d0/d1e/f3e 1055339 0 2024-09-21T08:02:33.581 INFO:tasks.workunit.client.1.smithi129.stdout:5/609: mkdir d2/d1e/d35/d33/db9 0 2024-09-21T08:02:33.583 INFO:tasks.workunit.client.1.smithi129.stdout:4/498: creat d5/d16/d47/d5f/fb4 x:0 0 0 2024-09-21T08:02:33.589 INFO:tasks.workunit.client.1.smithi129.stdout:0/547: dwrite de/d15/f59 [0,4194304] 0 2024-09-21T08:02:33.589 INFO:tasks.workunit.client.1.smithi129.stdout:6/494: symlink d7/d1b/lad 0 2024-09-21T08:02:33.590 INFO:tasks.workunit.client.1.smithi129.stdout:6/495: creat d7/d1b/d25/d2b/d3e/d93/fae x:0 0 0 2024-09-21T08:02:33.590 INFO:tasks.workunit.client.1.smithi129.stdout:6/496: truncate d7/d1b/d1e/d39/f5f 3968330 0 2024-09-21T08:02:33.590 INFO:tasks.workunit.client.1.smithi129.stdout:6/497: stat d7/d1b/d25/d2b/d3e 0 2024-09-21T08:02:33.591 INFO:tasks.workunit.client.1.smithi129.stdout:1/689: link d1/d9/d6b/l8d d1/d16/d25/da0/lec 0 2024-09-21T08:02:33.591 INFO:tasks.workunit.client.1.smithi129.stdout:1/690: chown d1/d16/db3 345202064 1 2024-09-21T08:02:33.593 INFO:tasks.workunit.client.1.smithi129.stdout:7/638: unlink d0/c94 0 2024-09-21T08:02:33.595 INFO:tasks.workunit.client.1.smithi129.stdout:5/610: truncate d2/f4e 268460 0 2024-09-21T08:02:33.599 INFO:tasks.workunit.client.1.smithi129.stdout:0/548: write de/d15/f59 [558441,52703] 0 2024-09-21T08:02:33.599 INFO:tasks.workunit.client.1.smithi129.stdout:0/549: dread - de/d81/fa7 zero size 2024-09-21T08:02:33.607 INFO:tasks.workunit.client.1.smithi129.stdout:7/639: mkdir d0/d46/d8e/d90/dd2 0 2024-09-21T08:02:33.607 INFO:tasks.workunit.client.1.smithi129.stdout:7/640: stat d0/c5a 0 2024-09-21T08:02:33.611 INFO:tasks.workunit.client.1.smithi129.stdout:5/611: symlink d2/d2a/d50/db1/lba 0 2024-09-21T08:02:33.612 INFO:tasks.workunit.client.1.smithi129.stdout:5/612: fdatasync d2/d2a/d50/d61/fb3 0 2024-09-21T08:02:33.615 INFO:tasks.workunit.client.1.smithi129.stdout:5/613: dread d2/d1e/d35/d33/d36/d5a/f5c [0,4194304] 0 2024-09-21T08:02:33.615 INFO:tasks.workunit.client.1.smithi129.stdout:5/614: chown d2/d2a/d50/l83 617289 1 2024-09-21T08:02:33.617 INFO:tasks.workunit.client.1.smithi129.stdout:6/498: getdents d7/d1b/d25/d35/d40/d41 0 2024-09-21T08:02:33.617 INFO:tasks.workunit.client.1.smithi129.stdout:6/499: fsync d7/d1b/d1e/f36 0 2024-09-21T08:02:33.617 INFO:tasks.workunit.client.1.smithi129.stdout:6/500: dread - d7/d10/fa8 zero size 2024-09-21T08:02:33.618 INFO:tasks.workunit.client.1.smithi129.stdout:0/550: dwrite de/d1f/da9/f7c [0,4194304] 0 2024-09-21T08:02:33.618 INFO:tasks.workunit.client.1.smithi129.stdout:0/551: readlink de/d19/l57 0 2024-09-21T08:02:33.626 INFO:tasks.workunit.client.1.smithi129.stdout:9/519: sync 2024-09-21T08:02:33.626 INFO:tasks.workunit.client.1.smithi129.stdout:2/752: sync 2024-09-21T08:02:33.626 INFO:tasks.workunit.client.1.smithi129.stdout:3/640: sync 2024-09-21T08:02:33.628 INFO:tasks.workunit.client.1.smithi129.stdout:6/501: write d7/fd [1622470,50997] 0 2024-09-21T08:02:33.629 INFO:tasks.workunit.client.1.smithi129.stdout:7/641: dwrite d0/d46/d6e/f5c [0,4194304] 0 2024-09-21T08:02:33.629 INFO:tasks.workunit.client.1.smithi129.stdout:3/641: mkdir d3/d69/d95/de1 0 2024-09-21T08:02:33.631 INFO:tasks.workunit.client.1.smithi129.stdout:2/753: mknod d1/d13/d32/c10e 0 2024-09-21T08:02:33.631 INFO:tasks.workunit.client.1.smithi129.stdout:2/754: chown d1/dc/d94/fbf 16 1 2024-09-21T08:02:33.631 INFO:tasks.workunit.client.1.smithi129.stdout:2/755: write d1/f39 [1616018,123436] 0 2024-09-21T08:02:33.634 INFO:tasks.workunit.client.1.smithi129.stdout:9/520: dread d17/d22/f30 [0,4194304] 0 2024-09-21T08:02:33.635 INFO:tasks.workunit.client.1.smithi129.stdout:7/642: unlink d0/d1e/c2d 0 2024-09-21T08:02:33.636 INFO:tasks.workunit.client.1.smithi129.stdout:3/642: mkdir d3/da/dc/d7f/dd6/de2 0 2024-09-21T08:02:33.638 INFO:tasks.workunit.client.1.smithi129.stdout:2/756: mknod d1/dc/d19/d4c/d9d/c10f 0 2024-09-21T08:02:33.639 INFO:tasks.workunit.client.1.smithi129.stdout:5/615: dwrite d2/d1e/d35/d33/d36/f8a [0,4194304] 0 2024-09-21T08:02:33.640 INFO:tasks.workunit.client.1.smithi129.stdout:6/502: getdents d7/d1b/d1e/d66 0 2024-09-21T08:02:33.640 INFO:tasks.workunit.client.1.smithi129.stdout:6/503: chown d7/d1b/d25/d35/d40/d78/faa 907 1 2024-09-21T08:02:33.642 INFO:tasks.workunit.client.1.smithi129.stdout:9/521: symlink d17/d22/d33/lac 0 2024-09-21T08:02:33.642 INFO:tasks.workunit.client.1.smithi129.stdout:9/522: creat d17/d22/d33/d36/d48/d3f/d53/fad x:0 0 0 2024-09-21T08:02:33.644 INFO:tasks.workunit.client.1.smithi129.stdout:3/643: link d3/da/dc/d25/f41 d3/d57/da2/fe3 0 2024-09-21T08:02:33.644 INFO:tasks.workunit.client.1.smithi129.stdout:3/644: write d3/d69/d95/f86 [4859860,125490] 0 2024-09-21T08:02:33.646 INFO:tasks.workunit.client.1.smithi129.stdout:2/757: symlink d1/dc/d19/d4c/l110 0 2024-09-21T08:02:33.650 INFO:tasks.workunit.client.1.smithi129.stdout:5/616: truncate d2/d1e/d35/d33/d36/f59 2217882 0 2024-09-21T08:02:33.651 INFO:tasks.workunit.client.1.smithi129.stdout:7/643: dwrite d0/d1e/f21 [0,4194304] 0 2024-09-21T08:02:33.651 INFO:tasks.workunit.client.1.smithi129.stdout:9/523: dread d17/d22/d33/d7a/d89/d90/fab [0,4194304] 0 2024-09-21T08:02:33.652 INFO:tasks.workunit.client.1.smithi129.stdout:6/504: rename d7/f24 to d7/d4a/d69/faf 0 2024-09-21T08:02:33.654 INFO:tasks.workunit.client.1.smithi129.stdout:2/758: dread d1/d13/d3a/ff4 [0,4194304] 0 2024-09-21T08:02:33.656 INFO:tasks.workunit.client.1.smithi129.stdout:9/524: mknod d17/d2c/d31/d5e/cae 0 2024-09-21T08:02:33.656 INFO:tasks.workunit.client.1.smithi129.stdout:9/525: stat d17/d22/d33/d36/d48 0 2024-09-21T08:02:33.658 INFO:tasks.workunit.client.1.smithi129.stdout:3/645: rename d3/da/d5d/lc7 to d3/d57/d80/le4 0 2024-09-21T08:02:33.662 INFO:tasks.workunit.client.1.smithi129.stdout:9/526: getdents d17/d55/d81 0 2024-09-21T08:02:33.662 INFO:tasks.workunit.client.1.smithi129.stdout:9/527: truncate f15 1581086 0 2024-09-21T08:02:33.662 INFO:tasks.workunit.client.1.smithi129.stdout:5/617: dread d2/d1e/d35/d33/d36/d5a/f5c [0,4194304] 0 2024-09-21T08:02:33.663 INFO:tasks.workunit.client.1.smithi129.stdout:6/505: getdents d7/d1b 0 2024-09-21T08:02:33.664 INFO:tasks.workunit.client.1.smithi129.stdout:7/644: dread d0/d46/d6e/f7d [0,4194304] 0 2024-09-21T08:02:33.664 INFO:tasks.workunit.client.1.smithi129.stdout:7/645: dread - d0/d46/d6e/f64 zero size 2024-09-21T08:02:33.666 INFO:tasks.workunit.client.1.smithi129.stdout:9/528: rename d17/d2c/d31/f85 to d17/d22/faf 0 2024-09-21T08:02:33.666 INFO:tasks.workunit.client.1.smithi129.stdout:9/529: write f0 [2500584,40007] 0 2024-09-21T08:02:33.666 INFO:tasks.workunit.client.1.smithi129.stdout:2/759: write d1/d13/d3a/d47/d1f/f25 [616150,59223] 0 2024-09-21T08:02:33.669 INFO:tasks.workunit.client.1.smithi129.stdout:9/530: unlink ca 0 2024-09-21T08:02:33.669 INFO:tasks.workunit.client.1.smithi129.stdout:9/531: readlink d17/d22/d33/d36/l58 0 2024-09-21T08:02:33.675 INFO:tasks.workunit.client.1.smithi129.stdout:2/760: dread d1/dc/d19/d4c/f67 [0,4194304] 0 2024-09-21T08:02:33.675 INFO:tasks.workunit.client.1.smithi129.stdout:7/646: dread d0/d46/f47 [0,4194304] 0 2024-09-21T08:02:33.679 INFO:tasks.workunit.client.1.smithi129.stdout:7/647: read d0/d46/d6e/f7d [3491854,112974] 0 2024-09-21T08:02:33.679 INFO:tasks.workunit.client.1.smithi129.stdout:7/648: chown d0/d46/l73 1829 1 2024-09-21T08:02:33.679 INFO:tasks.workunit.client.1.smithi129.stdout:7/649: chown d0/d1e/fa4 109 1 2024-09-21T08:02:33.686 INFO:tasks.workunit.client.1.smithi129.stdout:2/761: mkdir d1/d13/d3a/d47/d5f/d111 0 2024-09-21T08:02:33.688 INFO:tasks.workunit.client.1.smithi129.stdout:5/618: dwrite d2/f24 [0,4194304] 0 2024-09-21T08:02:33.690 INFO:tasks.workunit.client.1.smithi129.stdout:2/762: symlink d1/d53/d68/l112 0 2024-09-21T08:02:33.694 INFO:tasks.workunit.client.1.smithi129.stdout:6/506: dwrite d7/d1b/d1e/d39/f5f [0,4194304] 0 2024-09-21T08:02:33.694 INFO:tasks.workunit.client.1.smithi129.stdout:6/507: write d7/d1b/d25/d35/f91 [160816,10455] 0 2024-09-21T08:02:33.697 INFO:tasks.workunit.client.1.smithi129.stdout:2/763: getdents d1/dc/d19/d4c/d9d 0 2024-09-21T08:02:33.697 INFO:tasks.workunit.client.1.smithi129.stdout:2/764: readlink d1/d53/lfa 0 2024-09-21T08:02:33.698 INFO:tasks.workunit.client.1.smithi129.stdout:7/650: rmdir d0/d46/d6e/d9b/da5/dbc 0 2024-09-21T08:02:33.700 INFO:tasks.workunit.client.1.smithi129.stdout:6/508: mknod d7/d1b/d8d/cb0 0 2024-09-21T08:02:33.701 INFO:tasks.workunit.client.1.smithi129.stdout:5/619: link d2/d1e/l8b d2/d1e/d35/d37/lbb 0 2024-09-21T08:02:33.703 INFO:tasks.workunit.client.1.smithi129.stdout:2/765: mknod d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d50/c113 0 2024-09-21T08:02:33.705 INFO:tasks.workunit.client.1.smithi129.stdout:7/651: mkdir d0/d46/dd3 0 2024-09-21T08:02:33.707 INFO:tasks.workunit.client.1.smithi129.stdout:5/620: rename d2/d1e/d35/faa to d2/d1e/d35/d33/d36/fbc 0 2024-09-21T08:02:33.708 INFO:tasks.workunit.client.1.smithi129.stdout:6/509: dread d7/d10/f15 [0,4194304] 0 2024-09-21T08:02:33.709 INFO:tasks.workunit.client.1.smithi129.stdout:7/652: rename d0/d46/l74 to d0/d1e/db1/dba/ld4 0 2024-09-21T08:02:33.710 INFO:tasks.workunit.client.1.smithi129.stdout:6/510: dread d7/d1b/d1e/d39/d79/f85 [0,4194304] 0 2024-09-21T08:02:33.710 INFO:tasks.workunit.client.1.smithi129.stdout:9/532: getdents d17/d2c/d31 0 2024-09-21T08:02:33.712 INFO:tasks.workunit.client.1.smithi129.stdout:5/621: rmdir d2/d2a/d50/db1 39 2024-09-21T08:02:33.714 INFO:tasks.workunit.client.1.smithi129.stdout:7/653: mknod d0/d1e/db1/dba/dc1/cd5 0 2024-09-21T08:02:33.716 INFO:tasks.workunit.client.1.smithi129.stdout:6/511: dread d7/d1b/d1e/d39/f46 [0,4194304] 0 2024-09-21T08:02:33.716 INFO:tasks.workunit.client.1.smithi129.stdout:9/533: link d17/d46/f8e d17/d22/d33/d36/d48/d75/fb0 0 2024-09-21T08:02:33.718 INFO:tasks.workunit.client.1.smithi129.stdout:9/534: getdents d17 0 2024-09-21T08:02:33.718 INFO:tasks.workunit.client.1.smithi129.stdout:2/766: dwrite d1/d53/d77/d8b/fee [0,4194304] 0 2024-09-21T08:02:33.718 INFO:tasks.workunit.client.1.smithi129.stdout:2/767: read - d1/d53/d68/db9/f107 zero size 2024-09-21T08:02:33.722 INFO:tasks.workunit.client.1.smithi129.stdout:9/535: fsync d17/d22/d33/d36/d48/d75/f7d 0 2024-09-21T08:02:33.729 INFO:tasks.workunit.client.1.smithi129.stdout:6/512: read d7/d1b/f49 [8020224,28614] 0 2024-09-21T08:02:33.731 INFO:tasks.workunit.client.1.smithi129.stdout:5/622: dwrite d2/d2a/d50/f63 [0,4194304] 0 2024-09-21T08:02:33.731 INFO:tasks.workunit.client.1.smithi129.stdout:5/623: write d2/d1e/d35/d33/d36/d5a/d77/d81/f94 [406579,49570] 0 2024-09-21T08:02:33.732 INFO:tasks.workunit.client.1.smithi129.stdout:5/624: chown d2/f4e 0 1 2024-09-21T08:02:33.732 INFO:tasks.workunit.client.1.smithi129.stdout:2/768: unlink d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d99/fb7 0 2024-09-21T08:02:33.732 INFO:tasks.workunit.client.1.smithi129.stdout:2/769: readlink d1/dc/d19/d4c/d6a/d69/lc5 0 2024-09-21T08:02:33.735 INFO:tasks.workunit.client.1.smithi129.stdout:6/513: unlink d7/d1b/d1e/d39/d4b/l8f 0 2024-09-21T08:02:33.743 INFO:tasks.workunit.client.1.smithi129.stdout:5/625: truncate d2/f4 1172863 0 2024-09-21T08:02:33.743 INFO:tasks.workunit.client.1.smithi129.stdout:5/626: truncate d2/d1e/d35/d33/d36/d5a/d77/d81/f94 1304436 0 2024-09-21T08:02:33.749 INFO:tasks.workunit.client.1.smithi129.stdout:9/536: rename d17/d2c to d17/d22/d33/d7a/d89/d90/db1 0 2024-09-21T08:02:33.749 INFO:tasks.workunit.client.1.smithi129.stdout:9/537: creat d17/d46/fb2 x:0 0 0 2024-09-21T08:02:33.751 INFO:tasks.workunit.client.1.smithi129.stdout:5/627: mknod d2/d1e/cbd 0 2024-09-21T08:02:33.754 INFO:tasks.workunit.client.1.smithi129.stdout:9/538: truncate d17/d22/d33/d7a/d89/d90/db1/d31/f91 323186 0 2024-09-21T08:02:33.754 INFO:tasks.workunit.client.1.smithi129.stdout:6/514: dwrite d7/d1b/d1e/d39/d4b/d6e/f73 [4194304,4194304] 0 2024-09-21T08:02:33.759 INFO:tasks.workunit.client.1.smithi129.stdout:9/539: rmdir d17/d22/d33/d36/d48/d3f/d71/da4 0 2024-09-21T08:02:33.759 INFO:tasks.workunit.client.1.smithi129.stdout:5/628: read d2/d1e/d35/d33/f34 [2887860,96207] 0 2024-09-21T08:02:33.765 INFO:tasks.workunit.client.1.smithi129.stdout:5/629: rename d2/d1e/d35/d33/d36/f59 to d2/d2a/d50/fbe 0 2024-09-21T08:02:33.765 INFO:tasks.workunit.client.1.smithi129.stdout:5/630: readlink d2/d1e/d35/d33/d36/d5a/d77/l87 0 2024-09-21T08:02:33.766 INFO:tasks.workunit.client.1.smithi129.stdout:5/631: fdatasync d2/f29 0 2024-09-21T08:02:33.766 INFO:tasks.workunit.client.1.smithi129.stdout:5/632: chown d2/d1e/d35/d37/d7d/ca2 24758 1 2024-09-21T08:02:33.766 INFO:tasks.workunit.client.1.smithi129.stdout:5/633: creat d2/d2a/fbf x:0 0 0 2024-09-21T08:02:33.768 INFO:tasks.workunit.client.1.smithi129.stdout:5/634: symlink d2/d1e/d35/d33/lc0 0 2024-09-21T08:02:33.784 INFO:tasks.workunit.client.1.smithi129.stdout:6/515: dwrite d7/fa [4194304,4194304] 0 2024-09-21T08:02:33.785 INFO:tasks.workunit.client.1.smithi129.stdout:5/635: dwrite d2/d1e/d35/d33/d36/d5a/f70 [0,4194304] 0 2024-09-21T08:02:33.785 INFO:tasks.workunit.client.1.smithi129.stdout:5/636: stat d2/d1e/d6b/f66 0 2024-09-21T08:02:33.786 INFO:tasks.workunit.client.1.smithi129.stdout:6/516: mkdir d7/d1b/d25/d35/d40/db1 0 2024-09-21T08:02:33.787 INFO:tasks.workunit.client.1.smithi129.stdout:6/517: write d7/d1b/d25/d2b/d3e/fa5 [132332,22381] 0 2024-09-21T08:02:33.797 INFO:tasks.workunit.client.1.smithi129.stdout:6/518: rename d7/d1b/d1e/d66/la9 to d7/d1b/d57/d96/lb2 0 2024-09-21T08:02:33.797 INFO:tasks.workunit.client.1.smithi129.stdout:6/519: fsync d7/d1b/f49 0 2024-09-21T08:02:33.797 INFO:tasks.workunit.client.1.smithi129.stdout:6/520: truncate d7/d1b/d25/d35/f91 515181 0 2024-09-21T08:02:33.799 INFO:tasks.workunit.client.1.smithi129.stdout:6/521: creat d7/d1b/d25/d2b/fb3 x:0 0 0 2024-09-21T08:02:33.802 INFO:tasks.workunit.client.1.smithi129.stdout:6/522: write d7/d1b/d1e/d39/f5f [1885983,122145] 0 2024-09-21T08:02:33.804 INFO:tasks.workunit.client.1.smithi129.stdout:5/637: dwrite d2/f45 [0,4194304] 0 2024-09-21T08:02:33.804 INFO:tasks.workunit.client.1.smithi129.stdout:5/638: fdatasync d2/d2a/d50/d61/f91 0 2024-09-21T08:02:33.807 INFO:tasks.workunit.client.1.smithi129.stdout:6/523: dread d7/d10/f14 [0,4194304] 0 2024-09-21T08:02:33.807 INFO:tasks.workunit.client.1.smithi129.stdout:6/524: chown d7/d1b/d1e/d39/d79/f85 933765121 1 2024-09-21T08:02:33.809 INFO:tasks.workunit.client.1.smithi129.stdout:8/472: sync 2024-09-21T08:02:33.809 INFO:tasks.workunit.client.1.smithi129.stdout:8/473: write d0/d6/d7/f7e [865780,54356] 0 2024-09-21T08:02:33.813 INFO:tasks.workunit.client.1.smithi129.stdout:5/639: dread d2/d1e/d35/f2b [0,4194304] 0 2024-09-21T08:02:33.820 INFO:tasks.workunit.client.1.smithi129.stdout:0/552: sync 2024-09-21T08:02:33.820 INFO:tasks.workunit.client.1.smithi129.stdout:3/646: sync 2024-09-21T08:02:33.820 INFO:tasks.workunit.client.1.smithi129.stdout:1/691: sync 2024-09-21T08:02:33.821 INFO:tasks.workunit.client.1.smithi129.stdout:4/499: sync 2024-09-21T08:02:33.821 INFO:tasks.workunit.client.1.smithi129.stdout:4/500: dread - d5/d48/f8e zero size 2024-09-21T08:02:33.821 INFO:tasks.workunit.client.1.smithi129.stdout:1/692: getdents d1/d7a/deb 0 2024-09-21T08:02:33.821 INFO:tasks.workunit.client.1.smithi129.stdout:3/647: write d3/da/dc/f62 [2168072,67157] 0 2024-09-21T08:02:33.828 INFO:tasks.workunit.client.1.smithi129.stdout:4/501: dread d5/f3c [0,4194304] 0 2024-09-21T08:02:33.830 INFO:tasks.workunit.client.1.smithi129.stdout:5/640: write d2/d2a/d50/f4f [584036,117491] 0 2024-09-21T08:02:33.832 INFO:tasks.workunit.client.1.smithi129.stdout:4/502: getdents d5/d16/d24/d4f/da1 0 2024-09-21T08:02:33.838 INFO:tasks.workunit.client.1.smithi129.stdout:5/641: creat d2/d2a/d50/db1/d71/fc1 x:0 0 0 2024-09-21T08:02:33.842 INFO:tasks.workunit.client.1.smithi129.stdout:6/525: dwrite d7/d1b/d25/d2b/d3e/d5e/fa0 [0,4194304] 0 2024-09-21T08:02:33.842 INFO:tasks.workunit.client.1.smithi129.stdout:6/526: readlink d7/d1b/d1e/d39/d4b/d6e/l77 0 2024-09-21T08:02:33.842 INFO:tasks.workunit.client.1.smithi129.stdout:5/642: rename d2/d1e/d35/d33/f3e to d2/d1e/d6b/fc2 0 2024-09-21T08:02:33.845 INFO:tasks.workunit.client.1.smithi129.stdout:8/474: dwrite d0/d6/d7/d3a/f6d [0,4194304] 0 2024-09-21T08:02:33.852 INFO:tasks.workunit.client.1.smithi129.stdout:6/527: rename d7/d10/f22 to d7/d1b/d1e/d39/fb4 0 2024-09-21T08:02:33.852 INFO:tasks.workunit.client.1.smithi129.stdout:6/528: creat d7/d1b/d1e/fb5 x:0 0 0 2024-09-21T08:02:33.852 INFO:tasks.workunit.client.1.smithi129.stdout:6/529: readlink d7/d1b/d57/l75 0 2024-09-21T08:02:33.852 INFO:tasks.workunit.client.1.smithi129.stdout:6/530: stat d7/d1b/d25/l2a 0 2024-09-21T08:02:33.855 INFO:tasks.workunit.client.1.smithi129.stdout:3/648: dwrite d3/d69/d95/d52/f9c [0,4194304] 0 2024-09-21T08:02:33.855 INFO:tasks.workunit.client.1.smithi129.stdout:3/649: dread - d3/d69/d95/fd9 zero size 2024-09-21T08:02:33.856 INFO:tasks.workunit.client.1.smithi129.stdout:8/475: mknod d0/d6/d7/d18/d61/d7f/c96 0 2024-09-21T08:02:33.859 INFO:tasks.workunit.client.1.smithi129.stdout:6/531: dread d7/d1b/d1e/d39/f46 [0,4194304] 0 2024-09-21T08:02:33.861 INFO:tasks.workunit.client.1.smithi129.stdout:6/532: dread d7/f82 [0,4194304] 0 2024-09-21T08:02:33.862 INFO:tasks.workunit.client.1.smithi129.stdout:1/693: dwrite d1/d4/dc2/dc6/fb8 [0,4194304] 0 2024-09-21T08:02:33.862 INFO:tasks.workunit.client.1.smithi129.stdout:1/694: readlink d1/d9/le6 0 2024-09-21T08:02:33.862 INFO:tasks.workunit.client.1.smithi129.stdout:1/695: creat d1/d44/d83/fed x:0 0 0 2024-09-21T08:02:33.863 INFO:tasks.workunit.client.1.smithi129.stdout:3/650: creat d3/da/d5d/d94/db3/dc3/fe5 x:0 0 0 2024-09-21T08:02:33.864 INFO:tasks.workunit.client.1.smithi129.stdout:0/553: dwrite fd [0,4194304] 0 2024-09-21T08:02:33.872 INFO:tasks.workunit.client.1.smithi129.stdout:5/643: dwrite d2/d1e/d6b/fc2 [0,4194304] 0 2024-09-21T08:02:33.873 INFO:tasks.workunit.client.1.smithi129.stdout:5/644: read d2/d2a/f2e [17349,48741] 0 2024-09-21T08:02:33.875 INFO:tasks.workunit.client.1.smithi129.stdout:8/476: dwrite d0/d6/d7/d24/f46 [0,4194304] 0 2024-09-21T08:02:33.875 INFO:tasks.workunit.client.1.smithi129.stdout:8/477: truncate d0/d6/d7/d18/d27/d32/d70/f8c 155564 0 2024-09-21T08:02:33.875 INFO:tasks.workunit.client.1.smithi129.stdout:0/554: mkdir de/d15/d39/d5b/db1 0 2024-09-21T08:02:33.875 INFO:tasks.workunit.client.1.smithi129.stdout:0/555: chown de/d1f 6028 1 2024-09-21T08:02:33.877 INFO:tasks.workunit.client.1.smithi129.stdout:1/696: getdents d1/d16/db3 0 2024-09-21T08:02:33.880 INFO:tasks.workunit.client.1.smithi129.stdout:5/645: rmdir d2/d2a/d50/db1 39 2024-09-21T08:02:33.885 INFO:tasks.workunit.client.1.smithi129.stdout:8/478: mkdir d0/d6/d7/d18/d27/d60/d97 0 2024-09-21T08:02:33.885 INFO:tasks.workunit.client.1.smithi129.stdout:8/479: stat d0/d6/d7/d9/f12 0 2024-09-21T08:02:33.886 INFO:tasks.workunit.client.1.smithi129.stdout:3/651: dwrite d3/d57/fc4 [0,4194304] 0 2024-09-21T08:02:33.886 INFO:tasks.workunit.client.1.smithi129.stdout:3/652: creat d3/d5a/fe6 x:0 0 0 2024-09-21T08:02:33.887 INFO:tasks.workunit.client.1.smithi129.stdout:0/556: mkdir de/d22/d27/d85/db2 0 2024-09-21T08:02:33.887 INFO:tasks.workunit.client.1.smithi129.stdout:0/557: chown de/d22/d27/d2f 20142 1 2024-09-21T08:02:33.889 INFO:tasks.workunit.client.1.smithi129.stdout:5/646: symlink d2/d1e/d35/d33/da1/lc3 0 2024-09-21T08:02:33.892 INFO:tasks.workunit.client.1.smithi129.stdout:1/697: dread d1/d9/f1a [0,4194304] 0 2024-09-21T08:02:33.894 INFO:tasks.workunit.client.1.smithi129.stdout:8/480: creat d0/d6/f98 x:0 0 0 2024-09-21T08:02:33.896 INFO:tasks.workunit.client.1.smithi129.stdout:0/558: write de/f12 [1727925,98489] 0 2024-09-21T08:02:33.898 INFO:tasks.workunit.client.1.smithi129.stdout:1/698: dread d1/f55 [0,4194304] 0 2024-09-21T08:02:33.900 INFO:tasks.workunit.client.1.smithi129.stdout:3/653: creat d3/da/dc/d7f/dd6/fe7 x:0 0 0 2024-09-21T08:02:33.902 INFO:tasks.workunit.client.1.smithi129.stdout:5/647: creat d2/d1e/d35/d33/d36/fc4 x:0 0 0 2024-09-21T08:02:33.904 INFO:tasks.workunit.client.1.smithi129.stdout:8/481: read d0/d6/f1a [1912895,82262] 0 2024-09-21T08:02:33.904 INFO:tasks.workunit.client.1.smithi129.stdout:8/482: fdatasync d0/d6/d7/d18/d27/d32/f4a 0 2024-09-21T08:02:33.906 INFO:tasks.workunit.client.1.smithi129.stdout:0/559: rename de/d15/c3f to de/d15/d39/d56/cb3 0 2024-09-21T08:02:33.908 INFO:tasks.workunit.client.1.smithi129.stdout:1/699: mknod d1/d16/d57/cee 0 2024-09-21T08:02:33.910 INFO:tasks.workunit.client.1.smithi129.stdout:3/654: symlink d3/da/dc/da3/le8 0 2024-09-21T08:02:33.910 INFO:tasks.workunit.client.1.smithi129.stdout:0/560: dread f7 [0,4194304] 0 2024-09-21T08:02:33.910 INFO:tasks.workunit.client.1.smithi129.stdout:0/561: write de/d22/d27/d2f/f61 [760115,10293] 0 2024-09-21T08:02:33.911 INFO:tasks.workunit.client.1.smithi129.stdout:1/700: symlink d1/d4/d6e/lef 0 2024-09-21T08:02:33.911 INFO:tasks.workunit.client.1.smithi129.stdout:5/648: write d2/d2a/d50/d61/f6e [1754461,30974] 0 2024-09-21T08:02:33.913 INFO:tasks.workunit.client.1.smithi129.stdout:3/655: creat d3/d69/d95/de1/fe9 x:0 0 0 2024-09-21T08:02:33.914 INFO:tasks.workunit.client.1.smithi129.stdout:3/656: read d3/da/f54 [206705,4684] 0 2024-09-21T08:02:33.915 INFO:tasks.workunit.client.1.smithi129.stdout:0/562: truncate de/d15/d44/d4b/fa8 2112651 0 2024-09-21T08:02:33.919 INFO:tasks.workunit.client.1.smithi129.stdout:8/483: dwrite d0/d6/f4c [0,4194304] 0 2024-09-21T08:02:33.920 INFO:tasks.workunit.client.1.smithi129.stdout:3/657: truncate d3/da/dc/d11/d2f/f40 2054760 0 2024-09-21T08:02:33.920 INFO:tasks.workunit.client.1.smithi129.stdout:3/658: truncate d3/da/d5d/d94/db3/dc3/fe5 851910 0 2024-09-21T08:02:33.920 INFO:tasks.workunit.client.1.smithi129.stdout:3/659: write d3/faa [91532,74633] 0 2024-09-21T08:02:33.920 INFO:tasks.workunit.client.1.smithi129.stdout:3/660: write d3/da/dc/d11/d2f/fb6 [711427,55828] 0 2024-09-21T08:02:33.922 INFO:tasks.workunit.client.1.smithi129.stdout:0/563: creat de/d22/fb4 x:0 0 0 2024-09-21T08:02:33.924 INFO:tasks.workunit.client.1.smithi129.stdout:1/701: rmdir d1/d44/db9 39 2024-09-21T08:02:33.924 INFO:tasks.workunit.client.1.smithi129.stdout:1/702: readlink d1/d9/l67 0 2024-09-21T08:02:33.926 INFO:tasks.workunit.client.1.smithi129.stdout:8/484: link d0/d6/d7/d5a/f5c d0/d6/d7/d18/d27/d60/d85/f99 0 2024-09-21T08:02:33.926 INFO:tasks.workunit.client.1.smithi129.stdout:8/485: write d0/d6/d7/d18/d27/d32/d37/f42 [1358457,85180] 0 2024-09-21T08:02:33.926 INFO:tasks.workunit.client.1.smithi129.stdout:8/486: write d0/f67 [611055,20781] 0 2024-09-21T08:02:33.927 INFO:tasks.workunit.client.1.smithi129.stdout:1/703: dread d1/d4/d6e/fd3 [4194304,4194304] 0 2024-09-21T08:02:33.927 INFO:tasks.workunit.client.1.smithi129.stdout:1/704: fsync d1/d16/d28/f33 0 2024-09-21T08:02:33.927 INFO:tasks.workunit.client.1.smithi129.stdout:3/661: symlink d3/da/dc/d11/lea 0 2024-09-21T08:02:33.929 INFO:tasks.workunit.client.1.smithi129.stdout:0/564: rename de/d1f/da9/f9f to de/d15/d44/da6/fb5 0 2024-09-21T08:02:33.932 INFO:tasks.workunit.client.1.smithi129.stdout:1/705: mknod d1/d16/d8f/cf0 0 2024-09-21T08:02:33.932 INFO:tasks.workunit.client.1.smithi129.stdout:1/706: chown d1/d4/fc0 359365 1 2024-09-21T08:02:33.933 INFO:tasks.workunit.client.1.smithi129.stdout:2/770: sync 2024-09-21T08:02:33.933 INFO:tasks.workunit.client.1.smithi129.stdout:2/771: readlink d1/la9 0 2024-09-21T08:02:33.933 INFO:tasks.workunit.client.1.smithi129.stdout:7/654: sync 2024-09-21T08:02:33.934 INFO:tasks.workunit.client.1.smithi129.stdout:7/655: creat d0/fd6 x:0 0 0 2024-09-21T08:02:33.934 INFO:tasks.workunit.client.1.smithi129.stdout:7/656: chown d0/d1e/l68 2009795780 1 2024-09-21T08:02:33.935 INFO:tasks.workunit.client.1.smithi129.stdout:0/565: rmdir de/d15/d39/d9e 39 2024-09-21T08:02:33.936 INFO:tasks.workunit.client.1.smithi129.stdout:2/772: truncate d1/dc/ff 2993153 0 2024-09-21T08:02:33.937 INFO:tasks.workunit.client.1.smithi129.stdout:2/773: write d1/dc/d19/d88/fd3 [739346,10282] 0 2024-09-21T08:02:33.938 INFO:tasks.workunit.client.1.smithi129.stdout:7/657: dread d0/d46/d6e/f7d [0,4194304] 0 2024-09-21T08:02:33.938 INFO:tasks.workunit.client.1.smithi129.stdout:7/658: dread - d0/d46/d8e/d90/fab zero size 2024-09-21T08:02:33.938 INFO:tasks.workunit.client.1.smithi129.stdout:7/659: write d0/d46/d6e/f85 [5649359,116418] 0 2024-09-21T08:02:33.940 INFO:tasks.workunit.client.1.smithi129.stdout:0/566: rmdir de/d15/d44/d45/da0 39 2024-09-21T08:02:33.940 INFO:tasks.workunit.client.1.smithi129.stdout:3/662: dread d3/da/dc/d11/d2f/fbf [4194304,4194304] 0 2024-09-21T08:02:33.941 INFO:tasks.workunit.client.1.smithi129.stdout:2/774: symlink d1/d13/d3a/d47/d5f/l114 0 2024-09-21T08:02:33.943 INFO:tasks.workunit.client.1.smithi129.stdout:7/660: mknod d0/d46/d8e/d8f/cd7 0 2024-09-21T08:02:33.944 INFO:tasks.workunit.client.1.smithi129.stdout:0/567: symlink de/d1f/da9/lb6 0 2024-09-21T08:02:33.946 INFO:tasks.workunit.client.1.smithi129.stdout:5/649: dwrite d2/d1e/d35/ff [0,4194304] 0 2024-09-21T08:02:33.946 INFO:tasks.workunit.client.1.smithi129.stdout:5/650: fdatasync d2/d1e/d35/f7c 0 2024-09-21T08:02:33.946 INFO:tasks.workunit.client.1.smithi129.stdout:5/651: write d2/d2a/f68 [4339182,20675] 0 2024-09-21T08:02:33.947 INFO:tasks.workunit.client.1.smithi129.stdout:8/487: dwrite d0/d6/d7/d9/f2a [0,4194304] 0 2024-09-21T08:02:33.949 INFO:tasks.workunit.client.1.smithi129.stdout:2/775: creat d1/dc/d19/d4c/d6a/f115 x:0 0 0 2024-09-21T08:02:33.949 INFO:tasks.workunit.client.1.smithi129.stdout:2/776: dread - d1/d13/d3a/d47/d1f/d85/df7/d45/d65/fe3 zero size 2024-09-21T08:02:33.950 INFO:tasks.workunit.client.1.smithi129.stdout:0/568: rename de/d22/d27/d30/f71 to de/d15/d39/d7f/fb7 0 2024-09-21T08:02:33.955 INFO:tasks.workunit.client.1.smithi129.stdout:5/652: write d2/f24 [1148562,51113] 0 2024-09-21T08:02:33.955 INFO:tasks.workunit.client.1.smithi129.stdout:5/653: chown d2/d2a/d50/db1/la3 1970213 1 2024-09-21T08:02:33.955 INFO:tasks.workunit.client.1.smithi129.stdout:5/654: fdatasync d2/f1b 0 2024-09-21T08:02:33.965 INFO:tasks.workunit.client.1.smithi129.stdout:7/661: dwrite d0/d1e/fa4 [0,4194304] 0 2024-09-21T08:02:33.965 INFO:tasks.workunit.client.1.smithi129.stdout:7/662: dread - d0/d46/d6e/d9b/da5/db7/fd1 zero size 2024-09-21T08:02:33.965 INFO:tasks.workunit.client.1.smithi129.stdout:3/663: rmdir d3/d69/d98 39 2024-09-21T08:02:33.965 INFO:tasks.workunit.client.1.smithi129.stdout:3/664: chown d3/l38 1890673 1 2024-09-21T08:02:33.965 INFO:tasks.workunit.client.1.smithi129.stdout:3/665: chown d3/d57/da2/fb8 293 1 2024-09-21T08:02:33.967 INFO:tasks.workunit.client.1.smithi129.stdout:8/488: truncate d0/d6/d7/d18/d27/d32/f4a 3129600 0 2024-09-21T08:02:33.968 INFO:tasks.workunit.client.1.smithi129.stdout:2/777: dwrite d1/dc/ff9 [0,4194304] 0 2024-09-21T08:02:33.978 INFO:tasks.workunit.client.1.smithi129.stdout:0/569: mknod de/d15/d39/d5b/db1/cb8 0 2024-09-21T08:02:33.978 INFO:tasks.workunit.client.1.smithi129.stdout:0/570: write de/d22/d27/d2f/d42/f77 [5387256,93494] 0 2024-09-21T08:02:33.978 INFO:tasks.workunit.client.1.smithi129.stdout:0/571: fdatasync de/f64 0 2024-09-21T08:02:33.978 INFO:tasks.workunit.client.1.smithi129.stdout:0/572: chown de/d22/d27/l53 283 1 2024-09-21T08:02:33.978 INFO:tasks.workunit.client.1.smithi129.stdout:0/573: write de/d1f/f34 [304642,120146] 0 2024-09-21T08:02:33.979 INFO:tasks.workunit.client.1.smithi129.stdout:8/489: write d0/d6/f4c [1577354,123108] 0 2024-09-21T08:02:33.979 INFO:tasks.workunit.client.1.smithi129.stdout:2/778: write d1/d53/d77/fd1 [2720948,31253] 0 2024-09-21T08:02:33.980 INFO:tasks.workunit.client.1.smithi129.stdout:5/655: mkdir d2/d1e/d35/d37/d65/dc5 0 2024-09-21T08:02:33.980 INFO:tasks.workunit.client.1.smithi129.stdout:5/656: stat d2/d2a/d50/f4f 0 2024-09-21T08:02:33.982 INFO:tasks.workunit.client.1.smithi129.stdout:7/663: creat d0/d46/d6e/d9b/da5/fd8 x:0 0 0 2024-09-21T08:02:33.985 INFO:tasks.workunit.client.1.smithi129.stdout:3/666: dwrite d3/d69/d95/d52/f8e [0,4194304] 0 2024-09-21T08:02:33.988 INFO:tasks.workunit.client.1.smithi129.stdout:0/574: unlink de/d15/d39/d56/f5f 0 2024-09-21T08:02:33.989 INFO:tasks.workunit.client.1.smithi129.stdout:2/779: mkdir d1/dc/d94/d116 0 2024-09-21T08:02:33.990 INFO:tasks.workunit.client.1.smithi129.stdout:8/490: read d0/d6/d7/d24/f46 [3532977,68400] 0 2024-09-21T08:02:33.990 INFO:tasks.workunit.client.1.smithi129.stdout:8/491: write d0/d6/d7/d5a/f8a [810249,119212] 0 2024-09-21T08:02:33.996 INFO:tasks.workunit.client.1.smithi129.stdout:0/575: creat de/d15/d44/da6/fb9 x:0 0 0 2024-09-21T08:02:33.996 INFO:tasks.workunit.client.1.smithi129.stdout:0/576: write de/d22/d27/d30/f93 [6095219,39505] 0 2024-09-21T08:02:33.997 INFO:tasks.workunit.client.1.smithi129.stdout:7/664: dread d0/f5e [0,4194304] 0 2024-09-21T08:02:34.005 INFO:tasks.workunit.client.1.smithi129.stdout:3/667: getdents d3/d5a 0 2024-09-21T08:02:34.005 INFO:tasks.workunit.client.1.smithi129.stdout:3/668: chown d3/da 21 1 2024-09-21T08:02:34.006 INFO:tasks.workunit.client.1.smithi129.stdout:3/669: dread d3/da/dc/d7f/fd0 [0,4194304] 0 2024-09-21T08:02:34.007 INFO:tasks.workunit.client.1.smithi129.stdout:0/577: mkdir de/d15/d39/d9e/dac/dba 0 2024-09-21T08:02:34.008 INFO:tasks.workunit.client.1.smithi129.stdout:7/665: symlink d0/ld9 0 2024-09-21T08:02:34.008 INFO:tasks.workunit.client.1.smithi129.stdout:7/666: write d0/d46/d6e/d9b/fcb [2482,54317] 0 2024-09-21T08:02:34.008 INFO:tasks.workunit.client.1.smithi129.stdout:7/667: chown d0/d1e/l68 8651433 1 2024-09-21T08:02:34.009 INFO:tasks.workunit.client.1.smithi129.stdout:9/540: sync 2024-09-21T08:02:34.012 INFO:tasks.workunit.client.1.smithi129.stdout:3/670: creat d3/da/dc/d7f/dd6/de2/feb x:0 0 0 2024-09-21T08:02:34.014 INFO:tasks.workunit.client.1.smithi129.stdout:0/578: link de/d1f/da9/f7c de/d19/d5e/fbb 0 2024-09-21T08:02:34.015 INFO:tasks.workunit.client.1.smithi129.stdout:5/657: dwrite d2/d1e/d35/f2d [0,4194304] 0 2024-09-21T08:02:34.015 INFO:tasks.workunit.client.1.smithi129.stdout:5/658: creat d2/d2a/d50/db1/d71/fc6 x:0 0 0 2024-09-21T08:02:34.015 INFO:tasks.workunit.client.1.smithi129.stdout:5/659: chown d2/d1e/d35/d37/d7d/ca2 11683180 1 2024-09-21T08:02:34.015 INFO:tasks.workunit.client.1.smithi129.stdout:5/660: fsync d2/d1e/d35/f2c 0 2024-09-21T08:02:34.015 INFO:tasks.workunit.client.1.smithi129.stdout:5/661: truncate d2/d1e/d35/d33/d36/f42 668786 0 2024-09-21T08:02:34.015 INFO:tasks.workunit.client.1.smithi129.stdout:5/662: write d2/f1b [1020137,15261] 0 2024-09-21T08:02:34.015 INFO:tasks.workunit.client.1.smithi129.stdout:5/663: read d2/d2a/f2e [560797,100800] 0 2024-09-21T08:02:34.015 INFO:tasks.workunit.client.1.smithi129.stdout:8/492: dwrite d0/d6/d7/d9/f5f [0,4194304] 0 2024-09-21T08:02:34.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:33 smithi129 ceph-mon[34472]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:34.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:33 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/211850711' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:02:34.017 INFO:tasks.workunit.client.1.smithi129.stdout:8/493: dread d0/d6/d7/d18/d27/d32/d70/f8c [0,4194304] 0 2024-09-21T08:02:34.017 INFO:tasks.workunit.client.1.smithi129.stdout:7/668: link d0/d46/d8e/c91 d0/d1e/db1/dba/cda 0 2024-09-21T08:02:34.019 INFO:tasks.workunit.client.1.smithi129.stdout:4/503: sync 2024-09-21T08:02:34.019 INFO:tasks.workunit.client.1.smithi129.stdout:6/533: sync 2024-09-21T08:02:34.019 INFO:tasks.workunit.client.1.smithi129.stdout:0/579: mknod de/d19/dad/cbc 0 2024-09-21T08:02:34.020 INFO:tasks.workunit.client.1.smithi129.stdout:6/534: fsync d7/d1b/d25/d35/f91 0 2024-09-21T08:02:34.023 INFO:tasks.workunit.client.1.smithi129.stdout:7/669: symlink d0/d46/d6e/d9b/da5/ldb 0 2024-09-21T08:02:34.025 INFO:tasks.workunit.client.1.smithi129.stdout:0/580: symlink de/d15/lbd 0 2024-09-21T08:02:34.027 INFO:tasks.workunit.client.1.smithi129.stdout:8/494: dread d0/d6/f1a [0,4194304] 0 2024-09-21T08:02:34.027 INFO:tasks.workunit.client.1.smithi129.stdout:8/495: fdatasync d0/d6/d7/d18/d27/d32/d70/f8c 0 2024-09-21T08:02:34.027 INFO:tasks.workunit.client.1.smithi129.stdout:6/535: unlink d7/d1b/d25/d35/d40/d41/f48 0 2024-09-21T08:02:34.031 INFO:tasks.workunit.client.1.smithi129.stdout:7/670: rename d0/f17 to d0/d1e/db1/dba/dc1/fdc 0 2024-09-21T08:02:34.031 INFO:tasks.workunit.client.1.smithi129.stdout:7/671: dread - d0/d46/d8e/d90/fab zero size 2024-09-21T08:02:34.035 INFO:tasks.workunit.client.1.smithi129.stdout:6/536: chown d7/c3b 30560 1 2024-09-21T08:02:34.037 INFO:tasks.workunit.client.1.smithi129.stdout:4/504: read d5/f39 [1686529,106552] 0 2024-09-21T08:02:34.037 INFO:tasks.workunit.client.1.smithi129.stdout:7/672: creat d0/d1e/db1/dba/dc1/dc4/fdd x:0 0 0 2024-09-21T08:02:34.037 INFO:tasks.workunit.client.1.smithi129.stdout:9/541: dwrite f10 [0,4194304] 0 2024-09-21T08:02:34.038 INFO:tasks.workunit.client.1.smithi129.stdout:0/581: getdents de/d22/d27/d2f 0 2024-09-21T08:02:34.039 INFO:tasks.workunit.client.1.smithi129.stdout:0/582: write de/d22/d27/d2f/f61 [729056,64876] 0 2024-09-21T08:02:34.039 INFO:tasks.workunit.client.1.smithi129.stdout:0/583: read - de/d1f/f9b zero size 2024-09-21T08:02:34.039 INFO:tasks.workunit.client.1.smithi129.stdout:4/505: mknod d5/d11/d3f/d50/cb5 0 2024-09-21T08:02:34.041 INFO:tasks.workunit.client.1.smithi129.stdout:7/673: symlink d0/d1e/db1/lde 0 2024-09-21T08:02:34.042 INFO:tasks.workunit.client.1.smithi129.stdout:9/542: readlink d17/d22/l4e 0 2024-09-21T08:02:34.043 INFO:tasks.workunit.client.1.smithi129.stdout:3/671: dwrite d3/d69/d95/f4e [0,4194304] 0 2024-09-21T08:02:34.048 INFO:tasks.workunit.client.1.smithi129.stdout:4/506: symlink d5/d33/d4e/lb6 0 2024-09-21T08:02:34.051 INFO:tasks.workunit.client.1.smithi129.stdout:5/664: dwrite d2/d1e/d35/f12 [0,4194304] 0 2024-09-21T08:02:34.051 INFO:tasks.workunit.client.1.smithi129.stdout:5/665: chown d2/d2a/d50/db1/l90 517621 1 2024-09-21T08:02:34.051 INFO:tasks.workunit.client.1.smithi129.stdout:7/674: rename d0/c3a to d0/d46/d8e/cdf 0 2024-09-21T08:02:34.052 INFO:tasks.workunit.client.1.smithi129.stdout:4/507: symlink d5/d48/da9/lb7 0 2024-09-21T08:02:34.052 INFO:tasks.workunit.client.1.smithi129.stdout:4/508: fdatasync d5/d16/d24/d3b/f97 0 2024-09-21T08:02:34.054 INFO:tasks.workunit.client.1.smithi129.stdout:9/543: rename d17/d23/f8b to d17/d60/d7b/fb3 0 2024-09-21T08:02:34.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:33 smithi107 ceph-mon[27622]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:34.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:33 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/211850711' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:02:34.055 INFO:tasks.workunit.client.1.smithi129.stdout:6/537: dread d7/d4a/d69/faf [0,4194304] 0 2024-09-21T08:02:34.057 INFO:tasks.workunit.client.1.smithi129.stdout:9/544: creat d17/d22/d33/d7a/d89/fb4 x:0 0 0 2024-09-21T08:02:34.057 INFO:tasks.workunit.client.1.smithi129.stdout:9/545: creat d17/d22/d33/d36/d48/d75/fb5 x:0 0 0 2024-09-21T08:02:34.059 INFO:tasks.workunit.client.1.smithi129.stdout:7/675: getdents d0/d46/d6e/d9b 0 2024-09-21T08:02:34.061 INFO:tasks.workunit.client.1.smithi129.stdout:6/538: mkdir d7/d1b/d25/d2b/db6 0 2024-09-21T08:02:34.061 INFO:tasks.workunit.client.1.smithi129.stdout:6/539: chown d7 2878 1 2024-09-21T08:02:34.062 INFO:tasks.workunit.client.1.smithi129.stdout:5/666: read d2/f60 [1325614,83033] 0 2024-09-21T08:02:34.063 INFO:tasks.workunit.client.1.smithi129.stdout:4/509: dread d5/d16/d24/d3b/f65 [0,4194304] 0 2024-09-21T08:02:34.065 INFO:tasks.workunit.client.1.smithi129.stdout:7/676: mkdir d0/d46/de0 0 2024-09-21T08:02:34.065 INFO:tasks.workunit.client.1.smithi129.stdout:7/677: stat d0/d46/d6e/d9b/fcb 0 2024-09-21T08:02:34.065 INFO:tasks.workunit.client.1.smithi129.stdout:7/678: fdatasync d0/d46/d6e/f83 0 2024-09-21T08:02:34.065 INFO:tasks.workunit.client.1.smithi129.stdout:7/679: creat d0/d46/d8e/d8f/fe1 x:0 0 0 2024-09-21T08:02:34.067 INFO:tasks.workunit.client.1.smithi129.stdout:3/672: dwrite d3/d57/d80/fd8 [0,4194304] 0 2024-09-21T08:02:34.067 INFO:tasks.workunit.client.1.smithi129.stdout:4/510: symlink d5/d11/d3f/lb8 0 2024-09-21T08:02:34.067 INFO:tasks.workunit.client.1.smithi129.stdout:4/511: readlink d5/l9d 0 2024-09-21T08:02:34.072 INFO:tasks.workunit.client.1.smithi129.stdout:9/546: read d17/d22/d33/d7a/d89/d90/db1/d31/d5e/d6b/f79 [2801659,106149] 0 2024-09-21T08:02:34.073 INFO:tasks.workunit.client.1.smithi129.stdout:7/680: symlink d0/d1e/d9a/dca/le2 0 2024-09-21T08:02:34.074 INFO:tasks.workunit.client.1.smithi129.stdout:0/584: dwrite de/f36 [0,4194304] 0 2024-09-21T08:02:34.074 INFO:tasks.workunit.client.1.smithi129.stdout:5/667: dread d2/d1e/d35/ff [0,4194304] 0 2024-09-21T08:02:34.074 INFO:tasks.workunit.client.1.smithi129.stdout:5/668: chown d2/d1e/f56 826 1 2024-09-21T08:02:34.075 INFO:tasks.workunit.client.1.smithi129.stdout:3/673: creat d3/d57/fec x:0 0 0 2024-09-21T08:02:34.075 INFO:tasks.workunit.client.1.smithi129.stdout:3/674: chown d3/da/d5d/d94/la1 130723 1 2024-09-21T08:02:34.075 INFO:tasks.workunit.client.1.smithi129.stdout:6/540: dwrite d7/d1b/d25/d35/d40/d78/faa [0,4194304] 0 2024-09-21T08:02:34.075 INFO:tasks.workunit.client.1.smithi129.stdout:6/541: write d7/d1b/d1e/d39/f46 [2179923,81091] 0 2024-09-21T08:02:34.076 INFO:tasks.workunit.client.1.smithi129.stdout:4/512: mknod d5/cb9 0 2024-09-21T08:02:34.076 INFO:tasks.workunit.client.1.smithi129.stdout:4/513: write d5/f2b [492543,89504] 0 2024-09-21T08:02:34.084 INFO:tasks.workunit.client.1.smithi129.stdout:3/675: dread d3/d69/d95/f91 [0,4194304] 0 2024-09-21T08:02:34.086 INFO:tasks.workunit.client.1.smithi129.stdout:9/547: mkdir d17/d22/d33/d7a/d89/d90/db1/d31/d5e/d6b/db6 0 2024-09-21T08:02:34.086 INFO:tasks.workunit.client.1.smithi129.stdout:9/548: readlink d17/d22/d33/d36/d76/l86 0 2024-09-21T08:02:34.088 INFO:tasks.workunit.client.1.smithi129.stdout:7/681: rename d0/d46/d6e/f7d to d0/d46/d6e/d9b/da5/db7/fe3 0 2024-09-21T08:02:34.088 INFO:tasks.workunit.client.1.smithi129.stdout:7/682: read d0/f41 [257885,115827] 0 2024-09-21T08:02:34.090 INFO:tasks.workunit.client.1.smithi129.stdout:7/683: dread d0/d1e/f3e [0,4194304] 0 2024-09-21T08:02:34.092 INFO:tasks.workunit.client.1.smithi129.stdout:0/585: rmdir de/d22/d27/d2f/d42 39 2024-09-21T08:02:34.093 INFO:tasks.workunit.client.1.smithi129.stdout:5/669: mknod d2/d1e/d6b/cc7 0 2024-09-21T08:02:34.097 INFO:tasks.workunit.client.1.smithi129.stdout:6/542: mknod d7/d1b/d57/d96/cb7 0 2024-09-21T08:02:34.099 INFO:tasks.workunit.client.1.smithi129.stdout:4/514: creat d5/fba x:0 0 0 2024-09-21T08:02:34.099 INFO:tasks.workunit.client.1.smithi129.stdout:4/515: chown d5/d33/d6d/ca6 227096177 1 2024-09-21T08:02:34.101 INFO:tasks.workunit.client.1.smithi129.stdout:3/676: link d3/da/dc/f73 d3/da/dc/d11/fed 0 2024-09-21T08:02:34.101 INFO:tasks.workunit.client.1.smithi129.stdout:5/670: write d2/d1e/d35/f12 [6961405,71613] 0 2024-09-21T08:02:34.102 INFO:tasks.workunit.client.1.smithi129.stdout:9/549: mkdir d17/d22/d33/d36/d48/db7 0 2024-09-21T08:02:34.104 INFO:tasks.workunit.client.1.smithi129.stdout:7/684: mkdir d0/d46/d6e/de4 0 2024-09-21T08:02:34.105 INFO:tasks.workunit.client.1.smithi129.stdout:0/586: mkdir de/d22/d27/d85/db2/dbe 0 2024-09-21T08:02:34.106 INFO:tasks.workunit.client.1.smithi129.stdout:6/543: unlink d7/d1b/d1e/d39/f5f 0 2024-09-21T08:02:34.114 INFO:tasks.workunit.client.1.smithi129.stdout:7/685: read d0/d46/d6e/dad/fce [2878746,72444] 0 2024-09-21T08:02:34.115 INFO:tasks.workunit.client.1.smithi129.stdout:3/677: rename d3/da/f2e to d3/d57/da2/fee 0 2024-09-21T08:02:34.117 INFO:tasks.workunit.client.1.smithi129.stdout:0/587: symlink de/d15/d44/d45/lbf 0 2024-09-21T08:02:34.120 INFO:tasks.workunit.client.1.smithi129.stdout:7/686: mkdir d0/d46/d6e/d9b/de5 0 2024-09-21T08:02:34.121 INFO:tasks.workunit.client.1.smithi129.stdout:0/588: dread de/d19/f38 [0,4194304] 0 2024-09-21T08:02:34.121 INFO:tasks.workunit.client.1.smithi129.stdout:0/589: write de/d15/d44/da6/fb5 [841353,40071] 0 2024-09-21T08:02:34.124 INFO:tasks.workunit.client.1.smithi129.stdout:4/516: dwrite d5/d16/d24/fa0 [0,4194304] 0 2024-09-21T08:02:34.124 INFO:tasks.workunit.client.1.smithi129.stdout:9/550: dwrite d17/d22/d33/f7f [0,4194304] 0 2024-09-21T08:02:34.124 INFO:tasks.workunit.client.1.smithi129.stdout:9/551: truncate d17/d46/f39 4417952 0 2024-09-21T08:02:34.124 INFO:tasks.workunit.client.1.smithi129.stdout:5/671: rename d2/d1e/d35/d37/d7d/ca2 to d2/d1e/d35/d33/d36/d5a/d77/d81/cc8 0 2024-09-21T08:02:34.124 INFO:tasks.workunit.client.1.smithi129.stdout:5/672: read d2/d1e/d35/d33/f4b [921107,37954] 0 2024-09-21T08:02:34.124 INFO:tasks.workunit.client.1.smithi129.stdout:9/552: dread d17/d22/d33/d36/d48/d75/fa8 [0,4194304] 0 2024-09-21T08:02:34.125 INFO:tasks.workunit.client.1.smithi129.stdout:3/678: mkdir d3/da/def 0 2024-09-21T08:02:34.126 INFO:tasks.workunit.client.1.smithi129.stdout:0/590: dread f0 [0,4194304] 0 2024-09-21T08:02:34.126 INFO:tasks.workunit.client.1.smithi129.stdout:0/591: write de/d15/d39/f8a [824667,45652] 0 2024-09-21T08:02:34.127 INFO:tasks.workunit.client.1.smithi129.stdout:7/687: symlink d0/d46/d6e/d9b/le6 0 2024-09-21T08:02:34.127 INFO:tasks.workunit.client.1.smithi129.stdout:7/688: chown d0/l3f 1987899 1 2024-09-21T08:02:34.132 INFO:tasks.workunit.client.1.smithi129.stdout:4/517: symlink d5/d16/d24/d3b/lbb 0 2024-09-21T08:02:34.132 INFO:tasks.workunit.client.1.smithi129.stdout:4/518: chown d5/d11/d3f/f52 7 1 2024-09-21T08:02:34.133 INFO:tasks.workunit.client.1.smithi129.stdout:5/673: creat d2/d1e/d35/d37/d96/fc9 x:0 0 0 2024-09-21T08:02:34.134 INFO:tasks.workunit.client.1.smithi129.stdout:6/544: dwrite d7/d10/f15 [0,4194304] 0 2024-09-21T08:02:34.135 INFO:tasks.workunit.client.1.smithi129.stdout:6/545: dread - d7/d1b/d57/d96/fa4 zero size 2024-09-21T08:02:34.135 INFO:tasks.workunit.client.1.smithi129.stdout:9/553: creat d17/d22/d33/d36/d76/fb8 x:0 0 0 2024-09-21T08:02:34.135 INFO:tasks.workunit.client.1.smithi129.stdout:9/554: fsync f0 0 2024-09-21T08:02:34.138 INFO:tasks.workunit.client.1.smithi129.stdout:3/679: rename d3/da/f54 to d3/da/def/ff0 0 2024-09-21T08:02:34.138 INFO:tasks.workunit.client.1.smithi129.stdout:3/680: write d3/da/def/ff0 [411283,112654] 0 2024-09-21T08:02:34.139 INFO:tasks.workunit.client.1.smithi129.stdout:0/592: mkdir de/d15/d39/d9e/dac/dba/dc0 0 2024-09-21T08:02:34.140 INFO:tasks.workunit.client.1.smithi129.stdout:7/689: dread d0/d46/d8e/d8f/f98 [0,4194304] 0 2024-09-21T08:02:34.141 INFO:tasks.workunit.client.1.smithi129.stdout:5/674: unlink d2/d1e/d35/d33/d36/d5a/d77/l87 0 2024-09-21T08:02:34.144 INFO:tasks.workunit.client.1.smithi129.stdout:4/519: dread d5/d16/d24/d4f/f54 [0,4194304] 0 2024-09-21T08:02:34.151 INFO:tasks.workunit.client.1.smithi129.stdout:5/675: read d2/d1e/d35/f2d [4173258,20126] 0 2024-09-21T08:02:34.155 INFO:tasks.workunit.client.1.smithi129.stdout:6/546: dwrite d7/d1b/d25/d35/f91 [0,4194304] 0 2024-09-21T08:02:34.155 INFO:tasks.workunit.client.1.smithi129.stdout:6/547: truncate d7/d1b/d25/d2b/fb3 304484 0 2024-09-21T08:02:34.157 INFO:tasks.workunit.client.1.smithi129.stdout:3/681: mkdir d3/d69/d95/de1/df1 0 2024-09-21T08:02:34.157 INFO:tasks.workunit.client.1.smithi129.stdout:3/682: truncate d3/da/dc/d11/fda 986393 0 2024-09-21T08:02:34.157 INFO:tasks.workunit.client.1.smithi129.stdout:3/683: chown d3/d57/d80/fd8 450563004 1 2024-09-21T08:02:34.158 INFO:tasks.workunit.client.1.smithi129.stdout:7/690: symlink d0/d46/d6e/d9b/le7 0 2024-09-21T08:02:34.159 INFO:tasks.workunit.client.1.smithi129.stdout:4/520: mkdir d5/d11/d77/da8/dbc 0 2024-09-21T08:02:34.161 INFO:tasks.workunit.client.1.smithi129.stdout:9/555: getdents d17/d22/d33/d7a/d89 0 2024-09-21T08:02:34.161 INFO:tasks.workunit.client.1.smithi129.stdout:9/556: readlink d17/d60/d7b/l8f 0 2024-09-21T08:02:34.163 INFO:tasks.workunit.client.1.smithi129.stdout:5/676: mkdir d2/d1e/d35/d33/dca 0 2024-09-21T08:02:34.163 INFO:tasks.workunit.client.1.smithi129.stdout:0/593: dwrite de/d15/d39/f4a [0,4194304] 0 2024-09-21T08:02:34.167 INFO:tasks.workunit.client.1.smithi129.stdout:6/548: dread f5 [0,4194304] 0 2024-09-21T08:02:34.167 INFO:tasks.workunit.client.1.smithi129.stdout:3/684: mkdir d3/da/dc/d7f/dd6/de2/df2 0 2024-09-21T08:02:34.169 INFO:tasks.workunit.client.1.smithi129.stdout:7/691: mkdir d0/d1e/d9a/dca/de8 0 2024-09-21T08:02:34.172 INFO:tasks.workunit.client.1.smithi129.stdout:5/677: mknod d2/d1e/d35/d37/d7d/ccb 0 2024-09-21T08:02:34.173 INFO:tasks.workunit.client.1.smithi129.stdout:5/678: write d2/d2a/d50/d61/f72 [1304498,49142] 0 2024-09-21T08:02:34.174 INFO:tasks.workunit.client.1.smithi129.stdout:9/557: dwrite d17/d22/d33/d36/d48/d75/fa8 [0,4194304] 0 2024-09-21T08:02:34.176 INFO:tasks.workunit.client.1.smithi129.stdout:0/594: mkdir de/d19/d5e/dc1 0 2024-09-21T08:02:34.176 INFO:tasks.workunit.client.1.smithi129.stdout:0/595: dread - de/d15/d44/d4b/f58 zero size 2024-09-21T08:02:34.177 INFO:tasks.workunit.client.1.smithi129.stdout:7/692: mknod d0/d1e/ce9 0 2024-09-21T08:02:34.182 INFO:tasks.workunit.client.1.smithi129.stdout:9/558: link d17/d22/d33/d7a/d89/d90/db1/d31/d5e/d6b/f79 d17/d55/fb9 0 2024-09-21T08:02:34.183 INFO:tasks.workunit.client.1.smithi129.stdout:0/596: truncate de/f13 2308433 0 2024-09-21T08:02:34.185 INFO:tasks.workunit.client.1.smithi129.stdout:7/693: creat d0/d46/d6e/d9b/de5/fea x:0 0 0 2024-09-21T08:02:34.186 INFO:tasks.workunit.client.1.smithi129.stdout:4/521: rename d5/d33/d6d/dac to d5/dbd 0 2024-09-21T08:02:34.189 INFO:tasks.workunit.client.1.smithi129.stdout:9/559: link d17/d22/d33/d7a/d89/d90/db1/d31/d5e/cae d17/d46/cba 0 2024-09-21T08:02:34.190 INFO:tasks.workunit.client.1.smithi129.stdout:0/597: mknod de/d19/d5e/cc2 0 2024-09-21T08:02:34.192 INFO:tasks.workunit.client.1.smithi129.stdout:4/522: getdents d5/d48/da9 0 2024-09-21T08:02:34.192 INFO:tasks.workunit.client.1.smithi129.stdout:4/523: fdatasync d5/d6/f30 0 2024-09-21T08:02:34.195 INFO:tasks.workunit.client.1.smithi129.stdout:6/549: rename d7/d7f to d7/d1b/d1e/d39/d79/db8 0 2024-09-21T08:02:34.197 INFO:tasks.workunit.client.1.smithi129.stdout:9/560: creat d17/d22/d33/d7a/d89/d90/db1/d31/d35/fbb x:0 0 0 2024-09-21T08:02:34.199 INFO:tasks.workunit.client.1.smithi129.stdout:0/598: mkdir de/d22/d27/d85/db2/dc3 0 2024-09-21T08:02:34.199 INFO:tasks.workunit.client.1.smithi129.stdout:7/694: dwrite d0/d1e/f40 [0,4194304] 0 2024-09-21T08:02:34.199 INFO:tasks.workunit.client.1.smithi129.stdout:7/695: creat d0/d46/d6e/feb x:0 0 0 2024-09-21T08:02:34.200 INFO:tasks.workunit.client.1.smithi129.stdout:0/599: write de/f12 [4173154,104807] 0 2024-09-21T08:02:34.200 INFO:tasks.workunit.client.1.smithi129.stdout:7/696: write d0/d46/d6e/f85 [6652087,64439] 0 2024-09-21T08:02:34.201 INFO:tasks.workunit.client.1.smithi129.stdout:4/524: symlink d5/d16/d47/d5f/lbe 0 2024-09-21T08:02:34.201 INFO:tasks.workunit.client.1.smithi129.stdout:4/525: fdatasync d5/fba 0 2024-09-21T08:02:34.203 INFO:tasks.workunit.client.1.smithi129.stdout:3/685: rename d3/da/dc/d11/lea to d3/d5a/da9/lf3 0 2024-09-21T08:02:34.203 INFO:tasks.workunit.client.1.smithi129.stdout:3/686: creat d3/da/dc/d11/d2f/ff4 x:0 0 0 2024-09-21T08:02:34.205 INFO:tasks.workunit.client.1.smithi129.stdout:6/550: symlink d7/d1b/d57/d96/lb9 0 2024-09-21T08:02:34.207 INFO:tasks.workunit.client.1.smithi129.stdout:9/561: mknod d17/d22/d33/cbc 0 2024-09-21T08:02:34.211 INFO:tasks.workunit.client.1.smithi129.stdout:3/687: dread d3/da/d5d/f77 [0,4194304] 0 2024-09-21T08:02:34.215 INFO:tasks.workunit.client.1.smithi129.stdout:7/697: mkdir d0/d1e/d9a/dec 0 2024-09-21T08:02:34.216 INFO:tasks.workunit.client.1.smithi129.stdout:4/526: truncate d5/d16/d24/d3b/f65 769175 0 2024-09-21T08:02:34.219 INFO:tasks.workunit.client.1.smithi129.stdout:5/679: rename d2/d2a/d50/d61/f91 to d2/d1e/d35/d33/dca/fcc 0 2024-09-21T08:02:34.219 INFO:tasks.workunit.client.1.smithi129.stdout:5/680: getdents d2/d1e/d35/d37/d65/dc5 0 2024-09-21T08:02:34.219 INFO:tasks.workunit.client.1.smithi129.stdout:2/780: sync 2024-09-21T08:02:34.219 INFO:tasks.workunit.client.1.smithi129.stdout:8/496: sync 2024-09-21T08:02:34.219 INFO:tasks.workunit.client.1.smithi129.stdout:1/707: sync 2024-09-21T08:02:34.220 INFO:tasks.workunit.client.1.smithi129.stdout:2/781: write d1/dc/d19/d4c/d6a/f82 [832983,76238] 0 2024-09-21T08:02:34.220 INFO:tasks.workunit.client.1.smithi129.stdout:1/708: read - d1/d9/d31/f6f zero size 2024-09-21T08:02:34.220 INFO:tasks.workunit.client.1.smithi129.stdout:2/782: chown d1/d13/d3a/d47/d1f/d85/df7/d45/d65/fe3 113489 1 2024-09-21T08:02:34.220 INFO:tasks.workunit.client.1.smithi129.stdout:2/783: dread - d1/f8c zero size 2024-09-21T08:02:34.220 INFO:tasks.workunit.client.1.smithi129.stdout:2/784: stat d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d50/f5d 0 2024-09-21T08:02:34.220 INFO:tasks.workunit.client.1.smithi129.stdout:0/600: dwrite de/d15/d44/da6/fb5 [0,4194304] 0 2024-09-21T08:02:34.222 INFO:tasks.workunit.client.1.smithi129.stdout:7/698: truncate d0/d1e/f55 4132494 0 2024-09-21T08:02:34.224 INFO:tasks.workunit.client.1.smithi129.stdout:3/688: write d3/d57/da2/fb8 [7978962,47236] 0 2024-09-21T08:02:34.227 INFO:tasks.workunit.client.1.smithi129.stdout:9/562: rename d17/d22/d33/d36/d48/d75/fb5 to d17/d22/d33/da5/fbd 0 2024-09-21T08:02:34.227 INFO:tasks.workunit.client.1.smithi129.stdout:9/563: truncate f10 4817762 0 2024-09-21T08:02:34.229 INFO:tasks.workunit.client.1.smithi129.stdout:5/681: unlink d2/d1e/d35/d33/d36/d5a/d77/d81/cb2 0 2024-09-21T08:02:34.229 INFO:tasks.workunit.client.1.smithi129.stdout:5/682: write d2/f4e [363801,110637] 0 2024-09-21T08:02:34.229 INFO:tasks.workunit.client.1.smithi129.stdout:5/683: read d2/f4e [229552,14647] 0 2024-09-21T08:02:34.233 INFO:tasks.workunit.client.1.smithi129.stdout:8/497: symlink d0/d6/d7/d6c/l9a 0 2024-09-21T08:02:34.238 INFO:tasks.workunit.client.1.smithi129.stdout:0/601: mknod de/d22/d27/d85/db2/cc4 0 2024-09-21T08:02:34.238 INFO:tasks.workunit.client.1.smithi129.stdout:0/602: write f7 [1148423,12413] 0 2024-09-21T08:02:34.240 INFO:tasks.workunit.client.1.smithi129.stdout:7/699: symlink d0/d1e/d9a/d9f/led 0 2024-09-21T08:02:34.243 INFO:tasks.workunit.client.1.smithi129.stdout:2/785: rename d1/d13/d3a/d47/d1f/cb2 to d1/c117 0 2024-09-21T08:02:34.244 INFO:tasks.workunit.client.1.smithi129.stdout:9/564: mknod d17/d22/d33/da5/cbe 0 2024-09-21T08:02:34.245 INFO:tasks.workunit.client.1.smithi129.stdout:9/565: read d17/f26 [93693,98815] 0 2024-09-21T08:02:34.246 INFO:tasks.workunit.client.1.smithi129.stdout:5/684: link d2/d1e/d35/d33/d36/d5a/d77/d81/l8d d2/d1e/d35/d33/d36/d5a/lcd 0 2024-09-21T08:02:34.246 INFO:tasks.workunit.client.1.smithi129.stdout:5/685: chown d2 1 1 2024-09-21T08:02:34.248 INFO:tasks.workunit.client.1.smithi129.stdout:1/709: mkdir d1/df1 0 2024-09-21T08:02:34.249 INFO:tasks.workunit.client.1.smithi129.stdout:3/689: dwrite d3/da/dc/d11/d2f/fcf [0,4194304] 0 2024-09-21T08:02:34.249 INFO:tasks.workunit.client.1.smithi129.stdout:6/551: dwrite d7/d1b/d25/d2b/d3e/d5e/fa0 [0,4194304] 0 2024-09-21T08:02:34.250 INFO:tasks.workunit.client.1.smithi129.stdout:4/527: dwrite d5/d11/d3f/f52 [0,4194304] 0 2024-09-21T08:02:34.251 INFO:tasks.workunit.client.1.smithi129.stdout:8/498: mknod d0/d6/d7/d18/d27/d32/d37/c9b 0 2024-09-21T08:02:34.253 INFO:tasks.workunit.client.1.smithi129.stdout:0/603: mknod de/d15/cc5 0 2024-09-21T08:02:34.254 INFO:tasks.workunit.client.1.smithi129.stdout:7/700: mkdir d0/d46/d8e/d90/dd2/dee 0 2024-09-21T08:02:34.255 INFO:tasks.workunit.client.1.smithi129.stdout:7/701: stat d0/d71/fac 0 2024-09-21T08:02:34.257 INFO:tasks.workunit.client.1.smithi129.stdout:9/566: symlink d17/d22/d33/d36/d48/d3f/d53/lbf 0 2024-09-21T08:02:34.260 INFO:tasks.workunit.client.1.smithi129.stdout:5/686: creat d2/d1e/d35/d37/d65/fce x:0 0 0 2024-09-21T08:02:34.262 INFO:tasks.workunit.client.1.smithi129.stdout:4/528: dread d5/d11/d3f/f52 [0,4194304] 0 2024-09-21T08:02:34.263 INFO:tasks.workunit.client.1.smithi129.stdout:2/786: dwrite d1/dc/d19/d88/fe7 [0,4194304] 0 2024-09-21T08:02:34.265 INFO:tasks.workunit.client.1.smithi129.stdout:3/690: creat d3/da/dc/d11/d55/ff5 x:0 0 0 2024-09-21T08:02:34.267 INFO:tasks.workunit.client.1.smithi129.stdout:3/691: dread d3/da/dc/da3/fb2 [0,4194304] 0 2024-09-21T08:02:34.267 INFO:tasks.workunit.client.1.smithi129.stdout:3/692: creat d3/da/dc/d7f/dd6/de2/ff6 x:0 0 0 2024-09-21T08:02:34.267 INFO:tasks.workunit.client.1.smithi129.stdout:3/693: truncate d3/da/dc/d11/d2f/fbf 9163850 0 2024-09-21T08:02:34.267 INFO:tasks.workunit.client.1.smithi129.stdout:3/694: readlink d3/d5a/l92 0 2024-09-21T08:02:34.268 INFO:tasks.workunit.client.1.smithi129.stdout:3/695: fdatasync d3/d69/d98/fd7 0 2024-09-21T08:02:34.269 INFO:tasks.workunit.client.1.smithi129.stdout:1/710: dwrite d1/d16/d9b/fa2 [0,4194304] 0 2024-09-21T08:02:34.270 INFO:tasks.workunit.client.1.smithi129.stdout:3/696: dread d3/da/dc/d11/d55/d68/f6f [0,4194304] 0 2024-09-21T08:02:34.278 INFO:tasks.workunit.client.1.smithi129.stdout:8/499: link d0/d6/d7/d18/d27/d32/d37/c4f d0/d6/d7/d18/d61/d7f/c9c 0 2024-09-21T08:02:34.278 INFO:tasks.workunit.client.1.smithi129.stdout:8/500: stat d0/d6/d7/d5a/f8a 0 2024-09-21T08:02:34.278 INFO:tasks.workunit.client.1.smithi129.stdout:8/501: write d0/d6/f4c [4735595,118161] 0 2024-09-21T08:02:34.280 INFO:tasks.workunit.client.1.smithi129.stdout:0/604: rmdir de/d1f/da9 39 2024-09-21T08:02:34.283 INFO:tasks.workunit.client.1.smithi129.stdout:7/702: link d0/l39 d0/d46/d6e/de4/lef 0 2024-09-21T08:02:34.285 INFO:tasks.workunit.client.1.smithi129.stdout:9/567: mkdir d17/d22/d33/d7a/d89/d90/db1/dc0 0 2024-09-21T08:02:34.288 INFO:tasks.workunit.client.1.smithi129.stdout:4/529: truncate d5/d11/d3f/d50/fa4 2358925 0 2024-09-21T08:02:34.292 INFO:tasks.workunit.client.1.smithi129.stdout:1/711: dwrite d1/d9/f26 [0,4194304] 0 2024-09-21T08:02:34.292 INFO:tasks.workunit.client.1.smithi129.stdout:1/712: stat d1/d4/dad 0 2024-09-21T08:02:34.293 INFO:tasks.workunit.client.1.smithi129.stdout:1/713: readlink d1/d16/d25/da0/lec 0 2024-09-21T08:02:34.293 INFO:tasks.workunit.client.1.smithi129.stdout:2/787: dwrite d1/d13/d3a/ff4 [0,4194304] 0 2024-09-21T08:02:34.293 INFO:tasks.workunit.client.1.smithi129.stdout:2/788: fsync d1/d13/d3a/d47/d5f/fc6 0 2024-09-21T08:02:34.301 INFO:tasks.workunit.client.1.smithi129.stdout:4/530: dwrite d5/d16/d24/d3b/f3e [0,4194304] 0 2024-09-21T08:02:34.309 INFO:tasks.workunit.client.1.smithi129.stdout:3/697: symlink d3/da/d5d/lf7 0 2024-09-21T08:02:34.311 INFO:tasks.workunit.client.1.smithi129.stdout:8/502: creat d0/d6/d7/d18/d61/f9d x:0 0 0 2024-09-21T08:02:34.314 INFO:tasks.workunit.client.1.smithi129.stdout:0/605: unlink de/d15/d39/f41 0 2024-09-21T08:02:34.318 INFO:tasks.workunit.client.1.smithi129.stdout:7/703: unlink d0/d71/l96 0 2024-09-21T08:02:34.318 INFO:tasks.workunit.client.1.smithi129.stdout:7/704: truncate d0/f24 1544401 0 2024-09-21T08:02:34.319 INFO:tasks.workunit.client.1.smithi129.stdout:9/568: rmdir d17/d22/d33/d7a/d89/d90/db1/d31 39 2024-09-21T08:02:34.323 INFO:tasks.workunit.client.1.smithi129.stdout:5/687: rmdir d2/d1e/d35/d33/d36/d5a/d77 39 2024-09-21T08:02:34.329 INFO:tasks.workunit.client.1.smithi129.stdout:1/714: truncate d1/d9/d31/fb7 286253 0 2024-09-21T08:02:34.333 INFO:tasks.workunit.client.1.smithi129.stdout:2/789: symlink d1/d53/d77/l118 0 2024-09-21T08:02:34.333 INFO:tasks.workunit.client.1.smithi129.stdout:2/790: getdents d1/dc/d19/d4c/d6a/d69 0 2024-09-21T08:02:34.338 INFO:tasks.workunit.client.1.smithi129.stdout:6/552: rename d7/d1b/d25 to d7/d1b/d1e/d66/dba 0 2024-09-21T08:02:34.339 INFO:tasks.workunit.client.1.smithi129.stdout:3/698: mkdir d3/d69/d95/df8 0 2024-09-21T08:02:34.341 INFO:tasks.workunit.client.1.smithi129.stdout:8/503: unlink d0/d6/d7/d6c/l9a 0 2024-09-21T08:02:34.343 INFO:tasks.workunit.client.1.smithi129.stdout:0/606: link de/d15/d51/l92 de/d81/d94/lc6 0 2024-09-21T08:02:34.345 INFO:tasks.workunit.client.1.smithi129.stdout:9/569: creat d17/d22/d33/d7a/d89/d90/db1/d31/d5e/fc1 x:0 0 0 2024-09-21T08:02:34.345 INFO:tasks.workunit.client.1.smithi129.stdout:9/570: write d17/d22/d33/d36/d48/d3f/d53/fad [84667,16879] 0 2024-09-21T08:02:34.347 INFO:tasks.workunit.client.1.smithi129.stdout:5/688: symlink d2/d2a/d50/db1/lcf 0 2024-09-21T08:02:34.347 INFO:tasks.workunit.client.1.smithi129.stdout:5/689: fsync d2/d1e/d35/d33/dca/fcc 0 2024-09-21T08:02:34.347 INFO:tasks.workunit.client.1.smithi129.stdout:5/690: fdatasync d2/d2a/d50/f53 0 2024-09-21T08:02:34.349 INFO:tasks.workunit.client.1.smithi129.stdout:1/715: creat d1/d16/d28/ff2 x:0 0 0 2024-09-21T08:02:34.351 INFO:tasks.workunit.client.1.smithi129.stdout:2/791: mknod d1/d53/d77/d8b/c119 0 2024-09-21T08:02:34.352 INFO:tasks.workunit.client.1.smithi129.stdout:4/531: rename d5/d33/c34 to d5/d16/d47/cbf 0 2024-09-21T08:02:34.354 INFO:tasks.workunit.client.1.smithi129.stdout:3/699: unlink d3/d5a/da9/fba 0 2024-09-21T08:02:34.357 INFO:tasks.workunit.client.1.smithi129.stdout:6/553: dwrite d7/d1b/d1e/d39/d4b/d6e/f73 [4194304,4194304] 0 2024-09-21T08:02:34.357 INFO:tasks.workunit.client.1.smithi129.stdout:6/554: chown d7/d4a/d69/d89 28 1 2024-09-21T08:02:34.357 INFO:tasks.workunit.client.1.smithi129.stdout:8/504: creat d0/d6/d7/d5d/f9e x:0 0 0 2024-09-21T08:02:34.361 INFO:tasks.workunit.client.1.smithi129.stdout:0/607: link de/d15/d44/da6/fb5 de/d15/d44/d45/da0/fc7 0 2024-09-21T08:02:34.365 INFO:tasks.workunit.client.1.smithi129.stdout:9/571: creat d17/d60/d7b/d8c/fc2 x:0 0 0 2024-09-21T08:02:34.365 INFO:tasks.workunit.client.1.smithi129.stdout:5/691: symlink d2/d1e/d35/d33/dca/ld0 0 2024-09-21T08:02:34.367 INFO:tasks.workunit.client.1.smithi129.stdout:2/792: link d1/d53/lfa d1/d13/d3a/d47/d1f/d85/df7/l11a 0 2024-09-21T08:02:34.368 INFO:tasks.workunit.client.1.smithi129.stdout:1/716: dread d1/d16/d57/f86 [0,4194304] 0 2024-09-21T08:02:34.368 INFO:tasks.workunit.client.1.smithi129.stdout:1/717: truncate d1/d4/dad/fd0 115276 0 2024-09-21T08:02:34.368 INFO:tasks.workunit.client.1.smithi129.stdout:7/705: rename d0/d46/f61 to d0/d1e/db1/dc7/ff0 0 2024-09-21T08:02:34.371 INFO:tasks.workunit.client.1.smithi129.stdout:8/505: dread d0/d6/d7/d18/d27/d32/d37/f77 [0,4194304] 0 2024-09-21T08:02:34.379 INFO:tasks.workunit.client.1.smithi129.stdout:4/532: creat d5/d16/d47/d5f/d64/fc0 x:0 0 0 2024-09-21T08:02:34.379 INFO:tasks.workunit.client.1.smithi129.stdout:0/608: write de/d1f/f24 [809872,41060] 0 2024-09-21T08:02:34.379 INFO:tasks.workunit.client.1.smithi129.stdout:9/572: unlink d17/d22/d33/d36/d48/d3f/f73 0 2024-09-21T08:02:34.379 INFO:tasks.workunit.client.1.smithi129.stdout:9/573: truncate d17/d46/f8e 529500 0 2024-09-21T08:02:34.379 INFO:tasks.workunit.client.1.smithi129.stdout:6/555: creat d7/d1b/d1e/d66/dba/fbb x:0 0 0 2024-09-21T08:02:34.379 INFO:tasks.workunit.client.1.smithi129.stdout:6/556: write d7/f53 [767278,75244] 0 2024-09-21T08:02:34.379 INFO:tasks.workunit.client.1.smithi129.stdout:6/557: chown d7/d1b/d1e/d39/d79 24707 1 2024-09-21T08:02:34.379 INFO:tasks.workunit.client.1.smithi129.stdout:2/793: dread d1/d13/d3a/d47/d1f/f2a [0,4194304] 0 2024-09-21T08:02:34.379 INFO:tasks.workunit.client.1.smithi129.stdout:2/794: truncate d1/d53/f58 4357883 0 2024-09-21T08:02:34.384 INFO:tasks.workunit.client.1.smithi129.stdout:1/718: dread d1/d4/fa [0,4194304] 0 2024-09-21T08:02:34.384 INFO:tasks.workunit.client.1.smithi129.stdout:1/719: fsync d1/d16/f2a 0 2024-09-21T08:02:34.387 INFO:tasks.workunit.client.1.smithi129.stdout:6/558: unlink d7/d1b/d1e/d66/dba/d35/d40/d78/l83 0 2024-09-21T08:02:34.387 INFO:tasks.workunit.client.1.smithi129.stdout:6/559: chown d7/d1b/d1e/d66/dba/d2b/f3c 422 1 2024-09-21T08:02:34.387 INFO:tasks.workunit.client.1.smithi129.stdout:4/533: dread d5/d11/f4c [0,4194304] 0 2024-09-21T08:02:34.388 INFO:tasks.workunit.client.1.smithi129.stdout:4/534: write d5/d16/d24/d4f/da1/f67 [962738,121156] 0 2024-09-21T08:02:34.388 INFO:tasks.workunit.client.1.smithi129.stdout:4/535: read - d5/d48/f8e zero size 2024-09-21T08:02:34.388 INFO:tasks.workunit.client.1.smithi129.stdout:4/536: fsync d5/d6/f2d 0 2024-09-21T08:02:34.389 INFO:tasks.workunit.client.1.smithi129.stdout:3/700: dwrite d3/d69/d95/fd9 [0,4194304] 0 2024-09-21T08:02:34.389 INFO:tasks.workunit.client.1.smithi129.stdout:3/701: creat d3/d69/d95/de1/ff9 x:0 0 0 2024-09-21T08:02:34.389 INFO:tasks.workunit.client.1.smithi129.stdout:3/702: chown d3/da/dc/d11/d55/d68/f6f 0 1 2024-09-21T08:02:34.390 INFO:tasks.workunit.client.1.smithi129.stdout:2/795: mknod d1/dc/d19/c11b 0 2024-09-21T08:02:34.396 INFO:tasks.workunit.client.1.smithi129.stdout:1/720: mknod d1/d44/d83/dcb/cf3 0 2024-09-21T08:02:34.404 INFO:tasks.workunit.client.1.smithi129.stdout:6/560: symlink d7/d1b/lbc 0 2024-09-21T08:02:34.404 INFO:tasks.workunit.client.1.smithi129.stdout:6/561: creat d7/d4a/d69/fbd x:0 0 0 2024-09-21T08:02:34.406 INFO:tasks.workunit.client.1.smithi129.stdout:4/537: creat d5/d33/d4e/da7/fc1 x:0 0 0 2024-09-21T08:02:34.413 INFO:tasks.workunit.client.1.smithi129.stdout:8/506: dwrite d0/d6/d7/d5d/f9e [0,4194304] 0 2024-09-21T08:02:34.414 INFO:tasks.workunit.client.1.smithi129.stdout:8/507: getdents d0/d6/d7/d9/d94 0 2024-09-21T08:02:34.414 INFO:tasks.workunit.client.1.smithi129.stdout:8/508: creat d0/d6/f9f x:0 0 0 2024-09-21T08:02:34.416 INFO:tasks.workunit.client.1.smithi129.stdout:0/609: dwrite de/d19/f4e [0,4194304] 0 2024-09-21T08:02:34.416 INFO:tasks.workunit.client.1.smithi129.stdout:0/610: creat de/d15/d87/fc8 x:0 0 0 2024-09-21T08:02:34.417 INFO:tasks.workunit.client.1.smithi129.stdout:0/611: creat de/d81/fc9 x:0 0 0 2024-09-21T08:02:34.417 INFO:tasks.workunit.client.1.smithi129.stdout:0/612: fdatasync f0 0 2024-09-21T08:02:34.417 INFO:tasks.workunit.client.1.smithi129.stdout:0/613: write de/d22/d27/d2f/f61 [687320,24412] 0 2024-09-21T08:02:34.417 INFO:tasks.workunit.client.1.smithi129.stdout:5/692: dwrite d2/d1e/d35/f12 [0,4194304] 0 2024-09-21T08:02:34.417 INFO:tasks.workunit.client.1.smithi129.stdout:5/693: read - d2/d1e/d35/d33/d36/f82 zero size 2024-09-21T08:02:34.417 INFO:tasks.workunit.client.1.smithi129.stdout:5/694: dread - d2/d1e/d6b/f8c zero size 2024-09-21T08:02:34.418 INFO:tasks.workunit.client.1.smithi129.stdout:3/703: dwrite d3/da/d5d/f77 [4194304,4194304] 0 2024-09-21T08:02:34.418 INFO:tasks.workunit.client.1.smithi129.stdout:3/704: readlink d3/d90/lcd 0 2024-09-21T08:02:34.419 INFO:tasks.workunit.client.1.smithi129.stdout:0/614: dread de/d15/d51/f8b [0,4194304] 0 2024-09-21T08:02:34.419 INFO:tasks.workunit.client.1.smithi129.stdout:0/615: creat de/d22/d27/fca x:0 0 0 2024-09-21T08:02:34.419 INFO:tasks.workunit.client.1.smithi129.stdout:0/616: truncate de/d22/d27/d2f/d42/f77 5779798 0 2024-09-21T08:02:34.424 INFO:tasks.workunit.client.1.smithi129.stdout:2/796: mkdir d1/dc/d19/d11c 0 2024-09-21T08:02:34.426 INFO:tasks.workunit.client.1.smithi129.stdout:1/721: symlink d1/d4/d96/lf4 0 2024-09-21T08:02:34.429 INFO:tasks.workunit.client.1.smithi129.stdout:0/617: dread de/d19/f4e [0,4194304] 0 2024-09-21T08:02:34.430 INFO:tasks.workunit.client.1.smithi129.stdout:0/618: write de/d15/d39/d56/f9d [975014,25076] 0 2024-09-21T08:02:34.430 INFO:tasks.workunit.client.1.smithi129.stdout:1/722: dread d1/d16/f2a [0,4194304] 0 2024-09-21T08:02:34.430 INFO:tasks.workunit.client.1.smithi129.stdout:6/562: creat d7/d4a/d69/d89/fbe x:0 0 0 2024-09-21T08:02:34.434 INFO:tasks.workunit.client.1.smithi129.stdout:4/538: rename d5/d48/f8e to d5/d16/d24/d3b/fc2 0 2024-09-21T08:02:34.434 INFO:tasks.workunit.client.1.smithi129.stdout:4/539: chown d5/dbd/fad 0 1 2024-09-21T08:02:34.442 INFO:tasks.workunit.client.1.smithi129.stdout:8/509: truncate d0/d6/d7/d6c/f6e 1061384 0 2024-09-21T08:02:34.442 INFO:tasks.workunit.client.1.smithi129.stdout:8/510: write d0/d6/d7/d5a/f5c [843902,57937] 0 2024-09-21T08:02:34.442 INFO:tasks.workunit.client.1.smithi129.stdout:8/511: chown d0/d6/f1a 137109356 1 2024-09-21T08:02:34.445 INFO:tasks.workunit.client.1.smithi129.stdout:5/695: dwrite d2/d1e/d35/d33/f34 [0,4194304] 0 2024-09-21T08:02:34.450 INFO:tasks.workunit.client.1.smithi129.stdout:3/705: mkdir d3/da/d5d/d94/dac/dfa 0 2024-09-21T08:02:34.452 INFO:tasks.workunit.client.1.smithi129.stdout:6/563: dwrite d7/d4a/d69/fbd [0,4194304] 0 2024-09-21T08:02:34.453 INFO:tasks.workunit.client.1.smithi129.stdout:0/619: dwrite de/d15/d44/f97 [0,4194304] 0 2024-09-21T08:02:34.453 INFO:tasks.workunit.client.1.smithi129.stdout:0/620: fsync de/d15/d44/f97 0 2024-09-21T08:02:34.453 INFO:tasks.workunit.client.1.smithi129.stdout:2/797: unlink d1/d13/d32/f90 0 2024-09-21T08:02:34.455 INFO:tasks.workunit.client.1.smithi129.stdout:1/723: symlink d1/d4/dc2/lf5 0 2024-09-21T08:02:34.456 INFO:tasks.workunit.client.1.smithi129.stdout:2/798: dread d1/d13/d3a/f6f [0,4194304] 0 2024-09-21T08:02:34.457 INFO:tasks.workunit.client.1.smithi129.stdout:4/540: mknod d5/d16/d47/d5f/cc3 0 2024-09-21T08:02:34.465 INFO:tasks.workunit.client.1.smithi129.stdout:1/724: write d1/d44/fb4 [3509958,96621] 0 2024-09-21T08:02:34.467 INFO:tasks.workunit.client.1.smithi129.stdout:2/799: dread d1/d13/d3a/d47/d1f/f40 [0,4194304] 0 2024-09-21T08:02:34.467 INFO:tasks.workunit.client.1.smithi129.stdout:2/800: chown d1/dc/d19/d4c/d6a/f43 41 1 2024-09-21T08:02:34.477 INFO:tasks.workunit.client.1.smithi129.stdout:6/564: dwrite d7/d1b/d1e/d39/d4b/d6e/f73 [8388608,4194304] 0 2024-09-21T08:02:34.477 INFO:tasks.workunit.client.1.smithi129.stdout:0/621: dwrite de/d15/f43 [4194304,4194304] 0 2024-09-21T08:02:34.477 INFO:tasks.workunit.client.1.smithi129.stdout:0/622: write de/d15/f3d [1367536,127183] 0 2024-09-21T08:02:34.478 INFO:tasks.workunit.client.1.smithi129.stdout:0/623: chown f0 7885 1 2024-09-21T08:02:34.494 INFO:tasks.workunit.client.1.smithi129.stdout:5/696: mkdir d2/d1e/d6b/dd1 0 2024-09-21T08:02:34.496 INFO:tasks.workunit.client.1.smithi129.stdout:3/706: mknod d3/da/d5d/cfb 0 2024-09-21T08:02:34.515 INFO:tasks.workunit.client.1.smithi129.stdout:1/725: mknod d1/d16/d57/cf6 0 2024-09-21T08:02:34.517 INFO:tasks.workunit.client.1.smithi129.stdout:2/801: mkdir d1/dc/d94/d116/d11d 0 2024-09-21T08:02:34.523 INFO:tasks.workunit.client.1.smithi129.stdout:6/565: truncate d7/fa 6754273 0 2024-09-21T08:02:34.523 INFO:tasks.workunit.client.1.smithi129.stdout:6/566: chown d7/d1b/d1e/d39/d4b/f4d 33481938 1 2024-09-21T08:02:34.541 INFO:tasks.workunit.client.1.smithi129.stdout:6/567: dwrite d7/f37 [0,4194304] 0 2024-09-21T08:02:34.637 INFO:tasks.workunit.client.1.smithi129.stdout:8/512: symlink d0/d6/d7/d18/la0 0 2024-09-21T08:02:34.637 INFO:tasks.workunit.client.1.smithi129.stdout:8/513: truncate d0/d6/d7/d24/f35 4400755 0 2024-09-21T08:02:34.637 INFO:tasks.workunit.client.1.smithi129.stdout:8/514: write d0/d6/d7/d18/d27/d32/f91 [625469,113479] 0 2024-09-21T08:02:34.639 INFO:tasks.workunit.client.1.smithi129.stdout:5/697: creat d2/d1e/d35/d33/db9/fd2 x:0 0 0 2024-09-21T08:02:34.640 INFO:tasks.workunit.client.1.smithi129.stdout:5/698: stat d2/d1e/d35/f51 0 2024-09-21T08:02:34.640 INFO:tasks.workunit.client.1.smithi129.stdout:5/699: rename d2/d1e/d35 to d2/d1e/d35/d33/da1/dd3 22 2024-09-21T08:02:34.642 INFO:tasks.workunit.client.1.smithi129.stdout:3/707: mknod d3/da/dc/d7f/cfc 0 2024-09-21T08:02:34.642 INFO:tasks.workunit.client.1.smithi129.stdout:3/708: write d3/f29 [3044404,96871] 0 2024-09-21T08:02:34.642 INFO:tasks.workunit.client.1.smithi129.stdout:3/709: readlink d3/l38 0 2024-09-21T08:02:34.644 INFO:tasks.workunit.client.1.smithi129.stdout:4/541: rmdir d5/d16/d47/d5f/d64 39 2024-09-21T08:02:34.647 INFO:tasks.workunit.client.1.smithi129.stdout:1/726: truncate d1/d4/d6e/da9/fd8 2550475 0 2024-09-21T08:02:34.652 INFO:tasks.workunit.client.1.smithi129.stdout:5/700: mknod d2/d1e/d35/d33/d36/d5a/cd4 0 2024-09-21T08:02:34.655 INFO:tasks.workunit.client.1.smithi129.stdout:3/710: symlink d3/d57/da2/lfd 0 2024-09-21T08:02:34.657 INFO:tasks.workunit.client.1.smithi129.stdout:4/542: creat d5/d33/fc4 x:0 0 0 2024-09-21T08:02:34.657 INFO:tasks.workunit.client.1.smithi129.stdout:4/543: chown d5/d33/d4e/c71 15 1 2024-09-21T08:02:34.657 INFO:tasks.workunit.client.1.smithi129.stdout:4/544: read - d5/d33/fc4 zero size 2024-09-21T08:02:34.657 INFO:tasks.workunit.client.1.smithi129.stdout:4/545: chown d5/c8 112478 1 2024-09-21T08:02:34.659 INFO:tasks.workunit.client.1.smithi129.stdout:1/727: mkdir d1/d4/dad/db6/df7 0 2024-09-21T08:02:34.660 INFO:tasks.workunit.client.1.smithi129.stdout:8/515: dwrite d0/d6/d7/d18/d27/f3c [0,4194304] 0 2024-09-21T08:02:34.660 INFO:tasks.workunit.client.1.smithi129.stdout:0/624: rmdir de/d19/dad 39 2024-09-21T08:02:34.661 INFO:tasks.workunit.client.1.smithi129.stdout:0/625: write de/d22/d27/d2f/d42/f77 [5632776,104727] 0 2024-09-21T08:02:34.666 INFO:tasks.workunit.client.1.smithi129.stdout:4/546: symlink d5/d16/d85/lc5 0 2024-09-21T08:02:34.669 INFO:tasks.workunit.client.1.smithi129.stdout:3/711: rmdir d3/da/dc/d11/d55/d68 39 2024-09-21T08:02:34.673 INFO:tasks.workunit.client.1.smithi129.stdout:3/712: creat d3/d69/d98/ffe x:0 0 0 2024-09-21T08:02:34.673 INFO:tasks.workunit.client.1.smithi129.stdout:3/713: write d3/d69/d95/d52/f9c [4207266,102977] 0 2024-09-21T08:02:34.677 INFO:tasks.workunit.client.1.smithi129.stdout:3/714: truncate d3/da/d5d/d94/db3/dc3/fe5 358055 0 2024-09-21T08:02:34.677 INFO:tasks.workunit.client.1.smithi129.stdout:3/715: truncate d3/da/dc/d11/d55/ff5 64072 0 2024-09-21T08:02:34.677 INFO:tasks.workunit.client.1.smithi129.stdout:3/716: chown d3/f8a 293 1 2024-09-21T08:02:34.701 INFO:tasks.workunit.client.1.smithi129.stdout:3/717: dwrite d3/da/dc/d7f/dd6/fe7 [0,4194304] 0 2024-09-21T08:02:34.701 INFO:tasks.workunit.client.1.smithi129.stdout:3/718: write d3/d90/fd3 [565796,50822] 0 2024-09-21T08:02:34.701 INFO:tasks.workunit.client.1.smithi129.stdout:3/719: read d3/da/dc/d11/fed [1701878,111649] 0 2024-09-21T08:02:34.705 INFO:tasks.workunit.client.1.smithi129.stdout:3/720: truncate d3/d69/d95/d52/fb4 229426 0 2024-09-21T08:02:34.705 INFO:tasks.workunit.client.1.smithi129.stdout:3/721: truncate d3/da/dc/fb5 370397 0 2024-09-21T08:02:34.745 INFO:tasks.workunit.client.1.smithi129.stdout:7/706: sync 2024-09-21T08:02:34.745 INFO:tasks.workunit.client.1.smithi129.stdout:7/707: dread - d0/d1e/f8b zero size 2024-09-21T08:02:34.747 INFO:tasks.workunit.client.1.smithi129.stdout:9/574: sync 2024-09-21T08:02:34.747 INFO:tasks.workunit.client.1.smithi129.stdout:9/575: fdatasync d17/f49 0 2024-09-21T08:02:34.747 INFO:tasks.workunit.client.1.smithi129.stdout:9/576: write d17/d22/d33/d7a/d89/d90/db1/d31/d5e/d6b/f77 [240201,53792] 0 2024-09-21T08:02:34.747 INFO:tasks.workunit.client.1.smithi129.stdout:9/577: dread - d17/d22/d33/d7a/d89/d90/db1/d31/d5e/fa9 zero size 2024-09-21T08:02:34.750 INFO:tasks.workunit.client.1.smithi129.stdout:2/802: mkdir d1/d13/d32/d11e 0 2024-09-21T08:02:34.751 INFO:tasks.workunit.client.1.smithi129.stdout:4/547: dwrite d5/f5c [0,4194304] 0 2024-09-21T08:02:34.752 INFO:tasks.workunit.client.1.smithi129.stdout:9/578: creat d17/d22/d33/da5/fc3 x:0 0 0 2024-09-21T08:02:34.756 INFO:tasks.workunit.client.1.smithi129.stdout:7/708: read d0/f16 [4168645,94007] 0 2024-09-21T08:02:34.756 INFO:tasks.workunit.client.1.smithi129.stdout:7/709: write d0/f16 [4652891,125773] 0 2024-09-21T08:02:34.758 INFO:tasks.workunit.client.1.smithi129.stdout:5/701: rename d2/d1e/d35/d37/l78 to d2/d2a/ld5 0 2024-09-21T08:02:34.758 INFO:tasks.workunit.client.1.smithi129.stdout:5/702: fsync d2/d1e/d35/d33/f69 0 2024-09-21T08:02:34.759 INFO:tasks.workunit.client.1.smithi129.stdout:4/548: symlink d5/d33/d6d/lc6 0 2024-09-21T08:02:34.760 INFO:tasks.workunit.client.1.smithi129.stdout:9/579: getdents d17/d22/d33/d7a/d89/d90/db1 0 2024-09-21T08:02:34.763 INFO:tasks.workunit.client.1.smithi129.stdout:6/568: mkdir d7/d1b/d1e/d39/dbf 0 2024-09-21T08:02:34.764 INFO:tasks.workunit.client.1.smithi129.stdout:7/710: mknod d0/d71/cf1 0 2024-09-21T08:02:34.764 INFO:tasks.workunit.client.1.smithi129.stdout:7/711: dread - d0/d1e/db1/dba/dc1/dc4/fdd zero size 2024-09-21T08:02:34.764 INFO:tasks.workunit.client.1.smithi129.stdout:7/712: stat d0/d1e/db1/dba 0 2024-09-21T08:02:34.764 INFO:tasks.workunit.client.1.smithi129.stdout:7/713: stat d0/d1e/f40 0 2024-09-21T08:02:34.765 INFO:tasks.workunit.client.1.smithi129.stdout:5/703: dread d2/f1d [0,4194304] 0 2024-09-21T08:02:34.767 INFO:tasks.workunit.client.1.smithi129.stdout:4/549: mknod d5/d48/cc7 0 2024-09-21T08:02:34.768 INFO:tasks.workunit.client.1.smithi129.stdout:6/569: mknod d7/d4a/d69/d89/cc0 0 2024-09-21T08:02:34.770 INFO:tasks.workunit.client.1.smithi129.stdout:4/550: symlink d5/d11/d3f/lc8 0 2024-09-21T08:02:34.772 INFO:tasks.workunit.client.1.smithi129.stdout:6/570: unlink d7/d1b/d1e/d66/dba/d35/f91 0 2024-09-21T08:02:34.774 INFO:tasks.workunit.client.1.smithi129.stdout:1/728: rename d1/f55 to d1/d16/db3/ff8 0 2024-09-21T08:02:34.774 INFO:tasks.workunit.client.1.smithi129.stdout:5/704: dread d2/d2a/d50/d61/fa4 [0,4194304] 0 2024-09-21T08:02:34.775 INFO:tasks.workunit.client.1.smithi129.stdout:5/705: stat d2/d1e/d35/d33/da1/lc3 0 2024-09-21T08:02:34.779 INFO:tasks.workunit.client.1.smithi129.stdout:8/516: rename d0/d6/d7/d18/d27/d32/d37/f55 to d0/d6/d7/d18/d27/d32/d70/fa1 0 2024-09-21T08:02:34.780 INFO:tasks.workunit.client.1.smithi129.stdout:7/714: dwrite d0/d46/d8e/d8f/fa6 [0,4194304] 0 2024-09-21T08:02:34.782 INFO:tasks.workunit.client.1.smithi129.stdout:5/706: link d2/d1e/c3a d2/d1e/d35/d37/d7d/cd6 0 2024-09-21T08:02:34.784 INFO:tasks.workunit.client.1.smithi129.stdout:6/571: getdents d7/d1b/d1e/d66/d7c 0 2024-09-21T08:02:34.790 INFO:tasks.workunit.client.1.smithi129.stdout:0/626: rename de/d15/d44/f97 to de/d15/d39/d9e/dac/dba/dc0/fcb 0 2024-09-21T08:02:34.790 INFO:tasks.workunit.client.1.smithi129.stdout:0/627: stat de/d15/d39/d5b/c6a 0 2024-09-21T08:02:34.792 INFO:tasks.workunit.client.1.smithi129.stdout:8/517: unlink d0/d6/d7/d9/f71 0 2024-09-21T08:02:34.793 INFO:tasks.workunit.client.1.smithi129.stdout:4/551: dwrite d5/d16/f29 [4194304,4194304] 0 2024-09-21T08:02:34.798 INFO:tasks.workunit.client.1.smithi129.stdout:7/715: dwrite d0/d71/fac [0,4194304] 0 2024-09-21T08:02:34.800 INFO:tasks.workunit.client.1.smithi129.stdout:0/628: mkdir de/d15/d44/d4b/dcc 0 2024-09-21T08:02:34.800 INFO:tasks.workunit.client.1.smithi129.stdout:0/629: readlink de/d15/lbd 0 2024-09-21T08:02:34.801 INFO:tasks.workunit.client.1.smithi129.stdout:8/518: creat d0/d6/d7/d18/d27/d60/d97/fa2 x:0 0 0 2024-09-21T08:02:34.803 INFO:tasks.workunit.client.1.smithi129.stdout:4/552: truncate d5/d11/f4c 100702 0 2024-09-21T08:02:34.803 INFO:tasks.workunit.client.1.smithi129.stdout:4/553: creat d5/d33/fc9 x:0 0 0 2024-09-21T08:02:34.803 INFO:tasks.workunit.client.1.smithi129.stdout:4/554: write f2 [1415104,82715] 0 2024-09-21T08:02:34.803 INFO:tasks.workunit.client.1.smithi129.stdout:4/555: dread - d5/d16/d24/d4f/fae zero size 2024-09-21T08:02:34.803 INFO:tasks.workunit.client.1.smithi129.stdout:4/556: dread - d5/d11/d3f/f88 zero size 2024-09-21T08:02:34.808 INFO:tasks.workunit.client.1.smithi129.stdout:7/716: creat d0/d46/dd3/ff2 x:0 0 0 2024-09-21T08:02:34.814 INFO:tasks.workunit.client.1.smithi129.stdout:4/557: creat d5/d16/d24/d3b/fca x:0 0 0 2024-09-21T08:02:34.816 INFO:tasks.workunit.client.1.smithi129.stdout:7/717: link d0/d71/l99 d0/d1e/db1/dc7/lf3 0 2024-09-21T08:02:34.817 INFO:tasks.workunit.client.1.smithi129.stdout:8/519: dwrite d0/d6/d7/f21 [0,4194304] 0 2024-09-21T08:02:34.817 INFO:tasks.workunit.client.1.smithi129.stdout:8/520: write d0/d6/d7/d18/d27/d32/d37/f89 [979212,97161] 0 2024-09-21T08:02:34.817 INFO:tasks.workunit.client.1.smithi129.stdout:0/630: rmdir de/d15/d44/da6 39 2024-09-21T08:02:34.818 INFO:tasks.workunit.client.1.smithi129.stdout:2/803: rmdir d1/d13/d32 39 2024-09-21T08:02:34.820 INFO:tasks.workunit.client.1.smithi129.stdout:8/521: unlink d0/d6/f28 0 2024-09-21T08:02:34.825 INFO:tasks.workunit.client.1.smithi129.stdout:2/804: mkdir d1/d53/d77/d8b/d11f 0 2024-09-21T08:02:34.825 INFO:tasks.workunit.client.1.smithi129.stdout:2/805: write d1/d13/d3a/d47/d1f/f40 [4689263,1251] 0 2024-09-21T08:02:34.827 INFO:tasks.workunit.client.1.smithi129.stdout:7/718: write d0/d46/d6e/dad/fce [5031491,19346] 0 2024-09-21T08:02:34.827 INFO:tasks.workunit.client.1.smithi129.stdout:4/558: dwrite d5/d16/d24/d4f/da1/f9c [0,4194304] 0 2024-09-21T08:02:34.828 INFO:tasks.workunit.client.1.smithi129.stdout:2/806: getdents d1/dc/d19/d4c 0 2024-09-21T08:02:34.830 INFO:tasks.workunit.client.1.smithi129.stdout:7/719: unlink d0/d46/d6e/f5c 0 2024-09-21T08:02:34.830 INFO:tasks.workunit.client.1.smithi129.stdout:7/720: dread - d0/d46/dd3/ff2 zero size 2024-09-21T08:02:34.830 INFO:tasks.workunit.client.1.smithi129.stdout:7/721: read d0/d1e/f21 [939769,113710] 0 2024-09-21T08:02:34.830 INFO:tasks.workunit.client.1.smithi129.stdout:7/722: write d0/d46/d6e/feb [443478,37010] 0 2024-09-21T08:02:34.834 INFO:tasks.workunit.client.1.smithi129.stdout:7/723: creat d0/d46/d6e/de4/ff4 x:0 0 0 2024-09-21T08:02:34.834 INFO:tasks.workunit.client.1.smithi129.stdout:7/724: chown d0/d71/c82 1525781 1 2024-09-21T08:02:34.834 INFO:tasks.workunit.client.1.smithi129.stdout:7/725: write d0/d46/dd3/ff2 [861839,14173] 0 2024-09-21T08:02:34.835 INFO:tasks.workunit.client.1.smithi129.stdout:8/522: dwrite d0/d6/d7/d18/f48 [0,4194304] 0 2024-09-21T08:02:34.835 INFO:tasks.workunit.client.1.smithi129.stdout:8/523: write d0/d6/d7/d18/d27/f90 [666269,20298] 0 2024-09-21T08:02:34.835 INFO:tasks.workunit.client.1.smithi129.stdout:8/524: dread - d0/d6/d7/d18/d27/d60/d97/fa2 zero size 2024-09-21T08:02:34.836 INFO:tasks.workunit.client.1.smithi129.stdout:7/726: rmdir d0/d1e/db1/dba/dc1 39 2024-09-21T08:02:34.837 INFO:tasks.workunit.client.1.smithi129.stdout:2/807: write d1/d13/d3a/dc1/fe1 [2711404,41571] 0 2024-09-21T08:02:34.840 INFO:tasks.workunit.client.1.smithi129.stdout:8/525: getdents d0/d6/d7/d3a/d68 0 2024-09-21T08:02:34.840 INFO:tasks.workunit.client.1.smithi129.stdout:8/526: dread - d0/d6/d7/d18/d27/d32/d70/f75 zero size 2024-09-21T08:02:34.841 INFO:tasks.workunit.client.1.smithi129.stdout:7/727: mknod d0/d46/de0/cf5 0 2024-09-21T08:02:34.843 INFO:tasks.workunit.client.1.smithi129.stdout:2/808: creat d1/dc/d94/d116/f120 x:0 0 0 2024-09-21T08:02:34.843 INFO:tasks.workunit.client.1.smithi129.stdout:2/809: dread - d1/d53/d77/f10d zero size 2024-09-21T08:02:34.843 INFO:tasks.workunit.client.1.smithi129.stdout:2/810: truncate d1/d13/f83 448682 0 2024-09-21T08:02:34.843 INFO:tasks.workunit.client.1.smithi129.stdout:2/811: truncate d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d99/f106 747379 0 2024-09-21T08:02:34.855 INFO:tasks.workunit.client.1.smithi129.stdout:7/728: dwrite d0/fd6 [0,4194304] 0 2024-09-21T08:02:34.859 INFO:tasks.workunit.client.1.smithi129.stdout:7/729: mkdir d0/d46/d6e/dad/df6 0 2024-09-21T08:02:34.861 INFO:tasks.workunit.client.1.smithi129.stdout:7/730: symlink d0/d1e/d9a/d9f/lf7 0 2024-09-21T08:02:34.862 INFO:tasks.workunit.client.1.smithi129.stdout:0/631: creat de/fcd x:0 0 0 2024-09-21T08:02:34.863 INFO:tasks.workunit.client.1.smithi129.stdout:0/632: creat de/d22/d27/d85/db2/dc3/fce x:0 0 0 2024-09-21T08:02:34.868 INFO:tasks.workunit.client.1.smithi129.stdout:7/731: dread d0/f22 [0,4194304] 0 2024-09-21T08:02:34.871 INFO:tasks.workunit.client.1.smithi129.stdout:7/732: getdents d0 0 2024-09-21T08:02:34.873 INFO:tasks.workunit.client.1.smithi129.stdout:7/733: dread d0/d46/f53 [0,4194304] 0 2024-09-21T08:02:34.878 INFO:tasks.workunit.client.1.smithi129.stdout:7/734: symlink d0/lf8 0 2024-09-21T08:02:34.878 INFO:tasks.workunit.client.1.smithi129.stdout:7/735: truncate d0/d46/d6e/d9b/da5/db7/fd1 982409 0 2024-09-21T08:02:34.878 INFO:tasks.workunit.client.1.smithi129.stdout:7/736: write d0/d46/d8e/d90/fb6 [7065862,84108] 0 2024-09-21T08:02:34.878 INFO:tasks.workunit.client.1.smithi129.stdout:7/737: chown d0/d46/d6e/f85 241 1 2024-09-21T08:02:34.878 INFO:tasks.workunit.client.1.smithi129.stdout:7/738: truncate d0/d46/d8e/d90/f92 86656 0 2024-09-21T08:02:34.881 INFO:tasks.workunit.client.1.smithi129.stdout:7/739: mkdir d0/d46/d6e/d9b/df9 0 2024-09-21T08:02:34.890 INFO:tasks.workunit.client.1.smithi129.stdout:0/633: dwrite de/f36 [0,4194304] 0 2024-09-21T08:02:34.893 INFO:tasks.workunit.client.1.smithi129.stdout:7/740: write d0/d46/d6e/d9b/da5/db3/fbb [3977646,6673] 0 2024-09-21T08:02:34.893 INFO:tasks.workunit.client.1.smithi129.stdout:7/741: chown d0/d46/d8e/d8f/fa6 104714061 1 2024-09-21T08:02:34.893 INFO:tasks.workunit.client.1.smithi129.stdout:7/742: chown d0/d46/f57 1644 1 2024-09-21T08:02:34.893 INFO:tasks.workunit.client.1.smithi129.stdout:8/527: rmdir d0/d6/d7/d18/d27/d60 39 2024-09-21T08:02:34.894 INFO:tasks.workunit.client.1.smithi129.stdout:7/743: mknod d0/d1e/db1/dba/cfa 0 2024-09-21T08:02:34.894 INFO:tasks.workunit.client.1.smithi129.stdout:7/744: dread - d0/f70 zero size 2024-09-21T08:02:34.897 INFO:tasks.workunit.client.1.smithi129.stdout:7/745: mkdir d0/d46/d8e/d90/dd2/dee/dfb 0 2024-09-21T08:02:34.897 INFO:tasks.workunit.client.1.smithi129.stdout:7/746: getdents d0/d46/d6e/d9b/df9 0 2024-09-21T08:02:34.897 INFO:tasks.workunit.client.1.smithi129.stdout:7/747: chown d0/d1e/l68 186127484 1 2024-09-21T08:02:34.897 INFO:tasks.workunit.client.1.smithi129.stdout:7/748: fdatasync d0/f6f 0 2024-09-21T08:02:34.897 INFO:tasks.workunit.client.1.smithi129.stdout:7/749: dread - d0/d1e/f8b zero size 2024-09-21T08:02:34.897 INFO:tasks.workunit.client.1.smithi129.stdout:7/750: creat d0/d46/d6e/d9b/da5/db7/ffc x:0 0 0 2024-09-21T08:02:34.897 INFO:tasks.workunit.client.1.smithi129.stdout:7/751: fdatasync d0/f37 0 2024-09-21T08:02:34.898 INFO:tasks.workunit.client.1.smithi129.stdout:7/752: truncate d0/d1e/f4b 8950642 0 2024-09-21T08:02:34.898 INFO:tasks.workunit.client.1.smithi129.stdout:7/753: stat d0/d46/d6e/dad/df6 0 2024-09-21T08:02:34.900 INFO:tasks.workunit.client.1.smithi129.stdout:7/754: mkdir d0/d46/d6e/dad/df6/dfd 0 2024-09-21T08:02:34.905 INFO:tasks.workunit.client.1.smithi129.stdout:9/580: rename d17/d22/d33/d36/d76 to d17/d60/d7b/dc4 0 2024-09-21T08:02:34.907 INFO:tasks.workunit.client.1.smithi129.stdout:5/707: rename d2/d1e/d35/d33/d36/d5a/d77/d81/l8d to d2/d2a/d50/db1/ld7 0 2024-09-21T08:02:34.909 INFO:tasks.workunit.client.1.smithi129.stdout:6/572: rename d7/d4a/d69/c84 to d7/d1b/d1e/d66/dba/d35/d40/d78/cc1 0 2024-09-21T08:02:34.910 INFO:tasks.workunit.client.1.smithi129.stdout:5/708: symlink d2/d1e/d6b/dd1/ld8 0 2024-09-21T08:02:34.912 INFO:tasks.workunit.client.1.smithi129.stdout:4/559: rename d5/d11/d77/d89/l8b to d5/d11/d77/da8/dbc/lcb 0 2024-09-21T08:02:34.913 INFO:tasks.workunit.client.1.smithi129.stdout:5/709: creat d2/d1e/d35/d33/d36/d5a/d77/d81/fd9 x:0 0 0 2024-09-21T08:02:34.914 INFO:tasks.workunit.client.1.smithi129.stdout:0/634: dwrite de/d22/d27/d2f/f3e [4194304,4194304] 0 2024-09-21T08:02:34.914 INFO:tasks.workunit.client.1.smithi129.stdout:0/635: dread - de/d1f/f9b zero size 2024-09-21T08:02:34.918 INFO:tasks.workunit.client.1.smithi129.stdout:2/812: rename d1/d13/d3a/d47/d1f/f22 to d1/d13/d3a/d47/d1f/d85/df7/d45/d65/ddf/de5/f121 0 2024-09-21T08:02:34.919 INFO:tasks.workunit.client.1.smithi129.stdout:2/813: chown d1/d13/d32 865447 1 2024-09-21T08:02:34.920 INFO:tasks.workunit.client.1.smithi129.stdout:8/528: dwrite d0/d6/f9f [0,4194304] 0 2024-09-21T08:02:34.922 INFO:tasks.workunit.client.1.smithi129.stdout:6/573: rename d7/d1b/d1e/d66/dba/d2b/d3e to d7/d1b/d1e/d66/dc2 0 2024-09-21T08:02:34.923 INFO:tasks.workunit.client.1.smithi129.stdout:2/814: getdents d1/d53/d77 0 2024-09-21T08:02:34.924 INFO:tasks.workunit.client.1.smithi129.stdout:2/815: dread - d1/dc/d94/d116/f120 zero size 2024-09-21T08:02:34.924 INFO:tasks.workunit.client.1.smithi129.stdout:8/529: dread d0/d6/d7/d6c/f6e [0,4194304] 0 2024-09-21T08:02:34.927 INFO:tasks.workunit.client.1.smithi129.stdout:4/560: dread d5/d16/f1f [0,4194304] 0 2024-09-21T08:02:34.927 INFO:tasks.workunit.client.1.smithi129.stdout:9/581: dwrite d17/d22/d33/da5/fbd [0,4194304] 0 2024-09-21T08:02:34.928 INFO:tasks.workunit.client.1.smithi129.stdout:8/530: rmdir d0/d6/d7/d18/d27/d60/d85/d95 0 2024-09-21T08:02:34.928 INFO:tasks.workunit.client.1.smithi129.stdout:8/531: fsync d0/d6/d7/d18/d27/f2d 0 2024-09-21T08:02:34.928 INFO:tasks.workunit.client.1.smithi129.stdout:8/532: fsync d0/d6/d7/d18/d27/d32/d70/f75 0 2024-09-21T08:02:34.932 INFO:tasks.workunit.client.1.smithi129.stdout:5/710: dread d2/f29 [0,4194304] 0 2024-09-21T08:02:34.932 INFO:tasks.workunit.client.1.smithi129.stdout:5/711: stat d2/d1e/d35/f40 0 2024-09-21T08:02:34.933 INFO:tasks.workunit.client.1.smithi129.stdout:4/561: rename d5/l9d to d5/d16/d24/lcc 0 2024-09-21T08:02:34.933 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:34 smithi129 ceph-mon[34472]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:34.933 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:34 smithi129 ceph-mon[34472]: pgmap v9: 65 pgs: 65 active+clean; 1.3 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 158 MiB/s rd, 188 MiB/s wr, 283 op/s 2024-09-21T08:02:34.935 INFO:tasks.workunit.client.1.smithi129.stdout:4/562: symlink d5/d16/d24/lcd 0 2024-09-21T08:02:34.935 INFO:tasks.workunit.client.1.smithi129.stdout:9/582: rmdir d17/d22/d33/d7a/d89/d90/db1/d31/d35 39 2024-09-21T08:02:34.937 INFO:tasks.workunit.client.1.smithi129.stdout:6/574: write d7/d4a/d69/fbd [3414604,122997] 0 2024-09-21T08:02:34.938 INFO:tasks.workunit.client.1.smithi129.stdout:4/563: link d5/d16/d24/d3b/c82 d5/d16/d47/d5f/d64/cce 0 2024-09-21T08:02:34.939 INFO:tasks.workunit.client.1.smithi129.stdout:9/583: mknod d17/d22/d33/d7a/d89/d90/db1/dc0/cc5 0 2024-09-21T08:02:34.939 INFO:tasks.workunit.client.1.smithi129.stdout:9/584: readlink d17/l21 0 2024-09-21T08:02:34.939 INFO:tasks.workunit.client.1.smithi129.stdout:6/575: symlink d7/d1b/d1e/lc3 0 2024-09-21T08:02:34.941 INFO:tasks.workunit.client.1.smithi129.stdout:4/564: mkdir d5/d16/d24/d4f/da1/dcf 0 2024-09-21T08:02:34.942 INFO:tasks.workunit.client.1.smithi129.stdout:6/576: mkdir d7/d4a/dc4 0 2024-09-21T08:02:34.954 INFO:tasks.workunit.client.1.smithi129.stdout:0/636: dwrite de/d1f/f24 [0,4194304] 0 2024-09-21T08:02:34.954 INFO:tasks.workunit.client.1.smithi129.stdout:4/565: write d5/d11/d3f/d50/f51 [382663,5123] 0 2024-09-21T08:02:34.954 INFO:tasks.workunit.client.1.smithi129.stdout:4/566: write d5/d16/d24/d4f/fae [954230,110201] 0 2024-09-21T08:02:34.954 INFO:tasks.workunit.client.1.smithi129.stdout:4/567: creat d5/d33/d4e/da7/fd0 x:0 0 0 2024-09-21T08:02:34.956 INFO:tasks.workunit.client.1.smithi129.stdout:0/637: mknod de/d22/d27/d85/db2/ccf 0 2024-09-21T08:02:34.957 INFO:tasks.workunit.client.1.smithi129.stdout:4/568: symlink d5/d16/d24/d4f/da1/ld1 0 2024-09-21T08:02:34.957 INFO:tasks.workunit.client.1.smithi129.stdout:4/569: chown d5/d16/d24/d3b/f46 0 1 2024-09-21T08:02:34.958 INFO:tasks.workunit.client.1.smithi129.stdout:0/638: getdents de/d22/d27 0 2024-09-21T08:02:34.961 INFO:tasks.workunit.client.1.smithi129.stdout:0/639: mknod de/d15/d44/d45/da0/cd0 0 2024-09-21T08:02:34.961 INFO:tasks.workunit.client.1.smithi129.stdout:0/640: chown de/d15/cc5 34 1 2024-09-21T08:02:34.962 INFO:tasks.workunit.client.1.smithi129.stdout:0/641: chown de/d15/d39/d5b/db1 84 1 2024-09-21T08:02:34.962 INFO:tasks.workunit.client.1.smithi129.stdout:0/642: getdents de/d15/d44/d45/d84 0 2024-09-21T08:02:34.962 INFO:tasks.workunit.client.1.smithi129.stdout:0/643: write de/d22/d27/d2f/f5a [4973867,36058] 0 2024-09-21T08:02:34.962 INFO:tasks.workunit.client.1.smithi129.stdout:0/644: chown de/d15/d44/d45/da0/f99 42 1 2024-09-21T08:02:34.962 INFO:tasks.workunit.client.1.smithi129.stdout:2/816: dwrite d1/d13/d3a/d47/d1f/d85/df7/d45/f46 [0,4194304] 0 2024-09-21T08:02:34.963 INFO:tasks.workunit.client.1.smithi129.stdout:8/533: dwrite d0/d6/f4c [4194304,4194304] 0 2024-09-21T08:02:34.963 INFO:tasks.workunit.client.1.smithi129.stdout:8/534: truncate d0/d6/d7/d18/d27/d32/d70/fa1 4471780 0 2024-09-21T08:02:34.963 INFO:tasks.workunit.client.1.smithi129.stdout:8/535: fdatasync d0/d6/d7/d18/d27/d32/d70/f75 0 2024-09-21T08:02:34.963 INFO:tasks.workunit.client.1.smithi129.stdout:0/645: mknod de/d22/cd1 0 2024-09-21T08:02:34.966 INFO:tasks.workunit.client.1.smithi129.stdout:2/817: dread d1/d13/d32/d97/fa5 [0,4194304] 0 2024-09-21T08:02:34.971 INFO:tasks.workunit.client.1.smithi129.stdout:8/536: mknod d0/d6/d7/d3a/ca3 0 2024-09-21T08:02:34.972 INFO:tasks.workunit.client.1.smithi129.stdout:2/818: link d1/dc/d19/d88/fcc d1/d13/d3a/d47/d1f/d85/df7/d45/d65/ddf/f122 0 2024-09-21T08:02:34.974 INFO:tasks.workunit.client.1.smithi129.stdout:8/537: symlink d0/d6/d7/d3a/d68/la4 0 2024-09-21T08:02:34.975 INFO:tasks.workunit.client.1.smithi129.stdout:9/585: dwrite d17/f61 [0,4194304] 0 2024-09-21T08:02:34.975 INFO:tasks.workunit.client.1.smithi129.stdout:2/819: creat d1/dc/d19/d4c/d9d/f123 x:0 0 0 2024-09-21T08:02:34.976 INFO:tasks.workunit.client.1.smithi129.stdout:6/577: dwrite d7/d4a/fac [0,4194304] 0 2024-09-21T08:02:34.976 INFO:tasks.workunit.client.1.smithi129.stdout:6/578: write d7/d1b/d1e/d66/dba/d35/d40/d41/f62 [648659,24102] 0 2024-09-21T08:02:34.976 INFO:tasks.workunit.client.1.smithi129.stdout:6/579: dread - d7/d1b/d1e/d39/d4b/fa2 zero size 2024-09-21T08:02:34.977 INFO:tasks.workunit.client.1.smithi129.stdout:4/570: dwrite d5/d11/f57 [0,4194304] 0 2024-09-21T08:02:34.977 INFO:tasks.workunit.client.1.smithi129.stdout:4/571: truncate d5/d33/fc9 304697 0 2024-09-21T08:02:34.977 INFO:tasks.workunit.client.1.smithi129.stdout:8/538: mknod d0/d6/ca5 0 2024-09-21T08:02:34.977 INFO:tasks.workunit.client.1.smithi129.stdout:8/539: truncate d0/d6/d7/d24/f5e 363567 0 2024-09-21T08:02:34.977 INFO:tasks.workunit.client.1.smithi129.stdout:8/540: fsync d0/d6/f1a 0 2024-09-21T08:02:34.978 INFO:tasks.workunit.client.1.smithi129.stdout:9/586: mknod d17/d22/d33/d7a/d89/d90/db1/d31/d5e/d6b/cc6 0 2024-09-21T08:02:34.981 INFO:tasks.workunit.client.1.smithi129.stdout:6/580: truncate d7/f82 556168 0 2024-09-21T08:02:34.982 INFO:tasks.workunit.client.1.smithi129.stdout:6/581: readlink d7/d1b/d1e/d66/dc2/l63 0 2024-09-21T08:02:34.982 INFO:tasks.workunit.client.1.smithi129.stdout:6/582: creat d7/d1b/d1e/d39/d4b/fc5 x:0 0 0 2024-09-21T08:02:34.984 INFO:tasks.workunit.client.1.smithi129.stdout:2/820: dread d1/dc/d19/d4c/d9d/fcb [0,4194304] 0 2024-09-21T08:02:34.985 INFO:tasks.workunit.client.1.smithi129.stdout:2/821: fdatasync d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d50/f5d 0 2024-09-21T08:02:34.985 INFO:tasks.workunit.client.1.smithi129.stdout:4/572: symlink d5/d48/ld2 0 2024-09-21T08:02:34.985 INFO:tasks.workunit.client.1.smithi129.stdout:4/573: stat d5/f7a 0 2024-09-21T08:02:34.985 INFO:tasks.workunit.client.1.smithi129.stdout:4/574: write d5/d16/d24/d4f/da1/f59 [45493,33163] 0 2024-09-21T08:02:34.986 INFO:tasks.workunit.client.1.smithi129.stdout:2/822: creat d1/dc/d19/d11c/f124 x:0 0 0 2024-09-21T08:02:34.986 INFO:tasks.workunit.client.1.smithi129.stdout:2/823: truncate d1/d13/d32/d97/fa5 492899 0 2024-09-21T08:02:34.986 INFO:tasks.workunit.client.1.smithi129.stdout:2/824: chown d1/dc/d19/d4c/l110 6948334 1 2024-09-21T08:02:34.987 INFO:tasks.workunit.client.1.smithi129.stdout:2/825: creat d1/dc/f125 x:0 0 0 2024-09-21T08:02:34.989 INFO:tasks.workunit.client.1.smithi129.stdout:0/646: dwrite de/d15/d44/da6/fb5 [4194304,4194304] 0 2024-09-21T08:02:35.001 INFO:tasks.workunit.client.1.smithi129.stdout:0/647: dread de/d15/d39/f96 [0,4194304] 0 2024-09-21T08:02:35.001 INFO:tasks.workunit.client.1.smithi129.stdout:0/648: creat de/d15/d39/fd2 x:0 0 0 2024-09-21T08:02:35.002 INFO:tasks.workunit.client.1.smithi129.stdout:7/755: truncate d0/d1e/f4b 9240334 0 2024-09-21T08:02:35.005 INFO:tasks.workunit.client.1.smithi129.stdout:0/649: mknod de/d22/d27/d30/cd3 0 2024-09-21T08:02:35.007 INFO:tasks.workunit.client.1.smithi129.stdout:7/756: mkdir d0/d46/d8e/d90/dfe 0 2024-09-21T08:02:35.009 INFO:tasks.workunit.client.1.smithi129.stdout:0/650: rename de/d15/d39/d5b to de/d1f/dd4 0 2024-09-21T08:02:35.009 INFO:tasks.workunit.client.1.smithi129.stdout:0/651: chown de/d19/d5e 22231785 1 2024-09-21T08:02:35.010 INFO:tasks.workunit.client.1.smithi129.stdout:0/652: symlink de/d22/d27/d85/ld5 0 2024-09-21T08:02:35.010 INFO:tasks.workunit.client.1.smithi129.stdout:0/653: chown de/f13 89755 1 2024-09-21T08:02:35.018 INFO:tasks.workunit.client.1.smithi129.stdout:7/757: write d0/f79 [3637824,112967] 0 2024-09-21T08:02:35.019 INFO:tasks.workunit.client.1.smithi129.stdout:7/758: truncate d0/f43 837056 0 2024-09-21T08:02:35.022 INFO:tasks.workunit.client.1.smithi129.stdout:9/587: dwrite d17/d46/f4b [0,4194304] 0 2024-09-21T08:02:35.023 INFO:tasks.workunit.client.1.smithi129.stdout:8/541: dwrite d0/d6/d7/d24/f46 [4194304,4194304] 0 2024-09-21T08:02:35.023 INFO:tasks.workunit.client.1.smithi129.stdout:6/583: dwrite d7/d1b/d1e/fb5 [0,4194304] 0 2024-09-21T08:02:35.023 INFO:tasks.workunit.client.1.smithi129.stdout:6/584: write d7/d1b/d1e/d66/dba/fbb [518074,81261] 0 2024-09-21T08:02:35.024 INFO:tasks.workunit.client.1.smithi129.stdout:4/575: dwrite d5/d11/f4c [0,4194304] 0 2024-09-21T08:02:35.024 INFO:tasks.workunit.client.1.smithi129.stdout:9/588: unlink d17/d22/d33/d36/d48/c44 0 2024-09-21T08:02:35.024 INFO:tasks.workunit.client.1.smithi129.stdout:2/826: dwrite d1/dc/d19/d88/ff0 [0,4194304] 0 2024-09-21T08:02:35.024 INFO:tasks.workunit.client.1.smithi129.stdout:2/827: truncate d1/d13/d3a/d47/d1f/d85/df7/d45/d65/fe3 275115 0 2024-09-21T08:02:35.026 INFO:tasks.workunit.client.1.smithi129.stdout:8/542: creat d0/d6/d7/d3a/d8e/fa6 x:0 0 0 2024-09-21T08:02:35.028 INFO:tasks.workunit.client.1.smithi129.stdout:6/585: symlink d7/d1b/d1e/d66/dc2/lc6 0 2024-09-21T08:02:35.030 INFO:tasks.workunit.client.1.smithi129.stdout:4/576: unlink d5/d33/d4e/c71 0 2024-09-21T08:02:35.030 INFO:tasks.workunit.client.1.smithi129.stdout:4/577: fsync d5/d16/d24/d4f/f54 0 2024-09-21T08:02:35.031 INFO:tasks.workunit.client.1.smithi129.stdout:9/589: rename d17/d46/c6d to d17/d22/d33/d7a/d89/d90/cc7 0 2024-09-21T08:02:35.031 INFO:tasks.workunit.client.1.smithi129.stdout:9/590: chown d17/d22/d33/d36/d48/d75/f7d 1893 1 2024-09-21T08:02:35.035 INFO:tasks.workunit.client.1.smithi129.stdout:2/828: mknod d1/d13/d3a/d47/d5f/c126 0 2024-09-21T08:02:35.037 INFO:tasks.workunit.client.1.smithi129.stdout:4/578: dread d5/d16/d24/d4f/fae [0,4194304] 0 2024-09-21T08:02:35.042 INFO:tasks.workunit.client.1.smithi129.stdout:9/591: creat d17/d22/d33/d36/d48/db7/fc8 x:0 0 0 2024-09-21T08:02:35.045 INFO:tasks.workunit.client.1.smithi129.stdout:2/829: truncate d1/dc/f15 1468511 0 2024-09-21T08:02:35.047 INFO:tasks.workunit.client.1.smithi129.stdout:4/579: getdents d5/d11/d77/da8/dbc 0 2024-09-21T08:02:35.047 INFO:tasks.workunit.client.1.smithi129.stdout:9/592: getdents d17/d60/d7b/dc4 0 2024-09-21T08:02:35.049 INFO:tasks.workunit.client.1.smithi129.stdout:8/543: dwrite d0/d6/d7/d18/d27/f3c [4194304,4194304] 0 2024-09-21T08:02:35.049 INFO:tasks.workunit.client.1.smithi129.stdout:6/586: dwrite d7/fe [4194304,4194304] 0 2024-09-21T08:02:35.050 INFO:tasks.workunit.client.1.smithi129.stdout:2/830: creat d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d50/f127 x:0 0 0 2024-09-21T08:02:35.050 INFO:tasks.workunit.client.1.smithi129.stdout:2/831: chown d1/f8c 9084 1 2024-09-21T08:02:35.051 INFO:tasks.workunit.client.1.smithi129.stdout:4/580: rename d5/d16/d24/d4f/da1/f67 to d5/d16/fd3 0 2024-09-21T08:02:35.052 INFO:tasks.workunit.client.1.smithi129.stdout:9/593: truncate f10 1318963 0 2024-09-21T08:02:35.052 INFO:tasks.workunit.client.1.smithi129.stdout:9/594: truncate d17/d22/d33/d36/d48/d3f/d53/fa3 260978 0 2024-09-21T08:02:35.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:34 smithi107 ceph-mon[27622]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:35.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:34 smithi107 ceph-mon[27622]: pgmap v9: 65 pgs: 65 active+clean; 1.3 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 158 MiB/s rd, 188 MiB/s wr, 283 op/s 2024-09-21T08:02:35.054 INFO:tasks.workunit.client.1.smithi129.stdout:8/544: unlink d0/d6/d7/d18/f48 0 2024-09-21T08:02:35.054 INFO:tasks.workunit.client.1.smithi129.stdout:8/545: chown d0/d6/d7/c50 210267860 1 2024-09-21T08:02:35.057 INFO:tasks.workunit.client.1.smithi129.stdout:6/587: symlink d7/d1b/d57/lc7 0 2024-09-21T08:02:35.057 INFO:tasks.workunit.client.1.smithi129.stdout:6/588: chown d7/d1b/d1e/d66/dc2/d93/f98 295 1 2024-09-21T08:02:35.057 INFO:tasks.workunit.client.1.smithi129.stdout:6/589: fsync d7/d10/fa8 0 2024-09-21T08:02:35.057 INFO:tasks.workunit.client.1.smithi129.stdout:6/590: chown d7/d10/fa8 25 1 2024-09-21T08:02:35.057 INFO:tasks.workunit.client.1.smithi129.stdout:6/591: fdatasync d7/d1b/d1e/f99 0 2024-09-21T08:02:35.057 INFO:tasks.workunit.client.1.smithi129.stdout:6/592: chown d7/d1b/d1e/d66/dba/d2b/c90 0 1 2024-09-21T08:02:35.057 INFO:tasks.workunit.client.1.smithi129.stdout:4/581: creat d5/d16/fd4 x:0 0 0 2024-09-21T08:02:35.058 INFO:tasks.workunit.client.1.smithi129.stdout:7/759: dwrite d0/f43 [0,4194304] 0 2024-09-21T08:02:35.059 INFO:tasks.workunit.client.1.smithi129.stdout:4/582: write d5/d16/d47/f99 [35125,27629] 0 2024-09-21T08:02:35.059 INFO:tasks.workunit.client.1.smithi129.stdout:4/583: write d5/d33/f9e [153912,81660] 0 2024-09-21T08:02:35.059 INFO:tasks.workunit.client.1.smithi129.stdout:9/595: mkdir d17/d22/d33/d36/d48/db7/dc9 0 2024-09-21T08:02:35.060 INFO:tasks.workunit.client.1.smithi129.stdout:6/593: rmdir d7/d4a/d7a 39 2024-09-21T08:02:35.062 INFO:tasks.workunit.client.1.smithi129.stdout:6/594: read d7/d1b/d1e/d66/dba/d35/d40/d41/f62 [507083,81047] 0 2024-09-21T08:02:35.062 INFO:tasks.workunit.client.1.smithi129.stdout:7/760: mknod d0/d1e/db1/dc7/cff 0 2024-09-21T08:02:35.062 INFO:tasks.workunit.client.1.smithi129.stdout:7/761: dread - d0/d46/d6e/f6d zero size 2024-09-21T08:02:35.063 INFO:tasks.workunit.client.1.smithi129.stdout:4/584: symlink d5/d16/d24/d4f/da1/ld5 0 2024-09-21T08:02:35.065 INFO:tasks.workunit.client.1.smithi129.stdout:6/595: creat d7/fc8 x:0 0 0 2024-09-21T08:02:35.067 INFO:tasks.workunit.client.1.smithi129.stdout:7/762: rmdir d0/d46/dd3 39 2024-09-21T08:02:35.072 INFO:tasks.workunit.client.1.smithi129.stdout:4/585: write d5/d16/d47/fab [5106899,7767] 0 2024-09-21T08:02:35.072 INFO:tasks.workunit.client.1.smithi129.stdout:7/763: rename d0/d46/d8e to d0/d1e/d9a/dca/d100 0 2024-09-21T08:02:35.076 INFO:tasks.workunit.client.1.smithi129.stdout:4/586: link d5/d16/f32 d5/d33/d6d/fd6 0 2024-09-21T08:02:35.078 INFO:tasks.workunit.client.1.smithi129.stdout:4/587: mknod d5/d16/d47/d61/cd7 0 2024-09-21T08:02:35.078 INFO:tasks.workunit.client.1.smithi129.stdout:4/588: chown d5/d16/d47/d61/cd7 1126885 1 2024-09-21T08:02:35.079 INFO:tasks.workunit.client.1.smithi129.stdout:4/589: rmdir d5/d33/d6d 39 2024-09-21T08:02:35.080 INFO:tasks.workunit.client.0.smithi107.stdout:6/28: sync 2024-09-21T08:02:35.080 INFO:tasks.workunit.client.0.smithi107.stdout:0/54: sync 2024-09-21T08:02:35.080 INFO:tasks.workunit.client.0.smithi107.stdout:4/25: sync 2024-09-21T08:02:35.080 INFO:tasks.workunit.client.0.smithi107.stdout:2/19: sync 2024-09-21T08:02:35.080 INFO:tasks.workunit.client.0.smithi107.stdout:0/55: fsync d1/d5/f14 0 2024-09-21T08:02:35.080 INFO:tasks.workunit.client.0.smithi107.stdout:5/61: sync 2024-09-21T08:02:35.080 INFO:tasks.workunit.client.0.smithi107.stdout:4/26: creat f6 x:0 0 0 2024-09-21T08:02:35.081 INFO:tasks.workunit.client.0.smithi107.stdout:4/27: rmdir - no directory 2024-09-21T08:02:35.081 INFO:tasks.workunit.client.0.smithi107.stdout:1/21: sync 2024-09-21T08:02:35.081 INFO:tasks.workunit.client.0.smithi107.stdout:1/22: write d0/f4 [768255,105105] 0 2024-09-21T08:02:35.081 INFO:tasks.workunit.client.0.smithi107.stdout:7/88: sync 2024-09-21T08:02:35.081 INFO:tasks.workunit.client.0.smithi107.stdout:3/3: sync 2024-09-21T08:02:35.081 INFO:tasks.workunit.client.0.smithi107.stdout:3/4: read - no filename 2024-09-21T08:02:35.082 INFO:tasks.workunit.client.0.smithi107.stdout:3/5: fdatasync - no filename 2024-09-21T08:02:35.082 INFO:tasks.workunit.client.0.smithi107.stdout:3/6: write - no filename 2024-09-21T08:02:35.082 INFO:tasks.workunit.client.0.smithi107.stdout:3/7: write - no filename 2024-09-21T08:02:35.082 INFO:tasks.workunit.client.0.smithi107.stdout:3/8: fsync - no filename 2024-09-21T08:02:35.082 INFO:tasks.workunit.client.0.smithi107.stdout:9/71: sync 2024-09-21T08:02:35.082 INFO:tasks.workunit.client.0.smithi107.stdout:8/1: sync 2024-09-21T08:02:35.082 INFO:tasks.workunit.client.0.smithi107.stdout:8/2: creat f1 x:0 0 0 2024-09-21T08:02:35.082 INFO:tasks.workunit.client.1.smithi129.stdout:4/590: mknod d5/d11/d77/da8/cd8 0 2024-09-21T08:02:35.086 INFO:tasks.workunit.client.0.smithi107.stdout:2/20: creat d1/f3 x:0 0 0 2024-09-21T08:02:35.086 INFO:tasks.workunit.client.0.smithi107.stdout:2/21: stat f0 0 2024-09-21T08:02:35.086 INFO:tasks.workunit.client.1.smithi129.stdout:7/764: dread d0/f43 [0,4194304] 0 2024-09-21T08:02:35.088 INFO:tasks.workunit.client.1.smithi129.stdout:4/591: creat d5/da5/fd9 x:0 0 0 2024-09-21T08:02:35.088 INFO:tasks.workunit.client.1.smithi129.stdout:4/592: write d5/d33/fc4 [858883,84786] 0 2024-09-21T08:02:35.088 INFO:tasks.workunit.client.1.smithi129.stdout:4/593: chown d5/d16/d24/d3b/fca 47352364 1 2024-09-21T08:02:35.088 INFO:tasks.workunit.client.0.smithi107.stdout:4/28: dread f0 [0,4194304] 0 2024-09-21T08:02:35.088 INFO:tasks.workunit.client.0.smithi107.stdout:9/72: dread f10 [0,4194304] 0 2024-09-21T08:02:35.088 INFO:tasks.workunit.client.0.smithi107.stdout:9/73: chown f3 11 1 2024-09-21T08:02:35.089 INFO:tasks.workunit.client.0.smithi107.stdout:4/29: readlink l4 0 2024-09-21T08:02:35.089 INFO:tasks.workunit.client.1.smithi129.stdout:2/832: dwrite d1/dc/d19/d88/ff0 [4194304,4194304] 0 2024-09-21T08:02:35.089 INFO:tasks.workunit.client.1.smithi129.stdout:2/833: fdatasync d1/d13/f83 0 2024-09-21T08:02:35.090 INFO:tasks.workunit.client.1.smithi129.stdout:2/834: read - d1/d13/d3a/d47/d1f/d85/df7/d45/fe6 zero size 2024-09-21T08:02:35.090 INFO:tasks.workunit.client.1.smithi129.stdout:2/835: fdatasync d1/f8 0 2024-09-21T08:02:35.090 INFO:tasks.workunit.client.1.smithi129.stdout:9/596: dwrite d17/d22/d33/d36/d48/d75/fa8 [0,4194304] 0 2024-09-21T08:02:35.090 INFO:tasks.workunit.client.1.smithi129.stdout:6/596: dwrite d7/d1b/d8d/fa3 [0,4194304] 0 2024-09-21T08:02:35.090 INFO:tasks.workunit.client.0.smithi107.stdout:0/56: read d1/f8 [3377619,2000] 0 2024-09-21T08:02:35.092 INFO:tasks.workunit.client.1.smithi129.stdout:7/765: rmdir d0/d1e/d9a/dca/d100 39 2024-09-21T08:02:35.093 INFO:tasks.workunit.client.0.smithi107.stdout:0/57: dread d1/fe [0,4194304] 0 2024-09-21T08:02:35.094 INFO:tasks.workunit.client.1.smithi129.stdout:4/594: symlink d5/d16/d47/d5f/d64/lda 0 2024-09-21T08:02:35.096 INFO:tasks.workunit.client.1.smithi129.stdout:6/597: write d7/d10/f15 [3570623,63543] 0 2024-09-21T08:02:35.096 INFO:tasks.workunit.client.1.smithi129.stdout:6/598: chown d7/d1b/d1e/d66/dba/d35/d40/d78/c94 465232844 1 2024-09-21T08:02:35.097 INFO:tasks.workunit.client.0.smithi107.stdout:1/23: mkdir d0/d7 0 2024-09-21T08:02:35.098 INFO:tasks.workunit.client.1.smithi129.stdout:2/836: mknod d1/d13/d3a/c128 0 2024-09-21T08:02:35.098 INFO:tasks.workunit.client.0.smithi107.stdout:6/29: dread d2/d3/f4 [0,4194304] 0 2024-09-21T08:02:35.099 INFO:tasks.workunit.client.0.smithi107.stdout:3/9: mknod c0 0 2024-09-21T08:02:35.099 INFO:tasks.workunit.client.0.smithi107.stdout:3/10: dwrite - no filename 2024-09-21T08:02:35.100 INFO:tasks.workunit.client.1.smithi129.stdout:9/597: truncate d17/f83 58035 0 2024-09-21T08:02:35.104 INFO:tasks.workunit.client.1.smithi129.stdout:6/599: dread d7/fe [4194304,4194304] 0 2024-09-21T08:02:35.105 INFO:tasks.workunit.client.0.smithi107.stdout:9/74: truncate f3 3489463 0 2024-09-21T08:02:35.107 INFO:tasks.workunit.client.1.smithi129.stdout:7/766: creat d0/d46/f101 x:0 0 0 2024-09-21T08:02:35.108 INFO:tasks.workunit.client.0.smithi107.stdout:4/30: unlink f0 0 2024-09-21T08:02:35.109 INFO:tasks.workunit.client.1.smithi129.stdout:4/595: symlink d5/d11/d77/da8/ldb 0 2024-09-21T08:02:35.109 INFO:tasks.workunit.client.1.smithi129.stdout:4/596: truncate d5/d6/f87 681811 0 2024-09-21T08:02:35.111 INFO:tasks.workunit.client.1.smithi129.stdout:2/837: rmdir d1/dc/d94/d116/d11d 0 2024-09-21T08:02:35.112 INFO:tasks.workunit.client.1.smithi129.stdout:2/838: write d1/dc/d19/d4c/ff8 [532216,69947] 0 2024-09-21T08:02:35.113 INFO:tasks.workunit.client.0.smithi107.stdout:0/58: mkdir d1/d15 0 2024-09-21T08:02:35.113 INFO:tasks.workunit.client.0.smithi107.stdout:0/59: write d1/fe [1441060,115931] 0 2024-09-21T08:02:35.113 INFO:tasks.workunit.client.0.smithi107.stdout:0/60: truncate d1/d5/f14 27642 0 2024-09-21T08:02:35.113 INFO:tasks.workunit.client.1.smithi129.stdout:9/598: mknod d17/d46/cca 0 2024-09-21T08:02:35.114 INFO:tasks.workunit.client.0.smithi107.stdout:1/24: rmdir d0/d6 0 2024-09-21T08:02:35.115 INFO:tasks.workunit.client.1.smithi129.stdout:2/839: dread d1/d13/d32/d97/fa5 [0,4194304] 0 2024-09-21T08:02:35.117 INFO:tasks.workunit.client.0.smithi107.stdout:7/89: mkdir d7/d22 0 2024-09-21T08:02:35.118 INFO:tasks.workunit.client.0.smithi107.stdout:7/90: chown d7/d18/f19 1971 1 2024-09-21T08:02:35.118 INFO:tasks.workunit.client.0.smithi107.stdout:7/91: dread f3 [0,4194304] 0 2024-09-21T08:02:35.119 INFO:tasks.workunit.client.1.smithi129.stdout:6/600: rename d7/d1b/d1e/d66/dba/d35/l65 to d7/d1b/d1e/d66/dba/d35/d40/d41/lc9 0 2024-09-21T08:02:35.120 INFO:tasks.workunit.client.0.smithi107.stdout:6/30: rmdir d2 39 2024-09-21T08:02:35.122 INFO:tasks.workunit.client.1.smithi129.stdout:9/599: symlink d17/d22/d33/lcb 0 2024-09-21T08:02:35.122 INFO:tasks.workunit.client.0.smithi107.stdout:3/11: rename c0 to c1 0 2024-09-21T08:02:35.124 INFO:tasks.workunit.client.1.smithi129.stdout:2/840: mkdir d1/d13/d3a/d129 0 2024-09-21T08:02:35.125 INFO:tasks.workunit.client.0.smithi107.stdout:8/3: link f1 f2 0 2024-09-21T08:02:35.125 INFO:tasks.workunit.client.0.smithi107.stdout:8/4: creat f3 x:0 0 0 2024-09-21T08:02:35.126 INFO:tasks.workunit.client.0.smithi107.stdout:6/31: write d2/d3/f4 [2783808,67530] 0 2024-09-21T08:02:35.126 INFO:tasks.workunit.client.1.smithi129.stdout:1/729: sync 2024-09-21T08:02:35.127 INFO:tasks.workunit.client.1.smithi129.stdout:7/767: rename d0/d46/c88 to d0/d1e/d9a/dca/d100/d8f/c102 0 2024-09-21T08:02:35.127 INFO:tasks.workunit.client.1.smithi129.stdout:7/768: creat d0/d46/d6e/de4/f103 x:0 0 0 2024-09-21T08:02:35.131 INFO:tasks.workunit.client.1.smithi129.stdout:2/841: symlink d1/d53/l12a 0 2024-09-21T08:02:35.131 INFO:tasks.workunit.client.1.smithi129.stdout:2/842: write d1/dc/d19/d4c/d9d/fcb [3440773,48357] 0 2024-09-21T08:02:35.131 INFO:tasks.workunit.client.1.smithi129.stdout:2/843: read d1/f8 [1089720,702] 0 2024-09-21T08:02:35.131 INFO:tasks.workunit.client.1.smithi129.stdout:2/844: read - d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d50/f127 zero size 2024-09-21T08:02:35.131 INFO:tasks.workunit.client.1.smithi129.stdout:3/722: sync 2024-09-21T08:02:35.131 INFO:tasks.workunit.client.1.smithi129.stdout:5/712: sync 2024-09-21T08:02:35.132 INFO:tasks.workunit.client.1.smithi129.stdout:3/723: dread d3/da/dc/fbd [0,4194304] 0 2024-09-21T08:02:35.134 INFO:tasks.workunit.client.1.smithi129.stdout:2/845: dread d1/dc/d19/d88/fd3 [0,4194304] 0 2024-09-21T08:02:35.134 INFO:tasks.workunit.client.1.smithi129.stdout:1/730: unlink d1/d16/c3e 0 2024-09-21T08:02:35.134 INFO:tasks.workunit.client.1.smithi129.stdout:1/731: truncate d1/d4/dc2/dc6/f78 963701 0 2024-09-21T08:02:35.135 INFO:tasks.workunit.client.1.smithi129.stdout:2/846: dread d1/dc/f37 [0,4194304] 0 2024-09-21T08:02:35.135 INFO:tasks.workunit.client.0.smithi107.stdout:9/75: creat d11/f15 x:0 0 0 2024-09-21T08:02:35.136 INFO:tasks.workunit.client.1.smithi129.stdout:5/713: dread d2/d1e/d35/d37/f73 [0,4194304] 0 2024-09-21T08:02:35.139 INFO:tasks.workunit.client.1.smithi129.stdout:7/769: creat d0/d1e/d9a/dca/de8/f104 x:0 0 0 2024-09-21T08:02:35.139 INFO:tasks.workunit.client.1.smithi129.stdout:7/770: fsync d0/d46/d6e/f85 0 2024-09-21T08:02:35.139 INFO:tasks.workunit.client.1.smithi129.stdout:7/771: fdatasync d0/d1e/f36 0 2024-09-21T08:02:35.140 INFO:tasks.workunit.client.0.smithi107.stdout:7/92: symlink d7/d22/l23 0 2024-09-21T08:02:35.142 INFO:tasks.workunit.client.1.smithi129.stdout:3/724: creat d3/d5a/da9/fff x:0 0 0 2024-09-21T08:02:35.143 INFO:tasks.workunit.client.0.smithi107.stdout:8/5: link f2 f4 0 2024-09-21T08:02:35.143 INFO:tasks.workunit.client.0.smithi107.stdout:8/6: dread - f1 zero size 2024-09-21T08:02:35.143 INFO:tasks.workunit.client.0.smithi107.stdout:8/7: readlink - no filename 2024-09-21T08:02:35.143 INFO:tasks.workunit.client.0.smithi107.stdout:1/25: dwrite d0/f3 [4194304,4194304] 0 2024-09-21T08:02:35.144 INFO:tasks.workunit.client.1.smithi129.stdout:1/732: rename d1/f3 to d1/d4/dc2/dc6/d7f/ff9 0 2024-09-21T08:02:35.146 INFO:tasks.workunit.client.1.smithi129.stdout:2/847: mkdir d1/d13/d3a/d12b 0 2024-09-21T08:02:35.146 INFO:tasks.workunit.client.0.smithi107.stdout:6/32: mkdir d2/d3/d7 0 2024-09-21T08:02:35.147 INFO:tasks.workunit.client.0.smithi107.stdout:6/33: write d2/d3/f4 [440637,44347] 0 2024-09-21T08:02:35.147 INFO:tasks.workunit.client.0.smithi107.stdout:6/34: readlink l1 0 2024-09-21T08:02:35.147 INFO:tasks.workunit.client.1.smithi129.stdout:7/772: mknod d0/d1e/db1/dba/c105 0 2024-09-21T08:02:35.148 INFO:tasks.workunit.client.1.smithi129.stdout:3/725: mknod d3/da/dc/d7f/dd6/de2/df2/c100 0 2024-09-21T08:02:35.148 INFO:tasks.workunit.client.1.smithi129.stdout:3/726: read d3/d69/d95/d52/f5e [2471221,30085] 0 2024-09-21T08:02:35.148 INFO:tasks.workunit.client.1.smithi129.stdout:6/601: dwrite d7/fc8 [0,4194304] 0 2024-09-21T08:02:35.149 INFO:tasks.workunit.client.1.smithi129.stdout:4/597: dwrite d5/d16/f1f [4194304,4194304] 0 2024-09-21T08:02:35.149 INFO:tasks.workunit.client.1.smithi129.stdout:4/598: fsync d5/dbd/fad 0 2024-09-21T08:02:35.149 INFO:tasks.workunit.client.0.smithi107.stdout:4/31: dwrite f6 [0,4194304] 0 2024-09-21T08:02:35.149 INFO:tasks.workunit.client.0.smithi107.stdout:4/32: creat f7 x:0 0 0 2024-09-21T08:02:35.150 INFO:tasks.workunit.client.1.smithi129.stdout:5/714: rename d2/d1e/d35/d37/d96/fc9 to d2/d1e/d35/d33/dca/fda 0 2024-09-21T08:02:35.151 INFO:tasks.workunit.client.1.smithi129.stdout:9/600: dwrite d17/d23/f2d [0,4194304] 0 2024-09-21T08:02:35.152 INFO:tasks.workunit.client.0.smithi107.stdout:7/93: creat d7/d22/f24 x:0 0 0 2024-09-21T08:02:35.155 INFO:tasks.workunit.client.1.smithi129.stdout:2/848: mknod d1/d13/d3a/d47/d1f/d85/df7/d45/d65/ddf/de5/c12c 0 2024-09-21T08:02:35.155 INFO:tasks.workunit.client.1.smithi129.stdout:2/849: chown d1/d53/d77/d8b/f105 331 1 2024-09-21T08:02:35.155 INFO:tasks.workunit.client.1.smithi129.stdout:2/850: write d1/d53/d77/f10d [580571,21372] 0 2024-09-21T08:02:35.155 INFO:tasks.workunit.client.1.smithi129.stdout:2/851: readlink d1/dc/d19/d4c/d6a/d69/l7f 0 2024-09-21T08:02:35.156 INFO:tasks.workunit.client.0.smithi107.stdout:8/8: mkdir d5 0 2024-09-21T08:02:35.159 INFO:tasks.workunit.client.1.smithi129.stdout:7/773: creat d0/dc5/f106 x:0 0 0 2024-09-21T08:02:35.160 INFO:tasks.workunit.client.1.smithi129.stdout:1/733: write d1/d9/f58 [3548964,40447] 0 2024-09-21T08:02:35.165 INFO:tasks.workunit.client.0.smithi107.stdout:1/26: creat d0/d7/f8 x:0 0 0 2024-09-21T08:02:35.165 INFO:tasks.workunit.client.0.smithi107.stdout:1/27: chown d0 3 1 2024-09-21T08:02:35.165 INFO:tasks.workunit.client.0.smithi107.stdout:1/28: dread - d0/f5 zero size 2024-09-21T08:02:35.166 INFO:tasks.workunit.client.1.smithi129.stdout:6/602: mknod d7/d1b/d8d/cca 0 2024-09-21T08:02:35.169 INFO:tasks.workunit.client.0.smithi107.stdout:0/61: write d1/f8 [4296643,92730] 0 2024-09-21T08:02:35.171 INFO:tasks.workunit.client.0.smithi107.stdout:6/35: unlink l1 0 2024-09-21T08:02:35.172 INFO:tasks.workunit.client.1.smithi129.stdout:4/599: mknod d5/d11/d77/cdc 0 2024-09-21T08:02:35.172 INFO:tasks.workunit.client.1.smithi129.stdout:3/727: dwrite d3/d57/fec [0,4194304] 0 2024-09-21T08:02:35.174 INFO:tasks.workunit.client.1.smithi129.stdout:5/715: mknod d2/d1e/d35/d33/d36/d5a/d77/d81/cdb 0 2024-09-21T08:02:35.177 INFO:tasks.workunit.client.0.smithi107.stdout:1/29: write d0/f3 [347158,82442] 0 2024-09-21T08:02:35.181 INFO:tasks.workunit.client.1.smithi129.stdout:9/601: rename d17/d22/d33/d7a/d89/d90/db1/d31/l4d to d17/d46/d9c/lcc 0 2024-09-21T08:02:35.182 INFO:tasks.workunit.client.0.smithi107.stdout:7/94: rmdir d7/d18 39 2024-09-21T08:02:35.183 INFO:tasks.workunit.client.0.smithi107.stdout:7/95: read - d7/d10/f21 zero size 2024-09-21T08:02:35.183 INFO:tasks.workunit.client.1.smithi129.stdout:1/734: symlink d1/d9/lfa 0 2024-09-21T08:02:35.184 INFO:tasks.workunit.client.0.smithi107.stdout:8/9: creat d5/f6 x:0 0 0 2024-09-21T08:02:35.185 INFO:tasks.workunit.client.1.smithi129.stdout:4/600: creat d5/d33/d66/fdd x:0 0 0 2024-09-21T08:02:35.186 INFO:tasks.workunit.client.1.smithi129.stdout:4/601: write d5/d16/d24/d3b/f97 [256715,33227] 0 2024-09-21T08:02:35.187 INFO:tasks.workunit.client.0.smithi107.stdout:4/33: dwrite f6 [0,4194304] 0 2024-09-21T08:02:35.187 INFO:tasks.workunit.client.0.smithi107.stdout:4/34: write f7 [36593,96078] 0 2024-09-21T08:02:35.187 INFO:tasks.workunit.client.0.smithi107.stdout:4/35: creat f8 x:0 0 0 2024-09-21T08:02:35.187 INFO:tasks.workunit.client.0.smithi107.stdout:0/62: symlink d1/d5/l16 0 2024-09-21T08:02:35.189 INFO:tasks.workunit.client.0.smithi107.stdout:7/96: rmdir d7/d18 39 2024-09-21T08:02:35.190 INFO:tasks.workunit.client.0.smithi107.stdout:8/10: mknod d5/c7 0 2024-09-21T08:02:35.191 INFO:tasks.workunit.client.0.smithi107.stdout:8/11: chown d5/c7 1870475 1 2024-09-21T08:02:35.193 INFO:tasks.workunit.client.1.smithi129.stdout:5/716: symlink d2/d1e/d35/d33/d36/d5a/d77/ldc 0 2024-09-21T08:02:35.193 INFO:tasks.workunit.client.1.smithi129.stdout:5/717: chown d2/d1e/d35/d37 6420 1 2024-09-21T08:02:35.193 INFO:tasks.workunit.client.0.smithi107.stdout:7/97: fsync d7/d22/f24 0 2024-09-21T08:02:35.194 INFO:tasks.workunit.client.0.smithi107.stdout:7/98: read - d7/f14 zero size 2024-09-21T08:02:35.195 INFO:tasks.workunit.client.1.smithi129.stdout:6/603: rename d7/d1b/d1e/d66/dba/d2b/c9c to d7/d1b/d1e/d39/ccb 0 2024-09-21T08:02:35.197 INFO:tasks.workunit.client.1.smithi129.stdout:2/852: dwrite d1/f2e [0,4194304] 0 2024-09-21T08:02:35.197 INFO:tasks.workunit.client.1.smithi129.stdout:7/774: dwrite d0/d46/d6e/f64 [0,4194304] 0 2024-09-21T08:02:35.199 INFO:tasks.workunit.client.1.smithi129.stdout:9/602: unlink d17/d22/d33/d36/l9a 0 2024-09-21T08:02:35.199 INFO:tasks.workunit.client.1.smithi129.stdout:9/603: read - d17/d22/d33/d7a/d89/d90/db1/d31/d35/fbb zero size 2024-09-21T08:02:35.199 INFO:tasks.workunit.client.1.smithi129.stdout:1/735: symlink d1/d44/d83/lfb 0 2024-09-21T08:02:35.199 INFO:tasks.workunit.client.1.smithi129.stdout:1/736: read - d1/d16/d25/f61 zero size 2024-09-21T08:02:35.199 INFO:tasks.workunit.client.1.smithi129.stdout:1/737: fsync d1/d44/d83/fb2 0 2024-09-21T08:02:35.200 INFO:tasks.workunit.client.0.smithi107.stdout:7/99: mknod d7/c25 0 2024-09-21T08:02:35.200 INFO:tasks.workunit.client.0.smithi107.stdout:7/100: stat d7/fd 0 2024-09-21T08:02:35.201 INFO:tasks.workunit.client.1.smithi129.stdout:5/718: rename d2/d2a/d50/c9c to d2/cdd 0 2024-09-21T08:02:35.202 INFO:tasks.workunit.client.1.smithi129.stdout:6/604: mkdir d7/d10/dcc 0 2024-09-21T08:02:35.202 INFO:tasks.workunit.client.1.smithi129.stdout:6/605: readlink d7/d1b/d1e/d66/dc2/d5e/l68 0 2024-09-21T08:02:35.203 INFO:tasks.workunit.client.0.smithi107.stdout:4/36: dread f6 [0,4194304] 0 2024-09-21T08:02:35.204 INFO:tasks.workunit.client.1.smithi129.stdout:7/775: dread d0/d46/d6e/d9b/da5/db3/fbb [0,4194304] 0 2024-09-21T08:02:35.204 INFO:tasks.workunit.client.1.smithi129.stdout:2/853: symlink d1/dc/d19/l12d 0 2024-09-21T08:02:35.205 INFO:tasks.workunit.client.0.smithi107.stdout:6/36: dread d2/d3/f4 [0,4194304] 0 2024-09-21T08:02:35.205 INFO:tasks.workunit.client.0.smithi107.stdout:6/37: chown d2/c5 1257156 1 2024-09-21T08:02:35.207 INFO:tasks.workunit.client.0.smithi107.stdout:4/37: symlink l9 0 2024-09-21T08:02:35.207 INFO:tasks.workunit.client.0.smithi107.stdout:4/38: fdatasync f8 0 2024-09-21T08:02:35.207 INFO:tasks.workunit.client.0.smithi107.stdout:4/39: write f8 [473140,40479] 0 2024-09-21T08:02:35.208 INFO:tasks.workunit.client.0.smithi107.stdout:6/38: dread d2/d3/f4 [0,4194304] 0 2024-09-21T08:02:35.208 INFO:tasks.workunit.client.1.smithi129.stdout:9/604: creat d17/d22/fcd x:0 0 0 2024-09-21T08:02:35.210 INFO:tasks.workunit.client.0.smithi107.stdout:4/40: fdatasync f7 0 2024-09-21T08:02:35.211 INFO:tasks.workunit.client.0.smithi107.stdout:4/41: fdatasync f6 0 2024-09-21T08:02:35.211 INFO:tasks.workunit.client.1.smithi129.stdout:6/606: mkdir d7/d1b/d1e/d39/dbf/dcd 0 2024-09-21T08:02:35.215 INFO:tasks.workunit.client.0.smithi107.stdout:4/42: dread f7 [0,4194304] 0 2024-09-21T08:02:35.215 INFO:tasks.workunit.client.0.smithi107.stdout:4/43: chown c1 197 1 2024-09-21T08:02:35.217 INFO:tasks.workunit.client.1.smithi129.stdout:9/605: link d17/d22/d33/d36/d48/d3f/d71/ca7 d17/d22/d33/d7a/d89/cce 0 2024-09-21T08:02:35.217 INFO:tasks.workunit.client.1.smithi129.stdout:7/776: dread d0/d46/d6e/d9b/fc3 [0,4194304] 0 2024-09-21T08:02:35.217 INFO:tasks.workunit.client.1.smithi129.stdout:3/728: dwrite d3/da/dc/d11/d2f/f40 [0,4194304] 0 2024-09-21T08:02:35.217 INFO:tasks.workunit.client.0.smithi107.stdout:6/39: dread d2/d3/f6 [0,4194304] 0 2024-09-21T08:02:35.218 INFO:tasks.workunit.client.0.smithi107.stdout:1/30: dwrite d0/f5 [0,4194304] 0 2024-09-21T08:02:35.218 INFO:tasks.workunit.client.0.smithi107.stdout:1/31: stat d0/f4 0 2024-09-21T08:02:35.219 INFO:tasks.workunit.client.0.smithi107.stdout:6/40: getdents d2 0 2024-09-21T08:02:35.219 INFO:tasks.workunit.client.0.smithi107.stdout:6/41: chown l0 10 1 2024-09-21T08:02:35.219 INFO:tasks.workunit.client.0.smithi107.stdout:6/42: write d2/d3/f4 [1703871,12081] 0 2024-09-21T08:02:35.220 INFO:tasks.workunit.client.1.smithi129.stdout:7/777: dread d0/d46/f53 [0,4194304] 0 2024-09-21T08:02:35.220 INFO:tasks.workunit.client.1.smithi129.stdout:7/778: chown d0/d46/d6e/d9b/da5/db7/fd1 1093764524 1 2024-09-21T08:02:35.220 INFO:tasks.workunit.client.1.smithi129.stdout:1/738: dwrite d1/d16/d28/ff2 [0,4194304] 0 2024-09-21T08:02:35.228 INFO:tasks.workunit.client.0.smithi107.stdout:1/32: rename d0/f5 to d0/d7/f9 0 2024-09-21T08:02:35.228 INFO:tasks.workunit.client.0.smithi107.stdout:6/43: dread d2/d3/f4 [0,4194304] 0 2024-09-21T08:02:35.230 INFO:tasks.workunit.client.0.smithi107.stdout:0/63: dread d1/f8 [0,4194304] 0 2024-09-21T08:02:35.230 INFO:tasks.workunit.client.0.smithi107.stdout:0/64: chown d1/d5/l16 1205 1 2024-09-21T08:02:35.230 INFO:tasks.workunit.client.0.smithi107.stdout:4/44: fsync f8 0 2024-09-21T08:02:35.237 INFO:tasks.workunit.client.0.smithi107.stdout:1/33: link d0/f4 d0/d7/fa 0 2024-09-21T08:02:35.239 INFO:tasks.workunit.client.0.smithi107.stdout:0/65: mknod d1/d15/c17 0 2024-09-21T08:02:35.240 INFO:tasks.workunit.client.1.smithi129.stdout:6/607: unlink d7/d1b/d1e/d66/f8b 0 2024-09-21T08:02:35.242 INFO:tasks.workunit.client.0.smithi107.stdout:1/34: link d0/f3 d0/fb 0 2024-09-21T08:02:35.242 INFO:tasks.workunit.client.0.smithi107.stdout:1/35: readlink - no filename 2024-09-21T08:02:35.242 INFO:tasks.workunit.client.0.smithi107.stdout:1/36: creat d0/fc x:0 0 0 2024-09-21T08:02:35.242 INFO:tasks.workunit.client.0.smithi107.stdout:1/37: dread - d0/d7/f8 zero size 2024-09-21T08:02:35.243 INFO:tasks.workunit.client.1.smithi129.stdout:2/854: getdents d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d50 0 2024-09-21T08:02:35.243 INFO:tasks.workunit.client.1.smithi129.stdout:3/729: dwrite d3/da/dc/fb5 [0,4194304] 0 2024-09-21T08:02:35.245 INFO:tasks.workunit.client.1.smithi129.stdout:9/606: symlink d17/d22/d33/d7a/d89/d90/db1/d31/d35/lcf 0 2024-09-21T08:02:35.245 INFO:tasks.workunit.client.0.smithi107.stdout:0/66: dread d1/f8 [0,4194304] 0 2024-09-21T08:02:35.246 INFO:tasks.workunit.client.1.smithi129.stdout:9/607: dread d17/d22/d33/d36/d48/d3f/d53/fa3 [0,4194304] 0 2024-09-21T08:02:35.246 INFO:tasks.workunit.client.1.smithi129.stdout:9/608: readlink d17/l21 0 2024-09-21T08:02:35.248 INFO:tasks.workunit.client.1.smithi129.stdout:7/779: rename d0/d1e/db1/dc7/lf3 to d0/d1e/db1/dba/dc1/dc4/l107 0 2024-09-21T08:02:35.249 INFO:tasks.workunit.client.0.smithi107.stdout:0/67: rename d1/d5/cc to d1/d10/c18 0 2024-09-21T08:02:35.251 INFO:tasks.workunit.client.0.smithi107.stdout:0/68: dread d1/d5/f14 [0,4194304] 0 2024-09-21T08:02:35.251 INFO:tasks.workunit.client.0.smithi107.stdout:0/69: truncate d1/f11 1029936 0 2024-09-21T08:02:35.251 INFO:tasks.workunit.client.0.smithi107.stdout:0/70: read d1/f11 [927636,11001] 0 2024-09-21T08:02:35.253 INFO:tasks.workunit.client.1.smithi129.stdout:6/608: rmdir d7/d1b 39 2024-09-21T08:02:35.255 INFO:tasks.workunit.client.0.smithi107.stdout:0/71: creat d1/f19 x:0 0 0 2024-09-21T08:02:35.255 INFO:tasks.workunit.client.0.smithi107.stdout:0/72: truncate d1/d5/f14 697025 0 2024-09-21T08:02:35.255 INFO:tasks.workunit.client.0.smithi107.stdout:0/73: chown d1/fe 46392553 1 2024-09-21T08:02:35.255 INFO:tasks.workunit.client.0.smithi107.stdout:0/74: dread - d1/f19 zero size 2024-09-21T08:02:35.255 INFO:tasks.workunit.client.0.smithi107.stdout:6/44: dwrite d2/d3/f4 [0,4194304] 0 2024-09-21T08:02:35.255 INFO:tasks.workunit.client.1.smithi129.stdout:1/739: dwrite d1/d16/db3/fe1 [0,4194304] 0 2024-09-21T08:02:35.257 INFO:tasks.workunit.client.1.smithi129.stdout:7/780: dread d0/d1e/f36 [0,4194304] 0 2024-09-21T08:02:35.257 INFO:tasks.workunit.client.1.smithi129.stdout:7/781: write d0/d46/d6e/de4/ff4 [67281,64916] 0 2024-09-21T08:02:35.258 INFO:tasks.workunit.client.0.smithi107.stdout:0/75: unlink d1/d5/l16 0 2024-09-21T08:02:35.262 INFO:tasks.workunit.client.1.smithi129.stdout:3/730: link d3/da/dc/da3/fb2 d3/da/dc/d7f/dd6/de2/df2/f101 0 2024-09-21T08:02:35.265 INFO:tasks.workunit.client.1.smithi129.stdout:9/609: mknod d17/d22/d33/d36/d48/d3f/d53/cd0 0 2024-09-21T08:02:35.265 INFO:tasks.workunit.client.1.smithi129.stdout:6/609: chown d7/d1b/d1e/d39/ccb 18779650 1 2024-09-21T08:02:35.269 INFO:tasks.workunit.client.1.smithi129.stdout:1/740: rename d1/d9/d6b/faf to d1/df1/ffc 0 2024-09-21T08:02:35.269 INFO:tasks.workunit.client.1.smithi129.stdout:7/782: rename d0/d46/d6e to d0/d46/d6e/d9b/da5/d108 22 2024-09-21T08:02:35.269 INFO:tasks.workunit.client.1.smithi129.stdout:1/741: chown d1/d9/d31/la5 259786502 1 2024-09-21T08:02:35.270 INFO:tasks.workunit.client.0.smithi107.stdout:1/38: dwrite d0/d7/f9 [0,4194304] 0 2024-09-21T08:02:35.270 INFO:tasks.workunit.client.0.smithi107.stdout:1/39: creat d0/d7/fd x:0 0 0 2024-09-21T08:02:35.270 INFO:tasks.workunit.client.1.smithi129.stdout:6/610: dread d7/f8 [4194304,4194304] 0 2024-09-21T08:02:35.270 INFO:tasks.workunit.client.1.smithi129.stdout:2/855: getdents d1/dc 0 2024-09-21T08:02:35.270 INFO:tasks.workunit.client.1.smithi129.stdout:2/856: read d1/d13/d3a/d47/d1f/f25 [914696,107268] 0 2024-09-21T08:02:35.271 INFO:tasks.workunit.client.0.smithi107.stdout:6/45: dwrite d2/d3/f6 [4194304,4194304] 0 2024-09-21T08:02:35.274 INFO:tasks.workunit.client.0.smithi107.stdout:1/40: symlink d0/d7/le 0 2024-09-21T08:02:35.278 INFO:tasks.workunit.client.1.smithi129.stdout:3/731: rename d3/da/dc/d11/l1f to d3/da/d5d/l102 0 2024-09-21T08:02:35.279 INFO:tasks.workunit.client.0.smithi107.stdout:1/41: truncate d0/f4 181860 0 2024-09-21T08:02:35.281 INFO:tasks.workunit.client.1.smithi129.stdout:7/783: unlink d0/d46/d6e/d9b/fa7 0 2024-09-21T08:02:35.281 INFO:tasks.workunit.client.1.smithi129.stdout:1/742: mknod d1/d44/d83/dc5/cfd 0 2024-09-21T08:02:35.283 INFO:tasks.workunit.client.0.smithi107.stdout:1/42: mknod d0/cf 0 2024-09-21T08:02:35.283 INFO:tasks.workunit.client.0.smithi107.stdout:1/43: write d0/fc [337482,86008] 0 2024-09-21T08:02:35.284 INFO:tasks.workunit.client.0.smithi107.stdout:0/76: rename d1/d10 to d1/d15/d1a 0 2024-09-21T08:02:35.284 INFO:tasks.workunit.client.0.smithi107.stdout:0/77: write d1/d5/f14 [1182820,84910] 0 2024-09-21T08:02:35.286 INFO:tasks.workunit.client.1.smithi129.stdout:6/611: unlink d7/d1b/d1e/d66/dba/d35/d40/l5a 0 2024-09-21T08:02:35.286 INFO:tasks.workunit.client.1.smithi129.stdout:0/654: sync 2024-09-21T08:02:35.287 INFO:tasks.workunit.client.1.smithi129.stdout:0/655: write de/d1f/da9/f98 [2134753,123268] 0 2024-09-21T08:02:35.287 INFO:tasks.workunit.client.1.smithi129.stdout:0/656: creat de/d15/d44/d45/fd6 x:0 0 0 2024-09-21T08:02:35.287 INFO:tasks.workunit.client.1.smithi129.stdout:0/657: fdatasync de/d15/d51/f5d 0 2024-09-21T08:02:35.287 INFO:tasks.workunit.client.1.smithi129.stdout:0/658: stat de/d1f/f9b 0 2024-09-21T08:02:35.288 INFO:tasks.workunit.client.1.smithi129.stdout:2/857: creat d1/d53/d68/f12e x:0 0 0 2024-09-21T08:02:35.288 INFO:tasks.workunit.client.1.smithi129.stdout:2/858: chown d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d50/l7d 603209459 1 2024-09-21T08:02:35.289 INFO:tasks.workunit.client.1.smithi129.stdout:3/732: mknod d3/da/c103 0 2024-09-21T08:02:35.289 INFO:tasks.workunit.client.1.smithi129.stdout:3/733: chown d3/da/c10 442836 1 2024-09-21T08:02:35.291 INFO:tasks.workunit.client.1.smithi129.stdout:1/743: mkdir d1/d7a/da4/dfe 0 2024-09-21T08:02:35.292 INFO:tasks.workunit.client.1.smithi129.stdout:6/612: rmdir d7/d1b/d1e/d39/d79/db8 39 2024-09-21T08:02:35.295 INFO:tasks.workunit.client.1.smithi129.stdout:0/659: getdents de/d15/d39/d7f 0 2024-09-21T08:02:35.296 INFO:tasks.workunit.client.1.smithi129.stdout:2/859: rename d1/d13/d32/d97/da7/lb4 to d1/d13/d3a/d47/d1f/d85/df7/d45/d65/ddf/de5/l12f 0 2024-09-21T08:02:35.299 INFO:tasks.workunit.client.1.smithi129.stdout:3/734: link d3/da/dc/d11/d2f/fbf d3/da/d5d/d94/f104 0 2024-09-21T08:02:35.299 INFO:tasks.workunit.client.1.smithi129.stdout:3/735: fsync d3/da/ff 0 2024-09-21T08:02:35.304 INFO:tasks.workunit.client.1.smithi129.stdout:6/613: getdents d7/d1b/d1e/d66/dba 0 2024-09-21T08:02:35.304 INFO:tasks.workunit.client.1.smithi129.stdout:4/602: sync 2024-09-21T08:02:35.304 INFO:tasks.workunit.client.1.smithi129.stdout:8/546: sync 2024-09-21T08:02:35.305 INFO:tasks.workunit.client.1.smithi129.stdout:1/744: read d1/d16/f71 [3993159,27416] 0 2024-09-21T08:02:35.306 INFO:tasks.workunit.client.1.smithi129.stdout:0/660: symlink de/d1f/da9/ld7 0 2024-09-21T08:02:35.306 INFO:tasks.workunit.client.1.smithi129.stdout:0/661: fsync de/d1f/f9b 0 2024-09-21T08:02:35.308 INFO:tasks.workunit.client.1.smithi129.stdout:2/860: rename d1/d13/d3a/d47/d1f/d85/df7/d45/d65/f9f to d1/d13/d3a/d8f/f130 0 2024-09-21T08:02:35.308 INFO:tasks.workunit.client.1.smithi129.stdout:2/861: write d1/dc/d19/d4c/d9d/fcb [1779845,54143] 0 2024-09-21T08:02:35.309 INFO:tasks.workunit.client.1.smithi129.stdout:3/736: symlink d3/da/d5d/l105 0 2024-09-21T08:02:35.309 INFO:tasks.workunit.client.1.smithi129.stdout:3/737: write d3/da/dc/d11/d2f/ff4 [856544,90935] 0 2024-09-21T08:02:35.312 INFO:tasks.workunit.client.1.smithi129.stdout:6/614: unlink d7/d1b/d1e/c2d 0 2024-09-21T08:02:35.312 INFO:tasks.workunit.client.1.smithi129.stdout:4/603: symlink d5/d16/d85/lde 0 2024-09-21T08:02:35.312 INFO:tasks.workunit.client.1.smithi129.stdout:4/604: dread - d5/d16/d24/d3b/fca zero size 2024-09-21T08:02:35.312 INFO:tasks.workunit.client.1.smithi129.stdout:4/605: write d5/d16/d24/d3b/f97 [289105,2983] 0 2024-09-21T08:02:35.313 INFO:tasks.workunit.client.1.smithi129.stdout:8/547: creat d0/d6/d7/d18/d27/d32/fa7 x:0 0 0 2024-09-21T08:02:35.314 INFO:tasks.workunit.client.1.smithi129.stdout:1/745: mkdir d1/d4/dad/db6/df7/dff 0 2024-09-21T08:02:35.315 INFO:tasks.workunit.client.1.smithi129.stdout:0/662: truncate de/d15/f43 2974058 0 2024-09-21T08:02:35.316 INFO:tasks.workunit.client.1.smithi129.stdout:8/548: write d0/d6/d7/d18/d27/d60/d85/f99 [325111,16682] 0 2024-09-21T08:02:35.317 INFO:tasks.workunit.client.1.smithi129.stdout:7/784: dwrite d0/d46/d6e/dad/fb9 [0,4194304] 0 2024-09-21T08:02:35.317 INFO:tasks.workunit.client.1.smithi129.stdout:7/785: write d0/f6f [1410733,17853] 0 2024-09-21T08:02:35.317 INFO:tasks.workunit.client.1.smithi129.stdout:7/786: chown d0/d46/d6e/d9b/da5/db7 0 1 2024-09-21T08:02:35.318 INFO:tasks.workunit.client.1.smithi129.stdout:6/615: rmdir d7/d1b/d1e/d66/dba/d2b 39 2024-09-21T08:02:35.318 INFO:tasks.workunit.client.1.smithi129.stdout:2/862: mkdir d1/d13/d3a/d47/d1f/d85/d131 0 2024-09-21T08:02:35.318 INFO:tasks.workunit.client.1.smithi129.stdout:2/863: chown d1/d13/f83 23081525 1 2024-09-21T08:02:35.318 INFO:tasks.workunit.client.1.smithi129.stdout:6/616: creat d7/d1b/d1e/d39/d79/fce x:0 0 0 2024-09-21T08:02:35.318 INFO:tasks.workunit.client.1.smithi129.stdout:2/864: write d1/dc/d94/d116/f120 [569799,86489] 0 2024-09-21T08:02:35.319 INFO:tasks.workunit.client.1.smithi129.stdout:4/606: symlink d5/d48/ldf 0 2024-09-21T08:02:35.323 INFO:tasks.workunit.client.1.smithi129.stdout:1/746: rename d1/d16/d28/c94 to d1/d4/dad/db6/c100 0 2024-09-21T08:02:35.324 INFO:tasks.workunit.client.1.smithi129.stdout:1/747: chown d1/d16/d9b 21 1 2024-09-21T08:02:35.327 INFO:tasks.workunit.client.1.smithi129.stdout:8/549: unlink d0/d6/ca5 0 2024-09-21T08:02:35.327 INFO:tasks.workunit.client.1.smithi129.stdout:8/550: fdatasync d0/d6/d7/d18/d27/f39 0 2024-09-21T08:02:35.331 INFO:tasks.workunit.client.1.smithi129.stdout:7/787: write d0/d46/d6e/f64 [2865080,82921] 0 2024-09-21T08:02:35.331 INFO:tasks.workunit.client.1.smithi129.stdout:7/788: chown d0/c3c 0 1 2024-09-21T08:02:35.331 INFO:tasks.workunit.client.1.smithi129.stdout:7/789: creat d0/d46/d6e/d9b/da5/db7/f109 x:0 0 0 2024-09-21T08:02:35.331 INFO:tasks.workunit.client.0.smithi107.stdout:0/78: dwrite d1/fe [0,4194304] 0 2024-09-21T08:02:35.331 INFO:tasks.workunit.client.0.smithi107.stdout:0/79: chown d1/d5 84136624 1 2024-09-21T08:02:35.332 INFO:tasks.workunit.client.0.smithi107.stdout:0/80: dread - d1/f19 zero size 2024-09-21T08:02:35.332 INFO:tasks.workunit.client.1.smithi129.stdout:3/738: dwrite d3/d57/fec [0,4194304] 0 2024-09-21T08:02:35.332 INFO:tasks.workunit.client.1.smithi129.stdout:3/739: write d3/da/dc/da3/fd1 [106080,111046] 0 2024-09-21T08:02:35.332 INFO:tasks.workunit.client.1.smithi129.stdout:3/740: creat d3/d69/d98/f106 x:0 0 0 2024-09-21T08:02:35.337 INFO:tasks.workunit.client.0.smithi107.stdout:0/81: dread d1/f11 [0,4194304] 0 2024-09-21T08:02:35.338 INFO:tasks.workunit.client.1.smithi129.stdout:6/617: symlink d7/d1b/d1e/d66/d7c/lcf 0 2024-09-21T08:02:35.338 INFO:tasks.workunit.client.1.smithi129.stdout:6/618: write d7/d1b/f49 [9670363,129210] 0 2024-09-21T08:02:35.338 INFO:tasks.workunit.client.1.smithi129.stdout:6/619: chown d7/d10/f14 106747 1 2024-09-21T08:02:35.340 INFO:tasks.workunit.client.1.smithi129.stdout:2/865: creat d1/d13/d3a/dc1/f132 x:0 0 0 2024-09-21T08:02:35.342 INFO:tasks.workunit.client.0.smithi107.stdout:0/82: rename d1/d15/c17 to d1/d15/d1a/c1b 0 2024-09-21T08:02:35.342 INFO:tasks.workunit.client.0.smithi107.stdout:0/83: readlink d1/d15/d1a/l13 0 2024-09-21T08:02:35.342 INFO:tasks.workunit.client.0.smithi107.stdout:0/84: readlink d1/d15/d1a/l13 0 2024-09-21T08:02:35.342 INFO:tasks.workunit.client.1.smithi129.stdout:2/866: dread d1/d13/d3a/f6f [0,4194304] 0 2024-09-21T08:02:35.345 INFO:tasks.workunit.client.1.smithi129.stdout:8/551: unlink d0/d6/d7/d18/d27/d32/f4a 0 2024-09-21T08:02:35.346 INFO:tasks.workunit.client.1.smithi129.stdout:0/663: dwrite de/d22/d27/d85/db2/dc3/fce [0,4194304] 0 2024-09-21T08:02:35.347 INFO:tasks.workunit.client.0.smithi107.stdout:1/44: dwrite d0/fc [0,4194304] 0 2024-09-21T08:02:35.349 INFO:tasks.workunit.client.1.smithi129.stdout:7/790: mkdir d0/d1e/d9a/dca/d100/d90/dd2/d10a 0 2024-09-21T08:02:35.349 INFO:tasks.workunit.client.1.smithi129.stdout:7/791: read - d0/d46/d6e/d9b/da5/db7/ffc zero size 2024-09-21T08:02:35.350 INFO:tasks.workunit.client.1.smithi129.stdout:0/664: dread de/d15/d39/d56/f6f [0,4194304] 0 2024-09-21T08:02:35.350 INFO:tasks.workunit.client.1.smithi129.stdout:0/665: write de/d19/f38 [1104667,73527] 0 2024-09-21T08:02:35.350 INFO:tasks.workunit.client.1.smithi129.stdout:0/666: chown de/d15/d44/d4b/fa8 147 1 2024-09-21T08:02:35.354 INFO:tasks.workunit.client.1.smithi129.stdout:1/748: dwrite d1/d16/d57/f88 [0,4194304] 0 2024-09-21T08:02:35.357 INFO:tasks.workunit.client.1.smithi129.stdout:3/741: creat d3/d57/d80/f107 x:0 0 0 2024-09-21T08:02:35.358 INFO:tasks.workunit.client.0.smithi107.stdout:0/85: dwrite d1/f12 [0,4194304] 0 2024-09-21T08:02:35.359 INFO:tasks.workunit.client.1.smithi129.stdout:6/620: link d7/fa d7/d10/dcc/fd0 0 2024-09-21T08:02:35.364 INFO:tasks.workunit.client.1.smithi129.stdout:2/867: mknod d1/d13/d32/d11e/c133 0 2024-09-21T08:02:35.366 INFO:tasks.workunit.client.1.smithi129.stdout:8/552: write d0/d6/d7/d9/f5f [4584451,11818] 0 2024-09-21T08:02:35.369 INFO:tasks.workunit.client.1.smithi129.stdout:0/667: mkdir de/d15/d44/d45/dd8 0 2024-09-21T08:02:35.371 INFO:tasks.workunit.client.1.smithi129.stdout:5/719: sync 2024-09-21T08:02:35.374 INFO:tasks.workunit.client.0.smithi107.stdout:0/86: dread d1/f12 [0,4194304] 0 2024-09-21T08:02:35.374 INFO:tasks.workunit.client.0.smithi107.stdout:0/87: creat d1/f1c x:0 0 0 2024-09-21T08:02:35.374 INFO:tasks.workunit.client.1.smithi129.stdout:1/749: rename d1/d7a/f95 to d1/d16/f101 0 2024-09-21T08:02:35.374 INFO:tasks.workunit.client.1.smithi129.stdout:1/750: dread - d1/df1/ffc zero size 2024-09-21T08:02:35.376 INFO:tasks.workunit.client.1.smithi129.stdout:7/792: dwrite d0/f26 [0,4194304] 0 2024-09-21T08:02:35.376 INFO:tasks.workunit.client.1.smithi129.stdout:7/793: truncate d0/d46/d6e/f83 525665 0 2024-09-21T08:02:35.376 INFO:tasks.workunit.client.1.smithi129.stdout:7/794: fsync d0/d71/fac 0 2024-09-21T08:02:35.377 INFO:tasks.workunit.client.1.smithi129.stdout:3/742: dwrite d3/d5a/fbc [0,4194304] 0 2024-09-21T08:02:35.377 INFO:tasks.workunit.client.0.smithi107.stdout:0/88: dread d1/f8 [0,4194304] 0 2024-09-21T08:02:35.377 INFO:tasks.workunit.client.0.smithi107.stdout:0/89: chown d1/d5 433393 1 2024-09-21T08:02:35.378 INFO:tasks.workunit.client.1.smithi129.stdout:2/868: mkdir d1/d13/d3a/d47/d1f/d85/d134 0 2024-09-21T08:02:35.378 INFO:tasks.workunit.client.1.smithi129.stdout:8/553: mknod d0/d6/ca8 0 2024-09-21T08:02:35.380 INFO:tasks.workunit.client.1.smithi129.stdout:0/668: truncate de/d19/f86 5489794 0 2024-09-21T08:02:35.381 INFO:tasks.workunit.client.1.smithi129.stdout:1/751: getdents d1/d4/dc2 0 2024-09-21T08:02:35.387 INFO:tasks.workunit.client.1.smithi129.stdout:2/869: creat d1/d13/d3a/d47/d1f/d85/df7/f135 x:0 0 0 2024-09-21T08:02:35.387 INFO:tasks.workunit.client.1.smithi129.stdout:2/870: fdatasync d1/dc/d19/d4c/d9d/fcb 0 2024-09-21T08:02:35.388 INFO:tasks.workunit.client.1.smithi129.stdout:8/554: creat d0/d6/d7/d18/d27/d32/d3d/fa9 x:0 0 0 2024-09-21T08:02:35.393 INFO:tasks.workunit.client.1.smithi129.stdout:6/621: getdents d7/d1b/d57/d96 0 2024-09-21T08:02:35.393 INFO:tasks.workunit.client.1.smithi129.stdout:6/622: chown d7/d1b/d1e/d66/dba/l2a 24 1 2024-09-21T08:02:35.393 INFO:tasks.workunit.client.1.smithi129.stdout:6/623: dread - d7/d1b/d1e/d39/d4b/fa2 zero size 2024-09-21T08:02:35.396 INFO:tasks.workunit.client.1.smithi129.stdout:2/871: unlink d1/dc/d19/d88/fcc 0 2024-09-21T08:02:35.399 INFO:tasks.workunit.client.1.smithi129.stdout:6/624: rmdir d7/d1b/d1e/d66/dba/d2b 39 2024-09-21T08:02:35.403 INFO:tasks.workunit.client.1.smithi129.stdout:2/872: creat d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d93/f136 x:0 0 0 2024-09-21T08:02:35.409 INFO:tasks.workunit.client.1.smithi129.stdout:8/555: write d0/f16 [4372596,18527] 0 2024-09-21T08:02:35.409 INFO:tasks.workunit.client.1.smithi129.stdout:8/556: write d0/d6/d7/d24/f36 [1121552,79947] 0 2024-09-21T08:02:35.411 INFO:tasks.workunit.client.1.smithi129.stdout:8/557: creat d0/d6/d7/d18/d27/d60/d85/faa x:0 0 0 2024-09-21T08:02:35.413 INFO:tasks.workunit.client.1.smithi129.stdout:6/625: read d7/d1b/d1e/fb5 [3992944,25866] 0 2024-09-21T08:02:35.414 INFO:tasks.workunit.client.1.smithi129.stdout:6/626: creat d7/d1b/d1e/d66/d7c/fd1 x:0 0 0 2024-09-21T08:02:35.417 INFO:tasks.workunit.client.1.smithi129.stdout:2/873: dread d1/d13/d3a/d47/f27 [0,4194304] 0 2024-09-21T08:02:35.418 INFO:tasks.workunit.client.1.smithi129.stdout:2/874: truncate d1/d13/d3a/d47/d1f/d85/df7/d45/fe6 403172 0 2024-09-21T08:02:35.419 INFO:tasks.workunit.client.1.smithi129.stdout:2/875: rename d1/d53/d77/d8b/c119 to d1/d13/d3a/d47/d1f/d85/df7/d45/d65/c137 0 2024-09-21T08:02:35.421 INFO:tasks.workunit.client.1.smithi129.stdout:8/558: dread d0/d6/d7/d18/d27/d32/f54 [0,4194304] 0 2024-09-21T08:02:35.421 INFO:tasks.workunit.client.1.smithi129.stdout:2/876: truncate d1/d13/d3a/d47/d1f/d85/fa6 123850 0 2024-09-21T08:02:35.422 INFO:tasks.workunit.client.1.smithi129.stdout:8/559: symlink d0/d6/d7/d18/d61/lab 0 2024-09-21T08:02:35.422 INFO:tasks.workunit.client.1.smithi129.stdout:8/560: readlink d0/d6/d7/d18/d27/l6f 0 2024-09-21T08:02:35.423 INFO:tasks.workunit.client.1.smithi129.stdout:2/877: rename d1/l4d to d1/dc/d19/d11c/l138 0 2024-09-21T08:02:35.428 INFO:tasks.workunit.client.1.smithi129.stdout:3/743: dwrite d3/f13 [8388608,4194304] 0 2024-09-21T08:02:35.430 INFO:tasks.workunit.client.1.smithi129.stdout:7/795: dwrite d0/d1e/d9a/dca/d100/d90/f92 [0,4194304] 0 2024-09-21T08:02:35.432 INFO:tasks.workunit.client.1.smithi129.stdout:7/796: mknod d0/d46/d6e/c10b 0 2024-09-21T08:02:35.433 INFO:tasks.workunit.client.1.smithi129.stdout:8/561: dread d0/f2b [0,4194304] 0 2024-09-21T08:02:35.433 INFO:tasks.workunit.client.1.smithi129.stdout:2/878: dread d1/d13/d3a/d47/d1f/f98 [0,4194304] 0 2024-09-21T08:02:35.435 INFO:tasks.workunit.client.1.smithi129.stdout:2/879: creat d1/d13/d3a/d47/d1f/d85/df7/d45/f139 x:0 0 0 2024-09-21T08:02:35.436 INFO:tasks.workunit.client.1.smithi129.stdout:2/880: symlink d1/d13/d32/d97/l13a 0 2024-09-21T08:02:35.437 INFO:tasks.workunit.client.1.smithi129.stdout:0/669: dwrite de/d15/d39/d56/f7d [4194304,4194304] 0 2024-09-21T08:02:35.438 INFO:tasks.workunit.client.0.smithi107.stdout:1/45: dwrite d0/fc [4194304,4194304] 0 2024-09-21T08:02:35.438 INFO:tasks.workunit.client.0.smithi107.stdout:0/90: dwrite d1/d5/f14 [0,4194304] 0 2024-09-21T08:02:35.438 INFO:tasks.workunit.client.0.smithi107.stdout:0/91: dread - d1/f1c zero size 2024-09-21T08:02:35.438 INFO:tasks.workunit.client.1.smithi129.stdout:1/752: dwrite d1/d9/f45 [0,4194304] 0 2024-09-21T08:02:35.439 INFO:tasks.workunit.client.0.smithi107.stdout:1/46: dread d0/d7/fa [0,4194304] 0 2024-09-21T08:02:35.441 INFO:tasks.workunit.client.1.smithi129.stdout:0/670: mkdir de/d19/dd9 0 2024-09-21T08:02:35.443 INFO:tasks.workunit.client.1.smithi129.stdout:3/744: dread d3/d57/fec [0,4194304] 0 2024-09-21T08:02:35.443 INFO:tasks.workunit.client.1.smithi129.stdout:6/627: dwrite d7/f9 [4194304,4194304] 0 2024-09-21T08:02:35.443 INFO:tasks.workunit.client.1.smithi129.stdout:3/745: read d3/da/dc/d11/d2f/fbf [3747100,90560] 0 2024-09-21T08:02:35.447 INFO:tasks.workunit.client.0.smithi107.stdout:1/47: unlink d0/d7/f8 0 2024-09-21T08:02:35.448 INFO:tasks.workunit.client.0.smithi107.stdout:1/48: fdatasync d0/d7/f9 0 2024-09-21T08:02:35.448 INFO:tasks.workunit.client.0.smithi107.stdout:1/49: write d0/d7/fd [331289,110385] 0 2024-09-21T08:02:35.448 INFO:tasks.workunit.client.0.smithi107.stdout:1/50: rename d0 to d0/d7/d10 22 2024-09-21T08:02:35.448 INFO:tasks.workunit.client.0.smithi107.stdout:1/51: fdatasync d0/d7/f9 0 2024-09-21T08:02:35.448 INFO:tasks.workunit.client.1.smithi129.stdout:6/628: read d7/fe [6838169,98866] 0 2024-09-21T08:02:35.451 INFO:tasks.workunit.client.1.smithi129.stdout:2/881: write d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d50/f9c [2164711,3069] 0 2024-09-21T08:02:35.457 INFO:tasks.workunit.client.1.smithi129.stdout:1/753: creat d1/d7a/da4/f102 x:0 0 0 2024-09-21T08:02:35.458 INFO:tasks.workunit.client.1.smithi129.stdout:0/671: getdents de/d15/d44/d45/da0 0 2024-09-21T08:02:35.460 INFO:tasks.workunit.client.1.smithi129.stdout:0/672: write de/d81/f8d [633376,10599] 0 2024-09-21T08:02:35.460 INFO:tasks.workunit.client.1.smithi129.stdout:0/673: readlink de/d1f/da9/ld7 0 2024-09-21T08:02:35.460 INFO:tasks.workunit.client.1.smithi129.stdout:0/674: write f0 [427729,79773] 0 2024-09-21T08:02:35.464 INFO:tasks.workunit.client.1.smithi129.stdout:1/754: creat d1/d44/d83/dc5/f103 x:0 0 0 2024-09-21T08:02:35.464 INFO:tasks.workunit.client.1.smithi129.stdout:0/675: mknod de/d15/d44/d45/da0/cda 0 2024-09-21T08:02:35.466 INFO:tasks.workunit.client.1.smithi129.stdout:0/676: symlink de/ldb 0 2024-09-21T08:02:35.466 INFO:tasks.workunit.client.1.smithi129.stdout:0/677: dread - de/d19/f82 zero size 2024-09-21T08:02:35.477 INFO:tasks.workunit.client.1.smithi129.stdout:2/882: dread d1/dc/f16 [0,4194304] 0 2024-09-21T08:02:35.481 INFO:tasks.workunit.client.1.smithi129.stdout:8/562: dwrite d0/f2b [0,4194304] 0 2024-09-21T08:02:35.481 INFO:tasks.workunit.client.0.smithi107.stdout:1/52: dwrite d0/fc [8388608,4194304] 0 2024-09-21T08:02:35.482 INFO:tasks.workunit.client.0.smithi107.stdout:0/92: dwrite d1/f1c [0,4194304] 0 2024-09-21T08:02:35.482 INFO:tasks.workunit.client.1.smithi129.stdout:6/629: dwrite d7/d1b/d1e/d66/dc2/fa5 [0,4194304] 0 2024-09-21T08:02:35.482 INFO:tasks.workunit.client.1.smithi129.stdout:2/883: dread d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d99/ff1 [0,4194304] 0 2024-09-21T08:02:35.483 INFO:tasks.workunit.client.1.smithi129.stdout:8/563: mkdir d0/d6/dac 0 2024-09-21T08:02:35.483 INFO:tasks.workunit.client.0.smithi107.stdout:1/53: unlink d0/fb 0 2024-09-21T08:02:35.485 INFO:tasks.workunit.client.1.smithi129.stdout:1/755: read d1/d9/f20 [1020288,39221] 0 2024-09-21T08:02:35.486 INFO:tasks.workunit.client.1.smithi129.stdout:7/797: dwrite d0/d46/d6e/f83 [0,4194304] 0 2024-09-21T08:02:35.486 INFO:tasks.workunit.client.1.smithi129.stdout:7/798: write d0/f24 [1653459,13691] 0 2024-09-21T08:02:35.486 INFO:tasks.workunit.client.1.smithi129.stdout:7/799: readlink d0/d1e/l31 0 2024-09-21T08:02:35.486 INFO:tasks.workunit.client.1.smithi129.stdout:4/607: sync 2024-09-21T08:02:35.486 INFO:tasks.workunit.client.1.smithi129.stdout:9/610: sync 2024-09-21T08:02:35.486 INFO:tasks.workunit.client.1.smithi129.stdout:9/611: fsync d17/d22/d33/d7a/d89/d90/db1/d31/d35/f54 0 2024-09-21T08:02:35.486 INFO:tasks.workunit.client.1.smithi129.stdout:4/608: truncate d5/d16/fd3 1353823 0 2024-09-21T08:02:35.486 INFO:tasks.workunit.client.1.smithi129.stdout:2/884: dread d1/dc/d19/d4c/d9d/fcb [0,4194304] 0 2024-09-21T08:02:35.486 INFO:tasks.workunit.client.1.smithi129.stdout:2/885: fdatasync d1/d53/f58 0 2024-09-21T08:02:35.487 INFO:tasks.workunit.client.1.smithi129.stdout:7/800: dread d0/d46/dd3/ff2 [0,4194304] 0 2024-09-21T08:02:35.487 INFO:tasks.workunit.client.1.smithi129.stdout:7/801: creat d0/d46/d6e/de4/f10c x:0 0 0 2024-09-21T08:02:35.487 INFO:tasks.workunit.client.1.smithi129.stdout:5/720: sync 2024-09-21T08:02:35.488 INFO:tasks.workunit.client.0.smithi107.stdout:0/93: link d1/f1c d1/d15/f1d 0 2024-09-21T08:02:35.492 INFO:tasks.workunit.client.0.smithi107.stdout:1/54: rename d0/f4 to d0/f11 0 2024-09-21T08:02:35.492 INFO:tasks.workunit.client.0.smithi107.stdout:1/55: creat d0/f12 x:0 0 0 2024-09-21T08:02:35.493 INFO:tasks.workunit.client.1.smithi129.stdout:6/630: symlink d7/d10/ld2 0 2024-09-21T08:02:35.494 INFO:tasks.workunit.client.0.smithi107.stdout:0/94: rename d1/f11 to d1/d5/f1e 0 2024-09-21T08:02:35.498 INFO:tasks.workunit.client.0.smithi107.stdout:0/95: creat d1/d15/f1f x:0 0 0 2024-09-21T08:02:35.500 INFO:tasks.workunit.client.0.smithi107.stdout:0/96: mkdir d1/d15/d20 0 2024-09-21T08:02:35.504 INFO:tasks.workunit.client.0.smithi107.stdout:0/97: mkdir d1/d15/d21 0 2024-09-21T08:02:35.506 INFO:tasks.workunit.client.1.smithi129.stdout:9/612: rename d17/d22/d33/d7a/d89/d90/db1/dc0 to d17/d55/dd1 0 2024-09-21T08:02:35.507 INFO:tasks.workunit.client.1.smithi129.stdout:2/886: symlink d1/dc/d19/d4c/l13b 0 2024-09-21T08:02:35.508 INFO:tasks.workunit.client.0.smithi107.stdout:0/98: rmdir d1/d15/d21 0 2024-09-21T08:02:35.509 INFO:tasks.workunit.client.0.smithi107.stdout:1/56: dwrite d0/d7/f9 [4194304,4194304] 0 2024-09-21T08:02:35.511 INFO:tasks.workunit.client.0.smithi107.stdout:1/57: dread d0/d7/fa [0,4194304] 0 2024-09-21T08:02:35.511 INFO:tasks.workunit.client.1.smithi129.stdout:7/802: creat d0/d1e/f10d x:0 0 0 2024-09-21T08:02:35.513 INFO:tasks.workunit.client.1.smithi129.stdout:5/721: unlink d2/d1e/d35/d33/d36/fc4 0 2024-09-21T08:02:35.515 INFO:tasks.workunit.client.1.smithi129.stdout:2/887: write d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d50/f6e [1706280,64187] 0 2024-09-21T08:02:35.515 INFO:tasks.workunit.client.1.smithi129.stdout:6/631: creat d7/d1b/d1e/d39/d79/db8/fd3 x:0 0 0 2024-09-21T08:02:35.515 INFO:tasks.workunit.client.1.smithi129.stdout:2/888: creat d1/d13/d3a/d47/d1f/d85/df7/d45/f13c x:0 0 0 2024-09-21T08:02:35.515 INFO:tasks.workunit.client.1.smithi129.stdout:2/889: chown d1/dc/d19/d4c/d9d/c10f 8 1 2024-09-21T08:02:35.515 INFO:tasks.workunit.client.1.smithi129.stdout:6/632: write d7/d10/fa8 [826956,72506] 0 2024-09-21T08:02:35.516 INFO:tasks.workunit.client.1.smithi129.stdout:6/633: chown d7/d1b/d1e/d66/dba/d35/d40/d41/f5d 2217 1 2024-09-21T08:02:35.517 INFO:tasks.workunit.client.0.smithi107.stdout:1/58: symlink d0/d7/l13 0 2024-09-21T08:02:35.517 INFO:tasks.workunit.client.0.smithi107.stdout:1/59: chown d0 16589874 1 2024-09-21T08:02:35.519 INFO:tasks.workunit.client.1.smithi129.stdout:8/564: getdents d0/d6/d7/d6c 0 2024-09-21T08:02:35.519 INFO:tasks.workunit.client.1.smithi129.stdout:8/565: creat d0/d6/d7/d3a/d8e/fad x:0 0 0 2024-09-21T08:02:35.519 INFO:tasks.workunit.client.0.smithi107.stdout:0/99: write d1/fe [2684438,68569] 0 2024-09-21T08:02:35.520 INFO:tasks.workunit.client.1.smithi129.stdout:1/756: getdents d1/d44/d83 0 2024-09-21T08:02:35.521 INFO:tasks.workunit.client.1.smithi129.stdout:7/803: dread d0/f4c [0,4194304] 0 2024-09-21T08:02:35.522 INFO:tasks.workunit.client.1.smithi129.stdout:4/609: rmdir d5/d16/d47/d5f 39 2024-09-21T08:02:35.522 INFO:tasks.workunit.client.0.smithi107.stdout:0/100: symlink d1/d15/d20/l22 0 2024-09-21T08:02:35.526 INFO:tasks.workunit.client.0.smithi107.stdout:0/101: mkdir d1/d23 0 2024-09-21T08:02:35.529 INFO:tasks.workunit.client.1.smithi129.stdout:6/634: symlink d7/d1b/d1e/d66/dba/d35/ld4 0 2024-09-21T08:02:35.530 INFO:tasks.workunit.client.1.smithi129.stdout:8/566: creat d0/d6/d7/d18/fae x:0 0 0 2024-09-21T08:02:35.531 INFO:tasks.workunit.client.1.smithi129.stdout:1/757: rename d1/d44/fb4 to d1/d9/d6b/ddd/f104 0 2024-09-21T08:02:35.531 INFO:tasks.workunit.client.1.smithi129.stdout:1/758: write d1/d4/dc2/dc6/fa6 [657641,75999] 0 2024-09-21T08:02:35.532 INFO:tasks.workunit.client.1.smithi129.stdout:7/804: creat d0/d1e/db1/f10e x:0 0 0 2024-09-21T08:02:35.532 INFO:tasks.workunit.client.1.smithi129.stdout:4/610: rmdir d5/d48 39 2024-09-21T08:02:35.532 INFO:tasks.workunit.client.1.smithi129.stdout:2/890: rmdir d1/dc/d19/d11c 39 2024-09-21T08:02:35.532 INFO:tasks.workunit.client.1.smithi129.stdout:2/891: write d1/d13/d32/d7c/fe2 [1012871,117800] 0 2024-09-21T08:02:35.533 INFO:tasks.workunit.client.1.smithi129.stdout:6/635: rmdir d7/d1b/d1e/d66/dba/d35/d40/d41 39 2024-09-21T08:02:35.533 INFO:tasks.workunit.client.1.smithi129.stdout:6/636: truncate d7/d4a/d69/d89/fbe 477480 0 2024-09-21T08:02:35.534 INFO:tasks.workunit.client.1.smithi129.stdout:8/567: creat d0/d6/dac/faf x:0 0 0 2024-09-21T08:02:35.535 INFO:tasks.workunit.client.1.smithi129.stdout:7/805: symlink d0/d1e/db1/dba/l10f 0 2024-09-21T08:02:35.535 INFO:tasks.workunit.client.1.smithi129.stdout:2/892: dread d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d99/ff1 [0,4194304] 0 2024-09-21T08:02:35.535 INFO:tasks.workunit.client.1.smithi129.stdout:2/893: chown d1/dc/d19/d4c/d6a/d69/cd8 1 1 2024-09-21T08:02:35.536 INFO:tasks.workunit.client.1.smithi129.stdout:7/806: creat d0/d1e/d9a/dca/d100/d90/f110 x:0 0 0 2024-09-21T08:02:35.538 INFO:tasks.workunit.client.1.smithi129.stdout:2/894: creat d1/d53/f13d x:0 0 0 2024-09-21T08:02:35.540 INFO:tasks.workunit.client.1.smithi129.stdout:7/807: mknod d0/c111 0 2024-09-21T08:02:35.540 INFO:tasks.workunit.client.1.smithi129.stdout:2/895: symlink d1/d13/d3a/d47/d5f/l13e 0 2024-09-21T08:02:35.541 INFO:tasks.workunit.client.1.smithi129.stdout:7/808: mkdir d0/dc5/d112 0 2024-09-21T08:02:35.541 INFO:tasks.workunit.client.1.smithi129.stdout:7/809: fsync d0/d1e/d9a/dca/d100/d8f/fa6 0 2024-09-21T08:02:35.541 INFO:tasks.workunit.client.1.smithi129.stdout:7/810: truncate d0/f24 2388698 0 2024-09-21T08:02:35.541 INFO:tasks.workunit.client.1.smithi129.stdout:7/811: fdatasync d0/d46/d6e/dad/fce 0 2024-09-21T08:02:35.541 INFO:tasks.workunit.client.1.smithi129.stdout:5/722: dwrite d2/d2a/d50/f53 [0,4194304] 0 2024-09-21T08:02:35.541 INFO:tasks.workunit.client.1.smithi129.stdout:2/896: mkdir d1/d13/d3a/d13f 0 2024-09-21T08:02:35.541 INFO:tasks.workunit.client.1.smithi129.stdout:2/897: write d1/dc/d19/f6d [4279614,84889] 0 2024-09-21T08:02:35.543 INFO:tasks.workunit.client.1.smithi129.stdout:7/812: rename d0/l6b to d0/d1e/d9a/dca/d100/d8f/l113 0 2024-09-21T08:02:35.543 INFO:tasks.workunit.client.1.smithi129.stdout:7/813: stat d0/d1e/f38 0 2024-09-21T08:02:35.543 INFO:tasks.workunit.client.1.smithi129.stdout:7/814: write d0/d1e/d9a/dca/d100/d90/fb6 [1380545,89651] 0 2024-09-21T08:02:35.544 INFO:tasks.workunit.client.1.smithi129.stdout:1/759: read d1/d44/f8c [1767951,82043] 0 2024-09-21T08:02:35.545 INFO:tasks.workunit.client.1.smithi129.stdout:5/723: getdents d2/d1e/d35/d33/d36/d5a/d77 0 2024-09-21T08:02:35.545 INFO:tasks.workunit.client.1.smithi129.stdout:4/611: dread d5/d16/d24/d3b/f3e [0,4194304] 0 2024-09-21T08:02:35.545 INFO:tasks.workunit.client.1.smithi129.stdout:9/613: dwrite d17/d22/d33/d7a/d89/d90/db1/d31/d5e/fc1 [0,4194304] 0 2024-09-21T08:02:35.546 INFO:tasks.workunit.client.0.smithi107.stdout:0/102: dread d1/d5/f14 [0,4194304] 0 2024-09-21T08:02:35.548 INFO:tasks.workunit.client.1.smithi129.stdout:1/760: write d1/d16/d57/fa1 [594792,120786] 0 2024-09-21T08:02:35.550 INFO:tasks.workunit.client.1.smithi129.stdout:2/898: dread d1/d13/d32/d7c/fe2 [0,4194304] 0 2024-09-21T08:02:35.550 INFO:tasks.workunit.client.1.smithi129.stdout:5/724: mknod d2/d1e/d35/d33/d36/d5a/d77/d81/cde 0 2024-09-21T08:02:35.550 INFO:tasks.workunit.client.1.smithi129.stdout:5/725: fdatasync d2/d1e/d35/d33/dca/fda 0 2024-09-21T08:02:35.552 INFO:tasks.workunit.client.1.smithi129.stdout:7/815: dread d0/d1e/f21 [0,4194304] 0 2024-09-21T08:02:35.554 INFO:tasks.workunit.client.1.smithi129.stdout:9/614: creat d17/d22/d33/d7a/d89/d90/db1/d31/d35/fd2 x:0 0 0 2024-09-21T08:02:35.555 INFO:tasks.workunit.client.1.smithi129.stdout:6/637: dwrite d7/d1b/f7b [0,4194304] 0 2024-09-21T08:02:35.555 INFO:tasks.workunit.client.1.smithi129.stdout:6/638: write d7/d1b/d1e/d39/d79/fce [1030536,63703] 0 2024-09-21T08:02:35.555 INFO:tasks.workunit.client.1.smithi129.stdout:6/639: fsync d7/d1b/d8d/fa3 0 2024-09-21T08:02:35.556 INFO:tasks.workunit.client.1.smithi129.stdout:1/761: rename d1/d16/d28/f93 to d1/df1/f105 0 2024-09-21T08:02:35.556 INFO:tasks.workunit.client.1.smithi129.stdout:1/762: getdents d1/d4/dc2 0 2024-09-21T08:02:35.559 INFO:tasks.workunit.client.1.smithi129.stdout:5/726: mknod d2/d1e/d35/d33/db9/cdf 0 2024-09-21T08:02:35.559 INFO:tasks.workunit.client.1.smithi129.stdout:4/612: rmdir d5/d33/d4e/da7 39 2024-09-21T08:02:35.560 INFO:tasks.workunit.client.1.smithi129.stdout:7/816: mkdir d0/d114 0 2024-09-21T08:02:35.561 INFO:tasks.workunit.client.1.smithi129.stdout:7/817: read d0/d46/f57 [483928,123073] 0 2024-09-21T08:02:35.561 INFO:tasks.workunit.client.1.smithi129.stdout:9/615: unlink d17/d46/cba 0 2024-09-21T08:02:35.562 INFO:tasks.workunit.client.1.smithi129.stdout:9/616: chown d17/d22/d33/d7a/d89/d90/db1/d31/f5a 207 1 2024-09-21T08:02:35.562 INFO:tasks.workunit.client.1.smithi129.stdout:9/617: chown d17/d46/d9c 9 1 2024-09-21T08:02:35.562 INFO:tasks.workunit.client.1.smithi129.stdout:7/818: read d0/d46/d6e/d9b/da5/db7/fd1 [162986,106422] 0 2024-09-21T08:02:35.568 INFO:tasks.workunit.client.0.smithi107.stdout:0/103: dwrite d1/d5/f1e [0,4194304] 0 2024-09-21T08:02:35.568 INFO:tasks.workunit.client.0.smithi107.stdout:0/104: creat d1/d5/f24 x:0 0 0 2024-09-21T08:02:35.575 INFO:tasks.workunit.client.1.smithi129.stdout:6/640: mkdir d7/d1b/d1e/d66/dc2/d93/dd5 0 2024-09-21T08:02:35.577 INFO:tasks.workunit.client.1.smithi129.stdout:2/899: rmdir d1/d13/d3a/dc1 39 2024-09-21T08:02:35.580 INFO:tasks.workunit.client.1.smithi129.stdout:5/727: mkdir d2/d1e/d35/d33/d36/de0 0 2024-09-21T08:02:35.581 INFO:tasks.workunit.client.1.smithi129.stdout:4/613: getdents d5/d48 0 2024-09-21T08:02:35.583 INFO:tasks.workunit.client.1.smithi129.stdout:7/819: rename d0/d1e/db1/dba/l10f to d0/d1e/db1/dba/l115 0 2024-09-21T08:02:35.586 INFO:tasks.workunit.client.1.smithi129.stdout:4/614: dread d5/d16/d47/d61/f91 [0,4194304] 0 2024-09-21T08:02:35.589 INFO:tasks.workunit.client.1.smithi129.stdout:2/900: rename d1/la9 to d1/dc/d19/d4c/dd5/l140 0 2024-09-21T08:02:35.589 INFO:tasks.workunit.client.1.smithi129.stdout:2/901: read d1/dc/d19/d4c/d6a/f3d [222362,102638] 0 2024-09-21T08:02:35.589 INFO:tasks.workunit.client.0.smithi107.stdout:0/105: dwrite d1/f8 [4194304,4194304] 0 2024-09-21T08:02:35.590 INFO:tasks.workunit.client.1.smithi129.stdout:5/728: creat d2/d1e/d35/d33/dca/fe1 x:0 0 0 2024-09-21T08:02:35.590 INFO:tasks.workunit.client.0.smithi107.stdout:0/106: write d1/f8 [2166798,12518] 0 2024-09-21T08:02:35.592 INFO:tasks.workunit.client.1.smithi129.stdout:4/615: link d5/d16/d24/d3b/f4a d5/d33/d4e/da7/fe0 0 2024-09-21T08:02:35.592 INFO:tasks.workunit.client.1.smithi129.stdout:4/616: chown d5/d11 308397 1 2024-09-21T08:02:35.593 INFO:tasks.workunit.client.1.smithi129.stdout:7/820: rename d0/c54 to d0/d71/c116 0 2024-09-21T08:02:35.594 INFO:tasks.workunit.client.1.smithi129.stdout:2/902: creat d1/d13/d32/d97/f141 x:0 0 0 2024-09-21T08:02:35.594 INFO:tasks.workunit.client.1.smithi129.stdout:5/729: symlink d2/d1e/d6b/dd1/le2 0 2024-09-21T08:02:35.595 INFO:tasks.workunit.client.1.smithi129.stdout:5/730: dread - d2/d1e/d35/d33/dca/fe1 zero size 2024-09-21T08:02:35.596 INFO:tasks.workunit.client.1.smithi129.stdout:4/617: mkdir d5/d11/d77/de1 0 2024-09-21T08:02:35.596 INFO:tasks.workunit.client.1.smithi129.stdout:4/618: fsync d5/d16/f32 0 2024-09-21T08:02:35.597 INFO:tasks.workunit.client.1.smithi129.stdout:7/821: mkdir d0/d46/d6e/d9b/de5/d117 0 2024-09-21T08:02:35.597 INFO:tasks.workunit.client.1.smithi129.stdout:5/731: symlink d2/d2a/le3 0 2024-09-21T08:02:35.598 INFO:tasks.workunit.client.1.smithi129.stdout:4/619: symlink d5/d33/le2 0 2024-09-21T08:02:35.599 INFO:tasks.workunit.client.1.smithi129.stdout:7/822: creat d0/d46/d6e/dad/df6/f118 x:0 0 0 2024-09-21T08:02:35.599 INFO:tasks.workunit.client.0.smithi107.stdout:0/107: dread d1/f1c [0,4194304] 0 2024-09-21T08:02:35.600 INFO:tasks.workunit.client.1.smithi129.stdout:7/823: mknod d0/d1e/d9a/dca/d100/d90/dfe/c119 0 2024-09-21T08:02:35.600 INFO:tasks.workunit.client.1.smithi129.stdout:7/824: chown d0/d1e/f38 87938 1 2024-09-21T08:02:35.601 INFO:tasks.workunit.client.0.smithi107.stdout:0/108: rename d1/d15/d1a to d1/d5/d25 0 2024-09-21T08:02:35.601 INFO:tasks.workunit.client.0.smithi107.stdout:0/109: chown d1/f12 1933024 1 2024-09-21T08:02:35.602 INFO:tasks.workunit.client.1.smithi129.stdout:7/825: symlink d0/d46/de0/l11a 0 2024-09-21T08:02:35.603 INFO:tasks.workunit.client.0.smithi107.stdout:0/110: creat d1/d23/f26 x:0 0 0 2024-09-21T08:02:35.603 INFO:tasks.workunit.client.0.smithi107.stdout:0/111: stat d1/d23/f26 0 2024-09-21T08:02:35.607 INFO:tasks.workunit.client.1.smithi129.stdout:2/903: write d1/dc/d19/d88/fe7 [1974714,111005] 0 2024-09-21T08:02:35.610 INFO:tasks.workunit.client.1.smithi129.stdout:7/826: write d0/d46/d6e/d9b/fc3 [73656,45869] 0 2024-09-21T08:02:35.610 INFO:tasks.workunit.client.1.smithi129.stdout:7/827: fsync d0/d46/d6e/f5f 0 2024-09-21T08:02:35.611 INFO:tasks.workunit.client.1.smithi129.stdout:6/641: dwrite d7/d1b/d1e/f99 [0,4194304] 0 2024-09-21T08:02:35.611 INFO:tasks.workunit.client.1.smithi129.stdout:2/904: dread d1/dc/d19/d4c/d6a/f3d [0,4194304] 0 2024-09-21T08:02:35.611 INFO:tasks.workunit.client.1.smithi129.stdout:2/905: write d1/dc/d19/f38 [864554,116057] 0 2024-09-21T08:02:35.611 INFO:tasks.workunit.client.1.smithi129.stdout:2/906: read d1/d13/d3a/d47/d1f/d85/df7/f33 [1933648,39352] 0 2024-09-21T08:02:35.612 INFO:tasks.workunit.client.1.smithi129.stdout:7/828: read d0/d1e/f3e [129757,22675] 0 2024-09-21T08:02:35.615 INFO:tasks.workunit.client.1.smithi129.stdout:7/829: creat d0/f11b x:0 0 0 2024-09-21T08:02:35.618 INFO:tasks.workunit.client.1.smithi129.stdout:6/642: mkdir d7/d1b/d57/dd6 0 2024-09-21T08:02:35.622 INFO:tasks.workunit.client.1.smithi129.stdout:6/643: getdents d7/d1b/d8d 0 2024-09-21T08:02:35.627 INFO:tasks.workunit.client.1.smithi129.stdout:5/732: dwrite d2/d1e/d35/d33/d36/f42 [0,4194304] 0 2024-09-21T08:02:35.627 INFO:tasks.workunit.client.1.smithi129.stdout:5/733: creat d2/d2a/d50/db1/d71/da9/fe4 x:0 0 0 2024-09-21T08:02:35.641 INFO:tasks.workunit.client.1.smithi129.stdout:4/620: dwrite d5/d6/f7 [4194304,4194304] 0 2024-09-21T08:02:35.642 INFO:tasks.workunit.client.0.smithi107.stdout:0/112: dwrite d1/f19 [0,4194304] 0 2024-09-21T08:02:35.642 INFO:tasks.workunit.client.0.smithi107.stdout:0/113: chown d1/d15/f1f 25523 1 2024-09-21T08:02:35.642 INFO:tasks.workunit.client.1.smithi129.stdout:2/907: dwrite d1/d13/d3a/d47/fea [0,4194304] 0 2024-09-21T08:02:35.642 INFO:tasks.workunit.client.1.smithi129.stdout:7/830: dwrite d0/d46/f57 [0,4194304] 0 2024-09-21T08:02:35.649 INFO:tasks.workunit.client.1.smithi129.stdout:2/908: mkdir d1/d13/d3a/dc1/d142 0 2024-09-21T08:02:35.649 INFO:tasks.workunit.client.1.smithi129.stdout:2/909: chown d1/dc/d19/d88/f89 83 1 2024-09-21T08:02:35.649 INFO:tasks.workunit.client.1.smithi129.stdout:2/910: creat d1/dc/d19/d4c/d9d/f143 x:0 0 0 2024-09-21T08:02:35.652 INFO:tasks.workunit.client.1.smithi129.stdout:4/621: dread d5/d16/f32 [0,4194304] 0 2024-09-21T08:02:35.653 INFO:tasks.workunit.client.1.smithi129.stdout:7/831: symlink d0/d46/l11c 0 2024-09-21T08:02:35.656 INFO:tasks.workunit.client.1.smithi129.stdout:2/911: mknod d1/dc/d19/d11c/c144 0 2024-09-21T08:02:35.659 INFO:tasks.workunit.client.1.smithi129.stdout:4/622: creat d5/d11/d77/fe3 x:0 0 0 2024-09-21T08:02:35.661 INFO:tasks.workunit.client.0.smithi107.stdout:0/114: dread d1/f8 [4194304,4194304] 0 2024-09-21T08:02:35.663 INFO:tasks.workunit.client.1.smithi129.stdout:4/623: symlink d5/d11/d77/da8/le4 0 2024-09-21T08:02:35.666 INFO:tasks.workunit.client.0.smithi107.stdout:0/115: rename d1/f19 to d1/d5/f27 0 2024-09-21T08:02:35.678 INFO:tasks.workunit.client.1.smithi129.stdout:5/734: rename d2/d2a/d50 to d2/d1e/d35/d37/d96/de5 0 2024-09-21T08:02:35.678 INFO:tasks.workunit.client.1.smithi129.stdout:5/735: chown d2/d1e/d35/f22 6414 1 2024-09-21T08:02:35.679 INFO:tasks.workunit.client.1.smithi129.stdout:5/736: mknod d2/d1e/d35/d37/d96/de5/db1/ce6 0 2024-09-21T08:02:35.682 INFO:tasks.workunit.client.1.smithi129.stdout:5/737: mkdir d2/d1e/d35/d37/d96/de5/db1/de7 0 2024-09-21T08:02:35.684 INFO:tasks.workunit.client.1.smithi129.stdout:5/738: creat d2/d1e/d35/d37/d7d/fe8 x:0 0 0 2024-09-21T08:02:35.684 INFO:tasks.workunit.client.1.smithi129.stdout:5/739: truncate d2/f23 660063 0 2024-09-21T08:02:35.685 INFO:tasks.workunit.client.1.smithi129.stdout:5/740: creat d2/d1e/d35/d33/d36/d5a/fe9 x:0 0 0 2024-09-21T08:02:35.685 INFO:tasks.workunit.client.1.smithi129.stdout:2/912: rename d1/dc/d19/d4c/dd5 to d1/d13/d32/d97/da7/d145 0 2024-09-21T08:02:35.686 INFO:tasks.workunit.client.1.smithi129.stdout:5/741: dread d2/d1e/d35/d33/f88 [0,4194304] 0 2024-09-21T08:02:35.694 INFO:tasks.workunit.client.1.smithi129.stdout:7/832: dwrite d0/d46/d6e/fd0 [0,4194304] 0 2024-09-21T08:02:35.694 INFO:tasks.workunit.client.1.smithi129.stdout:4/624: dwrite d5/d16/d24/d3b/f46 [0,4194304] 0 2024-09-21T08:02:35.695 INFO:tasks.workunit.client.1.smithi129.stdout:4/625: truncate d5/d16/fd3 1599853 0 2024-09-21T08:02:35.695 INFO:tasks.workunit.client.1.smithi129.stdout:4/626: fdatasync d5/d11/f31 0 2024-09-21T08:02:35.695 INFO:tasks.workunit.client.1.smithi129.stdout:4/627: truncate d5/d11/d3f/d50/f51 5631171 0 2024-09-21T08:02:35.695 INFO:tasks.workunit.client.0.smithi107.stdout:0/116: dwrite d1/d5/f24 [0,4194304] 0 2024-09-21T08:02:35.699 INFO:tasks.workunit.client.1.smithi129.stdout:7/833: link d0/d46/d6e/dad/fb9 d0/d46/d6e/d9b/de5/f11d 0 2024-09-21T08:02:35.699 INFO:tasks.workunit.client.1.smithi129.stdout:7/834: chown d0/d1e/fa4 3 1 2024-09-21T08:02:35.701 INFO:tasks.workunit.client.1.smithi129.stdout:2/913: write d1/dc/f18 [1691220,93513] 0 2024-09-21T08:02:35.701 INFO:tasks.workunit.client.1.smithi129.stdout:2/914: fdatasync d1/d53/d77/d8b/fb0 0 2024-09-21T08:02:35.702 INFO:tasks.workunit.client.1.smithi129.stdout:7/835: mkdir d0/d46/d6e/d9b/de5/d117/d11e 0 2024-09-21T08:02:35.705 INFO:tasks.workunit.client.1.smithi129.stdout:2/915: symlink d1/d13/d3a/dc1/d142/l146 0 2024-09-21T08:02:35.706 INFO:tasks.workunit.client.1.smithi129.stdout:2/916: creat d1/d53/d68/db9/f147 x:0 0 0 2024-09-21T08:02:35.706 INFO:tasks.workunit.client.1.smithi129.stdout:7/836: creat d0/dc5/d112/f11f x:0 0 0 2024-09-21T08:02:35.707 INFO:tasks.workunit.client.1.smithi129.stdout:7/837: write d0/d46/d6e/d9b/da5/db7/ffc [459533,113614] 0 2024-09-21T08:02:35.709 INFO:tasks.workunit.client.1.smithi129.stdout:7/838: mkdir d0/d120 0 2024-09-21T08:02:35.709 INFO:tasks.workunit.client.1.smithi129.stdout:7/839: creat d0/d1e/d9a/d9f/f121 x:0 0 0 2024-09-21T08:02:35.711 INFO:tasks.workunit.client.1.smithi129.stdout:7/840: getdents d0/d46/d6e/d9b 0 2024-09-21T08:02:35.711 INFO:tasks.workunit.client.1.smithi129.stdout:7/841: getdents d0/d1e/d9a/dca/d100/d90/dd2 0 2024-09-21T08:02:35.713 INFO:tasks.workunit.client.1.smithi129.stdout:7/842: mkdir d0/d1e/db1/d122 0 2024-09-21T08:02:35.718 INFO:tasks.workunit.client.1.smithi129.stdout:7/843: dread d0/f16 [4194304,4194304] 0 2024-09-21T08:02:35.721 INFO:tasks.workunit.client.1.smithi129.stdout:7/844: mkdir d0/d46/d6e/dad/df6/d123 0 2024-09-21T08:02:35.722 INFO:tasks.workunit.client.1.smithi129.stdout:7/845: symlink d0/d1e/d9a/dec/l124 0 2024-09-21T08:02:35.722 INFO:tasks.workunit.client.1.smithi129.stdout:7/846: chown d0/d46/d6e/f5f 3646552 1 2024-09-21T08:02:35.723 INFO:tasks.workunit.client.1.smithi129.stdout:7/847: symlink d0/d1e/db1/dba/dc1/dc4/l125 0 2024-09-21T08:02:35.730 INFO:tasks.workunit.client.1.smithi129.stdout:5/742: dwrite d2/f23 [0,4194304] 0 2024-09-21T08:02:35.730 INFO:tasks.workunit.client.1.smithi129.stdout:4/628: dwrite d5/d6/f7 [4194304,4194304] 0 2024-09-21T08:02:35.731 INFO:tasks.workunit.client.0.smithi107.stdout:0/117: dwrite d1/f12 [0,4194304] 0 2024-09-21T08:02:35.732 INFO:tasks.workunit.client.1.smithi129.stdout:2/917: dwrite d1/d13/d32/d7c/f8e [0,4194304] 0 2024-09-21T08:02:35.732 INFO:tasks.workunit.client.1.smithi129.stdout:2/918: chown d1/d13/d3a/d47/d1f/d85/fa6 128 1 2024-09-21T08:02:35.732 INFO:tasks.workunit.client.1.smithi129.stdout:2/919: dread - d1/d53/f8d zero size 2024-09-21T08:02:35.734 INFO:tasks.workunit.client.0.smithi107.stdout:0/118: getdents d1/d5 0 2024-09-21T08:02:35.736 INFO:tasks.workunit.client.0.smithi107.stdout:0/119: mknod d1/c28 0 2024-09-21T08:02:35.739 INFO:tasks.workunit.client.0.smithi107.stdout:0/120: mkdir d1/d15/d20/d29 0 2024-09-21T08:02:35.739 INFO:tasks.workunit.client.0.smithi107.stdout:0/121: write d1/d23/f26 [507561,97102] 0 2024-09-21T08:02:35.742 INFO:tasks.workunit.client.1.smithi129.stdout:4/629: mknod d5/d33/d4e/ce5 0 2024-09-21T08:02:35.743 INFO:tasks.workunit.client.1.smithi129.stdout:2/920: creat d1/d13/d3a/f148 x:0 0 0 2024-09-21T08:02:35.744 INFO:tasks.workunit.client.1.smithi129.stdout:5/743: getdents d2/d1e/d35/d33/db9 0 2024-09-21T08:02:35.744 INFO:tasks.workunit.client.1.smithi129.stdout:5/744: dread - d2/d1e/d35/d33/d36/d5a/f74 zero size 2024-09-21T08:02:35.744 INFO:tasks.workunit.client.1.smithi129.stdout:5/745: chown d2/d1e/d35/d37/d96/de5/db1/l90 109 1 2024-09-21T08:02:35.746 INFO:tasks.workunit.client.1.smithi129.stdout:7/848: dwrite d0/d1e/f38 [0,4194304] 0 2024-09-21T08:02:35.746 INFO:tasks.workunit.client.1.smithi129.stdout:7/849: stat d0/d1e/f40 0 2024-09-21T08:02:35.746 INFO:tasks.workunit.client.1.smithi129.stdout:7/850: stat d0/d46/d6e/f5f 0 2024-09-21T08:02:35.746 INFO:tasks.workunit.client.1.smithi129.stdout:7/851: creat d0/d46/d6e/f126 x:0 0 0 2024-09-21T08:02:35.746 INFO:tasks.workunit.client.1.smithi129.stdout:7/852: creat d0/d1e/d9a/d9f/f127 x:0 0 0 2024-09-21T08:02:35.746 INFO:tasks.workunit.client.1.smithi129.stdout:7/853: dread - d0/d1e/d9a/fa2 zero size 2024-09-21T08:02:35.746 INFO:tasks.workunit.client.1.smithi129.stdout:7/854: write d0/d46/d6e/de4/f103 [1028325,120203] 0 2024-09-21T08:02:35.747 INFO:tasks.workunit.client.1.smithi129.stdout:2/921: mkdir d1/d13/d3a/d13f/d149 0 2024-09-21T08:02:35.747 INFO:tasks.workunit.client.1.smithi129.stdout:4/630: rmdir d5/d11/d77 39 2024-09-21T08:02:35.747 INFO:tasks.workunit.client.1.smithi129.stdout:2/922: fsync d1/d13/d3a/d47/d1f/d85/df7/d45/d65/fe3 0 2024-09-21T08:02:35.751 INFO:tasks.workunit.client.1.smithi129.stdout:2/923: creat d1/d13/d3a/d47/d1f/d85/d134/f14a x:0 0 0 2024-09-21T08:02:35.751 INFO:tasks.workunit.client.0.smithi107.stdout:0/122: write d1/d5/f27 [2467108,128536] 0 2024-09-21T08:02:35.752 INFO:tasks.workunit.client.1.smithi129.stdout:2/924: truncate d1/dc/d94/fbf 2600817 0 2024-09-21T08:02:35.754 INFO:tasks.workunit.client.0.smithi107.stdout:0/123: rename d1/d5/f14 to d1/d23/f2a 0 2024-09-21T08:02:35.755 INFO:tasks.workunit.client.1.smithi129.stdout:5/746: read d2/d1e/d35/d33/d36/d5a/f5b [3552903,127995] 0 2024-09-21T08:02:35.755 INFO:tasks.workunit.client.1.smithi129.stdout:3/746: sync 2024-09-21T08:02:35.755 INFO:tasks.workunit.client.1.smithi129.stdout:4/631: dread d5/d16/f29 [0,4194304] 0 2024-09-21T08:02:35.755 INFO:tasks.workunit.client.1.smithi129.stdout:4/632: fsync d5/d16/d24/d3b/fc2 0 2024-09-21T08:02:35.756 INFO:tasks.workunit.client.1.smithi129.stdout:9/618: sync 2024-09-21T08:02:35.756 INFO:tasks.workunit.client.1.smithi129.stdout:8/568: sync 2024-09-21T08:02:35.756 INFO:tasks.workunit.client.1.smithi129.stdout:1/763: sync 2024-09-21T08:02:35.756 INFO:tasks.workunit.client.1.smithi129.stdout:0/678: sync 2024-09-21T08:02:35.756 INFO:tasks.workunit.client.1.smithi129.stdout:1/764: chown d1/d16/d57/l85 178 1 2024-09-21T08:02:35.756 INFO:tasks.workunit.client.1.smithi129.stdout:8/569: stat d0/d6/dac/faf 0 2024-09-21T08:02:35.756 INFO:tasks.workunit.client.1.smithi129.stdout:8/570: read - d0/d6/d7/d18/fae zero size 2024-09-21T08:02:35.757 INFO:tasks.workunit.client.1.smithi129.stdout:8/571: fsync d0/d6/dac/faf 0 2024-09-21T08:02:35.757 INFO:tasks.workunit.client.1.smithi129.stdout:6/644: sync 2024-09-21T08:02:35.757 INFO:tasks.workunit.client.1.smithi129.stdout:3/747: truncate d3/da/dc/d11/fed 1361334 0 2024-09-21T08:02:35.758 INFO:tasks.workunit.client.1.smithi129.stdout:4/633: creat d5/d16/d24/d4f/da1/dcf/fe6 x:0 0 0 2024-09-21T08:02:35.761 INFO:tasks.workunit.client.1.smithi129.stdout:6/645: stat d7/c28 0 2024-09-21T08:02:35.761 INFO:tasks.workunit.client.1.smithi129.stdout:1/765: truncate d1/d16/f71 1703864 0 2024-09-21T08:02:35.761 INFO:tasks.workunit.client.1.smithi129.stdout:1/766: readlink d1/d9/d6b/l8d 0 2024-09-21T08:02:35.762 INFO:tasks.workunit.client.1.smithi129.stdout:8/572: dread d0/d6/d7/d18/d27/d32/d70/f8c [0,4194304] 0 2024-09-21T08:02:35.763 INFO:tasks.workunit.client.1.smithi129.stdout:8/573: write d0/d6/d7/d18/d27/f39 [1229741,106577] 0 2024-09-21T08:02:35.763 INFO:tasks.workunit.client.1.smithi129.stdout:3/748: truncate d3/da/d5d/f77 5725617 0 2024-09-21T08:02:35.763 INFO:tasks.workunit.client.1.smithi129.stdout:8/574: stat d0 0 2024-09-21T08:02:35.765 INFO:tasks.workunit.client.1.smithi129.stdout:6/646: mknod d7/d1b/d57/dd6/cd7 0 2024-09-21T08:02:35.765 INFO:tasks.workunit.client.1.smithi129.stdout:1/767: creat d1/d4/dad/db6/df7/dff/f106 x:0 0 0 2024-09-21T08:02:35.767 INFO:tasks.workunit.client.1.smithi129.stdout:3/749: mknod d3/d69/c108 0 2024-09-21T08:02:35.768 INFO:tasks.workunit.client.1.smithi129.stdout:8/575: symlink d0/d6/d7/d18/d27/d60/d97/lb0 0 2024-09-21T08:02:35.768 INFO:tasks.workunit.client.1.smithi129.stdout:8/576: write d0/d6/d7/d18/d27/d32/d37/f42 [1413639,41585] 0 2024-09-21T08:02:35.772 INFO:tasks.workunit.client.1.smithi129.stdout:0/679: write de/d19/f72 [498641,69575] 0 2024-09-21T08:02:35.773 INFO:tasks.workunit.client.1.smithi129.stdout:3/750: rmdir d3 39 2024-09-21T08:02:35.773 INFO:tasks.workunit.client.1.smithi129.stdout:8/577: mknod d0/d6/d7/d3a/cb1 0 2024-09-21T08:02:35.775 INFO:tasks.workunit.client.1.smithi129.stdout:9/619: write d17/d22/f30 [1115856,114516] 0 2024-09-21T08:02:35.776 INFO:tasks.workunit.client.1.smithi129.stdout:5/747: read d2/d1e/f56 [895341,27549] 0 2024-09-21T08:02:35.776 INFO:tasks.workunit.client.1.smithi129.stdout:0/680: mknod de/d15/d39/d56/cdc 0 2024-09-21T08:02:35.779 INFO:tasks.workunit.client.1.smithi129.stdout:9/620: mkdir d17/d22/d33/d36/dd3 0 2024-09-21T08:02:35.779 INFO:tasks.workunit.client.1.smithi129.stdout:8/578: mknod d0/d6/d7/d6c/cb2 0 2024-09-21T08:02:35.779 INFO:tasks.workunit.client.1.smithi129.stdout:9/621: write d17/d46/fb2 [393290,118614] 0 2024-09-21T08:02:35.780 INFO:tasks.workunit.client.1.smithi129.stdout:3/751: mknod d3/da/dc/d7f/dd6/c109 0 2024-09-21T08:02:35.781 INFO:tasks.workunit.client.1.smithi129.stdout:3/752: creat d3/da/dc/d11/d55/f10a x:0 0 0 2024-09-21T08:02:35.781 INFO:tasks.workunit.client.1.smithi129.stdout:3/753: creat d3/da/dc/d7f/dd6/f10b x:0 0 0 2024-09-21T08:02:35.782 INFO:tasks.workunit.client.1.smithi129.stdout:0/681: creat de/d19/dd9/fdd x:0 0 0 2024-09-21T08:02:35.784 INFO:tasks.workunit.client.1.smithi129.stdout:3/754: dread d3/da/dc/da3/fd1 [0,4194304] 0 2024-09-21T08:02:35.784 INFO:tasks.workunit.client.1.smithi129.stdout:3/755: truncate d3/d69/d95/f91 4833153 0 2024-09-21T08:02:35.784 INFO:tasks.workunit.client.1.smithi129.stdout:3/756: fdatasync d3/d69/d95/de1/fe9 0 2024-09-21T08:02:35.787 INFO:tasks.workunit.client.1.smithi129.stdout:0/682: symlink de/d15/d39/d9e/dac/lde 0 2024-09-21T08:02:35.788 INFO:tasks.workunit.client.1.smithi129.stdout:7/855: dwrite d0/d1e/d9a/dca/d100/fa8 [0,4194304] 0 2024-09-21T08:02:35.792 INFO:tasks.workunit.client.1.smithi129.stdout:3/757: creat d3/da/dc/d7f/dd6/de2/df2/f10c x:0 0 0 2024-09-21T08:02:35.794 INFO:tasks.workunit.client.1.smithi129.stdout:7/856: creat d0/d46/d6e/dad/df6/dfd/f128 x:0 0 0 2024-09-21T08:02:35.794 INFO:tasks.workunit.client.1.smithi129.stdout:7/857: read - d0/d1e/d9a/dca/d100/d90/f110 zero size 2024-09-21T08:02:35.795 INFO:tasks.workunit.client.1.smithi129.stdout:7/858: write d0/d1e/f8b [619482,73805] 0 2024-09-21T08:02:35.795 INFO:tasks.workunit.client.1.smithi129.stdout:3/758: mkdir d3/d69/d10d 0 2024-09-21T08:02:35.797 INFO:tasks.workunit.client.1.smithi129.stdout:7/859: symlink d0/d1e/d9a/dca/de8/l129 0 2024-09-21T08:02:35.797 INFO:tasks.workunit.client.1.smithi129.stdout:7/860: fdatasync d0/f22 0 2024-09-21T08:02:35.797 INFO:tasks.workunit.client.1.smithi129.stdout:7/861: dread - d0/d46/d6e/de4/f10c zero size 2024-09-21T08:02:35.797 INFO:tasks.workunit.client.1.smithi129.stdout:7/862: chown d0/d1e/d9a/dca/d100/d8f/cb2 823782 1 2024-09-21T08:02:35.798 INFO:tasks.workunit.client.1.smithi129.stdout:5/748: write d2/f45 [3287851,64543] 0 2024-09-21T08:02:35.798 INFO:tasks.workunit.client.1.smithi129.stdout:5/749: truncate d2/d1e/d35/d37/d96/de5/db1/d71/fc1 524627 0 2024-09-21T08:02:35.799 INFO:tasks.workunit.client.1.smithi129.stdout:7/863: creat d0/d120/f12a x:0 0 0 2024-09-21T08:02:35.799 INFO:tasks.workunit.client.1.smithi129.stdout:7/864: chown d0/d1e/d9a/d9f/lf7 14154 1 2024-09-21T08:02:35.803 INFO:tasks.workunit.client.1.smithi129.stdout:2/925: dwrite d1/d13/d32/f87 [0,4194304] 0 2024-09-21T08:02:35.807 INFO:tasks.workunit.client.1.smithi129.stdout:2/926: link d1/d13/d3a/dc1/f132 d1/d53/d77/d8b/f14b 0 2024-09-21T08:02:35.807 INFO:tasks.workunit.client.1.smithi129.stdout:2/927: symlink d1/d13/d3a/d47/d1f/d85/d131/l14c 0 2024-09-21T08:02:35.808 INFO:tasks.workunit.client.1.smithi129.stdout:2/928: write d1/dc/d19/d4c/f5b [684192,107262] 0 2024-09-21T08:02:35.808 INFO:tasks.workunit.client.1.smithi129.stdout:2/929: mknod d1/d13/d3a/d47/d1f/d85/c14d 0 2024-09-21T08:02:35.808 INFO:tasks.workunit.client.1.smithi129.stdout:2/930: chown d1/dc/d19/d4c/l13b 44422755 1 2024-09-21T08:02:35.809 INFO:tasks.workunit.client.1.smithi129.stdout:2/931: symlink d1/d13/d3a/dc1/d142/l14e 0 2024-09-21T08:02:35.809 INFO:tasks.workunit.client.1.smithi129.stdout:2/932: readlink d1/d13/d32/l4e 0 2024-09-21T08:02:35.810 INFO:tasks.workunit.client.1.smithi129.stdout:2/933: rename d1/dc/d19/d4c/d6a/l56 to d1/dc/d19/l14f 0 2024-09-21T08:02:35.811 INFO:tasks.workunit.client.1.smithi129.stdout:2/934: creat d1/d13/d3a/d47/d1f/f150 x:0 0 0 2024-09-21T08:02:35.811 INFO:tasks.workunit.client.1.smithi129.stdout:2/935: truncate d1/d13/d3a/d47/d1f/d85/d134/f14a 687983 0 2024-09-21T08:02:35.812 INFO:tasks.workunit.client.1.smithi129.stdout:2/936: creat d1/d13/d32/f151 x:0 0 0 2024-09-21T08:02:35.812 INFO:tasks.workunit.client.1.smithi129.stdout:2/937: truncate d1/d13/d32/f151 954275 0 2024-09-21T08:02:35.813 INFO:tasks.workunit.client.1.smithi129.stdout:2/938: unlink d1/d13/d3a/dc1/d142/l14e 0 2024-09-21T08:02:35.813 INFO:tasks.workunit.client.1.smithi129.stdout:2/939: creat d1/d13/d3a/d47/d1f/d85/df7/f152 x:0 0 0 2024-09-21T08:02:35.813 INFO:tasks.workunit.client.1.smithi129.stdout:2/940: fsync d1/d13/d3a/d47/f27 0 2024-09-21T08:02:35.813 INFO:tasks.workunit.client.1.smithi129.stdout:2/941: creat d1/d13/d3a/d47/d1f/d85/d134/f153 x:0 0 0 2024-09-21T08:02:35.814 INFO:tasks.workunit.client.1.smithi129.stdout:2/942: symlink d1/d13/d3a/d47/l154 0 2024-09-21T08:02:35.815 INFO:tasks.workunit.client.1.smithi129.stdout:2/943: dread d1/d13/d3a/d47/d1f/d85/df7/d45/d65/f57 [0,4194304] 0 2024-09-21T08:02:35.816 INFO:tasks.workunit.client.1.smithi129.stdout:2/944: unlink d1/d13/d3a/d47/d1f/d85/df7/d45/d65/d50/c76 0 2024-09-21T08:02:35.824 INFO:tasks.workunit.client.0.smithi107.stdout:0/124: dwrite d1/d5/f1e [0,4194304] 0 2024-09-21T08:02:35.827 INFO:tasks.workunit.client.1.smithi129.stdout:4/634: dwrite d5/d11/f4c [0,4194304] 0 2024-09-21T08:02:35.831 INFO:tasks.workunit.client.1.smithi129.stdout:6/647: dwrite d7/fc8 [0,4194304] 0 2024-09-21T08:02:35.833 INFO:tasks.workunit.client.1.smithi129.stdout:6/648: symlink d7/d1b/d1e/d66/d7c/ld8 0 2024-09-21T08:02:35.837 INFO:tasks.workunit.client.1.smithi129.stdout:9/622: dwrite d17/d46/f4b [4194304,4194304] 0 2024-09-21T08:02:35.840 INFO:tasks.workunit.client.1.smithi129.stdout:9/623: truncate d17/d22/d33/d7a/d89/d90/db1/d31/f56 5062381 0 2024-09-21T08:02:35.841 INFO:tasks.workunit.client.1.smithi129.stdout:9/624: truncate d17/d22/d33/d7a/d89/d90/db1/d31/f5a 3661533 0 2024-09-21T08:02:35.841 INFO:tasks.workunit.client.1.smithi129.stdout:9/625: truncate f15 2125996 0 2024-09-21T08:02:35.841 INFO:tasks.workunit.client.1.smithi129.stdout:1/768: dwrite d1/d16/d57/fa1 [0,4194304] 0 2024-09-21T08:02:35.842 INFO:tasks.workunit.client.1.smithi129.stdout:8/579: dwrite d0/d6/d7/d3a/d8e/fa6 [0,4194304] 0 2024-09-21T08:02:35.842 INFO:tasks.workunit.client.1.smithi129.stdout:8/580: creat d0/d6/d7/d3a/d8e/fb3 x:0 0 0 2024-09-21T08:02:35.843 INFO:tasks.workunit.client.1.smithi129.stdout:9/626: mkdir d17/d46/dd4 0 2024-09-21T08:02:35.843 INFO:tasks.workunit.client.1.smithi129.stdout:9/627: dread - d17/d22/d33/d7a/f9d zero size 2024-09-21T08:02:35.843 INFO:tasks.workunit.client.1.smithi129.stdout:9/628: chown d17/d22/fcd 700863 1 2024-09-21T08:02:35.843 INFO:tasks.workunit.client.1.smithi129.stdout:9/629: chown d17/d22/d33/d36/d48/d3f/d71/ca7 6972124 1 2024-09-21T08:02:35.843 INFO:tasks.workunit.client.1.smithi129.stdout:0/683: dwrite de/d15/d39/d56/f63 [0,4194304] 0 2024-09-21T08:02:35.843 INFO:tasks.workunit.client.1.smithi129.stdout:0/684: readlink de/ldb 0 2024-09-21T08:02:35.845 INFO:tasks.workunit.client.0.smithi107.stdout:0/125: dread d1/fe [0,4194304] 0 2024-09-21T08:02:36.013 INFO:tasks.workunit.client.1.smithi129.stdout:2/945: dwrite d1/d13/d3a/d47/d1f/d85/df7/d45/d65/ddf/de5/f121 [0,4194304] 0 2024-09-21T08:02:36.013 INFO:tasks.workunit.client.1.smithi129.stdout:2/946: creat d1/dc/d19/d88/f155 x:0 0 0 2024-09-21T08:02:36.013 INFO:tasks.workunit.client.1.smithi129.stdout:2/947: truncate d1/dc/f125 720360 0 2024-09-21T08:02:36.013 INFO:tasks.workunit.client.1.smithi129.stdout:5/750: dwrite d2/d1e/d35/d33/d36/d5a/d77/d81/fd9 [0,4194304] 0 2024-09-21T08:02:36.013 INFO:tasks.workunit.client.1.smithi129.stdout:1/769: mkdir d1/d7a/da4/d107 0 2024-09-21T08:02:36.014 INFO:tasks.workunit.client.0.smithi107.stdout:0/126: mknod d1/d5/d25/c2b 0 2024-09-21T08:02:36.029 INFO:tasks.workunit.client.1.smithi129.stdout:8/581: dread d0/f3f [0,4194304] 0 2024-09-21T08:02:36.030 INFO:tasks.workunit.client.1.smithi129.stdout:8/582: read d0/d6/d7/d18/d27/f90 [445190,97645] 0 2024-09-21T08:02:36.030 INFO:tasks.workunit.client.1.smithi129.stdout:8/583: write d0/d6/d7/f21 [4357545,105515] 0 2024-09-21T08:02:36.032 INFO:tasks.workunit.client.1.smithi129.stdout:2/948: creat d1/d13/d32/d97/da7/d145/f156 x:0 0 0 2024-09-21T08:02:36.033 INFO:tasks.workunit.client.1.smithi129.stdout:8/584: dread d0/d6/d7/d18/d27/f90 [0,4194304] 0 2024-09-21T08:02:36.034 INFO:tasks.workunit.client.1.smithi129.stdout:1/770: link d1/d9/d31/fb7 d1/d4/f108 0 2024-09-21T08:02:36.037 INFO:tasks.workunit.client.1.smithi129.stdout:2/949: rename d1/d13/d3a/d47/d1f/f98 to d1/d53/d68/f157 0 2024-09-21T08:02:36.038 INFO:tasks.workunit.client.1.smithi129.stdout:8/585: unlink d0/d6/d7/d18/la0 0 2024-09-21T08:02:36.038 INFO:tasks.workunit.client.1.smithi129.stdout:8/586: chown d0/d6/d7/d18/d27/d32/d37/f89 9850 1 2024-09-21T08:02:36.039 INFO:tasks.workunit.client.1.smithi129.stdout:8/587: fsync d0/d6/d7/d18/d27/f39 0 2024-09-21T08:02:36.040 INFO:tasks.workunit.client.1.smithi129.stdout:1/771: creat d1/d16/d25/f109 x:0 0 0 2024-09-21T08:02:36.040 INFO:tasks.workunit.client.1.smithi129.stdout:8/588: write d0/d6/d7/d24/f36 [502408,41296] 0 2024-09-21T08:02:36.040 INFO:tasks.workunit.client.1.smithi129.stdout:4/635: dwrite d5/d16/d24/d4f/fae [0,4194304] 0 2024-09-21T08:02:36.041 INFO:tasks.workunit.client.1.smithi129.stdout:6/649: dwrite d7/d1b/d1e/d39/d4b/f1d [4194304,4194304] 0 2024-09-21T08:02:36.042 INFO:tasks.workunit.client.1.smithi129.stdout:2/950: unlink d1/d13/d3a/d47/d5f/l74 0 2024-09-21T08:02:36.043 INFO:tasks.workunit.client.1.smithi129.stdout:2/951: dread d1/d13/d3a/d47/d1f/d85/df7/d45/d65/fe3 [0,4194304] 0 2024-09-21T08:02:36.043 INFO:tasks.workunit.client.1.smithi129.stdout:2/952: chown d1/d13/f28 51 1 2024-09-21T08:02:36.048 INFO:tasks.workunit.client.1.smithi129.stdout:6/650: creat d7/d1b/d1e/d66/dc2/d93/fd9 x:0 0 0 2024-09-21T08:02:36.049 INFO:tasks.workunit.client.1.smithi129.stdout:9/630: dwrite d17/d22/d33/d36/d48/d75/fa8 [0,4194304] 0 2024-09-21T08:02:36.050 INFO:tasks.workunit.client.1.smithi129.stdout:5/751: dwrite d2/d1e/d35/d33/dca/fda [0,4194304] 0 2024-09-21T08:02:36.050 INFO:tasks.workunit.client.1.smithi129.stdout:5/752: readlink d2/d1e/d35/d33/da1/lc3 0 2024-09-21T08:02:36.051 INFO:tasks.workunit.client.1.smithi129.stdout:0/685: dwrite de/d19/f72 [0,4194304] 0 2024-09-21T08:02:36.051 INFO:tasks.workunit.client.1.smithi129.stdout:9/631: link d17/d22/d33/l64 d17/d22/d33/d7a/ld5 0 2024-09-21T08:02:36.055 INFO:tasks.workunit.client.1.smithi129.stdout:1/772: write d1/d16/d9b/fa2 [3907408,12935] 0 2024-09-21T08:02:36.055 INFO:tasks.workunit.client.1.smithi129.stdout:1/773: write d1/d16/f2a [720276,107618] 0 2024-09-21T08:02:36.055 INFO:tasks.workunit.client.1.smithi129.stdout:1/774: chown d1/d16/d28/f5c 1 1 2024-09-21T08:02:36.056 INFO:tasks.workunit.client.1.smithi129.stdout:1/775: chown d1/d4/d6e/fd3 979621229 1 2024-09-21T08:02:36.057 INFO:tasks.workunit.client.1.smithi129.stdout:8/589: read d0/d6/d7/d18/d27/d32/d37/f89 [561461,88638] 0 2024-09-21T08:02:36.058 INFO:tasks.workunit.client.1.smithi129.stdout:2/953: dread d1/d13/d3a/d47/d5f/fc6 [0,4194304] 0 2024-09-21T08:02:36.060 INFO:tasks.workunit.client.1.smithi129.stdout:5/753: dread d2/d1e/d35/f31 [0,4194304] 0 2024-09-21T08:02:36.062 INFO:tasks.workunit.client.1.smithi129.stdout:6/651: dread d7/d1b/f7b [0,4194304] 0 2024-09-21T08:02:36.062 INFO:tasks.workunit.client.1.smithi129.stdout:6/652: write d7/d1b/d1e/d66/d7c/f97 [872380,91998] 0 2024-09-21T08:02:36.062 INFO:tasks.workunit.client.1.smithi129.stdout:0/686: symlink de/d15/d44/ldf 0 2024-09-21T08:02:36.063 INFO:tasks.workunit.client.1.smithi129.stdout:0/687: write de/d19/f4e [4430258,61712] 0 2024-09-21T08:02:36.063 INFO:tasks.workunit.client.1.smithi129.stdout:0/688: chown de/d15/d44/d4b/f7a 1758434 1 2024-09-21T08:02:36.063 INFO:tasks.workunit.client.1.smithi129.stdout:1/776: rename d1/d44/c75 to d1/d16/d28/c10a 0 2024-09-21T08:02:36.063 INFO:tasks.workunit.client.1.smithi129.stdout:1/777: read - d1/d16/d28/fd4 zero size 2024-09-21T08:02:36.063 INFO:tasks.workunit.client.1.smithi129.stdout:9/632: dread d17/d22/d33/d7a/d89/fa6 [0,4194304] 0 2024-09-21T08:02:36.063 INFO:tasks.workunit.client.1.smithi129.stdout:9/633: fsync d17/f49 0 2024-09-21T08:02:36.064 INFO:tasks.workunit.client.1.smithi129.stdout:8/590: link d0/d6/d7/d18/d27/d32/d3d/d83/c8b d0/d6/d7/d5a/cb4 0 2024-09-21T08:02:36.066 INFO:tasks.workunit.client.1.smithi129.stdout:2/954: unlink d1/d13/d3a/d47/d5f/cfe 0 2024-09-21T08:02:36.068 INFO:tasks.workunit.client.1.smithi129.stdout:5/754: link d2/d2a/f2e d2/d2a/fea 0 2024-09-21T08:02:36.068 INFO:tasks.workunit.client.1.smithi129.stdout:6/653: rmdir d7/d1b/d57 39 2024-09-21T08:02:36.069 INFO:tasks.workunit.client.1.smithi129.stdout:6/654: chown d7/d1b/d57/d96/lb9 176389944 1 2024-09-21T08:02:36.069 INFO:tasks.workunit.client.1.smithi129.stdout:0/689: rmdir de/d15/d39/d9e/dac/dba 39 2024-09-21T08:02:36.071 INFO:tasks.workunit.client.1.smithi129.stdout:1/778: creat d1/d9/d31/f10b x:0 0 0 2024-09-21T08:02:36.073 INFO:tasks.workunit.client.1.smithi129.stdout:9/634: creat d17/d60/fd6 x:0 0 0 2024-09-21T08:02:36.073 INFO:tasks.workunit.client.1.smithi129.stdout:8/591: creat d0/d6/d7/d9/d94/fb5 x:0 0 0 2024-09-21T08:02:36.073 INFO:tasks.workunit.client.1.smithi129.stdout:9/635: fdatasync d17/d22/d33/d7a/d89/d90/db1/f66 0 2024-09-21T08:02:36.073 INFO:tasks.workunit.client.1.smithi129.stdout:8/592: dread - d0/d6/d7/d3a/d8e/fb3 zero size 2024-09-21T08:02:36.073 INFO:tasks.workunit.client.1.smithi129.stdout:8/593: fsync d0/d6/f98 0 2024-09-21T08:02:36.074 INFO:tasks.workunit.client.1.smithi129.stdout:8/594: fsync d0/d6/d7/d6c/f6e 0 2024-09-21T08:02:36.075 INFO:tasks.workunit.client.1.smithi129.stdout:2/955: mknod d1/d13/d3a/d47/d1f/d85/df7/c158 0 2024-09-21T08:02:36.076 INFO:tasks.workunit.client.1.smithi129.stdout:5/755: symlink d2/d1e/d6b/dd1/leb 0 2024-09-21T08:02:36.077 INFO:tasks.workunit.client.1.smithi129.stdout:5/756: dread - d2/d1e/d35/d33/d36/d5a/fa8 zero size 2024-09-21T08:02:36.077 INFO:tasks.workunit.client.1.smithi129.stdout:5/757: readlink d2/d2a/le3 0 2024-09-21T08:02:36.077 INFO:tasks.workunit.client.1.smithi129.stdout:5/758: write d2/d2a/fb0 [321787,75701] 0 2024-09-21T08:02:36.077 INFO:tasks.workunit.client.1.smithi129.stdout:1/779: symlink d1/d7a/da4/l10c 0 2024-09-21T08:02:36.077 INFO:tasks.workunit.client.1.smithi129.stdout:1/780: chown d1/d16/l1b 18408467 1 2024-09-21T08:02:36.078 INFO:tasks.workunit.client.1.smithi129.stdout:9/636: mknod d17/d22/d33/da5/cd7 0 2024-09-21T08:02:36.079 INFO:tasks.workunit.client.1.smithi129.stdout:8/595: read d0/d6/d7/d9/f7d [15888,8163] 0 2024-09-21T08:02:36.079 INFO:tasks.workunit.client.1.smithi129.stdout:8/596: write d0/d6/d7/d18/d27/d32/fa7 [867726,114462] 0 2024-09-21T08:02:36.080 INFO:tasks.workunit.client.1.smithi129.stdout:2/956: unlink d1/dc/d19/d4c/d9d/ldb 0 2024-09-21T08:02:36.080 INFO:tasks.workunit.client.1.smithi129.stdout:5/759: dread d2/f1d [0,4194304] 0 2024-09-21T08:02:36.082 INFO:tasks.workunit.client.1.smithi129.stdout:9/637: mknod d17/d22/d33/d7a/d89/d90/db1/d31/d5e/cd8 0 2024-09-21T08:02:36.084 INFO:tasks.workunit.client.1.smithi129.stdout:2/957: creat d1/dc/d19/d4c/d6a/f159 x:0 0 0 2024-09-21T08:02:36.085 INFO:tasks.workunit.client.1.smithi129.stdout:5/760: symlink d2/d1e/d35/d33/d36/d5a/lec 0 2024-09-21T08:02:36.085 INFO:tasks.workunit.client.1.smithi129.stdout:5/761: getdents d2/d1e/d35/d33/d36/de0 0 2024-09-21T08:02:36.086 INFO:tasks.workunit.client.1.smithi129.stdout:9/638: symlink d17/d22/d33/da5/ld9 0 2024-09-21T08:02:36.087 INFO:tasks.workunit.client.1.smithi129.stdout:9/639: chown d17/d46/f4b 571071 1 2024-09-21T08:02:36.088 INFO:tasks.workunit.client.1.smithi129.stdout:5/762: rmdir d2/d1e/d35/d33/d36/d5a/d77 39 2024-09-21T08:02:36.090 INFO:tasks.workunit.client.1.smithi129.stdout:6/655: dwrite d7/d1b/d1e/d66/dba/d35/d40/d41/f70 [0,4194304] 0 2024-09-21T08:02:36.091 INFO:tasks.workunit.client.1.smithi129.stdout:9/640: rename d17/d22/d33/d7a/d89/d90/db1/d31/d35/c72 to d17/d60/d97/cda 0 2024-09-21T08:02:36.091 INFO:tasks.workunit.client.1.smithi129.stdout:1/781: dread d1/d16/d28/f33 [0,4194304] 0 2024-09-21T08:02:36.092 INFO:tasks.workunit.client.1.smithi129.stdout:9/641: write d17/d46/f8e [344793,112112] 0 2024-09-21T08:02:36.092 INFO:tasks.workunit.client.1.smithi129.stdout:9/642: getdents d17/d22/d33/d7a/d89/d90/db1/d31/d5e/d6b/db6 0 2024-09-21T08:02:36.092 INFO:tasks.workunit.client.1.smithi129.stdout:9/643: chown d17/d55/d81/c6e 9 1 2024-09-21T08:02:36.095 INFO:tasks.workunit.client.1.smithi129.stdout:5/763: truncate d2/d1e/d35/ff 632692 0 2024-09-21T08:02:36.095 INFO:tasks.workunit.client.1.smithi129.stdout:5/764: chown d2/d1e/d35/d37/d96/de5/db1/d71/da9/fb8 131210081 1 2024-09-21T08:02:36.095 INFO:tasks.workunit.client.1.smithi129.stdout:5/765: creat d2/d1e/d35/d33/da1/fed x:0 0 0 2024-09-21T08:02:36.095 INFO:tasks.workunit.client.1.smithi129.stdout:6/656: rename d7/d4a/l56 to d7/d4a/lda 0 2024-09-21T08:02:36.098 INFO:tasks.workunit.client.1.smithi129.stdout:0/690: dwrite de/d15/d39/d9e/dac/dba/dc0/fcb [4194304,4194304] 0 2024-09-21T08:02:36.098 INFO:tasks.workunit.client.1.smithi129.stdout:1/782: rename d1/d4/d6e/da9/fd8 to d1/d4/d96/f10d 0 2024-09-21T08:02:36.100 INFO:tasks.workunit.client.1.smithi129.stdout:5/766: rmdir d2/d1e/d35/d37/d96/de5 39 2024-09-21T08:02:36.101 INFO:tasks.workunit.client.1.smithi129.stdout:6/657: symlink d7/d4a/d7a/ldb 0 2024-09-21T08:02:36.104 INFO:tasks.workunit.client.1.smithi129.stdout:0/691: rename de/d22/d27/fca to de/d19/d5e/dc1/fe0 0 2024-09-21T08:02:36.106 INFO:tasks.workunit.client.1.smithi129.stdout:5/767: link d2/d1e/d35/d37/lbb d2/d1e/d35/d37/d96/de5/db1/d71/da9/lee 0 2024-09-21T08:02:36.106 INFO:tasks.workunit.client.1.smithi129.stdout:6/658: getdents d7/d10/dcc 0 2024-09-21T08:02:36.109 INFO:tasks.workunit.client.1.smithi129.stdout:1/783: write d1/d4/f6d [2320903,38505] 0 2024-09-21T08:02:36.109 INFO:tasks.workunit.client.1.smithi129.stdout:5/768: truncate d2/d1e/d35/d33/d36/d5a/d77/d81/fd9 1011879 0 2024-09-21T08:02:36.110 INFO:tasks.workunit.client.1.smithi129.stdout:1/784: truncate d1/d16/d57/f86 2802728 0 2024-09-21T08:02:36.110 INFO:tasks.workunit.client.1.smithi129.stdout:1/785: readlink d1/d9/d31/la7 0 2024-09-21T08:02:36.112 INFO:tasks.workunit.client.1.smithi129.stdout:1/786: rmdir d1/d44/d83/dcb 39 2024-09-21T08:02:36.114 INFO:tasks.workunit.client.1.smithi129.stdout:8/597: dwrite d0/f3f [0,4194304] 0 2024-09-21T08:02:36.115 INFO:tasks.workunit.client.1.smithi129.stdout:1/787: mknod d1/d7a/da4/c10e 0 2024-09-21T08:02:36.115 INFO:tasks.workunit.client.1.smithi129.stdout:1/788: stat d1/d44/cdf 0 2024-09-21T08:02:36.115 INFO:tasks.workunit.client.1.smithi129.stdout:7/865: sync 2024-09-21T08:02:36.115 INFO:tasks.workunit.client.1.smithi129.stdout:3/759: sync 2024-09-21T08:02:36.115 INFO:tasks.workunit.client.1.smithi129.stdout:3/760: stat d3/da/d5d/d94/db3/dc3/fe5 0 2024-09-21T08:02:36.116 INFO:tasks.workunit.client.1.smithi129.stdout:7/866: fsync d0/d46/d6e/d9b/fcb 0 2024-09-21T08:02:36.116 INFO:tasks.workunit.client.1.smithi129.stdout:7/867: fdatasync d0/d1e/d9a/dca/d100/d8f/fa6 0 2024-09-21T08:02:36.116 INFO:tasks.workunit.client.1.smithi129.stdout:7/868: write d0/f70 [1036649,123858] 0 2024-09-21T08:02:36.116 INFO:tasks.workunit.client.1.smithi129.stdout:2/958: dwrite d1/f8 [0,4194304] 0 2024-09-21T08:02:36.117 INFO:tasks.workunit.client.1.smithi129.stdout:2/959: stat d1/d13/d32/d97/da7/faf 0 2024-09-21T08:02:36.117 INFO:tasks.workunit.client.1.smithi129.stdout:2/960: creat d1/d13/d3a/d8f/f15a x:0 0 0 2024-09-21T08:02:36.117 INFO:tasks.workunit.client.1.smithi129.stdout:9/644: dwrite d17/d46/f4b [4194304,4194304] 0 2024-09-21T08:02:36.119 INFO:tasks.workunit.client.1.smithi129.stdout:1/789: truncate d1/f12 1343116 0 2024-09-21T08:02:36.119 INFO:tasks.workunit.client.1.smithi129.stdout:3/761: symlink d3/da/def/l10e 0 2024-09-21T08:02:36.119 INFO:tasks.workunit.client.1.smithi129.stdout:3/762: readlink d3/d69/l6b 0 2024-09-21T08:02:36.121 INFO:tasks.workunit.client.1.smithi129.stdout:7/869: symlink d0/d1e/d9a/dca/d100/l12b 0 2024-09-21T08:02:36.122 INFO:tasks.workunit.client.1.smithi129.stdout:8/598: dread d0/d6/d7/d18/d27/d32/d37/f89 [0,4194304] 0 2024-09-21T08:02:36.122 INFO:tasks.workunit.client.1.smithi129.stdout:8/599: chown d0/d6/d7/d18/d61/d7f/c9c 870881 1 2024-09-21T08:02:36.122 INFO:tasks.workunit.client.1.smithi129.stdout:8/600: read d0/d6/d7/d24/f36 [743037,96008] 0 2024-09-21T08:02:36.122 INFO:tasks.workunit.client.1.smithi129.stdout:6/659: dread d7/fd [0,4194304] 0 2024-09-21T08:02:36.122 INFO:tasks.workunit.client.1.smithi129.stdout:6/660: write d7/d1b/d1e/d66/dba/d35/f6b [249616,79414] 0 2024-09-21T08:02:36.124 INFO:tasks.workunit.client.1.smithi129.stdout:2/961: symlink d1/d13/d3a/d12b/l15b 0 2024-09-21T08:02:36.126 INFO:tasks.workunit.client.1.smithi129.stdout:0/692: dwrite f0 [0,4194304] 0 2024-09-21T08:02:36.127 INFO:tasks.workunit.client.1.smithi129.stdout:9/645: symlink d17/d22/d33/d7a/d89/ldb 0 2024-09-21T08:02:36.128 INFO:tasks.workunit.client.1.smithi129.stdout:1/790: creat d1/d7a/da4/d107/f10f x:0 0 0 2024-09-21T08:02:36.129 INFO:tasks.workunit.client.1.smithi129.stdout:3/763: symlink d3/da/d5d/d94/dac/l10f 0 2024-09-21T08:02:36.129 INFO:tasks.workunit.client.1.smithi129.stdout:3/764: read d3/da/dc/f73 [1141678,46074] 0 2024-09-21T08:02:36.129 INFO:tasks.workunit.client.1.smithi129.stdout:2/962: link d1/d13/d3a/dc1/f132 d1/d13/d32/d97/da7/f15c 0 2024-09-21T08:02:36.131 INFO:tasks.workunit.client.1.smithi129.stdout:3/765: symlink d3/da/dc/d25/l110 0 2024-09-21T08:02:36.131 INFO:tasks.workunit.client.1.smithi129.stdout:3/766: creat d3/da/dc/d7f/dd6/de2/df2/f111 x:0 0 0 2024-09-21T08:02:36.133 INFO:tasks.workunit.client.1.smithi129.stdout:2/963: creat d1/dc/d19/f15d x:0 0 0 2024-09-21T08:02:36.134 INFO:tasks.workunit.client.1.smithi129.stdout:7/870: dread d0/f79 [4194304,4194304] 0 2024-09-21T08:02:36.136 INFO:tasks.workunit.client.1.smithi129.stdout:3/767: rename d3/d57/d80/fd8 to d3/da/f112 0 2024-09-21T08:02:36.137 INFO:tasks.workunit.client.1.smithi129.stdout:5/769: dwrite d2/f1b [0,4194304] 0 2024-09-21T08:02:36.138 INFO:tasks.workunit.client.1.smithi129.stdout:8/601: write d0/d6/d7/d18/d27/f2d [7853260,116789] 0 2024-09-21T08:02:36.138 INFO:tasks.workunit.client.1.smithi129.stdout:2/964: symlink d1/d13/d32/d97/da7/d145/l15e 0 2024-09-21T08:02:36.138 INFO:tasks.workunit.client.1.smithi129.stdout:8/602: chown d0/d6/d7/d24/f35 2482 1 2024-09-21T08:02:36.139 INFO:tasks.workunit.client.1.smithi129.stdout:8/603: stat d0/d6/d7/d18/d61/c88 0 2024-09-21T08:02:36.139 INFO:tasks.workunit.client.1.smithi129.stdout:2/965: read d1/dc/d19/d4c/d9d/fcb [943208,69340] 0 2024-09-21T08:02:36.139 INFO:tasks.workunit.client.1.smithi129.stdout:2/966: chown d1/dc/d19/d4c/d9d/c10b 1 1 2024-09-21T08:02:36.139 INFO:tasks.workunit.client.1.smithi129.stdout:7/871: creat d0/d1e/db1/dc7/f12c x:0 0 0 2024-09-21T08:02:36.140 INFO:tasks.workunit.client.1.smithi129.stdout:0/693: write de/d22/f2b [3789313,72397] 0 2024-09-21T08:02:36.142 INFO:tasks.workunit.client.1.smithi129.stdout:5/770: rename d2/d1e/d35/l27 to d2/d1e/d35/d37/d96/de5/db1/d71/da9/lef 0 2024-09-21T08:02:36.143 INFO:tasks.workunit.client.1.smithi129.stdout:8/604: symlink d0/d6/d7/lb6 0 2024-09-21T08:02:36.143 INFO:tasks.workunit.client.1.smithi129.stdout:8/605: creat d0/d6/dac/fb7 x:0 0 0 2024-09-21T08:02:36.143 INFO:tasks.workunit.client.1.smithi129.stdout:1/791: dread d1/d4/dad/db6/fc1 [0,4194304] 0 2024-09-21T08:02:36.144 INFO:tasks.workunit.client.1.smithi129.stdout:2/967: mknod d1/d13/d32/d7c/c15f 0 2024-09-21T08:02:36.144 INFO:tasks.workunit.client.1.smithi129.stdout:2/968: dread - d1/d13/d3a/d47/d1f/fda zero size 2024-09-21T08:02:36.144 INFO:tasks.workunit.client.1.smithi129.stdout:2/969: creat d1/dc/d94/d116/f160 x:0 0 0 2024-09-21T08:02:36.144 INFO:tasks.workunit.client.1.smithi129.stdout:2/970: creat d1/d53/d68/db9/f161 x:0 0 0 2024-09-21T08:02:36.147 INFO:tasks.workunit.client.1.smithi129.stdout:7/872: mkdir d0/d1e/db1/dba/d12d 0 2024-09-21T08:02:36.148 INFO:tasks.workunit.client.1.smithi129.stdout:0/694: symlink de/d15/d39/d9e/le1 0 2024-09-21T08:02:36.149 INFO:tasks.workunit.client.1.smithi129.stdout:3/768: symlink d3/l113 0 2024-09-21T08:02:36.150 INFO:tasks.workunit.client.1.smithi129.stdout:5/771: creat d2/d1e/d35/ff0 x:0 0 0 2024-09-21T08:02:36.151 INFO:tasks.workunit.client.1.smithi129.stdout:5/772: chown d2/d2a/le3 47218265 1 2024-09-21T08:02:36.151 INFO:tasks.workunit.client.1.smithi129.stdout:5/773: stat d2/d1e/d35/d33/d36/d5a/d77/ldc 0 2024-09-21T08:02:36.154 INFO:tasks.workunit.client.1.smithi129.stdout:6/661: dwrite d7/d1b/d1e/d66/dba/d2b/f3c [0,4194304] 0 2024-09-21T08:02:36.154 INFO:tasks.workunit.client.1.smithi129.stdout:6/662: stat d7/d1b/d1e/d39/d4b/c52 0 2024-09-21T08:02:36.156 INFO:tasks.workunit.client.1.smithi129.stdout:3/769: symlink d3/da/d5d/d94/db3/dc3/l114 0 2024-09-21T08:02:36.157 INFO:tasks.workunit.client.1.smithi129.stdout:3/770: read d3/da/dc/da3/fb2 [356369,4554] 0 2024-09-21T08:02:36.157 INFO:tasks.workunit.client.1.smithi129.stdout:3/771: chown d3/da/dc/d11/d2f/fcf 6440308 1 2024-09-21T08:02:36.159 INFO:tasks.workunit.client.1.smithi129.stdout:8/606: dread d0/d6/d7/d18/d27/d32/fa7 [0,4194304] 0 2024-09-21T08:02:36.161 INFO:tasks.workunit.client.1.smithi129.stdout:9/646: dwrite d17/d22/d33/d36/d48/db7/fc8 [0,4194304] 0 2024-09-21T08:02:36.161 INFO:tasks.workunit.client.1.smithi129.stdout:9/647: chown d17/d46/f4f 63206 1 2024-09-21T08:02:36.161 INFO:tasks.workunit.client.1.smithi129.stdout:1/792: dread d1/f3f [0,4194304] 0 2024-09-21T08:02:36.163 INFO:tasks.workunit.client.1.smithi129.stdout:9/648: read d17/d46/fb2 [56327,39748] 0 2024-09-21T08:02:36.163 INFO:tasks.workunit.client.1.smithi129.stdout:7/873: dread d0/f70 [0,4194304] 0 2024-09-21T08:02:36.169 INFO:tasks.workunit.client.1.smithi129.stdout:3/772: unlink d3/da/c7c 0 2024-09-21T08:02:36.169 INFO:tasks.workunit.client.1.smithi129.stdout:3/773: fdatasync d3/da/dc/fb5 0 2024-09-21T08:02:36.170 INFO:tasks.workunit.client.1.smithi129.stdout:1/793: mknod d1/d16/d25/da0/c110 0 2024-09-21T08:02:36.171 INFO:tasks.workunit.client.1.smithi129.stdout:9/649: mkdir d17/d22/d33/d7a/d89/d90/db1/d31/ddc 0 2024-09-21T08:02:36.171 INFO:tasks.workunit.client.1.smithi129.stdout:9/650: chown d17/d22/d33/d36/d48/d3f/d71/ca7 150038 1 2024-09-21T08:02:36.172 INFO:tasks.workunit.client.1.smithi129.stdout:3/774: mkdir d3/da/d5d/d94/db3/dc3/d115 0 2024-09-21T08:02:36.172 INFO:tasks.workunit.client.1.smithi129.stdout:3/775: write d3/d69/d98/f106 [458675,62519] 0 2024-09-21T08:02:36.173 INFO:tasks.workunit.client.1.smithi129.stdout:3/776: chown d3/da/dc/f4d 137145273 1 2024-09-21T08:02:36.173 INFO:tasks.workunit.client.1.smithi129.stdout:7/874: rmdir d0/dc5/d112 39 2024-09-21T08:02:36.174 INFO:tasks.workunit.client.1.smithi129.stdout:3/777: unlink d3/d90/lcd 0 2024-09-21T08:02:36.175 INFO:tasks.workunit.client.1.smithi129.stdout:3/778: symlink d3/da/dc/d11/d2f/l116 0 2024-09-21T08:02:36.179 INFO:tasks.workunit.client.1.smithi129.stdout:1/794: dread d1/d16/d9b/fa2 [0,4194304] 0 2024-09-21T08:02:36.185 INFO:tasks.workunit.client.1.smithi129.stdout:9/651: write d17/d22/d33/d7a/d89/d90/db1/d31/f51 [180735,69114] 0 2024-09-21T08:02:36.186 INFO:tasks.workunit.client.1.smithi129.stdout:9/652: rmdir d17/d22/d33/d7a/d89/d90/db1/d31 39 2024-09-21T08:02:36.188 INFO:tasks.workunit.client.1.smithi129.stdout:5/774: dwrite d2/d1e/d35/d33/f88 [0,4194304] 0 2024-09-21T08:02:36.190 INFO:tasks.workunit.client.1.smithi129.stdout:7/875: dread d0/d46/d6e/d9b/de5/f11d [0,4194304] 0 2024-09-21T08:02:36.190 INFO:tasks.workunit.client.1.smithi129.stdout:7/876: chown d0/d1e/db1/dba/cda 197 1 2024-09-21T08:02:36.190 INFO:tasks.workunit.client.1.smithi129.stdout:7/877: fsync d0/d46/d6e/d9b/de5/fea 0 2024-09-21T08:02:36.191 INFO:tasks.workunit.client.1.smithi129.stdout:5/775: creat d2/d1e/d35/d37/d96/de5/db1/ff1 x:0 0 0 2024-09-21T08:02:36.192 INFO:tasks.workunit.client.1.smithi129.stdout:8/607: dwrite d0/d6/d7/d6c/f6e [0,4194304] 0 2024-09-21T08:02:36.193 INFO:tasks.workunit.client.1.smithi129.stdout:7/878: symlink d0/d46/d6e/d9b/da5/db7/l12e 0 2024-09-21T08:02:36.193 INFO:tasks.workunit.client.1.smithi129.stdout:7/879: readlink d0/d1e/d9a/d9f/led 0 2024-09-21T08:02:36.194 INFO:tasks.workunit.client.1.smithi129.stdout:8/608: dread d0/d6/d7/d9/f7d [0,4194304] 0 2024-09-21T08:02:36.194 INFO:tasks.workunit.client.1.smithi129.stdout:9/653: write f10 [459286,28662] 0 2024-09-21T08:02:36.194 INFO:tasks.workunit.client.1.smithi129.stdout:5/776: symlink d2/d1e/d35/d37/d96/de5/lf2 0 2024-09-21T08:02:36.196 INFO:tasks.workunit.client.1.smithi129.stdout:8/609: mknod d0/d6/d7/d9/cb8 0 2024-09-21T08:02:36.197 INFO:tasks.workunit.client.1.smithi129.stdout:9/654: rename d17/d55/d81/c68 to d17/d22/d33/cdd 0 2024-09-21T08:02:36.198 INFO:tasks.workunit.client.1.smithi129.stdout:9/655: write d17/d22/d33/d36/d48/d75/fb0 [1136015,78283] 0 2024-09-21T08:02:36.198 INFO:tasks.workunit.client.1.smithi129.stdout:9/656: chown d17/d22/d33/d7a/d89/d90/db1/d31/d5e/fc1 0 1 2024-09-21T08:02:36.199 INFO:tasks.workunit.client.1.smithi129.stdout:5/777: link d2/d1e/d35/f40 d2/d1e/d35/d37/d65/dc5/ff3 0 2024-09-21T08:02:36.199 INFO:tasks.workunit.client.1.smithi129.stdout:5/778: chown d2/d1e/d35/d37/d65/dc5 133 1 2024-09-21T08:02:36.200 INFO:tasks.workunit.client.1.smithi129.stdout:9/657: rmdir d17/d60/d7b/dc4 39 2024-09-21T08:02:36.201 INFO:tasks.workunit.client.1.smithi129.stdout:0/695: dwrite de/d19/f4e [4194304,4194304] 0 2024-09-21T08:02:36.202 INFO:tasks.workunit.client.1.smithi129.stdout:5/779: symlink d2/d1e/d35/d33/dca/lf4 0 2024-09-21T08:02:36.203 INFO:tasks.workunit.client.1.smithi129.stdout:5/780: fsync d2/d1e/d35/d33/d36/d5a/f70 0 2024-09-21T08:02:36.203 INFO:tasks.workunit.client.1.smithi129.stdout:5/781: write d2/d1e/d35/d37/d96/de5/d61/f6e [1098753,102504] 0 2024-09-21T08:02:36.203 INFO:tasks.workunit.client.1.smithi129.stdout:8/610: unlink d0/d6/d7/d18/c49 0 2024-09-21T08:02:36.203 INFO:tasks.workunit.client.1.smithi129.stdout:8/611: readlink d0/d6/d7/d18/d61/lab 0 2024-09-21T08:02:36.204 INFO:tasks.workunit.client.1.smithi129.stdout:9/658: getdents d17/d22/d33/d7a/d89/d90 0 2024-09-21T08:02:36.205 INFO:tasks.workunit.client.1.smithi129.stdout:9/659: mknod d17/d22/d33/d7a/d89/d90/cde 0 2024-09-21T08:02:36.205 INFO:tasks.workunit.client.1.smithi129.stdout:9/660: mknod d17/d22/d33/d36/d48/cdf 0 2024-09-21T08:02:36.207 INFO:tasks.workunit.client.1.smithi129.stdout:7/880: write d0/d1e/f40 [1839025,99443] 0 2024-09-21T08:02:36.207 INFO:tasks.workunit.client.1.smithi129.stdout:1/795: dwrite d1/d4/d6e/da9/fd2 [0,4194304] 0 2024-09-21T08:02:36.208 INFO:tasks.workunit.client.1.smithi129.stdout:3/779: dwrite d3/d90/fd3 [0,4194304] 0 2024-09-21T08:02:36.208 INFO:tasks.workunit.client.1.smithi129.stdout:7/881: creat d0/d46/d6e/dad/df6/dfd/f12f x:0 0 0 2024-09-21T08:02:36.208 INFO:tasks.workunit.client.1.smithi129.stdout:3/780: write d3/da/dc/d25/fbe [710560,27651] 0 2024-09-21T08:02:36.208 INFO:tasks.workunit.client.1.smithi129.stdout:7/882: readlink d0/l35 0 2024-09-21T08:02:36.208 INFO:tasks.workunit.client.1.smithi129.stdout:3/781: dread - d3/d5a/fe6 zero size 2024-09-21T08:02:36.208 INFO:tasks.workunit.client.1.smithi129.stdout:3/782: write d3/da/dc/d11/d2f/fb1 [357070,75649] 0 2024-09-21T08:02:36.209 INFO:tasks.workunit.client.1.smithi129.stdout:8/612: dread d0/d6/d7/d18/d27/f90 [0,4194304] 0 2024-09-21T08:02:36.209 INFO:tasks.workunit.client.1.smithi129.stdout:8/613: truncate d0/d6/d7/d18/fae 285413 0 2024-09-21T08:02:36.209 INFO:tasks.workunit.client.1.smithi129.stdout:8/614: chown d0/d6/dac/fb7 96427367 1 2024-09-21T08:02:36.209 INFO:tasks.workunit.client.1.smithi129.stdout:8/615: write d0/d6/dac/faf [22863,119097] 0 2024-09-21T08:02:36.209 INFO:tasks.workunit.client.1.smithi129.stdout:8/616: chown d0/d6/d7/d18/d61/d7f/c96 7 1 2024-09-21T08:02:36.209 INFO:tasks.workunit.client.1.smithi129.stdout:8/617: fdatasync d0/d6/d7/d18/d27/f3c 0 2024-09-21T08:02:36.210 INFO:tasks.workunit.client.1.smithi129.stdout:8/618: truncate d0/d6/d7/d18/d27/d32/fa7 1412197 0 2024-09-21T08:02:36.212 INFO:tasks.workunit.client.1.smithi129.stdout:1/796: symlink d1/d9/d6b/l111 0 2024-09-21T08:02:36.213 INFO:tasks.workunit.client.1.smithi129.stdout:1/797: read d1/d16/f71 [888457,83321] 0 2024-09-21T08:02:36.215 INFO:tasks.workunit.client.1.smithi129.stdout:7/883: symlink d0/d1e/db1/dba/dc1/l130 0 2024-09-21T08:02:36.215 INFO:tasks.workunit.client.1.smithi129.stdout:7/884: chown d0/d1e/d9a/dca/de8 82245 1 2024-09-21T08:02:36.217 INFO:tasks.workunit.client.1.smithi129.stdout:9/661: rename d17/d22/d33/d36/l58 to d17/d22/d33/d7a/d89/d90/le0 0 2024-09-21T08:02:36.218 INFO:tasks.workunit.client.1.smithi129.stdout:8/619: mkdir d0/d6/dac/db9 0 2024-09-21T08:02:36.218 INFO:tasks.workunit.client.1.smithi129.stdout:8/620: chown d0/d6/d7/f40 3954 1 2024-09-21T08:02:36.219 INFO:tasks.workunit.client.1.smithi129.stdout:8/621: fdatasync d0/d6/d7/d18/d27/d32/d37/f42 0 2024-09-21T08:02:36.219 INFO:tasks.workunit.client.1.smithi129.stdout:8/622: write d0/d6/d7/d24/f46 [53769,52003] 0 2024-09-21T08:02:36.219 INFO:tasks.workunit.client.1.smithi129.stdout:8/623: write d0/d6/d7/d18/d27/d32/f5b [845683,7602] 0 2024-09-21T08:02:36.220 INFO:tasks.workunit.client.1.smithi129.stdout:1/798: mkdir d1/d4/dc2/dc6/d7f/d112 0 2024-09-21T08:02:36.220 INFO:tasks.workunit.client.1.smithi129.stdout:1/799: fsync d1/d16/f101 0 2024-09-21T08:02:36.222 INFO:tasks.workunit.client.1.smithi129.stdout:7/885: mkdir d0/d46/d6e/dad/d131 0 2024-09-21T08:02:36.222 INFO:tasks.workunit.client.1.smithi129.stdout:7/886: dread - d0/d46/d6e/d9b/da5/db7/f109 zero size 2024-09-21T08:02:36.225 INFO:tasks.workunit.client.1.smithi129.stdout:7/887: truncate d0/f20 7645026 0 2024-09-21T08:02:36.227 INFO:tasks.workunit.client.1.smithi129.stdout:9/662: link d17/d46/fb2 d17/d22/d33/d7a/d89/d90/db1/d31/d5e/d6b/db6/fe1 0 2024-09-21T08:02:36.227 INFO:tasks.workunit.client.1.smithi129.stdout:4/636: sync 2024-09-21T08:02:36.227 INFO:tasks.workunit.client.1.smithi129.stdout:4/637: truncate d5/d33/d66/f68 4696329 0 2024-09-21T08:02:36.227 INFO:tasks.workunit.client.1.smithi129.stdout:7/888: dread d0/d46/dd3/ff2 [0,4194304] 0 2024-09-21T08:02:36.227 INFO:tasks.workunit.client.1.smithi129.stdout:7/889: stat d0/l2a 0 2024-09-21T08:02:36.229 INFO:tasks.workunit.client.1.smithi129.stdout:4/638: getdents d5 0 2024-09-21T08:02:36.229 INFO:tasks.workunit.client.1.smithi129.stdout:4/639: read - d5/d16/d47/d5f/fb4 zero size 2024-09-21T08:02:36.229 INFO:tasks.workunit.client.1.smithi129.stdout:4/640: chown d5/d6/f7f 5425135 1 2024-09-21T08:02:36.229 INFO:tasks.workunit.client.1.smithi129.stdout:4/641: readlink d5/d11/d3f/lc8 0 2024-09-21T08:02:36.229 INFO:tasks.workunit.client.1.smithi129.stdout:4/642: creat d5/d16/fe7 x:0 0 0 2024-09-21T08:02:36.230 INFO:tasks.workunit.client.1.smithi129.stdout:0/696: dwrite de/d15/f1c [0,4194304] 0 2024-09-21T08:02:36.230 INFO:tasks.workunit.client.1.smithi129.stdout:0/697: fsync de/fcd 0 2024-09-21T08:02:36.230 INFO:tasks.workunit.client.1.smithi129.stdout:9/663: getdents d17/d22 0 2024-09-21T08:02:36.232 INFO:tasks.workunit.client.1.smithi129.stdout:4/643: rename d5/d16/d24/d4f/da1/dcf/fe6 to d5/fe8 0 2024-09-21T08:02:36.232 INFO:tasks.workunit.client.1.smithi129.stdout:8/624: read d0/d6/d7/d24/f46 [6430167,17627] 0 2024-09-21T08:02:36.232 INFO:tasks.workunit.client.1.smithi129.stdout:5/782: dwrite d2/d1e/d35/d37/d96/de5/d61/f6e [0,4194304] 0 2024-09-21T08:02:36.234 INFO:tasks.workunit.client.1.smithi129.stdout:1/800: write d1/d9/fc7 [3106463,1172] 0 2024-09-21T08:02:36.234 INFO:tasks.workunit.client.1.smithi129.stdout:1/801: chown d1/d9/d6b/l9c 1278 1 2024-09-21T08:02:36.235 INFO:tasks.workunit.client.1.smithi129.stdout:1/802: chown d1/d44/d83/dcb 10951 1 2024-09-21T08:02:36.241 INFO:tasks.workunit.client.1.smithi129.stdout:5/783: dread d2/f79 [0,4194304] 0 2024-09-21T08:02:36.299 INFO:tasks.workunit.client.1.smithi129.stdout:0/698: creat de/d22/d27/d2f/fe2 x:0 0 0 2024-09-21T08:02:36.300 INFO:tasks.workunit.client.1.smithi129.stdout:9/664: rmdir d17/d22/d33 39 2024-09-21T08:02:36.300 INFO:tasks.workunit.client.1.smithi129.stdout:9/665: write d17/d22/d33/d7a/d89/d90/db1/d31/f91 [1249834,354] 0 2024-09-21T08:02:36.301 INFO:tasks.workunit.client.1.smithi129.stdout:4/644: rmdir d5 39 2024-09-21T08:02:36.301 INFO:tasks.workunit.client.1.smithi129.stdout:4/645: dread - d5/d16/d47/d5f/fb4 zero size 2024-09-21T08:02:36.302 INFO:tasks.workunit.client.1.smithi129.stdout:8/625: creat d0/d6/d7/d18/d27/d32/d37/fba x:0 0 0 2024-09-21T08:02:36.306 INFO:tasks.workunit.client.1.smithi129.stdout:1/803: mkdir d1/d4/d6e/da9/d113 0 2024-09-21T08:02:36.306 INFO:tasks.workunit.client.1.smithi129.stdout:5/784: mknod d2/d1e/d35/d33/d36/cf5 0 2024-09-21T08:02:36.306 INFO:tasks.workunit.client.1.smithi129.stdout:1/804: truncate d1/d16/dd1/fe9 928104 0 2024-09-21T08:02:36.306 INFO:tasks.workunit.client.1.smithi129.stdout:5/785: write d2/d1e/d35/d33/d36/d5a/f5b [1033599,9181] 0 2024-09-21T08:02:36.310 INFO:tasks.workunit.client.1.smithi129.stdout:4/646: unlink d5/d16/d47/d5f/f6b 0 2024-09-21T08:02:36.312 INFO:tasks.workunit.client.1.smithi129.stdout:1/805: mknod d1/d4/dc2/dc6/d7f/d112/c114 0 2024-09-21T08:02:36.312 INFO:tasks.workunit.client.1.smithi129.stdout:1/806: fsync d1/d9/f20 0 2024-09-21T08:02:36.313 INFO:tasks.workunit.client.1.smithi129.stdout:4/647: write d5/d33/fc4 [256806,86988] 0 2024-09-21T08:02:36.313 INFO:tasks.workunit.client.1.smithi129.stdout:4/648: fdatasync d5/d16/fd4 0 2024-09-21T08:02:36.316 INFO:tasks.workunit.client.1.smithi129.stdout:4/649: link d5/d16/d24/d4f/da1/f8f d5/d16/d24/d4f/da1/fe9 0 2024-09-21T08:02:36.319 INFO:tasks.workunit.client.1.smithi129.stdout:4/650: rename d5/d16/d24/d4f/c96 to d5/d11/d77/da8/dbc/cea 0 2024-09-21T08:02:36.319 INFO:tasks.workunit.client.1.smithi129.stdout:4/651: fdatasync d5/f3c 0 2024-09-21T08:02:36.321 INFO:tasks.workunit.client.1.smithi129.stdout:4/652: mknod d5/d11/d77/ceb 0 2024-09-21T08:02:36.331 INFO:tasks.workunit.client.1.smithi129.stdout:7/890: dread d0/d1e/d9a/dca/d100/d90/fb6 [0,4194304] 0 2024-09-21T08:02:36.347 INFO:tasks.workunit.client.1.smithi129.stdout:8/626: dwrite d0/d6/d7/f7e [0,4194304] 0 2024-09-21T08:02:36.359 INFO:tasks.workunit.client.1.smithi129.stdout:5/786: dwrite d2/f60 [0,4194304] 0 2024-09-21T08:02:36.360 INFO:tasks.workunit.client.1.smithi129.stdout:5/787: fdatasync d2/d1e/d35/d37/f9b 0 2024-09-21T08:02:36.360 INFO:tasks.workunit.client.1.smithi129.stdout:0/699: dwrite de/d15/d39/f96 [0,4194304] 0 2024-09-21T08:02:36.368 INFO:tasks.workunit.client.1.smithi129.stdout:7/891: dwrite d0/d46/d6e/d9b/da5/db7/ffc [0,4194304] 0 2024-09-21T08:02:36.368 INFO:tasks.workunit.client.1.smithi129.stdout:7/892: write d0/d46/d6e/dad/df6/f118 [641863,128032] 0 2024-09-21T08:02:36.369 INFO:tasks.workunit.client.1.smithi129.stdout:1/807: dwrite d1/d16/d25/f109 [0,4194304] 0 2024-09-21T08:02:36.370 INFO:tasks.workunit.client.1.smithi129.stdout:8/627: dwrite d0/d6/d7/d18/d27/f39 [0,4194304] 0 2024-09-21T08:02:36.372 INFO:tasks.workunit.client.1.smithi129.stdout:9/666: dwrite d17/d22/d33/d7a/d89/fb4 [0,4194304] 0 2024-09-21T08:02:36.372 INFO:tasks.workunit.client.1.smithi129.stdout:5/788: write d2/d1e/d35/d33/f34 [2893609,102721] 0 2024-09-21T08:02:36.372 INFO:tasks.workunit.client.1.smithi129.stdout:5/789: dread - d2/d2a/fbf zero size 2024-09-21T08:02:36.372 INFO:tasks.workunit.client.1.smithi129.stdout:0/700: dread de/d15/d39/d56/f7d [0,4194304] 0 2024-09-21T08:02:36.372 INFO:tasks.workunit.client.1.smithi129.stdout:0/701: write de/d19/dd9/fdd [418818,59974] 0 2024-09-21T08:02:36.373 INFO:tasks.workunit.client.1.smithi129.stdout:7/893: creat d0/d46/d6e/d9b/da5/db3/f132 x:0 0 0 2024-09-21T08:02:36.375 INFO:tasks.workunit.client.1.smithi129.stdout:3/783: sync 2024-09-21T08:02:36.375 INFO:tasks.workunit.client.1.smithi129.stdout:2/971: sync 2024-09-21T08:02:36.375 INFO:tasks.workunit.client.1.smithi129.stdout:6/663: sync 2024-09-21T08:02:36.375 INFO:tasks.workunit.client.1.smithi129.stdout:1/808: truncate d1/d4/dc2/dc6/f66 592564 0 2024-09-21T08:02:36.375 INFO:tasks.workunit.client.1.smithi129.stdout:1/809: readlink d1/d16/d25/l7b 0 2024-09-21T08:02:36.375 INFO:tasks.workunit.client.1.smithi129.stdout:1/810: getdents d1/d16/d9b/dbf 0 2024-09-21T08:02:36.376 INFO:tasks.workunit.client.1.smithi129.stdout:1/811: dread - d1/d4/d6e/da9/fe3 zero size 2024-09-21T08:02:36.376 INFO:tasks.workunit.client.1.smithi129.stdout:1/812: dread - d1/d9/fbc zero size 2024-09-21T08:02:36.376 INFO:tasks.workunit.client.1.smithi129.stdout:1/813: chown d1/d9/d31/fb7 366357 1 2024-09-21T08:02:36.376 INFO:tasks.workunit.client.1.smithi129.stdout:4/653: link d5/d11/d77/da8/dbc/cea d5/d16/d24/d3b/cec 0 2024-09-21T08:02:36.377 INFO:tasks.workunit.client.1.smithi129.stdout:4/654: readlink d5/d16/d24/l5a 0 2024-09-21T08:02:36.377 INFO:tasks.workunit.client.1.smithi129.stdout:4/655: fdatasync d5/d33/d4e/da7/fe0 0 2024-09-21T08:02:36.378 INFO:tasks.workunit.client.1.smithi129.stdout:8/628: mknod d0/d6/d7/d6c/cbb 0 2024-09-21T08:02:36.378 INFO:tasks.workunit.client.1.smithi129.stdout:8/629: chown d0/d6/d7/d5a/f8a 84887 1 2024-09-21T08:02:36.383 INFO:tasks.workunit.client.1.smithi129.stdout:9/667: unlink d17/d22/d33/d7a/d89/d90/db1/d31/f91 0 2024-09-21T08:02:36.385 INFO:tasks.workunit.client.1.smithi129.stdout:0/702: mknod de/d15/d39/ce3 0 2024-09-21T08:02:36.386 INFO:tasks.workunit.client.1.smithi129.stdout:7/894: rmdir d0/d1e/d9a 39 2024-09-21T08:02:36.387 INFO:tasks.workunit.client.1.smithi129.stdout:7/895: chown d0/d1e/db1 1 1 2024-09-21T08:02:36.387 INFO:tasks.workunit.client.1.smithi129.stdout:7/896: read - d0/d46/d6e/f6d zero size 2024-09-21T08:02:36.387 INFO:tasks.workunit.client.1.smithi129.stdout:7/897: getdents d0/d114 0 2024-09-21T08:02:36.387 INFO:tasks.workunit.client.1.smithi129.stdout:7/898: creat d0/d46/d6e/dad/df6/dfd/f133 x:0 0 0 2024-09-21T08:02:36.388 INFO:tasks.workunit.client.1.smithi129.stdout:3/784: rmdir d3/d69/d95/df8 0 2024-09-21T08:02:36.390 INFO:tasks.workunit.client.1.smithi129.stdout:2/972: creat d1/d13/d32/d11e/f162 x:0 0 0 2024-09-21T08:02:36.390 INFO:tasks.workunit.client.1.smithi129.stdout:2/973: chown d1/d13/d3a/d8f/fd2 1769 1 2024-09-21T08:02:36.390 INFO:tasks.workunit.client.1.smithi129.stdout:6/664: mknod d7/d1b/cdc 0 2024-09-21T08:02:36.391 INFO:tasks.workunit.client.1.smithi129.stdout:8/630: mkdir d0/d6/d7/d5a/dbc 0 2024-09-21T08:02:36.394 INFO:tasks.workunit.client.1.smithi129.stdout:5/790: rmdir d2/d1e/d35/d37/d96 39 2024-09-21T08:02:36.394 INFO:tasks.workunit.client.1.smithi129.stdout:5/791: read d2/f24 [3055800,113764] 0 2024-09-21T08:02:36.394 INFO:tasks.workunit.client.1.smithi129.stdout:7/899: truncate d0/d46/d6e/de4/f103 554869 0 2024-09-21T08:02:36.395 INFO:tasks.workunit.client.1.smithi129.stdout:2/974: mknod d1/d53/d68/db9/c163 0 2024-09-21T08:02:36.396 INFO:tasks.workunit.client.1.smithi129.stdout:6/665: rename d7/d1b/d1e/d66/dba/d35/ld4 to d7/d1b/d1e/d66/dc2/ldd 0 2024-09-21T08:02:36.397 INFO:tasks.workunit.client.1.smithi129.stdout:8/631: symlink d0/d6/d7/d5a/dbc/lbd 0 2024-09-21T08:02:36.397 INFO:tasks.workunit.client.1.smithi129.stdout:8/632: readlink d0/d6/d7/d18/d61/lab 0 2024-09-21T08:02:36.398 INFO:tasks.workunit.client.1.smithi129.stdout:5/792: symlink d2/d1e/d35/d33/dca/lf6 0 2024-09-21T08:02:36.398 INFO:tasks.workunit.client.1.smithi129.stdout:0/703: getdents de/d15/d44/d4b 0 2024-09-21T08:02:36.398 INFO:tasks.workunit.client.1.smithi129.stdout:3/785: rmdir d3/da/dc/da3 39 2024-09-21T08:02:36.399 INFO:tasks.workunit.client.1.smithi129.stdout:9/668: read d17/d22/d33/d7a/d89/d90/db1/d31/d35/f50 [1920173,114568] 0 2024-09-21T08:02:36.399 INFO:tasks.workunit.client.1.smithi129.stdout:6/666: creat d7/d1b/d57/dd6/fde x:0 0 0 2024-09-21T08:02:36.403 INFO:tasks.workunit.client.1.smithi129.stdout:4/656: dwrite d5/d11/d77/f7e [0,4194304] 0 2024-09-21T08:02:36.403 INFO:tasks.workunit.client.1.smithi129.stdout:4/657: fdatasync d5/d11/d77/fe3 0 2024-09-21T08:02:36.403 INFO:tasks.workunit.client.1.smithi129.stdout:4/658: readlink d5/d16/d85/lc5 0 2024-09-21T08:02:36.403 INFO:tasks.workunit.client.1.smithi129.stdout:0/704: link de/f36 de/d19/d5e/fe4 0 2024-09-21T08:02:36.403 INFO:tasks.workunit.client.1.smithi129.stdout:1/814: dwrite d1/d16/d57/fa1 [0,4194304] 0 2024-09-21T08:02:36.404 INFO:tasks.workunit.client.1.smithi129.stdout:3/786: truncate d3/d90/fd3 510417 0 2024-09-21T08:02:36.407 INFO:tasks.workunit.client.1.smithi129.stdout:6/667: unlink d7/d1b/d57/d96/fa4 0 2024-09-21T08:02:36.408 INFO:tasks.workunit.client.1.smithi129.stdout:4/659: mknod d5/d16/ced 0 2024-09-21T08:02:36.409 INFO:tasks.workunit.client.1.smithi129.stdout:0/705: truncate de/f13 972128 0 2024-09-21T08:02:36.410 INFO:tasks.workunit.client.1.smithi129.stdout:0/706: read de/d15/d51/f5d [312952,24022] 0 2024-09-21T08:02:36.410 INFO:tasks.workunit.client.1.smithi129.stdout:0/707: creat de/d22/d27/d85/db2/dc3/fe5 x:0 0 0 2024-09-21T08:02:36.413 INFO:tasks.workunit.client.1.smithi129.stdout:3/787: mknod d3/da/c117 0 2024-09-21T08:02:36.421 INFO:tasks.workunit.client.1.smithi129.stdout:0/708: unlink de/d19/dad/cbc 0 2024-09-21T08:02:36.422 INFO:tasks.workunit.client.1.smithi129.stdout:8/633: getdents d0/d6/d7/d5a 0 2024-09-21T08:02:36.422 INFO:tasks.workunit.client.1.smithi129.stdout:8/634: chown d0/f3f 1050 1 2024-09-21T08:02:36.426 INFO:tasks.workunit.client.1.smithi129.stdout:8/635: creat d0/d6/d7/d9/fbe x:0 0 0 2024-09-21T08:02:36.426 INFO:tasks.workunit.client.1.smithi129.stdout:8/636: chown d0/d6/d7/d18/d27/d60/d85/f99 971455 1 2024-09-21T08:02:36.426 INFO:tasks.workunit.client.1.smithi129.stdout:4/660: write d5/d11/f57 [1528934,46517] 0 2024-09-21T08:02:36.428 INFO:tasks.workunit.client.1.smithi129.stdout:0/709: dread de/d15/d39/d56/f7d [0,4194304] 0 2024-09-21T08:02:36.428 INFO:tasks.workunit.client.1.smithi129.stdout:0/710: truncate de/f12 5320640 0 2024-09-21T08:02:36.428 INFO:tasks.workunit.client.1.smithi129.stdout:0/711: dread - de/f64 zero size 2024-09-21T08:02:36.428 INFO:tasks.workunit.client.1.smithi129.stdout:8/637: dread d0/d6/d7/d18/d27/f90 [0,4194304] 0 2024-09-21T08:02:36.428 INFO:tasks.workunit.client.1.smithi129.stdout:0/712: creat de/d81/fe6 x:0 0 0 2024-09-21T08:02:36.428 INFO:tasks.workunit.client.1.smithi129.stdout:8/638: truncate d0/d6/d7/d18/d27/d32/f5b 1209469 0 2024-09-21T08:02:36.429 INFO:tasks.workunit.client.1.smithi129.stdout:4/661: mknod d5/d33/cee 0 2024-09-21T08:02:36.430 INFO:tasks.workunit.client.1.smithi129.stdout:0/713: truncate de/d81/f8d 287974 0 2024-09-21T08:02:36.431 INFO:tasks.workunit.client.1.smithi129.stdout:4/662: creat d5/d16/d24/d4f/da1/fef x:0 0 0 2024-09-21T08:02:36.433 INFO:tasks.workunit.client.1.smithi129.stdout:0/714: rename de/d1f/da9/l32 to de/d81/d94/le7 0 2024-09-21T08:02:36.434 INFO:tasks.workunit.client.1.smithi129.stdout:0/715: creat de/d22/d27/fe8 x:0 0 0 2024-09-21T08:02:36.441 INFO:tasks.workunit.client.1.smithi129.stdout:0/716: write de/f3c [205517,99443] 0 2024-09-21T08:02:36.441 INFO:tasks.workunit.client.1.smithi129.stdout:2/975: dwrite d1/d13/d32/d11e/f162 [0,4194304] 0 2024-09-21T08:02:36.441 INFO:tasks.workunit.client.1.smithi129.stdout:2/976: write d1/d13/d32/d7c/ffc [978723,106907] 0 2024-09-21T08:02:36.442 INFO:tasks.workunit.client.1.smithi129.stdout:7/900: dwrite d0/d1e/db1/dc7/f12c [0,4194304] 0 2024-09-21T08:02:36.442 INFO:tasks.workunit.client.1.smithi129.stdout:7/901: truncate d0/d46/d6e/d9b/da5/db3/f132 666609 0 2024-09-21T08:02:36.443 INFO:tasks.workunit.client.1.smithi129.stdout:0/717: symlink de/d19/dd9/le9 0 2024-09-21T08:02:36.445 INFO:tasks.workunit.client.1.smithi129.stdout:4/663: dread d5/d16/d47/fab [4194304,4194304] 0 2024-09-21T08:02:36.445 INFO:tasks.workunit.client.1.smithi129.stdout:9/669: dwrite f0 [0,4194304] 0 2024-09-21T08:02:36.446 INFO:tasks.workunit.client.1.smithi129.stdout:7/902: rename d0/d46/d6e/d9b/da5/db3/fbb to d0/d46/d6e/d9b/da5/f134 0 2024-09-21T08:02:36.446 INFO:tasks.workunit.client.1.smithi129.stdout:7/903: truncate d0/f25 1264597 0 2024-09-21T08:02:36.446 INFO:tasks.workunit.client.1.smithi129.stdout:2/977: dread d1/d13/d32/f3b [0,4194304] 0 2024-09-21T08:02:36.447 INFO:tasks.workunit.client.1.smithi129.stdout:7/904: mknod d0/d46/d6e/dad/df6/c135 0 2024-09-21T08:02:36.448 INFO:tasks.workunit.client.1.smithi129.stdout:7/905: mkdir d0/d46/d6e/d9b/da5/d136 0 2024-09-21T08:02:36.448 INFO:tasks.workunit.client.1.smithi129.stdout:5/793: dwrite d2/d1e/d6b/f66 [0,4194304] 0 2024-09-21T08:02:36.450 INFO:tasks.workunit.client.1.smithi129.stdout:7/906: mkdir d0/d46/d6e/d9b/d137 0 2024-09-21T08:02:36.451 INFO:tasks.workunit.client.1.smithi129.stdout:3/788: dwrite d3/d57/da2/fee [0,4194304] 0 2024-09-21T08:02:36.453 INFO:tasks.workunit.client.1.smithi129.stdout:7/907: link d0/d1e/f55 d0/d1e/d9a/dca/f138 0 2024-09-21T08:02:36.454 INFO:tasks.workunit.client.1.smithi129.stdout:9/670: dread d17/d22/d33/d36/d48/d75/fb0 [0,4194304] 0 2024-09-21T08:02:36.454 INFO:tasks.workunit.client.1.smithi129.stdout:9/671: readlink d17/d22/d33/d36/d48/d3f/d53/lbf 0 2024-09-21T08:02:36.454 INFO:tasks.workunit.client.1.smithi129.stdout:9/672: chown d17/d22/d33/d36/d48/d3f/f69 7488 1 2024-09-21T08:02:36.454 INFO:tasks.workunit.client.1.smithi129.stdout:9/673: write d17/f49 [4595586,62992] 0 2024-09-21T08:02:36.454 INFO:tasks.workunit.client.1.smithi129.stdout:9/674: creat d17/d22/d33/d36/d48/db7/fe2 x:0 0 0 2024-09-21T08:02:36.456 INFO:tasks.workunit.client.1.smithi129.stdout:9/675: readlink d17/d22/d33/d7a/d89/d90/db1/d31/d35/l4c 0 2024-09-21T08:02:36.456 INFO:tasks.workunit.client.1.smithi129.stdout:9/676: chown d17/d22/d33/d7a/d89/fb4 0 1 2024-09-21T08:02:36.457 INFO:tasks.workunit.client.1.smithi129.stdout:6/668: dwrite d7/d1b/d1e/d66/dba/d2b/f3c [0,4194304] 0 2024-09-21T08:02:36.457 INFO:tasks.workunit.client.1.smithi129.stdout:6/669: write d7/d1b/d1e/d39/d79/fce [1083792,124978] 0 2024-09-21T08:02:36.460 INFO:tasks.workunit.client.1.smithi129.stdout:6/670: symlink d7/d4a/d69/ldf 0 2024-09-21T08:02:36.460 INFO:tasks.workunit.client.1.smithi129.stdout:0/718: dread de/d15/f59 [0,4194304] 0 2024-09-21T08:02:36.463 INFO:tasks.workunit.client.1.smithi129.stdout:5/794: dread d2/d1e/d35/f2d [0,4194304] 0 2024-09-21T08:02:36.463 INFO:tasks.workunit.client.1.smithi129.stdout:4/664: dwrite d5/f14 [4194304,4194304] 0 2024-09-21T08:02:36.464 INFO:tasks.workunit.client.1.smithi129.stdout:4/665: dread - d5/d11/d77/fe3 zero size 2024-09-21T08:02:36.464 INFO:tasks.workunit.client.1.smithi129.stdout:6/671: creat d7/d1b/d1e/d66/dba/d2b/db6/fe0 x:0 0 0 2024-09-21T08:02:36.466 INFO:tasks.workunit.client.1.smithi129.stdout:2/978: read d1/d13/d32/f87 [2464090,100348] 0 2024-09-21T08:02:36.466 INFO:tasks.workunit.client.1.smithi129.stdout:8/639: dwrite d0/d6/d7/d18/d27/f38 [4194304,4194304] 0 2024-09-21T08:02:36.466 INFO:tasks.workunit.client.1.smithi129.stdout:5/795: creat d2/d1e/d35/d33/db9/ff7 x:0 0 0 2024-09-21T08:02:36.475 INFO:tasks.workunit.client.1.smithi129.stdout:4/666: write d5/d16/d24/d4f/f54 [1666655,78679] 0 2024-09-21T08:02:36.476 INFO:tasks.workunit.client.1.smithi129.stdout:6/672: dread d7/f9 [4194304,4194304] 0 2024-09-21T08:02:36.476 INFO:tasks.workunit.client.1.smithi129.stdout:6/673: write d7/d1b/d1e/d39/f4c [5753811,53188] 0 2024-09-21T08:02:36.476 INFO:tasks.workunit.client.1.smithi129.stdout:6/674: chown d7/d4a/d69/d89 819 1 2024-09-21T08:02:36.478 INFO:tasks.workunit.client.1.smithi129.stdout:9/677: dread d17/d22/faf [0,4194304] 0 2024-09-21T08:02:36.482 INFO:tasks.workunit.client.1.smithi129.stdout:2/979: symlink d1/d13/d3a/dc1/l164 0 2024-09-21T08:02:36.484 INFO:tasks.workunit.client.1.smithi129.stdout:8/640: mkdir d0/d6/d7/d18/d27/d32/d3d/d7b/dbf 0 2024-09-21T08:02:36.485 INFO:tasks.workunit.client.1.smithi129.stdout:7/908: dwrite d0/d1e/d9a/dca/d100/d90/f97 [0,4194304] 0 2024-09-21T08:02:36.487 INFO:tasks.workunit.client.1.smithi129.stdout:4/667: mkdir d5/d33/d6d/df0 0 2024-09-21T08:02:36.488 INFO:tasks.workunit.client.1.smithi129.stdout:2/980: mknod d1/d13/d32/d11e/c165 0 2024-09-21T08:02:36.489 INFO:tasks.workunit.client.1.smithi129.stdout:8/641: mkdir d0/d6/d7/d6c/dc0 0 2024-09-21T08:02:36.489 INFO:tasks.workunit.client.1.smithi129.stdout:8/642: write d0/d6/d7/d18/d27/d32/d3d/d83/f87 [1193440,76694] 0 2024-09-21T08:02:36.490 INFO:tasks.workunit.client.1.smithi129.stdout:0/719: dwrite de/d19/d5e/dc1/fe0 [0,4194304] 0 2024-09-21T08:02:36.492 INFO:tasks.workunit.client.1.smithi129.stdout:7/909: unlink d0/d1e/d9a/d9f/f127 0 2024-09-21T08:02:36.492 INFO:tasks.workunit.client.1.smithi129.stdout:7/910: write d0/d1e/d9a/dca/d100/d90/fb6 [6870915,120752] 0 2024-09-21T08:02:36.492 INFO:tasks.workunit.client.1.smithi129.stdout:9/678: dwrite d17/d22/d33/d7a/d89/d90/db1/d31/d35/f54 [0,4194304] 0 2024-09-21T08:02:36.493 INFO:tasks.workunit.client.1.smithi129.stdout:5/796: truncate d2/d1e/d6b/f66 1148499 0 2024-09-21T08:02:36.493 INFO:tasks.workunit.client.1.smithi129.stdout:5/797: readlink d2/d1e/d35/d33/dca/ld0 0 2024-09-21T08:02:36.495 INFO:tasks.workunit.client.1.smithi129.stdout:4/668: dread d5/d11/d3f/d50/fa4 [0,4194304] 0 2024-09-21T08:02:36.495 INFO:tasks.workunit.client.1.smithi129.stdout:4/669: stat d5/d16/d24/d4f/da1/ld5 0 2024-09-21T08:02:36.495 INFO:tasks.workunit.client.1.smithi129.stdout:4/670: dread - d5/da5/fd9 zero size 2024-09-21T08:02:36.495 INFO:tasks.workunit.client.1.smithi129.stdout:4/671: creat d5/da5/ff1 x:0 0 0 2024-09-21T08:02:36.495 INFO:tasks.workunit.client.1.smithi129.stdout:6/675: rename d7/c26 to d7/d1b/d8d/ce1 0 2024-09-21T08:02:36.495 INFO:tasks.workunit.client.1.smithi129.stdout:8/643: symlink d0/d6/d7/d18/d27/d32/d3d/d83/lc1 0 2024-09-21T08:02:36.496 INFO:tasks.workunit.client.1.smithi129.stdout:8/644: fsync d0/d6/d7/f21 0 2024-09-21T08:02:36.498 INFO:tasks.workunit.client.1.smithi129.stdout:0/720: symlink de/d15/d39/d9e/lea 0 2024-09-21T08:02:36.498 INFO:tasks.workunit.client.1.smithi129.stdout:0/721: chown de/d19/d5e/fbb 64778 1 2024-09-21T08:02:36.498 INFO:tasks.workunit.client.1.smithi129.stdout:0/722: chown de/d81/d94/lc6 121 1 2024-09-21T08:02:36.498 INFO:tasks.workunit.client.1.smithi129.stdout:0/723: stat de/d15/d51/f5d 0 2024-09-21T08:02:36.502 INFO:tasks.workunit.client.1.smithi129.stdout:9/679: link d17/d22/d33/d36/c47 d17/d55/dd1/ce3 0 2024-09-21T08:02:36.505 INFO:tasks.workunit.client.1.smithi129.stdout:5/798: creat d2/d1e/d35/d37/d96/de5/db1/ff8 x:0 0 0 2024-09-21T08:02:36.507 INFO:tasks.workunit.client.1.smithi129.stdout:4/672: truncate d5/f7a 4120746 0 2024-09-21T08:02:36.507 INFO:tasks.workunit.client.1.smithi129.stdout:4/673: chown d5/d33/d4e/lb6 1931 1 2024-09-21T08:02:36.509 INFO:tasks.workunit.client.1.smithi129.stdout:7/911: getdents d0/d1e/d9a/dca/de8 0 2024-09-21T08:02:36.511 INFO:tasks.workunit.client.1.smithi129.stdout:9/680: mkdir d17/d22/d33/d36/de4 0 2024-09-21T08:02:36.512 INFO:tasks.workunit.client.1.smithi129.stdout:5/799: creat d2/d1e/d35/d37/d65/dc5/ff9 x:0 0 0 2024-09-21T08:02:36.512 INFO:tasks.workunit.client.1.smithi129.stdout:5/800: chown d2/d1e/d35/l64 9436732 1 2024-09-21T08:02:36.512 INFO:tasks.workunit.client.1.smithi129.stdout:5/801: write d2/d1e/d35/f31 [2123697,96307] 0 2024-09-21T08:02:36.512 INFO:tasks.workunit.client.1.smithi129.stdout:5/802: dread - d2/d1e/d35/d37/d65/fce zero size 2024-09-21T08:02:36.516 INFO:tasks.workunit.client.1.smithi129.stdout:9/681: write d17/d22/d33/f9f [577094,128398] 0 2024-09-21T08:02:36.516 INFO:tasks.workunit.client.1.smithi129.stdout:6/676: rename d7/d1b/d1e/d66/dba/d35 to d7/d1b/d1e/d66/dc2/de2 0 2024-09-21T08:02:36.517 INFO:tasks.workunit.client.1.smithi129.stdout:6/677: chown d7/d1b/d1e/d66/dba 792782 1 2024-09-21T08:02:36.517 INFO:tasks.workunit.client.1.smithi129.stdout:9/682: getdents d17/d22/d33/d36/d48/d3f/d71 0 2024-09-21T08:02:36.518 INFO:tasks.workunit.client.1.smithi129.stdout:9/683: fdatasync f0 0 2024-09-21T08:02:36.518 INFO:tasks.workunit.client.1.smithi129.stdout:9/684: chown d17/d22/d33/d7a/d89/d90/db1/d31/d5e/d6b/l6c 1 1 2024-09-21T08:02:36.518 INFO:tasks.workunit.client.1.smithi129.stdout:9/685: write d17/d22/d33/d36/d48/d3f/d53/f7e [83887,71835] 0 2024-09-21T08:02:36.519 INFO:tasks.workunit.client.1.smithi129.stdout:6/678: creat d7/d1b/d1e/fe3 x:0 0 0 2024-09-21T08:02:36.520 INFO:tasks.workunit.client.1.smithi129.stdout:9/686: mknod d17/d22/d33/d36/d48/db7/dc9/ce5 0 2024-09-21T08:02:36.521 INFO:tasks.workunit.client.1.smithi129.stdout:6/679: mknod d7/d1b/d1e/d66/dc2/d5e/ce4 0 2024-09-21T08:02:36.524 INFO:tasks.workunit.client.1.smithi129.stdout:6/680: mkdir d7/d1b/d1e/d39/d4b/d6e/de5 0 2024-09-21T08:02:36.524 INFO:tasks.workunit.client.1.smithi129.stdout:6/681: write d7/d1b/d1e/d66/dba/fbb [1502036,106465] 0 2024-09-21T08:02:36.525 INFO:tasks.workunit.client.1.smithi129.stdout:8/645: dwrite d0/d6/d7/d18/d27/d32/d70/f8c [0,4194304] 0 2024-09-21T08:02:36.526 INFO:tasks.workunit.client.1.smithi129.stdout:9/687: mkdir d17/d22/d33/de6 0 2024-09-21T08:02:36.540 INFO:tasks.workunit.client.1.smithi129.stdout:6/682: read d7/f37 [3729176,8032] 0 2024-09-21T08:02:36.541 INFO:tasks.workunit.client.1.smithi129.stdout:4/674: dwrite d5/d33/fc9 [0,4194304] 0 2024-09-21T08:02:36.541 INFO:tasks.workunit.client.1.smithi129.stdout:4/675: write d5/d33/d4e/f76 [252618,12638] 0 2024-09-21T08:02:36.541 INFO:tasks.workunit.client.1.smithi129.stdout:4/676: chown d5/d16/f29 6497774 1 2024-09-21T08:02:36.543 INFO:tasks.workunit.client.1.smithi129.stdout:4/677: mkdir d5/d33/df2 0 2024-09-21T08:02:36.543 INFO:tasks.workunit.client.1.smithi129.stdout:4/678: fdatasync d5/d16/d47/d5f/d64/fc0 0 2024-09-21T08:02:36.552 INFO:tasks.workunit.client.1.smithi129.stdout:0/724: dwrite de/d15/d39/d9e/dac/dba/dc0/fcb [4194304,4194304] 0 2024-09-21T08:02:36.552 INFO:tasks.workunit.client.1.smithi129.stdout:5/803: dwrite d2/d1e/d35/d37/d96/de5/db1/ff8 [0,4194304] 0 2024-09-21T08:02:36.555 INFO:tasks.workunit.client.1.smithi129.stdout:7/912: dwrite d0/d1e/d9a/dca/d100/d90/fab [0,4194304] 0 2024-09-21T08:02:36.556 INFO:tasks.workunit.client.1.smithi129.stdout:9/688: dwrite d17/d22/f30 [0,4194304] 0 2024-09-21T08:02:36.556 INFO:tasks.workunit.client.1.smithi129.stdout:5/804: creat d2/d1e/d35/d37/d96/de5/db1/de7/ffa x:0 0 0 2024-09-21T08:02:36.557 INFO:tasks.workunit.client.1.smithi129.stdout:0/725: dread de/d22/d27/d2f/f8e [0,4194304] 0 2024-09-21T08:02:36.557 INFO:tasks.workunit.client.1.smithi129.stdout:8/646: dwrite d0/d6/d7/d9/f7d [0,4194304] 0 2024-09-21T08:02:36.557 INFO:tasks.workunit.client.1.smithi129.stdout:0/726: fdatasync de/d15/f43 0 2024-09-21T08:02:36.559 INFO:tasks.workunit.client.1.smithi129.stdout:7/913: symlink d0/d1e/db1/d122/l139 0 2024-09-21T08:02:36.559 INFO:tasks.workunit.client.1.smithi129.stdout:7/914: creat d0/d1e/d9a/dca/d100/d90/f13a x:0 0 0 2024-09-21T08:02:36.559 INFO:tasks.workunit.client.1.smithi129.stdout:7/915: fsync d0/d1e/f21 0 2024-09-21T08:02:36.559 INFO:tasks.workunit.client.1.smithi129.stdout:9/689: mkdir d17/d23/de7 0 2024-09-21T08:02:36.560 INFO:tasks.workunit.client.1.smithi129.stdout:5/805: mknod d2/d1e/d35/d33/dca/cfb 0 2024-09-21T08:02:36.567 INFO:tasks.workunit.client.1.smithi129.stdout:8/647: unlink d0/d6/d7/f40 0 2024-09-21T08:02:36.568 INFO:tasks.workunit.client.1.smithi129.stdout:0/727: symlink de/d15/d87/leb 0 2024-09-21T08:02:36.569 INFO:tasks.workunit.client.1.smithi129.stdout:8/648: dread d0/f11 [0,4194304] 0 2024-09-21T08:02:36.569 INFO:tasks.workunit.client.1.smithi129.stdout:7/916: rmdir d0/d1e/d9a/dca/d100/d90/dd2/dee 39 2024-09-21T08:02:36.569 INFO:tasks.workunit.client.1.smithi129.stdout:0/728: dread de/d81/f8d [0,4194304] 0 2024-09-21T08:02:36.570 INFO:tasks.workunit.client.1.smithi129.stdout:5/806: unlink d2/d1e/d35/d37/d96/de5/db1/de7/ffa 0 2024-09-21T08:02:36.571 INFO:tasks.workunit.client.1.smithi129.stdout:5/807: readlink d2/d1e/d35/d37/d96/de5/db1/d71/da9/lef 0 2024-09-21T08:02:36.571 INFO:tasks.workunit.client.1.smithi129.stdout:5/808: write d2/d2a/f2e [1746993,88431] 0 2024-09-21T08:02:36.571 INFO:tasks.workunit.client.1.smithi129.stdout:5/809: creat d2/d1e/d35/d37/d96/de5/db1/de7/ffc x:0 0 0 2024-09-21T08:02:36.571 INFO:tasks.workunit.client.1.smithi129.stdout:4/679: rename d5/f7a to d5/d16/d24/d4f/ff3 0 2024-09-21T08:02:36.575 INFO:tasks.workunit.client.1.smithi129.stdout:5/810: mkdir d2/d1e/d35/d37/d65/dc5/dfd 0 2024-09-21T08:02:36.577 INFO:tasks.workunit.client.1.smithi129.stdout:4/680: mkdir d5/df4 0 2024-09-21T08:02:36.578 INFO:tasks.workunit.client.1.smithi129.stdout:8/649: getdents d0/d6/d7/d5d 0 2024-09-21T08:02:36.578 INFO:tasks.workunit.client.1.smithi129.stdout:8/650: readlink d0/d6/d7/d5a/dbc/lbd 0 2024-09-21T08:02:36.578 INFO:tasks.workunit.client.1.smithi129.stdout:0/729: write de/d15/d39/d56/f63 [1607663,107302] 0 2024-09-21T08:02:36.580 INFO:tasks.workunit.client.1.smithi129.stdout:5/811: rename d2/d1e/d35/d37/d96/de5/l5d to d2/d1e/d35/d37/d96/de5/db1/d71/da9/lfe 0 2024-09-21T08:02:36.581 INFO:tasks.workunit.client.1.smithi129.stdout:4/681: creat d5/da5/db1/ff5 x:0 0 0 2024-09-21T08:02:36.581 INFO:tasks.workunit.client.1.smithi129.stdout:4/682: write d5/d33/d66/fdd [972836,12519] 0 2024-09-21T08:02:36.582 INFO:tasks.workunit.client.1.smithi129.stdout:8/651: symlink d0/d6/d7/d9/d94/lc2 0 2024-09-21T08:02:36.582 INFO:tasks.workunit.client.1.smithi129.stdout:8/652: fsync d0/d6/d7/d18/d27/d32/f91 0 2024-09-21T08:02:36.584 INFO:tasks.workunit.client.1.smithi129.stdout:0/730: mknod de/d22/d27/d2f/d42/cec 0 2024-09-21T08:02:36.585 INFO:tasks.workunit.client.1.smithi129.stdout:5/812: mknod d2/d1e/d35/d37/d65/cff 0 2024-09-21T08:02:36.587 INFO:tasks.workunit.client.1.smithi129.stdout:0/731: creat de/d1f/dd4/fed x:0 0 0 2024-09-21T08:02:36.588 INFO:tasks.workunit.client.1.smithi129.stdout:0/732: write de/d15/d39/d56/f9d [1314202,100208] 0 2024-09-21T08:02:36.589 INFO:tasks.workunit.client.1.smithi129.stdout:5/813: creat d2/f100 x:0 0 0 2024-09-21T08:02:36.590 INFO:tasks.workunit.client.1.smithi129.stdout:4/683: rmdir d5/d16/d47/d5f 39 2024-09-21T08:02:36.592 INFO:tasks.workunit.client.1.smithi129.stdout:4/684: symlink d5/d33/d6d/df0/lf6 0 2024-09-21T08:02:36.592 INFO:tasks.workunit.client.1.smithi129.stdout:4/685: fsync d5/d11/f57 0 2024-09-21T08:02:36.594 INFO:tasks.workunit.client.1.smithi129.stdout:7/917: rmdir d0/d1e/d9a/dca/d100/d90 39 2024-09-21T08:02:36.596 INFO:tasks.workunit.client.1.smithi129.stdout:8/653: dwrite d0/d6/d7/d9/d94/fb5 [0,4194304] 0 2024-09-21T08:02:36.596 INFO:tasks.workunit.client.1.smithi129.stdout:7/918: link d0/c7c d0/d46/d6e/d9b/c13b 0 2024-09-21T08:02:36.597 INFO:tasks.workunit.client.1.smithi129.stdout:1/815: sync 2024-09-21T08:02:36.606 INFO:tasks.workunit.client.1.smithi129.stdout:8/654: truncate d0/d6/d7/d18/d27/d32/d3d/d83/f87 955210 0 2024-09-21T08:02:36.607 INFO:tasks.workunit.client.1.smithi129.stdout:7/919: mkdir d0/d1e/d9a/d9f/d13c 0 2024-09-21T08:02:36.608 INFO:tasks.workunit.client.1.smithi129.stdout:1/816: truncate d1/d16/d28/ff2 2820829 0 2024-09-21T08:02:36.608 INFO:tasks.workunit.client.1.smithi129.stdout:1/817: chown d1/d16/fcd 9415 1 2024-09-21T08:02:36.608 INFO:tasks.workunit.client.1.smithi129.stdout:1/818: write d1/d16/d28/f33 [4161373,18766] 0 2024-09-21T08:02:36.609 INFO:tasks.workunit.client.1.smithi129.stdout:7/920: symlink d0/d114/l13d 0 2024-09-21T08:02:36.610 INFO:tasks.workunit.client.1.smithi129.stdout:1/819: rmdir d1/d16/db3 39 2024-09-21T08:02:36.611 INFO:tasks.workunit.client.1.smithi129.stdout:7/921: link d0/l5b d0/d1e/db1/l13e 0 2024-09-21T08:02:36.612 INFO:tasks.workunit.client.1.smithi129.stdout:7/922: write d0/f16 [1930334,120606] 0 2024-09-21T08:02:36.612 INFO:tasks.workunit.client.1.smithi129.stdout:7/923: read - d0/d1e/f10d zero size 2024-09-21T08:02:36.612 INFO:tasks.workunit.client.1.smithi129.stdout:1/820: mknod d1/d16/d9b/dbf/c115 0 2024-09-21T08:02:36.613 INFO:tasks.workunit.client.1.smithi129.stdout:1/821: truncate d1/d4/dc2/dc6/d7f/fde 3396991 0 2024-09-21T08:02:36.613 INFO:tasks.workunit.client.1.smithi129.stdout:1/822: readlink d1/d4/d96/l9a 0 2024-09-21T08:02:36.624 INFO:tasks.workunit.client.1.smithi129.stdout:8/655: dread d0/d6/d7/d9/f12 [0,4194304] 0 2024-09-21T08:02:36.624 INFO:tasks.workunit.client.1.smithi129.stdout:8/656: chown d0/d6/d7/d5a/cb4 695795304 1 2024-09-21T08:02:36.625 INFO:tasks.workunit.client.1.smithi129.stdout:1/823: getdents d1/d44/d83/dcb 0 2024-09-21T08:02:36.626 INFO:tasks.workunit.client.1.smithi129.stdout:0/733: dwrite de/d22/d27/d2f/d42/f77 [4194304,4194304] 0 2024-09-21T08:02:36.626 INFO:tasks.workunit.client.1.smithi129.stdout:7/924: write d0/f43 [1263617,104136] 0 2024-09-21T08:02:36.627 INFO:tasks.workunit.client.1.smithi129.stdout:4/686: dwrite d5/d11/d77/f7e [0,4194304] 0 2024-09-21T08:02:36.627 INFO:tasks.workunit.client.1.smithi129.stdout:1/824: link d1/d9/d31/f68 d1/d16/db3/f116 0 2024-09-21T08:02:36.627 INFO:tasks.workunit.client.1.smithi129.stdout:1/825: chown d1/d16/d25/l7b 29 1 2024-09-21T08:02:36.628 INFO:tasks.workunit.client.1.smithi129.stdout:5/814: dwrite d2/d1e/d35/d37/d96/de5/db1/ff8 [0,4194304] 0 2024-09-21T08:02:36.628 INFO:tasks.workunit.client.1.smithi129.stdout:8/657: getdents d0/d6/d7 0 2024-09-21T08:02:36.629 INFO:tasks.workunit.client.1.smithi129.stdout:0/734: mknod de/d15/d39/d9e/cee 0 2024-09-21T08:02:36.631 INFO:tasks.workunit.client.1.smithi129.stdout:4/687: mknod d5/da5/cf7 0 2024-09-21T08:02:36.631 INFO:tasks.workunit.client.1.smithi129.stdout:1/826: mknod d1/d44/db9/c117 0 2024-09-21T08:02:36.633 INFO:tasks.workunit.client.1.smithi129.stdout:8/658: truncate d0/d6/d7/d5a/f8a 659610 0 2024-09-21T08:02:36.634 INFO:tasks.workunit.client.1.smithi129.stdout:4/688: mknod d5/df4/cf8 0 2024-09-21T08:02:36.635 INFO:tasks.workunit.client.1.smithi129.stdout:4/689: write d5/d6/f7f [713731,101067] 0 2024-09-21T08:02:36.635 INFO:tasks.workunit.client.1.smithi129.stdout:4/690: chown d5/d16/d24/d4f/f54 382 1 2024-09-21T08:02:36.635 INFO:tasks.workunit.client.1.smithi129.stdout:1/827: mkdir d1/d44/d83/d118 0 2024-09-21T08:02:36.638 INFO:tasks.workunit.client.1.smithi129.stdout:1/828: rmdir d1/d7a/da4/d107 39 2024-09-21T08:02:36.638 INFO:tasks.workunit.client.1.smithi129.stdout:1/829: fdatasync d1/d16/dd1/fe9 0 2024-09-21T08:02:36.644 INFO:tasks.workunit.client.1.smithi129.stdout:5/815: write d2/f1b [428879,14416] 0 2024-09-21T08:02:36.654 INFO:tasks.workunit.client.1.smithi129.stdout:8/659: dread d0/d6/d7/d9/d94/fb5 [0,4194304] 0 2024-09-21T08:02:36.654 INFO:tasks.workunit.client.1.smithi129.stdout:0/735: dwrite de/d15/f3d [0,4194304] 0 2024-09-21T08:02:36.691 INFO:tasks.workunit.client.1.smithi129.stdout:5/816: dwrite d2/d1e/d35/d37/d96/de5/d61/f6e [0,4194304] 0 2024-09-21T08:02:36.692 INFO:tasks.workunit.client.1.smithi129.stdout:5/817: chown d2/d2a/fb0 1659271 1 2024-09-21T08:02:36.692 INFO:tasks.workunit.client.1.smithi129.stdout:5/818: fdatasync d2/d1e/d35/d37/d96/de5/d61/fb3 0 2024-09-21T08:02:36.692 INFO:tasks.workunit.client.1.smithi129.stdout:1/830: dwrite d1/d4/dc2/dc6/fca [0,4194304] 0 2024-09-21T08:02:36.692 INFO:tasks.workunit.client.1.smithi129.stdout:4/691: dwrite d5/d33/fc4 [0,4194304] 0 2024-09-21T08:02:36.692 INFO:tasks.workunit.client.1.smithi129.stdout:1/831: read d1/d44/db9/fc9 [236083,65376] 0 2024-09-21T08:02:36.692 INFO:tasks.workunit.client.1.smithi129.stdout:8/660: dwrite d0/d6/d7/d24/f35 [0,4194304] 0 2024-09-21T08:02:36.693 INFO:tasks.workunit.client.1.smithi129.stdout:0/736: dwrite de/d15/d44/d4b/f58 [0,4194304] 0 2024-09-21T08:02:36.694 INFO:tasks.workunit.client.1.smithi129.stdout:5/819: symlink d2/d1e/d35/d33/d36/d5a/d77/l101 0 2024-09-21T08:02:36.696 INFO:tasks.workunit.client.1.smithi129.stdout:4/692: truncate d5/d6/f30 2706130 0 2024-09-21T08:02:36.696 INFO:tasks.workunit.client.1.smithi129.stdout:4/693: write d5/d16/d24/d4f/da1/fe9 [4700680,89133] 0 2024-09-21T08:02:36.702 INFO:tasks.workunit.client.1.smithi129.stdout:5/820: getdents d2/d1e/d35/d37/d96/de5/db1/d71/da9 0 2024-09-21T08:02:36.705 INFO:tasks.workunit.client.1.smithi129.stdout:4/694: rename l3 to d5/d11/d3f/lf9 0 2024-09-21T08:02:36.706 INFO:tasks.workunit.client.1.smithi129.stdout:8/661: mknod d0/d6/d7/d18/cc3 0 2024-09-21T08:02:36.707 INFO:tasks.workunit.client.1.smithi129.stdout:5/821: mkdir d2/d1e/d35/d37/d96/de5/d61/d102 0 2024-09-21T08:02:36.709 INFO:tasks.workunit.client.1.smithi129.stdout:8/662: rename d0/d6/d7/d18/l7c to d0/d6/d7/d18/d27/d32/d3d/d83/lc4 0 2024-09-21T08:02:36.711 INFO:tasks.workunit.client.1.smithi129.stdout:5/822: rename d2/c41 to d2/d1e/d6b/dd1/c103 0 2024-09-21T08:02:36.711 INFO:tasks.workunit.client.1.smithi129.stdout:5/823: stat d2/d1e/d35/d33/d36/d5a/d77/d81/l84 0 2024-09-21T08:02:36.711 INFO:tasks.workunit.client.1.smithi129.stdout:5/824: dread - d2/d1e/d35/d37/d96/de5/d61/f9d zero size 2024-09-21T08:02:36.712 INFO:tasks.workunit.client.1.smithi129.stdout:8/663: link d0/d6/d7/d18/d27/d32/d37/fba d0/d6/d7/d6c/fc5 0 2024-09-21T08:02:36.712 INFO:tasks.workunit.client.1.smithi129.stdout:8/664: truncate d0/d6/d7/d18/d27/f90 355588 0 2024-09-21T08:02:36.713 INFO:tasks.workunit.client.1.smithi129.stdout:8/665: rmdir d0/d6/d7/d18/d27 39 2024-09-21T08:02:36.715 INFO:tasks.workunit.client.1.smithi129.stdout:0/737: dwrite de/d15/d87/f89 [0,4194304] 0 2024-09-21T08:02:36.718 INFO:tasks.workunit.client.1.smithi129.stdout:0/738: mkdir de/d15/d39/d56/def 0 2024-09-21T08:02:36.719 INFO:tasks.workunit.client.1.smithi129.stdout:0/739: write de/d22/d27/d2f/fe2 [746944,20638] 0 2024-09-21T08:02:36.719 INFO:tasks.workunit.client.1.smithi129.stdout:4/695: dwrite d5/fe8 [0,4194304] 0 2024-09-21T08:02:36.721 INFO:tasks.workunit.client.1.smithi129.stdout:8/666: read d0/d6/d7/d9/f5f [389034,51464] 0 2024-09-21T08:02:36.722 INFO:tasks.workunit.client.1.smithi129.stdout:4/696: symlink d5/d6/lfa 0 2024-09-21T08:02:36.725 INFO:tasks.workunit.client.1.smithi129.stdout:4/697: creat d5/d16/d47/ffb x:0 0 0 2024-09-21T08:02:36.726 INFO:tasks.workunit.client.1.smithi129.stdout:4/698: link f2 d5/d16/d47/ffc 0 2024-09-21T08:02:36.727 INFO:tasks.workunit.client.1.smithi129.stdout:8/667: getdents d0/d6/d7/d18/d27/d32/d3d/d83 0 2024-09-21T08:02:36.728 INFO:tasks.workunit.client.1.smithi129.stdout:8/668: readlink d0/d6/d7/d18/d61/lab 0 2024-09-21T08:02:36.728 INFO:tasks.workunit.client.1.smithi129.stdout:8/669: fsync d0/d6/d7/d18/d27/d32/f54 0 2024-09-21T08:02:36.729 INFO:tasks.workunit.client.1.smithi129.stdout:8/670: rename d0/d6/d7/d3a/d8e/fad to d0/d6/d7/d9/d94/fc6 0 2024-09-21T08:02:36.731 INFO:tasks.workunit.client.1.smithi129.stdout:8/671: mknod d0/d6/dac/cc7 0 2024-09-21T08:02:36.731 INFO:tasks.workunit.client.1.smithi129.stdout:8/672: stat d0/d6/d7/d9/c1e 0 2024-09-21T08:02:36.741 INFO:tasks.workunit.client.1.smithi129.stdout:9/690: sync 2024-09-21T08:02:36.741 INFO:tasks.workunit.client.1.smithi129.stdout:3/789: sync 2024-09-21T08:02:36.741 INFO:tasks.workunit.client.1.smithi129.stdout:2/981: sync 2024-09-21T08:02:36.741 INFO:tasks.workunit.client.1.smithi129.stdout:3/790: fsync d3/d69/d98/ffe 0 2024-09-21T08:02:36.741 INFO:tasks.workunit.client.1.smithi129.stdout:2/982: fsync d1/d13/d32/f55 0 2024-09-21T08:02:36.741 INFO:tasks.workunit.client.1.smithi129.stdout:2/983: write d1/dc/f18 [3044359,87439] 0 2024-09-21T08:02:36.742 INFO:tasks.workunit.client.1.smithi129.stdout:6/683: sync 2024-09-21T08:02:36.742 INFO:tasks.workunit.client.1.smithi129.stdout:9/691: mkdir d17/d22/d33/d36/de8 0 2024-09-21T08:02:36.743 INFO:tasks.workunit.client.1.smithi129.stdout:3/791: getdents d3/da/d5d/d94 0 2024-09-21T08:02:36.743 INFO:tasks.workunit.client.1.smithi129.stdout:3/792: chown d3/da/dc/d11/l7e 9 1 2024-09-21T08:02:36.744 INFO:tasks.workunit.client.1.smithi129.stdout:6/684: mkdir d7/d1b/d1e/d66/dc2/d93/dd5/de6 0 2024-09-21T08:02:36.745 INFO:tasks.workunit.client.1.smithi129.stdout:9/692: read - d17/d22/d33/da5/fc3 zero size 2024-09-21T08:02:36.745 INFO:tasks.workunit.client.1.smithi129.stdout:9/693: fdatasync d17/d22/d33/d36/f65 0 2024-09-21T08:02:36.746 INFO:tasks.workunit.client.1.smithi129.stdout:3/793: symlink d3/da/d5d/d94/dac/dfa/l118 0 2024-09-21T08:02:36.746 INFO:tasks.workunit.client.1.smithi129.stdout:3/794: dread - d3/da/d5d/fa0 zero size 2024-09-21T08:02:36.747 INFO:tasks.workunit.client.1.smithi129.stdout:6/685: mkdir d7/d1b/d1e/d66/de7 0 2024-09-21T08:02:36.748 INFO:tasks.workunit.client.1.smithi129.stdout:3/795: mknod d3/da/c119 0 2024-09-21T08:02:36.748 INFO:tasks.workunit.client.1.smithi129.stdout:3/796: creat d3/d69/d95/de1/f11a x:0 0 0 2024-09-21T08:02:36.748 INFO:tasks.workunit.client.1.smithi129.stdout:3/797: fsync d3/da/d5d/d94/db3/dc3/fe5 0 2024-09-21T08:02:36.749 INFO:tasks.workunit.client.1.smithi129.stdout:7/925: sync 2024-09-21T08:02:36.749 INFO:tasks.workunit.client.1.smithi129.stdout:7/926: chown d0/d46/d6e/d9b/da5/fd8 1960402 1 2024-09-21T08:02:36.752 INFO:tasks.workunit.client.1.smithi129.stdout:5/825: dwrite d2/d1e/d35/d37/d96/de5/d61/f72 [0,4194304] 0 2024-09-21T08:02:36.755 INFO:tasks.workunit.client.1.smithi129.stdout:0/740: dwrite de/d19/f72 [0,4194304] 0 2024-09-21T08:02:36.755 INFO:tasks.workunit.client.1.smithi129.stdout:0/741: fsync de/d19/f66 0 2024-09-21T08:02:36.756 INFO:tasks.workunit.client.1.smithi129.stdout:8/673: dwrite d0/d6/d7/d18/d27/d60/d97/fa2 [0,4194304] 0 2024-09-21T08:02:36.756 INFO:tasks.workunit.client.1.smithi129.stdout:8/674: write d0/d6/d7/d9/fbe [130642,23863] 0 2024-09-21T08:02:36.758 INFO:tasks.workunit.client.1.smithi129.stdout:2/984: read d1/d13/f41 [7510644,66128] 0 2024-09-21T08:02:36.758 INFO:tasks.workunit.client.1.smithi129.stdout:4/699: dwrite d5/d33/fc9 [0,4194304] 0 2024-09-21T08:02:36.759 INFO:tasks.workunit.client.1.smithi129.stdout:4/700: dread d5/d33/d4e/f7b [0,4194304] 0 2024-09-21T08:02:36.759 INFO:tasks.workunit.client.1.smithi129.stdout:4/701: chown d5/d16/d85/l95 654934 1 2024-09-21T08:02:36.763 INFO:tasks.workunit.client.1.smithi129.stdout:5/826: rmdir d2/d1e/d35/d33 39 2024-09-21T08:02:36.764 INFO:tasks.workunit.client.1.smithi129.stdout:0/742: dread de/d22/f2b [0,4194304] 0 2024-09-21T08:02:36.765 INFO:tasks.workunit.client.1.smithi129.stdout:6/686: rename d7/d4a to d7/d1b/d1e/d39/d4b/de8 0 2024-09-21T08:02:36.766 INFO:tasks.workunit.client.1.smithi129.stdout:7/927: getdents d0/d120 0 2024-09-21T08:02:36.767 INFO:tasks.workunit.client.1.smithi129.stdout:3/798: dwrite d3/da/dc/fbd [0,4194304] 0 2024-09-21T08:02:36.768 INFO:tasks.workunit.client.1.smithi129.stdout:9/694: dwrite d17/d22/d33/d7a/d89/d90/db1/d31/d5e/d6b/f79 [0,4194304] 0 2024-09-21T08:02:36.769 INFO:tasks.workunit.client.1.smithi129.stdout:8/675: getdents d0/d6/d7/d18/d61/d7f 0 2024-09-21T08:02:36.771 INFO:tasks.workunit.client.1.smithi129.stdout:2/985: unlink d1/d53/d68/f12e 0 2024-09-21T08:02:36.773 INFO:tasks.workunit.client.1.smithi129.stdout:5/827: symlink d2/d1e/d6b/l104 0 2024-09-21T08:02:36.774 INFO:tasks.workunit.client.1.smithi129.stdout:0/743: mknod de/d81/cf0 0 2024-09-21T08:02:36.775 INFO:tasks.workunit.client.1.smithi129.stdout:6/687: creat d7/d1b/d1e/d66/dc2/d5e/fe9 x:0 0 0 2024-09-21T08:02:36.777 INFO:tasks.workunit.client.1.smithi129.stdout:7/928: creat d0/d1e/db1/dba/f13f x:0 0 0 2024-09-21T08:02:36.777 INFO:tasks.workunit.client.1.smithi129.stdout:7/929: readlink d0/d46/d6e/d9b/da5/db7/l12e 0 2024-09-21T08:02:36.781 INFO:tasks.workunit.client.1.smithi129.stdout:9/695: creat d17/d60/d97/fe9 x:0 0 0 2024-09-21T08:02:36.781 INFO:tasks.workunit.client.1.smithi129.stdout:9/696: dread - d17/d22/d33/d7a/d89/d90/db1/d31/d5e/fa9 zero size 2024-09-21T08:02:36.781 INFO:tasks.workunit.client.1.smithi129.stdout:9/697: chown d17/d22/d33/d7a/d89/d90/db1/d31/d35/l4c 0 1 2024-09-21T08:02:36.782 INFO:tasks.workunit.client.1.smithi129.stdout:9/698: fdatasync d17/d55/fb9 0 2024-09-21T08:02:36.782 INFO:tasks.workunit.client.1.smithi129.stdout:9/699: readlink d17/d22/d33/d36/d48/d3f/d53/l96 0 2024-09-21T08:02:36.783 INFO:tasks.workunit.client.1.smithi129.stdout:8/676: creat d0/d6/d7/d6c/dc0/fc8 x:0 0 0 2024-09-21T08:02:36.785 INFO:tasks.workunit.client.1.smithi129.stdout:2/986: unlink d1/d13/d3a/d47/d1f/d85/df7/d45/f7b 0 2024-09-21T08:02:36.786 INFO:tasks.workunit.client.1.smithi129.stdout:5/828: link d2/d1e/d35/d33/d36/f82 d2/d1e/d35/d33/d36/d5a/f105 0 2024-09-21T08:02:36.788 INFO:tasks.workunit.client.1.smithi129.stdout:3/799: getdents d3/d57 0 2024-09-21T08:02:36.790 INFO:tasks.workunit.client.1.smithi129.stdout:2/987: truncate d1/d13/d3a/d47/d1f/f25 2372274 0 2024-09-21T08:02:36.792 INFO:tasks.workunit.client.1.smithi129.stdout:3/800: mkdir d3/d57/d80/d11b 0 2024-09-21T08:02:36.793 INFO:tasks.workunit.client.1.smithi129.stdout:9/700: getdents d17/d60 0 2024-09-21T08:02:36.795 INFO:tasks.workunit.client.1.smithi129.stdout:2/988: creat d1/dc/d19/d4c/f166 x:0 0 0 2024-09-21T08:02:36.795 INFO:tasks.workunit.client.1.smithi129.stdout:2/989: stat d1/d53/d77/d8b/cf5 0 2024-09-21T08:02:36.795 INFO:tasks.workunit.client.1.smithi129.stdout:2/990: creat d1/d53/f167 x:0 0 0 2024-09-21T08:02:36.795 INFO:tasks.workunit.client.1.smithi129.stdout:9/701: rmdir d17/d23 39 2024-09-21T08:02:36.796 INFO:tasks.workunit.client.1.smithi129.stdout:9/702: write d17/d22/d33/d7a/d89/d90/db1/d31/d35/fd2 [4070,15259] 0 2024-09-21T08:02:36.796 INFO:tasks.workunit.client.1.smithi129.stdout:9/703: read d17/f49 [1952173,51921] 0 2024-09-21T08:02:36.797 INFO:tasks.workunit.client.1.smithi129.stdout:2/991: symlink d1/d13/d3a/d47/d1f/l168 0 2024-09-21T08:02:36.798 INFO:tasks.workunit.client.1.smithi129.stdout:9/704: rename d17/d22/d33/d36/d48/d3f/d53/l96 to d17/d55/dd1/lea 0 2024-09-21T08:02:36.799 INFO:tasks.workunit.client.1.smithi129.stdout:9/705: link l7 d17/d22/d33/d36/de8/leb 0 2024-09-21T08:02:36.799 INFO:tasks.workunit.client.1.smithi129.stdout:9/706: creat d17/d22/d33/d36/d48/d3f/d53/fec x:0 0 0 2024-09-21T08:02:36.801 INFO:tasks.workunit.client.1.smithi129.stdout:6/688: dwrite d7/d1b/f49 [8388608,4194304] 0 2024-09-21T08:02:36.801 INFO:tasks.workunit.client.1.smithi129.stdout:6/689: write d7/f8 [2074863,98261] 0 2024-09-21T08:02:36.801 INFO:tasks.workunit.client.1.smithi129.stdout:6/690: write d7/d1b/d1e/d39/d4b/de8/d69/f87 [615999,79209] 0 2024-09-21T08:02:36.801 INFO:tasks.workunit.client.1.smithi129.stdout:6/691: write d7/f82 [1301822,78858] 0 2024-09-21T08:02:36.802 INFO:tasks.workunit.client.1.smithi129.stdout:6/692: rename d7/l8c to d7/d1b/d1e/d66/dc2/d5e/lea 0 2024-09-21T08:02:36.816 INFO:tasks.workunit.client.1.smithi129.stdout:9/707: dread d17/d22/d33/f7f [0,4194304] 0 2024-09-21T08:02:36.817 INFO:tasks.workunit.client.1.smithi129.stdout:8/677: dwrite d0/d6/d7/d24/f35 [4194304,4194304] 0 2024-09-21T08:02:36.817 INFO:tasks.workunit.client.1.smithi129.stdout:8/678: chown d0/d6/d7/d24/l84 28918 1 2024-09-21T08:02:36.817 INFO:tasks.workunit.client.1.smithi129.stdout:9/708: mknod d17/d46/d9c/ced 0 2024-09-21T08:02:36.817 INFO:tasks.workunit.client.1.smithi129.stdout:8/679: creat d0/d6/d7/d18/d27/d32/fc9 x:0 0 0 2024-09-21T08:02:36.817 INFO:tasks.workunit.client.1.smithi129.stdout:6/693: dread d7/d1b/d1e/f36 [4194304,4194304] 0 2024-09-21T08:02:36.817 INFO:tasks.workunit.client.1.smithi129.stdout:6/694: dread - d7/f9a zero size 2024-09-21T08:02:36.818 INFO:tasks.workunit.client.1.smithi129.stdout:8/680: unlink d0/d6/d7/d18/d27/d32/d3d/d83/lc4 0 2024-09-21T08:02:36.819 INFO:tasks.workunit.client.1.smithi129.stdout:6/695: symlink d7/d1b/d1e/d39/leb 0 2024-09-21T08:02:36.820 INFO:tasks.workunit.client.1.smithi129.stdout:6/696: symlink d7/d1b/d1e/d39/d4b/de8/d69/d89/lec 0 2024-09-21T08:02:36.821 INFO:tasks.workunit.client.1.smithi129.stdout:0/744: dwrite de/d22/d27/d30/f93 [0,4194304] 0 2024-09-21T08:02:36.821 INFO:tasks.workunit.client.1.smithi129.stdout:0/745: creat de/d22/d27/d85/db2/dc3/ff1 x:0 0 0 2024-09-21T08:02:36.823 INFO:tasks.workunit.client.1.smithi129.stdout:5/829: dwrite d2/d1e/d35/d33/d36/d5a/d77/d81/f94 [0,4194304] 0 2024-09-21T08:02:36.823 INFO:tasks.workunit.client.1.smithi129.stdout:2/992: dwrite d1/d53/d77/d8b/fb0 [0,4194304] 0 2024-09-21T08:02:36.823 INFO:tasks.workunit.client.1.smithi129.stdout:3/801: dwrite d3/d5a/fe6 [0,4194304] 0 2024-09-21T08:02:36.824 INFO:tasks.workunit.client.1.smithi129.stdout:0/746: creat de/d15/d39/d9e/dac/dba/ff2 x:0 0 0 2024-09-21T08:02:36.824 INFO:tasks.workunit.client.1.smithi129.stdout:0/747: chown de/d15/d39/d56/f6f 826282 1 2024-09-21T08:02:36.828 INFO:tasks.workunit.client.1.smithi129.stdout:5/830: symlink d2/d1e/d35/d33/db9/l106 0 2024-09-21T08:02:36.829 INFO:tasks.workunit.client.1.smithi129.stdout:2/993: truncate d1/d13/d3a/d47/d1f/d85/df7/d45/d65/fa8 1974359 0 2024-09-21T08:02:36.832 INFO:tasks.workunit.client.1.smithi129.stdout:3/802: link d3/d57/fec d3/da/dc/d7f/dd6/de2/df2/f11c 0 2024-09-21T08:02:36.836 INFO:tasks.workunit.client.1.smithi129.stdout:0/748: dread f0 [0,4194304] 0 2024-09-21T08:02:36.837 INFO:tasks.workunit.client.1.smithi129.stdout:0/749: chown de/d1f/da9/f7c 1056026044 1 2024-09-21T08:02:36.837 INFO:tasks.workunit.client.1.smithi129.stdout:0/750: dread - de/d81/fe6 zero size 2024-09-21T08:02:36.844 INFO:tasks.workunit.client.1.smithi129.stdout:3/803: unlink d3/da/f78 0 2024-09-21T08:02:36.844 INFO:tasks.workunit.client.1.smithi129.stdout:3/804: dread - d3/da/dc/fdf zero size 2024-09-21T08:02:36.845 INFO:tasks.workunit.client.1.smithi129.stdout:0/751: mknod de/d15/d87/cf3 0 2024-09-21T08:02:36.846 INFO:tasks.workunit.client.1.smithi129.stdout:0/752: readlink de/d22/d27/d85/ld5 0 2024-09-21T08:02:36.846 INFO:tasks.workunit.client.1.smithi129.stdout:0/753: write de/d1f/da9/f7c [4329899,28204] 0 2024-09-21T08:02:36.846 INFO:tasks.workunit.client.1.smithi129.stdout:3/805: truncate d3/da/dc/d11/d2f/fcf 2010625 0 2024-09-21T08:02:36.846 INFO:tasks.workunit.client.1.smithi129.stdout:3/806: fsync d3/da/dc/d7f/dd6/de2/df2/f10c 0 2024-09-21T08:02:36.848 INFO:tasks.workunit.client.1.smithi129.stdout:0/754: link de/f12 de/d81/d94/ff4 0 2024-09-21T08:02:36.851 INFO:tasks.workunit.client.1.smithi129.stdout:6/697: dwrite d7/d1b/d1e/d39/fb4 [0,4194304] 0 2024-09-21T08:02:36.851 INFO:tasks.workunit.client.1.smithi129.stdout:0/755: rename de/d15/d44/d45/d84 to de/d1f/dd4/db1/df5 0 2024-09-21T08:02:36.851 INFO:tasks.workunit.client.1.smithi129.stdout:0/756: dread - de/d22/d27/d85/db2/dc3/fe5 zero size 2024-09-21T08:02:36.851 INFO:tasks.workunit.client.1.smithi129.stdout:0/757: chown de/d22/d27/d2f/d42/cec 1633015 1 2024-09-21T08:02:36.851 INFO:tasks.workunit.client.1.smithi129.stdout:0/758: fdatasync de/d22/d27/d2f/f61 0 2024-09-21T08:02:36.851 INFO:tasks.workunit.client.1.smithi129.stdout:3/807: mknod d3/c11d 0 2024-09-21T08:02:36.852 INFO:tasks.workunit.client.1.smithi129.stdout:5/831: dwrite d2/d1e/d35/d37/d96/de5/f63 [0,4194304] 0 2024-09-21T08:02:36.852 INFO:tasks.workunit.client.1.smithi129.stdout:2/994: dwrite d1/d13/d3a/d47/d1f/d85/df7/d45/f46 [0,4194304] 0 2024-09-21T08:02:36.852 INFO:tasks.workunit.client.1.smithi129.stdout:2/995: fdatasync d1/fc3 0 2024-09-21T08:02:36.856 INFO:tasks.workunit.client.1.smithi129.stdout:6/698: rmdir d7/d1b/d1e/d39/dbf/dcd 0 2024-09-21T08:02:36.856 INFO:tasks.workunit.client.1.smithi129.stdout:6/699: truncate d7/d1b/d1e/d66/dc2/d5e/fa0 4423393 0 2024-09-21T08:02:36.857 INFO:tasks.workunit.client.1.smithi129.stdout:3/808: rmdir d3 39 2024-09-21T08:02:36.860 INFO:tasks.workunit.client.1.smithi129.stdout:2/996: creat d1/f169 x:0 0 0 2024-09-21T08:02:36.861 INFO:tasks.workunit.client.1.smithi129.stdout:2/997: getdents d1/dc 0 2024-09-21T08:02:36.861 INFO:tasks.workunit.client.1.smithi129.stdout:5/832: dread d2/d1e/d35/f51 [0,4194304] 0 2024-09-21T08:02:36.862 INFO:tasks.workunit.client.1.smithi129.stdout:6/700: unlink d7/f8 0 2024-09-21T08:02:36.863 INFO:tasks.workunit.client.1.smithi129.stdout:3/809: link d3/da/dc/d11/d2f/cd5 d3/da/d5d/d94/dac/dfa/c11e 0 2024-09-21T08:02:36.863 INFO:tasks.workunit.client.1.smithi129.stdout:3/810: creat d3/da/dc/d11/d55/f11f x:0 0 0 2024-09-21T08:02:36.865 INFO:tasks.workunit.client.1.smithi129.stdout:0/759: dwrite de/d15/d51/f5d [0,4194304] 0 2024-09-21T08:02:36.865 INFO:tasks.workunit.client.1.smithi129.stdout:5/833: link d2/le d2/d1e/d35/d37/d96/de5/l107 0 2024-09-21T08:02:36.865 INFO:tasks.workunit.client.1.smithi129.stdout:5/834: readlink d2/d1e/d35/d33/d36/d5a/d77/l101 0 2024-09-21T08:02:36.866 INFO:tasks.workunit.client.1.smithi129.stdout:6/701: mkdir d7/d1b/d1e/d39/d79/ded 0 2024-09-21T08:02:36.868 INFO:tasks.workunit.client.1.smithi129.stdout:3/811: unlink d3/da/dc/d11/d2f/fb6 0 2024-09-21T08:02:36.871 INFO:tasks.workunit.client.1.smithi129.stdout:0/760: dread de/d15/d39/d56/f63 [0,4194304] 0 2024-09-21T08:02:36.871 INFO:tasks.workunit.client.1.smithi129.stdout:0/761: chown de/d15/cc5 19886199 1 2024-09-21T08:02:36.871 INFO:tasks.workunit.client.1.smithi129.stdout:0/762: chown de/d22/d27/d85 14372 1 2024-09-21T08:02:36.873 INFO:tasks.workunit.client.1.smithi129.stdout:6/702: symlink d7/d1b/d1e/d66/dc2/de2/lee 0 2024-09-21T08:02:36.873 INFO:tasks.workunit.client.1.smithi129.stdout:6/703: write f5 [1833069,130152] 0 2024-09-21T08:02:36.877 INFO:tasks.workunit.client.1.smithi129.stdout:5/835: dread d2/d1e/f32 [0,4194304] 0 2024-09-21T08:02:36.877 INFO:tasks.workunit.client.1.smithi129.stdout:5/836: creat d2/d1e/d35/d37/d7d/f108 x:0 0 0 2024-09-21T08:02:36.877 INFO:tasks.workunit.client.1.smithi129.stdout:6/704: dread d7/d1b/d1e/d66/dc2/de2/d40/d41/f62 [0,4194304] 0 2024-09-21T08:02:36.880 INFO:tasks.workunit.client.1.smithi129.stdout:5/837: rename d2/d1e/d35/f7c to d2/d1e/d35/f109 0 2024-09-21T08:02:36.882 INFO:tasks.workunit.client.1.smithi129.stdout:6/705: creat d7/d1b/d1e/d39/d4b/d6e/de5/fef x:0 0 0 2024-09-21T08:02:36.885 INFO:tasks.workunit.client.1.smithi129.stdout:5/838: mkdir d2/d1e/d6b/d10a 0 2024-09-21T08:02:36.885 INFO:tasks.workunit.client.1.smithi129.stdout:5/839: dread - d2/d2a/fbf zero size 2024-09-21T08:02:36.886 INFO:tasks.workunit.client.1.smithi129.stdout:6/706: creat d7/d1b/d1e/d39/dbf/ff0 x:0 0 0 2024-09-21T08:02:36.890 INFO:tasks.workunit.client.1.smithi129.stdout:0/763: dwrite de/d81/fc9 [0,4194304] 0 2024-09-21T08:02:36.890 INFO:tasks.workunit.client.1.smithi129.stdout:3/812: dwrite d3/da/dc/d11/d55/f10a [0,4194304] 0 2024-09-21T08:02:36.890 INFO:tasks.workunit.client.1.smithi129.stdout:3/813: write d3/da/dc/fdf [420436,96336] 0 2024-09-21T08:02:36.891 INFO:tasks.workunit.client.1.smithi129.stdout:6/707: rename d7/d1b/d1e/d39/d4b/de8/d7a/ldb to d7/d1b/d57/dd6/lf1 0 2024-09-21T08:02:36.897 INFO:tasks.workunit.client.1.smithi129.stdout:6/708: truncate d7/d1b/d1e/f36 6554592 0 2024-09-21T08:02:36.900 INFO:tasks.workunit.client.1.smithi129.stdout:3/814: rename d3/d57 to d3/da/dc/d7f/dd6/de2/d120 0 2024-09-21T08:02:36.900 INFO:tasks.workunit.client.1.smithi129.stdout:3/815: chown d3/da/dc/l39 7471 1 2024-09-21T08:02:36.901 INFO:tasks.workunit.client.1.smithi129.stdout:6/709: creat d7/d1b/d1e/d39/d4b/de8/d7a/ff2 x:0 0 0 2024-09-21T08:02:36.907 INFO:tasks.workunit.client.1.smithi129.stdout:5/840: dwrite d2/d1e/d35/d37/d96/de5/f4f [0,4194304] 0 2024-09-21T08:02:36.907 INFO:tasks.workunit.client.1.smithi129.stdout:5/841: write d2/d1e/d35/d37/d65/fce [232459,38083] 0 2024-09-21T08:02:36.908 INFO:tasks.workunit.client.1.smithi129.stdout:1/832: sync 2024-09-21T08:02:36.918 INFO:tasks.workunit.client.1.smithi129.stdout:5/842: dread d2/d1e/d35/d37/d96/de5/d61/f72 [0,4194304] 0 2024-09-21T08:02:36.920 INFO:tasks.workunit.client.1.smithi129.stdout:5/843: symlink d2/d1e/d35/d37/d96/de5/d61/l10b 0 2024-09-21T08:02:36.920 INFO:tasks.workunit.client.1.smithi129.stdout:5/844: mknod d2/d1e/d35/d33/db9/c10c 0 2024-09-21T08:02:36.920 INFO:tasks.workunit.client.1.smithi129.stdout:5/845: read d2/d1e/d35/d33/d36/d5a/f5b [1497323,19192] 0 2024-09-21T08:02:36.936 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:36 smithi129 ceph-mon[34472]: pgmap v10: 65 pgs: 65 active+clean; 1.3 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 144 MiB/s rd, 172 MiB/s wr, 259 op/s 2024-09-21T08:02:36.961 INFO:tasks.workunit.client.0.smithi107.stdout:5/62: sync 2024-09-21T08:02:36.962 INFO:tasks.workunit.client.0.smithi107.stdout:5/63: creat d7/de/f13 x:0 0 0 2024-09-21T08:02:36.970 INFO:tasks.workunit.client.1.smithi129.stdout:6/710: write d7/d1b/d1e/d39/f4c [1889325,124763] 0 2024-09-21T08:02:36.970 INFO:tasks.workunit.client.1.smithi129.stdout:3/816: dwrite d3/da/dc/fbd [0,4194304] 0 2024-09-21T08:02:36.971 INFO:tasks.workunit.client.1.smithi129.stdout:3/817: read d3/da/dc/da3/fd1 [10955,67835] 0 2024-09-21T08:02:36.971 INFO:tasks.workunit.client.1.smithi129.stdout:3/818: chown d3/f93 4030 1 2024-09-21T08:02:36.972 INFO:tasks.workunit.client.1.smithi129.stdout:1/833: dwrite d1/f12 [0,4194304] 0 2024-09-21T08:02:36.973 INFO:tasks.workunit.client.1.smithi129.stdout:6/711: link d7/f37 d7/d1b/d1e/d39/d79/ded/ff3 0 2024-09-21T08:02:36.973 INFO:tasks.workunit.client.1.smithi129.stdout:6/712: creat d7/d1b/d1e/d66/d7c/ff4 x:0 0 0 2024-09-21T08:02:36.974 INFO:tasks.workunit.client.1.smithi129.stdout:3/819: mkdir d3/da/d5d/d94/db3/dc3/d115/d121 0 2024-09-21T08:02:36.974 INFO:tasks.workunit.client.1.smithi129.stdout:3/820: write d3/d69/d98/fd7 [200560,3321] 0 2024-09-21T08:02:36.974 INFO:tasks.workunit.client.1.smithi129.stdout:3/821: fsync d3/da/dc/d11/d2f/f40 0 2024-09-21T08:02:36.975 INFO:tasks.workunit.client.1.smithi129.stdout:5/846: dread d2/d1e/d35/d33/dca/fda [0,4194304] 0 2024-09-21T08:02:36.977 INFO:tasks.workunit.client.1.smithi129.stdout:1/834: symlink d1/d16/d25/l119 0 2024-09-21T08:02:36.978 INFO:tasks.workunit.client.1.smithi129.stdout:1/835: creat d1/d16/d9b/f11a x:0 0 0 2024-09-21T08:02:36.983 INFO:tasks.workunit.client.1.smithi129.stdout:1/836: link d1/d9/la3 d1/d9/l11b 0 2024-09-21T08:02:36.983 INFO:tasks.workunit.client.1.smithi129.stdout:1/837: write d1/d9/d31/f62 [582149,69749] 0 2024-09-21T08:02:36.984 INFO:tasks.workunit.client.1.smithi129.stdout:6/713: truncate d7/f82 882376 0 2024-09-21T08:02:36.987 INFO:tasks.workunit.client.1.smithi129.stdout:6/714: unlink d7/d1b/d1e/d39/d79/db8/ca7 0 2024-09-21T08:02:36.989 INFO:tasks.workunit.client.1.smithi129.stdout:1/838: rename d1/c23 to d1/d16/d9b/dbf/c11c 0 2024-09-21T08:02:36.992 INFO:tasks.workunit.client.1.smithi129.stdout:1/839: rmdir d1/d44 39 2024-09-21T08:02:36.993 INFO:tasks.workunit.client.1.smithi129.stdout:1/840: link d1/d4/dc2/dc6/d7f/ff9 d1/d4/dad/db6/f11d 0 2024-09-21T08:02:36.994 INFO:tasks.workunit.client.1.smithi129.stdout:1/841: creat d1/d44/d83/dcb/f11e x:0 0 0 2024-09-21T08:02:36.995 INFO:tasks.workunit.client.1.smithi129.stdout:1/842: unlink d1/lce 0 2024-09-21T08:02:36.998 INFO:tasks.workunit.client.1.smithi129.stdout:3/822: dwrite d3/da/dc/d11/d2f/f85 [0,4194304] 0 2024-09-21T08:02:37.001 INFO:tasks.workunit.client.1.smithi129.stdout:6/715: dread d7/d1b/d1e/d39/d4b/f1d [0,4194304] 0 2024-09-21T08:02:37.002 INFO:tasks.workunit.client.0.smithi107.stdout:5/64: dwrite d7/de/f13 [0,4194304] 0 2024-09-21T08:02:37.002 INFO:tasks.workunit.client.1.smithi129.stdout:5/847: dwrite d2/d1e/d35/f40 [4194304,4194304] 0 2024-09-21T08:02:37.003 INFO:tasks.workunit.client.1.smithi129.stdout:5/848: chown d2/d1e/d35/d37/d65/fce 505 1 2024-09-21T08:02:37.004 INFO:tasks.workunit.client.1.smithi129.stdout:6/716: dread d7/d1b/d1e/d66/dc2/de2/f6b [0,4194304] 0 2024-09-21T08:02:37.010 INFO:tasks.workunit.client.1.smithi129.stdout:4/702: sync 2024-09-21T08:02:37.011 INFO:tasks.workunit.client.0.smithi107.stdout:5/65: dread d7/de/f10 [0,4194304] 0 2024-09-21T08:02:37.013 INFO:tasks.workunit.client.1.smithi129.stdout:6/717: creat d7/d1b/d1e/d39/d4b/de8/ff5 x:0 0 0 2024-09-21T08:02:37.014 INFO:tasks.workunit.client.1.smithi129.stdout:6/718: chown d7/d1b/d1e/d39/d4b/de8/d7a/la1 5775066 1 2024-09-21T08:02:37.014 INFO:tasks.workunit.client.0.smithi107.stdout:5/66: mknod d7/c14 0 2024-09-21T08:02:37.016 INFO:tasks.workunit.client.0.smithi107.stdout:5/67: rename d7/cb to d7/de/c15 0 2024-09-21T08:02:37.017 INFO:tasks.workunit.client.0.smithi107.stdout:5/68: rename d7/fa to d7/de/f16 0 2024-09-21T08:02:37.023 INFO:tasks.workunit.client.1.smithi129.stdout:2/998: sync 2024-09-21T08:02:37.023 INFO:tasks.workunit.client.1.smithi129.stdout:7/930: sync 2024-09-21T08:02:37.023 INFO:tasks.workunit.client.1.smithi129.stdout:8/681: sync 2024-09-21T08:02:37.023 INFO:tasks.workunit.client.1.smithi129.stdout:9/709: sync 2024-09-21T08:02:37.023 INFO:tasks.workunit.client.1.smithi129.stdout:2/999: getdents d1/d13/d3a/dc1 0 2024-09-21T08:02:37.025 INFO:tasks.workunit.client.1.smithi129.stdout:7/931: mkdir d0/d46/d6e/d9b/de5/d117/d140 0 2024-09-21T08:02:37.025 INFO:tasks.workunit.client.1.smithi129.stdout:6/719: write f4 [56718,131010] 0 2024-09-21T08:02:37.025 INFO:tasks.workunit.client.1.smithi129.stdout:6/720: fsync d7/d1b/d1e/d39/d4b/de8/d7a/ff2 0 2024-09-21T08:02:37.025 INFO:tasks.workunit.client.1.smithi129.stdout:4/703: dread d5/d11/d3f/f52 [0,4194304] 0 2024-09-21T08:02:37.026 INFO:tasks.workunit.client.1.smithi129.stdout:9/710: creat d17/d22/d33/d36/de4/fee x:0 0 0 2024-09-21T08:02:37.026 INFO:tasks.workunit.client.1.smithi129.stdout:7/932: mknod d0/d46/de0/c141 0 2024-09-21T08:02:37.026 INFO:tasks.workunit.client.1.smithi129.stdout:8/682: getdents d0/d6 0 2024-09-21T08:02:37.027 INFO:tasks.workunit.client.1.smithi129.stdout:7/933: dread d0/d46/d6e/d9b/da5/db7/fd1 [0,4194304] 0 2024-09-21T08:02:37.027 INFO:tasks.workunit.client.1.smithi129.stdout:7/934: readlink d0/d46/l9e 0 2024-09-21T08:02:37.028 INFO:tasks.workunit.client.1.smithi129.stdout:9/711: rename d17/d22/d33/d36/d48/l92 to d17/d55/dd1/lef 0 2024-09-21T08:02:37.028 INFO:tasks.workunit.client.1.smithi129.stdout:8/683: getdents d0/d6/d7/d18/d27/d32/d3d/d7b 0 2024-09-21T08:02:37.030 INFO:tasks.workunit.client.1.smithi129.stdout:9/712: rename d17/d22/d33/f9f to d17/d22/d33/d36/d48/d3f/d71/ff0 0 2024-09-21T08:02:37.031 INFO:tasks.workunit.client.1.smithi129.stdout:1/843: dwrite d1/d4/d6e/da9/fd2 [0,4194304] 0 2024-09-21T08:02:37.031 INFO:tasks.workunit.client.1.smithi129.stdout:1/844: creat d1/d16/d28/f11f x:0 0 0 2024-09-21T08:02:37.031 INFO:tasks.workunit.client.1.smithi129.stdout:8/684: symlink d0/d6/d7/d18/lca 0 2024-09-21T08:02:37.033 INFO:tasks.workunit.client.1.smithi129.stdout:5/849: dwrite d2/d1e/d35/d33/f34 [4194304,4194304] 0 2024-09-21T08:02:37.033 INFO:tasks.workunit.client.1.smithi129.stdout:5/850: chown d2/l89 1 1 2024-09-21T08:02:37.036 INFO:tasks.workunit.client.1.smithi129.stdout:3/823: dwrite d3/fca [4194304,4194304] 0 2024-09-21T08:02:37.037 INFO:tasks.workunit.client.1.smithi129.stdout:5/851: creat d2/d1e/f10d x:0 0 0 2024-09-21T08:02:37.037 INFO:tasks.workunit.client.1.smithi129.stdout:5/852: fdatasync d2/d1e/d35/d33/d36/d5a/fa8 0 2024-09-21T08:02:37.039 INFO:tasks.workunit.client.1.smithi129.stdout:8/685: getdents d0/d6/d7/d18/d27/d60/d85 0 2024-09-21T08:02:37.039 INFO:tasks.workunit.client.1.smithi129.stdout:5/853: mkdir d2/d1e/d35/d33/db9/d10e 0 2024-09-21T08:02:37.039 INFO:tasks.workunit.client.1.smithi129.stdout:5/854: dread - d2/d1e/d35/d37/d96/de5/db1/d71/fc6 zero size 2024-09-21T08:02:37.039 INFO:tasks.workunit.client.1.smithi129.stdout:5/855: fdatasync d2/d1e/d35/d37/f9b 0 2024-09-21T08:02:37.039 INFO:tasks.workunit.client.1.smithi129.stdout:5/856: chown d2/d1e/d35/f31 603 1 2024-09-21T08:02:37.041 INFO:tasks.workunit.client.1.smithi129.stdout:5/857: symlink d2/d1e/d6b/dd1/l10f 0 2024-09-21T08:02:37.043 INFO:tasks.workunit.client.1.smithi129.stdout:5/858: symlink d2/d1e/d35/d33/d36/de0/l110 0 2024-09-21T08:02:37.044 INFO:tasks.workunit.client.1.smithi129.stdout:4/704: write d5/f14 [6056574,116982] 0 2024-09-21T08:02:37.047 INFO:tasks.workunit.client.1.smithi129.stdout:4/705: rename d5/d11/d77/fe3 to d5/d16/d47/ffd 0 2024-09-21T08:02:37.049 INFO:tasks.workunit.client.1.smithi129.stdout:9/713: dread d17/d22/d33/d7a/d89/d90/db1/f66 [0,4194304] 0 2024-09-21T08:02:37.049 INFO:tasks.workunit.client.1.smithi129.stdout:9/714: fdatasync d17/d22/d33/d36/d48/d3f/f69 0 2024-09-21T08:02:37.049 INFO:tasks.workunit.client.1.smithi129.stdout:9/715: write d17/f49 [2719153,26919] 0 2024-09-21T08:02:37.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:36 smithi107 ceph-mon[27622]: pgmap v10: 65 pgs: 65 active+clean; 1.3 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 144 MiB/s rd, 172 MiB/s wr, 259 op/s 2024-09-21T08:02:37.056 INFO:tasks.workunit.client.1.smithi129.stdout:9/716: write d17/d55/d81/f52 [599647,1467] 0 2024-09-21T08:02:37.062 INFO:tasks.workunit.client.1.smithi129.stdout:1/845: write d1/d4/dc2/dc6/fca [2294039,100456] 0 2024-09-21T08:02:37.062 INFO:tasks.workunit.client.1.smithi129.stdout:1/846: chown d1/d4/dc2/dc6/cb1 618495872 1 2024-09-21T08:02:37.062 INFO:tasks.workunit.client.1.smithi129.stdout:1/847: readlink d1/d9/d6b/l8d 0 2024-09-21T08:02:37.086 INFO:tasks.workunit.client.1.smithi129.stdout:9/717: dread d17/d46/fa2 [0,4194304] 0 2024-09-21T08:02:37.086 INFO:tasks.workunit.client.1.smithi129.stdout:9/718: chown d17/d22/d33/d36/d48/d3f/f69 2026 1 2024-09-21T08:02:37.095 INFO:tasks.workunit.client.1.smithi129.stdout:6/721: dwrite d7/fe [0,4194304] 0 2024-09-21T08:02:37.097 INFO:tasks.workunit.client.1.smithi129.stdout:7/935: dwrite d0/d1e/f81 [0,4194304] 0 2024-09-21T08:02:37.097 INFO:tasks.workunit.client.1.smithi129.stdout:7/936: write d0/f6f [347829,26063] 0 2024-09-21T08:02:37.097 INFO:tasks.workunit.client.1.smithi129.stdout:3/824: dwrite d3/d90/fd3 [0,4194304] 0 2024-09-21T08:02:37.097 INFO:tasks.workunit.client.1.smithi129.stdout:7/937: write d0/d46/d6e/f5f [554634,20065] 0 2024-09-21T08:02:37.098 INFO:tasks.workunit.client.1.smithi129.stdout:3/825: unlink d3/da/dc/d11/fde 0 2024-09-21T08:02:37.099 INFO:tasks.workunit.client.1.smithi129.stdout:7/938: rmdir d0/d1e/d9a/dca/d100/d90/dd2 39 2024-09-21T08:02:37.099 INFO:tasks.workunit.client.1.smithi129.stdout:7/939: write d0/d1e/d9a/db5/fc2 [488754,120607] 0 2024-09-21T08:02:37.099 INFO:tasks.workunit.client.1.smithi129.stdout:7/940: fdatasync d0/dc5/f106 0 2024-09-21T08:02:37.099 INFO:tasks.workunit.client.1.smithi129.stdout:7/941: chown d0/d46/d6e/c10b 610066 1 2024-09-21T08:02:37.100 INFO:tasks.workunit.client.1.smithi129.stdout:3/826: link d3/da/d5d/d94/dac/dfa/l118 d3/d5a/da9/l122 0 2024-09-21T08:02:37.100 INFO:tasks.workunit.client.1.smithi129.stdout:3/827: fsync d3/da/d5d/d94/fab 0 2024-09-21T08:02:37.100 INFO:tasks.workunit.client.1.smithi129.stdout:7/942: symlink d0/d1e/d9a/dca/de8/l142 0 2024-09-21T08:02:37.101 INFO:tasks.workunit.client.1.smithi129.stdout:3/828: rename d3/da/dc/d11/d2f/f85 to d3/d90/f123 0 2024-09-21T08:02:37.103 INFO:tasks.workunit.client.1.smithi129.stdout:7/943: unlink d0/f25 0 2024-09-21T08:02:37.105 INFO:tasks.workunit.client.1.smithi129.stdout:7/944: rename d0/d46/d6e/d9b/da5/db7/ffc to d0/f143 0 2024-09-21T08:02:37.107 INFO:tasks.workunit.client.1.smithi129.stdout:5/859: dwrite d2/d1e/d35/d37/d96/de5/d61/fa4 [4194304,4194304] 0 2024-09-21T08:02:37.107 INFO:tasks.workunit.client.1.smithi129.stdout:5/860: write d2/d1e/d35/d37/d96/de5/fbe [1855453,29825] 0 2024-09-21T08:02:37.107 INFO:tasks.workunit.client.1.smithi129.stdout:1/848: dwrite d1/d16/d57/f88 [0,4194304] 0 2024-09-21T08:02:37.107 INFO:tasks.workunit.client.1.smithi129.stdout:7/945: mknod d0/d1e/db1/dc7/c144 0 2024-09-21T08:02:37.107 INFO:tasks.workunit.client.1.smithi129.stdout:4/706: dwrite d5/d16/fd4 [0,4194304] 0 2024-09-21T08:02:37.107 INFO:tasks.workunit.client.1.smithi129.stdout:4/707: readlink d5/d6/l28 0 2024-09-21T08:02:37.107 INFO:tasks.workunit.client.1.smithi129.stdout:4/708: dread - d5/d11/d3f/f88 zero size 2024-09-21T08:02:37.107 INFO:tasks.workunit.client.1.smithi129.stdout:4/709: stat d5/d16/d47/d5f 0 2024-09-21T08:02:37.107 INFO:tasks.workunit.client.1.smithi129.stdout:8/686: dwrite d0/d6/d7/d18/d27/f90 [0,4194304] 0 2024-09-21T08:02:37.108 INFO:tasks.workunit.client.1.smithi129.stdout:9/719: dwrite d17/d22/d33/d7a/d89/d90/db1/d31/d35/fd2 [0,4194304] 0 2024-09-21T08:02:37.108 INFO:tasks.workunit.client.1.smithi129.stdout:9/720: chown d17/d22/d33/d7a 35 1 2024-09-21T08:02:37.108 INFO:tasks.workunit.client.1.smithi129.stdout:5/861: creat d2/d1e/d35/d37/d96/de5/db1/d71/f111 x:0 0 0 2024-09-21T08:02:37.108 INFO:tasks.workunit.client.1.smithi129.stdout:5/862: write d2/d1e/d35/d33/db9/fd2 [847417,86776] 0 2024-09-21T08:02:37.109 INFO:tasks.workunit.client.1.smithi129.stdout:5/863: chown d2/d1e/d35/d33/db9 699 1 2024-09-21T08:02:37.109 INFO:tasks.workunit.client.1.smithi129.stdout:7/946: mkdir d0/d1e/d9a/dca/de8/d145 0 2024-09-21T08:02:37.109 INFO:tasks.workunit.client.1.smithi129.stdout:7/947: readlink d0/d114/l13d 0 2024-09-21T08:02:37.110 INFO:tasks.workunit.client.1.smithi129.stdout:7/948: read d0/d1e/f8b [390882,8044] 0 2024-09-21T08:02:37.111 INFO:tasks.workunit.client.1.smithi129.stdout:4/710: write d5/d6/f7f [662112,103338] 0 2024-09-21T08:02:37.119 INFO:tasks.workunit.client.1.smithi129.stdout:8/687: symlink d0/d6/dac/lcb 0 2024-09-21T08:02:37.119 INFO:tasks.workunit.client.1.smithi129.stdout:5/864: mknod d2/d1e/d6b/dd1/c112 0 2024-09-21T08:02:37.120 INFO:tasks.workunit.client.1.smithi129.stdout:5/865: write d2/d2a/f68 [5243305,69349] 0 2024-09-21T08:02:37.120 INFO:tasks.workunit.client.1.smithi129.stdout:5/866: chown d2/d1e/d35/d37/d65/l6d 1960663510 1 2024-09-21T08:02:37.120 INFO:tasks.workunit.client.1.smithi129.stdout:4/711: mkdir d5/d11/dfe 0 2024-09-21T08:02:37.121 INFO:tasks.workunit.client.1.smithi129.stdout:9/721: read d17/d23/f2d [2222771,27591] 0 2024-09-21T08:02:37.121 INFO:tasks.workunit.client.1.smithi129.stdout:1/849: write d1/d4/dc2/dc6/d7f/fde [1754179,61556] 0 2024-09-21T08:02:37.122 INFO:tasks.workunit.client.1.smithi129.stdout:8/688: rename d0/d6/d7/d3a/d68 to d0/d6/d7/d18/d27/d60/d85/dcc 0 2024-09-21T08:02:37.123 INFO:tasks.workunit.client.1.smithi129.stdout:8/689: chown d0/d6/d7/d18/d27/d32/d37/c4f 504 1 2024-09-21T08:02:37.123 INFO:tasks.workunit.client.1.smithi129.stdout:8/690: write d0/d6/d7/d3a/d8e/fb3 [845014,20144] 0 2024-09-21T08:02:37.124 INFO:tasks.workunit.client.1.smithi129.stdout:5/867: truncate d2/d1e/d35/f2c 3974312 0 2024-09-21T08:02:37.125 INFO:tasks.workunit.client.1.smithi129.stdout:9/722: symlink d17/d60/d7b/d8c/lf1 0 2024-09-21T08:02:37.126 INFO:tasks.workunit.client.1.smithi129.stdout:9/723: fsync d17/d22/d33/d7a/d89/d90/db1/d31/f56 0 2024-09-21T08:02:37.128 INFO:tasks.workunit.client.1.smithi129.stdout:8/691: rename d0/d6/d7/d18/d27/d32/d3d/c59 to d0/d6/d7/d3a/d8e/ccd 0 2024-09-21T08:02:37.128 INFO:tasks.workunit.client.1.smithi129.stdout:7/949: dwrite d0/d1e/db1/dba/dc1/dc4/fdd [0,4194304] 0 2024-09-21T08:02:37.128 INFO:tasks.workunit.client.1.smithi129.stdout:6/722: dwrite d7/d1b/d1e/fb5 [0,4194304] 0 2024-09-21T08:02:37.130 INFO:tasks.workunit.client.1.smithi129.stdout:4/712: getdents d5/d33/d66 0 2024-09-21T08:02:37.130 INFO:tasks.workunit.client.1.smithi129.stdout:9/724: stat d17/d22/d33/d7a/d89/d90/db1/d31/d35/c42 0 2024-09-21T08:02:37.130 INFO:tasks.workunit.client.1.smithi129.stdout:9/725: dread - d17/d60/fd6 zero size 2024-09-21T08:02:37.132 INFO:tasks.workunit.client.1.smithi129.stdout:7/950: creat d0/d1e/d9a/dca/d100/d90/dfe/f146 x:0 0 0 2024-09-21T08:02:37.132 INFO:tasks.workunit.client.1.smithi129.stdout:7/951: chown d0/d1e/f10d 8044064 1 2024-09-21T08:02:37.132 INFO:tasks.workunit.client.1.smithi129.stdout:7/952: write d0/d46/d6e/dad/df6/dfd/f133 [323385,752] 0 2024-09-21T08:02:37.132 INFO:tasks.workunit.client.1.smithi129.stdout:7/953: getdents d0/d1e/d9a/dca/de8/d145 0 2024-09-21T08:02:37.133 INFO:tasks.workunit.client.1.smithi129.stdout:5/868: getdents d2/d1e/d35/d37/d7d 0 2024-09-21T08:02:37.133 INFO:tasks.workunit.client.1.smithi129.stdout:3/829: dwrite d3/d69/d95/fd9 [4194304,4194304] 0 2024-09-21T08:02:37.133 INFO:tasks.workunit.client.1.smithi129.stdout:3/830: chown d3/da/d5d/l105 35975411 1 2024-09-21T08:02:37.136 INFO:tasks.workunit.client.1.smithi129.stdout:4/713: rename d5/d11/d3f/laf to d5/d33/d6d/df0/lff 0 2024-09-21T08:02:37.136 INFO:tasks.workunit.client.1.smithi129.stdout:4/714: read - d5/d33/d4e/da7/fd0 zero size 2024-09-21T08:02:37.137 INFO:tasks.workunit.client.0.smithi107.stdout:2/22: sync 2024-09-21T08:02:37.137 INFO:tasks.workunit.client.0.smithi107.stdout:2/23: write d1/f3 [496961,55205] 0 2024-09-21T08:02:37.137 INFO:tasks.workunit.client.0.smithi107.stdout:2/24: chown d1/d2 18 1 2024-09-21T08:02:37.137 INFO:tasks.workunit.client.0.smithi107.stdout:2/25: fsync f0 0 2024-09-21T08:02:37.141 INFO:tasks.workunit.client.1.smithi129.stdout:3/831: creat d3/da/dc/d11/f124 x:0 0 0 2024-09-21T08:02:37.141 INFO:tasks.workunit.client.1.smithi129.stdout:3/832: fdatasync d3/da/dc/d7f/dd6/de2/d120/d80/f107 0 2024-09-21T08:02:37.142 INFO:tasks.workunit.client.1.smithi129.stdout:4/715: dread d5/d11/f45 [0,4194304] 0 2024-09-21T08:02:37.143 INFO:tasks.workunit.client.0.smithi107.stdout:2/26: symlink d1/l4 0 2024-09-21T08:02:37.143 INFO:tasks.workunit.client.0.smithi107.stdout:2/27: fsync f0 0 2024-09-21T08:02:37.144 INFO:tasks.workunit.client.1.smithi129.stdout:9/726: rmdir d17/d22/d33/d7a/d89/d90/db1/d31/d5e 39 2024-09-21T08:02:37.146 INFO:tasks.workunit.client.1.smithi129.stdout:3/833: mknod d3/da/dc/d11/d2f/c125 0 2024-09-21T08:02:37.146 INFO:tasks.workunit.client.1.smithi129.stdout:3/834: getdents d3/d69/d95/de1/df1 0 2024-09-21T08:02:37.147 INFO:tasks.workunit.client.1.smithi129.stdout:4/716: creat d5/d11/d77/da8/f100 x:0 0 0 2024-09-21T08:02:37.147 INFO:tasks.workunit.client.1.smithi129.stdout:4/717: chown d5/d48/ldf 499782174 1 2024-09-21T08:02:37.148 INFO:tasks.workunit.client.1.smithi129.stdout:6/723: dread d7/d1b/d1e/d39/d4b/f1d [4194304,4194304] 0 2024-09-21T08:02:37.148 INFO:tasks.workunit.client.0.smithi107.stdout:2/28: dread f0 [0,4194304] 0 2024-09-21T08:02:37.149 INFO:tasks.workunit.client.1.smithi129.stdout:6/724: creat d7/d1b/d1e/d66/ff6 x:0 0 0 2024-09-21T08:02:37.150 INFO:tasks.workunit.client.1.smithi129.stdout:1/850: dwrite d1/d4/dc2/dc6/fac [0,4194304] 0 2024-09-21T08:02:37.151 INFO:tasks.workunit.client.1.smithi129.stdout:7/954: write d0/d71/f7f [1030081,34450] 0 2024-09-21T08:02:37.151 INFO:tasks.workunit.client.0.smithi107.stdout:2/29: creat d1/d2/f5 x:0 0 0 2024-09-21T08:02:37.154 INFO:tasks.workunit.client.1.smithi129.stdout:6/725: symlink d7/d1b/d1e/d39/d4b/de8/d69/lf7 0 2024-09-21T08:02:37.156 INFO:tasks.workunit.client.1.smithi129.stdout:3/835: write d3/d5a/fbc [1159248,6998] 0 2024-09-21T08:02:37.157 INFO:tasks.workunit.client.1.smithi129.stdout:3/836: chown d3/d69/d95/de1 5641 1 2024-09-21T08:02:37.157 INFO:tasks.workunit.client.1.smithi129.stdout:3/837: chown d3/da/dc/d7f/dd6/de2/d120/da2/fe3 23592324 1 2024-09-21T08:02:37.157 INFO:tasks.workunit.client.0.smithi107.stdout:2/30: mkdir d1/d6 0 2024-09-21T08:02:37.158 INFO:tasks.workunit.client.1.smithi129.stdout:8/692: dwrite d0/d6/d7/d9/fbe [0,4194304] 0 2024-09-21T08:02:37.158 INFO:tasks.workunit.client.1.smithi129.stdout:8/693: chown d0/d6/d7/d18/d27/d32/d37/f63 5998 1 2024-09-21T08:02:37.160 INFO:tasks.workunit.client.0.smithi107.stdout:2/31: creat d1/d6/f7 x:0 0 0 2024-09-21T08:02:37.160 INFO:tasks.workunit.client.0.smithi107.stdout:2/32: creat d1/d6/f8 x:0 0 0 2024-09-21T08:02:37.160 INFO:tasks.workunit.client.0.smithi107.stdout:2/33: creat d1/d2/f9 x:0 0 0 2024-09-21T08:02:37.160 INFO:tasks.workunit.client.0.smithi107.stdout:2/34: creat d1/d6/fa x:0 0 0 2024-09-21T08:02:37.161 INFO:tasks.workunit.client.0.smithi107.stdout:2/35: rename d1 to d1/db 22 2024-09-21T08:02:37.161 INFO:tasks.workunit.client.1.smithi129.stdout:1/851: symlink d1/d7a/da4/l120 0 2024-09-21T08:02:37.161 INFO:tasks.workunit.client.1.smithi129.stdout:6/726: symlink d7/d1b/d1e/d66/dc2/d93/dd5/de6/lf8 0 2024-09-21T08:02:37.162 INFO:tasks.workunit.client.1.smithi129.stdout:3/838: truncate d3/da/f19 674845 0 2024-09-21T08:02:37.167 INFO:tasks.workunit.client.1.smithi129.stdout:7/955: read d0/d1e/d9a/dca/d100/d8f/f98 [2139470,19786] 0 2024-09-21T08:02:37.167 INFO:tasks.workunit.client.1.smithi129.stdout:7/956: chown d0/d1e/d9a/dca/d100/c91 530607284 1 2024-09-21T08:02:37.167 INFO:tasks.workunit.client.1.smithi129.stdout:8/694: dread d0/f2b [0,4194304] 0 2024-09-21T08:02:37.167 INFO:tasks.workunit.client.1.smithi129.stdout:1/852: readlink d1/d4/dc2/dc6/l76 0 2024-09-21T08:02:37.168 INFO:tasks.workunit.client.1.smithi129.stdout:6/727: fsync d7/d10/f19 0 2024-09-21T08:02:37.169 INFO:tasks.workunit.client.1.smithi129.stdout:6/728: write d7/d1b/d1e/d39/d4b/f4d [4898813,73177] 0 2024-09-21T08:02:37.171 INFO:tasks.workunit.client.1.smithi129.stdout:7/957: symlink d0/d1e/l147 0 2024-09-21T08:02:37.172 INFO:tasks.workunit.client.1.smithi129.stdout:8/695: truncate d0/d6/d7/d18/d27/d60/d97/fa2 1021938 0 2024-09-21T08:02:37.172 INFO:tasks.workunit.client.1.smithi129.stdout:8/696: chown d0/d6/d7/d9/c1e 12683618 1 2024-09-21T08:02:37.175 INFO:tasks.workunit.client.1.smithi129.stdout:7/958: rename d0/d1e/l49 to d0/d46/d6e/dad/df6/l148 0 2024-09-21T08:02:37.176 INFO:tasks.workunit.client.1.smithi129.stdout:4/718: dwrite d5/d16/d24/d3b/f65 [0,4194304] 0 2024-09-21T08:02:37.177 INFO:tasks.workunit.client.1.smithi129.stdout:9/727: dwrite d17/d22/d33/d7a/d89/d90/db1/d31/d5e/fc1 [0,4194304] 0 2024-09-21T08:02:37.178 INFO:tasks.workunit.client.1.smithi129.stdout:9/728: truncate d17/d60/d7b/dc4/fb8 889822 0 2024-09-21T08:02:37.178 INFO:tasks.workunit.client.1.smithi129.stdout:7/959: rmdir d0/d46/d6e/d9b/da5/d136 0 2024-09-21T08:02:37.180 INFO:tasks.workunit.client.1.smithi129.stdout:0/764: sync 2024-09-21T08:02:37.180 INFO:tasks.workunit.client.1.smithi129.stdout:8/697: link d0/d6/dac/cc7 d0/d6/d7/d18/cce 0 2024-09-21T08:02:37.184 INFO:tasks.workunit.client.1.smithi129.stdout:4/719: mknod d5/d48/da9/c101 0 2024-09-21T08:02:37.185 INFO:tasks.workunit.client.1.smithi129.stdout:5/869: dwrite d2/d1e/d35/f2b [0,4194304] 0 2024-09-21T08:02:37.185 INFO:tasks.workunit.client.1.smithi129.stdout:3/839: dread d3/da/d5d/d94/f104 [0,4194304] 0 2024-09-21T08:02:37.186 INFO:tasks.workunit.client.1.smithi129.stdout:3/840: fsync d3/da/dc/d11/d2f/ff4 0 2024-09-21T08:02:37.189 INFO:tasks.workunit.client.1.smithi129.stdout:9/729: mknod d17/d22/d33/da5/cf2 0 2024-09-21T08:02:37.189 INFO:tasks.workunit.client.1.smithi129.stdout:9/730: stat d17/d22/d33/d36/d48/d75 0 2024-09-21T08:02:37.190 INFO:tasks.workunit.client.1.smithi129.stdout:7/960: mkdir d0/d1e/d9a/d9f/d13c/d149 0 2024-09-21T08:02:37.192 INFO:tasks.workunit.client.1.smithi129.stdout:0/765: creat de/d15/d39/d9e/ff6 x:0 0 0 2024-09-21T08:02:37.192 INFO:tasks.workunit.client.1.smithi129.stdout:0/766: fsync de/d15/d51/f8b 0 2024-09-21T08:02:37.194 INFO:tasks.workunit.client.1.smithi129.stdout:1/853: dwrite d1/d4/dc2/dc6/fac [0,4194304] 0 2024-09-21T08:02:37.194 INFO:tasks.workunit.client.1.smithi129.stdout:1/854: chown d1/d4/dc2/dc6/l76 12484 1 2024-09-21T08:02:37.194 INFO:tasks.workunit.client.1.smithi129.stdout:1/855: write d1/d44/d83/fea [794925,15259] 0 2024-09-21T08:02:37.196 INFO:tasks.workunit.client.1.smithi129.stdout:3/841: rename d3/d69/d95/d52/f9c to d3/da/dc/d7f/dd6/de2/d120/d80/f126 0 2024-09-21T08:02:37.198 INFO:tasks.workunit.client.1.smithi129.stdout:5/870: mkdir d2/d1e/d35/d37/d96/de5/db1/de7/d113 0 2024-09-21T08:02:37.201 INFO:tasks.workunit.client.1.smithi129.stdout:7/961: symlink d0/dc5/l14a 0 2024-09-21T08:02:37.203 INFO:tasks.workunit.client.1.smithi129.stdout:4/720: getdents d5/d33 0 2024-09-21T08:02:37.205 INFO:tasks.workunit.client.1.smithi129.stdout:3/842: dread d3/da/dc/d7f/fa8 [0,4194304] 0 2024-09-21T08:02:37.206 INFO:tasks.workunit.client.1.smithi129.stdout:1/856: creat d1/d16/dd1/f121 x:0 0 0 2024-09-21T08:02:37.206 INFO:tasks.workunit.client.1.smithi129.stdout:1/857: chown d1/d9/d31/la5 1 1 2024-09-21T08:02:37.206 INFO:tasks.workunit.client.1.smithi129.stdout:1/858: stat d1/d4/d96 0 2024-09-21T08:02:37.206 INFO:tasks.workunit.client.1.smithi129.stdout:1/859: readlink d1/d9/d31/la7 0 2024-09-21T08:02:37.208 INFO:tasks.workunit.client.1.smithi129.stdout:7/962: symlink d0/d120/l14b 0 2024-09-21T08:02:37.209 INFO:tasks.workunit.client.1.smithi129.stdout:8/698: dwrite d0/d6/d7/d18/d27/f2d [0,4194304] 0 2024-09-21T08:02:37.209 INFO:tasks.workunit.client.1.smithi129.stdout:3/843: creat d3/da/dc/d7f/dd6/de2/d120/da2/f127 x:0 0 0 2024-09-21T08:02:37.210 INFO:tasks.workunit.client.1.smithi129.stdout:1/860: getdents d1/d44/d83 0 2024-09-21T08:02:37.211 INFO:tasks.workunit.client.1.smithi129.stdout:5/871: mkdir d2/d1e/d35/d37/d114 0 2024-09-21T08:02:37.212 INFO:tasks.workunit.client.1.smithi129.stdout:5/872: fdatasync d2/d1e/d35/d37/d96/de5/d61/f9d 0 2024-09-21T08:02:37.212 INFO:tasks.workunit.client.1.smithi129.stdout:7/963: creat d0/d46/d6e/d9b/df9/f14c x:0 0 0 2024-09-21T08:02:37.213 INFO:tasks.workunit.client.1.smithi129.stdout:9/731: dwrite d17/d22/d33/da5/fbd [0,4194304] 0 2024-09-21T08:02:37.214 INFO:tasks.workunit.client.0.smithi107.stdout:2/36: getdents d1/d6 0 2024-09-21T08:02:37.215 INFO:tasks.workunit.client.0.smithi107.stdout:2/37: fdatasync d1/d2/f5 0 2024-09-21T08:02:37.215 INFO:tasks.workunit.client.1.smithi129.stdout:1/861: rmdir d1/df1 39 2024-09-21T08:02:37.215 INFO:tasks.workunit.client.1.smithi129.stdout:8/699: link d0/d6/d7/d18/d61/f9d d0/d6/d7/d18/d27/d60/d85/fcf 0 2024-09-21T08:02:37.215 INFO:tasks.workunit.client.1.smithi129.stdout:8/700: write d0/d6/d7/d24/f46 [1766572,125619] 0 2024-09-21T08:02:37.217 INFO:tasks.workunit.client.1.smithi129.stdout:9/732: dread d17/d22/d33/d36/d48/d3f/d53/f7e [0,4194304] 0 2024-09-21T08:02:37.221 INFO:tasks.workunit.client.1.smithi129.stdout:5/873: rename d2/d1e/d35/d37/d96/de5/db1/ca7 to d2/d1e/d35/d33/d36/de0/c115 0 2024-09-21T08:02:37.221 INFO:tasks.workunit.client.1.smithi129.stdout:5/874: write d2/d1e/d35/f40 [8868990,28259] 0 2024-09-21T08:02:37.227 INFO:tasks.workunit.client.1.smithi129.stdout:5/875: symlink d2/d2a/l116 0 2024-09-21T08:02:37.230 INFO:tasks.workunit.client.0.smithi107.stdout:2/38: rmdir d1 39 2024-09-21T08:02:37.230 INFO:tasks.workunit.client.0.smithi107.stdout:2/39: rename d1 to d1/d2/dc 22 2024-09-21T08:02:37.230 INFO:tasks.workunit.client.0.smithi107.stdout:2/40: chown d1/d2/f5 9765158 1 2024-09-21T08:02:37.232 INFO:tasks.workunit.client.1.smithi129.stdout:9/733: dread d17/d22/d33/d36/d48/d75/f7d [0,4194304] 0 2024-09-21T08:02:37.233 INFO:tasks.workunit.client.1.smithi129.stdout:9/734: mknod d17/d22/d33/d7a/d89/d90/cf3 0 2024-09-21T08:02:37.239 INFO:tasks.workunit.client.1.smithi129.stdout:7/964: dread d0/d46/f47 [0,4194304] 0 2024-09-21T08:02:37.239 INFO:tasks.workunit.client.1.smithi129.stdout:7/965: write d0/f22 [7489571,17949] 0 2024-09-21T08:02:37.239 INFO:tasks.workunit.client.1.smithi129.stdout:7/966: chown d0/d46/dd3 1 1 2024-09-21T08:02:37.240 INFO:tasks.workunit.client.1.smithi129.stdout:5/876: dread d2/d1e/d35/d37/d96/de5/fbe [0,4194304] 0 2024-09-21T08:02:37.243 INFO:tasks.workunit.client.1.smithi129.stdout:8/701: dwrite d0/d6/d7/d18/d27/d32/d37/f42 [0,4194304] 0 2024-09-21T08:02:37.243 INFO:tasks.workunit.client.1.smithi129.stdout:7/967: dread d0/d1e/f8b [0,4194304] 0 2024-09-21T08:02:37.243 INFO:tasks.workunit.client.1.smithi129.stdout:7/968: readlink d0/d1e/db1/l13e 0 2024-09-21T08:02:37.244 INFO:tasks.workunit.client.1.smithi129.stdout:9/735: write d17/d22/d33/d7a/d89/fb4 [131234,116897] 0 2024-09-21T08:02:37.245 INFO:tasks.workunit.client.0.smithi107.stdout:5/69: sync 2024-09-21T08:02:37.245 INFO:tasks.workunit.client.0.smithi107.stdout:6/46: sync 2024-09-21T08:02:37.245 INFO:tasks.workunit.client.0.smithi107.stdout:7/101: sync 2024-09-21T08:02:37.245 INFO:tasks.workunit.client.0.smithi107.stdout:0/127: sync 2024-09-21T08:02:37.245 INFO:tasks.workunit.client.0.smithi107.stdout:0/128: read - d1/d15/f1f zero size 2024-09-21T08:02:37.245 INFO:tasks.workunit.client.0.smithi107.stdout:4/45: sync 2024-09-21T08:02:37.245 INFO:tasks.workunit.client.0.smithi107.stdout:1/60: sync 2024-09-21T08:02:37.245 INFO:tasks.workunit.client.0.smithi107.stdout:4/46: creat fa x:0 0 0 2024-09-21T08:02:37.245 INFO:tasks.workunit.client.0.smithi107.stdout:4/47: stat c3 0 2024-09-21T08:02:37.245 INFO:tasks.workunit.client.0.smithi107.stdout:4/48: truncate fa 721709 0 2024-09-21T08:02:37.245 INFO:tasks.workunit.client.0.smithi107.stdout:4/49: creat fb x:0 0 0 2024-09-21T08:02:37.245 INFO:tasks.workunit.client.0.smithi107.stdout:4/50: dread - fb zero size 2024-09-21T08:02:37.245 INFO:tasks.workunit.client.0.smithi107.stdout:4/51: write f8 [1405248,19148] 0 2024-09-21T08:02:37.246 INFO:tasks.workunit.client.0.smithi107.stdout:9/76: sync 2024-09-21T08:02:37.246 INFO:tasks.workunit.client.0.smithi107.stdout:4/52: stat c3 0 2024-09-21T08:02:37.246 INFO:tasks.workunit.client.0.smithi107.stdout:9/77: truncate f10 1276651 0 2024-09-21T08:02:37.246 INFO:tasks.workunit.client.0.smithi107.stdout:3/12: sync 2024-09-21T08:02:37.246 INFO:tasks.workunit.client.0.smithi107.stdout:8/12: sync 2024-09-21T08:02:37.247 INFO:tasks.workunit.client.0.smithi107.stdout:1/61: dread d0/f11 [0,4194304] 0 2024-09-21T08:02:37.247 INFO:tasks.workunit.client.0.smithi107.stdout:1/62: write d0/f12 [881345,83300] 0 2024-09-21T08:02:37.247 INFO:tasks.workunit.client.1.smithi129.stdout:3/844: dwrite d3/d90/f123 [0,4194304] 0 2024-09-21T08:02:37.247 INFO:tasks.workunit.client.1.smithi129.stdout:7/969: mkdir d0/d1e/db1/dba/d14d 0 2024-09-21T08:02:37.247 INFO:tasks.workunit.client.1.smithi129.stdout:4/721: dwrite d5/d16/d24/d4f/da1/f62 [0,4194304] 0 2024-09-21T08:02:37.247 INFO:tasks.workunit.client.1.smithi129.stdout:1/862: dwrite d1/d9/fc7 [4194304,4194304] 0 2024-09-21T08:02:37.249 INFO:tasks.workunit.client.1.smithi129.stdout:9/736: mknod d17/d22/d33/d36/de4/cf4 0 2024-09-21T08:02:37.249 INFO:tasks.workunit.client.1.smithi129.stdout:3/845: dread d3/f63 [0,4194304] 0 2024-09-21T08:02:37.250 INFO:tasks.workunit.client.0.smithi107.stdout:7/102: symlink d7/d18/l26 0 2024-09-21T08:02:37.252 INFO:tasks.workunit.client.0.smithi107.stdout:0/129: dread d1/d15/f1d [0,4194304] 0 2024-09-21T08:02:37.253 INFO:tasks.workunit.client.1.smithi129.stdout:7/970: rename d0/d1e/d9a/dca/d100/d8f/fe1 to d0/d1e/db1/f14e 0 2024-09-21T08:02:37.253 INFO:tasks.workunit.client.1.smithi129.stdout:7/971: creat d0/d1e/d9a/d9f/f14f x:0 0 0 2024-09-21T08:02:37.253 INFO:tasks.workunit.client.1.smithi129.stdout:7/972: getdents d0/d1e/d9a/d9f/d13c/d149 0 2024-09-21T08:02:37.253 INFO:tasks.workunit.client.1.smithi129.stdout:7/973: fdatasync d0/d1e/db1/dba/f13f 0 2024-09-21T08:02:37.256 INFO:tasks.workunit.client.0.smithi107.stdout:6/47: creat d2/d3/d7/f8 x:0 0 0 2024-09-21T08:02:37.256 INFO:tasks.workunit.client.1.smithi129.stdout:8/702: write d0/d6/d7/f21 [3338150,4882] 0 2024-09-21T08:02:37.260 INFO:tasks.workunit.client.1.smithi129.stdout:4/722: creat d5/d33/f102 x:0 0 0 2024-09-21T08:02:37.263 INFO:tasks.workunit.client.0.smithi107.stdout:9/78: rename d11/l12 to d11/l16 0 2024-09-21T08:02:37.265 INFO:tasks.workunit.client.1.smithi129.stdout:1/863: unlink d1/d4/fc0 0 2024-09-21T08:02:37.266 INFO:tasks.workunit.client.0.smithi107.stdout:3/13: creat f2 x:0 0 0 2024-09-21T08:02:37.266 INFO:tasks.workunit.client.0.smithi107.stdout:3/14: read - f2 zero size 2024-09-21T08:02:37.267 INFO:tasks.workunit.client.1.smithi129.stdout:3/846: dread d3/da/dc/d7f/dd6/fe7 [0,4194304] 0 2024-09-21T08:02:37.267 INFO:tasks.workunit.client.0.smithi107.stdout:8/13: symlink d5/l8 0 2024-09-21T08:02:37.271 INFO:tasks.workunit.client.0.smithi107.stdout:0/130: link d1/f8 d1/d5/f2c 0 2024-09-21T08:02:37.275 INFO:tasks.workunit.client.1.smithi129.stdout:4/723: mknod d5/d33/d6d/c103 0 2024-09-21T08:02:37.276 INFO:tasks.workunit.client.0.smithi107.stdout:9/79: mknod d11/c17 0 2024-09-21T08:02:37.278 INFO:tasks.workunit.client.1.smithi129.stdout:1/864: rmdir d1/d7a/da4/dfe 0 2024-09-21T08:02:37.279 INFO:tasks.workunit.client.0.smithi107.stdout:3/15: rename c1 to c3 0 2024-09-21T08:02:37.279 INFO:tasks.workunit.client.0.smithi107.stdout:3/16: chown f2 52 1 2024-09-21T08:02:37.279 INFO:tasks.workunit.client.1.smithi129.stdout:1/865: dread d1/d9/d31/fb7 [0,4194304] 0 2024-09-21T08:02:37.280 INFO:tasks.workunit.client.1.smithi129.stdout:1/866: stat d1/d7a/da4/d107/f10f 0 2024-09-21T08:02:37.280 INFO:tasks.workunit.client.1.smithi129.stdout:1/867: write d1/d9/fbc [463647,52444] 0 2024-09-21T08:02:37.280 INFO:tasks.workunit.client.1.smithi129.stdout:3/847: getdents d3/da/d5d/d94/dac/dfa 0 2024-09-21T08:02:37.280 INFO:tasks.workunit.client.0.smithi107.stdout:8/14: mknod d5/c9 0 2024-09-21T08:02:37.280 INFO:tasks.workunit.client.0.smithi107.stdout:8/15: chown f4 866154 1 2024-09-21T08:02:37.280 INFO:tasks.workunit.client.0.smithi107.stdout:8/16: chown f4 0 1 2024-09-21T08:02:37.280 INFO:tasks.workunit.client.0.smithi107.stdout:8/17: truncate f3 264277 0 2024-09-21T08:02:37.281 INFO:tasks.workunit.client.1.smithi129.stdout:3/848: dread d3/da/dc/d7f/fd0 [0,4194304] 0 2024-09-21T08:02:37.281 INFO:tasks.workunit.client.1.smithi129.stdout:7/974: getdents d0/d46/d6e 0 2024-09-21T08:02:37.282 INFO:tasks.workunit.client.0.smithi107.stdout:0/131: mkdir d1/d5/d25/d2d 0 2024-09-21T08:02:37.284 INFO:tasks.workunit.client.0.smithi107.stdout:6/48: getdents d2/d3/d7 0 2024-09-21T08:02:37.284 INFO:tasks.workunit.client.0.smithi107.stdout:6/49: creat d2/d3/f9 x:0 0 0 2024-09-21T08:02:37.284 INFO:tasks.workunit.client.1.smithi129.stdout:1/868: dread d1/f3f [0,4194304] 0 2024-09-21T08:02:37.285 INFO:tasks.workunit.client.1.smithi129.stdout:4/724: symlink d5/d16/d47/d5f/d64/l104 0 2024-09-21T08:02:37.286 INFO:tasks.workunit.client.1.smithi129.stdout:4/725: read d5/d6/f7f [66957,130936] 0 2024-09-21T08:02:37.286 INFO:tasks.workunit.client.1.smithi129.stdout:4/726: creat d5/d16/d24/d4f/da1/dcf/f105 x:0 0 0 2024-09-21T08:02:37.286 INFO:tasks.workunit.client.0.smithi107.stdout:9/80: rename d11/f15 to d11/f18 0 2024-09-21T08:02:37.286 INFO:tasks.workunit.client.0.smithi107.stdout:9/81: creat d11/f19 x:0 0 0 2024-09-21T08:02:37.287 INFO:tasks.workunit.client.0.smithi107.stdout:0/132: dread d1/d15/f1d [0,4194304] 0 2024-09-21T08:02:37.287 INFO:tasks.workunit.client.0.smithi107.stdout:0/133: stat d1/d5/f27 0 2024-09-21T08:02:37.287 INFO:tasks.workunit.client.1.smithi129.stdout:3/849: symlink d3/da/dc/d7f/dd6/de2/d120/l128 0 2024-09-21T08:02:37.288 INFO:tasks.workunit.client.1.smithi129.stdout:3/850: stat d3/da/dc/d11/l7e 0 2024-09-21T08:02:37.290 INFO:tasks.workunit.client.1.smithi129.stdout:7/975: rename d0/d71/l87 to d0/d46/de0/l150 0 2024-09-21T08:02:37.291 INFO:tasks.workunit.client.0.smithi107.stdout:8/18: rename f2 to d5/fa 0 2024-09-21T08:02:37.292 INFO:tasks.workunit.client.1.smithi129.stdout:1/869: truncate d1/d4/d96/f10d 327497 0 2024-09-21T08:02:37.294 INFO:tasks.workunit.client.0.smithi107.stdout:7/103: write d7/f8 [8228614,113743] 0 2024-09-21T08:02:37.294 INFO:tasks.workunit.client.0.smithi107.stdout:5/70: dwrite d7/de/f16 [4194304,4194304] 0 2024-09-21T08:02:37.295 INFO:tasks.workunit.client.0.smithi107.stdout:1/63: dwrite d0/fc [4194304,4194304] 0 2024-09-21T08:02:37.295 INFO:tasks.workunit.client.0.smithi107.stdout:4/53: dwrite f6 [0,4194304] 0 2024-09-21T08:02:37.296 INFO:tasks.workunit.client.1.smithi129.stdout:9/737: dwrite f10 [0,4194304] 0 2024-09-21T08:02:37.296 INFO:tasks.workunit.client.1.smithi129.stdout:9/738: chown d17/d60/d97/fe9 14807921 1 2024-09-21T08:02:37.296 INFO:tasks.workunit.client.1.smithi129.stdout:5/877: dwrite d2/f4 [0,4194304] 0 2024-09-21T08:02:37.296 INFO:tasks.workunit.client.1.smithi129.stdout:5/878: write d2/d2a/fea [87362,79381] 0 2024-09-21T08:02:37.297 INFO:tasks.workunit.client.1.smithi129.stdout:4/727: unlink d5/d33/f102 0 2024-09-21T08:02:37.300 INFO:tasks.workunit.client.0.smithi107.stdout:9/82: link lc d11/l1a 0 2024-09-21T08:02:37.301 INFO:tasks.workunit.client.1.smithi129.stdout:3/851: getdents d3/d69/d95 0 2024-09-21T08:02:37.303 INFO:tasks.workunit.client.0.smithi107.stdout:0/134: creat d1/d15/d20/d29/f2e x:0 0 0 2024-09-21T08:02:37.303 INFO:tasks.workunit.client.0.smithi107.stdout:0/135: readlink d1/d5/d25/l13 0 2024-09-21T08:02:37.305 INFO:tasks.workunit.client.1.smithi129.stdout:7/976: creat d0/d46/d6e/dad/d131/f151 x:0 0 0 2024-09-21T08:02:37.306 INFO:tasks.workunit.client.0.smithi107.stdout:3/17: getdents . 0 2024-09-21T08:02:37.310 INFO:tasks.workunit.client.0.smithi107.stdout:6/50: rename d2/c5 to d2/d3/d7/ca 0 2024-09-21T08:02:37.310 INFO:tasks.workunit.client.0.smithi107.stdout:6/51: read - d2/d3/f9 zero size 2024-09-21T08:02:37.312 INFO:tasks.workunit.client.1.smithi129.stdout:5/879: dread d2/f4 [0,4194304] 0 2024-09-21T08:02:37.313 INFO:tasks.workunit.client.0.smithi107.stdout:7/104: write d7/d10/f17 [101986,114587] 0 2024-09-21T08:02:37.314 INFO:tasks.workunit.client.1.smithi129.stdout:9/739: creat d17/ff5 x:0 0 0 2024-09-21T08:02:37.314 INFO:tasks.workunit.client.1.smithi129.stdout:9/740: truncate d17/ff5 976379 0 2024-09-21T08:02:37.316 INFO:tasks.workunit.client.0.smithi107.stdout:1/64: symlink d0/l14 0 2024-09-21T08:02:37.316 INFO:tasks.workunit.client.0.smithi107.stdout:1/65: chown d0/fc 6 1 2024-09-21T08:02:37.318 INFO:tasks.workunit.client.0.smithi107.stdout:1/66: dread d0/f11 [0,4194304] 0 2024-09-21T08:02:37.318 INFO:tasks.workunit.client.0.smithi107.stdout:1/67: chown d0/d7/le 1934748 1 2024-09-21T08:02:37.318 INFO:tasks.workunit.client.0.smithi107.stdout:4/54: mkdir dc 0 2024-09-21T08:02:37.318 INFO:tasks.workunit.client.0.smithi107.stdout:5/71: dwrite d7/ff [0,4194304] 0 2024-09-21T08:02:37.318 INFO:tasks.workunit.client.0.smithi107.stdout:5/72: dread - d7/f11 zero size 2024-09-21T08:02:37.319 INFO:tasks.workunit.client.0.smithi107.stdout:9/83: unlink f3 0 2024-09-21T08:02:37.322 INFO:tasks.workunit.client.0.smithi107.stdout:9/84: dread f10 [0,4194304] 0 2024-09-21T08:02:37.322 INFO:tasks.workunit.client.0.smithi107.stdout:9/85: creat d11/f1b x:0 0 0 2024-09-21T08:02:37.322 INFO:tasks.workunit.client.0.smithi107.stdout:9/86: stat c2 0 2024-09-21T08:02:37.322 INFO:tasks.workunit.client.0.smithi107.stdout:9/87: creat d11/f1c x:0 0 0 2024-09-21T08:02:37.322 INFO:tasks.workunit.client.0.smithi107.stdout:3/18: link f2 f4 0 2024-09-21T08:02:37.322 INFO:tasks.workunit.client.0.smithi107.stdout:6/52: write d2/d3/f6 [7314024,78910] 0 2024-09-21T08:02:37.323 INFO:tasks.workunit.client.0.smithi107.stdout:8/19: getdents d5 0 2024-09-21T08:02:37.328 INFO:tasks.workunit.client.0.smithi107.stdout:1/68: symlink d0/l15 0 2024-09-21T08:02:37.328 INFO:tasks.workunit.client.1.smithi129.stdout:7/977: mkdir d0/d1e/d9a/dca/d100/d152 0 2024-09-21T08:02:37.328 INFO:tasks.workunit.client.1.smithi129.stdout:5/880: getdents d2/d1e/d35/d37/d96/de5 0 2024-09-21T08:02:37.329 INFO:tasks.workunit.client.1.smithi129.stdout:3/852: dwrite d3/d69/d98/ffe [0,4194304] 0 2024-09-21T08:02:37.329 INFO:tasks.workunit.client.0.smithi107.stdout:0/136: dwrite d1/d5/f24 [4194304,4194304] 0 2024-09-21T08:02:37.329 INFO:tasks.workunit.client.1.smithi129.stdout:1/870: dwrite d1/f12 [0,4194304] 0 2024-09-21T08:02:37.330 INFO:tasks.workunit.client.0.smithi107.stdout:4/55: mknod dc/cd 0 2024-09-21T08:02:37.331 INFO:tasks.workunit.client.1.smithi129.stdout:7/978: truncate d0/d1e/db1/dba/dc1/dc4/fdd 915295 0 2024-09-21T08:02:37.332 INFO:tasks.workunit.client.0.smithi107.stdout:5/73: rmdir d7 39 2024-09-21T08:02:37.332 INFO:tasks.workunit.client.0.smithi107.stdout:5/74: write d7/f11 [157245,40320] 0 2024-09-21T08:02:37.333 INFO:tasks.workunit.client.1.smithi129.stdout:9/741: write d17/f83 [1810220,51138] 0 2024-09-21T08:02:37.340 INFO:tasks.workunit.client.0.smithi107.stdout:9/88: truncate fa 1912857 0 2024-09-21T08:02:37.342 INFO:tasks.workunit.client.0.smithi107.stdout:3/19: dread - f2 zero size 2024-09-21T08:02:37.342 INFO:tasks.workunit.client.0.smithi107.stdout:3/20: chown f2 6320274 1 2024-09-21T08:02:37.343 INFO:tasks.workunit.client.0.smithi107.stdout:3/21: fdatasync f2 0 2024-09-21T08:02:37.345 INFO:tasks.workunit.client.0.smithi107.stdout:8/20: mknod d5/cb 0 2024-09-21T08:02:37.345 INFO:tasks.workunit.client.1.smithi129.stdout:7/979: truncate d0/d46/d6e/dad/fce 2077196 0 2024-09-21T08:02:37.346 INFO:tasks.workunit.client.1.smithi129.stdout:7/980: stat d0/d71/cf1 0 2024-09-21T08:02:37.346 INFO:tasks.workunit.client.1.smithi129.stdout:7/981: stat d0/d1e/d9a/dca/d100/d8f/fa6 0 2024-09-21T08:02:37.346 INFO:tasks.workunit.client.1.smithi129.stdout:7/982: write d0/d46/d6e/d9b/da5/db7/fd1 [610781,35791] 0 2024-09-21T08:02:37.346 INFO:tasks.workunit.client.0.smithi107.stdout:0/137: write d1/d5/f24 [5490802,110173] 0 2024-09-21T08:02:37.347 INFO:tasks.workunit.client.1.smithi129.stdout:9/742: mknod d17/d22/d33/d36/d48/db7/dc9/cf6 0 2024-09-21T08:02:37.349 INFO:tasks.workunit.client.0.smithi107.stdout:1/69: mknod d0/c16 0 2024-09-21T08:02:37.349 INFO:tasks.workunit.client.0.smithi107.stdout:1/70: chown d0/d7 14804 1 2024-09-21T08:02:37.350 INFO:tasks.workunit.client.1.smithi129.stdout:3/853: write d3/da/dc/d7f/dd6/de2/d120/fc4 [2842276,38223] 0 2024-09-21T08:02:37.350 INFO:tasks.workunit.client.1.smithi129.stdout:3/854: readlink d3/d5a/da9/l122 0 2024-09-21T08:02:37.350 INFO:tasks.workunit.client.1.smithi129.stdout:3/855: read d3/da/dc/d11/d55/d68/f6f [848008,51190] 0 2024-09-21T08:02:37.351 INFO:tasks.workunit.client.0.smithi107.stdout:6/53: dwrite d2/d3/f4 [0,4194304] 0 2024-09-21T08:02:37.353 INFO:tasks.workunit.client.1.smithi129.stdout:1/871: getdents d1/d16 0 2024-09-21T08:02:37.353 INFO:tasks.workunit.client.1.smithi129.stdout:3/856: dread d3/faa [0,4194304] 0 2024-09-21T08:02:37.355 INFO:tasks.workunit.client.0.smithi107.stdout:4/56: creat dc/fe x:0 0 0 2024-09-21T08:02:37.355 INFO:tasks.workunit.client.0.smithi107.stdout:4/57: write fb [813284,124935] 0 2024-09-21T08:02:37.356 INFO:tasks.workunit.client.0.smithi107.stdout:4/58: write fa [212685,20539] 0 2024-09-21T08:02:37.357 INFO:tasks.workunit.client.1.smithi129.stdout:9/743: rmdir d17/d22/d33/d7a/d89/d90/db1/d31/ddc 0 2024-09-21T08:02:37.362 INFO:tasks.workunit.client.0.smithi107.stdout:5/75: rename d7/c14 to d7/de/c17 0 2024-09-21T08:02:37.367 INFO:tasks.workunit.client.0.smithi107.stdout:1/71: symlink d0/d7/l17 0 2024-09-21T08:02:37.369 INFO:tasks.workunit.client.1.smithi129.stdout:3/857: read d3/da/dc/d7f/dd6/de2/df2/f11c [2216717,105402] 0 2024-09-21T08:02:37.369 INFO:tasks.workunit.client.1.smithi129.stdout:3/858: creat d3/da/dc/d7f/dd6/de2/d120/da2/f129 x:0 0 0 2024-09-21T08:02:37.369 INFO:tasks.workunit.client.0.smithi107.stdout:6/54: creat d2/fb x:0 0 0 2024-09-21T08:02:37.370 INFO:tasks.workunit.client.0.smithi107.stdout:6/55: write d2/d3/f9 [188452,25989] 0 2024-09-21T08:02:37.373 INFO:tasks.workunit.client.1.smithi129.stdout:3/859: mknod d3/d5a/c12a 0 2024-09-21T08:02:37.373 INFO:tasks.workunit.client.1.smithi129.stdout:3/860: creat d3/d5a/da9/f12b x:0 0 0 2024-09-21T08:02:37.373 INFO:tasks.workunit.client.1.smithi129.stdout:3/861: chown d3/da/dc/d7f/dd6/de2/df2/f10c 7 1 2024-09-21T08:02:37.373 INFO:tasks.workunit.client.1.smithi129.stdout:3/862: chown d3/da/dc/d11/f124 8033354 1 2024-09-21T08:02:37.373 INFO:tasks.workunit.client.1.smithi129.stdout:3/863: write d3/da/dc/d11/fed [1666830,49014] 0 2024-09-21T08:02:37.375 INFO:tasks.workunit.client.0.smithi107.stdout:4/59: rename l4 to dc/lf 0 2024-09-21T08:02:37.375 INFO:tasks.workunit.client.0.smithi107.stdout:4/60: read f7 [130214,80437] 0 2024-09-21T08:02:37.375 INFO:tasks.workunit.client.0.smithi107.stdout:4/61: chown dc/cd 4132 1 2024-09-21T08:02:37.375 INFO:tasks.workunit.client.0.smithi107.stdout:4/62: fdatasync f6 0 2024-09-21T08:02:37.375 INFO:tasks.workunit.client.0.smithi107.stdout:4/63: fdatasync f8 0 2024-09-21T08:02:37.375 INFO:tasks.workunit.client.0.smithi107.stdout:4/64: chown c2 40935 1 2024-09-21T08:02:37.375 INFO:tasks.workunit.client.0.smithi107.stdout:4/65: stat f7 0 2024-09-21T08:02:37.375 INFO:tasks.workunit.client.0.smithi107.stdout:1/72: dread d0/f12 [0,4194304] 0 2024-09-21T08:02:37.376 INFO:tasks.workunit.client.0.smithi107.stdout:5/76: truncate d7/de/f10 223127 0 2024-09-21T08:02:37.376 INFO:tasks.workunit.client.0.smithi107.stdout:5/77: creat d7/de/f18 x:0 0 0 2024-09-21T08:02:37.376 INFO:tasks.workunit.client.0.smithi107.stdout:5/78: creat d7/de/f19 x:0 0 0 2024-09-21T08:02:37.377 INFO:tasks.workunit.client.1.smithi129.stdout:3/864: creat d3/da/d5d/d94/db3/dc3/d115/d121/f12c x:0 0 0 2024-09-21T08:02:37.377 INFO:tasks.workunit.client.1.smithi129.stdout:3/865: chown d3/da/d5d/d94 1 1 2024-09-21T08:02:37.377 INFO:tasks.workunit.client.1.smithi129.stdout:3/866: chown d3/da/dc/fbd 32872672 1 2024-09-21T08:02:37.378 INFO:tasks.workunit.client.0.smithi107.stdout:3/22: mkdir d5 0 2024-09-21T08:02:37.378 INFO:tasks.workunit.client.0.smithi107.stdout:3/23: stat f4 0 2024-09-21T08:02:37.378 INFO:tasks.workunit.client.0.smithi107.stdout:3/24: dread - f2 zero size 2024-09-21T08:02:37.380 INFO:tasks.workunit.client.0.smithi107.stdout:6/56: symlink d2/d3/lc 0 2024-09-21T08:02:37.380 INFO:tasks.workunit.client.0.smithi107.stdout:6/57: readlink l0 0 2024-09-21T08:02:37.380 INFO:tasks.workunit.client.0.smithi107.stdout:6/58: creat d2/fd x:0 0 0 2024-09-21T08:02:37.380 INFO:tasks.workunit.client.0.smithi107.stdout:6/59: truncate d2/d3/d7/f8 743379 0 2024-09-21T08:02:37.380 INFO:tasks.workunit.client.0.smithi107.stdout:6/60: write d2/d3/d7/f8 [1744426,34833] 0 2024-09-21T08:02:37.381 INFO:tasks.workunit.client.1.smithi129.stdout:3/867: symlink d3/da/dc/d7f/dd6/de2/d120/d80/d11b/l12d 0 2024-09-21T08:02:37.381 INFO:tasks.workunit.client.1.smithi129.stdout:3/868: readlink d3/da/d5d/lf7 0 2024-09-21T08:02:37.381 INFO:tasks.workunit.client.1.smithi129.stdout:3/869: write d3/da/dc/d7f/dd6/de2/df2/f11c [1372383,72617] 0 2024-09-21T08:02:37.382 INFO:tasks.workunit.client.0.smithi107.stdout:1/73: mknod d0/d7/c18 0 2024-09-21T08:02:37.386 INFO:tasks.workunit.client.1.smithi129.stdout:6/729: sync 2024-09-21T08:02:37.388 INFO:tasks.workunit.client.0.smithi107.stdout:5/79: rmdir d7 39 2024-09-21T08:02:37.388 INFO:tasks.workunit.client.1.smithi129.stdout:5/881: dwrite d2/d1e/d35/d37/d96/de5/d61/fad [0,4194304] 0 2024-09-21T08:02:37.389 INFO:tasks.workunit.client.0.smithi107.stdout:4/66: write f6 [129676,24833] 0 2024-09-21T08:02:37.389 INFO:tasks.workunit.client.0.smithi107.stdout:4/67: stat l9 0 2024-09-21T08:02:37.390 INFO:tasks.workunit.client.0.smithi107.stdout:3/25: rmdir d5 0 2024-09-21T08:02:37.390 INFO:tasks.workunit.client.0.smithi107.stdout:3/26: write f4 [211056,113726] 0 2024-09-21T08:02:37.391 INFO:tasks.workunit.client.1.smithi129.stdout:9/744: fsync d17/f83 0 2024-09-21T08:02:37.391 INFO:tasks.workunit.client.0.smithi107.stdout:8/21: dwrite d5/fa [0,4194304] 0 2024-09-21T08:02:37.393 INFO:tasks.workunit.client.1.smithi129.stdout:3/870: dread d3/da/f19 [0,4194304] 0 2024-09-21T08:02:37.393 INFO:tasks.workunit.client.1.smithi129.stdout:3/871: write d3/da/dc/d11/d55/d68/f87 [3222477,68948] 0 2024-09-21T08:02:37.394 INFO:tasks.workunit.client.0.smithi107.stdout:6/61: fdatasync d2/d3/d7/f8 0 2024-09-21T08:02:37.394 INFO:tasks.workunit.client.0.smithi107.stdout:6/62: creat d2/fe x:0 0 0 2024-09-21T08:02:37.394 INFO:tasks.workunit.client.1.smithi129.stdout:1/872: dwrite d1/d16/d57/f86 [0,4194304] 0 2024-09-21T08:02:37.394 INFO:tasks.workunit.client.1.smithi129.stdout:7/983: dwrite d0/d120/f12a [0,4194304] 0 2024-09-21T08:02:37.396 INFO:tasks.workunit.client.1.smithi129.stdout:6/730: getdents d7/d1b/d57/dd6 0 2024-09-21T08:02:37.396 INFO:tasks.workunit.client.1.smithi129.stdout:6/731: truncate d7/d1b/d1e/d66/dc2/d93/fd9 680722 0 2024-09-21T08:02:37.396 INFO:tasks.workunit.client.1.smithi129.stdout:6/732: creat d7/d1b/d1e/d66/d7c/ff9 x:0 0 0 2024-09-21T08:02:37.397 INFO:tasks.workunit.client.0.smithi107.stdout:9/89: dwrite d11/f1b [0,4194304] 0 2024-09-21T08:02:37.399 INFO:tasks.workunit.client.0.smithi107.stdout:3/27: fsync f2 0 2024-09-21T08:02:37.399 INFO:tasks.workunit.client.0.smithi107.stdout:3/28: fsync f4 0 2024-09-21T08:02:37.399 INFO:tasks.workunit.client.0.smithi107.stdout:9/90: dread f10 [0,4194304] 0 2024-09-21T08:02:37.399 INFO:tasks.workunit.client.1.smithi129.stdout:9/745: unlink d17/d22/d33/d36/d48/d3f/c82 0 2024-09-21T08:02:37.402 INFO:tasks.workunit.client.1.smithi129.stdout:3/872: link d3/da/cd4 d3/d69/d95/de1/c12e 0 2024-09-21T08:02:37.402 INFO:tasks.workunit.client.1.smithi129.stdout:3/873: dread - d3/da/dc/d11/f124 zero size 2024-09-21T08:02:37.402 INFO:tasks.workunit.client.1.smithi129.stdout:3/874: write d3/da/def/ff0 [671695,119006] 0 2024-09-21T08:02:37.403 INFO:tasks.workunit.client.0.smithi107.stdout:3/29: dread f4 [0,4194304] 0 2024-09-21T08:02:37.405 INFO:tasks.workunit.client.1.smithi129.stdout:1/873: mknod d1/d16/d28/c122 0 2024-09-21T08:02:37.405 INFO:tasks.workunit.client.1.smithi129.stdout:1/874: readlink d1/d4/d96/l9a 0 2024-09-21T08:02:37.415 INFO:tasks.workunit.client.0.smithi107.stdout:4/68: getdents dc 0 2024-09-21T08:02:37.415 INFO:tasks.workunit.client.1.smithi129.stdout:1/875: dread d1/d9/f42 [4194304,4194304] 0 2024-09-21T08:02:37.419 INFO:tasks.workunit.client.0.smithi107.stdout:9/91: rename fa to d11/f1d 0 2024-09-21T08:02:37.423 INFO:tasks.workunit.client.0.smithi107.stdout:8/22: truncate f4 3396486 0 2024-09-21T08:02:37.424 INFO:tasks.workunit.client.1.smithi129.stdout:9/746: truncate d17/d22/d33/d36/d48/d75/f7d 2546347 0 2024-09-21T08:02:37.425 INFO:tasks.workunit.client.1.smithi129.stdout:3/875: symlink d3/d69/d95/de1/l12f 0 2024-09-21T08:02:37.426 INFO:tasks.workunit.client.1.smithi129.stdout:3/876: write d3/da/dc/d11/d55/ff5 [756916,25668] 0 2024-09-21T08:02:37.426 INFO:tasks.workunit.client.0.smithi107.stdout:4/69: unlink dc/cd 0 2024-09-21T08:02:37.427 INFO:tasks.workunit.client.1.smithi129.stdout:6/733: getdents d7/d1b/d1e/d66/dc2/d5e 0 2024-09-21T08:02:37.429 INFO:tasks.workunit.client.1.smithi129.stdout:6/734: truncate d7/d10/dcc/fd0 427468 0 2024-09-21T08:02:37.429 INFO:tasks.workunit.client.1.smithi129.stdout:6/735: dread - d7/d1b/d1e/d39/d4b/de8/ff5 zero size 2024-09-21T08:02:37.431 INFO:tasks.workunit.client.0.smithi107.stdout:6/63: getdents d2 0 2024-09-21T08:02:37.431 INFO:tasks.workunit.client.0.smithi107.stdout:6/64: fsync d2/fe 0 2024-09-21T08:02:37.431 INFO:tasks.workunit.client.0.smithi107.stdout:6/65: fdatasync d2/d3/f4 0 2024-09-21T08:02:37.431 INFO:tasks.workunit.client.0.smithi107.stdout:6/66: chown d2/fe 17061 1 2024-09-21T08:02:37.431 INFO:tasks.workunit.client.0.smithi107.stdout:8/23: symlink d5/lc 0 2024-09-21T08:02:37.431 INFO:tasks.workunit.client.0.smithi107.stdout:8/24: truncate d5/f6 100450 0 2024-09-21T08:02:37.432 INFO:tasks.workunit.client.1.smithi129.stdout:5/882: dwrite d2/d1e/d35/d33/d36/d5a/d77/d81/fd9 [0,4194304] 0 2024-09-21T08:02:37.433 INFO:tasks.workunit.client.0.smithi107.stdout:5/80: dwrite d7/f11 [0,4194304] 0 2024-09-21T08:02:37.433 INFO:tasks.workunit.client.0.smithi107.stdout:5/81: chown d7/cc 227 1 2024-09-21T08:02:37.433 INFO:tasks.workunit.client.0.smithi107.stdout:5/82: stat d7/de/f16 0 2024-09-21T08:02:37.435 INFO:tasks.workunit.client.0.smithi107.stdout:6/67: rmdir d2 39 2024-09-21T08:02:37.435 INFO:tasks.workunit.client.0.smithi107.stdout:6/68: write d2/fe [429638,5264] 0 2024-09-21T08:02:37.436 INFO:tasks.workunit.client.1.smithi129.stdout:7/984: dwrite d0/d1e/db1/dc7/ff0 [0,4194304] 0 2024-09-21T08:02:37.436 INFO:tasks.workunit.client.1.smithi129.stdout:7/985: write d0/d1e/f10d [636863,38020] 0 2024-09-21T08:02:37.436 INFO:tasks.workunit.client.1.smithi129.stdout:6/736: mkdir d7/d1b/d1e/d39/d4b/de8/d69/dfa 0 2024-09-21T08:02:37.437 INFO:tasks.workunit.client.1.smithi129.stdout:6/737: chown d7/d1b/d1e/d66/d7c 1792961 1 2024-09-21T08:02:37.437 INFO:tasks.workunit.client.1.smithi129.stdout:3/877: dread d3/f29 [0,4194304] 0 2024-09-21T08:02:37.437 INFO:tasks.workunit.client.1.smithi129.stdout:3/878: read d3/da/dc/d25/f26 [3212209,24195] 0 2024-09-21T08:02:37.437 INFO:tasks.workunit.client.1.smithi129.stdout:9/747: dread d17/d22/d33/d36/d48/db7/fc8 [0,4194304] 0 2024-09-21T08:02:37.437 INFO:tasks.workunit.client.1.smithi129.stdout:9/748: write d17/d22/d33/d36/d48/d75/fb0 [1905982,130649] 0 2024-09-21T08:02:37.437 INFO:tasks.workunit.client.1.smithi129.stdout:9/749: write d17/d22/d33/d7a/d89/d90/db1/d31/d35/f50 [1195088,72346] 0 2024-09-21T08:02:37.438 INFO:tasks.workunit.client.0.smithi107.stdout:8/25: creat d5/fd x:0 0 0 2024-09-21T08:02:37.438 INFO:tasks.workunit.client.0.smithi107.stdout:3/30: truncate f4 208463 0 2024-09-21T08:02:37.438 INFO:tasks.workunit.client.0.smithi107.stdout:3/31: fdatasync f2 0 2024-09-21T08:02:37.446 INFO:tasks.workunit.client.1.smithi129.stdout:7/986: unlink d0/d1e/d9a/dca/d100/d8f/c102 0 2024-09-21T08:02:37.446 INFO:tasks.workunit.client.1.smithi129.stdout:3/879: dread d3/fca [0,4194304] 0 2024-09-21T08:02:37.446 INFO:tasks.workunit.client.1.smithi129.stdout:6/738: creat d7/d1b/d1e/d66/dc2/d93/dd5/de6/ffb x:0 0 0 2024-09-21T08:02:37.449 INFO:tasks.workunit.client.0.smithi107.stdout:5/83: write d7/de/f16 [6932565,127047] 0 2024-09-21T08:02:37.449 INFO:tasks.workunit.client.0.smithi107.stdout:5/84: creat d7/de/f1a x:0 0 0 2024-09-21T08:02:37.449 INFO:tasks.workunit.client.0.smithi107.stdout:5/85: write d7/de/f19 [1014649,8780] 0 2024-09-21T08:02:37.449 INFO:tasks.workunit.client.0.smithi107.stdout:5/86: write d7/ff [4374909,79028] 0 2024-09-21T08:02:37.450 INFO:tasks.workunit.client.1.smithi129.stdout:5/883: dread d2/d1e/d35/d33/f88 [0,4194304] 0 2024-09-21T08:02:37.452 INFO:tasks.workunit.client.0.smithi107.stdout:4/70: rmdir dc 39 2024-09-21T08:02:37.454 INFO:tasks.workunit.client.1.smithi129.stdout:9/750: dwrite d17/d46/fb2 [0,4194304] 0 2024-09-21T08:02:37.455 INFO:tasks.workunit.client.0.smithi107.stdout:6/69: unlink l0 0 2024-09-21T08:02:37.458 INFO:tasks.workunit.client.0.smithi107.stdout:8/26: unlink d5/l8 0 2024-09-21T08:02:37.460 INFO:tasks.workunit.client.1.smithi129.stdout:3/880: rename d3/da/dc/d7f/dd6/de2/d120/d80/d11b to d3/da/d5d/d130 0 2024-09-21T08:02:37.461 INFO:tasks.workunit.client.1.smithi129.stdout:3/881: read d3/da/dc/d25/fa5 [396696,107277] 0 2024-09-21T08:02:37.463 INFO:tasks.workunit.client.1.smithi129.stdout:6/739: rmdir d7/d1b/d1e/d66/de7 0 2024-09-21T08:02:37.463 INFO:tasks.workunit.client.1.smithi129.stdout:6/740: chown d7/d1b/d1e/d66/dc2/de2/d40/d78 704148466 1 2024-09-21T08:02:37.463 INFO:tasks.workunit.client.1.smithi129.stdout:6/741: fsync d7/d1b/d1e/d39/f4c 0 2024-09-21T08:02:37.465 INFO:tasks.workunit.client.1.smithi129.stdout:5/884: creat d2/d1e/d35/d37/d114/f117 x:0 0 0 2024-09-21T08:02:37.466 INFO:tasks.workunit.client.1.smithi129.stdout:6/742: read d7/f9 [7428153,4261] 0 2024-09-21T08:02:37.467 INFO:tasks.workunit.client.0.smithi107.stdout:5/87: rename d7/de/f10 to d7/de/f1b 0 2024-09-21T08:02:37.470 INFO:tasks.workunit.client.1.smithi129.stdout:9/751: unlink d17/d22/d33/d36/d48/db7/dc9/cf6 0 2024-09-21T08:02:37.472 INFO:tasks.workunit.client.1.smithi129.stdout:7/987: dwrite d0/f37 [0,4194304] 0 2024-09-21T08:02:37.472 INFO:tasks.workunit.client.0.smithi107.stdout:6/70: dwrite d2/fb [0,4194304] 0 2024-09-21T08:02:37.474 INFO:tasks.workunit.client.1.smithi129.stdout:3/882: link d3/d90/l9d d3/d69/d95/l131 0 2024-09-21T08:02:37.474 INFO:tasks.workunit.client.1.smithi129.stdout:3/883: fsync d3/da/dc/d7f/dd6/de2/d120/fec 0 2024-09-21T08:02:37.475 INFO:tasks.workunit.client.0.smithi107.stdout:3/32: symlink l6 0 2024-09-21T08:02:37.477 INFO:tasks.workunit.client.0.smithi107.stdout:3/33: write f2 [75867,96227] 0 2024-09-21T08:02:37.477 INFO:tasks.workunit.client.0.smithi107.stdout:3/34: stat f2 0 2024-09-21T08:02:37.477 INFO:tasks.workunit.client.1.smithi129.stdout:5/885: rename d2/d1e/d35/f31 to d2/d1e/d35/d33/d36/f118 0 2024-09-21T08:02:37.477 INFO:tasks.workunit.client.1.smithi129.stdout:5/886: chown d2/d1e/d35/d37/d96/de5/d61/fa4 8349831 1 2024-09-21T08:02:37.478 INFO:tasks.workunit.client.0.smithi107.stdout:5/88: rmdir d7 39 2024-09-21T08:02:37.479 INFO:tasks.workunit.client.1.smithi129.stdout:6/743: mknod d7/d1b/d1e/d39/d4b/cfc 0 2024-09-21T08:02:37.480 INFO:tasks.workunit.client.1.smithi129.stdout:0/767: sync 2024-09-21T08:02:37.480 INFO:tasks.workunit.client.1.smithi129.stdout:8/703: sync 2024-09-21T08:02:37.480 INFO:tasks.workunit.client.1.smithi129.stdout:4/728: sync 2024-09-21T08:02:37.480 INFO:tasks.workunit.client.1.smithi129.stdout:4/729: readlink d5/d11/d77/da8/ldb 0 2024-09-21T08:02:37.481 INFO:tasks.workunit.client.0.smithi107.stdout:4/71: symlink dc/l10 0 2024-09-21T08:02:37.481 INFO:tasks.workunit.client.1.smithi129.stdout:9/752: truncate d17/d22/d33/d36/d48/d3f/f57 3625268 0 2024-09-21T08:02:37.484 INFO:tasks.workunit.client.0.smithi107.stdout:8/27: getdents d5 0 2024-09-21T08:02:37.487 INFO:tasks.workunit.client.1.smithi129.stdout:7/988: getdents d0/d1e/d9a/dec 0 2024-09-21T08:02:37.487 INFO:tasks.workunit.client.1.smithi129.stdout:7/989: chown d0/d46/c52 1015228137 1 2024-09-21T08:02:37.487 INFO:tasks.workunit.client.1.smithi129.stdout:7/990: chown d0/d1e/f10d 128781 1 2024-09-21T08:02:37.487 INFO:tasks.workunit.client.1.smithi129.stdout:7/991: dread - d0/d46/d6e/dad/df6/dfd/f12f zero size 2024-09-21T08:02:37.489 INFO:tasks.workunit.client.1.smithi129.stdout:5/887: rename d2/d1e/c3a to d2/d1e/d35/d33/dca/c119 0 2024-09-21T08:02:37.491 INFO:tasks.workunit.client.1.smithi129.stdout:6/744: creat d7/d1b/d1e/d39/d4b/de8/d69/d89/ffd x:0 0 0 2024-09-21T08:02:37.493 INFO:tasks.workunit.client.1.smithi129.stdout:0/768: getdents de/d15 0 2024-09-21T08:02:37.493 INFO:tasks.workunit.client.1.smithi129.stdout:0/769: truncate de/f7b 899650 0 2024-09-21T08:02:37.494 INFO:tasks.workunit.client.0.smithi107.stdout:5/89: symlink d7/de/l1c 0 2024-09-21T08:02:37.495 INFO:tasks.workunit.client.1.smithi129.stdout:4/730: symlink d5/d11/d77/l106 0 2024-09-21T08:02:37.495 INFO:tasks.workunit.client.1.smithi129.stdout:4/731: write d5/da5/fb3 [1032923,47723] 0 2024-09-21T08:02:37.495 INFO:tasks.workunit.client.1.smithi129.stdout:4/732: write d5/d33/d66/f9b [1170365,113929] 0 2024-09-21T08:02:37.497 INFO:tasks.workunit.client.1.smithi129.stdout:9/753: mkdir d17/d22/d33/d7a/d89/df7 0 2024-09-21T08:02:37.498 INFO:tasks.workunit.client.0.smithi107.stdout:3/35: rename l6 to l7 0 2024-09-21T08:02:37.499 INFO:tasks.workunit.client.1.smithi129.stdout:7/992: symlink d0/d1e/db1/dba/dc1/l153 0 2024-09-21T08:02:37.502 INFO:tasks.workunit.client.0.smithi107.stdout:6/71: dwrite d2/d3/f6 [4194304,4194304] 0 2024-09-21T08:02:37.502 INFO:tasks.workunit.client.1.smithi129.stdout:0/770: unlink de/d19/dd9/le9 0 2024-09-21T08:02:37.504 INFO:tasks.workunit.client.1.smithi129.stdout:3/884: dwrite d3/da/ff [0,4194304] 0 2024-09-21T08:02:37.504 INFO:tasks.workunit.client.1.smithi129.stdout:3/885: getdents d3/d69/d10d 0 2024-09-21T08:02:37.504 INFO:tasks.workunit.client.1.smithi129.stdout:3/886: fdatasync d3/da/dc/d7f/dd6/de2/d120/da2/f127 0 2024-09-21T08:02:37.505 INFO:tasks.workunit.client.1.smithi129.stdout:4/733: rmdir d5/d33/d4e/da7 39 2024-09-21T08:02:37.505 INFO:tasks.workunit.client.1.smithi129.stdout:4/734: fdatasync d5/d33/d4e/f7b 0 2024-09-21T08:02:37.506 INFO:tasks.workunit.client.1.smithi129.stdout:4/735: chown d5/d11/d3f/d50/l80 225192 1 2024-09-21T08:02:37.508 INFO:tasks.workunit.client.0.smithi107.stdout:3/36: dread f4 [0,4194304] 0 2024-09-21T08:02:37.508 INFO:tasks.workunit.client.1.smithi129.stdout:7/993: unlink d0/d1e/db1/d122/l139 0 2024-09-21T08:02:37.509 INFO:tasks.workunit.client.1.smithi129.stdout:9/754: write d17/d22/d33/d7a/d89/d90/db1/f43 [411695,87034] 0 2024-09-21T08:02:37.509 INFO:tasks.workunit.client.1.smithi129.stdout:8/704: dwrite d0/d6/d7/d18/d61/f9d [0,4194304] 0 2024-09-21T08:02:37.511 INFO:tasks.workunit.client.0.smithi107.stdout:4/72: getdents dc 0 2024-09-21T08:02:37.511 INFO:tasks.workunit.client.0.smithi107.stdout:4/73: chown dc/fe 4251007 1 2024-09-21T08:02:37.511 INFO:tasks.workunit.client.0.smithi107.stdout:4/74: fdatasync f8 0 2024-09-21T08:02:37.512 INFO:tasks.workunit.client.1.smithi129.stdout:7/994: dread d0/d46/d6e/d9b/fcb [0,4194304] 0 2024-09-21T08:02:37.513 INFO:tasks.workunit.client.1.smithi129.stdout:5/888: rmdir d2/d1e/d35/d37/d96/de5/db1/de7 39 2024-09-21T08:02:37.516 INFO:tasks.workunit.client.1.smithi129.stdout:3/887: symlink d3/da/dc/d7f/dd6/de2/d120/da2/l132 0 2024-09-21T08:02:37.517 INFO:tasks.workunit.client.1.smithi129.stdout:3/888: dread d3/da/d5d/d94/db3/dc3/fe5 [0,4194304] 0 2024-09-21T08:02:37.517 INFO:tasks.workunit.client.1.smithi129.stdout:3/889: chown d3/da/d5d 82508816 1 2024-09-21T08:02:37.517 INFO:tasks.workunit.client.0.smithi107.stdout:4/75: creat dc/f11 x:0 0 0 2024-09-21T08:02:37.519 INFO:tasks.workunit.client.1.smithi129.stdout:4/736: symlink d5/d16/d24/d3b/l107 0 2024-09-21T08:02:37.521 INFO:tasks.workunit.client.0.smithi107.stdout:3/37: getdents . 0 2024-09-21T08:02:37.525 INFO:tasks.workunit.client.0.smithi107.stdout:3/38: unlink f4 0 2024-09-21T08:02:37.525 INFO:tasks.workunit.client.0.smithi107.stdout:5/90: truncate d7/de/f16 7950626 0 2024-09-21T08:02:37.526 INFO:tasks.workunit.client.1.smithi129.stdout:7/995: dread d0/d1e/f4b [0,4194304] 0 2024-09-21T08:02:37.526 INFO:tasks.workunit.client.1.smithi129.stdout:7/996: chown d0/d46/d6e/f64 1804 1 2024-09-21T08:02:37.527 INFO:tasks.workunit.client.1.smithi129.stdout:9/755: creat d17/d60/ff8 x:0 0 0 2024-09-21T08:02:37.527 INFO:tasks.workunit.client.1.smithi129.stdout:9/756: dread - d17/d22/fcd zero size 2024-09-21T08:02:37.528 INFO:tasks.workunit.client.0.smithi107.stdout:3/39: stat l7 0 2024-09-21T08:02:37.530 INFO:tasks.workunit.client.0.smithi107.stdout:6/72: dwrite d2/fe [0,4194304] 0 2024-09-21T08:02:37.530 INFO:tasks.workunit.client.0.smithi107.stdout:6/73: chown d2/d3/d7/ca 94 1 2024-09-21T08:02:37.530 INFO:tasks.workunit.client.0.smithi107.stdout:5/91: mkdir d7/de/d1d 0 2024-09-21T08:02:37.530 INFO:tasks.workunit.client.0.smithi107.stdout:5/92: chown d7/de/c12 291406686 1 2024-09-21T08:02:37.531 INFO:tasks.workunit.client.0.smithi107.stdout:3/40: stat f2 0 2024-09-21T08:02:37.534 INFO:tasks.workunit.client.1.smithi129.stdout:0/771: dwrite de/d1f/da9/f37 [4194304,4194304] 0 2024-09-21T08:02:37.534 INFO:tasks.workunit.client.1.smithi129.stdout:0/772: stat de/d15/lbd 0 2024-09-21T08:02:37.537 INFO:tasks.workunit.client.1.smithi129.stdout:8/705: mknod d0/d6/dac/db9/cd0 0 2024-09-21T08:02:37.538 INFO:tasks.workunit.client.1.smithi129.stdout:8/706: chown d0/d6/d7/d18/d27/d32/f54 31 1 2024-09-21T08:02:37.538 INFO:tasks.workunit.client.0.smithi107.stdout:3/41: mkdir d8 0 2024-09-21T08:02:37.540 INFO:tasks.workunit.client.1.smithi129.stdout:5/889: truncate d2/d1e/f32 903486 0 2024-09-21T08:02:37.541 INFO:tasks.workunit.client.1.smithi129.stdout:7/997: dread d0/d1e/d9a/dca/d100/d90/f92 [0,4194304] 0 2024-09-21T08:02:37.541 INFO:tasks.workunit.client.0.smithi107.stdout:6/74: dread d2/d3/f4 [0,4194304] 0 2024-09-21T08:02:37.542 INFO:tasks.workunit.client.1.smithi129.stdout:9/757: unlink d17/d22/d33/d36/d48/d3f/d71/ff0 0 2024-09-21T08:02:37.544 INFO:tasks.workunit.client.0.smithi107.stdout:3/42: rename l7 to d8/l9 0 2024-09-21T08:02:37.544 INFO:tasks.workunit.client.0.smithi107.stdout:3/43: fdatasync f2 0 2024-09-21T08:02:37.544 INFO:tasks.workunit.client.0.smithi107.stdout:3/44: fdatasync f2 0 2024-09-21T08:02:37.544 INFO:tasks.workunit.client.0.smithi107.stdout:3/45: truncate f2 651066 0 2024-09-21T08:02:37.546 INFO:tasks.workunit.client.1.smithi129.stdout:3/890: dwrite d3/da/dc/d11/d55/ff5 [0,4194304] 0 2024-09-21T08:02:37.547 INFO:tasks.workunit.client.1.smithi129.stdout:0/773: rename de/d15/d39/f96 to de/d22/d27/d2f/ff7 0 2024-09-21T08:02:37.548 INFO:tasks.workunit.client.0.smithi107.stdout:6/75: creat d2/ff x:0 0 0 2024-09-21T08:02:37.548 INFO:tasks.workunit.client.0.smithi107.stdout:6/76: fsync d2/d3/f9 0 2024-09-21T08:02:37.550 INFO:tasks.workunit.client.1.smithi129.stdout:5/890: link d2/d1e/d35/d37/d96/de5/l44 d2/d1e/d35/d37/d114/l11a 0 2024-09-21T08:02:37.551 INFO:tasks.workunit.client.0.smithi107.stdout:6/77: symlink d2/l10 0 2024-09-21T08:02:37.551 INFO:tasks.workunit.client.0.smithi107.stdout:4/76: dwrite fb [0,4194304] 0 2024-09-21T08:02:37.553 INFO:tasks.workunit.client.0.smithi107.stdout:5/93: dwrite d7/de/f18 [0,4194304] 0 2024-09-21T08:02:37.554 INFO:tasks.workunit.client.1.smithi129.stdout:7/998: link d0/d1e/f8b d0/d46/d6e/dad/f154 0 2024-09-21T08:02:37.558 INFO:tasks.workunit.client.0.smithi107.stdout:6/78: creat d2/d3/d7/f11 x:0 0 0 2024-09-21T08:02:37.558 INFO:tasks.workunit.client.0.smithi107.stdout:6/79: write d2/d3/f6 [8812912,23413] 0 2024-09-21T08:02:37.558 INFO:tasks.workunit.client.0.smithi107.stdout:6/80: chown d2/d3/f4 28803422 1 2024-09-21T08:02:37.558 INFO:tasks.workunit.client.1.smithi129.stdout:9/758: mkdir d17/d22/d33/d7a/d89/d90/db1/d31/d5e/df9 0 2024-09-21T08:02:37.559 INFO:tasks.workunit.client.1.smithi129.stdout:9/759: readlink d17/d22/d33/d7a/d89/ldb 0 2024-09-21T08:02:37.559 INFO:tasks.workunit.client.1.smithi129.stdout:9/760: dread d17/d22/d33/d36/d48/d3f/d53/fa3 [0,4194304] 0 2024-09-21T08:02:37.561 INFO:tasks.workunit.client.1.smithi129.stdout:3/891: dread d3/da/dc/fb5 [0,4194304] 0 2024-09-21T08:02:37.564 INFO:tasks.workunit.client.0.smithi107.stdout:3/46: dwrite f2 [0,4194304] 0 2024-09-21T08:02:37.564 INFO:tasks.workunit.client.1.smithi129.stdout:8/707: rename d0/d6/d7/d6c/dc0/fc8 to d0/d6/d7/d5a/fd1 0 2024-09-21T08:02:37.567 INFO:tasks.workunit.client.1.smithi129.stdout:5/891: link d2/l5e d2/d1e/l11b 0 2024-09-21T08:02:37.569 INFO:tasks.workunit.client.0.smithi107.stdout:5/94: rename d7/cc to d7/de/c1e 0 2024-09-21T08:02:37.573 INFO:tasks.workunit.client.1.smithi129.stdout:7/999: mkdir d0/d46/d6e/dad/df6/d155 0 2024-09-21T08:02:37.574 INFO:tasks.workunit.client.0.smithi107.stdout:4/77: write fb [3956930,34911] 0 2024-09-21T08:02:37.574 INFO:tasks.workunit.client.0.smithi107.stdout:4/78: creat dc/f12 x:0 0 0 2024-09-21T08:02:37.579 INFO:tasks.workunit.client.1.smithi129.stdout:9/761: creat d17/d22/d33/d36/d48/ffa x:0 0 0 2024-09-21T08:02:37.584 INFO:tasks.workunit.client.1.smithi129.stdout:0/774: rename de/d22/d27/d85/db2/cc4 to de/d22/d27/cf8 0 2024-09-21T08:02:37.585 INFO:tasks.workunit.client.1.smithi129.stdout:5/892: truncate d2/d1e/d35/f4d 4027609 0 2024-09-21T08:02:37.588 INFO:tasks.workunit.client.1.smithi129.stdout:0/775: dread de/d15/d39/d7f/faa [4194304,4194304] 0 2024-09-21T08:02:37.591 INFO:tasks.workunit.client.1.smithi129.stdout:5/893: getdents d2/d1e/d6b/dd1 0 2024-09-21T08:02:37.591 INFO:tasks.workunit.client.1.smithi129.stdout:5/894: chown d2/d1e/d35/d33/dca/fcc 58156118 1 2024-09-21T08:02:37.592 INFO:tasks.workunit.client.1.smithi129.stdout:0/776: truncate de/d19/f4e 3668807 0 2024-09-21T08:02:37.595 INFO:tasks.workunit.client.1.smithi129.stdout:5/895: creat d2/d1e/d35/d37/d96/de5/d61/d102/f11c x:0 0 0 2024-09-21T08:02:37.598 INFO:tasks.workunit.client.1.smithi129.stdout:8/708: rename d0/d6/d7/d6c to d0/d6/d7/d18/d61/d7f/dd2 0 2024-09-21T08:02:37.599 INFO:tasks.workunit.client.1.smithi129.stdout:0/777: symlink de/d15/d44/d45/lf9 0 2024-09-21T08:02:37.601 INFO:tasks.workunit.client.1.smithi129.stdout:5/896: link d2/d2a/f2e d2/d1e/f11d 0 2024-09-21T08:02:37.601 INFO:tasks.workunit.client.1.smithi129.stdout:5/897: fdatasync d2/d1e/d35/d33/db9/ff7 0 2024-09-21T08:02:37.604 INFO:tasks.workunit.client.1.smithi129.stdout:8/709: rename d0/d6/d7/d18/c80 to d0/d6/d7/d9/d94/cd3 0 2024-09-21T08:02:37.608 INFO:tasks.workunit.client.1.smithi129.stdout:9/762: rename d17/d22/d33/lcb to d17/d22/d33/d36/dd3/lfb 0 2024-09-21T08:02:37.609 INFO:tasks.workunit.client.1.smithi129.stdout:3/892: dwrite d3/d90/f123 [0,4194304] 0 2024-09-21T08:02:37.609 INFO:tasks.workunit.client.1.smithi129.stdout:3/893: write d3/da/d5d/fa0 [560315,67350] 0 2024-09-21T08:02:37.609 INFO:tasks.workunit.client.1.smithi129.stdout:3/894: readlink d3/l38 0 2024-09-21T08:02:37.609 INFO:tasks.workunit.client.0.smithi107.stdout:6/81: dwrite d2/d3/d7/f11 [0,4194304] 0 2024-09-21T08:02:37.610 INFO:tasks.workunit.client.0.smithi107.stdout:6/82: chown d2 0 1 2024-09-21T08:02:37.612 INFO:tasks.workunit.client.0.smithi107.stdout:3/47: truncate f2 3168756 0 2024-09-21T08:02:37.614 INFO:tasks.workunit.client.1.smithi129.stdout:3/895: creat d3/da/d5d/d130/f133 x:0 0 0 2024-09-21T08:02:37.616 INFO:tasks.workunit.client.1.smithi129.stdout:9/763: mkdir d17/d22/d33/d7a/d89/d90/dfc 0 2024-09-21T08:02:37.618 INFO:tasks.workunit.client.0.smithi107.stdout:6/83: read d2/d3/f4 [598170,7831] 0 2024-09-21T08:02:37.618 INFO:tasks.workunit.client.0.smithi107.stdout:6/84: fdatasync d2/ff 0 2024-09-21T08:02:37.618 INFO:tasks.workunit.client.0.smithi107.stdout:6/85: chown d2/d3/f9 3961867 1 2024-09-21T08:02:37.618 INFO:tasks.workunit.client.0.smithi107.stdout:5/95: dwrite d7/f8 [0,4194304] 0 2024-09-21T08:02:37.618 INFO:tasks.workunit.client.0.smithi107.stdout:5/96: dread - d7/de/f1a zero size 2024-09-21T08:02:37.620 INFO:tasks.workunit.client.1.smithi129.stdout:3/896: rename d3/da/dc/d11/d55/d68/lc1 to d3/da/d5d/d94/l134 0 2024-09-21T08:02:37.621 INFO:tasks.workunit.client.0.smithi107.stdout:3/48: stat d8/l9 0 2024-09-21T08:02:37.622 INFO:tasks.workunit.client.1.smithi129.stdout:9/764: unlink d17/d22/d33/d36/de4/fee 0 2024-09-21T08:02:37.626 INFO:tasks.workunit.client.1.smithi129.stdout:3/897: rename d3/da/d5d/d94/db3/dc3/d115/d121/f12c to d3/da/dc/d7f/dd6/de2/df2/f135 0 2024-09-21T08:02:37.626 INFO:tasks.workunit.client.1.smithi129.stdout:3/898: fsync d3/d5a/da9/fff 0 2024-09-21T08:02:37.627 INFO:tasks.workunit.client.0.smithi107.stdout:5/97: rename d7/de/f16 to d7/f1f 0 2024-09-21T08:02:37.627 INFO:tasks.workunit.client.0.smithi107.stdout:4/79: dwrite f8 [0,4194304] 0 2024-09-21T08:02:37.627 INFO:tasks.workunit.client.0.smithi107.stdout:4/80: stat f8 0 2024-09-21T08:02:37.628 INFO:tasks.workunit.client.1.smithi129.stdout:0/778: dwrite de/d19/f82 [0,4194304] 0 2024-09-21T08:02:37.628 INFO:tasks.workunit.client.1.smithi129.stdout:0/779: stat de/d81/cf0 0 2024-09-21T08:02:37.628 INFO:tasks.workunit.client.1.smithi129.stdout:5/898: dwrite d2/d1e/f11d [0,4194304] 0 2024-09-21T08:02:37.629 INFO:tasks.workunit.client.1.smithi129.stdout:9/765: mknod d17/d22/d33/d36/d48/d3f/d53/cfd 0 2024-09-21T08:02:37.629 INFO:tasks.workunit.client.1.smithi129.stdout:9/766: read d17/f83 [2387684,45432] 0 2024-09-21T08:02:37.629 INFO:tasks.workunit.client.1.smithi129.stdout:9/767: write d17/d60/fd6 [706294,21518] 0 2024-09-21T08:02:37.629 INFO:tasks.workunit.client.1.smithi129.stdout:9/768: write d17/d22/faf [4098272,129917] 0 2024-09-21T08:02:37.630 INFO:tasks.workunit.client.0.smithi107.stdout:3/49: creat d8/fa x:0 0 0 2024-09-21T08:02:37.635 INFO:tasks.workunit.client.0.smithi107.stdout:6/86: write d2/fe [3546146,79191] 0 2024-09-21T08:02:37.635 INFO:tasks.workunit.client.0.smithi107.stdout:6/87: creat d2/d3/d7/f12 x:0 0 0 2024-09-21T08:02:37.635 INFO:tasks.workunit.client.0.smithi107.stdout:6/88: creat d2/d3/d7/f13 x:0 0 0 2024-09-21T08:02:37.635 INFO:tasks.workunit.client.0.smithi107.stdout:6/89: creat d2/d3/f14 x:0 0 0 2024-09-21T08:02:37.635 INFO:tasks.workunit.client.0.smithi107.stdout:6/90: read - d2/fd zero size 2024-09-21T08:02:37.636 INFO:tasks.workunit.client.1.smithi129.stdout:5/899: dread d2/d1e/d35/d33/f88 [0,4194304] 0 2024-09-21T08:02:37.636 INFO:tasks.workunit.client.1.smithi129.stdout:5/900: dread - d2/d1e/d35/d37/d96/de5/db1/d71/da9/fe4 zero size 2024-09-21T08:02:37.636 INFO:tasks.workunit.client.0.smithi107.stdout:5/98: link d7/de/c15 d7/de/c20 0 2024-09-21T08:02:37.636 INFO:tasks.workunit.client.0.smithi107.stdout:5/99: chown d7/de/c1e 1531641 1 2024-09-21T08:02:37.636 INFO:tasks.workunit.client.0.smithi107.stdout:5/100: stat d7/de/f13 0 2024-09-21T08:02:37.639 INFO:tasks.workunit.client.1.smithi129.stdout:1/876: sync 2024-09-21T08:02:37.639 INFO:tasks.workunit.client.1.smithi129.stdout:1/877: creat d1/d16/dd1/f123 x:0 0 0 2024-09-21T08:02:37.639 INFO:tasks.workunit.client.1.smithi129.stdout:1/878: stat d1/d16/fdb 0 2024-09-21T08:02:37.639 INFO:tasks.workunit.client.1.smithi129.stdout:1/879: read d1/d9/f20 [306120,111585] 0 2024-09-21T08:02:37.643 INFO:tasks.workunit.client.1.smithi129.stdout:3/899: dread d3/da/dc/d11/d55/ff5 [0,4194304] 0 2024-09-21T08:02:37.643 INFO:tasks.workunit.client.1.smithi129.stdout:3/900: stat d3/da/dc/d11 0 2024-09-21T08:02:37.643 INFO:tasks.workunit.client.1.smithi129.stdout:3/901: dread - d3/da/dc/d7f/dd6/de2/df2/f111 zero size 2024-09-21T08:02:37.648 INFO:tasks.workunit.client.0.smithi107.stdout:3/50: write f2 [433744,10603] 0 2024-09-21T08:02:37.658 INFO:tasks.workunit.client.1.smithi129.stdout:9/769: rmdir d17/d60/d7b/dc4 39 2024-09-21T08:02:37.659 INFO:tasks.workunit.client.0.smithi107.stdout:3/51: symlink d8/lb 0 2024-09-21T08:02:37.661 INFO:tasks.workunit.client.1.smithi129.stdout:3/902: mknod d3/da/dc/d7f/dd6/de2/c136 0 2024-09-21T08:02:37.661 INFO:tasks.workunit.client.1.smithi129.stdout:3/903: chown d3/da/dc/da3/le8 153 1 2024-09-21T08:02:37.661 INFO:tasks.workunit.client.1.smithi129.stdout:3/904: write d3/da/d5d/f77 [1453688,94523] 0 2024-09-21T08:02:37.661 INFO:tasks.workunit.client.1.smithi129.stdout:9/770: symlink d17/d22/d33/d36/d48/lfe 0 2024-09-21T08:02:37.662 INFO:tasks.workunit.client.0.smithi107.stdout:4/81: dwrite dc/f12 [0,4194304] 0 2024-09-21T08:02:37.664 INFO:tasks.workunit.client.1.smithi129.stdout:3/905: getdents d3/d69/d95/de1 0 2024-09-21T08:02:37.664 INFO:tasks.workunit.client.1.smithi129.stdout:3/906: write d3/da/dc/f73 [2374635,4683] 0 2024-09-21T08:02:37.666 INFO:tasks.workunit.client.0.smithi107.stdout:4/82: mkdir dc/d13 0 2024-09-21T08:02:37.669 INFO:tasks.workunit.client.1.smithi129.stdout:4/737: sync 2024-09-21T08:02:37.670 INFO:tasks.workunit.client.1.smithi129.stdout:6/745: sync 2024-09-21T08:02:37.671 INFO:tasks.workunit.client.1.smithi129.stdout:0/780: dwrite de/d15/f3d [0,4194304] 0 2024-09-21T08:02:37.671 INFO:tasks.workunit.client.1.smithi129.stdout:0/781: stat de/l55 0 2024-09-21T08:02:37.671 INFO:tasks.workunit.client.1.smithi129.stdout:0/782: stat de/d22 0 2024-09-21T08:02:37.672 INFO:tasks.workunit.client.0.smithi107.stdout:6/91: dread d2/fe [0,4194304] 0 2024-09-21T08:02:37.673 INFO:tasks.workunit.client.0.smithi107.stdout:3/52: fsync f2 0 2024-09-21T08:02:37.674 INFO:tasks.workunit.client.1.smithi129.stdout:5/901: dwrite d2/f60 [0,4194304] 0 2024-09-21T08:02:37.674 INFO:tasks.workunit.client.1.smithi129.stdout:1/880: dwrite d1/d4/f21 [0,4194304] 0 2024-09-21T08:02:37.674 INFO:tasks.workunit.client.1.smithi129.stdout:1/881: chown d1/d4/dc2/dc6/fb8 167672 1 2024-09-21T08:02:37.674 INFO:tasks.workunit.client.1.smithi129.stdout:1/882: creat d1/d7a/da4/f124 x:0 0 0 2024-09-21T08:02:37.675 INFO:tasks.workunit.client.1.smithi129.stdout:6/746: symlink d7/d1b/d8d/lfe 0 2024-09-21T08:02:37.676 INFO:tasks.workunit.client.1.smithi129.stdout:0/783: stat de/d1f/c50 0 2024-09-21T08:02:37.676 INFO:tasks.workunit.client.1.smithi129.stdout:9/771: read d17/d22/d33/d7a/d89/d90/db1/d31/d5e/d6b/db6/fe1 [1391157,30238] 0 2024-09-21T08:02:37.676 INFO:tasks.workunit.client.1.smithi129.stdout:9/772: truncate d17/d22/d33/d36/d48/db7/fe2 940789 0 2024-09-21T08:02:37.680 INFO:tasks.workunit.client.1.smithi129.stdout:6/747: symlink d7/d1b/d1e/d39/d4b/de8/d69/lff 0 2024-09-21T08:02:37.681 INFO:tasks.workunit.client.0.smithi107.stdout:3/53: rename d8/lb to d8/lc 0 2024-09-21T08:02:37.681 INFO:tasks.workunit.client.1.smithi129.stdout:4/738: dread d5/d33/d4e/da7/fe0 [0,4194304] 0 2024-09-21T08:02:37.684 INFO:tasks.workunit.client.0.smithi107.stdout:3/54: symlink d8/ld 0 2024-09-21T08:02:37.684 INFO:tasks.workunit.client.0.smithi107.stdout:3/55: creat d8/fe x:0 0 0 2024-09-21T08:02:37.684 INFO:tasks.workunit.client.1.smithi129.stdout:3/907: dread d3/da/dc/d7f/dd6/de2/d120/fc4 [0,4194304] 0 2024-09-21T08:02:37.685 INFO:tasks.workunit.client.1.smithi129.stdout:3/908: stat d3/da/c119 0 2024-09-21T08:02:37.685 INFO:tasks.workunit.client.1.smithi129.stdout:3/909: write d3/d5a/fbc [1408100,71301] 0 2024-09-21T08:02:37.686 INFO:tasks.workunit.client.1.smithi129.stdout:6/748: link d7/d1b/d1e/d66/dc2/de2/d40/d41/l74 d7/d1b/d1e/d39/d4b/de8/l100 0 2024-09-21T08:02:37.690 INFO:tasks.workunit.client.1.smithi129.stdout:9/773: rename d17/d22/d33/d7a/d89/d90/fab to d17/d22/d33/d7a/d89/d90/db1/d31/fff 0 2024-09-21T08:02:37.690 INFO:tasks.workunit.client.0.smithi107.stdout:3/56: mknod d8/cf 0 2024-09-21T08:02:37.691 INFO:tasks.workunit.client.0.smithi107.stdout:3/57: truncate d8/fa 536849 0 2024-09-21T08:02:37.691 INFO:tasks.workunit.client.0.smithi107.stdout:3/58: write f2 [201131,19712] 0 2024-09-21T08:02:37.692 INFO:tasks.workunit.client.1.smithi129.stdout:5/902: dread d2/d1e/d35/d33/d36/d5a/d77/d81/fd9 [0,4194304] 0 2024-09-21T08:02:37.695 INFO:tasks.workunit.client.1.smithi129.stdout:1/883: write d1/d16/d57/f88 [168164,98314] 0 2024-09-21T08:02:37.695 INFO:tasks.workunit.client.1.smithi129.stdout:4/739: dread d5/d16/d24/d4f/da1/f9c [0,4194304] 0 2024-09-21T08:02:37.695 INFO:tasks.workunit.client.1.smithi129.stdout:4/740: chown d5/d11/d3f/d50/f51 25 1 2024-09-21T08:02:37.696 INFO:tasks.workunit.client.1.smithi129.stdout:3/910: getdents d3/da 0 2024-09-21T08:02:37.698 INFO:tasks.workunit.client.1.smithi129.stdout:4/741: rmdir d5/d16/d47/d5f/d64 39 2024-09-21T08:02:37.699 INFO:tasks.workunit.client.1.smithi129.stdout:5/903: rmdir d2/d1e/d35/d33/d36/d5a 39 2024-09-21T08:02:37.699 INFO:tasks.workunit.client.1.smithi129.stdout:5/904: readlink d2/d1e/d35/d33/laf 0 2024-09-21T08:02:37.699 INFO:tasks.workunit.client.1.smithi129.stdout:5/905: readlink d2/le 0 2024-09-21T08:02:37.699 INFO:tasks.workunit.client.1.smithi129.stdout:5/906: write d2/f60 [4845686,8008] 0 2024-09-21T08:02:37.699 INFO:tasks.workunit.client.1.smithi129.stdout:3/911: mkdir d3/da/def/d137 0 2024-09-21T08:02:37.701 INFO:tasks.workunit.client.1.smithi129.stdout:4/742: rename d5/d16/l6c to d5/d33/d6d/l108 0 2024-09-21T08:02:37.701 INFO:tasks.workunit.client.1.smithi129.stdout:4/743: truncate d5/dbd/fad 703333 0 2024-09-21T08:02:37.702 INFO:tasks.workunit.client.1.smithi129.stdout:6/749: dread d7/d1b/d1e/d66/dc2/de2/d40/d41/f5d [0,4194304] 0 2024-09-21T08:02:37.703 INFO:tasks.workunit.client.1.smithi129.stdout:4/744: getdents d5/d16/d47/d5f 0 2024-09-21T08:02:37.703 INFO:tasks.workunit.client.1.smithi129.stdout:4/745: truncate d5/d16/d24/d4f/da1/fa3 657857 0 2024-09-21T08:02:37.703 INFO:tasks.workunit.client.1.smithi129.stdout:4/746: stat d5/d16/d24/lcd 0 2024-09-21T08:02:37.703 INFO:tasks.workunit.client.0.smithi107.stdout:4/83: dwrite f7 [0,4194304] 0 2024-09-21T08:02:37.703 INFO:tasks.workunit.client.1.smithi129.stdout:5/907: rename d2/d1e/d35/d37/d96/de5/db1/lcf to d2/d1e/d35/d37/d7d/l11e 0 2024-09-21T08:02:37.704 INFO:tasks.workunit.client.1.smithi129.stdout:5/908: read - d2/d1e/d35/d33/d36/d5a/d77/d81/fa0 zero size 2024-09-21T08:02:37.706 INFO:tasks.workunit.client.1.smithi129.stdout:5/909: truncate d2/d1e/d35/d37/d96/de5/fbe 9267 0 2024-09-21T08:02:37.712 INFO:tasks.workunit.client.1.smithi129.stdout:3/912: rename d3/da/d5d/d130 to d3/da/d5d/d94/dac/dfa/d138 0 2024-09-21T08:02:37.713 INFO:tasks.workunit.client.0.smithi107.stdout:6/92: dwrite d2/d3/d7/f11 [0,4194304] 0 2024-09-21T08:02:37.713 INFO:tasks.workunit.client.0.smithi107.stdout:6/93: creat d2/d3/d7/f15 x:0 0 0 2024-09-21T08:02:37.713 INFO:tasks.workunit.client.0.smithi107.stdout:6/94: write d2/d3/d7/f13 [37396,46292] 0 2024-09-21T08:02:37.716 INFO:tasks.workunit.client.1.smithi129.stdout:3/913: mknod d3/da/dc/d7f/dd6/de2/d120/c139 0 2024-09-21T08:02:37.717 INFO:tasks.workunit.client.0.smithi107.stdout:6/95: dread d2/d3/f9 [0,4194304] 0 2024-09-21T08:02:37.717 INFO:tasks.workunit.client.0.smithi107.stdout:6/96: truncate d2/fd 564700 0 2024-09-21T08:02:37.717 INFO:tasks.workunit.client.1.smithi129.stdout:6/750: dread f5 [0,4194304] 0 2024-09-21T08:02:37.718 INFO:tasks.workunit.client.0.smithi107.stdout:6/97: symlink d2/d3/d7/l16 0 2024-09-21T08:02:37.719 INFO:tasks.workunit.client.1.smithi129.stdout:6/751: rmdir d7/d1b/d1e/d39/d4b/de8/d69 39 2024-09-21T08:02:37.719 INFO:tasks.workunit.client.1.smithi129.stdout:4/747: write d5/d33/fc4 [1361870,93679] 0 2024-09-21T08:02:37.720 INFO:tasks.workunit.client.1.smithi129.stdout:6/752: truncate d7/d1b/d1e/d39/f46 43086 0 2024-09-21T08:02:37.720 INFO:tasks.workunit.client.1.smithi129.stdout:6/753: fdatasync d7/d1b/d1e/f36 0 2024-09-21T08:02:37.721 INFO:tasks.workunit.client.1.smithi129.stdout:6/754: fdatasync d7/d1b/d57/dd6/fde 0 2024-09-21T08:02:37.721 INFO:tasks.workunit.client.1.smithi129.stdout:6/755: write d7/d1b/d1e/d39/d79/fce [1695731,64254] 0 2024-09-21T08:02:37.721 INFO:tasks.workunit.client.1.smithi129.stdout:6/756: dread - d7/d1b/d1e/d39/d4b/de8/ff5 zero size 2024-09-21T08:02:37.722 INFO:tasks.workunit.client.1.smithi129.stdout:5/910: read d2/d1e/d35/f2b [2103431,7607] 0 2024-09-21T08:02:37.722 INFO:tasks.workunit.client.1.smithi129.stdout:5/911: fdatasync d2/f1d 0 2024-09-21T08:02:37.723 INFO:tasks.workunit.client.1.smithi129.stdout:4/748: mkdir d5/da5/d109 0 2024-09-21T08:02:37.724 INFO:tasks.workunit.client.1.smithi129.stdout:6/757: mknod d7/d1b/d1e/d39/d4b/c101 0 2024-09-21T08:02:37.724 INFO:tasks.workunit.client.1.smithi129.stdout:5/912: symlink d2/d1e/d35/d33/d36/d5a/l11f 0 2024-09-21T08:02:37.725 INFO:tasks.workunit.client.1.smithi129.stdout:0/784: dwrite de/d81/d94/ff4 [0,4194304] 0 2024-09-21T08:02:37.725 INFO:tasks.workunit.client.1.smithi129.stdout:4/749: truncate d5/d11/f45 82125 0 2024-09-21T08:02:37.725 INFO:tasks.workunit.client.1.smithi129.stdout:4/750: read - d5/d16/fe7 zero size 2024-09-21T08:02:37.726 INFO:tasks.workunit.client.1.smithi129.stdout:1/884: dwrite d1/d16/d28/f33 [0,4194304] 0 2024-09-21T08:02:37.726 INFO:tasks.workunit.client.1.smithi129.stdout:1/885: chown d1/f3f 492 1 2024-09-21T08:02:37.726 INFO:tasks.workunit.client.1.smithi129.stdout:6/758: truncate d7/d10/f15 2822497 0 2024-09-21T08:02:37.727 INFO:tasks.workunit.client.1.smithi129.stdout:6/759: dread - d7/d1b/d1e/d39/d4b/de8/d7a/ff2 zero size 2024-09-21T08:02:37.730 INFO:tasks.workunit.client.1.smithi129.stdout:4/751: mknod d5/c10a 0 2024-09-21T08:02:37.730 INFO:tasks.workunit.client.1.smithi129.stdout:4/752: fdatasync d5/d16/d24/d4f/da1/f9c 0 2024-09-21T08:02:37.732 INFO:tasks.workunit.client.1.smithi129.stdout:1/886: rename d1/d9/fbc to d1/d4/d96/f125 0 2024-09-21T08:02:37.732 INFO:tasks.workunit.client.1.smithi129.stdout:1/887: creat d1/d9/d6b/f126 x:0 0 0 2024-09-21T08:02:37.732 INFO:tasks.workunit.client.1.smithi129.stdout:1/888: fsync d1/d9/fc7 0 2024-09-21T08:02:37.733 INFO:tasks.workunit.client.0.smithi107.stdout:3/59: truncate f2 44636 0 2024-09-21T08:02:37.738 INFO:tasks.workunit.client.0.smithi107.stdout:4/84: dwrite f7 [0,4194304] 0 2024-09-21T08:02:37.739 INFO:tasks.workunit.client.1.smithi129.stdout:3/914: dwrite d3/d69/d95/de1/fe9 [0,4194304] 0 2024-09-21T08:02:37.745 INFO:tasks.workunit.client.1.smithi129.stdout:5/913: dread d2/d1e/d35/d37/d96/de5/f63 [0,4194304] 0 2024-09-21T08:02:37.745 INFO:tasks.workunit.client.1.smithi129.stdout:1/889: dread d1/d7a/f7c [0,4194304] 0 2024-09-21T08:02:37.745 INFO:tasks.workunit.client.1.smithi129.stdout:5/914: mknod d2/d1e/d35/d33/dca/c120 0 2024-09-21T08:02:37.748 INFO:tasks.workunit.client.1.smithi129.stdout:1/890: symlink d1/d4/l127 0 2024-09-21T08:02:37.748 INFO:tasks.workunit.client.1.smithi129.stdout:1/891: write d1/d16/d57/f88 [3427191,57983] 0 2024-09-21T08:02:37.749 INFO:tasks.workunit.client.1.smithi129.stdout:5/915: symlink d2/d1e/d35/d33/d36/d5a/d77/d81/l121 0 2024-09-21T08:02:37.749 INFO:tasks.workunit.client.1.smithi129.stdout:0/785: write de/d19/f86 [1602002,108486] 0 2024-09-21T08:02:37.749 INFO:tasks.workunit.client.1.smithi129.stdout:0/786: write de/d81/fe6 [633622,70133] 0 2024-09-21T08:02:37.753 INFO:tasks.workunit.client.1.smithi129.stdout:5/916: creat d2/d1e/d6b/dd1/f122 x:0 0 0 2024-09-21T08:02:37.754 INFO:tasks.workunit.client.1.smithi129.stdout:0/787: mknod de/d19/cfa 0 2024-09-21T08:02:37.754 INFO:tasks.workunit.client.1.smithi129.stdout:3/915: write d3/da/ff [2984674,104273] 0 2024-09-21T08:02:37.757 INFO:tasks.workunit.client.1.smithi129.stdout:1/892: rmdir d1/d16/d25 39 2024-09-21T08:02:37.757 INFO:tasks.workunit.client.1.smithi129.stdout:1/893: fdatasync d1/d16/d9b/f11a 0 2024-09-21T08:02:37.757 INFO:tasks.workunit.client.1.smithi129.stdout:1/894: getdents d1/d44/d83 0 2024-09-21T08:02:37.760 INFO:tasks.workunit.client.1.smithi129.stdout:5/917: creat d2/d1e/d35/d33/d36/de0/f123 x:0 0 0 2024-09-21T08:02:37.760 INFO:tasks.workunit.client.1.smithi129.stdout:5/918: chown d2/d1e/d6b/l104 408137297 1 2024-09-21T08:02:37.761 INFO:tasks.workunit.client.1.smithi129.stdout:0/788: mkdir de/d15/d39/d9e/dac/dba/dc0/dfb 0 2024-09-21T08:02:37.761 INFO:tasks.workunit.client.1.smithi129.stdout:3/916: creat d3/d69/d95/de1/df1/f13a x:0 0 0 2024-09-21T08:02:37.762 INFO:tasks.workunit.client.0.smithi107.stdout:2/41: sync 2024-09-21T08:02:37.762 INFO:tasks.workunit.client.0.smithi107.stdout:2/42: readlink d1/l4 0 2024-09-21T08:02:37.764 INFO:tasks.workunit.client.1.smithi129.stdout:5/919: mkdir d2/d1e/d35/d33/db9/d124 0 2024-09-21T08:02:37.764 INFO:tasks.workunit.client.1.smithi129.stdout:5/920: fsync d2/d1e/d35/d37/d65/dc5/ff3 0 2024-09-21T08:02:37.768 INFO:tasks.workunit.client.1.smithi129.stdout:5/921: symlink d2/d1e/d35/d33/d36/d5a/l125 0 2024-09-21T08:02:37.775 INFO:tasks.workunit.client.1.smithi129.stdout:4/753: dwrite d5/d33/fc9 [0,4194304] 0 2024-09-21T08:02:37.777 INFO:tasks.workunit.client.0.smithi107.stdout:4/85: write f8 [3155971,84850] 0 2024-09-21T08:02:37.777 INFO:tasks.workunit.client.0.smithi107.stdout:4/86: chown c2 51787 1 2024-09-21T08:02:37.777 INFO:tasks.workunit.client.0.smithi107.stdout:4/87: fsync dc/fe 0 2024-09-21T08:02:37.781 INFO:tasks.workunit.client.0.smithi107.stdout:4/88: link dc/lf dc/l14 0 2024-09-21T08:02:37.782 INFO:tasks.workunit.client.1.smithi129.stdout:3/917: dread d3/da/f49 [0,4194304] 0 2024-09-21T08:02:37.782 INFO:tasks.workunit.client.1.smithi129.stdout:3/918: stat d3/da/def 0 2024-09-21T08:02:37.782 INFO:tasks.workunit.client.1.smithi129.stdout:3/919: fdatasync d3/da/dc/d7f/dd6/de2/d120/da2/f127 0 2024-09-21T08:02:37.784 INFO:tasks.workunit.client.1.smithi129.stdout:3/920: creat d3/da/d5d/d94/f13b x:0 0 0 2024-09-21T08:02:37.784 INFO:tasks.workunit.client.0.smithi107.stdout:4/89: mknod dc/c15 0 2024-09-21T08:02:37.787 INFO:tasks.workunit.client.0.smithi107.stdout:4/90: creat dc/d13/f16 x:0 0 0 2024-09-21T08:02:37.787 INFO:tasks.workunit.client.0.smithi107.stdout:4/91: chown c1 63726526 1 2024-09-21T08:02:37.788 INFO:tasks.workunit.client.1.smithi129.stdout:3/921: symlink d3/da/def/d137/l13c 0 2024-09-21T08:02:37.788 INFO:tasks.workunit.client.1.smithi129.stdout:3/922: fsync d3/da/dc/d7f/dd6/de2/d120/fc4 0 2024-09-21T08:02:37.788 INFO:tasks.workunit.client.1.smithi129.stdout:3/923: readlink d3/da/d5d/lf7 0 2024-09-21T08:02:37.789 INFO:tasks.workunit.client.1.smithi129.stdout:3/924: mknod d3/d69/d10d/c13d 0 2024-09-21T08:02:37.789 INFO:tasks.workunit.client.1.smithi129.stdout:3/925: chown d3/d69/lcb 1996 1 2024-09-21T08:02:37.791 INFO:tasks.workunit.client.1.smithi129.stdout:6/760: dwrite d7/d1b/d1e/f36 [0,4194304] 0 2024-09-21T08:02:37.795 INFO:tasks.workunit.client.1.smithi129.stdout:6/761: rmdir d7/d1b/d1e/d66/dc2/de2/d40/db1 0 2024-09-21T08:02:37.796 INFO:tasks.workunit.client.1.smithi129.stdout:6/762: rename d7/d10/f15 to d7/d1b/d1e/d39/dbf/f102 0 2024-09-21T08:02:37.805 INFO:tasks.workunit.client.0.smithi107.stdout:4/92: dread f7 [0,4194304] 0 2024-09-21T08:02:37.806 INFO:tasks.workunit.client.0.smithi107.stdout:4/93: mknod dc/c17 0 2024-09-21T08:02:37.811 INFO:tasks.workunit.client.1.smithi129.stdout:1/895: dwrite d1/d9/d31/f5e [0,4194304] 0 2024-09-21T08:02:37.811 INFO:tasks.workunit.client.1.smithi129.stdout:3/926: read d3/fca [8350734,35875] 0 2024-09-21T08:02:37.813 INFO:tasks.workunit.client.0.smithi107.stdout:4/94: rmdir dc/d13 39 2024-09-21T08:02:37.813 INFO:tasks.workunit.client.0.smithi107.stdout:4/95: read - dc/d13/f16 zero size 2024-09-21T08:02:37.816 INFO:tasks.workunit.client.1.smithi129.stdout:1/896: symlink d1/d16/d8f/l128 0 2024-09-21T08:02:37.817 INFO:tasks.workunit.client.1.smithi129.stdout:3/927: symlink d3/da/dc/d7f/dd6/de2/d120/d80/l13e 0 2024-09-21T08:02:37.817 INFO:tasks.workunit.client.1.smithi129.stdout:3/928: creat d3/d69/d95/de1/df1/f13f x:0 0 0 2024-09-21T08:02:37.817 INFO:tasks.workunit.client.1.smithi129.stdout:3/929: chown d3/da/c103 11 1 2024-09-21T08:02:37.817 INFO:tasks.workunit.client.1.smithi129.stdout:3/930: stat d3/da/dc/d7f/dd6/ldd 0 2024-09-21T08:02:37.817 INFO:tasks.workunit.client.1.smithi129.stdout:1/897: unlink d1/d7a/da4/ce5 0 2024-09-21T08:02:37.819 INFO:tasks.workunit.client.1.smithi129.stdout:3/931: mkdir d3/d90/d140 0 2024-09-21T08:02:37.820 INFO:tasks.workunit.client.0.smithi107.stdout:3/60: dwrite f2 [0,4194304] 0 2024-09-21T08:02:37.821 INFO:tasks.workunit.client.0.smithi107.stdout:6/98: dwrite d2/d3/d7/f13 [0,4194304] 0 2024-09-21T08:02:37.821 INFO:tasks.workunit.client.0.smithi107.stdout:6/99: fsync d2/d3/d7/f15 0 2024-09-21T08:02:37.822 INFO:tasks.workunit.client.0.smithi107.stdout:3/61: rename d8/l9 to d8/l10 0 2024-09-21T08:02:37.822 INFO:tasks.workunit.client.0.smithi107.stdout:3/62: chown d8/lc 7645611 1 2024-09-21T08:02:37.822 INFO:tasks.workunit.client.1.smithi129.stdout:0/789: dwrite de/d15/d39/d7f/faa [0,4194304] 0 2024-09-21T08:02:37.823 INFO:tasks.workunit.client.1.smithi129.stdout:8/710: sync 2024-09-21T08:02:37.823 INFO:tasks.workunit.client.1.smithi129.stdout:9/774: sync 2024-09-21T08:02:37.823 INFO:tasks.workunit.client.1.smithi129.stdout:5/922: dwrite d2/f100 [0,4194304] 0 2024-09-21T08:02:37.823 INFO:tasks.workunit.client.1.smithi129.stdout:4/754: dwrite d5/d33/d66/f69 [0,4194304] 0 2024-09-21T08:02:37.824 INFO:tasks.workunit.client.0.smithi107.stdout:2/43: dwrite f0 [0,4194304] 0 2024-09-21T08:02:37.824 INFO:tasks.workunit.client.0.smithi107.stdout:2/44: dread - d1/d6/f8 zero size 2024-09-21T08:02:37.826 INFO:tasks.workunit.client.1.smithi129.stdout:0/790: symlink de/d15/d39/d9e/lfc 0 2024-09-21T08:02:37.828 INFO:tasks.workunit.client.1.smithi129.stdout:8/711: truncate d0/d6/d7/d18/d27/f3c 3970807 0 2024-09-21T08:02:37.830 INFO:tasks.workunit.client.1.smithi129.stdout:9/775: mknod d17/d60/d7b/dc4/c100 0 2024-09-21T08:02:37.830 INFO:tasks.workunit.client.1.smithi129.stdout:9/776: write d17/d60/d7b/d8c/fc2 [804869,72739] 0 2024-09-21T08:02:37.833 INFO:tasks.workunit.client.0.smithi107.stdout:2/45: write d1/f3 [73681,94170] 0 2024-09-21T08:02:37.834 INFO:tasks.workunit.client.1.smithi129.stdout:1/898: dread d1/d4/dc2/dc6/fca [0,4194304] 0 2024-09-21T08:02:37.837 INFO:tasks.workunit.client.0.smithi107.stdout:6/100: rmdir d2 39 2024-09-21T08:02:37.837 INFO:tasks.workunit.client.0.smithi107.stdout:6/101: fsync d2/fb 0 2024-09-21T08:02:37.837 INFO:tasks.workunit.client.0.smithi107.stdout:3/63: dread f2 [0,4194304] 0 2024-09-21T08:02:37.837 INFO:tasks.workunit.client.0.smithi107.stdout:3/64: chown d8/cf 24932846 1 2024-09-21T08:02:37.838 INFO:tasks.workunit.client.0.smithi107.stdout:2/46: mknod d1/d2/cd 0 2024-09-21T08:02:37.839 INFO:tasks.workunit.client.1.smithi129.stdout:4/755: rename d5/c6f to d5/d16/d24/d4f/c10b 0 2024-09-21T08:02:37.839 INFO:tasks.workunit.client.1.smithi129.stdout:4/756: creat d5/d11/d77/da8/f10c x:0 0 0 2024-09-21T08:02:37.840 INFO:tasks.workunit.client.1.smithi129.stdout:4/757: fsync d5/d16/d24/d4f/da1/f59 0 2024-09-21T08:02:37.840 INFO:tasks.workunit.client.1.smithi129.stdout:0/791: dread de/d19/f4e [0,4194304] 0 2024-09-21T08:02:37.841 INFO:tasks.workunit.client.1.smithi129.stdout:5/923: mkdir d2/d1e/d35/d33/d36/d5a/d77/d81/d126 0 2024-09-21T08:02:37.841 INFO:tasks.workunit.client.1.smithi129.stdout:5/924: creat d2/d1e/d35/d33/d36/de0/f127 x:0 0 0 2024-09-21T08:02:37.842 INFO:tasks.workunit.client.0.smithi107.stdout:6/102: creat d2/d3/d7/f17 x:0 0 0 2024-09-21T08:02:37.842 INFO:tasks.workunit.client.0.smithi107.stdout:6/103: fdatasync d2/d3/f9 0 2024-09-21T08:02:37.847 INFO:tasks.workunit.client.1.smithi129.stdout:9/777: mkdir d17/d22/d33/d7a/d89/d90/db1/d101 0 2024-09-21T08:02:37.847 INFO:tasks.workunit.client.1.smithi129.stdout:9/778: chown d17/d60/d7b/l8f 6839 1 2024-09-21T08:02:37.847 INFO:tasks.workunit.client.1.smithi129.stdout:9/779: truncate d17/d22/d33/d36/d48/f95 876248 0 2024-09-21T08:02:37.847 INFO:tasks.workunit.client.1.smithi129.stdout:9/780: creat d17/d46/f102 x:0 0 0 2024-09-21T08:02:37.847 INFO:tasks.workunit.client.1.smithi129.stdout:9/781: truncate d17/d22/d33/d36/d48/d3f/d53/fa3 601263 0 2024-09-21T08:02:37.847 INFO:tasks.workunit.client.1.smithi129.stdout:9/782: write d17/d22/d33/d7a/d89/d90/db1/d31/f51 [2579236,17415] 0 2024-09-21T08:02:37.847 INFO:tasks.workunit.client.1.smithi129.stdout:9/783: chown d17/d22/c41 3986 1 2024-09-21T08:02:37.847 INFO:tasks.workunit.client.1.smithi129.stdout:9/784: chown d17/d22/d33/d7a/d89/d90 0 1 2024-09-21T08:02:37.848 INFO:tasks.workunit.client.0.smithi107.stdout:2/47: creat d1/d2/fe x:0 0 0 2024-09-21T08:02:37.848 INFO:tasks.workunit.client.0.smithi107.stdout:3/65: dread f2 [0,4194304] 0 2024-09-21T08:02:37.849 INFO:tasks.workunit.client.1.smithi129.stdout:1/899: dread d1/d16/db3/fe1 [0,4194304] 0 2024-09-21T08:02:37.849 INFO:tasks.workunit.client.1.smithi129.stdout:3/932: dwrite d3/d5a/da9/f12b [0,4194304] 0 2024-09-21T08:02:37.849 INFO:tasks.workunit.client.1.smithi129.stdout:3/933: chown d3/da/dc/d11/d2f/l83 194228 1 2024-09-21T08:02:37.849 INFO:tasks.workunit.client.1.smithi129.stdout:3/934: creat d3/da/d5d/d94/f141 x:0 0 0 2024-09-21T08:02:37.849 INFO:tasks.workunit.client.1.smithi129.stdout:3/935: fsync d3/d69/d95/de1/ff9 0 2024-09-21T08:02:37.849 INFO:tasks.workunit.client.0.smithi107.stdout:6/104: creat d2/f18 x:0 0 0 2024-09-21T08:02:37.851 INFO:tasks.workunit.client.1.smithi129.stdout:4/758: link d5/d16/d24/d3b/lb0 d5/da5/l10d 0 2024-09-21T08:02:37.851 INFO:tasks.workunit.client.1.smithi129.stdout:4/759: creat d5/da5/f10e x:0 0 0 2024-09-21T08:02:37.851 INFO:tasks.workunit.client.0.smithi107.stdout:4/96: dwrite dc/f12 [0,4194304] 0 2024-09-21T08:02:37.851 INFO:tasks.workunit.client.0.smithi107.stdout:2/48: mknod d1/d2/cf 0 2024-09-21T08:02:37.851 INFO:tasks.workunit.client.0.smithi107.stdout:2/49: write d1/f3 [732670,11998] 0 2024-09-21T08:02:37.855 INFO:tasks.workunit.client.0.smithi107.stdout:6/105: mknod d2/c19 0 2024-09-21T08:02:37.855 INFO:tasks.workunit.client.0.smithi107.stdout:6/106: write d2/d3/d7/f15 [286945,119567] 0 2024-09-21T08:02:37.855 INFO:tasks.workunit.client.0.smithi107.stdout:6/107: write d2/d3/d7/f17 [990619,28599] 0 2024-09-21T08:02:37.855 INFO:tasks.workunit.client.0.smithi107.stdout:6/108: truncate d2/d3/d7/f12 116239 0 2024-09-21T08:02:37.855 INFO:tasks.workunit.client.0.smithi107.stdout:6/109: chown d2 10 1 2024-09-21T08:02:37.855 INFO:tasks.workunit.client.0.smithi107.stdout:6/110: write d2/d3/d7/f17 [1821397,67320] 0 2024-09-21T08:02:37.855 INFO:tasks.workunit.client.0.smithi107.stdout:6/111: rename d2 to d2/d3/d7/d1a 22 2024-09-21T08:02:37.860 INFO:tasks.workunit.client.0.smithi107.stdout:3/66: write f2 [1945677,64241] 0 2024-09-21T08:02:37.860 INFO:tasks.workunit.client.0.smithi107.stdout:3/67: creat d8/f11 x:0 0 0 2024-09-21T08:02:37.862 INFO:tasks.workunit.client.0.smithi107.stdout:2/50: rmdir d1 39 2024-09-21T08:02:37.862 INFO:tasks.workunit.client.0.smithi107.stdout:2/51: chown d1/d6/f7 2081 1 2024-09-21T08:02:37.862 INFO:tasks.workunit.client.0.smithi107.stdout:2/52: write d1/d2/f5 [317868,81206] 0 2024-09-21T08:02:37.865 INFO:tasks.workunit.client.0.smithi107.stdout:6/112: link d2/d3/f9 d2/d3/d7/f1b 0 2024-09-21T08:02:37.865 INFO:tasks.workunit.client.1.smithi129.stdout:9/785: dread d17/d22/d33/d7a/d89/d90/db1/d31/d5e/fc1 [0,4194304] 0 2024-09-21T08:02:37.866 INFO:tasks.workunit.client.1.smithi129.stdout:5/925: dwrite d2/d1e/d35/d33/d36/d5a/f105 [0,4194304] 0 2024-09-21T08:02:37.870 INFO:tasks.workunit.client.0.smithi107.stdout:3/68: stat c3 0 2024-09-21T08:02:37.872 INFO:tasks.workunit.client.1.smithi129.stdout:3/936: symlink d3/da/dc/d11/d55/l142 0 2024-09-21T08:02:37.872 INFO:tasks.workunit.client.1.smithi129.stdout:3/937: rename d3/da/dc to d3/da/dc/d11/d55/d143 22 2024-09-21T08:02:37.872 INFO:tasks.workunit.client.1.smithi129.stdout:3/938: readlink d3/d5a/da9/l122 0 2024-09-21T08:02:37.872 INFO:tasks.workunit.client.0.smithi107.stdout:4/97: dread dc/f12 [0,4194304] 0 2024-09-21T08:02:37.876 INFO:tasks.workunit.client.1.smithi129.stdout:5/926: dread d2/d1e/d35/f4d [0,4194304] 0 2024-09-21T08:02:37.878 INFO:tasks.workunit.client.1.smithi129.stdout:3/939: rmdir d3/da/d5d/d94/dac/dfa 39 2024-09-21T08:02:37.880 INFO:tasks.workunit.client.1.smithi129.stdout:4/760: dwrite d5/d16/d24/d4f/f72 [0,4194304] 0 2024-09-21T08:02:37.880 INFO:tasks.workunit.client.1.smithi129.stdout:5/927: rename d2/d1e/d35/d37/d96/de5/db1/d71/da9/lee to d2/d1e/d35/d33/d36/de0/l128 0 2024-09-21T08:02:37.883 INFO:tasks.workunit.client.0.smithi107.stdout:7/105: sync 2024-09-21T08:02:37.883 INFO:tasks.workunit.client.1.smithi129.stdout:3/940: read d3/da/dc/d7f/fa8 [3305078,3333] 0 2024-09-21T08:02:37.883 INFO:tasks.workunit.client.1.smithi129.stdout:3/941: creat d3/da/dc/d7f/dd6/de2/df2/f144 x:0 0 0 2024-09-21T08:02:37.884 INFO:tasks.workunit.client.1.smithi129.stdout:3/942: chown d3/da/dc/d7f/dd6/de2/df2/f11c 24054631 1 2024-09-21T08:02:37.884 INFO:tasks.workunit.client.1.smithi129.stdout:3/943: write d3/da/dc/d11/d2f/fbf [8141923,71672] 0 2024-09-21T08:02:37.886 INFO:tasks.workunit.client.1.smithi129.stdout:0/792: dwrite de/d81/fa7 [0,4194304] 0 2024-09-21T08:02:37.886 INFO:tasks.workunit.client.1.smithi129.stdout:4/761: symlink d5/d16/d24/d3b/l10f 0 2024-09-21T08:02:37.887 INFO:tasks.workunit.client.1.smithi129.stdout:1/900: dwrite d1/d16/fdb [0,4194304] 0 2024-09-21T08:02:37.887 INFO:tasks.workunit.client.1.smithi129.stdout:4/762: stat d5/d48/da9 0 2024-09-21T08:02:37.887 INFO:tasks.workunit.client.0.smithi107.stdout:3/69: fsync f2 0 2024-09-21T08:02:37.887 INFO:tasks.workunit.client.0.smithi107.stdout:3/70: creat d8/f12 x:0 0 0 2024-09-21T08:02:37.888 INFO:tasks.workunit.client.0.smithi107.stdout:3/71: creat d8/f13 x:0 0 0 2024-09-21T08:02:37.888 INFO:tasks.workunit.client.0.smithi107.stdout:3/72: fsync d8/f11 0 2024-09-21T08:02:37.889 INFO:tasks.workunit.client.1.smithi129.stdout:9/786: dwrite d17/d55/fb9 [0,4194304] 0 2024-09-21T08:02:37.889 INFO:tasks.workunit.client.1.smithi129.stdout:9/787: chown d17/f26 24515 1 2024-09-21T08:02:37.889 INFO:tasks.workunit.client.1.smithi129.stdout:9/788: write d17/f80 [543884,87316] 0 2024-09-21T08:02:37.889 INFO:tasks.workunit.client.0.smithi107.stdout:2/53: creat d1/f10 x:0 0 0 2024-09-21T08:02:37.889 INFO:tasks.workunit.client.0.smithi107.stdout:2/54: truncate d1/d6/fa 731534 0 2024-09-21T08:02:37.889 INFO:tasks.workunit.client.0.smithi107.stdout:2/55: dread - d1/f10 zero size 2024-09-21T08:02:37.891 INFO:tasks.workunit.client.0.smithi107.stdout:6/113: symlink d2/d3/d7/l1c 0 2024-09-21T08:02:37.893 INFO:tasks.workunit.client.0.smithi107.stdout:4/98: creat dc/d13/f18 x:0 0 0 2024-09-21T08:02:37.894 INFO:tasks.workunit.client.1.smithi129.stdout:3/944: creat d3/da/dc/f145 x:0 0 0 2024-09-21T08:02:37.894 INFO:tasks.workunit.client.1.smithi129.stdout:3/945: creat d3/da/d5d/f146 x:0 0 0 2024-09-21T08:02:37.895 INFO:tasks.workunit.client.1.smithi129.stdout:3/946: write d3/d69/d98/fd7 [476363,94480] 0 2024-09-21T08:02:37.897 INFO:tasks.workunit.client.1.smithi129.stdout:1/901: write d1/d16/db3/ff8 [1110408,2325] 0 2024-09-21T08:02:37.897 INFO:tasks.workunit.client.1.smithi129.stdout:1/902: write d1/d9/fc7 [137528,53360] 0 2024-09-21T08:02:37.899 INFO:tasks.workunit.client.1.smithi129.stdout:0/793: write f6 [2005817,38702] 0 2024-09-21T08:02:37.900 INFO:tasks.workunit.client.1.smithi129.stdout:4/763: write d5/d16/d24/d3b/f65 [2051165,102831] 0 2024-09-21T08:02:37.900 INFO:tasks.workunit.client.1.smithi129.stdout:4/764: chown d5/d16/d24/d3b/l107 695 1 2024-09-21T08:02:37.901 INFO:tasks.workunit.client.0.smithi107.stdout:3/73: mkdir d8/d14 0 2024-09-21T08:02:37.901 INFO:tasks.workunit.client.0.smithi107.stdout:3/74: creat d8/f15 x:0 0 0 2024-09-21T08:02:37.901 INFO:tasks.workunit.client.0.smithi107.stdout:3/75: stat d8/ld 0 2024-09-21T08:02:37.901 INFO:tasks.workunit.client.0.smithi107.stdout:3/76: chown d8/lc 615686 1 2024-09-21T08:02:37.902 INFO:tasks.workunit.client.1.smithi129.stdout:5/928: dwrite d2/d2a/fb0 [0,4194304] 0 2024-09-21T08:02:37.902 INFO:tasks.workunit.client.1.smithi129.stdout:5/929: stat d2/d2a/c5f 0 2024-09-21T08:02:37.902 INFO:tasks.workunit.client.1.smithi129.stdout:5/930: chown d2/d1e/d6b/dd1/le2 1328 1 2024-09-21T08:02:37.902 INFO:tasks.workunit.client.0.smithi107.stdout:2/56: mknod d1/c11 0 2024-09-21T08:02:37.905 INFO:tasks.workunit.client.0.smithi107.stdout:6/114: link d2/l10 d2/l1d 0 2024-09-21T08:02:37.908 INFO:tasks.workunit.client.0.smithi107.stdout:4/99: truncate dc/f12 2295709 0 2024-09-21T08:02:37.908 INFO:tasks.workunit.client.0.smithi107.stdout:4/100: truncate dc/f11 726680 0 2024-09-21T08:02:37.908 INFO:tasks.workunit.client.0.smithi107.stdout:3/77: dread f2 [0,4194304] 0 2024-09-21T08:02:37.911 INFO:tasks.workunit.client.1.smithi129.stdout:9/789: creat d17/d22/d33/d36/d48/d3f/d71/f103 x:0 0 0 2024-09-21T08:02:37.911 INFO:tasks.workunit.client.1.smithi129.stdout:9/790: write d17/d22/d33/d7a/d89/d90/db1/f43 [4866126,129052] 0 2024-09-21T08:02:37.911 INFO:tasks.workunit.client.1.smithi129.stdout:9/791: fdatasync d17/d22/d33/d7a/d89/d90/db1/d31/fff 0 2024-09-21T08:02:37.911 INFO:tasks.workunit.client.1.smithi129.stdout:9/792: write d17/d22/d33/d7a/d89/d90/db1/d31/f51 [3456417,49197] 0 2024-09-21T08:02:37.914 INFO:tasks.workunit.client.0.smithi107.stdout:2/57: mknod d1/d6/c12 0 2024-09-21T08:02:37.914 INFO:tasks.workunit.client.0.smithi107.stdout:2/58: chown d1/d6/f8 181 1 2024-09-21T08:02:37.914 INFO:tasks.workunit.client.0.smithi107.stdout:2/59: fsync d1/d2/f5 0 2024-09-21T08:02:37.914 INFO:tasks.workunit.client.0.smithi107.stdout:2/60: stat d1/d2/f5 0 2024-09-21T08:02:37.914 INFO:tasks.workunit.client.0.smithi107.stdout:2/61: write d1/f3 [193535,34828] 0 2024-09-21T08:02:37.914 INFO:tasks.workunit.client.0.smithi107.stdout:2/62: fdatasync d1/d2/f5 0 2024-09-21T08:02:37.914 INFO:tasks.workunit.client.0.smithi107.stdout:2/63: chown d1/d2/cd 6 1 2024-09-21T08:02:37.915 INFO:tasks.workunit.client.1.smithi129.stdout:3/947: rename d3/da/dc/d7f/dd6/de2/d120/d80/f107 to d3/d69/d95/d52/f147 0 2024-09-21T08:02:37.916 INFO:tasks.workunit.client.0.smithi107.stdout:6/115: symlink d2/d3/l1e 0 2024-09-21T08:02:37.916 INFO:tasks.workunit.client.0.smithi107.stdout:6/116: creat d2/d3/d7/f1f x:0 0 0 2024-09-21T08:02:37.916 INFO:tasks.workunit.client.0.smithi107.stdout:6/117: write d2/d3/d7/f1b [440494,93894] 0 2024-09-21T08:02:37.916 INFO:tasks.workunit.client.0.smithi107.stdout:3/78: fsync d8/f12 0 2024-09-21T08:02:37.919 INFO:tasks.workunit.client.1.smithi129.stdout:1/903: link d1/d4/d96/f125 d1/d16/d8f/f129 0 2024-09-21T08:02:37.919 INFO:tasks.workunit.client.1.smithi129.stdout:1/904: dread - d1/d16/d28/fd4 zero size 2024-09-21T08:02:37.920 INFO:tasks.workunit.client.1.smithi129.stdout:0/794: mkdir de/d15/d39/d9e/dac/dfd 0 2024-09-21T08:02:37.921 INFO:tasks.workunit.client.0.smithi107.stdout:2/64: mknod d1/c13 0 2024-09-21T08:02:37.921 INFO:tasks.workunit.client.0.smithi107.stdout:2/65: dread - d1/d2/fe zero size 2024-09-21T08:02:37.923 INFO:tasks.workunit.client.1.smithi129.stdout:4/765: mknod d5/d48/da9/c110 0 2024-09-21T08:02:37.926 INFO:tasks.workunit.client.0.smithi107.stdout:3/79: rename d8/cf to d8/c16 0 2024-09-21T08:02:37.926 INFO:tasks.workunit.client.0.smithi107.stdout:3/80: write d8/f13 [893323,73866] 0 2024-09-21T08:02:37.926 INFO:tasks.workunit.client.0.smithi107.stdout:3/81: stat d8/f11 0 2024-09-21T08:02:37.927 INFO:tasks.workunit.client.0.smithi107.stdout:3/82: chown d8 3334 1 2024-09-21T08:02:37.927 INFO:tasks.workunit.client.0.smithi107.stdout:3/83: dread - d8/fe zero size 2024-09-21T08:02:37.927 INFO:tasks.workunit.client.0.smithi107.stdout:3/84: truncate d8/f15 432287 0 2024-09-21T08:02:37.927 INFO:tasks.workunit.client.0.smithi107.stdout:4/101: dwrite dc/fe [0,4194304] 0 2024-09-21T08:02:37.928 INFO:tasks.workunit.client.0.smithi107.stdout:2/66: unlink d1/d6/f7 0 2024-09-21T08:02:37.928 INFO:tasks.workunit.client.0.smithi107.stdout:2/67: dread - d1/d2/f9 zero size 2024-09-21T08:02:37.932 INFO:tasks.workunit.client.0.smithi107.stdout:3/85: symlink d8/l17 0 2024-09-21T08:02:37.932 INFO:tasks.workunit.client.1.smithi129.stdout:0/795: write de/d1f/f24 [3272605,94719] 0 2024-09-21T08:02:37.937 INFO:tasks.workunit.client.0.smithi107.stdout:4/102: mknod dc/c19 0 2024-09-21T08:02:37.937 INFO:tasks.workunit.client.0.smithi107.stdout:4/103: write f6 [1966686,65014] 0 2024-09-21T08:02:37.939 INFO:tasks.workunit.client.0.smithi107.stdout:2/68: rename d1/d2/fe to d1/d2/f14 0 2024-09-21T08:02:37.939 INFO:tasks.workunit.client.0.smithi107.stdout:2/69: chown d1/d6/c12 152724827 1 2024-09-21T08:02:37.939 INFO:tasks.workunit.client.0.smithi107.stdout:2/70: creat d1/d2/f15 x:0 0 0 2024-09-21T08:02:37.939 INFO:tasks.workunit.client.0.smithi107.stdout:2/71: stat d1/d2/f5 0 2024-09-21T08:02:37.939 INFO:tasks.workunit.client.0.smithi107.stdout:6/118: rmdir d2 39 2024-09-21T08:02:37.940 INFO:tasks.workunit.client.0.smithi107.stdout:3/86: symlink d8/d14/l18 0 2024-09-21T08:02:37.942 INFO:tasks.workunit.client.1.smithi129.stdout:9/793: mknod d17/d22/d33/d36/c104 0 2024-09-21T08:02:37.943 INFO:tasks.workunit.client.0.smithi107.stdout:4/104: truncate fb 1923172 0 2024-09-21T08:02:37.945 INFO:tasks.workunit.client.1.smithi129.stdout:3/948: mkdir d3/da/dc/d7f/dd6/de2/d148 0 2024-09-21T08:02:37.945 INFO:tasks.workunit.client.1.smithi129.stdout:3/949: write d3/da/dc/d11/d2f/fcf [2913447,127628] 0 2024-09-21T08:02:37.945 INFO:tasks.workunit.client.1.smithi129.stdout:3/950: fdatasync d3/da/dc/f145 0 2024-09-21T08:02:37.948 INFO:tasks.workunit.client.1.smithi129.stdout:1/905: mkdir d1/d16/d9b/d12a 0 2024-09-21T08:02:37.949 INFO:tasks.workunit.client.0.smithi107.stdout:2/72: mkdir d1/d16 0 2024-09-21T08:02:37.950 INFO:tasks.workunit.client.1.smithi129.stdout:5/931: symlink d2/d1e/d35/d37/l129 0 2024-09-21T08:02:37.952 INFO:tasks.workunit.client.0.smithi107.stdout:6/119: rename d2/l10 to d2/d3/d7/l20 0 2024-09-21T08:02:37.952 INFO:tasks.workunit.client.0.smithi107.stdout:6/120: write d2/d3/f9 [1200600,35907] 0 2024-09-21T08:02:37.954 INFO:tasks.workunit.client.1.smithi129.stdout:5/932: dread d2/d1e/d35/d37/d96/de5/d61/fa4 [0,4194304] 0 2024-09-21T08:02:37.954 INFO:tasks.workunit.client.1.smithi129.stdout:5/933: write d2/f24 [4465427,124769] 0 2024-09-21T08:02:37.956 INFO:tasks.workunit.client.1.smithi129.stdout:0/796: creat de/d81/d94/ffe x:0 0 0 2024-09-21T08:02:37.958 INFO:tasks.workunit.client.0.smithi107.stdout:2/73: rename d1/d6/f8 to d1/d16/f17 0 2024-09-21T08:02:37.959 INFO:tasks.workunit.client.1.smithi129.stdout:9/794: write d17/d22/d33/f9e [1695337,511] 0 2024-09-21T08:02:37.959 INFO:tasks.workunit.client.1.smithi129.stdout:9/795: chown d17/d22/d33/d7a/d89/d90/db1/d31/d5e/fc1 888 1 2024-09-21T08:02:37.960 INFO:tasks.workunit.client.1.smithi129.stdout:9/796: dread d17/d22/d33/d36/d48/db7/fe2 [0,4194304] 0 2024-09-21T08:02:37.960 INFO:tasks.workunit.client.1.smithi129.stdout:9/797: chown d17/d22/d33/d7a/d89/d90/db1/d31/fff 2534 1 2024-09-21T08:02:37.961 INFO:tasks.workunit.client.1.smithi129.stdout:1/906: creat d1/d4/dad/db6/df7/f12b x:0 0 0 2024-09-21T08:02:37.961 INFO:tasks.workunit.client.1.smithi129.stdout:1/907: write d1/d16/d28/f11f [271189,74690] 0 2024-09-21T08:02:37.961 INFO:tasks.workunit.client.1.smithi129.stdout:1/908: chown d1/d16/d25/c80 47585080 1 2024-09-21T08:02:37.963 INFO:tasks.workunit.client.0.smithi107.stdout:2/74: unlink d1/d2/f14 0 2024-09-21T08:02:37.963 INFO:tasks.workunit.client.0.smithi107.stdout:2/75: chown d1/d16 1136 1 2024-09-21T08:02:37.963 INFO:tasks.workunit.client.0.smithi107.stdout:2/76: dread - d1/d16/f17 zero size 2024-09-21T08:02:37.963 INFO:tasks.workunit.client.1.smithi129.stdout:9/798: truncate d17/f1e 1456682 0 2024-09-21T08:02:37.964 INFO:tasks.workunit.client.0.smithi107.stdout:4/105: dwrite fa [0,4194304] 0 2024-09-21T08:02:37.965 INFO:tasks.workunit.client.1.smithi129.stdout:1/909: rename d1/d4/f84 to d1/d4/d6e/da9/f12c 0 2024-09-21T08:02:37.965 INFO:tasks.workunit.client.1.smithi129.stdout:0/797: dread de/d15/d39/d56/f63 [0,4194304] 0 2024-09-21T08:02:37.965 INFO:tasks.workunit.client.0.smithi107.stdout:2/77: creat d1/d6/f18 x:0 0 0 2024-09-21T08:02:37.966 INFO:tasks.workunit.client.1.smithi129.stdout:5/934: dread d2/d1e/d35/f2d [0,4194304] 0 2024-09-21T08:02:37.967 INFO:tasks.workunit.client.1.smithi129.stdout:0/798: symlink de/d15/d39/d9e/dac/dba/dc0/lff 0 2024-09-21T08:02:37.969 INFO:tasks.workunit.client.1.smithi129.stdout:3/951: dwrite d3/da/dc/d11/f124 [0,4194304] 0 2024-09-21T08:02:37.970 INFO:tasks.workunit.client.0.smithi107.stdout:6/121: dwrite d2/fb [0,4194304] 0 2024-09-21T08:02:37.971 INFO:tasks.workunit.client.0.smithi107.stdout:3/87: rmdir d8 39 2024-09-21T08:02:37.973 INFO:tasks.workunit.client.1.smithi129.stdout:9/799: rename d17/d22/d33/l64 to d17/d22/d33/d7a/d89/l105 0 2024-09-21T08:02:37.973 INFO:tasks.workunit.client.1.smithi129.stdout:9/800: write d17/d22/d33/d36/d48/d3f/f69 [265426,68340] 0 2024-09-21T08:02:37.976 INFO:tasks.workunit.client.1.smithi129.stdout:5/935: creat d2/d1e/d6b/f12a x:0 0 0 2024-09-21T08:02:37.980 INFO:tasks.workunit.client.0.smithi107.stdout:3/88: unlink d8/fa 0 2024-09-21T08:02:37.982 INFO:tasks.workunit.client.0.smithi107.stdout:6/122: dread d2/d3/f4 [0,4194304] 0 2024-09-21T08:02:37.983 INFO:tasks.workunit.client.1.smithi129.stdout:5/936: mkdir d2/d2a/d12b 0 2024-09-21T08:02:37.983 INFO:tasks.workunit.client.1.smithi129.stdout:5/937: chown d2/d1e/d35/d33/dca/fe1 0 1 2024-09-21T08:02:37.983 INFO:tasks.workunit.client.1.smithi129.stdout:5/938: truncate d2/d2a/f68 5537128 0 2024-09-21T08:02:37.983 INFO:tasks.workunit.client.1.smithi129.stdout:0/799: dread de/d15/d39/d9e/dac/dba/dc0/fcb [0,4194304] 0 2024-09-21T08:02:37.984 INFO:tasks.workunit.client.1.smithi129.stdout:3/952: dread d3/da/dc/f62 [0,4194304] 0 2024-09-21T08:02:37.985 INFO:tasks.workunit.client.1.smithi129.stdout:0/800: rename de/d15/d39/c88 to de/d15/d39/d9e/c100 0 2024-09-21T08:02:37.985 INFO:tasks.workunit.client.1.smithi129.stdout:0/801: write de/d15/f28 [537447,52315] 0 2024-09-21T08:02:37.986 INFO:tasks.workunit.client.1.smithi129.stdout:3/953: unlink d3/d69/d95/l44 0 2024-09-21T08:02:37.987 INFO:tasks.workunit.client.1.smithi129.stdout:3/954: fdatasync d3/da/dc/d11/d55/d68/f87 0 2024-09-21T08:02:37.988 INFO:tasks.workunit.client.0.smithi107.stdout:3/89: dread f2 [0,4194304] 0 2024-09-21T08:02:37.988 INFO:tasks.workunit.client.0.smithi107.stdout:3/90: write d8/fe [181449,87047] 0 2024-09-21T08:02:37.988 INFO:tasks.workunit.client.0.smithi107.stdout:3/91: fsync d8/f12 0 2024-09-21T08:02:37.989 INFO:tasks.workunit.client.1.smithi129.stdout:0/802: mkdir de/d15/d39/d56/def/d101 0 2024-09-21T08:02:37.991 INFO:tasks.workunit.client.1.smithi129.stdout:3/955: rename d3/da/d5d/d94/dac/dfa/d138/f133 to d3/da/d5d/f149 0 2024-09-21T08:02:37.992 INFO:tasks.workunit.client.1.smithi129.stdout:0/803: mkdir de/d22/d27/d2f/d42/d102 0 2024-09-21T08:02:37.995 INFO:tasks.workunit.client.1.smithi129.stdout:0/804: mkdir de/d22/d27/d103 0 2024-09-21T08:02:37.995 INFO:tasks.workunit.client.1.smithi129.stdout:0/805: chown de/d15/d39/d9e/dac/lde 870 1 2024-09-21T08:02:37.995 INFO:tasks.workunit.client.1.smithi129.stdout:3/956: rmdir d3/da/dc/d25 39 2024-09-21T08:02:37.998 INFO:tasks.workunit.client.1.smithi129.stdout:0/806: mknod de/d1f/dd4/c104 0 2024-09-21T08:02:37.999 INFO:tasks.workunit.client.1.smithi129.stdout:3/957: rename d3/da/dc/d25/fa5 to d3/da/d5d/d94/dac/dfa/d138/f14a 0 2024-09-21T08:02:37.999 INFO:tasks.workunit.client.1.smithi129.stdout:3/958: creat d3/da/dc/d7f/dd6/f14b x:0 0 0 2024-09-21T08:02:38.001 INFO:tasks.workunit.client.1.smithi129.stdout:5/939: write d2/f100 [1366099,88900] 0 2024-09-21T08:02:38.001 INFO:tasks.workunit.client.1.smithi129.stdout:0/807: rename de/d15/d39/d56/f7d to de/d22/d27/d30/f105 0 2024-09-21T08:02:38.001 INFO:tasks.workunit.client.1.smithi129.stdout:0/808: fsync de/d15/d87/fc8 0 2024-09-21T08:02:38.003 INFO:tasks.workunit.client.1.smithi129.stdout:3/959: truncate d3/da/dc/d7f/dd6/de2/df2/f11c 831106 0 2024-09-21T08:02:38.004 INFO:tasks.workunit.client.1.smithi129.stdout:5/940: mkdir d2/d1e/d35/d33/d36/de0/d12c 0 2024-09-21T08:02:38.005 INFO:tasks.workunit.client.1.smithi129.stdout:0/809: mknod de/d22/d27/d85/db2/dbe/c106 0 2024-09-21T08:02:38.006 INFO:tasks.workunit.client.1.smithi129.stdout:3/960: mkdir d3/da/dc/d7f/d14c 0 2024-09-21T08:02:38.008 INFO:tasks.workunit.client.1.smithi129.stdout:5/941: mknod d2/d1e/d35/d37/d96/de5/db1/de7/d113/c12d 0 2024-09-21T08:02:38.010 INFO:tasks.workunit.client.1.smithi129.stdout:0/810: unlink de/f3c 0 2024-09-21T08:02:38.010 INFO:tasks.workunit.client.1.smithi129.stdout:0/811: fdatasync de/d19/f38 0 2024-09-21T08:02:38.011 INFO:tasks.workunit.client.1.smithi129.stdout:0/812: mknod de/d1f/dd4/db1/c107 0 2024-09-21T08:02:38.013 INFO:tasks.workunit.client.1.smithi129.stdout:1/910: dwrite d1/d16/d28/ff2 [0,4194304] 0 2024-09-21T08:02:38.013 INFO:tasks.workunit.client.1.smithi129.stdout:1/911: write d1/d4/f108 [1185073,206] 0 2024-09-21T08:02:38.013 INFO:tasks.workunit.client.0.smithi107.stdout:2/78: dwrite d1/d6/f18 [0,4194304] 0 2024-09-21T08:02:38.014 INFO:tasks.workunit.client.0.smithi107.stdout:4/106: dwrite dc/d13/f16 [0,4194304] 0 2024-09-21T08:02:38.014 INFO:tasks.workunit.client.0.smithi107.stdout:4/107: creat dc/f1a x:0 0 0 2024-09-21T08:02:38.014 INFO:tasks.workunit.client.1.smithi129.stdout:9/801: dwrite f10 [0,4194304] 0 2024-09-21T08:02:38.014 INFO:tasks.workunit.client.0.smithi107.stdout:6/123: dwrite d2/d3/d7/f1f [0,4194304] 0 2024-09-21T08:02:38.016 INFO:tasks.workunit.client.1.smithi129.stdout:1/912: getdents d1/d4/dc2/dc6/d7f/d112 0 2024-09-21T08:02:38.019 INFO:tasks.workunit.client.1.smithi129.stdout:3/961: write d3/da/dc/d11/d55/f10a [4080820,87972] 0 2024-09-21T08:02:38.022 INFO:tasks.workunit.client.0.smithi107.stdout:2/79: mknod d1/d16/c19 0 2024-09-21T08:02:38.023 INFO:tasks.workunit.client.0.smithi107.stdout:2/80: dread - d1/d16/f17 zero size 2024-09-21T08:02:38.027 INFO:tasks.workunit.client.0.smithi107.stdout:6/124: dread d2/d3/f6 [0,4194304] 0 2024-09-21T08:02:38.035 INFO:tasks.workunit.client.0.smithi107.stdout:2/81: unlink d1/d6/fa 0 2024-09-21T08:02:38.037 INFO:tasks.workunit.client.1.smithi129.stdout:9/802: getdents d17/d22/d33/d7a/d89/d90/db1/d31/d35 0 2024-09-21T08:02:38.037 INFO:tasks.workunit.client.1.smithi129.stdout:9/803: stat d17/d22/d33/d36/d48/c78 0 2024-09-21T08:02:38.037 INFO:tasks.workunit.client.1.smithi129.stdout:9/804: read - d17/d22/d33/d7a/d89/d90/db1/d31/f87 zero size 2024-09-21T08:02:38.037 INFO:tasks.workunit.client.0.smithi107.stdout:6/125: mknod d2/c21 0 2024-09-21T08:02:38.038 INFO:tasks.workunit.client.0.smithi107.stdout:2/82: symlink d1/l1a 0 2024-09-21T08:02:38.038 INFO:tasks.workunit.client.1.smithi129.stdout:1/913: dread d1/d16/d57/f86 [0,4194304] 0 2024-09-21T08:02:38.039 INFO:tasks.workunit.client.1.smithi129.stdout:9/805: mknod d17/d22/d33/de6/c106 0 2024-09-21T08:02:38.039 INFO:tasks.workunit.client.1.smithi129.stdout:9/806: fsync d17/f1e 0 2024-09-21T08:02:38.039 INFO:tasks.workunit.client.0.smithi107.stdout:6/126: rmdir d2 39 2024-09-21T08:02:38.041 INFO:tasks.workunit.client.0.smithi107.stdout:2/83: link d1/d2/cd d1/d16/c1b 0 2024-09-21T08:02:38.042 INFO:tasks.workunit.client.0.smithi107.stdout:6/127: creat d2/d3/f22 x:0 0 0 2024-09-21T08:02:38.043 INFO:tasks.workunit.client.1.smithi129.stdout:9/807: symlink d17/d22/d33/d7a/d89/d90/db1/d31/l107 0 2024-09-21T08:02:38.043 INFO:tasks.workunit.client.0.smithi107.stdout:2/84: dread d1/d2/f5 [0,4194304] 0 2024-09-21T08:02:38.044 INFO:tasks.workunit.client.0.smithi107.stdout:6/128: unlink d2/d3/d7/f17 0 2024-09-21T08:02:38.045 INFO:tasks.workunit.client.0.smithi107.stdout:6/129: stat d2/d3/d7/l16 0 2024-09-21T08:02:38.046 INFO:tasks.workunit.client.1.smithi129.stdout:1/914: write d1/d4/d6e/da9/f12c [2662200,20734] 0 2024-09-21T08:02:38.046 INFO:tasks.workunit.client.0.smithi107.stdout:6/130: mkdir d2/d3/d7/d23 0 2024-09-21T08:02:38.049 INFO:tasks.workunit.client.1.smithi129.stdout:9/808: dread d17/d22/d33/d7a/d89/d90/db1/f43 [0,4194304] 0 2024-09-21T08:02:38.051 INFO:tasks.workunit.client.1.smithi129.stdout:9/809: mknod d17/d60/d7b/d8c/c108 0 2024-09-21T08:02:38.051 INFO:tasks.workunit.client.1.smithi129.stdout:9/810: truncate d17/d22/d33/d36/d48/d3f/d53/fa3 1524729 0 2024-09-21T08:02:38.051 INFO:tasks.workunit.client.1.smithi129.stdout:9/811: write d17/d22/d33/d36/d48/d3f/d53/f7e [908683,89385] 0 2024-09-21T08:02:38.052 INFO:tasks.workunit.client.1.smithi129.stdout:9/812: mknod d17/d22/d33/d36/d48/db7/dc9/c109 0 2024-09-21T08:02:38.052 INFO:tasks.workunit.client.1.smithi129.stdout:9/813: write d17/f80 [1089087,19399] 0 2024-09-21T08:02:38.054 INFO:tasks.workunit.client.1.smithi129.stdout:9/814: link d17/d46/f4f d17/d22/d33/d36/de4/f10a 0 2024-09-21T08:02:38.055 INFO:tasks.workunit.client.1.smithi129.stdout:9/815: unlink d17/d55/dd1/lea 0 2024-09-21T08:02:38.057 INFO:tasks.workunit.client.1.smithi129.stdout:9/816: link d17/d22/d33/d7a/d89/d90/db1/d31/d35/fbb d17/d22/d33/d7a/f10b 0 2024-09-21T08:02:38.058 INFO:tasks.workunit.client.1.smithi129.stdout:9/817: rename d17/d55/d81/c6e to d17/d22/d33/d7a/d89/d90/db1/d31/d5e/d6b/db6/c10c 0 2024-09-21T08:02:38.059 INFO:tasks.workunit.client.1.smithi129.stdout:4/766: sync 2024-09-21T08:02:38.059 INFO:tasks.workunit.client.1.smithi129.stdout:6/763: sync 2024-09-21T08:02:38.059 INFO:tasks.workunit.client.1.smithi129.stdout:8/712: sync 2024-09-21T08:02:38.060 INFO:tasks.workunit.client.1.smithi129.stdout:4/767: fsync d5/da5/db1/ff5 0 2024-09-21T08:02:38.070 INFO:tasks.workunit.client.1.smithi129.stdout:8/713: dread d0/d6/f1a [0,4194304] 0 2024-09-21T08:02:38.071 INFO:tasks.workunit.client.1.smithi129.stdout:8/714: mknod d0/d6/d7/d18/d61/cd4 0 2024-09-21T08:02:38.071 INFO:tasks.workunit.client.1.smithi129.stdout:8/715: readlink d0/d6/d7/d18/lca 0 2024-09-21T08:02:38.075 INFO:tasks.workunit.client.0.smithi107.stdout:1/74: sync 2024-09-21T08:02:38.075 INFO:tasks.workunit.client.0.smithi107.stdout:0/138: sync 2024-09-21T08:02:38.075 INFO:tasks.workunit.client.0.smithi107.stdout:9/92: sync 2024-09-21T08:02:38.075 INFO:tasks.workunit.client.0.smithi107.stdout:1/75: readlink d0/d7/le 0 2024-09-21T08:02:38.075 INFO:tasks.workunit.client.0.smithi107.stdout:0/139: chown d1/d5/d25/c1b 17976 1 2024-09-21T08:02:38.077 INFO:tasks.workunit.client.0.smithi107.stdout:0/140: link d1/fe d1/d5/d25/d2d/f2f 0 2024-09-21T08:02:38.077 INFO:tasks.workunit.client.0.smithi107.stdout:0/141: fsync d1/d5/f1e 0 2024-09-21T08:02:38.077 INFO:tasks.workunit.client.0.smithi107.stdout:5/101: sync 2024-09-21T08:02:38.077 INFO:tasks.workunit.client.0.smithi107.stdout:8/28: sync 2024-09-21T08:02:38.077 INFO:tasks.workunit.client.0.smithi107.stdout:5/102: dread - d7/de/f1a zero size 2024-09-21T08:02:38.077 INFO:tasks.workunit.client.0.smithi107.stdout:8/29: truncate d5/f6 428358 0 2024-09-21T08:02:38.078 INFO:tasks.workunit.client.0.smithi107.stdout:1/76: mkdir d0/d19 0 2024-09-21T08:02:38.078 INFO:tasks.workunit.client.0.smithi107.stdout:1/77: readlink d0/d7/l13 0 2024-09-21T08:02:38.078 INFO:tasks.workunit.client.0.smithi107.stdout:9/93: symlink d11/l1e 0 2024-09-21T08:02:38.078 INFO:tasks.workunit.client.0.smithi107.stdout:9/94: creat d11/f1f x:0 0 0 2024-09-21T08:02:38.078 INFO:tasks.workunit.client.0.smithi107.stdout:0/142: symlink d1/d23/l30 0 2024-09-21T08:02:38.079 INFO:tasks.workunit.client.0.smithi107.stdout:5/103: rmdir d7 39 2024-09-21T08:02:38.080 INFO:tasks.workunit.client.0.smithi107.stdout:8/30: link f3 d5/fe 0 2024-09-21T08:02:38.083 INFO:tasks.workunit.client.0.smithi107.stdout:5/104: creat d7/f21 x:0 0 0 2024-09-21T08:02:38.083 INFO:tasks.workunit.client.0.smithi107.stdout:5/105: chown d7/f11 2884 1 2024-09-21T08:02:38.085 INFO:tasks.workunit.client.0.smithi107.stdout:8/31: symlink d5/lf 0 2024-09-21T08:02:38.088 INFO:tasks.workunit.client.0.smithi107.stdout:5/106: symlink d7/de/l22 0 2024-09-21T08:02:38.088 INFO:tasks.workunit.client.0.smithi107.stdout:8/32: symlink d5/l10 0 2024-09-21T08:02:38.089 INFO:tasks.workunit.client.0.smithi107.stdout:5/107: rename d7/de/c15 to d7/de/c23 0 2024-09-21T08:02:38.091 INFO:tasks.workunit.client.0.smithi107.stdout:8/33: mknod d5/c11 0 2024-09-21T08:02:38.091 INFO:tasks.workunit.client.0.smithi107.stdout:8/34: fdatasync d5/f6 0 2024-09-21T08:02:38.092 INFO:tasks.workunit.client.1.smithi129.stdout:8/716: read d0/d6/f9f [3672881,64274] 0 2024-09-21T08:02:38.092 INFO:tasks.workunit.client.1.smithi129.stdout:5/942: dwrite d2/d1e/d35/f2b [0,4194304] 0 2024-09-21T08:02:38.092 INFO:tasks.workunit.client.1.smithi129.stdout:5/943: dread - d2/d1e/d35/d33/dca/fe1 zero size 2024-09-21T08:02:38.093 INFO:tasks.workunit.client.1.smithi129.stdout:0/813: dwrite de/d15/faf [0,4194304] 0 2024-09-21T08:02:38.094 INFO:tasks.workunit.client.0.smithi107.stdout:8/35: creat d5/f12 x:0 0 0 2024-09-21T08:02:38.095 INFO:tasks.workunit.client.0.smithi107.stdout:8/36: write d5/f6 [77975,69533] 0 2024-09-21T08:02:38.095 INFO:tasks.workunit.client.0.smithi107.stdout:8/37: chown d5/c11 59787959 1 2024-09-21T08:02:38.095 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:37 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:02:38.096 INFO:tasks.workunit.client.1.smithi129.stdout:8/717: mkdir d0/d6/d7/d9/dd5 0 2024-09-21T08:02:38.096 INFO:tasks.workunit.client.0.smithi107.stdout:1/78: rmdir d0 39 2024-09-21T08:02:38.099 INFO:tasks.workunit.client.1.smithi129.stdout:5/944: symlink d2/d1e/d35/d37/d96/de5/d61/l12e 0 2024-09-21T08:02:38.099 INFO:tasks.workunit.client.1.smithi129.stdout:5/945: readlink d2/d1e/d35/d33/dca/ld0 0 2024-09-21T08:02:38.101 INFO:tasks.workunit.client.0.smithi107.stdout:1/79: creat d0/d7/f1a x:0 0 0 2024-09-21T08:02:38.101 INFO:tasks.workunit.client.0.smithi107.stdout:1/80: write d0/f12 [1488016,14875] 0 2024-09-21T08:02:38.103 INFO:tasks.workunit.client.0.smithi107.stdout:9/95: getdents d11 0 2024-09-21T08:02:38.105 INFO:tasks.workunit.client.0.smithi107.stdout:9/96: write f10 [381078,53088] 0 2024-09-21T08:02:38.106 INFO:tasks.workunit.client.0.smithi107.stdout:4/108: dwrite f6 [0,4194304] 0 2024-09-21T08:02:38.106 INFO:tasks.workunit.client.0.smithi107.stdout:4/109: creat dc/f1b x:0 0 0 2024-09-21T08:02:38.107 INFO:tasks.workunit.client.1.smithi129.stdout:8/718: link d0/d6/d7/d5d/f9e d0/d6/d7/d9/dd5/fd6 0 2024-09-21T08:02:38.109 INFO:tasks.workunit.client.1.smithi129.stdout:5/946: link d2/f45 d2/d1e/d35/d33/d36/de0/f12f 0 2024-09-21T08:02:38.110 INFO:tasks.workunit.client.0.smithi107.stdout:9/97: link d11/f1d d11/f20 0 2024-09-21T08:02:38.110 INFO:tasks.workunit.client.0.smithi107.stdout:9/98: fsync d11/f1b 0 2024-09-21T08:02:38.113 INFO:tasks.workunit.client.0.smithi107.stdout:9/99: creat d11/f21 x:0 0 0 2024-09-21T08:02:38.113 INFO:tasks.workunit.client.0.smithi107.stdout:9/100: chown d11/c14 325907047 1 2024-09-21T08:02:38.113 INFO:tasks.workunit.client.1.smithi129.stdout:5/947: write d2/d1e/d35/f4d [1154213,91302] 0 2024-09-21T08:02:38.114 INFO:tasks.workunit.client.0.smithi107.stdout:9/101: link c2 d11/c22 0 2024-09-21T08:02:38.114 INFO:tasks.workunit.client.1.smithi129.stdout:8/719: read d0/d6/d7/d18/d27/d60/d97/fa2 [400690,88189] 0 2024-09-21T08:02:38.115 INFO:tasks.workunit.client.0.smithi107.stdout:9/102: truncate f7 933885 0 2024-09-21T08:02:38.117 INFO:tasks.workunit.client.1.smithi129.stdout:6/764: dwrite d7/d1b/d1e/d39/d79/ded/ff3 [4194304,4194304] 0 2024-09-21T08:02:38.119 INFO:tasks.workunit.client.0.smithi107.stdout:8/38: getdents d5 0 2024-09-21T08:02:38.119 INFO:tasks.workunit.client.0.smithi107.stdout:8/39: chown d5/lf 3757 1 2024-09-21T08:02:38.133 INFO:tasks.workunit.client.1.smithi129.stdout:9/818: dwrite d17/d46/f8e [0,4194304] 0 2024-09-21T08:02:38.134 INFO:tasks.workunit.client.1.smithi129.stdout:1/915: dwrite d1/d44/d83/fed [0,4194304] 0 2024-09-21T08:02:38.134 INFO:tasks.workunit.client.1.smithi129.stdout:1/916: readlink d1/d4/l2c 0 2024-09-21T08:02:38.137 INFO:tasks.workunit.client.1.smithi129.stdout:0/814: dwrite de/d22/d27/d2f/f3e [0,4194304] 0 2024-09-21T08:02:38.137 INFO:tasks.workunit.client.1.smithi129.stdout:0/815: fdatasync de/d15/f18 0 2024-09-21T08:02:38.137 INFO:tasks.workunit.client.1.smithi129.stdout:0/816: fdatasync de/f13 0 2024-09-21T08:02:38.137 INFO:tasks.workunit.client.1.smithi129.stdout:0/817: dread - de/f64 zero size 2024-09-21T08:02:38.137 INFO:tasks.workunit.client.1.smithi129.stdout:0/818: dread - de/f64 zero size 2024-09-21T08:02:38.137 INFO:tasks.workunit.client.1.smithi129.stdout:9/819: rmdir d17/d60/d7b/dc4 39 2024-09-21T08:02:38.138 INFO:tasks.workunit.client.1.smithi129.stdout:9/820: chown d17/d55/dd1/lef 9 1 2024-09-21T08:02:38.138 INFO:tasks.workunit.client.0.smithi107.stdout:5/108: write d7/de/f18 [4034120,100250] 0 2024-09-21T08:02:38.138 INFO:tasks.workunit.client.0.smithi107.stdout:2/85: dwrite f0 [4194304,4194304] 0 2024-09-21T08:02:38.139 INFO:tasks.workunit.client.1.smithi129.stdout:1/917: creat d1/d4/dad/db6/f12d x:0 0 0 2024-09-21T08:02:38.141 INFO:tasks.workunit.client.0.smithi107.stdout:2/86: link d1/d2/cd d1/d16/c1c 0 2024-09-21T08:02:38.141 INFO:tasks.workunit.client.0.smithi107.stdout:2/87: readlink d1/l4 0 2024-09-21T08:02:38.141 INFO:tasks.workunit.client.0.smithi107.stdout:2/88: write d1/d2/f15 [52537,39722] 0 2024-09-21T08:02:38.142 INFO:tasks.workunit.client.1.smithi129.stdout:9/821: truncate d17/d22/d33/d7a/d89/d90/db1/d31/d35/f54 38847 0 2024-09-21T08:02:38.142 INFO:tasks.workunit.client.1.smithi129.stdout:9/822: chown d17/d22/d33/d7a/d89/d90/db1/d31/l107 172 1 2024-09-21T08:02:38.142 INFO:tasks.workunit.client.0.smithi107.stdout:5/109: mkdir d7/de/d1d/d24 0 2024-09-21T08:02:38.143 INFO:tasks.workunit.client.0.smithi107.stdout:2/89: link d1/c11 d1/d2/c1d 0 2024-09-21T08:02:38.144 INFO:tasks.workunit.client.1.smithi129.stdout:9/823: rmdir d17/d23 39 2024-09-21T08:02:38.145 INFO:tasks.workunit.client.1.smithi129.stdout:9/824: write d17/f80 [677369,65909] 0 2024-09-21T08:02:38.146 INFO:tasks.workunit.client.1.smithi129.stdout:9/825: write d17/d22/d33/d7a/d89/d90/db1/d31/f5a [2077095,125288] 0 2024-09-21T08:02:38.148 INFO:tasks.workunit.client.1.smithi129.stdout:9/826: unlink d17/d22/faf 0 2024-09-21T08:02:38.149 INFO:tasks.workunit.client.0.smithi107.stdout:1/81: dwrite d0/d7/fa [0,4194304] 0 2024-09-21T08:02:38.149 INFO:tasks.workunit.client.0.smithi107.stdout:1/82: write d0/d7/fd [377527,65549] 0 2024-09-21T08:02:38.150 INFO:tasks.workunit.client.0.smithi107.stdout:0/143: dwrite d1/f8 [4194304,4194304] 0 2024-09-21T08:02:38.152 INFO:tasks.workunit.client.1.smithi129.stdout:0/819: dread de/d15/d39/f4a [0,4194304] 0 2024-09-21T08:02:38.152 INFO:tasks.workunit.client.1.smithi129.stdout:0/820: fdatasync de/d22/d27/d2f/f3e 0 2024-09-21T08:02:38.155 INFO:tasks.workunit.client.0.smithi107.stdout:0/144: dread d1/d23/f26 [0,4194304] 0 2024-09-21T08:02:38.155 INFO:tasks.workunit.client.0.smithi107.stdout:1/83: mkdir d0/d7/d1b 0 2024-09-21T08:02:38.155 INFO:tasks.workunit.client.0.smithi107.stdout:0/145: write d1/d23/f26 [816651,10002] 0 2024-09-21T08:02:38.157 INFO:tasks.workunit.client.0.smithi107.stdout:1/84: truncate d0/d7/f9 1684972 0 2024-09-21T08:02:38.159 INFO:tasks.workunit.client.0.smithi107.stdout:0/146: symlink d1/l31 0 2024-09-21T08:02:38.160 INFO:tasks.workunit.client.1.smithi129.stdout:0/821: mknod de/d15/d39/c108 0 2024-09-21T08:02:38.160 INFO:tasks.workunit.client.1.smithi129.stdout:0/822: truncate de/d1f/f34 1208068 0 2024-09-21T08:02:38.160 INFO:tasks.workunit.client.1.smithi129.stdout:0/823: fsync fd 0 2024-09-21T08:02:38.160 INFO:tasks.workunit.client.1.smithi129.stdout:0/824: fdatasync de/d15/d44/d4b/f7a 0 2024-09-21T08:02:38.161 INFO:tasks.workunit.client.0.smithi107.stdout:1/85: mkdir d0/d7/d1c 0 2024-09-21T08:02:38.162 INFO:tasks.workunit.client.0.smithi107.stdout:0/147: rename d1/d15/d20/l22 to d1/d15/d20/l32 0 2024-09-21T08:02:38.162 INFO:tasks.workunit.client.0.smithi107.stdout:0/148: creat d1/d15/f33 x:0 0 0 2024-09-21T08:02:38.162 INFO:tasks.workunit.client.0.smithi107.stdout:0/149: write d1/d15/d20/d29/f2e [724898,66411] 0 2024-09-21T08:02:38.162 INFO:tasks.workunit.client.0.smithi107.stdout:0/150: chown d1/f1c 1336930 1 2024-09-21T08:02:38.162 INFO:tasks.workunit.client.0.smithi107.stdout:0/151: chown d1/d5/f27 218 1 2024-09-21T08:02:38.162 INFO:tasks.workunit.client.0.smithi107.stdout:0/152: write d1/d5/f24 [6406235,45803] 0 2024-09-21T08:02:38.162 INFO:tasks.workunit.client.0.smithi107.stdout:9/103: dwrite d11/f19 [0,4194304] 0 2024-09-21T08:02:38.163 INFO:tasks.workunit.client.0.smithi107.stdout:0/153: getdents d1/d5/d25/d2d 0 2024-09-21T08:02:38.164 INFO:tasks.workunit.client.1.smithi129.stdout:0/825: rmdir de/d15/d51 39 2024-09-21T08:02:38.170 INFO:tasks.workunit.client.1.smithi129.stdout:8/720: dwrite d0/d6/d7/d18/d27/d32/d37/f72 [0,4194304] 0 2024-09-21T08:02:38.174 INFO:tasks.workunit.client.1.smithi129.stdout:8/721: symlink d0/d6/d7/d18/ld7 0 2024-09-21T08:02:38.174 INFO:tasks.workunit.client.1.smithi129.stdout:8/722: creat d0/d6/d7/d18/d61/fd8 x:0 0 0 2024-09-21T08:02:38.180 INFO:tasks.workunit.client.0.smithi107.stdout:1/86: read d0/fc [5112253,126035] 0 2024-09-21T08:02:38.181 INFO:tasks.workunit.client.0.smithi107.stdout:1/87: creat d0/d7/d1b/f1d x:0 0 0 2024-09-21T08:02:38.181 INFO:tasks.workunit.client.0.smithi107.stdout:1/88: chown d0/d7/d1b/f1d 14 1 2024-09-21T08:02:38.186 INFO:tasks.workunit.client.1.smithi129.stdout:6/765: dwrite d7/d10/f14 [0,4194304] 0 2024-09-21T08:02:38.186 INFO:tasks.workunit.client.1.smithi129.stdout:6/766: dread - d7/f9a zero size 2024-09-21T08:02:38.187 INFO:tasks.workunit.client.1.smithi129.stdout:6/767: rename d7/d1b/d1e/d66/dc2/l63 to d7/d1b/d1e/d66/dba/d2b/l103 0 2024-09-21T08:02:38.188 INFO:tasks.workunit.client.1.smithi129.stdout:6/768: chown d7/d1b/d57/lc7 22593 1 2024-09-21T08:02:38.189 INFO:tasks.workunit.client.1.smithi129.stdout:6/769: rename d7/d1b/d1e/d39/d4b/de8/d69/ldf to d7/d1b/d1e/d39/d4b/d6e/de5/l104 0 2024-09-21T08:02:38.193 INFO:tasks.workunit.client.0.smithi107.stdout:8/40: dwrite d5/fa [0,4194304] 0 2024-09-21T08:02:38.193 INFO:tasks.workunit.client.0.smithi107.stdout:8/41: dread d5/fe [0,4194304] 0 2024-09-21T08:02:38.201 INFO:tasks.workunit.client.0.smithi107.stdout:1/89: write d0/fc [2158747,114999] 0 2024-09-21T08:02:38.202 INFO:tasks.workunit.client.1.smithi129.stdout:1/918: dwrite d1/d16/d28/f54 [0,4194304] 0 2024-09-21T08:02:38.202 INFO:tasks.workunit.client.0.smithi107.stdout:2/90: dwrite d1/d2/f5 [0,4194304] 0 2024-09-21T08:02:38.202 INFO:tasks.workunit.client.0.smithi107.stdout:2/91: fsync d1/d2/f9 0 2024-09-21T08:02:38.202 INFO:tasks.workunit.client.0.smithi107.stdout:2/92: fsync d1/d6/f18 0 2024-09-21T08:02:38.202 INFO:tasks.workunit.client.0.smithi107.stdout:5/110: dwrite d7/de/f1b [0,4194304] 0 2024-09-21T08:02:38.204 INFO:tasks.workunit.client.0.smithi107.stdout:0/154: dwrite d1/fe [0,4194304] 0 2024-09-21T08:02:38.204 INFO:tasks.workunit.client.0.smithi107.stdout:0/155: chown d1/l31 84916790 1 2024-09-21T08:02:38.204 INFO:tasks.workunit.client.1.smithi129.stdout:0/826: dwrite de/d22/fb4 [0,4194304] 0 2024-09-21T08:02:38.207 INFO:tasks.workunit.client.1.smithi129.stdout:9/827: dwrite f16 [4194304,4194304] 0 2024-09-21T08:02:38.209 INFO:tasks.workunit.client.0.smithi107.stdout:1/90: write d0/f11 [322638,98278] 0 2024-09-21T08:02:38.213 INFO:tasks.workunit.client.1.smithi129.stdout:1/919: dread d1/d9/f58 [0,4194304] 0 2024-09-21T08:02:38.216 INFO:tasks.workunit.client.1.smithi129.stdout:6/770: dwrite d7/d1b/d8d/f9e [0,4194304] 0 2024-09-21T08:02:38.216 INFO:tasks.workunit.client.1.smithi129.stdout:6/771: readlink d7/d1b/d57/lc7 0 2024-09-21T08:02:38.216 INFO:tasks.workunit.client.1.smithi129.stdout:6/772: write d7/d1b/f49 [4919748,31225] 0 2024-09-21T08:02:38.221 INFO:tasks.workunit.client.0.smithi107.stdout:9/104: rmdir d11 39 2024-09-21T08:02:38.230 INFO:tasks.workunit.client.1.smithi129.stdout:0/827: symlink de/d22/d27/d85/l109 0 2024-09-21T08:02:38.231 INFO:tasks.workunit.client.0.smithi107.stdout:8/42: link f1 d5/f13 0 2024-09-21T08:02:38.231 INFO:tasks.workunit.client.0.smithi107.stdout:8/43: dread - d5/fd zero size 2024-09-21T08:02:38.237 INFO:tasks.workunit.client.0.smithi107.stdout:2/93: mkdir d1/d1e 0 2024-09-21T08:02:38.240 INFO:tasks.workunit.client.0.smithi107.stdout:2/94: dread d1/d2/f15 [0,4194304] 0 2024-09-21T08:02:38.244 INFO:tasks.workunit.client.0.smithi107.stdout:5/111: rename d7/f11 to d7/de/d1d/f25 0 2024-09-21T08:02:38.245 INFO:tasks.workunit.client.1.smithi129.stdout:0/828: rename de/d22/d27/d2f to de/d22/d27/d10a 0 2024-09-21T08:02:38.248 INFO:tasks.workunit.client.0.smithi107.stdout:9/105: rename cf to d11/c23 0 2024-09-21T08:02:38.249 INFO:tasks.workunit.client.0.smithi107.stdout:5/112: mknod d7/de/c26 0 2024-09-21T08:02:38.249 INFO:tasks.workunit.client.0.smithi107.stdout:8/44: dwrite d5/f12 [0,4194304] 0 2024-09-21T08:02:38.250 INFO:tasks.workunit.client.0.smithi107.stdout:5/113: mknod d7/de/c27 0 2024-09-21T08:02:38.250 INFO:tasks.workunit.client.1.smithi129.stdout:6/773: dwrite d7/d1b/d1e/d39/f46 [0,4194304] 0 2024-09-21T08:02:38.252 INFO:tasks.workunit.client.0.smithi107.stdout:5/114: read d7/de/f19 [68840,59606] 0 2024-09-21T08:02:38.252 INFO:tasks.workunit.client.0.smithi107.stdout:8/45: creat d5/f14 x:0 0 0 2024-09-21T08:02:38.256 INFO:tasks.workunit.client.0.smithi107.stdout:8/46: symlink d5/l15 0 2024-09-21T08:02:38.256 INFO:tasks.workunit.client.0.smithi107.stdout:8/47: write d5/fa [4918589,47427] 0 2024-09-21T08:02:38.256 INFO:tasks.workunit.client.0.smithi107.stdout:8/48: write f0 [48564,49404] 0 2024-09-21T08:02:38.260 INFO:tasks.workunit.client.0.smithi107.stdout:9/106: dread d11/f20 [0,4194304] 0 2024-09-21T08:02:38.260 INFO:tasks.workunit.client.0.smithi107.stdout:2/95: dwrite d1/d2/f15 [0,4194304] 0 2024-09-21T08:02:38.260 INFO:tasks.workunit.client.0.smithi107.stdout:2/96: stat d1/d1e 0 2024-09-21T08:02:38.260 INFO:tasks.workunit.client.0.smithi107.stdout:2/97: write d1/d16/f17 [197097,124585] 0 2024-09-21T08:02:38.262 INFO:tasks.workunit.client.0.smithi107.stdout:9/107: mkdir d11/d24 0 2024-09-21T08:02:38.264 INFO:tasks.workunit.client.0.smithi107.stdout:9/108: rename d11/l16 to d11/d24/l25 0 2024-09-21T08:02:38.265 INFO:tasks.workunit.client.1.smithi129.stdout:0/829: write de/d15/d39/d7f/faa [118826,62004] 0 2024-09-21T08:02:38.270 INFO:tasks.workunit.client.1.smithi129.stdout:6/774: dwrite d7/f37 [8388608,4194304] 0 2024-09-21T08:02:38.270 INFO:tasks.workunit.client.1.smithi129.stdout:6/775: read - d7/d1b/d1e/d39/d4b/de8/d69/d89/ffd zero size 2024-09-21T08:02:38.270 INFO:tasks.workunit.client.1.smithi129.stdout:6/776: rename d7/d1b/d1e/d39 to d7/d1b/d1e/d39/d79/d105 22 2024-09-21T08:02:38.271 INFO:tasks.workunit.client.1.smithi129.stdout:6/777: readlink d7/d1b/d1e/d66/dc2/de2/d40/l47 0 2024-09-21T08:02:38.271 INFO:tasks.workunit.client.1.smithi129.stdout:6/778: dread - d7/d1b/d1e/d66/d7c/fd1 zero size 2024-09-21T08:02:38.278 INFO:tasks.workunit.client.0.smithi107.stdout:9/109: getdents d11/d24 0 2024-09-21T08:02:38.279 INFO:tasks.workunit.client.0.smithi107.stdout:9/110: unlink d11/l13 0 2024-09-21T08:02:38.281 INFO:tasks.workunit.client.0.smithi107.stdout:9/111: unlink c9 0 2024-09-21T08:02:38.282 INFO:tasks.workunit.client.0.smithi107.stdout:9/112: mkdir d11/d24/d26 0 2024-09-21T08:02:38.283 INFO:tasks.workunit.client.0.smithi107.stdout:5/115: dwrite d7/de/f1a [0,4194304] 0 2024-09-21T08:02:38.284 INFO:tasks.workunit.client.0.smithi107.stdout:9/113: mkdir d11/d27 0 2024-09-21T08:02:38.285 INFO:tasks.workunit.client.0.smithi107.stdout:9/114: creat d11/d24/d26/f28 x:0 0 0 2024-09-21T08:02:38.288 INFO:tasks.workunit.client.0.smithi107.stdout:9/115: dread d11/f1d [0,4194304] 0 2024-09-21T08:02:38.288 INFO:tasks.workunit.client.0.smithi107.stdout:9/116: chown d11 6 1 2024-09-21T08:02:38.290 INFO:tasks.workunit.client.0.smithi107.stdout:9/117: dread f10 [0,4194304] 0 2024-09-21T08:02:38.291 INFO:tasks.workunit.client.0.smithi107.stdout:5/116: dread d7/de/f18 [0,4194304] 0 2024-09-21T08:02:38.291 INFO:tasks.workunit.client.0.smithi107.stdout:9/118: unlink d11/f1b 0 2024-09-21T08:02:38.291 INFO:tasks.workunit.client.0.smithi107.stdout:9/119: chown d11/l1a 24 1 2024-09-21T08:02:38.291 INFO:tasks.workunit.client.0.smithi107.stdout:5/117: creat d7/de/d1d/f28 x:0 0 0 2024-09-21T08:02:38.292 INFO:tasks.workunit.client.0.smithi107.stdout:9/120: rename f10 to d11/d27/f29 0 2024-09-21T08:02:38.293 INFO:tasks.workunit.client.0.smithi107.stdout:9/121: mkdir d11/d27/d2a 0 2024-09-21T08:02:38.294 INFO:tasks.workunit.client.0.smithi107.stdout:9/122: rename d11/c17 to d11/d24/c2b 0 2024-09-21T08:02:38.295 INFO:tasks.workunit.client.0.smithi107.stdout:9/123: rename d11/f19 to d11/d27/d2a/f2c 0 2024-09-21T08:02:38.295 INFO:tasks.workunit.client.0.smithi107.stdout:9/124: write d11/d24/d26/f28 [64318,56580] 0 2024-09-21T08:02:38.295 INFO:tasks.workunit.client.0.smithi107.stdout:9/125: dread - d11/f18 zero size 2024-09-21T08:02:38.295 INFO:tasks.workunit.client.0.smithi107.stdout:9/126: read d11/d24/d26/f28 [71623,126004] 0 2024-09-21T08:02:38.303 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:37 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:02:38.308 INFO:tasks.workunit.client.0.smithi107.stdout:9/127: dwrite d11/f1f [0,4194304] 0 2024-09-21T08:02:38.311 INFO:tasks.workunit.client.0.smithi107.stdout:9/128: rename d11/f1d to d11/d27/d2a/f2d 0 2024-09-21T08:02:38.319 INFO:tasks.workunit.client.0.smithi107.stdout:0/156: dwrite d1/d5/f27 [0,4194304] 0 2024-09-21T08:02:38.319 INFO:tasks.workunit.client.0.smithi107.stdout:0/157: getdents d1/d5/d25/d2d 0 2024-09-21T08:02:38.319 INFO:tasks.workunit.client.0.smithi107.stdout:0/158: fdatasync d1/d15/d20/d29/f2e 0 2024-09-21T08:02:38.320 INFO:tasks.workunit.client.0.smithi107.stdout:0/159: symlink d1/d15/d20/d29/l34 0 2024-09-21T08:02:38.322 INFO:tasks.workunit.client.0.smithi107.stdout:0/160: symlink d1/d5/l35 0 2024-09-21T08:02:38.322 INFO:tasks.workunit.client.0.smithi107.stdout:0/161: rmdir d1/d5/d25/d2d 39 2024-09-21T08:02:38.323 INFO:tasks.workunit.client.0.smithi107.stdout:0/162: mknod d1/c36 0 2024-09-21T08:02:38.323 INFO:tasks.workunit.client.0.smithi107.stdout:0/163: chown d1/d15/d20/d29/f2e 0 1 2024-09-21T08:02:38.323 INFO:tasks.workunit.client.0.smithi107.stdout:0/164: symlink d1/d5/d25/d2d/l37 0 2024-09-21T08:02:38.324 INFO:tasks.workunit.client.0.smithi107.stdout:0/165: chown d1/f1c 37025 1 2024-09-21T08:02:38.324 INFO:tasks.workunit.client.0.smithi107.stdout:0/166: chown d1/d5/d25/c18 27004025 1 2024-09-21T08:02:38.337 INFO:tasks.workunit.client.1.smithi129.stdout:1/920: dwrite d1/d16/d57/f88 [0,4194304] 0 2024-09-21T08:02:38.338 INFO:tasks.workunit.client.0.smithi107.stdout:9/129: dwrite d11/d27/d2a/f2c [0,4194304] 0 2024-09-21T08:02:38.338 INFO:tasks.workunit.client.1.smithi129.stdout:1/921: chown d1/d4/dc2/dc6/d7f/d112/c114 4 1 2024-09-21T08:02:38.339 INFO:tasks.workunit.client.1.smithi129.stdout:6/779: dwrite d7/d1b/d1e/d39/d4b/fc5 [0,4194304] 0 2024-09-21T08:02:38.339 INFO:tasks.workunit.client.0.smithi107.stdout:1/91: dwrite d0/d7/f9 [0,4194304] 0 2024-09-21T08:02:38.339 INFO:tasks.workunit.client.0.smithi107.stdout:5/118: dread d7/de/f1b [0,4194304] 0 2024-09-21T08:02:38.339 INFO:tasks.workunit.client.1.smithi129.stdout:6/780: readlink d7/d1b/d57/dd6/lf1 0 2024-09-21T08:02:38.342 INFO:tasks.workunit.client.0.smithi107.stdout:1/92: symlink d0/d7/l1e 0 2024-09-21T08:02:38.343 INFO:tasks.workunit.client.0.smithi107.stdout:1/93: chown d0/d7/d1b 1008700357 1 2024-09-21T08:02:38.343 INFO:tasks.workunit.client.0.smithi107.stdout:1/94: write d0/fc [7143974,58312] 0 2024-09-21T08:02:38.343 INFO:tasks.workunit.client.0.smithi107.stdout:1/95: truncate d0/d7/d1b/f1d 101601 0 2024-09-21T08:02:38.348 INFO:tasks.workunit.client.0.smithi107.stdout:9/130: write d11/f1f [2695111,921] 0 2024-09-21T08:02:38.348 INFO:tasks.workunit.client.0.smithi107.stdout:9/131: fdatasync f7 0 2024-09-21T08:02:38.348 INFO:tasks.workunit.client.0.smithi107.stdout:9/132: creat d11/d24/d26/f2e x:0 0 0 2024-09-21T08:02:38.348 INFO:tasks.workunit.client.0.smithi107.stdout:9/133: read - d11/d24/d26/f2e zero size 2024-09-21T08:02:38.354 INFO:tasks.workunit.client.0.smithi107.stdout:9/134: mkdir d11/d27/d2f 0 2024-09-21T08:02:38.355 INFO:tasks.workunit.client.0.smithi107.stdout:5/119: dread d7/de/d1d/f25 [0,4194304] 0 2024-09-21T08:02:38.357 INFO:tasks.workunit.client.0.smithi107.stdout:9/135: rename c2 to d11/d24/c30 0 2024-09-21T08:02:38.357 INFO:tasks.workunit.client.1.smithi129.stdout:6/781: dread d7/fc8 [0,4194304] 0 2024-09-21T08:02:38.359 INFO:tasks.workunit.client.0.smithi107.stdout:5/120: unlink d7/de/c1e 0 2024-09-21T08:02:38.359 INFO:tasks.workunit.client.0.smithi107.stdout:9/136: mknod d11/d27/d2a/c31 0 2024-09-21T08:02:38.360 INFO:tasks.workunit.client.1.smithi129.stdout:6/782: chown d7/c33 131430 1 2024-09-21T08:02:38.361 INFO:tasks.workunit.client.0.smithi107.stdout:5/121: mkdir d7/de/d1d/d29 0 2024-09-21T08:02:38.363 INFO:tasks.workunit.client.0.smithi107.stdout:5/122: unlink d7/de/f18 0 2024-09-21T08:02:38.363 INFO:tasks.workunit.client.0.smithi107.stdout:5/123: creat d7/f2a x:0 0 0 2024-09-21T08:02:38.364 INFO:tasks.workunit.client.0.smithi107.stdout:1/96: dread d0/f2 [0,4194304] 0 2024-09-21T08:02:38.365 INFO:tasks.workunit.client.0.smithi107.stdout:9/137: dread d11/d27/d2a/f2d [0,4194304] 0 2024-09-21T08:02:38.367 INFO:tasks.workunit.client.0.smithi107.stdout:1/97: symlink d0/d7/l1f 0 2024-09-21T08:02:38.367 INFO:tasks.workunit.client.0.smithi107.stdout:1/98: write d0/f2 [689755,43973] 0 2024-09-21T08:02:38.370 INFO:tasks.workunit.client.0.smithi107.stdout:0/167: dwrite d1/d5/f1e [0,4194304] 0 2024-09-21T08:02:38.370 INFO:tasks.workunit.client.0.smithi107.stdout:0/168: readlink d1/l31 0 2024-09-21T08:02:38.371 INFO:tasks.workunit.client.1.smithi129.stdout:1/922: dwrite d1/f39 [0,4194304] 0 2024-09-21T08:02:38.371 INFO:tasks.workunit.client.1.smithi129.stdout:1/923: write d1/d4/dc2/dc6/f66 [848303,28454] 0 2024-09-21T08:02:38.372 INFO:tasks.workunit.client.0.smithi107.stdout:9/138: fsync d11/f1f 0 2024-09-21T08:02:38.372 INFO:tasks.workunit.client.0.smithi107.stdout:9/139: rename d11 to d11/d27/d2f/d32 22 2024-09-21T08:02:38.372 INFO:tasks.workunit.client.0.smithi107.stdout:1/99: fsync d0/fc 0 2024-09-21T08:02:38.372 INFO:tasks.workunit.client.0.smithi107.stdout:1/100: stat d0/d7/f9 0 2024-09-21T08:02:38.372 INFO:tasks.workunit.client.0.smithi107.stdout:1/101: chown d0/l15 9031244 1 2024-09-21T08:02:38.372 INFO:tasks.workunit.client.0.smithi107.stdout:8/49: dwrite d5/f13 [4194304,4194304] 0 2024-09-21T08:02:38.378 INFO:tasks.workunit.client.1.smithi129.stdout:1/924: rename d1/d4/dad/db6/df7/f12b to d1/d4/dad/db6/df7/dff/f12e 0 2024-09-21T08:02:38.378 INFO:tasks.workunit.client.1.smithi129.stdout:1/925: fsync d1/d4/fa 0 2024-09-21T08:02:38.381 INFO:tasks.workunit.client.1.smithi129.stdout:1/926: mkdir d1/d9/d6b/ddd/d12f 0 2024-09-21T08:02:38.381 INFO:tasks.workunit.client.1.smithi129.stdout:1/927: readlink d1/d4/d96/lf4 0 2024-09-21T08:02:38.381 INFO:tasks.workunit.client.1.smithi129.stdout:6/783: dwrite d7/d1b/d1e/d39/d4b/de8/d69/faf [0,4194304] 0 2024-09-21T08:02:38.384 INFO:tasks.workunit.client.0.smithi107.stdout:8/50: mknod d5/c16 0 2024-09-21T08:02:38.385 INFO:tasks.workunit.client.1.smithi129.stdout:6/784: symlink d7/d1b/d1e/d39/d4b/d6e/de5/l106 0 2024-09-21T08:02:38.386 INFO:tasks.workunit.client.1.smithi129.stdout:1/928: dread d1/d16/d57/f86 [0,4194304] 0 2024-09-21T08:02:38.386 INFO:tasks.workunit.client.1.smithi129.stdout:1/929: fsync d1/df1/ffc 0 2024-09-21T08:02:38.388 INFO:tasks.workunit.client.1.smithi129.stdout:6/785: creat d7/d1b/d1e/d39/f107 x:0 0 0 2024-09-21T08:02:38.389 INFO:tasks.workunit.client.0.smithi107.stdout:8/51: rename d5/cb to d5/c17 0 2024-09-21T08:02:38.389 INFO:tasks.workunit.client.0.smithi107.stdout:8/52: truncate d5/f14 452664 0 2024-09-21T08:02:38.390 INFO:tasks.workunit.client.0.smithi107.stdout:0/169: dwrite d1/d23/f2a [0,4194304] 0 2024-09-21T08:02:38.390 INFO:tasks.workunit.client.0.smithi107.stdout:9/140: dread f7 [0,4194304] 0 2024-09-21T08:02:38.390 INFO:tasks.workunit.client.1.smithi129.stdout:1/930: symlink d1/d16/db3/l130 0 2024-09-21T08:02:38.391 INFO:tasks.workunit.client.0.smithi107.stdout:8/53: dread d5/fe [0,4194304] 0 2024-09-21T08:02:38.391 INFO:tasks.workunit.client.0.smithi107.stdout:8/54: fsync d5/f14 0 2024-09-21T08:02:38.391 INFO:tasks.workunit.client.0.smithi107.stdout:8/55: creat d5/f18 x:0 0 0 2024-09-21T08:02:38.391 INFO:tasks.workunit.client.0.smithi107.stdout:5/124: rmdir d7/de 39 2024-09-21T08:02:38.392 INFO:tasks.workunit.client.0.smithi107.stdout:8/56: dread f3 [0,4194304] 0 2024-09-21T08:02:38.392 INFO:tasks.workunit.client.0.smithi107.stdout:8/57: chown d5/fa 1172114 1 2024-09-21T08:02:38.392 INFO:tasks.workunit.client.0.smithi107.stdout:8/58: creat d5/f19 x:0 0 0 2024-09-21T08:02:38.392 INFO:tasks.workunit.client.0.smithi107.stdout:1/102: rename d0/d7/d1b to d0/d7/d1c/d20 0 2024-09-21T08:02:38.393 INFO:tasks.workunit.client.1.smithi129.stdout:6/786: symlink d7/d1b/d1e/d66/dc2/de2/d40/d78/l108 0 2024-09-21T08:02:38.393 INFO:tasks.workunit.client.1.smithi129.stdout:6/787: chown d7/fe 348557 1 2024-09-21T08:02:38.394 INFO:tasks.workunit.client.1.smithi129.stdout:6/788: stat d7/d1b/d1e/d39/d4b/f1d 0 2024-09-21T08:02:38.394 INFO:tasks.workunit.client.1.smithi129.stdout:6/789: chown d7/d1b/d1e/d66/dc2/de2/d40/l47 129 1 2024-09-21T08:02:38.394 INFO:tasks.workunit.client.0.smithi107.stdout:0/170: mknod d1/d5/c38 0 2024-09-21T08:02:38.394 INFO:tasks.workunit.client.0.smithi107.stdout:0/171: chown d1/d15/d20/d29/f2e 2 1 2024-09-21T08:02:38.394 INFO:tasks.workunit.client.0.smithi107.stdout:0/172: fsync d1/fe 0 2024-09-21T08:02:38.395 INFO:tasks.workunit.client.1.smithi129.stdout:1/931: rmdir d1/d44/d83 39 2024-09-21T08:02:38.395 INFO:tasks.workunit.client.0.smithi107.stdout:9/141: creat d11/d27/d2a/f33 x:0 0 0 2024-09-21T08:02:38.395 INFO:tasks.workunit.client.0.smithi107.stdout:9/142: chown d11/d27/d2a/f2d 55 1 2024-09-21T08:02:38.396 INFO:tasks.workunit.client.1.smithi129.stdout:6/790: unlink d7/d1b/d1e/d66/dba/fbb 0 2024-09-21T08:02:38.399 INFO:tasks.workunit.client.1.smithi129.stdout:1/932: mkdir d1/d9/d6b/ddd/d12f/d131 0 2024-09-21T08:02:38.400 INFO:tasks.workunit.client.0.smithi107.stdout:8/59: dread f4 [4194304,4194304] 0 2024-09-21T08:02:38.400 INFO:tasks.workunit.client.0.smithi107.stdout:8/60: readlink d5/l15 0 2024-09-21T08:02:38.401 INFO:tasks.workunit.client.1.smithi129.stdout:3/962: sync 2024-09-21T08:02:38.403 INFO:tasks.workunit.client.1.smithi129.stdout:1/933: creat d1/d44/d83/f132 x:0 0 0 2024-09-21T08:02:38.403 INFO:tasks.workunit.client.0.smithi107.stdout:0/173: dread d1/d5/d25/d2d/f2f [0,4194304] 0 2024-09-21T08:02:38.403 INFO:tasks.workunit.client.0.smithi107.stdout:0/174: write d1/d15/d20/d29/f2e [889359,13711] 0 2024-09-21T08:02:38.403 INFO:tasks.workunit.client.0.smithi107.stdout:0/175: truncate d1/fe 4509309 0 2024-09-21T08:02:38.403 INFO:tasks.workunit.client.1.smithi129.stdout:6/791: write d7/d1b/d1e/d66/dc2/de2/d40/d41/f70 [755210,67759] 0 2024-09-21T08:02:38.403 INFO:tasks.workunit.client.1.smithi129.stdout:6/792: chown d7/d1b/f49 135589683 1 2024-09-21T08:02:38.405 INFO:tasks.workunit.client.1.smithi129.stdout:3/963: creat d3/da/dc/d7f/d14c/f14d x:0 0 0 2024-09-21T08:02:38.405 INFO:tasks.workunit.client.1.smithi129.stdout:3/964: readlink d3/da/dc/da3/lc6 0 2024-09-21T08:02:38.407 INFO:tasks.workunit.client.0.smithi107.stdout:1/103: link d0/d7/l1e d0/d19/l21 0 2024-09-21T08:02:38.408 INFO:tasks.workunit.client.1.smithi129.stdout:6/793: link d7/d1b/d1e/d39/d4b/de8/la6 d7/d1b/d1e/d66/dba/d2b/l109 0 2024-09-21T08:02:38.409 INFO:tasks.workunit.client.0.smithi107.stdout:9/143: mkdir d11/d27/d2a/d34 0 2024-09-21T08:02:38.409 INFO:tasks.workunit.client.0.smithi107.stdout:9/144: dread - d11/d24/d26/f2e zero size 2024-09-21T08:02:38.411 INFO:tasks.workunit.client.1.smithi129.stdout:3/965: getdents d3/da/dc/d7f/dd6/de2/d120 0 2024-09-21T08:02:38.411 INFO:tasks.workunit.client.1.smithi129.stdout:3/966: chown d3/d69/lcb 146875074 1 2024-09-21T08:02:38.411 INFO:tasks.workunit.client.1.smithi129.stdout:3/967: read - d3/da/dc/d7f/dd6/de2/df2/f144 zero size 2024-09-21T08:02:38.412 INFO:tasks.workunit.client.1.smithi129.stdout:3/968: truncate d3/faa 897355 0 2024-09-21T08:02:38.413 INFO:tasks.workunit.client.0.smithi107.stdout:8/61: rename d5/l15 to d5/l1a 0 2024-09-21T08:02:38.415 INFO:tasks.workunit.client.1.smithi129.stdout:1/934: link d1/d9/d31/fb7 d1/d4/dc2/dc6/f133 0 2024-09-21T08:02:38.417 INFO:tasks.workunit.client.1.smithi129.stdout:6/794: rename d7/d1b/d1e/f36 to d7/d1b/d1e/d39/d4b/de8/f10a 0 2024-09-21T08:02:38.418 INFO:tasks.workunit.client.0.smithi107.stdout:0/176: mknod d1/d15/d20/c39 0 2024-09-21T08:02:38.419 INFO:tasks.workunit.client.0.smithi107.stdout:0/177: creat d1/d23/f3a x:0 0 0 2024-09-21T08:02:38.419 INFO:tasks.workunit.client.0.smithi107.stdout:0/178: fsync d1/f12 0 2024-09-21T08:02:38.419 INFO:tasks.workunit.client.0.smithi107.stdout:0/179: creat d1/f3b x:0 0 0 2024-09-21T08:02:38.419 INFO:tasks.workunit.client.0.smithi107.stdout:0/180: stat d1/d5/d25/d2d 0 2024-09-21T08:02:38.420 INFO:tasks.workunit.client.1.smithi129.stdout:3/969: creat d3/da/f14e x:0 0 0 2024-09-21T08:02:38.422 INFO:tasks.workunit.client.0.smithi107.stdout:5/125: rename d7/de/c23 to d7/de/d1d/d29/c2b 0 2024-09-21T08:02:38.425 INFO:tasks.workunit.client.1.smithi129.stdout:1/935: symlink d1/d44/d83/dc5/l134 0 2024-09-21T08:02:38.427 INFO:tasks.workunit.client.1.smithi129.stdout:6/795: link d7/d1b/d1e/d66/dc2/d5e/ce4 d7/d1b/d1e/d39/d4b/de8/dc4/c10b 0 2024-09-21T08:02:38.427 INFO:tasks.workunit.client.0.smithi107.stdout:9/145: mkdir d11/d24/d35 0 2024-09-21T08:02:38.427 INFO:tasks.workunit.client.0.smithi107.stdout:9/146: write d11/f1f [279158,59174] 0 2024-09-21T08:02:38.427 INFO:tasks.workunit.client.0.smithi107.stdout:9/147: write d11/d27/d2a/f33 [22162,21023] 0 2024-09-21T08:02:38.428 INFO:tasks.workunit.client.0.smithi107.stdout:7/106: sync 2024-09-21T08:02:38.428 INFO:tasks.workunit.client.0.smithi107.stdout:7/107: write d7/fd [4641795,70381] 0 2024-09-21T08:02:38.429 INFO:tasks.workunit.client.1.smithi129.stdout:1/936: creat d1/d16/d25/f135 x:0 0 0 2024-09-21T08:02:38.433 INFO:tasks.workunit.client.1.smithi129.stdout:6/796: mkdir d7/d1b/d57/d96/d10c 0 2024-09-21T08:02:38.435 INFO:tasks.workunit.client.1.smithi129.stdout:1/937: mkdir d1/d4/d136 0 2024-09-21T08:02:38.437 INFO:tasks.workunit.client.0.smithi107.stdout:1/104: dwrite d0/d7/f9 [0,4194304] 0 2024-09-21T08:02:38.437 INFO:tasks.workunit.client.0.smithi107.stdout:8/62: rename f4 to d5/f1b 0 2024-09-21T08:02:38.438 INFO:tasks.workunit.client.0.smithi107.stdout:5/126: truncate d7/de/f1b 4979535 0 2024-09-21T08:02:38.438 INFO:tasks.workunit.client.0.smithi107.stdout:5/127: read d7/f1f [4270517,124210] 0 2024-09-21T08:02:38.439 INFO:tasks.workunit.client.0.smithi107.stdout:9/148: write d11/d27/d2a/f2c [1918823,6117] 0 2024-09-21T08:02:38.439 INFO:tasks.workunit.client.0.smithi107.stdout:0/181: dwrite d1/d15/f33 [0,4194304] 0 2024-09-21T08:02:38.439 INFO:tasks.workunit.client.1.smithi129.stdout:1/938: creat d1/d4/dc2/dc6/d7f/d112/f137 x:0 0 0 2024-09-21T08:02:38.440 INFO:tasks.workunit.client.0.smithi107.stdout:7/108: rmdir d7/d18 39 2024-09-21T08:02:38.441 INFO:tasks.workunit.client.0.smithi107.stdout:1/105: mkdir d0/d7/d1c/d22 0 2024-09-21T08:02:38.442 INFO:tasks.workunit.client.0.smithi107.stdout:8/63: truncate d5/f1b 5594117 0 2024-09-21T08:02:38.442 INFO:tasks.workunit.client.0.smithi107.stdout:8/64: readlink d5/l1a 0 2024-09-21T08:02:38.445 INFO:tasks.workunit.client.1.smithi129.stdout:3/970: dwrite d3/d69/d95/f91 [0,4194304] 0 2024-09-21T08:02:38.445 INFO:tasks.workunit.client.1.smithi129.stdout:3/971: chown d3/da/dc/d11/c37 21198 1 2024-09-21T08:02:38.446 INFO:tasks.workunit.client.0.smithi107.stdout:9/149: rename d11/d24/l25 to d11/d27/d2a/d34/l36 0 2024-09-21T08:02:38.448 INFO:tasks.workunit.client.0.smithi107.stdout:1/106: unlink d0/fc 0 2024-09-21T08:02:38.449 INFO:tasks.workunit.client.0.smithi107.stdout:8/65: symlink d5/l1c 0 2024-09-21T08:02:38.449 INFO:tasks.workunit.client.0.smithi107.stdout:8/66: readlink d5/l1c 0 2024-09-21T08:02:38.451 INFO:tasks.workunit.client.1.smithi129.stdout:1/939: read d1/f39 [3970876,113271] 0 2024-09-21T08:02:38.451 INFO:tasks.workunit.client.1.smithi129.stdout:1/940: read - d1/d9/d31/f10b zero size 2024-09-21T08:02:38.451 INFO:tasks.workunit.client.0.smithi107.stdout:0/182: rename d1/d15/d20/c39 to d1/c3c 0 2024-09-21T08:02:38.453 INFO:tasks.workunit.client.1.smithi129.stdout:6/797: dwrite d7/f53 [0,4194304] 0 2024-09-21T08:02:38.453 INFO:tasks.workunit.client.1.smithi129.stdout:6/798: truncate d7/d1b/d1e/d66/dc2/d93/fae 868008 0 2024-09-21T08:02:38.453 INFO:tasks.workunit.client.1.smithi129.stdout:6/799: getdents d7/d1b/d1e/d39/d4b/de8/d69/dfa 0 2024-09-21T08:02:38.453 INFO:tasks.workunit.client.0.smithi107.stdout:9/150: rename d11/f1f to d11/f37 0 2024-09-21T08:02:38.453 INFO:tasks.workunit.client.0.smithi107.stdout:9/151: fsync d11/d24/d26/f2e 0 2024-09-21T08:02:38.453 INFO:tasks.workunit.client.0.smithi107.stdout:9/152: chown d11 583 1 2024-09-21T08:02:38.454 INFO:tasks.workunit.client.1.smithi129.stdout:6/800: dread d7/d10/f19 [4194304,4194304] 0 2024-09-21T08:02:38.454 INFO:tasks.workunit.client.1.smithi129.stdout:6/801: stat d7/d1b/d1e/d39/d79/db8/l6a 0 2024-09-21T08:02:38.454 INFO:tasks.workunit.client.1.smithi129.stdout:6/802: write d7/d1b/d1e/d39/d79/f85 [900632,62638] 0 2024-09-21T08:02:38.455 INFO:tasks.workunit.client.0.smithi107.stdout:7/109: symlink d7/d10/l27 0 2024-09-21T08:02:38.457 INFO:tasks.workunit.client.0.smithi107.stdout:1/107: symlink d0/d7/d1c/d22/l23 0 2024-09-21T08:02:38.457 INFO:tasks.workunit.client.0.smithi107.stdout:1/108: fsync d0/d7/f9 0 2024-09-21T08:02:38.457 INFO:tasks.workunit.client.1.smithi129.stdout:3/972: write d3/d69/d95/f86 [3241656,34703] 0 2024-09-21T08:02:38.457 INFO:tasks.workunit.client.1.smithi129.stdout:3/973: readlink d3/da/dc/d11/l7e 0 2024-09-21T08:02:38.457 INFO:tasks.workunit.client.1.smithi129.stdout:6/803: write d7/d1b/d1e/d66/d7c/f97 [130902,66053] 0 2024-09-21T08:02:38.459 INFO:tasks.workunit.client.0.smithi107.stdout:8/67: unlink d5/f18 0 2024-09-21T08:02:38.461 INFO:tasks.workunit.client.0.smithi107.stdout:1/109: dread d0/f11 [0,4194304] 0 2024-09-21T08:02:38.462 INFO:tasks.workunit.client.0.smithi107.stdout:9/153: mkdir d11/d27/d2f/d38 0 2024-09-21T08:02:38.465 INFO:tasks.workunit.client.1.smithi129.stdout:1/941: link d1/d9/le6 d1/d9/d6b/l138 0 2024-09-21T08:02:38.465 INFO:tasks.workunit.client.1.smithi129.stdout:1/942: dread - d1/d9/d31/f10b zero size 2024-09-21T08:02:38.466 INFO:tasks.workunit.client.0.smithi107.stdout:8/68: mkdir d5/d1d 0 2024-09-21T08:02:38.468 INFO:tasks.workunit.client.0.smithi107.stdout:5/128: rename c6 to d7/de/d1d/d24/c2c 0 2024-09-21T08:02:38.470 INFO:tasks.workunit.client.1.smithi129.stdout:5/948: sync 2024-09-21T08:02:38.470 INFO:tasks.workunit.client.1.smithi129.stdout:4/768: sync 2024-09-21T08:02:38.470 INFO:tasks.workunit.client.1.smithi129.stdout:0/830: sync 2024-09-21T08:02:38.470 INFO:tasks.workunit.client.1.smithi129.stdout:9/828: sync 2024-09-21T08:02:38.470 INFO:tasks.workunit.client.1.smithi129.stdout:8/723: sync 2024-09-21T08:02:38.470 INFO:tasks.workunit.client.1.smithi129.stdout:0/831: readlink de/d22/l74 0 2024-09-21T08:02:38.472 INFO:tasks.workunit.client.1.smithi129.stdout:4/769: dread d5/d16/d24/d3b/f46 [0,4194304] 0 2024-09-21T08:02:38.473 INFO:tasks.workunit.client.1.smithi129.stdout:4/770: stat d5/d6/f7f 0 2024-09-21T08:02:38.473 INFO:tasks.workunit.client.1.smithi129.stdout:3/974: stat d3/l17 0 2024-09-21T08:02:38.473 INFO:tasks.workunit.client.1.smithi129.stdout:3/975: chown d3/da/dc/d11/d2f/fb1 1106 1 2024-09-21T08:02:38.473 INFO:tasks.workunit.client.1.smithi129.stdout:3/976: dread - d3/d69/d95/d52/f147 zero size 2024-09-21T08:02:38.474 INFO:tasks.workunit.client.1.smithi129.stdout:4/771: dread d5/d16/d24/d4f/da1/f59 [0,4194304] 0 2024-09-21T08:02:38.476 INFO:tasks.workunit.client.1.smithi129.stdout:6/804: creat d7/d1b/f10d x:0 0 0 2024-09-21T08:02:38.478 INFO:tasks.workunit.client.1.smithi129.stdout:1/943: symlink d1/d9/d31/l139 0 2024-09-21T08:02:38.480 INFO:tasks.workunit.client.1.smithi129.stdout:9/829: creat d17/d46/dd4/f10d x:0 0 0 2024-09-21T08:02:38.480 INFO:tasks.workunit.client.1.smithi129.stdout:0/832: dread de/d19/f82 [0,4194304] 0 2024-09-21T08:02:38.480 INFO:tasks.workunit.client.1.smithi129.stdout:5/949: dread d2/d2a/fb0 [0,4194304] 0 2024-09-21T08:02:38.481 INFO:tasks.workunit.client.1.smithi129.stdout:9/830: write d17/d22/d33/d36/d48/d3f/d53/fa3 [1452024,102697] 0 2024-09-21T08:02:38.481 INFO:tasks.workunit.client.1.smithi129.stdout:8/724: creat d0/d6/d7/d3a/fd9 x:0 0 0 2024-09-21T08:02:38.483 INFO:tasks.workunit.client.1.smithi129.stdout:3/977: symlink d3/da/dc/d7f/dd6/de2/d120/d80/l14f 0 2024-09-21T08:02:38.484 INFO:tasks.workunit.client.1.smithi129.stdout:4/772: truncate f2 1185843 0 2024-09-21T08:02:38.486 INFO:tasks.workunit.client.1.smithi129.stdout:6/805: creat d7/d1b/d1e/d66/dc2/de2/d40/f10e x:0 0 0 2024-09-21T08:02:38.486 INFO:tasks.workunit.client.1.smithi129.stdout:6/806: write d7/f9 [1361384,17203] 0 2024-09-21T08:02:38.486 INFO:tasks.workunit.client.1.smithi129.stdout:6/807: creat d7/d1b/d1e/d66/dc2/d93/f10f x:0 0 0 2024-09-21T08:02:38.486 INFO:tasks.workunit.client.1.smithi129.stdout:6/808: chown d7/d1b/d1e/d66/dba/d2b/f3c 8 1 2024-09-21T08:02:38.486 INFO:tasks.workunit.client.1.smithi129.stdout:6/809: write d7/d1b/d1e/d66/dc2/d93/dd5/de6/ffb [208101,94017] 0 2024-09-21T08:02:38.486 INFO:tasks.workunit.client.1.smithi129.stdout:6/810: fsync d7/d1b/d1e/d66/dc2/d93/fd9 0 2024-09-21T08:02:38.487 INFO:tasks.workunit.client.0.smithi107.stdout:1/110: mknod d0/d7/d1c/d22/c24 0 2024-09-21T08:02:38.487 INFO:tasks.workunit.client.1.smithi129.stdout:0/833: dread de/d15/d39/d9e/dac/dba/dc0/fcb [0,4194304] 0 2024-09-21T08:02:38.487 INFO:tasks.workunit.client.1.smithi129.stdout:5/950: unlink d2/d1e/d35/d33/d36/d5a/d77/d81/f94 0 2024-09-21T08:02:38.488 INFO:tasks.workunit.client.0.smithi107.stdout:9/154: mkdir d11/d27/d39 0 2024-09-21T08:02:38.490 INFO:tasks.workunit.client.1.smithi129.stdout:1/944: write d1/d9/f45 [2152480,123802] 0 2024-09-21T08:02:38.490 INFO:tasks.workunit.client.1.smithi129.stdout:3/978: dread d3/da/dc/d25/fbe [0,4194304] 0 2024-09-21T08:02:38.490 INFO:tasks.workunit.client.1.smithi129.stdout:3/979: fdatasync d3/da/dc/d7f/dd6/de2/df2/f11c 0 2024-09-21T08:02:38.490 INFO:tasks.workunit.client.1.smithi129.stdout:1/945: write d1/d44/db9/fc9 [896412,26180] 0 2024-09-21T08:02:38.490 INFO:tasks.workunit.client.0.smithi107.stdout:7/110: mkdir d7/d10/d28 0 2024-09-21T08:02:38.491 INFO:tasks.workunit.client.1.smithi129.stdout:6/811: dread d7/d10/fa8 [0,4194304] 0 2024-09-21T08:02:38.491 INFO:tasks.workunit.client.1.smithi129.stdout:9/831: link d17/d22/d33/d7a/d89/d90/db1/d31/d5e/fa9 d17/d46/d9c/f10e 0 2024-09-21T08:02:38.491 INFO:tasks.workunit.client.1.smithi129.stdout:9/832: creat d17/d46/f10f x:0 0 0 2024-09-21T08:02:38.491 INFO:tasks.workunit.client.1.smithi129.stdout:9/833: chown d17/d22/d33/d36/d48/d3f/d53/fec 2 1 2024-09-21T08:02:38.491 INFO:tasks.workunit.client.1.smithi129.stdout:6/812: write d7/d1b/d1e/d66/dc2/de2/d40/d41/f5d [4551817,118435] 0 2024-09-21T08:02:38.492 INFO:tasks.workunit.client.0.smithi107.stdout:5/129: dwrite d7/de/f1b [0,4194304] 0 2024-09-21T08:02:38.492 INFO:tasks.workunit.client.1.smithi129.stdout:4/773: rmdir d5/d16/d47/d5f 39 2024-09-21T08:02:38.492 INFO:tasks.workunit.client.1.smithi129.stdout:4/774: fdatasync d5/d33/d4e/da7/fd0 0 2024-09-21T08:02:38.493 INFO:tasks.workunit.client.0.smithi107.stdout:8/69: link f3 d5/d1d/f1e 0 2024-09-21T08:02:38.494 INFO:tasks.workunit.client.1.smithi129.stdout:9/834: fdatasync d17/d22/d33/d36/d48/d3f/d53/fa3 0 2024-09-21T08:02:38.495 INFO:tasks.workunit.client.1.smithi129.stdout:1/946: dread d1/d4/f17 [0,4194304] 0 2024-09-21T08:02:38.495 INFO:tasks.workunit.client.1.smithi129.stdout:1/947: chown d1/d44/d83/dcb/cf3 44641 1 2024-09-21T08:02:38.495 INFO:tasks.workunit.client.1.smithi129.stdout:1/948: fdatasync d1/d16/db3/f116 0 2024-09-21T08:02:38.496 INFO:tasks.workunit.client.1.smithi129.stdout:8/725: dread d0/d6/d7/f7e [0,4194304] 0 2024-09-21T08:02:38.499 INFO:tasks.workunit.client.1.smithi129.stdout:5/951: unlink d2/d1e/d6b/dd1/c112 0 2024-09-21T08:02:38.500 INFO:tasks.workunit.client.0.smithi107.stdout:1/111: mknod d0/d19/c25 0 2024-09-21T08:02:38.502 INFO:tasks.workunit.client.0.smithi107.stdout:9/155: rmdir d11/d27/d2a/d34 39 2024-09-21T08:02:38.504 INFO:tasks.workunit.client.0.smithi107.stdout:7/111: creat d7/d18/f29 x:0 0 0 2024-09-21T08:02:38.505 INFO:tasks.workunit.client.1.smithi129.stdout:3/980: mkdir d3/da/dc/d11/d2f/d150 0 2024-09-21T08:02:38.505 INFO:tasks.workunit.client.1.smithi129.stdout:3/981: chown d3/da/dc/d25/c30 127578 1 2024-09-21T08:02:38.505 INFO:tasks.workunit.client.1.smithi129.stdout:3/982: write d3/da/dc/d7f/dd6/de2/df2/f135 [330637,9306] 0 2024-09-21T08:02:38.506 INFO:tasks.workunit.client.1.smithi129.stdout:3/983: fdatasync d3/da/dc/fb5 0 2024-09-21T08:02:38.508 INFO:tasks.workunit.client.0.smithi107.stdout:2/98: sync 2024-09-21T08:02:38.508 INFO:tasks.workunit.client.0.smithi107.stdout:6/131: sync 2024-09-21T08:02:38.508 INFO:tasks.workunit.client.0.smithi107.stdout:4/110: sync 2024-09-21T08:02:38.508 INFO:tasks.workunit.client.0.smithi107.stdout:3/92: sync 2024-09-21T08:02:38.508 INFO:tasks.workunit.client.0.smithi107.stdout:3/93: chown f2 3 1 2024-09-21T08:02:38.512 INFO:tasks.workunit.client.0.smithi107.stdout:8/70: symlink d5/d1d/l1f 0 2024-09-21T08:02:38.513 INFO:tasks.workunit.client.0.smithi107.stdout:8/71: fdatasync d5/f1b 0 2024-09-21T08:02:38.513 INFO:tasks.workunit.client.0.smithi107.stdout:8/72: creat d5/f20 x:0 0 0 2024-09-21T08:02:38.513 INFO:tasks.workunit.client.0.smithi107.stdout:8/73: write d5/f20 [890355,10813] 0 2024-09-21T08:02:38.513 INFO:tasks.workunit.client.0.smithi107.stdout:1/112: dread d0/d7/f9 [0,4194304] 0 2024-09-21T08:02:38.514 INFO:tasks.workunit.client.1.smithi129.stdout:6/813: mknod d7/d1b/d1e/d39/d4b/d6e/de5/c110 0 2024-09-21T08:02:38.516 INFO:tasks.workunit.client.1.smithi129.stdout:4/775: creat d5/d33/df2/f111 x:0 0 0 2024-09-21T08:02:38.516 INFO:tasks.workunit.client.1.smithi129.stdout:4/776: read d5/d16/d24/d4f/da1/f73 [3641766,86583] 0 2024-09-21T08:02:38.516 INFO:tasks.workunit.client.1.smithi129.stdout:4/777: dread - d5/d16/d47/ffb zero size 2024-09-21T08:02:38.517 INFO:tasks.workunit.client.1.smithi129.stdout:0/834: dwrite de/d22/d27/d10a/ff7 [0,4194304] 0 2024-09-21T08:02:38.517 INFO:tasks.workunit.client.1.smithi129.stdout:9/835: dwrite d17/d22/d33/d7a/d89/fa6 [0,4194304] 0 2024-09-21T08:02:38.518 INFO:tasks.workunit.client.1.smithi129.stdout:1/949: symlink d1/d7a/da4/l13a 0 2024-09-21T08:02:38.519 INFO:tasks.workunit.client.0.smithi107.stdout:9/156: stat d11/c22 0 2024-09-21T08:02:38.519 INFO:tasks.workunit.client.0.smithi107.stdout:9/157: dread - d11/f18 zero size 2024-09-21T08:02:38.520 INFO:tasks.workunit.client.1.smithi129.stdout:8/726: rmdir d0/d6/d7/d18/d27/d32/d3d/d7b 39 2024-09-21T08:02:38.520 INFO:tasks.workunit.client.1.smithi129.stdout:8/727: chown d0/d6/d7/d9/c1e 431425 1 2024-09-21T08:02:38.520 INFO:tasks.workunit.client.0.smithi107.stdout:5/130: unlink d7/de/c26 0 2024-09-21T08:02:38.521 INFO:tasks.workunit.client.1.smithi129.stdout:5/952: truncate d2/d1e/d35/d37/d96/de5/f4f 4055121 0 2024-09-21T08:02:38.523 INFO:tasks.workunit.client.0.smithi107.stdout:2/99: unlink d1/d2/f5 0 2024-09-21T08:02:38.526 INFO:tasks.workunit.client.0.smithi107.stdout:6/132: mkdir d2/d3/d7/d24 0 2024-09-21T08:02:38.528 INFO:tasks.workunit.client.1.smithi129.stdout:6/814: unlink d7/d1b/d57/dd6/lf1 0 2024-09-21T08:02:38.528 INFO:tasks.workunit.client.1.smithi129.stdout:6/815: fdatasync d7/d1b/d1e/d39/d4b/de8/d69/d89/fbe 0 2024-09-21T08:02:38.528 INFO:tasks.workunit.client.1.smithi129.stdout:6/816: stat d7/d10/c12 0 2024-09-21T08:02:38.529 INFO:tasks.workunit.client.0.smithi107.stdout:4/111: link c5 dc/c1c 0 2024-09-21T08:02:38.530 INFO:tasks.workunit.client.0.smithi107.stdout:4/112: chown dc 2 1 2024-09-21T08:02:38.531 INFO:tasks.workunit.client.1.smithi129.stdout:4/778: rename d5/d16/d85/lc5 to d5/d11/d77/de1/l112 0 2024-09-21T08:02:38.531 INFO:tasks.workunit.client.1.smithi129.stdout:4/779: chown d5/d11/d3f 1 1 2024-09-21T08:02:38.531 INFO:tasks.workunit.client.1.smithi129.stdout:4/780: chown d5/d11/d3f 18010576 1 2024-09-21T08:02:38.532 INFO:tasks.workunit.client.1.smithi129.stdout:4/781: readlink d5/d6/la2 0 2024-09-21T08:02:38.532 INFO:tasks.workunit.client.1.smithi129.stdout:1/950: dread d1/d4/dad/db6/fc1 [0,4194304] 0 2024-09-21T08:02:38.533 INFO:tasks.workunit.client.1.smithi129.stdout:0/835: mknod de/d22/d27/d85/db2/dc3/c10b 0 2024-09-21T08:02:38.534 INFO:tasks.workunit.client.1.smithi129.stdout:0/836: write de/d15/d39/f8a [531503,128672] 0 2024-09-21T08:02:38.534 INFO:tasks.workunit.client.1.smithi129.stdout:0/837: dread - de/d15/d39/d7f/fb7 zero size 2024-09-21T08:02:38.534 INFO:tasks.workunit.client.1.smithi129.stdout:0/838: write de/d15/d39/d56/f63 [2162472,90504] 0 2024-09-21T08:02:38.534 INFO:tasks.workunit.client.1.smithi129.stdout:0/839: read de/d22/d27/d10a/f61 [488800,77545] 0 2024-09-21T08:02:38.535 INFO:tasks.workunit.client.0.smithi107.stdout:1/113: creat d0/d7/d1c/f26 x:0 0 0 2024-09-21T08:02:38.538 INFO:tasks.workunit.client.0.smithi107.stdout:0/183: rename d1/d15 to d1/d5/d25/d3d 0 2024-09-21T08:02:38.538 INFO:tasks.workunit.client.1.smithi129.stdout:9/836: dwrite d17/d22/d33/d7a/d89/d90/db1/d31/d5e/fc1 [0,4194304] 0 2024-09-21T08:02:38.538 INFO:tasks.workunit.client.1.smithi129.stdout:9/837: chown d17/d22/d33/d7a/d89/d90/le0 0 1 2024-09-21T08:02:38.538 INFO:tasks.workunit.client.0.smithi107.stdout:6/133: write d2/d3/f6 [5158174,3844] 0 2024-09-21T08:02:38.540 INFO:tasks.workunit.client.0.smithi107.stdout:9/158: mkdir d11/d27/d2f/d3a 0 2024-09-21T08:02:38.542 INFO:tasks.workunit.client.1.smithi129.stdout:8/728: truncate d0/d6/d7/d18/d61/f9d 2236858 0 2024-09-21T08:02:38.546 INFO:tasks.workunit.client.0.smithi107.stdout:4/113: symlink dc/l1d 0 2024-09-21T08:02:38.547 INFO:tasks.workunit.client.0.smithi107.stdout:4/114: creat dc/f1e x:0 0 0 2024-09-21T08:02:38.548 INFO:tasks.workunit.client.0.smithi107.stdout:3/94: getdents d8 0 2024-09-21T08:02:38.552 INFO:tasks.workunit.client.0.smithi107.stdout:2/100: rename d1/c13 to d1/d2/c1f 0 2024-09-21T08:02:38.554 INFO:tasks.workunit.client.0.smithi107.stdout:6/134: link d2/d3/f6 d2/d3/d7/d24/f25 0 2024-09-21T08:02:38.555 INFO:tasks.workunit.client.0.smithi107.stdout:6/135: dread d2/fd [0,4194304] 0 2024-09-21T08:02:38.555 INFO:tasks.workunit.client.0.smithi107.stdout:3/95: dread d8/f13 [0,4194304] 0 2024-09-21T08:02:38.556 INFO:tasks.workunit.client.0.smithi107.stdout:9/159: link d11/d27/d2a/f2c d11/d27/d2f/f3b 0 2024-09-21T08:02:38.556 INFO:tasks.workunit.client.0.smithi107.stdout:1/114: dwrite d0/d7/f1a [0,4194304] 0 2024-09-21T08:02:38.556 INFO:tasks.workunit.client.0.smithi107.stdout:9/160: write d11/f37 [1083201,128233] 0 2024-09-21T08:02:38.556 INFO:tasks.workunit.client.0.smithi107.stdout:9/161: write d11/d27/d2f/f3b [3194165,23065] 0 2024-09-21T08:02:38.557 INFO:tasks.workunit.client.1.smithi129.stdout:5/953: creat d2/d1e/d35/d33/d36/d5a/d77/d81/f130 x:0 0 0 2024-09-21T08:02:38.557 INFO:tasks.workunit.client.1.smithi129.stdout:5/954: chown d2/d1e/d35/d37/d96/de5/db1/d71/da9/lfe 25 1 2024-09-21T08:02:38.558 INFO:tasks.workunit.client.0.smithi107.stdout:6/136: read d2/d3/d7/f8 [1629679,107323] 0 2024-09-21T08:02:38.558 INFO:tasks.workunit.client.0.smithi107.stdout:6/137: chown d2/fd 9 1 2024-09-21T08:02:38.558 INFO:tasks.workunit.client.0.smithi107.stdout:6/138: chown d2/fe 684 1 2024-09-21T08:02:38.558 INFO:tasks.workunit.client.0.smithi107.stdout:6/139: creat d2/d3/f26 x:0 0 0 2024-09-21T08:02:38.558 INFO:tasks.workunit.client.0.smithi107.stdout:6/140: dread - d2/d3/f22 zero size 2024-09-21T08:02:38.558 INFO:tasks.workunit.client.0.smithi107.stdout:6/141: dread - d2/d3/f14 zero size 2024-09-21T08:02:38.558 INFO:tasks.workunit.client.0.smithi107.stdout:6/142: chown d2/fe 5748 1 2024-09-21T08:02:38.558 INFO:tasks.workunit.client.0.smithi107.stdout:5/131: mkdir d7/de/d2d 0 2024-09-21T08:02:38.560 INFO:tasks.workunit.client.0.smithi107.stdout:1/115: dread d0/f11 [0,4194304] 0 2024-09-21T08:02:38.561 INFO:tasks.workunit.client.0.smithi107.stdout:0/184: dwrite d1/d5/d25/d2d/f2f [0,4194304] 0 2024-09-21T08:02:38.561 INFO:tasks.workunit.client.0.smithi107.stdout:4/115: mknod dc/d13/c1f 0 2024-09-21T08:02:38.561 INFO:tasks.workunit.client.0.smithi107.stdout:4/116: read - dc/f1b zero size 2024-09-21T08:02:38.562 INFO:tasks.workunit.client.1.smithi129.stdout:4/782: getdents d5/d33/d6d/df0 0 2024-09-21T08:02:38.563 INFO:tasks.workunit.client.0.smithi107.stdout:0/185: dread d1/d23/f26 [0,4194304] 0 2024-09-21T08:02:38.563 INFO:tasks.workunit.client.0.smithi107.stdout:2/101: mknod d1/c20 0 2024-09-21T08:02:38.564 INFO:tasks.workunit.client.0.smithi107.stdout:2/102: creat d1/d6/f21 x:0 0 0 2024-09-21T08:02:38.565 INFO:tasks.workunit.client.1.smithi129.stdout:1/951: symlink d1/d4/d6e/l13b 0 2024-09-21T08:02:38.568 INFO:tasks.workunit.client.0.smithi107.stdout:3/96: mknod d8/c19 0 2024-09-21T08:02:38.569 INFO:tasks.workunit.client.1.smithi129.stdout:0/840: creat de/d22/d27/d85/f10c x:0 0 0 2024-09-21T08:02:38.569 INFO:tasks.workunit.client.1.smithi129.stdout:5/955: dread d2/d1e/d35/d33/f4b [0,4194304] 0 2024-09-21T08:02:38.570 INFO:tasks.workunit.client.1.smithi129.stdout:4/783: write d5/d16/d24/d4f/f72 [3937997,333] 0 2024-09-21T08:02:38.572 INFO:tasks.workunit.client.1.smithi129.stdout:9/838: creat d17/d22/d33/d36/f110 x:0 0 0 2024-09-21T08:02:38.573 INFO:tasks.workunit.client.0.smithi107.stdout:0/186: dread d1/d5/f27 [0,4194304] 0 2024-09-21T08:02:38.574 INFO:tasks.workunit.client.0.smithi107.stdout:9/162: symlink d11/d24/d26/l3c 0 2024-09-21T08:02:38.574 INFO:tasks.workunit.client.0.smithi107.stdout:9/163: chown d11/f1c 1 1 2024-09-21T08:02:38.576 INFO:tasks.workunit.client.1.smithi129.stdout:8/729: rename d0/d6/d7/d18/d27/d32/d37/f89 to d0/d6/d7/d18/d27/d32/fda 0 2024-09-21T08:02:38.580 INFO:tasks.workunit.client.1.smithi129.stdout:6/817: rmdir d7/d1b/d1e/d66/dc2/de2/d40 39 2024-09-21T08:02:38.581 INFO:tasks.workunit.client.0.smithi107.stdout:6/143: symlink d2/l27 0 2024-09-21T08:02:38.581 INFO:tasks.workunit.client.0.smithi107.stdout:6/144: chown d2/f18 323722303 1 2024-09-21T08:02:38.583 INFO:tasks.workunit.client.1.smithi129.stdout:1/952: unlink d1/d4/d96/l9a 0 2024-09-21T08:02:38.583 INFO:tasks.workunit.client.1.smithi129.stdout:1/953: fsync d1/d16/d25/f109 0 2024-09-21T08:02:38.585 INFO:tasks.workunit.client.1.smithi129.stdout:1/954: dread d1/d16/d28/f11f [0,4194304] 0 2024-09-21T08:02:38.585 INFO:tasks.workunit.client.1.smithi129.stdout:5/956: getdents d2/d1e/d35/d33/d36/d5a 0 2024-09-21T08:02:38.586 INFO:tasks.workunit.client.0.smithi107.stdout:1/116: symlink d0/d19/l27 0 2024-09-21T08:02:38.588 INFO:tasks.workunit.client.1.smithi129.stdout:4/784: creat d5/d33/d4e/da7/f113 x:0 0 0 2024-09-21T08:02:38.589 INFO:tasks.workunit.client.0.smithi107.stdout:4/117: symlink dc/d13/l20 0 2024-09-21T08:02:38.590 INFO:tasks.workunit.client.1.smithi129.stdout:9/839: symlink d17/d60/d97/l111 0 2024-09-21T08:02:38.590 INFO:tasks.workunit.client.1.smithi129.stdout:9/840: fdatasync d17/d22/d33/d7a/d89/fa6 0 2024-09-21T08:02:38.594 INFO:tasks.workunit.client.1.smithi129.stdout:9/841: write d17/d22/d33/f7f [1666849,10745] 0 2024-09-21T08:02:38.597 INFO:tasks.workunit.client.0.smithi107.stdout:9/164: dwrite d11/f18 [0,4194304] 0 2024-09-21T08:02:38.597 INFO:tasks.workunit.client.0.smithi107.stdout:3/97: creat d8/d14/f1a x:0 0 0 2024-09-21T08:02:38.599 INFO:tasks.workunit.client.1.smithi129.stdout:0/841: rename de/d1f/dd4/cae to de/d15/d39/d56/c10d 0 2024-09-21T08:02:38.599 INFO:tasks.workunit.client.1.smithi129.stdout:0/842: chown de/d15/d39/d56/l9c 528164179 1 2024-09-21T08:02:38.599 INFO:tasks.workunit.client.1.smithi129.stdout:0/843: chown de/d15/d39/d9e/lfc 2144 1 2024-09-21T08:02:38.599 INFO:tasks.workunit.client.1.smithi129.stdout:6/818: mkdir d7/d1b/d1e/d39/d111 0 2024-09-21T08:02:38.600 INFO:tasks.workunit.client.0.smithi107.stdout:3/98: write d8/f13 [617108,85596] 0 2024-09-21T08:02:38.600 INFO:tasks.workunit.client.0.smithi107.stdout:3/99: write f2 [850653,99572] 0 2024-09-21T08:02:38.600 INFO:tasks.workunit.client.0.smithi107.stdout:3/100: dread - d8/f11 zero size 2024-09-21T08:02:38.600 INFO:tasks.workunit.client.0.smithi107.stdout:3/101: write d8/f15 [1170200,12802] 0 2024-09-21T08:02:38.600 INFO:tasks.workunit.client.0.smithi107.stdout:0/187: truncate d1/d5/f24 1851626 0 2024-09-21T08:02:38.601 INFO:tasks.workunit.client.1.smithi129.stdout:4/785: symlink d5/d33/d4e/l114 0 2024-09-21T08:02:38.601 INFO:tasks.workunit.client.1.smithi129.stdout:4/786: write d5/d16/f32 [4272510,122832] 0 2024-09-21T08:02:38.601 INFO:tasks.workunit.client.0.smithi107.stdout:1/117: dread d0/f2 [4194304,4194304] 0 2024-09-21T08:02:38.601 INFO:tasks.workunit.client.0.smithi107.stdout:1/118: truncate d0/d7/d1c/d20/f1d 957510 0 2024-09-21T08:02:38.601 INFO:tasks.workunit.client.0.smithi107.stdout:1/119: write d0/d7/fd [973303,117405] 0 2024-09-21T08:02:38.601 INFO:tasks.workunit.client.0.smithi107.stdout:6/145: truncate d2/d3/f9 767848 0 2024-09-21T08:02:38.602 INFO:tasks.workunit.client.0.smithi107.stdout:5/132: symlink d7/de/l2e 0 2024-09-21T08:02:38.604 INFO:tasks.workunit.client.0.smithi107.stdout:4/118: rename dc/c1c to dc/c21 0 2024-09-21T08:02:38.607 INFO:tasks.workunit.client.1.smithi129.stdout:6/819: link d7/d1b/d1e/d66/dc2/de2/d40/d41/f70 d7/d1b/d1e/d66/dc2/d93/dd5/de6/f112 0 2024-09-21T08:02:38.607 INFO:tasks.workunit.client.1.smithi129.stdout:6/820: fsync d7/f9a 0 2024-09-21T08:02:38.607 INFO:tasks.workunit.client.1.smithi129.stdout:6/821: write d7/d10/f19 [1982818,101918] 0 2024-09-21T08:02:38.607 INFO:tasks.workunit.client.1.smithi129.stdout:4/787: mkdir d5/d11/d77/da8/dbc/d115 0 2024-09-21T08:02:38.608 INFO:tasks.workunit.client.0.smithi107.stdout:9/165: mknod d11/d27/d2a/d34/c3d 0 2024-09-21T08:02:38.611 INFO:tasks.workunit.client.0.smithi107.stdout:3/102: creat d8/f1b x:0 0 0 2024-09-21T08:02:38.611 INFO:tasks.workunit.client.0.smithi107.stdout:3/103: creat d8/f1c x:0 0 0 2024-09-21T08:02:38.612 INFO:tasks.workunit.client.0.smithi107.stdout:0/188: creat d1/d5/d25/f3e x:0 0 0 2024-09-21T08:02:38.612 INFO:tasks.workunit.client.0.smithi107.stdout:0/189: stat d1/d5/d25/d3d/d20 0 2024-09-21T08:02:38.613 INFO:tasks.workunit.client.0.smithi107.stdout:0/190: write d1/d5/f2c [2282248,77975] 0 2024-09-21T08:02:38.613 INFO:tasks.workunit.client.1.smithi129.stdout:9/842: rmdir d17/d22/d33/d36/d48/d3f 39 2024-09-21T08:02:38.615 INFO:tasks.workunit.client.0.smithi107.stdout:1/120: mknod d0/d7/d1c/d20/c28 0 2024-09-21T08:02:38.616 INFO:tasks.workunit.client.0.smithi107.stdout:1/121: chown d0/d7/fa 4113 1 2024-09-21T08:02:38.616 INFO:tasks.workunit.client.0.smithi107.stdout:1/122: read d0/d7/fd [343904,44343] 0 2024-09-21T08:02:38.617 INFO:tasks.workunit.client.0.smithi107.stdout:6/146: truncate d2/d3/d7/f11 930698 0 2024-09-21T08:02:38.617 INFO:tasks.workunit.client.0.smithi107.stdout:6/147: chown d2/d3/d7/f12 140275 1 2024-09-21T08:02:38.618 INFO:tasks.workunit.client.1.smithi129.stdout:6/822: readlink d7/d1b/d57/l75 0 2024-09-21T08:02:38.619 INFO:tasks.workunit.client.0.smithi107.stdout:5/133: read d7/de/f19 [40668,119300] 0 2024-09-21T08:02:38.619 INFO:tasks.workunit.client.0.smithi107.stdout:5/134: truncate d7/f8 4285098 0 2024-09-21T08:02:38.619 INFO:tasks.workunit.client.0.smithi107.stdout:1/123: dread d0/d7/f9 [0,4194304] 0 2024-09-21T08:02:38.620 INFO:tasks.workunit.client.1.smithi129.stdout:9/843: mknod d17/d55/dd1/c112 0 2024-09-21T08:02:38.620 INFO:tasks.workunit.client.0.smithi107.stdout:1/124: dread d0/d7/d1c/d20/f1d [0,4194304] 0 2024-09-21T08:02:38.621 INFO:tasks.workunit.client.0.smithi107.stdout:4/119: symlink dc/l22 0 2024-09-21T08:02:38.621 INFO:tasks.workunit.client.1.smithi129.stdout:4/788: write d5/d16/d24/d4f/da1/f8f [3566775,61183] 0 2024-09-21T08:02:38.621 INFO:tasks.workunit.client.1.smithi129.stdout:4/789: readlink d5/d16/d24/d3b/l107 0 2024-09-21T08:02:38.623 INFO:tasks.workunit.client.1.smithi129.stdout:4/790: write d5/d33/d66/fdd [866603,116890] 0 2024-09-21T08:02:38.623 INFO:tasks.workunit.client.1.smithi129.stdout:4/791: fsync d5/d16/d24/d3b/f90 0 2024-09-21T08:02:38.623 INFO:tasks.workunit.client.1.smithi129.stdout:4/792: write d5/d11/d77/da8/f10c [427995,63229] 0 2024-09-21T08:02:38.623 INFO:tasks.workunit.client.1.smithi129.stdout:5/957: dwrite d2/f4e [0,4194304] 0 2024-09-21T08:02:38.623 INFO:tasks.workunit.client.1.smithi129.stdout:8/730: dwrite d0/d6/d7/d24/f47 [0,4194304] 0 2024-09-21T08:02:38.623 INFO:tasks.workunit.client.1.smithi129.stdout:1/955: dwrite d1/d44/d83/fed [0,4194304] 0 2024-09-21T08:02:38.623 INFO:tasks.workunit.client.1.smithi129.stdout:1/956: stat d1/d9/d31/f10b 0 2024-09-21T08:02:38.623 INFO:tasks.workunit.client.1.smithi129.stdout:0/844: rename de/d15/d39/d9e/dac/dba to de/d81/d10e 0 2024-09-21T08:02:38.623 INFO:tasks.workunit.client.1.smithi129.stdout:0/845: creat de/d15/d39/d9e/f10f x:0 0 0 2024-09-21T08:02:38.625 INFO:tasks.workunit.client.0.smithi107.stdout:9/166: rename d11/d27/d2a/f2d to d11/f3e 0 2024-09-21T08:02:38.625 INFO:tasks.workunit.client.1.smithi129.stdout:3/984: sync 2024-09-21T08:02:38.627 INFO:tasks.workunit.client.1.smithi129.stdout:6/823: symlink d7/d1b/d57/dd6/l113 0 2024-09-21T08:02:38.627 INFO:tasks.workunit.client.1.smithi129.stdout:6/824: chown d7/d1b/d1e/d66/dba/d2b/fb3 6681 1 2024-09-21T08:02:38.627 INFO:tasks.workunit.client.1.smithi129.stdout:6/825: fdatasync d7/d1b/d1e/d66/dc2/de2/d40/d41/f70 0 2024-09-21T08:02:38.630 INFO:tasks.workunit.client.0.smithi107.stdout:1/125: dread d0/d7/f1a [0,4194304] 0 2024-09-21T08:02:38.630 INFO:tasks.workunit.client.1.smithi129.stdout:9/844: symlink d17/d22/d33/d36/d48/d3f/d53/l113 0 2024-09-21T08:02:38.632 INFO:tasks.workunit.client.0.smithi107.stdout:3/104: mkdir d8/d14/d1d 0 2024-09-21T08:02:38.632 INFO:tasks.workunit.client.0.smithi107.stdout:3/105: write d8/f13 [2014655,8902] 0 2024-09-21T08:02:38.633 INFO:tasks.workunit.client.0.smithi107.stdout:4/120: dread fa [0,4194304] 0 2024-09-21T08:02:38.635 INFO:tasks.workunit.client.1.smithi129.stdout:4/793: mknod d5/d16/d47/c116 0 2024-09-21T08:02:38.636 INFO:tasks.workunit.client.1.smithi129.stdout:4/794: fsync d5/d16/d47/f70 0 2024-09-21T08:02:38.637 INFO:tasks.workunit.client.1.smithi129.stdout:1/957: dread d1/d16/d9b/fa2 [0,4194304] 0 2024-09-21T08:02:38.637 INFO:tasks.workunit.client.0.smithi107.stdout:6/148: mknod d2/d3/d7/c28 0 2024-09-21T08:02:38.640 INFO:tasks.workunit.client.0.smithi107.stdout:0/191: rename d1/d5/f1e to d1/d23/f3f 0 2024-09-21T08:02:38.643 INFO:tasks.workunit.client.0.smithi107.stdout:9/167: mknod d11/d27/d2f/d38/c3f 0 2024-09-21T08:02:38.643 INFO:tasks.workunit.client.0.smithi107.stdout:9/168: fdatasync d11/f18 0 2024-09-21T08:02:38.645 INFO:tasks.workunit.client.1.smithi129.stdout:5/958: getdents d2/d1e/d35/d37/d96/de5/d61 0 2024-09-21T08:02:38.646 INFO:tasks.workunit.client.0.smithi107.stdout:1/126: rmdir d0/d7/d1c/d20 39 2024-09-21T08:02:38.646 INFO:tasks.workunit.client.1.smithi129.stdout:8/731: unlink d0/d6/dac/faf 0 2024-09-21T08:02:38.646 INFO:tasks.workunit.client.1.smithi129.stdout:8/732: fsync d0/d6/f1a 0 2024-09-21T08:02:38.647 INFO:tasks.workunit.client.0.smithi107.stdout:3/106: creat d8/d14/d1d/f1e x:0 0 0 2024-09-21T08:02:38.647 INFO:tasks.workunit.client.0.smithi107.stdout:3/107: chown d8/d14/f1a 788 1 2024-09-21T08:02:38.647 INFO:tasks.workunit.client.0.smithi107.stdout:4/121: mknod dc/c23 0 2024-09-21T08:02:38.649 INFO:tasks.workunit.client.0.smithi107.stdout:6/149: link d2/l1d d2/l29 0 2024-09-21T08:02:38.650 INFO:tasks.workunit.client.1.smithi129.stdout:6/826: symlink d7/d1b/d1e/d39/d4b/de8/l114 0 2024-09-21T08:02:38.650 INFO:tasks.workunit.client.1.smithi129.stdout:6/827: read d7/d10/f19 [25178,73971] 0 2024-09-21T08:02:38.650 INFO:tasks.workunit.client.1.smithi129.stdout:6/828: truncate d7/d1b/d1e/d66/d7c/f97 1982214 0 2024-09-21T08:02:38.650 INFO:tasks.workunit.client.1.smithi129.stdout:6/829: write d7/d1b/d1e/d66/d7c/f97 [9854,59472] 0 2024-09-21T08:02:38.652 INFO:tasks.workunit.client.0.smithi107.stdout:9/169: symlink d11/d27/d2a/l40 0 2024-09-21T08:02:38.652 INFO:tasks.workunit.client.0.smithi107.stdout:9/170: dread - d11/f1c zero size 2024-09-21T08:02:38.653 INFO:tasks.workunit.client.0.smithi107.stdout:9/171: creat d11/d27/d2a/f41 x:0 0 0 2024-09-21T08:02:38.653 INFO:tasks.workunit.client.0.smithi107.stdout:9/172: creat d11/d27/d2a/f42 x:0 0 0 2024-09-21T08:02:38.653 INFO:tasks.workunit.client.0.smithi107.stdout:9/173: chown d11/d27/d2a/f42 7 1 2024-09-21T08:02:38.653 INFO:tasks.workunit.client.0.smithi107.stdout:9/174: readlink lc 0 2024-09-21T08:02:38.653 INFO:tasks.workunit.client.1.smithi129.stdout:4/795: link d5/d16/d24/d4f/da1/ld5 d5/d16/d47/d5f/d64/l117 0 2024-09-21T08:02:38.654 INFO:tasks.workunit.client.0.smithi107.stdout:1/127: mkdir d0/d29 0 2024-09-21T08:02:38.655 INFO:tasks.workunit.client.1.smithi129.stdout:1/958: rename d1/d9/d31/cc4 to d1/df1/c13c 0 2024-09-21T08:02:38.655 INFO:tasks.workunit.client.0.smithi107.stdout:4/122: symlink dc/d13/l24 0 2024-09-21T08:02:38.657 INFO:tasks.workunit.client.1.smithi129.stdout:8/733: creat d0/d6/d7/d5d/fdb x:0 0 0 2024-09-21T08:02:38.657 INFO:tasks.workunit.client.1.smithi129.stdout:8/734: readlink d0/d6/d7/d3a/l92 0 2024-09-21T08:02:38.658 INFO:tasks.workunit.client.0.smithi107.stdout:5/135: rename d7/de/c20 to d7/de/d1d/d24/c2f 0 2024-09-21T08:02:38.658 INFO:tasks.workunit.client.0.smithi107.stdout:5/136: fsync d7/de/d1d/f25 0 2024-09-21T08:02:38.658 INFO:tasks.workunit.client.0.smithi107.stdout:5/137: chown c5 1159894 1 2024-09-21T08:02:38.658 INFO:tasks.workunit.client.1.smithi129.stdout:3/985: dwrite d3/da/dc/fdf [0,4194304] 0 2024-09-21T08:02:38.659 INFO:tasks.workunit.client.1.smithi129.stdout:3/986: write d3/da/dc/d7f/dd6/de2/df2/f135 [519402,124404] 0 2024-09-21T08:02:38.659 INFO:tasks.workunit.client.1.smithi129.stdout:0/846: dwrite de/d22/d27/d10a/f61 [0,4194304] 0 2024-09-21T08:02:38.659 INFO:tasks.workunit.client.1.smithi129.stdout:0/847: chown de/d15/d39/d7f/faa 20274 1 2024-09-21T08:02:38.659 INFO:tasks.workunit.client.1.smithi129.stdout:0/848: write de/d22/d27/d10a/d42/f77 [2915100,408] 0 2024-09-21T08:02:38.660 INFO:tasks.workunit.client.1.smithi129.stdout:6/830: symlink d7/d1b/d1e/d66/dc2/de2/d40/d41/l115 0 2024-09-21T08:02:38.660 INFO:tasks.workunit.client.1.smithi129.stdout:6/831: fdatasync d7/d1b/d1e/d66/dc2/d5e/fe9 0 2024-09-21T08:02:38.660 INFO:tasks.workunit.client.1.smithi129.stdout:5/959: read d2/d2a/f2e [2926225,92903] 0 2024-09-21T08:02:38.660 INFO:tasks.workunit.client.1.smithi129.stdout:5/960: dread - d2/d1e/d35/d33/da1/fa6 zero size 2024-09-21T08:02:38.665 INFO:tasks.workunit.client.1.smithi129.stdout:4/796: rename d5/d16/d47/d61/cd7 to d5/d11/d3f/c118 0 2024-09-21T08:02:38.666 INFO:tasks.workunit.client.0.smithi107.stdout:9/175: unlink d11/c22 0 2024-09-21T08:02:38.667 INFO:tasks.workunit.client.1.smithi129.stdout:4/797: dread d5/d33/d4e/f76 [0,4194304] 0 2024-09-21T08:02:38.667 INFO:tasks.workunit.client.1.smithi129.stdout:4/798: dread - d5/da5/ff1 zero size 2024-09-21T08:02:38.667 INFO:tasks.workunit.client.1.smithi129.stdout:4/799: dread - d5/d16/fe7 zero size 2024-09-21T08:02:38.668 INFO:tasks.workunit.client.1.smithi129.stdout:1/959: symlink d1/d7a/deb/l13d 0 2024-09-21T08:02:38.668 INFO:tasks.workunit.client.1.smithi129.stdout:1/960: fsync d1/d16/d25/f135 0 2024-09-21T08:02:38.668 INFO:tasks.workunit.client.1.smithi129.stdout:1/961: chown d1/d16/d28/f33 2397 1 2024-09-21T08:02:38.668 INFO:tasks.workunit.client.1.smithi129.stdout:1/962: dread - d1/d16/d25/f70 zero size 2024-09-21T08:02:38.668 INFO:tasks.workunit.client.1.smithi129.stdout:1/963: write d1/d44/db9/fc9 [1783003,123550] 0 2024-09-21T08:02:38.668 INFO:tasks.workunit.client.1.smithi129.stdout:1/964: chown d1/d7a 1505968 1 2024-09-21T08:02:38.669 INFO:tasks.workunit.client.0.smithi107.stdout:1/128: mknod d0/c2a 0 2024-09-21T08:02:38.669 INFO:tasks.workunit.client.0.smithi107.stdout:1/129: chown d0/d7/l1e 3046664 1 2024-09-21T08:02:38.669 INFO:tasks.workunit.client.1.smithi129.stdout:8/735: dread - d0/d6/d7/d18/d27/d32/d70/f75 zero size 2024-09-21T08:02:38.669 INFO:tasks.workunit.client.1.smithi129.stdout:8/736: read - d0/d6/d7/d18/d61/fd8 zero size 2024-09-21T08:02:38.672 INFO:tasks.workunit.client.0.smithi107.stdout:5/138: creat d7/de/f30 x:0 0 0 2024-09-21T08:02:38.672 INFO:tasks.workunit.client.0.smithi107.stdout:5/139: chown d7/f1f 129930 1 2024-09-21T08:02:38.673 INFO:tasks.workunit.client.1.smithi129.stdout:9/845: rmdir d17/d55/dd1 39 2024-09-21T08:02:38.675 INFO:tasks.workunit.client.1.smithi129.stdout:3/987: dwrite d3/da/dc/d7f/dd6/de2/d120/da2/f129 [0,4194304] 0 2024-09-21T08:02:38.675 INFO:tasks.workunit.client.0.smithi107.stdout:0/192: rename d1/f3b to d1/d5/d25/f40 0 2024-09-21T08:02:38.675 INFO:tasks.workunit.client.0.smithi107.stdout:0/193: fdatasync d1/d23/f3a 0 2024-09-21T08:02:38.676 INFO:tasks.workunit.client.1.smithi129.stdout:3/988: dread d3/f93 [0,4194304] 0 2024-09-21T08:02:38.678 INFO:tasks.workunit.client.1.smithi129.stdout:1/965: read d1/d4/fa [228539,22082] 0 2024-09-21T08:02:38.680 INFO:tasks.workunit.client.0.smithi107.stdout:1/130: mkdir d0/d19/d2b 0 2024-09-21T08:02:38.682 INFO:tasks.workunit.client.1.smithi129.stdout:0/849: link de/d22/d27/d10a/f5a de/d15/d44/d4b/f110 0 2024-09-21T08:02:38.683 INFO:tasks.workunit.client.1.smithi129.stdout:6/832: rmdir d7/d1b/d1e/d66/dc2/de2/d40/d41 39 2024-09-21T08:02:38.683 INFO:tasks.workunit.client.1.smithi129.stdout:6/833: stat d7/d1b/d1e/d66/dc2/de2 0 2024-09-21T08:02:38.683 INFO:tasks.workunit.client.1.smithi129.stdout:6/834: creat d7/d1b/d1e/d66/dc2/d93/dd5/de6/f116 x:0 0 0 2024-09-21T08:02:38.687 INFO:tasks.workunit.client.1.smithi129.stdout:5/961: creat d2/d1e/d35/d33/db9/d124/f131 x:0 0 0 2024-09-21T08:02:38.687 INFO:tasks.workunit.client.1.smithi129.stdout:5/962: chown d2/d1e/l8b 114 1 2024-09-21T08:02:38.689 INFO:tasks.workunit.client.1.smithi129.stdout:4/800: truncate d5/d33/d66/f68 1071353 0 2024-09-21T08:02:38.689 INFO:tasks.workunit.client.1.smithi129.stdout:4/801: chown d5/d16/d24/d4f/c10b 10149767 1 2024-09-21T08:02:38.689 INFO:tasks.workunit.client.0.smithi107.stdout:9/176: dwrite d11/d24/d26/f2e [0,4194304] 0 2024-09-21T08:02:38.689 INFO:tasks.workunit.client.0.smithi107.stdout:9/177: chown d11/f21 3434 1 2024-09-21T08:02:38.691 INFO:tasks.workunit.client.1.smithi129.stdout:0/850: dread de/d15/d39/f4a [0,4194304] 0 2024-09-21T08:02:38.692 INFO:tasks.workunit.client.1.smithi129.stdout:8/737: rename d0/d6/d7/d18/d61/cd4 to d0/d6/d7/d18/d27/d60/d85/dcc/cdc 0 2024-09-21T08:02:38.695 INFO:tasks.workunit.client.0.smithi107.stdout:5/140: write d7/de/f13 [5205370,76775] 0 2024-09-21T08:02:38.699 INFO:tasks.workunit.client.0.smithi107.stdout:3/108: rename d8/d14/f1a to d8/d14/d1d/f1f 0 2024-09-21T08:02:38.701 INFO:tasks.workunit.client.0.smithi107.stdout:0/194: mknod d1/d5/d25/d3d/c41 0 2024-09-21T08:02:38.702 INFO:tasks.workunit.client.1.smithi129.stdout:3/989: mknod d3/da/d5d/d94/db3/dc3/c151 0 2024-09-21T08:02:38.707 INFO:tasks.workunit.client.1.smithi129.stdout:6/835: mknod d7/d1b/d1e/d39/d4b/de8/d7a/c117 0 2024-09-21T08:02:38.708 INFO:tasks.workunit.client.0.smithi107.stdout:4/123: getdents dc/d13 0 2024-09-21T08:02:38.708 INFO:tasks.workunit.client.0.smithi107.stdout:4/124: truncate dc/f1b 302908 0 2024-09-21T08:02:38.708 INFO:tasks.workunit.client.0.smithi107.stdout:4/125: chown dc/c15 114229483 1 2024-09-21T08:02:38.708 INFO:tasks.workunit.client.0.smithi107.stdout:4/126: chown dc/d13/c1f 1 1 2024-09-21T08:02:38.708 INFO:tasks.workunit.client.0.smithi107.stdout:9/178: mknod d11/d27/d2f/d3a/c43 0 2024-09-21T08:02:38.714 INFO:tasks.workunit.client.1.smithi129.stdout:0/851: mkdir de/d1f/da9/d111 0 2024-09-21T08:02:38.716 INFO:tasks.workunit.client.0.smithi107.stdout:3/109: rename d8/l17 to d8/l20 0 2024-09-21T08:02:38.716 INFO:tasks.workunit.client.0.smithi107.stdout:3/110: write d8/f13 [2267473,86458] 0 2024-09-21T08:02:38.716 INFO:tasks.workunit.client.0.smithi107.stdout:3/111: truncate d8/f13 3034706 0 2024-09-21T08:02:38.716 INFO:tasks.workunit.client.0.smithi107.stdout:0/195: write d1/d5/d25/d3d/f33 [1441074,29847] 0 2024-09-21T08:02:38.719 INFO:tasks.workunit.client.0.smithi107.stdout:9/179: link lc d11/d27/d2f/d38/l44 0 2024-09-21T08:02:38.719 INFO:tasks.workunit.client.0.smithi107.stdout:9/180: write d11/f37 [2641089,105934] 0 2024-09-21T08:02:38.719 INFO:tasks.workunit.client.0.smithi107.stdout:1/131: dwrite d0/d7/fa [4194304,4194304] 0 2024-09-21T08:02:38.721 INFO:tasks.workunit.client.0.smithi107.stdout:3/112: unlink d8/f12 0 2024-09-21T08:02:38.722 INFO:tasks.workunit.client.0.smithi107.stdout:3/113: write d8/d14/d1d/f1e [60984,45413] 0 2024-09-21T08:02:38.722 INFO:tasks.workunit.client.0.smithi107.stdout:3/114: truncate d8/fe 1066923 0 2024-09-21T08:02:38.722 INFO:tasks.workunit.client.0.smithi107.stdout:3/115: write d8/f1b [754262,121539] 0 2024-09-21T08:02:38.722 INFO:tasks.workunit.client.0.smithi107.stdout:3/116: truncate d8/fe 1268962 0 2024-09-21T08:02:38.722 INFO:tasks.workunit.client.1.smithi129.stdout:3/990: creat d3/da/dc/d11/d2f/d150/f152 x:0 0 0 2024-09-21T08:02:38.724 INFO:tasks.workunit.client.1.smithi129.stdout:5/963: dwrite d2/d1e/d35/d33/d36/d5a/f70 [0,4194304] 0 2024-09-21T08:02:38.724 INFO:tasks.workunit.client.1.smithi129.stdout:5/964: chown d2/d2a/f2e 47494120 1 2024-09-21T08:02:38.724 INFO:tasks.workunit.client.0.smithi107.stdout:0/196: symlink d1/d5/d25/d3d/d20/l42 0 2024-09-21T08:02:38.724 INFO:tasks.workunit.client.0.smithi107.stdout:0/197: read - d1/d5/d25/f3e zero size 2024-09-21T08:02:38.724 INFO:tasks.workunit.client.0.smithi107.stdout:0/198: write d1/d5/d25/f3e [68882,17974] 0 2024-09-21T08:02:38.725 INFO:tasks.workunit.client.1.smithi129.stdout:4/802: getdents d5/d11/d77/da8 0 2024-09-21T08:02:38.728 INFO:tasks.workunit.client.0.smithi107.stdout:9/181: getdents d11/d27 0 2024-09-21T08:02:38.730 INFO:tasks.workunit.client.0.smithi107.stdout:5/141: dwrite d7/f8 [0,4194304] 0 2024-09-21T08:02:38.730 INFO:tasks.workunit.client.0.smithi107.stdout:5/142: stat d7/de/d1d/d29 0 2024-09-21T08:02:38.730 INFO:tasks.workunit.client.1.smithi129.stdout:0/852: link de/l55 de/d15/d39/d56/def/d101/l112 0 2024-09-21T08:02:38.731 INFO:tasks.workunit.client.1.smithi129.stdout:1/966: dwrite d1/d44/d83/fed [0,4194304] 0 2024-09-21T08:02:38.731 INFO:tasks.workunit.client.1.smithi129.stdout:8/738: getdents d0/d6/d7/d18/d27/d32/d3d/d83 0 2024-09-21T08:02:38.733 INFO:tasks.workunit.client.0.smithi107.stdout:1/132: mkdir d0/d29/d2c 0 2024-09-21T08:02:38.734 INFO:tasks.workunit.client.1.smithi129.stdout:3/991: symlink d3/da/d5d/d94/dac/l153 0 2024-09-21T08:02:38.735 INFO:tasks.workunit.client.0.smithi107.stdout:0/199: truncate d1/f12 1839732 0 2024-09-21T08:02:38.736 INFO:tasks.workunit.client.1.smithi129.stdout:5/965: rmdir d2/d1e/d35/d33/d36/d5a 39 2024-09-21T08:02:38.736 INFO:tasks.workunit.client.1.smithi129.stdout:5/966: truncate d2/d1e/d35/d37/d114/f117 836941 0 2024-09-21T08:02:38.737 INFO:tasks.workunit.client.1.smithi129.stdout:5/967: write d2/d1e/d35/d37/d65/fce [11654,2513] 0 2024-09-21T08:02:38.737 INFO:tasks.workunit.client.1.smithi129.stdout:5/968: creat d2/d1e/d35/d37/d96/de5/d61/d102/f132 x:0 0 0 2024-09-21T08:02:38.737 INFO:tasks.workunit.client.1.smithi129.stdout:5/969: fsync d2/d1e/d35/d33/f34 0 2024-09-21T08:02:38.737 INFO:tasks.workunit.client.1.smithi129.stdout:5/970: readlink d2/d1e/d35/d37/d96/de5/db1/lba 0 2024-09-21T08:02:38.737 INFO:tasks.workunit.client.1.smithi129.stdout:5/971: chown d2/d1e/d35/d37/d65/cff 28 1 2024-09-21T08:02:38.738 INFO:tasks.workunit.client.0.smithi107.stdout:0/200: dread d1/d23/f26 [0,4194304] 0 2024-09-21T08:02:38.738 INFO:tasks.workunit.client.0.smithi107.stdout:5/143: creat d7/de/d1d/f31 x:0 0 0 2024-09-21T08:02:38.739 INFO:tasks.workunit.client.0.smithi107.stdout:1/133: stat d0/d7/l1e 0 2024-09-21T08:02:38.742 INFO:tasks.workunit.client.1.smithi129.stdout:0/853: rename de/d15/d39/d9e/dac/dfd to de/d1f/dd4/db1/df5/d113 0 2024-09-21T08:02:38.743 INFO:tasks.workunit.client.0.smithi107.stdout:0/201: mknod d1/d5/d25/c43 0 2024-09-21T08:02:38.743 INFO:tasks.workunit.client.0.smithi107.stdout:0/202: truncate d1/d5/d25/d3d/f33 4662896 0 2024-09-21T08:02:38.744 INFO:tasks.workunit.client.1.smithi129.stdout:0/854: read de/d15/d44/d4b/f110 [4180083,91978] 0 2024-09-21T08:02:38.744 INFO:tasks.workunit.client.1.smithi129.stdout:0/855: read - de/d15/d44/d45/da0/f99 zero size 2024-09-21T08:02:38.748 INFO:tasks.workunit.client.0.smithi107.stdout:5/144: unlink d7/de/d1d/f25 0 2024-09-21T08:02:38.748 INFO:tasks.workunit.client.0.smithi107.stdout:9/182: dread d11/d27/d2f/f3b [0,4194304] 0 2024-09-21T08:02:38.748 INFO:tasks.workunit.client.0.smithi107.stdout:9/183: chown d11/d27 501 1 2024-09-21T08:02:38.748 INFO:tasks.workunit.client.0.smithi107.stdout:4/127: dwrite f7 [0,4194304] 0 2024-09-21T08:02:38.748 INFO:tasks.workunit.client.0.smithi107.stdout:4/128: creat dc/f25 x:0 0 0 2024-09-21T08:02:38.748 INFO:tasks.workunit.client.0.smithi107.stdout:4/129: readlink l9 0 2024-09-21T08:02:38.749 INFO:tasks.workunit.client.1.smithi129.stdout:1/967: write d1/d16/d57/f86 [137450,128360] 0 2024-09-21T08:02:38.749 INFO:tasks.workunit.client.1.smithi129.stdout:1/968: fdatasync d1/d16/d25/f135 0 2024-09-21T08:02:38.750 INFO:tasks.workunit.client.0.smithi107.stdout:1/134: dread d0/f11 [0,4194304] 0 2024-09-21T08:02:38.751 INFO:tasks.workunit.client.0.smithi107.stdout:0/203: creat d1/d5/d25/d3d/d20/d29/f44 x:0 0 0 2024-09-21T08:02:38.751 INFO:tasks.workunit.client.1.smithi129.stdout:6/836: dwrite d7/d1b/d1e/d66/dc2/de2/d40/d41/f5d [0,4194304] 0 2024-09-21T08:02:38.752 INFO:tasks.workunit.client.1.smithi129.stdout:6/837: rename d7/d1b/d1e to d7/d1b/d1e/d66/dc2/d93/dd5/de6/d118 22 2024-09-21T08:02:38.753 INFO:tasks.workunit.client.1.smithi129.stdout:3/992: unlink d3/da/le 0 2024-09-21T08:02:38.753 INFO:tasks.workunit.client.1.smithi129.stdout:5/972: dwrite d2/d1e/d35/d33/da1/fed [0,4194304] 0 2024-09-21T08:02:38.754 INFO:tasks.workunit.client.1.smithi129.stdout:5/973: fsync d2/f4e 0 2024-09-21T08:02:38.758 INFO:tasks.workunit.client.0.smithi107.stdout:9/184: symlink d11/d27/d2f/d38/l45 0 2024-09-21T08:02:38.761 INFO:tasks.workunit.client.1.smithi129.stdout:0/856: symlink de/d22/d27/d85/db2/dc3/l114 0 2024-09-21T08:02:38.762 INFO:tasks.workunit.client.0.smithi107.stdout:3/117: dwrite d8/fe [0,4194304] 0 2024-09-21T08:02:38.763 INFO:tasks.workunit.client.0.smithi107.stdout:4/130: creat dc/d13/f26 x:0 0 0 2024-09-21T08:02:38.764 INFO:tasks.workunit.client.0.smithi107.stdout:5/145: write d7/de/f1a [3665615,28600] 0 2024-09-21T08:02:38.766 INFO:tasks.workunit.client.1.smithi129.stdout:3/993: dread d3/da/dc/d7f/dd6/de2/d120/fc4 [0,4194304] 0 2024-09-21T08:02:38.768 INFO:tasks.workunit.client.0.smithi107.stdout:0/204: mknod d1/d5/d25/d2d/c45 0 2024-09-21T08:02:38.771 INFO:tasks.workunit.client.0.smithi107.stdout:9/185: dread d11/f18 [0,4194304] 0 2024-09-21T08:02:38.780 INFO:tasks.workunit.client.1.smithi129.stdout:5/974: rename d2/d1e/d35/d33/d36/cf5 to d2/d1e/d35/d33/db9/d10e/c133 0 2024-09-21T08:02:38.786 INFO:tasks.workunit.client.0.smithi107.stdout:3/118: unlink d8/c16 0 2024-09-21T08:02:38.786 INFO:tasks.workunit.client.0.smithi107.stdout:3/119: readlink d8/ld 0 2024-09-21T08:02:38.786 INFO:tasks.workunit.client.0.smithi107.stdout:3/120: write d8/d14/d1d/f1e [81465,33047] 0 2024-09-21T08:02:38.786 INFO:tasks.workunit.client.0.smithi107.stdout:3/121: write f2 [3864507,127136] 0 2024-09-21T08:02:38.787 INFO:tasks.workunit.client.0.smithi107.stdout:4/131: mknod dc/c27 0 2024-09-21T08:02:38.787 INFO:tasks.workunit.client.0.smithi107.stdout:5/146: creat d7/de/f32 x:0 0 0 2024-09-21T08:02:38.789 INFO:tasks.workunit.client.0.smithi107.stdout:9/186: unlink d11/f1c 0 2024-09-21T08:02:38.789 INFO:tasks.workunit.client.0.smithi107.stdout:9/187: write d11/f21 [864945,119224] 0 2024-09-21T08:02:38.789 INFO:tasks.workunit.client.1.smithi129.stdout:0/857: symlink de/d15/d39/d9e/l115 0 2024-09-21T08:02:38.790 INFO:tasks.workunit.client.0.smithi107.stdout:1/135: dwrite d0/f2 [4194304,4194304] 0 2024-09-21T08:02:38.791 INFO:tasks.workunit.client.1.smithi129.stdout:8/739: rmdir d0/d6/d7/d18/d61/d7f/dd2/dc0 0 2024-09-21T08:02:38.791 INFO:tasks.workunit.client.1.smithi129.stdout:8/740: dread - d0/d6/d7/d9/d94/fc6 zero size 2024-09-21T08:02:38.791 INFO:tasks.workunit.client.1.smithi129.stdout:3/994: dwrite d3/d90/fd3 [0,4194304] 0 2024-09-21T08:02:38.792 INFO:tasks.workunit.client.0.smithi107.stdout:3/122: mkdir d8/d21 0 2024-09-21T08:02:38.792 INFO:tasks.workunit.client.1.smithi129.stdout:1/969: dwrite d1/d7a/da4/f102 [0,4194304] 0 2024-09-21T08:02:38.792 INFO:tasks.workunit.client.1.smithi129.stdout:9/846: dwrite d17/d22/d33/d36/d48/f95 [0,4194304] 0 2024-09-21T08:02:38.793 INFO:tasks.workunit.client.1.smithi129.stdout:6/838: mkdir d7/d1b/d57/d119 0 2024-09-21T08:02:38.793 INFO:tasks.workunit.client.1.smithi129.stdout:6/839: write d7/d1b/d1e/d66/dc2/d93/dd5/de6/f116 [737882,57005] 0 2024-09-21T08:02:38.794 INFO:tasks.workunit.client.0.smithi107.stdout:4/132: link f6 dc/d13/f28 0 2024-09-21T08:02:38.795 INFO:tasks.workunit.client.0.smithi107.stdout:5/147: chown d7/de/c12 4 1 2024-09-21T08:02:38.797 INFO:tasks.workunit.client.1.smithi129.stdout:5/975: creat d2/d2a/f134 x:0 0 0 2024-09-21T08:02:38.799 INFO:tasks.workunit.client.0.smithi107.stdout:9/188: mkdir d11/d27/d39/d46 0 2024-09-21T08:02:38.801 INFO:tasks.workunit.client.1.smithi129.stdout:0/858: creat de/d1f/da9/f116 x:0 0 0 2024-09-21T08:02:38.802 INFO:tasks.workunit.client.1.smithi129.stdout:6/840: write d7/d1b/d1e/d66/dc2/fa5 [1553025,26304] 0 2024-09-21T08:02:38.804 INFO:tasks.workunit.client.0.smithi107.stdout:1/136: rename d0/d7/l1f to d0/d19/d2b/l2d 0 2024-09-21T08:02:38.805 INFO:tasks.workunit.client.1.smithi129.stdout:8/741: mkdir d0/d6/d7/d18/d27/d32/d3d/d7b/dbf/ddd 0 2024-09-21T08:02:38.805 INFO:tasks.workunit.client.1.smithi129.stdout:8/742: chown d0/d6/d7/d18/d27/d32/f91 2863 1 2024-09-21T08:02:38.809 INFO:tasks.workunit.client.0.smithi107.stdout:5/148: creat d7/de/d1d/d29/f33 x:0 0 0 2024-09-21T08:02:38.809 INFO:tasks.workunit.client.0.smithi107.stdout:5/149: creat d7/f34 x:0 0 0 2024-09-21T08:02:38.809 INFO:tasks.workunit.client.0.smithi107.stdout:5/150: chown d7/f2a 187 1 2024-09-21T08:02:38.811 INFO:tasks.workunit.client.1.smithi129.stdout:5/976: write d2/f60 [853687,50410] 0 2024-09-21T08:02:38.811 INFO:tasks.workunit.client.1.smithi129.stdout:5/977: read - d2/d1e/d35/d33/d36/de0/f127 zero size 2024-09-21T08:02:38.811 INFO:tasks.workunit.client.1.smithi129.stdout:5/978: readlink d2/d1e/d35/d33/dca/lf6 0 2024-09-21T08:02:38.811 INFO:tasks.workunit.client.1.smithi129.stdout:5/979: write d2/d1e/d35/d33/d36/d5a/f6a [946561,128757] 0 2024-09-21T08:02:38.812 INFO:tasks.workunit.client.0.smithi107.stdout:9/189: creat d11/d27/d39/f47 x:0 0 0 2024-09-21T08:02:38.814 INFO:tasks.workunit.client.1.smithi129.stdout:0/859: write de/d19/f4e [3280544,4068] 0 2024-09-21T08:02:38.814 INFO:tasks.workunit.client.1.smithi129.stdout:0/860: chown de/d15/d39/d56/f9d 37741 1 2024-09-21T08:02:38.814 INFO:tasks.workunit.client.1.smithi129.stdout:0/861: chown de/d22/d27/d85/db2/dc3/fce 92 1 2024-09-21T08:02:38.814 INFO:tasks.workunit.client.1.smithi129.stdout:0/862: chown de/d19/dd9 520 1 2024-09-21T08:02:38.815 INFO:tasks.workunit.client.0.smithi107.stdout:4/133: rename f6 to dc/f29 0 2024-09-21T08:02:38.815 INFO:tasks.workunit.client.1.smithi129.stdout:1/970: symlink d1/d4/dad/db6/l13e 0 2024-09-21T08:02:38.818 INFO:tasks.workunit.client.0.smithi107.stdout:0/205: dwrite d1/f12 [0,4194304] 0 2024-09-21T08:02:38.818 INFO:tasks.workunit.client.0.smithi107.stdout:0/206: rename d1 to d1/d5/d25/d3d/d20/d29/d46 22 2024-09-21T08:02:38.819 INFO:tasks.workunit.client.1.smithi129.stdout:3/995: dwrite d3/f13 [12582912,4194304] 0 2024-09-21T08:02:38.820 INFO:tasks.workunit.client.0.smithi107.stdout:0/207: dread d1/d5/d25/d3d/f33 [4194304,4194304] 0 2024-09-21T08:02:38.820 INFO:tasks.workunit.client.0.smithi107.stdout:4/134: dread dc/f12 [0,4194304] 0 2024-09-21T08:02:38.821 INFO:tasks.workunit.client.0.smithi107.stdout:3/123: truncate d8/f1b 847402 0 2024-09-21T08:02:38.825 INFO:tasks.workunit.client.1.smithi129.stdout:9/847: rename d17/d22/d33/d36/dd3/lfb to d17/l114 0 2024-09-21T08:02:38.827 INFO:tasks.workunit.client.1.smithi129.stdout:6/841: rmdir d7 39 2024-09-21T08:02:38.831 INFO:tasks.workunit.client.1.smithi129.stdout:8/743: mknod d0/d6/d7/d18/d61/cde 0 2024-09-21T08:02:38.831 INFO:tasks.workunit.client.1.smithi129.stdout:8/744: creat d0/d6/d7/d18/d61/fdf x:0 0 0 2024-09-21T08:02:38.832 INFO:tasks.workunit.client.0.smithi107.stdout:0/208: symlink d1/d23/l47 0 2024-09-21T08:02:38.832 INFO:tasks.workunit.client.0.smithi107.stdout:0/209: chown d1/d5/d25/d3d/d20 4027 1 2024-09-21T08:02:38.835 INFO:tasks.workunit.client.1.smithi129.stdout:5/980: creat d2/d1e/d35/d37/d96/de5/f135 x:0 0 0 2024-09-21T08:02:38.837 INFO:tasks.workunit.client.0.smithi107.stdout:3/124: link c3 d8/d14/c22 0 2024-09-21T08:02:38.839 INFO:tasks.workunit.client.1.smithi129.stdout:0/863: unlink de/d15/d44/da6/fb5 0 2024-09-21T08:02:38.841 INFO:tasks.workunit.client.0.smithi107.stdout:5/151: mkdir d7/de/d35 0 2024-09-21T08:02:38.842 INFO:tasks.workunit.client.0.smithi107.stdout:9/190: getdents d11/d27/d2a 0 2024-09-21T08:02:38.844 INFO:tasks.workunit.client.0.smithi107.stdout:0/210: truncate d1/d23/f2a 3647514 0 2024-09-21T08:02:38.845 INFO:tasks.workunit.client.1.smithi129.stdout:9/848: dread d17/d46/f8e [0,4194304] 0 2024-09-21T08:02:38.850 INFO:tasks.workunit.client.1.smithi129.stdout:5/981: getdents d2/d1e/d35/d37/d96/de5/db1/d71/da9 0 2024-09-21T08:02:38.850 INFO:tasks.workunit.client.0.smithi107.stdout:3/125: symlink d8/d21/l23 0 2024-09-21T08:02:38.851 INFO:tasks.workunit.client.0.smithi107.stdout:5/152: symlink d7/de/d1d/d24/l36 0 2024-09-21T08:02:38.851 INFO:tasks.workunit.client.0.smithi107.stdout:5/153: stat d7/f1f 0 2024-09-21T08:02:38.851 INFO:tasks.workunit.client.0.smithi107.stdout:5/154: write d7/ff [5367423,97628] 0 2024-09-21T08:02:38.853 INFO:tasks.workunit.client.0.smithi107.stdout:9/191: symlink d11/d27/d2f/d38/l48 0 2024-09-21T08:02:38.853 INFO:tasks.workunit.client.0.smithi107.stdout:9/192: dread - d11/d27/d2a/f41 zero size 2024-09-21T08:02:38.854 INFO:tasks.workunit.client.1.smithi129.stdout:0/864: write de/d15/f18 [7972482,69338] 0 2024-09-21T08:02:38.854 INFO:tasks.workunit.client.1.smithi129.stdout:8/745: mkdir d0/d6/d7/d18/de0 0 2024-09-21T08:02:38.854 INFO:tasks.workunit.client.1.smithi129.stdout:8/746: chown d0/d6/d7/d24/f36 10792302 1 2024-09-21T08:02:38.858 INFO:tasks.workunit.client.0.smithi107.stdout:9/193: creat d11/d24/d35/f49 x:0 0 0 2024-09-21T08:02:38.858 INFO:tasks.workunit.client.0.smithi107.stdout:9/194: chown d11/d27/d2a/l40 1334470909 1 2024-09-21T08:02:38.859 INFO:tasks.workunit.client.0.smithi107.stdout:9/195: chown d11/d27/d2a/f41 5 1 2024-09-21T08:02:38.859 INFO:tasks.workunit.client.0.smithi107.stdout:9/196: mkdir d11/d24/d4a 0 2024-09-21T08:02:38.860 INFO:tasks.workunit.client.0.smithi107.stdout:9/197: write d11/d27/d2f/f3b [556365,128055] 0 2024-09-21T08:02:38.861 INFO:tasks.workunit.client.0.smithi107.stdout:9/198: creat d11/d27/d2f/d3a/f4b x:0 0 0 2024-09-21T08:02:38.864 INFO:tasks.workunit.client.0.smithi107.stdout:0/211: dread d1/f8 [0,4194304] 0 2024-09-21T08:02:38.864 INFO:tasks.workunit.client.0.smithi107.stdout:0/212: truncate d1/fe 4514547 0 2024-09-21T08:02:38.870 INFO:tasks.workunit.client.0.smithi107.stdout:1/137: getdents d0/d19/d2b 0 2024-09-21T08:02:38.870 INFO:tasks.workunit.client.0.smithi107.stdout:1/138: readlink d0/d7/l17 0 2024-09-21T08:02:38.873 INFO:tasks.workunit.client.0.smithi107.stdout:1/139: creat d0/d29/d2c/f2e x:0 0 0 2024-09-21T08:02:38.875 INFO:tasks.workunit.client.1.smithi129.stdout:4/803: sync 2024-09-21T08:02:38.876 INFO:tasks.workunit.client.1.smithi129.stdout:4/804: fdatasync d5/d11/f4c 0 2024-09-21T08:02:38.876 INFO:tasks.workunit.client.1.smithi129.stdout:0/865: dread de/d22/d27/d85/db2/dc3/fce [0,4194304] 0 2024-09-21T08:02:38.876 INFO:tasks.workunit.client.1.smithi129.stdout:0/866: chown de/d22/d27/f2d 1 1 2024-09-21T08:02:38.877 INFO:tasks.workunit.client.0.smithi107.stdout:4/135: dwrite dc/d13/f18 [0,4194304] 0 2024-09-21T08:02:38.877 INFO:tasks.workunit.client.0.smithi107.stdout:4/136: creat dc/d13/f2a x:0 0 0 2024-09-21T08:02:38.878 INFO:tasks.workunit.client.1.smithi129.stdout:3/996: dwrite d3/da/dc/d11/d2f/f40 [0,4194304] 0 2024-09-21T08:02:38.878 INFO:tasks.workunit.client.1.smithi129.stdout:3/997: truncate d3/d69/d95/de1/df1/f13f 331989 0 2024-09-21T08:02:38.878 INFO:tasks.workunit.client.1.smithi129.stdout:1/971: dwrite d1/d9/f26 [0,4194304] 0 2024-09-21T08:02:38.878 INFO:tasks.workunit.client.1.smithi129.stdout:0/867: creat de/d1f/dd4/db1/df5/d113/f117 x:0 0 0 2024-09-21T08:02:38.881 INFO:tasks.workunit.client.1.smithi129.stdout:6/842: dwrite d7/d1b/d1e/d39/d4b/de8/d69/d89/fbe [0,4194304] 0 2024-09-21T08:02:38.881 INFO:tasks.workunit.client.1.smithi129.stdout:5/982: dwrite d2/d1e/d35/d37/d96/de5/db1/d71/f93 [0,4194304] 0 2024-09-21T08:02:38.885 INFO:tasks.workunit.client.1.smithi129.stdout:3/998: truncate d3/da/dc/d7f/dd6/de2/d120/da2/fee 1911921 0 2024-09-21T08:02:38.887 INFO:tasks.workunit.client.1.smithi129.stdout:4/805: dread d5/d11/d3f/d50/f51 [0,4194304] 0 2024-09-21T08:02:38.891 INFO:tasks.workunit.client.0.smithi107.stdout:5/155: getdents d7/de/d1d/d24 0 2024-09-21T08:02:38.893 INFO:tasks.workunit.client.1.smithi129.stdout:1/972: unlink d1/d4/dad/db6/f11d 0 2024-09-21T08:02:38.893 INFO:tasks.workunit.client.1.smithi129.stdout:1/973: write d1/d4/f9e [364260,48276] 0 2024-09-21T08:02:38.893 INFO:tasks.workunit.client.1.smithi129.stdout:1/974: chown d1/d9 12254691 1 2024-09-21T08:02:38.893 INFO:tasks.workunit.client.1.smithi129.stdout:1/975: write d1/d16/dd1/fe9 [761310,110831] 0 2024-09-21T08:02:38.894 INFO:tasks.workunit.client.0.smithi107.stdout:0/213: dwrite d1/d5/f27 [4194304,4194304] 0 2024-09-21T08:02:38.894 INFO:tasks.workunit.client.0.smithi107.stdout:0/214: chown d1 104068 1 2024-09-21T08:02:38.895 INFO:tasks.workunit.client.1.smithi129.stdout:8/747: dwrite d0/f2b [4194304,4194304] 0 2024-09-21T08:02:38.896 INFO:tasks.workunit.client.1.smithi129.stdout:0/868: unlink de/d15/f1c 0 2024-09-21T08:02:38.896 INFO:tasks.workunit.client.1.smithi129.stdout:3/999: dread d3/da/ff [0,4194304] 0 2024-09-21T08:02:38.896 INFO:tasks.workunit.client.0.smithi107.stdout:0/215: dread d1/d23/f26 [0,4194304] 0 2024-09-21T08:02:38.897 INFO:tasks.workunit.client.1.smithi129.stdout:8/748: dread d0/d6/d7/d5a/f8a [0,4194304] 0 2024-09-21T08:02:38.903 INFO:tasks.workunit.client.0.smithi107.stdout:9/199: truncate d11/d27/d2a/f2c 1119754 0 2024-09-21T08:02:38.905 INFO:tasks.workunit.client.0.smithi107.stdout:0/216: creat d1/d5/f48 x:0 0 0 2024-09-21T08:02:38.905 INFO:tasks.workunit.client.0.smithi107.stdout:0/217: write d1/f8 [1220397,120184] 0 2024-09-21T08:02:38.910 INFO:tasks.workunit.client.1.smithi129.stdout:6/843: rename d7/d1b/d1e/d39/d4b/de8/d69/lf7 to d7/d1b/d1e/d39/dbf/l11a 0 2024-09-21T08:02:38.910 INFO:tasks.workunit.client.1.smithi129.stdout:6/844: dread - d7/f9a zero size 2024-09-21T08:02:38.910 INFO:tasks.workunit.client.1.smithi129.stdout:6/845: fsync d7/d1b/d1e/d66/d7c/ff9 0 2024-09-21T08:02:38.910 INFO:tasks.workunit.client.1.smithi129.stdout:6/846: write d7/d1b/f49 [3536456,111216] 0 2024-09-21T08:02:38.910 INFO:tasks.workunit.client.1.smithi129.stdout:6/847: dread - d7/f9a zero size 2024-09-21T08:02:38.910 INFO:tasks.workunit.client.1.smithi129.stdout:6/848: read - d7/d1b/d1e/d66/dc2/d5e/fe9 zero size 2024-09-21T08:02:38.910 INFO:tasks.workunit.client.1.smithi129.stdout:6/849: readlink d7/d1b/d57/d96/lb2 0 2024-09-21T08:02:38.910 INFO:tasks.workunit.client.1.smithi129.stdout:4/806: symlink d5/d16/d24/l119 0 2024-09-21T08:02:38.912 INFO:tasks.workunit.client.1.smithi129.stdout:8/749: dwrite d0/d6/d7/d18/d27/f2d [4194304,4194304] 0 2024-09-21T08:02:38.912 INFO:tasks.workunit.client.1.smithi129.stdout:6/850: dread d7/d10/fa8 [0,4194304] 0 2024-09-21T08:02:38.912 INFO:tasks.workunit.client.0.smithi107.stdout:5/156: rmdir d7/de/d1d 39 2024-09-21T08:02:38.912 INFO:tasks.workunit.client.0.smithi107.stdout:5/157: dread - d7/f34 zero size 2024-09-21T08:02:38.912 INFO:tasks.workunit.client.0.smithi107.stdout:5/158: fdatasync d7/de/f30 0 2024-09-21T08:02:38.912 INFO:tasks.workunit.client.0.smithi107.stdout:4/137: getdents dc/d13 0 2024-09-21T08:02:38.912 INFO:tasks.workunit.client.0.smithi107.stdout:4/138: read - dc/d13/f26 zero size 2024-09-21T08:02:38.912 INFO:tasks.workunit.client.0.smithi107.stdout:4/139: dread - dc/f1e zero size 2024-09-21T08:02:38.914 INFO:tasks.workunit.client.0.smithi107.stdout:9/200: symlink d11/d27/l4c 0 2024-09-21T08:02:38.916 INFO:tasks.workunit.client.1.smithi129.stdout:1/976: unlink d1/d4/dc2/dc6/cb1 0 2024-09-21T08:02:38.918 INFO:tasks.workunit.client.1.smithi129.stdout:0/869: mknod de/d22/d27/d10a/d42/d102/c118 0 2024-09-21T08:02:38.918 INFO:tasks.workunit.client.0.smithi107.stdout:0/218: rename d1/d5/d25/d2d/l37 to d1/d5/d25/l49 0 2024-09-21T08:02:38.921 INFO:tasks.workunit.client.1.smithi129.stdout:5/983: rename d2/d1e/d6b/d10a to d2/d1e/d35/d37/d96/de5/d61/d102/d136 0 2024-09-21T08:02:38.921 INFO:tasks.workunit.client.1.smithi129.stdout:5/984: chown d2/d1e/d35/d37/d7d/ccb 2128764348 1 2024-09-21T08:02:38.922 INFO:tasks.workunit.client.0.smithi107.stdout:5/159: readlink d7/de/l22 0 2024-09-21T08:02:38.924 INFO:tasks.workunit.client.1.smithi129.stdout:6/851: write d7/d1b/d1e/d66/dc2/de2/d40/d41/f5d [3043651,55407] 0 2024-09-21T08:02:38.924 INFO:tasks.workunit.client.1.smithi129.stdout:6/852: write d7/d1b/d1e/d39/f107 [502525,98718] 0 2024-09-21T08:02:38.926 INFO:tasks.workunit.client.0.smithi107.stdout:4/140: truncate f7 1565796 0 2024-09-21T08:02:38.926 INFO:tasks.workunit.client.1.smithi129.stdout:0/870: creat de/d19/f119 x:0 0 0 2024-09-21T08:02:38.927 INFO:tasks.workunit.client.1.smithi129.stdout:0/871: chown de/d22/d27/d10a/ff7 1 1 2024-09-21T08:02:38.927 INFO:tasks.workunit.client.0.smithi107.stdout:9/201: mkdir d11/d27/d2f/d4d 0 2024-09-21T08:02:38.927 INFO:tasks.workunit.client.0.smithi107.stdout:9/202: write d11/d24/d35/f49 [52842,130581] 0 2024-09-21T08:02:38.928 INFO:tasks.workunit.client.0.smithi107.stdout:9/203: fdatasync d11/d24/d26/f2e 0 2024-09-21T08:02:38.928 INFO:tasks.workunit.client.0.smithi107.stdout:9/204: creat d11/d24/d35/f4e x:0 0 0 2024-09-21T08:02:38.928 INFO:tasks.workunit.client.0.smithi107.stdout:0/219: dread d1/f12 [0,4194304] 0 2024-09-21T08:02:38.929 INFO:tasks.workunit.client.0.smithi107.stdout:5/160: creat d7/de/d1d/f37 x:0 0 0 2024-09-21T08:02:38.929 INFO:tasks.workunit.client.0.smithi107.stdout:5/161: chown d7/de/d1d/f28 232031 1 2024-09-21T08:02:38.930 INFO:tasks.workunit.client.1.smithi129.stdout:1/977: dwrite d1/d16/d25/f61 [0,4194304] 0 2024-09-21T08:02:38.930 INFO:tasks.workunit.client.1.smithi129.stdout:1/978: truncate d1/f12 4392413 0 2024-09-21T08:02:38.930 INFO:tasks.workunit.client.1.smithi129.stdout:1/979: read - d1/d9/d31/f6f zero size 2024-09-21T08:02:38.930 INFO:tasks.workunit.client.1.smithi129.stdout:4/807: rename d5/d33/d4e/ce5 to d5/df4/c11a 0 2024-09-21T08:02:38.931 INFO:tasks.workunit.client.0.smithi107.stdout:4/141: truncate f8 1542996 0 2024-09-21T08:02:38.935 INFO:tasks.workunit.client.0.smithi107.stdout:9/205: mknod d11/d24/d35/c4f 0 2024-09-21T08:02:38.935 INFO:tasks.workunit.client.0.smithi107.stdout:9/206: fsync f7 0 2024-09-21T08:02:38.936 INFO:tasks.workunit.client.1.smithi129.stdout:6/853: symlink d7/d1b/d1e/d39/dbf/l11b 0 2024-09-21T08:02:38.937 INFO:tasks.workunit.client.0.smithi107.stdout:0/220: truncate d1/fe 3273479 0 2024-09-21T08:02:38.941 INFO:tasks.workunit.client.0.smithi107.stdout:5/162: mknod d7/c38 0 2024-09-21T08:02:38.941 INFO:tasks.workunit.client.0.smithi107.stdout:5/163: read - d7/f21 zero size 2024-09-21T08:02:38.941 INFO:tasks.workunit.client.0.smithi107.stdout:5/164: creat d7/f39 x:0 0 0 2024-09-21T08:02:38.944 INFO:tasks.workunit.client.0.smithi107.stdout:9/207: creat d11/d27/d39/d46/f50 x:0 0 0 2024-09-21T08:02:38.948 INFO:tasks.workunit.client.0.smithi107.stdout:0/221: dread d1/d23/f3f [0,4194304] 0 2024-09-21T08:02:38.951 INFO:tasks.workunit.client.0.smithi107.stdout:0/222: creat d1/d5/d25/d3d/f4a x:0 0 0 2024-09-21T08:02:38.953 INFO:tasks.workunit.client.1.smithi129.stdout:4/808: creat d5/d11/dfe/f11b x:0 0 0 2024-09-21T08:02:38.953 INFO:tasks.workunit.client.1.smithi129.stdout:5/985: getdents d2/d1e/d35/d33/d36/de0 0 2024-09-21T08:02:38.954 INFO:tasks.workunit.client.1.smithi129.stdout:5/986: readlink d2/d1e/d35/d33/da1/lc3 0 2024-09-21T08:02:38.955 INFO:tasks.workunit.client.0.smithi107.stdout:0/223: mknod d1/d23/c4b 0 2024-09-21T08:02:38.955 INFO:tasks.workunit.client.0.smithi107.stdout:0/224: fdatasync d1/d5/d25/f40 0 2024-09-21T08:02:38.955 INFO:tasks.workunit.client.0.smithi107.stdout:0/225: fdatasync d1/d5/d25/d3d/d20/d29/f44 0 2024-09-21T08:02:38.958 INFO:tasks.workunit.client.1.smithi129.stdout:6/854: unlink d7/f82 0 2024-09-21T08:02:38.959 INFO:tasks.workunit.client.0.smithi107.stdout:5/165: dwrite d7/de/f32 [0,4194304] 0 2024-09-21T08:02:38.961 INFO:tasks.workunit.client.1.smithi129.stdout:4/809: creat d5/d11/d3f/d50/f11c x:0 0 0 2024-09-21T08:02:38.962 INFO:tasks.workunit.client.0.smithi107.stdout:0/226: dread d1/d5/f24 [0,4194304] 0 2024-09-21T08:02:38.962 INFO:tasks.workunit.client.0.smithi107.stdout:0/227: creat d1/f4c x:0 0 0 2024-09-21T08:02:38.965 INFO:tasks.workunit.client.1.smithi129.stdout:6/855: getdents d7/d1b/d1e/d66/dc2/de2/d40/d41 0 2024-09-21T08:02:38.965 INFO:tasks.workunit.client.0.smithi107.stdout:7/112: sync 2024-09-21T08:02:38.966 INFO:tasks.workunit.client.1.smithi129.stdout:4/810: creat d5/d33/d6d/f11d x:0 0 0 2024-09-21T08:02:38.967 INFO:tasks.workunit.client.0.smithi107.stdout:5/166: mknod d7/de/d35/c3a 0 2024-09-21T08:02:38.967 INFO:tasks.workunit.client.0.smithi107.stdout:5/167: truncate d7/de/d1d/d29/f33 127847 0 2024-09-21T08:02:38.967 INFO:tasks.workunit.client.0.smithi107.stdout:5/168: readlink d7/de/d1d/d24/l36 0 2024-09-21T08:02:38.969 INFO:tasks.workunit.client.1.smithi129.stdout:4/811: unlink d5/d16/d24/d3b/f3e 0 2024-09-21T08:02:38.969 INFO:tasks.workunit.client.1.smithi129.stdout:4/812: fsync d5/d6/f7 0 2024-09-21T08:02:38.970 INFO:tasks.workunit.client.0.smithi107.stdout:0/228: rename d1/f12 to d1/d5/d25/f4d 0 2024-09-21T08:02:38.970 INFO:tasks.workunit.client.0.smithi107.stdout:0/229: creat d1/d5/d25/f4e x:0 0 0 2024-09-21T08:02:38.970 INFO:tasks.workunit.client.0.smithi107.stdout:0/230: truncate d1/d5/d25/f4e 624007 0 2024-09-21T08:02:38.970 INFO:tasks.workunit.client.0.smithi107.stdout:7/113: symlink d7/d22/l2a 0 2024-09-21T08:02:38.971 INFO:tasks.workunit.client.1.smithi129.stdout:4/813: unlink d5/d16/d47/d5f/lbe 0 2024-09-21T08:02:38.972 INFO:tasks.workunit.client.0.smithi107.stdout:5/169: symlink d7/de/d1d/l3b 0 2024-09-21T08:02:38.972 INFO:tasks.workunit.client.0.smithi107.stdout:5/170: chown c5 1987606 1 2024-09-21T08:02:38.972 INFO:tasks.workunit.client.0.smithi107.stdout:5/171: write d7/de/f1a [2418969,5386] 0 2024-09-21T08:02:38.974 INFO:tasks.workunit.client.1.smithi129.stdout:4/814: rename d5/d11/c40 to d5/d33/d4e/da7/c11e 0 2024-09-21T08:02:38.975 INFO:tasks.workunit.client.0.smithi107.stdout:5/172: creat d7/de/d1d/d29/f3c x:0 0 0 2024-09-21T08:02:38.975 INFO:tasks.workunit.client.1.smithi129.stdout:4/815: link d5/d16/d24/d4f/f54 d5/d16/d24/f11f 0 2024-09-21T08:02:38.977 INFO:tasks.workunit.client.0.smithi107.stdout:5/173: mkdir d7/de/d1d/d24/d3d 0 2024-09-21T08:02:38.977 INFO:tasks.workunit.client.0.smithi107.stdout:5/174: fdatasync d7/f8 0 2024-09-21T08:02:38.977 INFO:tasks.workunit.client.0.smithi107.stdout:5/175: write d7/de/d1d/d29/f33 [307736,36050] 0 2024-09-21T08:02:38.977 INFO:tasks.workunit.client.0.smithi107.stdout:5/176: write d7/de/f19 [1117869,27483] 0 2024-09-21T08:02:38.977 INFO:tasks.workunit.client.1.smithi129.stdout:4/816: mknod d5/d33/d6d/c120 0 2024-09-21T08:02:38.978 INFO:tasks.workunit.client.1.smithi129.stdout:4/817: write d5/d16/d24/d4f/da1/fa3 [549784,91869] 0 2024-09-21T08:02:38.978 INFO:tasks.workunit.client.1.smithi129.stdout:4/818: readlink d5/d16/d24/d4f/da1/ld1 0 2024-09-21T08:02:38.986 INFO:tasks.workunit.client.0.smithi107.stdout:5/177: mknod d7/de/c3e 0 2024-09-21T08:02:38.989 INFO:tasks.workunit.client.1.smithi129.stdout:4/819: dread d5/f14 [4194304,4194304] 0 2024-09-21T08:02:38.989 INFO:tasks.workunit.client.1.smithi129.stdout:4/820: fdatasync d5/d33/fc4 0 2024-09-21T08:02:38.991 INFO:tasks.workunit.client.1.smithi129.stdout:4/821: mkdir d5/d11/d77/da8/dbc/d121 0 2024-09-21T08:02:38.991 INFO:tasks.workunit.client.1.smithi129.stdout:4/822: fsync d5/d16/d47/f99 0 2024-09-21T08:02:38.991 INFO:tasks.workunit.client.1.smithi129.stdout:4/823: fdatasync d5/d33/fc4 0 2024-09-21T08:02:38.991 INFO:tasks.workunit.client.1.smithi129.stdout:4/824: creat d5/d16/d24/d4f/f122 x:0 0 0 2024-09-21T08:02:38.997 INFO:tasks.workunit.client.0.smithi107.stdout:4/142: dwrite dc/f29 [0,4194304] 0 2024-09-21T08:02:38.997 INFO:tasks.workunit.client.0.smithi107.stdout:4/143: write dc/f25 [735073,92292] 0 2024-09-21T08:02:38.998 INFO:tasks.workunit.client.0.smithi107.stdout:4/144: link dc/d13/l20 dc/d13/l2b 0 2024-09-21T08:02:39.005 INFO:tasks.workunit.client.1.smithi129.stdout:6/856: dwrite d7/d1b/d1e/fe3 [0,4194304] 0 2024-09-21T08:02:39.005 INFO:tasks.workunit.client.1.smithi129.stdout:5/987: dwrite d2/d1e/d35/d33/db9/fd2 [0,4194304] 0 2024-09-21T08:02:39.005 INFO:tasks.workunit.client.1.smithi129.stdout:6/857: write d7/f9 [1064482,76186] 0 2024-09-21T08:02:39.005 INFO:tasks.workunit.client.1.smithi129.stdout:5/988: creat d2/d2a/f137 x:0 0 0 2024-09-21T08:02:39.006 INFO:tasks.workunit.client.1.smithi129.stdout:5/989: truncate d2/d1e/d35/d37/f73 455695 0 2024-09-21T08:02:39.006 INFO:tasks.workunit.client.0.smithi107.stdout:7/114: dwrite d7/f8 [0,4194304] 0 2024-09-21T08:02:39.007 INFO:tasks.workunit.client.0.smithi107.stdout:5/178: dwrite d7/f34 [0,4194304] 0 2024-09-21T08:02:39.010 INFO:tasks.workunit.client.0.smithi107.stdout:0/231: write d1/fe [1982210,118195] 0 2024-09-21T08:02:39.018 INFO:tasks.workunit.client.0.smithi107.stdout:7/115: getdents d7/d22 0 2024-09-21T08:02:39.018 INFO:tasks.workunit.client.0.smithi107.stdout:7/116: chown d7/f13 231 1 2024-09-21T08:02:39.018 INFO:tasks.workunit.client.0.smithi107.stdout:7/117: write d7/f8 [9266422,115456] 0 2024-09-21T08:02:39.019 INFO:tasks.workunit.client.0.smithi107.stdout:7/118: write d7/d18/f29 [129928,6587] 0 2024-09-21T08:02:39.019 INFO:tasks.workunit.client.0.smithi107.stdout:7/119: fdatasync d7/d22/f24 0 2024-09-21T08:02:39.019 INFO:tasks.workunit.client.0.smithi107.stdout:5/179: write d7/f8 [1749594,81503] 0 2024-09-21T08:02:39.019 INFO:tasks.workunit.client.0.smithi107.stdout:5/180: chown d7/de/l22 1616991079 1 2024-09-21T08:02:39.020 INFO:tasks.workunit.client.0.smithi107.stdout:5/181: chown d7/de/d1d/d29/f3c 2611728 1 2024-09-21T08:02:39.020 INFO:tasks.workunit.client.0.smithi107.stdout:7/120: symlink d7/d18/l2b 0 2024-09-21T08:02:39.022 INFO:tasks.workunit.client.1.smithi129.stdout:5/990: creat d2/d1e/d35/d37/d96/f138 x:0 0 0 2024-09-21T08:02:39.024 INFO:tasks.workunit.client.0.smithi107.stdout:5/182: link d7/de/c12 d7/de/d1d/c3f 0 2024-09-21T08:02:39.025 INFO:tasks.workunit.client.1.smithi129.stdout:6/858: dwrite d7/f53 [0,4194304] 0 2024-09-21T08:02:39.025 INFO:tasks.workunit.client.0.smithi107.stdout:7/121: mknod d7/d22/c2c 0 2024-09-21T08:02:39.027 INFO:tasks.workunit.client.1.smithi129.stdout:6/859: write d7/d1b/d1e/d39/d79/f85 [769562,71887] 0 2024-09-21T08:02:39.028 INFO:tasks.workunit.client.0.smithi107.stdout:7/122: creat d7/d22/f2d x:0 0 0 2024-09-21T08:02:39.030 INFO:tasks.workunit.client.1.smithi129.stdout:6/860: truncate d7/d1b/d1e/d39/d4b/f1d 5563213 0 2024-09-21T08:02:39.030 INFO:tasks.workunit.client.1.smithi129.stdout:6/861: readlink d7/d1b/d1e/d39/leb 0 2024-09-21T08:02:39.032 INFO:tasks.workunit.client.1.smithi129.stdout:4/825: rename d5/d11/d77 to d5/d33/d4e/da7/d123 0 2024-09-21T08:02:39.032 INFO:tasks.workunit.client.1.smithi129.stdout:4/826: readlink d5/d16/d24/lcc 0 2024-09-21T08:02:39.033 INFO:tasks.workunit.client.1.smithi129.stdout:4/827: link d5/d33/d6d/fd6 d5/d16/d47/d5f/d64/f124 0 2024-09-21T08:02:39.040 INFO:tasks.workunit.client.0.smithi107.stdout:0/232: dwrite d1/d23/f26 [0,4194304] 0 2024-09-21T08:02:39.040 INFO:tasks.workunit.client.1.smithi129.stdout:6/862: dread d7/d1b/d1e/d39/d79/ded/ff3 [0,4194304] 0 2024-09-21T08:02:39.040 INFO:tasks.workunit.client.1.smithi129.stdout:6/863: chown d7/d1b/d1e/d39/d4b/de8/ff5 9735 1 2024-09-21T08:02:39.041 INFO:tasks.workunit.client.1.smithi129.stdout:5/991: dwrite d2/d1e/d35/d33/f34 [8388608,4194304] 0 2024-09-21T08:02:39.043 INFO:tasks.workunit.client.0.smithi107.stdout:7/123: write d7/fd [2456792,105694] 0 2024-09-21T08:02:39.051 INFO:tasks.workunit.client.1.smithi129.stdout:5/992: creat d2/d1e/d35/d33/d36/f139 x:0 0 0 2024-09-21T08:02:39.051 INFO:tasks.workunit.client.1.smithi129.stdout:5/993: chown d2/d1e/d35/d33/d36/c52 1996 1 2024-09-21T08:02:39.051 INFO:tasks.workunit.client.1.smithi129.stdout:6/864: dread d7/d1b/d1e/f99 [0,4194304] 0 2024-09-21T08:02:39.052 INFO:tasks.workunit.client.0.smithi107.stdout:7/124: symlink d7/l2e 0 2024-09-21T08:02:39.052 INFO:tasks.workunit.client.1.smithi129.stdout:4/828: dread d5/d16/d24/fa0 [0,4194304] 0 2024-09-21T08:02:39.053 INFO:tasks.workunit.client.1.smithi129.stdout:5/994: creat d2/d1e/d35/d33/db9/d10e/f13a x:0 0 0 2024-09-21T08:02:39.053 INFO:tasks.workunit.client.1.smithi129.stdout:5/995: write d2/d1e/d35/d33/db9/d10e/f13a [577043,54075] 0 2024-09-21T08:02:39.054 INFO:tasks.workunit.client.1.smithi129.stdout:8/750: sync 2024-09-21T08:02:39.054 INFO:tasks.workunit.client.1.smithi129.stdout:9/849: sync 2024-09-21T08:02:39.054 INFO:tasks.workunit.client.1.smithi129.stdout:6/865: rename d7/d1b/d1e/d66/dc2/de2/d40/d78 to d7/d1b/d1e/d66/dc2/d93/dd5/d11c 0 2024-09-21T08:02:39.055 INFO:tasks.workunit.client.1.smithi129.stdout:8/751: truncate d0/d6/d7/d9/f7d 605322 0 2024-09-21T08:02:39.057 INFO:tasks.workunit.client.1.smithi129.stdout:9/850: mknod d17/d22/d33/d7a/d89/d90/db1/d31/d5e/df9/c115 0 2024-09-21T08:02:39.059 INFO:tasks.workunit.client.1.smithi129.stdout:5/996: rename d2/c92 to d2/d1e/d35/d37/d96/de5/db1/de7/c13b 0 2024-09-21T08:02:39.060 INFO:tasks.workunit.client.1.smithi129.stdout:6/866: unlink d7/d1b/d1e/d39/d79/db8/c9f 0 2024-09-21T08:02:39.060 INFO:tasks.workunit.client.1.smithi129.stdout:6/867: stat d7/d1b/d57/dd6/cd7 0 2024-09-21T08:02:39.060 INFO:tasks.workunit.client.1.smithi129.stdout:0/872: sync 2024-09-21T08:02:39.060 INFO:tasks.workunit.client.1.smithi129.stdout:1/980: sync 2024-09-21T08:02:39.060 INFO:tasks.workunit.client.1.smithi129.stdout:0/873: fdatasync de/d15/d44/d4b/f7a 0 2024-09-21T08:02:39.060 INFO:tasks.workunit.client.0.smithi107.stdout:0/233: dwrite d1/f1c [0,4194304] 0 2024-09-21T08:02:39.061 INFO:tasks.workunit.client.1.smithi129.stdout:9/851: link d17/d22/d33/d7a/d89/d90/db1/d31/d35/fbb d17/d22/d33/d7a/d89/f116 0 2024-09-21T08:02:39.062 INFO:tasks.workunit.client.1.smithi129.stdout:9/852: truncate d17/d22/d33/d36/d48/d75/fa8 4559943 0 2024-09-21T08:02:39.064 INFO:tasks.workunit.client.1.smithi129.stdout:6/868: mknod d7/d1b/d1e/d66/dba/d2b/c11d 0 2024-09-21T08:02:39.068 INFO:tasks.workunit.client.1.smithi129.stdout:9/853: mknod d17/d22/d33/d36/d48/d75/c117 0 2024-09-21T08:02:39.070 INFO:tasks.workunit.client.1.smithi129.stdout:9/854: mknod d17/c118 0 2024-09-21T08:02:39.072 INFO:tasks.workunit.client.1.smithi129.stdout:9/855: mknod d17/d22/d33/d36/de8/c119 0 2024-09-21T08:02:39.072 INFO:tasks.workunit.client.1.smithi129.stdout:5/997: read d2/d1e/d35/d33/d36/d5a/f70 [3368790,56013] 0 2024-09-21T08:02:39.073 INFO:tasks.workunit.client.1.smithi129.stdout:9/856: symlink d17/d23/l11a 0 2024-09-21T08:02:39.076 INFO:tasks.workunit.client.1.smithi129.stdout:5/998: rmdir d2/d1e/d6b 39 2024-09-21T08:02:39.077 INFO:tasks.workunit.client.1.smithi129.stdout:5/999: mknod d2/d1e/d35/d37/d65/dc5/dfd/c13c 0 2024-09-21T08:02:39.079 INFO:tasks.workunit.client.1.smithi129.stdout:1/981: write d1/f8e [2408129,126966] 0 2024-09-21T08:02:39.080 INFO:tasks.workunit.client.1.smithi129.stdout:1/982: chown d1/c24 221851919 1 2024-09-21T08:02:39.082 INFO:tasks.workunit.client.1.smithi129.stdout:1/983: creat d1/d16/f13f x:0 0 0 2024-09-21T08:02:39.083 INFO:tasks.workunit.client.1.smithi129.stdout:4/829: dwrite d5/d11/f57 [0,4194304] 0 2024-09-21T08:02:39.084 INFO:tasks.workunit.client.1.smithi129.stdout:1/984: rename d1/d16/d25/f135 to d1/d9/d31/f140 0 2024-09-21T08:02:39.084 INFO:tasks.workunit.client.1.smithi129.stdout:1/985: stat d1/d4/d96/lf4 0 2024-09-21T08:02:39.084 INFO:tasks.workunit.client.1.smithi129.stdout:1/986: stat d1/d4/f108 0 2024-09-21T08:02:39.085 INFO:tasks.workunit.client.1.smithi129.stdout:4/830: rmdir d5/d11 39 2024-09-21T08:02:39.087 INFO:tasks.workunit.client.1.smithi129.stdout:1/987: link d1/d4/d6e/da9/cd5 d1/d44/db9/c141 0 2024-09-21T08:02:39.087 INFO:tasks.workunit.client.1.smithi129.stdout:1/988: chown d1/d4/dc2 4 1 2024-09-21T08:02:39.090 INFO:tasks.workunit.client.0.smithi107.stdout:0/234: dwrite d1/d5/d25/d3d/f33 [0,4194304] 0 2024-09-21T08:02:39.092 INFO:tasks.workunit.client.1.smithi129.stdout:4/831: link d5/da5/cf7 d5/d16/c125 0 2024-09-21T08:02:39.092 INFO:tasks.workunit.client.1.smithi129.stdout:0/874: dwrite de/d1f/da9/f98 [0,4194304] 0 2024-09-21T08:02:39.092 INFO:tasks.workunit.client.1.smithi129.stdout:6/869: dwrite d7/d1b/d1e/d39/dbf/f102 [0,4194304] 0 2024-09-21T08:02:39.092 INFO:tasks.workunit.client.1.smithi129.stdout:0/875: chown de/d15/d44/d4b 15431494 1 2024-09-21T08:02:39.095 INFO:tasks.workunit.client.1.smithi129.stdout:4/832: rename d5/d16/d47/fab to d5/d16/d85/f126 0 2024-09-21T08:02:39.096 INFO:tasks.workunit.client.1.smithi129.stdout:0/876: mkdir de/d22/d11a 0 2024-09-21T08:02:39.096 INFO:tasks.workunit.client.1.smithi129.stdout:0/877: chown l4 63 1 2024-09-21T08:02:39.097 INFO:tasks.workunit.client.1.smithi129.stdout:6/870: creat d7/d1b/d8d/f11e x:0 0 0 2024-09-21T08:02:39.097 INFO:tasks.workunit.client.1.smithi129.stdout:6/871: chown d7/d1b/f10d 64281825 1 2024-09-21T08:02:39.097 INFO:tasks.workunit.client.1.smithi129.stdout:4/833: symlink d5/da5/l127 0 2024-09-21T08:02:39.097 INFO:tasks.workunit.client.1.smithi129.stdout:4/834: read - d5/d16/d24/d4f/f122 zero size 2024-09-21T08:02:39.098 INFO:tasks.workunit.client.1.smithi129.stdout:4/835: stat d5/d16/d24/d4f/f72 0 2024-09-21T08:02:39.098 INFO:tasks.workunit.client.1.smithi129.stdout:6/872: mkdir d7/d1b/d1e/d39/d111/d11f 0 2024-09-21T08:02:39.098 INFO:tasks.workunit.client.1.smithi129.stdout:6/873: stat d7/d1b/d57/dd6/fde 0 2024-09-21T08:02:39.099 INFO:tasks.workunit.client.1.smithi129.stdout:4/836: mkdir d5/d33/d4e/d128 0 2024-09-21T08:02:39.099 INFO:tasks.workunit.client.1.smithi129.stdout:6/874: symlink d7/d1b/d1e/d66/dba/d2b/l120 0 2024-09-21T08:02:39.100 INFO:tasks.workunit.client.1.smithi129.stdout:4/837: link d5/da5/fb3 d5/dbd/f129 0 2024-09-21T08:02:39.100 INFO:tasks.workunit.client.1.smithi129.stdout:4/838: getdents d5/da5/d109 0 2024-09-21T08:02:39.101 INFO:tasks.workunit.client.1.smithi129.stdout:6/875: truncate d7/f37 2535144 0 2024-09-21T08:02:39.101 INFO:tasks.workunit.client.0.smithi107.stdout:8/74: sync 2024-09-21T08:02:39.103 INFO:tasks.workunit.client.1.smithi129.stdout:4/839: creat d5/d33/d4e/da7/d123/da8/dbc/d121/f12a x:0 0 0 2024-09-21T08:02:39.103 INFO:tasks.workunit.client.1.smithi129.stdout:4/840: write d5/d16/fd3 [5174495,61640] 0 2024-09-21T08:02:39.103 INFO:tasks.workunit.client.1.smithi129.stdout:6/876: symlink d7/d1b/d1e/d39/d79/db8/l121 0 2024-09-21T08:02:39.104 INFO:tasks.workunit.client.0.smithi107.stdout:8/75: rename d5/f13 to d5/f21 0 2024-09-21T08:02:39.105 INFO:tasks.workunit.client.0.smithi107.stdout:0/235: dread d1/d23/f2a [0,4194304] 0 2024-09-21T08:02:39.106 INFO:tasks.workunit.client.1.smithi129.stdout:4/841: truncate d5/f14 616294 0 2024-09-21T08:02:39.106 INFO:tasks.workunit.client.0.smithi107.stdout:0/236: link d1/l31 d1/d5/d25/d3d/d20/d29/l4f 0 2024-09-21T08:02:39.118 INFO:tasks.workunit.client.0.smithi107.stdout:8/76: dread d5/f12 [0,4194304] 0 2024-09-21T08:02:39.125 INFO:tasks.workunit.client.1.smithi129.stdout:9/857: dwrite d17/d22/d33/d36/d48/db7/fe2 [0,4194304] 0 2024-09-21T08:02:39.125 INFO:tasks.workunit.client.1.smithi129.stdout:9/858: chown d17/d22/d33 26 1 2024-09-21T08:02:39.126 INFO:tasks.workunit.client.1.smithi129.stdout:1/989: dwrite d1/d16/f101 [0,4194304] 0 2024-09-21T08:02:39.126 INFO:tasks.workunit.client.1.smithi129.stdout:1/990: chown d1/d4/dc2/lf5 30980784 1 2024-09-21T08:02:39.126 INFO:tasks.workunit.client.1.smithi129.stdout:1/991: fsync d1/d16/d57/fa1 0 2024-09-21T08:02:39.126 INFO:tasks.workunit.client.1.smithi129.stdout:0/878: dwrite de/d22/d27/f2d [0,4194304] 0 2024-09-21T08:02:39.126 INFO:tasks.workunit.client.1.smithi129.stdout:6/877: dwrite d7/d1b/d1e/d66/dc2/de2/f6b [0,4194304] 0 2024-09-21T08:02:39.136 INFO:tasks.workunit.client.1.smithi129.stdout:1/992: write d1/d9/f3d [4329907,51122] 0 2024-09-21T08:02:39.136 INFO:tasks.workunit.client.1.smithi129.stdout:1/993: dread - d1/d9/d6b/f126 zero size 2024-09-21T08:02:39.136 INFO:tasks.workunit.client.1.smithi129.stdout:1/994: read d1/d4/f6d [2286109,63672] 0 2024-09-21T08:02:39.142 INFO:tasks.workunit.client.1.smithi129.stdout:6/878: dwrite d7/d1b/d1e/d66/dc2/de2/d40/f10e [0,4194304] 0 2024-09-21T08:02:39.142 INFO:tasks.workunit.client.1.smithi129.stdout:6/879: truncate d7/d1b/d1e/d39/d4b/d6e/de5/fef 228036 0 2024-09-21T08:02:39.149 INFO:tasks.workunit.client.1.smithi129.stdout:6/880: dread d7/d1b/d1e/d39/d4b/de8/fac [0,4194304] 0 2024-09-21T08:02:39.208 INFO:tasks.workunit.client.1.smithi129.stdout:4/842: unlink d5/d33/d6d/l108 0 2024-09-21T08:02:39.208 INFO:tasks.workunit.client.1.smithi129.stdout:4/843: fsync d5/d33/d4e/da7/d123/da8/f10c 0 2024-09-21T08:02:39.208 INFO:tasks.workunit.client.1.smithi129.stdout:4/844: chown d5/d16/d24/d3b/l107 7 1 2024-09-21T08:02:39.208 INFO:tasks.workunit.client.1.smithi129.stdout:4/845: chown d5/d16/d24/d4f/da1/fef 1 1 2024-09-21T08:02:39.208 INFO:tasks.workunit.client.1.smithi129.stdout:4/846: fsync d5/f2b 0 2024-09-21T08:02:39.210 INFO:tasks.workunit.client.0.smithi107.stdout:0/237: link d1/d5/f27 d1/d5/d25/f50 0 2024-09-21T08:02:39.211 INFO:tasks.workunit.client.0.smithi107.stdout:8/77: mknod d5/d1d/c22 0 2024-09-21T08:02:39.212 INFO:tasks.workunit.client.0.smithi107.stdout:8/78: write d5/fd [849722,37421] 0 2024-09-21T08:02:39.212 INFO:tasks.workunit.client.0.smithi107.stdout:8/79: stat d5/f21 0 2024-09-21T08:02:39.213 INFO:tasks.workunit.client.1.smithi129.stdout:9/859: symlink d17/d23/de7/l11b 0 2024-09-21T08:02:39.217 INFO:tasks.workunit.client.1.smithi129.stdout:0/879: rmdir de/d15/d39/d56/def/d101 39 2024-09-21T08:02:39.217 INFO:tasks.workunit.client.1.smithi129.stdout:0/880: stat de/d15/d39/ce3 0 2024-09-21T08:02:39.221 INFO:tasks.workunit.client.1.smithi129.stdout:1/995: symlink d1/d9/d6b/l142 0 2024-09-21T08:02:39.221 INFO:tasks.workunit.client.1.smithi129.stdout:1/996: creat d1/d16/d9b/f143 x:0 0 0 2024-09-21T08:02:39.222 INFO:tasks.workunit.client.0.smithi107.stdout:0/238: creat d1/d5/d25/d3d/d20/f51 x:0 0 0 2024-09-21T08:02:39.222 INFO:tasks.workunit.client.0.smithi107.stdout:0/239: fsync d1/d5/d25/f4e 0 2024-09-21T08:02:39.225 INFO:tasks.workunit.client.0.smithi107.stdout:8/80: unlink d5/d1d/l1f 0 2024-09-21T08:02:39.226 INFO:tasks.workunit.client.0.smithi107.stdout:8/81: chown d5/l1c 262 1 2024-09-21T08:02:39.226 INFO:tasks.workunit.client.0.smithi107.stdout:8/82: readlink d5/lf 0 2024-09-21T08:02:39.226 INFO:tasks.workunit.client.0.smithi107.stdout:8/83: chown d5/f21 18848497 1 2024-09-21T08:02:39.227 INFO:tasks.workunit.client.0.smithi107.stdout:0/240: symlink d1/l52 0 2024-09-21T08:02:39.227 INFO:tasks.workunit.client.0.smithi107.stdout:0/241: chown d1/d5/l35 823575 1 2024-09-21T08:02:39.229 INFO:tasks.workunit.client.1.smithi129.stdout:6/881: symlink d7/d1b/d1e/d66/dc2/de2/l122 0 2024-09-21T08:02:39.229 INFO:tasks.workunit.client.1.smithi129.stdout:6/882: fsync d7/d1b/d1e/d66/dc2/d5e/fe9 0 2024-09-21T08:02:39.229 INFO:tasks.workunit.client.1.smithi129.stdout:6/883: fdatasync d7/d1b/d1e/fb5 0 2024-09-21T08:02:39.230 INFO:tasks.workunit.client.0.smithi107.stdout:8/84: mkdir d5/d23 0 2024-09-21T08:02:39.230 INFO:tasks.workunit.client.0.smithi107.stdout:8/85: chown d5/f14 2664068 1 2024-09-21T08:02:39.232 INFO:tasks.workunit.client.0.smithi107.stdout:8/86: creat d5/d1d/f24 x:0 0 0 2024-09-21T08:02:39.237 INFO:tasks.workunit.client.1.smithi129.stdout:0/881: creat de/d81/d10e/f11b x:0 0 0 2024-09-21T08:02:39.241 INFO:tasks.workunit.client.1.smithi129.stdout:6/884: truncate d7/d1b/d1e/d39/d79/fce 229850 0 2024-09-21T08:02:39.241 INFO:tasks.workunit.client.1.smithi129.stdout:6/885: readlink d7/d1b/d1e/d66/dc2/de2/d40/l50 0 2024-09-21T08:02:39.241 INFO:tasks.workunit.client.1.smithi129.stdout:6/886: truncate d7/d1b/d8d/f11e 875970 0 2024-09-21T08:02:39.241 INFO:tasks.workunit.client.1.smithi129.stdout:9/860: dwrite d17/d22/d33/d36/d48/d3f/f69 [0,4194304] 0 2024-09-21T08:02:39.242 INFO:tasks.workunit.client.1.smithi129.stdout:0/882: mknod de/c11c 0 2024-09-21T08:02:39.242 INFO:tasks.workunit.client.1.smithi129.stdout:0/883: dread - de/d1f/dd4/db1/df5/d113/f117 zero size 2024-09-21T08:02:39.243 INFO:tasks.workunit.client.1.smithi129.stdout:6/887: dread d7/d10/fa8 [0,4194304] 0 2024-09-21T08:02:39.243 INFO:tasks.workunit.client.1.smithi129.stdout:6/888: write d7/d1b/d57/dd6/fde [262535,46289] 0 2024-09-21T08:02:39.243 INFO:tasks.workunit.client.1.smithi129.stdout:6/889: creat d7/d1b/d1e/d66/f123 x:0 0 0 2024-09-21T08:02:39.246 INFO:tasks.workunit.client.1.smithi129.stdout:6/890: symlink d7/d1b/d1e/d39/dbf/l124 0 2024-09-21T08:02:39.248 INFO:tasks.workunit.client.1.smithi129.stdout:6/891: getdents d7/d1b/d1e/d39/d4b/de8/d69 0 2024-09-21T08:02:39.248 INFO:tasks.workunit.client.1.smithi129.stdout:6/892: fsync d7/d1b/d1e/d66/ff6 0 2024-09-21T08:02:39.250 INFO:tasks.workunit.client.1.smithi129.stdout:6/893: unlink d7/d1b/d1e/d66/dc2/d93/f98 0 2024-09-21T08:02:39.253 INFO:tasks.workunit.client.1.smithi129.stdout:6/894: rename d7/l11 to d7/d1b/l125 0 2024-09-21T08:02:39.257 INFO:tasks.workunit.client.1.smithi129.stdout:1/997: dwrite d1/d9/f58 [4194304,4194304] 0 2024-09-21T08:02:39.257 INFO:tasks.workunit.client.1.smithi129.stdout:1/998: truncate d1/d4/dad/fd0 758114 0 2024-09-21T08:02:39.258 INFO:tasks.workunit.client.0.smithi107.stdout:0/242: dwrite d1/f8 [8388608,4194304] 0 2024-09-21T08:02:39.258 INFO:tasks.workunit.client.0.smithi107.stdout:0/243: creat d1/d5/d25/d3d/d20/f53 x:0 0 0 2024-09-21T08:02:39.259 INFO:tasks.workunit.client.1.smithi129.stdout:1/999: creat d1/d9/d6b/ddd/d12f/f144 x:0 0 0 2024-09-21T08:02:39.261 INFO:tasks.workunit.client.0.smithi107.stdout:2/103: sync 2024-09-21T08:02:39.261 INFO:tasks.workunit.client.0.smithi107.stdout:3/126: sync 2024-09-21T08:02:39.262 INFO:tasks.workunit.client.0.smithi107.stdout:1/140: sync 2024-09-21T08:02:39.262 INFO:tasks.workunit.client.0.smithi107.stdout:3/127: chown d8/d14/d1d/f1f 13568 1 2024-09-21T08:02:39.262 INFO:tasks.workunit.client.0.smithi107.stdout:2/104: dread - d1/d6/f21 zero size 2024-09-21T08:02:39.262 INFO:tasks.workunit.client.0.smithi107.stdout:3/128: fdatasync d8/d14/d1d/f1e 0 2024-09-21T08:02:39.262 INFO:tasks.workunit.client.0.smithi107.stdout:3/129: read - d8/f11 zero size 2024-09-21T08:02:39.262 INFO:tasks.workunit.client.0.smithi107.stdout:3/130: write d8/f11 [526962,111899] 0 2024-09-21T08:02:39.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:38 smithi129 ceph-mon[34472]: pgmap v11: 65 pgs: 65 active+clean; 1.6 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 168 MiB/s rd, 206 MiB/s wr, 355 op/s 2024-09-21T08:02:39.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:38 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:39.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:38 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:39.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:38 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:39.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:38 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:39.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:38 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:39.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:38 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:39.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:38 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:39.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:38 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:39.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:38 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:39.268 INFO:tasks.workunit.client.0.smithi107.stdout:6/150: sync 2024-09-21T08:02:39.268 INFO:tasks.workunit.client.0.smithi107.stdout:6/151: chown d2/d3/d7/ca 33036941 1 2024-09-21T08:02:39.273 INFO:tasks.workunit.client.0.smithi107.stdout:0/244: rename d1/d5/d25/c18 to d1/d5/d25/d3d/d20/c54 0 2024-09-21T08:02:39.275 INFO:tasks.workunit.client.0.smithi107.stdout:2/105: symlink d1/d6/l22 0 2024-09-21T08:02:39.276 INFO:tasks.workunit.client.0.smithi107.stdout:2/106: fdatasync d1/d6/f18 0 2024-09-21T08:02:39.277 INFO:tasks.workunit.client.0.smithi107.stdout:3/131: unlink d8/d14/c22 0 2024-09-21T08:02:39.278 INFO:tasks.workunit.client.0.smithi107.stdout:6/152: mkdir d2/d3/d7/d2a 0 2024-09-21T08:02:39.279 INFO:tasks.workunit.client.0.smithi107.stdout:3/132: creat d8/d21/f24 x:0 0 0 2024-09-21T08:02:39.280 INFO:tasks.workunit.client.0.smithi107.stdout:6/153: mkdir d2/d3/d7/d23/d2b 0 2024-09-21T08:02:39.281 INFO:tasks.workunit.client.0.smithi107.stdout:3/133: truncate f2 1497477 0 2024-09-21T08:02:39.283 INFO:tasks.workunit.client.1.smithi129.stdout:9/861: dwrite d17/ff5 [0,4194304] 0 2024-09-21T08:02:39.283 INFO:tasks.workunit.client.1.smithi129.stdout:9/862: chown d17/d55 33987199 1 2024-09-21T08:02:39.283 INFO:tasks.workunit.client.1.smithi129.stdout:9/863: chown d17/d22/d33/d7a/d89/d90/db1/d31/d5e/fa9 519872366 1 2024-09-21T08:02:39.283 INFO:tasks.workunit.client.1.smithi129.stdout:9/864: rename d17 to d17/d46/d11c 22 2024-09-21T08:02:39.283 INFO:tasks.workunit.client.0.smithi107.stdout:6/154: rename d2/d3/d7/f12 to d2/d3/d7/d24/f2c 0 2024-09-21T08:02:39.284 INFO:tasks.workunit.client.1.smithi129.stdout:8/752: sync 2024-09-21T08:02:39.284 INFO:tasks.workunit.client.1.smithi129.stdout:8/753: write d0/d6/d7/d18/d27/d32/d37/fba [337258,96181] 0 2024-09-21T08:02:39.285 INFO:tasks.workunit.client.1.smithi129.stdout:6/895: dwrite d7/d1b/d1e/d39/d4b/d6e/de5/fef [0,4194304] 0 2024-09-21T08:02:39.286 INFO:tasks.workunit.client.0.smithi107.stdout:1/141: dwrite d0/d7/fa [0,4194304] 0 2024-09-21T08:02:39.286 INFO:tasks.workunit.client.0.smithi107.stdout:6/155: creat d2/d3/d7/d24/f2d x:0 0 0 2024-09-21T08:02:39.287 INFO:tasks.workunit.client.1.smithi129.stdout:0/884: dwrite de/d1f/da9/f7c [0,4194304] 0 2024-09-21T08:02:39.287 INFO:tasks.workunit.client.1.smithi129.stdout:0/885: read - de/d81/d10e/f11b zero size 2024-09-21T08:02:39.287 INFO:tasks.workunit.client.1.smithi129.stdout:0/886: creat de/d1f/da9/f11d x:0 0 0 2024-09-21T08:02:39.288 INFO:tasks.workunit.client.1.smithi129.stdout:9/865: truncate d17/d22/d33/d7a/d89/d90/db1/f66 3531029 0 2024-09-21T08:02:39.288 INFO:tasks.workunit.client.0.smithi107.stdout:1/142: symlink d0/d7/l2f 0 2024-09-21T08:02:39.289 INFO:tasks.workunit.client.0.smithi107.stdout:3/134: write d8/f13 [2566218,14159] 0 2024-09-21T08:02:39.289 INFO:tasks.workunit.client.0.smithi107.stdout:3/135: chown d8/f1b 399 1 2024-09-21T08:02:39.289 INFO:tasks.workunit.client.0.smithi107.stdout:3/136: chown d8/d14/d1d/f1e 1355497235 1 2024-09-21T08:02:39.291 INFO:tasks.workunit.client.1.smithi129.stdout:8/754: rename d0/d6/d7/d18/d27/d32/d37/f42 to d0/d6/d7/d5d/fe1 0 2024-09-21T08:02:39.291 INFO:tasks.workunit.client.0.smithi107.stdout:6/156: mkdir d2/d2e 0 2024-09-21T08:02:39.291 INFO:tasks.workunit.client.0.smithi107.stdout:6/157: dread - d2/d3/d7/d24/f2d zero size 2024-09-21T08:02:39.293 INFO:tasks.workunit.client.0.smithi107.stdout:3/137: mkdir d8/d25 0 2024-09-21T08:02:39.293 INFO:tasks.workunit.client.0.smithi107.stdout:3/138: chown d8/lc 200016647 1 2024-09-21T08:02:39.296 INFO:tasks.workunit.client.0.smithi107.stdout:6/158: creat d2/d3/d7/d23/d2b/f2f x:0 0 0 2024-09-21T08:02:39.297 INFO:tasks.workunit.client.0.smithi107.stdout:1/143: dread d0/d7/fa [0,4194304] 0 2024-09-21T08:02:39.297 INFO:tasks.workunit.client.1.smithi129.stdout:6/896: link d7/f53 d7/d1b/d1e/d39/dbf/f126 0 2024-09-21T08:02:39.297 INFO:tasks.workunit.client.1.smithi129.stdout:6/897: chown d7/d1b/d1e/d39/d4b 1209 1 2024-09-21T08:02:39.299 INFO:tasks.workunit.client.0.smithi107.stdout:6/159: rename d2/l27 to d2/l30 0 2024-09-21T08:02:39.299 INFO:tasks.workunit.client.0.smithi107.stdout:6/160: chown d2/d3/d7/d24 0 1 2024-09-21T08:02:39.299 INFO:tasks.workunit.client.0.smithi107.stdout:6/161: write d2/fe [1484791,22291] 0 2024-09-21T08:02:39.301 INFO:tasks.workunit.client.1.smithi129.stdout:0/887: rename de/d15/d44/d45/da0 to de/d81/d10e/dc0/dfb/d11e 0 2024-09-21T08:02:39.302 INFO:tasks.workunit.client.1.smithi129.stdout:8/755: rmdir d0/d6/d7/d18/d61/d7f 39 2024-09-21T08:02:39.302 INFO:tasks.workunit.client.1.smithi129.stdout:8/756: chown d0/d6/d7/d18/d27/d32/d3d/fa9 10 1 2024-09-21T08:02:39.302 INFO:tasks.workunit.client.1.smithi129.stdout:8/757: chown d0/d6/d7/d5a/l66 736763 1 2024-09-21T08:02:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:38 smithi107 ceph-mon[27622]: pgmap v11: 65 pgs: 65 active+clean; 1.6 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 168 MiB/s rd, 206 MiB/s wr, 355 op/s 2024-09-21T08:02:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:38 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:38 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:38 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:38 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:38 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:38 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:38 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:39.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:38 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:39.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:38 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:39.307 INFO:tasks.workunit.client.1.smithi129.stdout:6/898: write d7/d1b/d1e/d39/d4b/fc5 [1425910,128676] 0 2024-09-21T08:02:39.307 INFO:tasks.workunit.client.1.smithi129.stdout:6/899: stat d7/d1b/d1e/d39/d79 0 2024-09-21T08:02:39.307 INFO:tasks.workunit.client.1.smithi129.stdout:6/900: chown d7/d1b/d1e/d39/d4b/de8/l100 1 1 2024-09-21T08:02:39.310 INFO:tasks.workunit.client.0.smithi107.stdout:0/245: dwrite d1/d5/d25/d2d/f2f [0,4194304] 0 2024-09-21T08:02:39.310 INFO:tasks.workunit.client.0.smithi107.stdout:2/107: dwrite d1/d16/f17 [0,4194304] 0 2024-09-21T08:02:39.311 INFO:tasks.workunit.client.1.smithi129.stdout:6/901: dread d7/f37 [0,4194304] 0 2024-09-21T08:02:39.311 INFO:tasks.workunit.client.1.smithi129.stdout:8/758: mknod d0/d6/d7/d5d/ce2 0 2024-09-21T08:02:39.311 INFO:tasks.workunit.client.0.smithi107.stdout:0/246: mkdir d1/d5/d25/d3d/d20/d29/d55 0 2024-09-21T08:02:39.317 INFO:tasks.workunit.client.1.smithi129.stdout:9/866: rename d17/d55/d81 to d17/d22/d33/de6/d11d 0 2024-09-21T08:02:39.319 INFO:tasks.workunit.client.0.smithi107.stdout:0/247: write d1/d23/f3f [2942923,34371] 0 2024-09-21T08:02:39.319 INFO:tasks.workunit.client.0.smithi107.stdout:0/248: fdatasync d1/d5/d25/f50 0 2024-09-21T08:02:39.319 INFO:tasks.workunit.client.0.smithi107.stdout:0/249: fsync d1/d5/d25/f4d 0 2024-09-21T08:02:39.320 INFO:tasks.workunit.client.0.smithi107.stdout:6/162: dwrite d2/d3/f14 [0,4194304] 0 2024-09-21T08:02:39.320 INFO:tasks.workunit.client.1.smithi129.stdout:0/888: rename de/d19/d5e/l9a to de/d81/d10e/l11f 0 2024-09-21T08:02:39.320 INFO:tasks.workunit.client.1.smithi129.stdout:0/889: chown de/d81/fa7 2700441 1 2024-09-21T08:02:39.320 INFO:tasks.workunit.client.1.smithi129.stdout:0/890: write de/d15/d44/d4b/f7a [528297,21625] 0 2024-09-21T08:02:39.321 INFO:tasks.workunit.client.1.smithi129.stdout:9/867: creat d17/d22/d33/d7a/d89/d90/db1/d31/d35/f11e x:0 0 0 2024-09-21T08:02:39.325 INFO:tasks.workunit.client.1.smithi129.stdout:0/891: getdents de/d81/d94 0 2024-09-21T08:02:39.326 INFO:tasks.workunit.client.1.smithi129.stdout:0/892: fsync de/d15/f18 0 2024-09-21T08:02:39.327 INFO:tasks.workunit.client.0.smithi107.stdout:6/163: mkdir d2/d3/d7/d2a/d31 0 2024-09-21T08:02:39.328 INFO:tasks.workunit.client.1.smithi129.stdout:0/893: creat de/d19/dad/f120 x:0 0 0 2024-09-21T08:02:39.330 INFO:tasks.workunit.client.0.smithi107.stdout:3/139: dread d8/f13 [0,4194304] 0 2024-09-21T08:02:39.336 INFO:tasks.workunit.client.0.smithi107.stdout:6/164: dread d2/d3/f4 [0,4194304] 0 2024-09-21T08:02:39.339 INFO:tasks.workunit.client.0.smithi107.stdout:6/165: link d2/d3/d7/l1c d2/d3/l32 0 2024-09-21T08:02:39.341 INFO:tasks.workunit.client.0.smithi107.stdout:6/166: link d2/l29 d2/d3/d7/l33 0 2024-09-21T08:02:39.341 INFO:tasks.workunit.client.0.smithi107.stdout:6/167: creat d2/d3/d7/d24/f34 x:0 0 0 2024-09-21T08:02:39.342 INFO:tasks.workunit.client.1.smithi129.stdout:4/847: sync 2024-09-21T08:02:39.342 INFO:tasks.workunit.client.1.smithi129.stdout:4/848: chown d5/dbd 3619775 1 2024-09-21T08:02:39.344 INFO:tasks.workunit.client.0.smithi107.stdout:6/168: creat d2/d3/d7/d23/f35 x:0 0 0 2024-09-21T08:02:39.344 INFO:tasks.workunit.client.0.smithi107.stdout:6/169: stat d2/d3/d7/d2a 0 2024-09-21T08:02:39.344 INFO:tasks.workunit.client.0.smithi107.stdout:6/170: mknod d2/d3/d7/c36 0 2024-09-21T08:02:39.346 INFO:tasks.workunit.client.0.smithi107.stdout:6/171: link d2/d3/d7/f8 d2/d3/d7/d24/f37 0 2024-09-21T08:02:39.346 INFO:tasks.workunit.client.0.smithi107.stdout:6/172: write d2/d3/f6 [2280681,91066] 0 2024-09-21T08:02:39.346 INFO:tasks.workunit.client.0.smithi107.stdout:6/173: truncate d2/ff 468854 0 2024-09-21T08:02:39.347 INFO:tasks.workunit.client.0.smithi107.stdout:6/174: rename d2/l30 to d2/d3/d7/d23/d2b/l38 0 2024-09-21T08:02:39.359 INFO:tasks.workunit.client.1.smithi129.stdout:6/902: dwrite d7/d1b/d1e/fe3 [0,4194304] 0 2024-09-21T08:02:39.361 INFO:tasks.workunit.client.1.smithi129.stdout:8/759: dwrite d0/d6/d7/d18/d27/f90 [4194304,4194304] 0 2024-09-21T08:02:39.371 INFO:tasks.workunit.client.0.smithi107.stdout:3/140: dwrite d8/d14/d1d/f1e [0,4194304] 0 2024-09-21T08:02:39.371 INFO:tasks.workunit.client.0.smithi107.stdout:0/250: dwrite d1/d5/d25/d3d/f4a [0,4194304] 0 2024-09-21T08:02:39.372 INFO:tasks.workunit.client.1.smithi129.stdout:0/894: dwrite de/f13 [0,4194304] 0 2024-09-21T08:02:39.372 INFO:tasks.workunit.client.1.smithi129.stdout:0/895: readlink de/d81/d10e/dc0/lff 0 2024-09-21T08:02:39.372 INFO:tasks.workunit.client.1.smithi129.stdout:9/868: dwrite d17/d22/d33/d7a/d89/d90/db1/d31/d5e/d6b/f9b [0,4194304] 0 2024-09-21T08:02:39.372 INFO:tasks.workunit.client.1.smithi129.stdout:4/849: dwrite d5/d33/f4d [0,4194304] 0 2024-09-21T08:02:39.372 INFO:tasks.workunit.client.1.smithi129.stdout:4/850: chown d5/d16/d24/l2c 79 1 2024-09-21T08:02:39.372 INFO:tasks.workunit.client.1.smithi129.stdout:4/851: readlink d5/d16/d47/d5f/d64/l117 0 2024-09-21T08:02:39.400 INFO:tasks.workunit.client.1.smithi129.stdout:9/869: dwrite d17/d22/d33/d7a/d89/fa6 [0,4194304] 0 2024-09-21T08:02:39.401 INFO:tasks.workunit.client.0.smithi107.stdout:3/141: dwrite d8/f13 [0,4194304] 0 2024-09-21T08:02:39.401 INFO:tasks.workunit.client.1.smithi129.stdout:4/852: dwrite f2 [0,4194304] 0 2024-09-21T08:02:39.403 INFO:tasks.workunit.client.0.smithi107.stdout:6/175: unlink d2/fb 0 2024-09-21T08:02:39.404 INFO:tasks.workunit.client.1.smithi129.stdout:6/903: mkdir d7/d1b/d57/d96/d127 0 2024-09-21T08:02:39.404 INFO:tasks.workunit.client.1.smithi129.stdout:4/853: dread d5/d33/d4e/da7/d123/da8/f10c [0,4194304] 0 2024-09-21T08:02:39.408 INFO:tasks.workunit.client.1.smithi129.stdout:8/760: mknod d0/d6/d7/ce3 0 2024-09-21T08:02:39.408 INFO:tasks.workunit.client.1.smithi129.stdout:8/761: fsync d0/d6/d7/d18/d27/d32/d3d/fa9 0 2024-09-21T08:02:39.412 INFO:tasks.workunit.client.1.smithi129.stdout:0/896: truncate de/d22/f2b 2266855 0 2024-09-21T08:02:39.419 INFO:tasks.workunit.client.1.smithi129.stdout:6/904: symlink d7/d1b/d1e/d66/dba/l128 0 2024-09-21T08:02:39.420 INFO:tasks.workunit.client.1.smithi129.stdout:4/854: mkdir d5/da5/db1/d12b 0 2024-09-21T08:02:39.422 INFO:tasks.workunit.client.0.smithi107.stdout:0/251: link d1/d23/l30 d1/d23/l56 0 2024-09-21T08:02:39.422 INFO:tasks.workunit.client.0.smithi107.stdout:0/252: write d1/d5/d25/d3d/d20/f53 [247974,28284] 0 2024-09-21T08:02:39.423 INFO:tasks.workunit.client.1.smithi129.stdout:8/762: mknod d0/d6/d7/d18/d27/d32/d37/ce4 0 2024-09-21T08:02:39.424 INFO:tasks.workunit.client.0.smithi107.stdout:6/176: mknod d2/d3/d7/d2a/d31/c39 0 2024-09-21T08:02:39.424 INFO:tasks.workunit.client.0.smithi107.stdout:6/177: chown d2/d2e 309703 1 2024-09-21T08:02:39.424 INFO:tasks.workunit.client.0.smithi107.stdout:6/178: read d2/fd [206419,96712] 0 2024-09-21T08:02:39.426 INFO:tasks.workunit.client.1.smithi129.stdout:0/897: creat de/d81/d10e/dc0/dfb/d11e/f121 x:0 0 0 2024-09-21T08:02:39.426 INFO:tasks.workunit.client.1.smithi129.stdout:0/898: truncate de/d81/d94/ffe 900500 0 2024-09-21T08:02:39.426 INFO:tasks.workunit.client.1.smithi129.stdout:9/870: dwrite d17/d22/d33/d36/d48/d75/f7d [0,4194304] 0 2024-09-21T08:02:39.426 INFO:tasks.workunit.client.1.smithi129.stdout:9/871: stat d17/d60 0 2024-09-21T08:02:39.427 INFO:tasks.workunit.client.0.smithi107.stdout:3/142: dwrite d8/d14/d1d/f1e [0,4194304] 0 2024-09-21T08:02:39.427 INFO:tasks.workunit.client.0.smithi107.stdout:0/253: symlink d1/d23/l57 0 2024-09-21T08:02:39.427 INFO:tasks.workunit.client.0.smithi107.stdout:0/254: truncate d1/d5/d25/f50 9357081 0 2024-09-21T08:02:39.428 INFO:tasks.workunit.client.1.smithi129.stdout:6/905: mknod d7/d1b/d1e/c129 0 2024-09-21T08:02:39.431 INFO:tasks.workunit.client.1.smithi129.stdout:4/855: creat d5/d6/f12c x:0 0 0 2024-09-21T08:02:39.433 INFO:tasks.workunit.client.1.smithi129.stdout:0/899: rmdir de/d22/d27/d10a 39 2024-09-21T08:02:39.433 INFO:tasks.workunit.client.1.smithi129.stdout:0/900: truncate de/f64 389505 0 2024-09-21T08:02:39.434 INFO:tasks.workunit.client.0.smithi107.stdout:3/143: rmdir d8/d14/d1d 39 2024-09-21T08:02:39.434 INFO:tasks.workunit.client.0.smithi107.stdout:3/144: chown d8/fe 2117 1 2024-09-21T08:02:39.435 INFO:tasks.workunit.client.1.smithi129.stdout:9/872: mknod d17/d46/c11f 0 2024-09-21T08:02:39.435 INFO:tasks.workunit.client.0.smithi107.stdout:0/255: getdents d1/d5/d25 0 2024-09-21T08:02:39.438 INFO:tasks.workunit.client.0.smithi107.stdout:3/145: mknod d8/c26 0 2024-09-21T08:02:39.441 INFO:tasks.workunit.client.0.smithi107.stdout:0/256: creat d1/d5/d25/d3d/d20/d29/d55/f58 x:0 0 0 2024-09-21T08:02:39.441 INFO:tasks.workunit.client.0.smithi107.stdout:0/257: dread - d1/d5/d25/d3d/d20/d29/d55/f58 zero size 2024-09-21T08:02:39.444 INFO:tasks.workunit.client.0.smithi107.stdout:6/179: dwrite d2/d3/d7/d24/f2c [0,4194304] 0 2024-09-21T08:02:39.450 INFO:tasks.workunit.client.1.smithi129.stdout:6/906: symlink d7/d1b/d57/d119/l12a 0 2024-09-21T08:02:39.453 INFO:tasks.workunit.client.1.smithi129.stdout:4/856: mkdir d5/d16/d24/d12d 0 2024-09-21T08:02:39.455 INFO:tasks.workunit.client.0.smithi107.stdout:6/180: getdents d2/d3 0 2024-09-21T08:02:39.455 INFO:tasks.workunit.client.0.smithi107.stdout:6/181: truncate d2/f18 479262 0 2024-09-21T08:02:39.455 INFO:tasks.workunit.client.0.smithi107.stdout:6/182: chown d2/d3/l1e 1954683 1 2024-09-21T08:02:39.455 INFO:tasks.workunit.client.0.smithi107.stdout:0/258: write d1/d23/f26 [2186970,55555] 0 2024-09-21T08:02:39.456 INFO:tasks.workunit.client.0.smithi107.stdout:9/208: sync 2024-09-21T08:02:39.457 INFO:tasks.workunit.client.1.smithi129.stdout:6/907: link d7/d1b/d1e/d66/dc2/de2/d40/d41/f70 d7/d10/dcc/f12b 0 2024-09-21T08:02:39.457 INFO:tasks.workunit.client.1.smithi129.stdout:4/857: truncate d5/d16/fd3 1242625 0 2024-09-21T08:02:39.459 INFO:tasks.workunit.client.0.smithi107.stdout:6/183: dread d2/d3/d7/f15 [0,4194304] 0 2024-09-21T08:02:39.461 INFO:tasks.workunit.client.0.smithi107.stdout:9/209: dread d11/d27/d2a/f33 [0,4194304] 0 2024-09-21T08:02:39.462 INFO:tasks.workunit.client.0.smithi107.stdout:3/146: dwrite d8/fe [4194304,4194304] 0 2024-09-21T08:02:39.462 INFO:tasks.workunit.client.1.smithi129.stdout:9/873: dwrite d17/d22/d33/d7a/d89/d90/db1/d31/d5e/fc1 [0,4194304] 0 2024-09-21T08:02:39.470 INFO:tasks.workunit.client.0.smithi107.stdout:0/259: dread d1/d5/d25/d3d/f4a [0,4194304] 0 2024-09-21T08:02:39.500 INFO:tasks.workunit.client.1.smithi129.stdout:0/901: rmdir de/d22/d27/d85/db2/dc3 39 2024-09-21T08:02:39.501 INFO:tasks.workunit.client.1.smithi129.stdout:0/902: write de/f12 [4462196,79665] 0 2024-09-21T08:02:39.502 INFO:tasks.workunit.client.0.smithi107.stdout:6/184: mknod d2/d3/d7/d23/c3a 0 2024-09-21T08:02:39.503 INFO:tasks.workunit.client.1.smithi129.stdout:4/858: symlink d5/d11/d3f/d50/l12e 0 2024-09-21T08:02:39.505 INFO:tasks.workunit.client.0.smithi107.stdout:9/210: symlink d11/d27/d2f/d38/l51 0 2024-09-21T08:02:39.507 INFO:tasks.workunit.client.1.smithi129.stdout:9/874: truncate d17/f26 746118 0 2024-09-21T08:02:39.511 INFO:tasks.workunit.client.0.smithi107.stdout:6/185: dread d2/d3/d7/d24/f25 [0,4194304] 0 2024-09-21T08:02:39.513 INFO:tasks.workunit.client.1.smithi129.stdout:9/875: read d17/d22/d33/d36/d48/d3f/f57 [1426258,67200] 0 2024-09-21T08:02:39.524 INFO:tasks.workunit.client.0.smithi107.stdout:0/260: truncate d1/d5/d25/f4d 542531 0 2024-09-21T08:02:39.529 INFO:tasks.workunit.client.1.smithi129.stdout:4/859: dread d5/d16/fd3 [0,4194304] 0 2024-09-21T08:02:39.529 INFO:tasks.workunit.client.1.smithi129.stdout:4/860: dread - d5/d16/d47/ffd zero size 2024-09-21T08:02:39.532 INFO:tasks.workunit.client.0.smithi107.stdout:6/186: mknod d2/d3/d7/d23/c3b 0 2024-09-21T08:02:39.534 INFO:tasks.workunit.client.0.smithi107.stdout:9/211: getdents d11 0 2024-09-21T08:02:39.535 INFO:tasks.workunit.client.0.smithi107.stdout:6/187: creat d2/d2e/f3c x:0 0 0 2024-09-21T08:02:39.539 INFO:tasks.workunit.client.0.smithi107.stdout:9/212: symlink d11/d27/d2f/d4d/l52 0 2024-09-21T08:02:39.541 INFO:tasks.workunit.client.0.smithi107.stdout:6/188: symlink d2/d3/d7/d23/l3d 0 2024-09-21T08:02:39.541 INFO:tasks.workunit.client.0.smithi107.stdout:6/189: write d2/d3/d7/d24/f37 [2003293,11931] 0 2024-09-21T08:02:39.543 INFO:tasks.workunit.client.0.smithi107.stdout:9/213: dread d11/f20 [0,4194304] 0 2024-09-21T08:02:39.544 INFO:tasks.workunit.client.0.smithi107.stdout:6/190: getdents d2/d3/d7/d2a 0 2024-09-21T08:02:39.547 INFO:tasks.workunit.client.0.smithi107.stdout:9/214: mknod d11/d27/d2a/c53 0 2024-09-21T08:02:39.547 INFO:tasks.workunit.client.0.smithi107.stdout:9/215: write d11/d24/d26/f28 [1097874,85149] 0 2024-09-21T08:02:39.547 INFO:tasks.workunit.client.0.smithi107.stdout:9/216: chown lc 9002 1 2024-09-21T08:02:39.547 INFO:tasks.workunit.client.0.smithi107.stdout:9/217: creat d11/d27/d39/f54 x:0 0 0 2024-09-21T08:02:39.549 INFO:tasks.workunit.client.0.smithi107.stdout:6/191: symlink d2/d3/l3e 0 2024-09-21T08:02:39.555 INFO:tasks.workunit.client.0.smithi107.stdout:9/218: mknod d11/d27/d2f/d3a/c55 0 2024-09-21T08:02:39.559 INFO:tasks.workunit.client.0.smithi107.stdout:6/192: mkdir d2/d3/d7/d3f 0 2024-09-21T08:02:39.559 INFO:tasks.workunit.client.0.smithi107.stdout:6/193: chown d2/d3/d7/f1b 2079 1 2024-09-21T08:02:39.561 INFO:tasks.workunit.client.0.smithi107.stdout:9/219: mknod d11/d27/d2f/d38/c56 0 2024-09-21T08:02:39.589 INFO:tasks.workunit.client.0.smithi107.stdout:6/194: dwrite d2/d3/d7/f13 [0,4194304] 0 2024-09-21T08:02:39.591 INFO:tasks.workunit.client.1.smithi129.stdout:0/903: mknod de/d22/d27/c122 0 2024-09-21T08:02:39.591 INFO:tasks.workunit.client.1.smithi129.stdout:0/904: readlink de/d81/d94/lc6 0 2024-09-21T08:02:39.591 INFO:tasks.workunit.client.1.smithi129.stdout:0/905: chown de/lb0 16 1 2024-09-21T08:02:39.593 INFO:tasks.workunit.client.0.smithi107.stdout:9/220: dwrite d11/d27/d39/f47 [0,4194304] 0 2024-09-21T08:02:39.593 INFO:tasks.workunit.client.0.smithi107.stdout:9/221: chown d11/d27/d2f/f3b 7330 1 2024-09-21T08:02:39.593 INFO:tasks.workunit.client.0.smithi107.stdout:9/222: stat l6 0 2024-09-21T08:02:39.594 INFO:tasks.workunit.client.0.smithi107.stdout:6/195: dread d2/d3/d7/f11 [0,4194304] 0 2024-09-21T08:02:39.595 INFO:tasks.workunit.client.1.smithi129.stdout:9/876: mknod d17/d60/d7b/dc4/c120 0 2024-09-21T08:02:39.596 INFO:tasks.workunit.client.1.smithi129.stdout:9/877: chown d17/d22/d33/d7a/d89/d90/db1/d31/d5e/fc1 78248 1 2024-09-21T08:02:39.598 INFO:tasks.workunit.client.0.smithi107.stdout:9/223: symlink d11/d27/d2f/l57 0 2024-09-21T08:02:39.598 INFO:tasks.workunit.client.0.smithi107.stdout:9/224: chown d11/d24/c30 156 1 2024-09-21T08:02:39.600 INFO:tasks.workunit.client.0.smithi107.stdout:6/196: mknod d2/d2e/c40 0 2024-09-21T08:02:39.603 INFO:tasks.workunit.client.1.smithi129.stdout:6/908: rmdir d7/d1b/d1e/d66/dc2/d93 39 2024-09-21T08:02:39.604 INFO:tasks.workunit.client.0.smithi107.stdout:6/197: mkdir d2/d3/d7/d24/d41 0 2024-09-21T08:02:39.604 INFO:tasks.workunit.client.0.smithi107.stdout:6/198: write d2/d3/f6 [2810513,130740] 0 2024-09-21T08:02:39.606 INFO:tasks.workunit.client.1.smithi129.stdout:9/878: mknod d17/d23/c121 0 2024-09-21T08:02:39.607 INFO:tasks.workunit.client.1.smithi129.stdout:6/909: dread d7/d10/fa8 [0,4194304] 0 2024-09-21T08:02:39.626 INFO:tasks.workunit.client.0.smithi107.stdout:9/225: dwrite d11/d27/d39/f47 [0,4194304] 0 2024-09-21T08:02:39.627 INFO:tasks.workunit.client.0.smithi107.stdout:6/199: dwrite d2/fd [0,4194304] 0 2024-09-21T08:02:39.628 INFO:tasks.workunit.client.0.smithi107.stdout:6/200: dread - d2/d3/d7/d24/f34 zero size 2024-09-21T08:02:39.628 INFO:tasks.workunit.client.0.smithi107.stdout:6/201: write d2/d3/d7/f15 [1092358,106058] 0 2024-09-21T08:02:39.628 INFO:tasks.workunit.client.0.smithi107.stdout:6/202: stat d2/fe 0 2024-09-21T08:02:39.631 INFO:tasks.workunit.client.1.smithi129.stdout:8/763: sync 2024-09-21T08:02:39.644 INFO:tasks.workunit.client.1.smithi129.stdout:9/879: rename d17/d22/d33/d36/d48/d3f/d71 to d17/d22/d33/d7a/d89/d122 0 2024-09-21T08:02:39.646 INFO:tasks.workunit.client.1.smithi129.stdout:6/910: rename d7/d1b/d1e/d39/d4b/de8/d69/fbd to d7/d1b/d1e/d66/dc2/de2/d40/f12c 0 2024-09-21T08:02:39.649 INFO:tasks.workunit.client.1.smithi129.stdout:8/764: rename d0/d6/d7/lb6 to d0/d6/d7/d5a/dbc/le5 0 2024-09-21T08:02:39.649 INFO:tasks.workunit.client.1.smithi129.stdout:8/765: chown d0/d6/d7/d18/d27/d60/d85/dcc/cdc 7 1 2024-09-21T08:02:39.651 INFO:tasks.workunit.client.0.smithi107.stdout:9/226: dwrite d11/d27/d2a/f41 [0,4194304] 0 2024-09-21T08:02:39.654 INFO:tasks.workunit.client.0.smithi107.stdout:6/203: dwrite d2/d2e/f3c [0,4194304] 0 2024-09-21T08:02:39.657 INFO:tasks.workunit.client.0.smithi107.stdout:9/227: mknod d11/d27/d2f/d38/c58 0 2024-09-21T08:02:39.658 INFO:tasks.workunit.client.1.smithi129.stdout:8/766: read d0/d6/d7/d5d/fe1 [599569,49746] 0 2024-09-21T08:02:39.660 INFO:tasks.workunit.client.0.smithi107.stdout:6/204: creat d2/d3/d7/f42 x:0 0 0 2024-09-21T08:02:39.661 INFO:tasks.workunit.client.1.smithi129.stdout:8/767: creat d0/d6/d7/d5a/fe6 x:0 0 0 2024-09-21T08:02:39.662 INFO:tasks.workunit.client.0.smithi107.stdout:6/205: symlink d2/d3/d7/d2a/l43 0 2024-09-21T08:02:39.663 INFO:tasks.workunit.client.1.smithi129.stdout:8/768: mknod d0/d6/d7/d5d/ce7 0 2024-09-21T08:02:39.665 INFO:tasks.workunit.client.1.smithi129.stdout:8/769: getdents d0/d6/dac 0 2024-09-21T08:02:39.666 INFO:tasks.workunit.client.0.smithi107.stdout:4/145: sync 2024-09-21T08:02:39.666 INFO:tasks.workunit.client.0.smithi107.stdout:4/146: creat dc/f2c x:0 0 0 2024-09-21T08:02:39.667 INFO:tasks.workunit.client.1.smithi129.stdout:8/770: creat d0/d6/d7/d18/d61/d7f/dd2/fe8 x:0 0 0 2024-09-21T08:02:39.669 INFO:tasks.workunit.client.0.smithi107.stdout:4/147: symlink dc/d13/l2d 0 2024-09-21T08:02:39.670 INFO:tasks.workunit.client.1.smithi129.stdout:8/771: rename d0/d6/d7/d9/f2a to d0/d6/d7/d5a/dbc/fe9 0 2024-09-21T08:02:39.670 INFO:tasks.workunit.client.1.smithi129.stdout:8/772: dread - d0/d6/d7/d5a/fd1 zero size 2024-09-21T08:02:39.671 INFO:tasks.workunit.client.0.smithi107.stdout:5/183: sync 2024-09-21T08:02:39.672 INFO:tasks.workunit.client.1.smithi129.stdout:8/773: link d0/d6/d7/d5a/f8a d0/d6/d7/d18/d27/d60/d85/dcc/fea 0 2024-09-21T08:02:39.674 INFO:tasks.workunit.client.1.smithi129.stdout:8/774: creat d0/d6/dac/feb x:0 0 0 2024-09-21T08:02:39.677 INFO:tasks.workunit.client.1.smithi129.stdout:9/880: dwrite d17/d46/f4f [0,4194304] 0 2024-09-21T08:02:39.677 INFO:tasks.workunit.client.0.smithi107.stdout:6/206: dread d2/d2e/f3c [0,4194304] 0 2024-09-21T08:02:39.678 INFO:tasks.workunit.client.1.smithi129.stdout:4/861: creat d5/d16/d47/d5f/f12f x:0 0 0 2024-09-21T08:02:39.680 INFO:tasks.workunit.client.1.smithi129.stdout:9/881: unlink cc 0 2024-09-21T08:02:39.680 INFO:tasks.workunit.client.1.smithi129.stdout:9/882: write d17/d22/d33/d7a/d89/fb4 [2504966,23833] 0 2024-09-21T08:02:39.680 INFO:tasks.workunit.client.1.smithi129.stdout:9/883: chown d17/d22/d33/d7a/d89/d90/db1/d31/d5e/d6b/f79 14622 1 2024-09-21T08:02:39.686 INFO:tasks.workunit.client.1.smithi129.stdout:0/906: mknod de/d15/d39/d9e/c123 0 2024-09-21T08:02:39.686 INFO:tasks.workunit.client.1.smithi129.stdout:0/907: write de/d15/d44/d4b/f7a [770186,17748] 0 2024-09-21T08:02:39.688 INFO:tasks.workunit.client.1.smithi129.stdout:0/908: creat de/d22/f124 x:0 0 0 2024-09-21T08:02:39.688 INFO:tasks.workunit.client.0.smithi107.stdout:5/184: dread d7/de/f1b [0,4194304] 0 2024-09-21T08:02:39.688 INFO:tasks.workunit.client.0.smithi107.stdout:5/185: chown d7/de/l22 1597 1 2024-09-21T08:02:39.692 INFO:tasks.workunit.client.0.smithi107.stdout:9/228: dwrite d11/d27/d2a/f41 [0,4194304] 0 2024-09-21T08:02:39.692 INFO:tasks.workunit.client.0.smithi107.stdout:9/229: truncate d11/d27/d2f/f3b 1394005 0 2024-09-21T08:02:39.692 INFO:tasks.workunit.client.0.smithi107.stdout:4/148: dwrite dc/f1e [0,4194304] 0 2024-09-21T08:02:39.692 INFO:tasks.workunit.client.0.smithi107.stdout:4/149: read - dc/d13/f26 zero size 2024-09-21T08:02:39.692 INFO:tasks.workunit.client.0.smithi107.stdout:4/150: readlink dc/d13/l20 0 2024-09-21T08:02:39.693 INFO:tasks.workunit.client.0.smithi107.stdout:6/207: write d2/d3/d7/f13 [380164,47078] 0 2024-09-21T08:02:39.693 INFO:tasks.workunit.client.0.smithi107.stdout:6/208: fsync d2/f18 0 2024-09-21T08:02:39.693 INFO:tasks.workunit.client.1.smithi129.stdout:8/775: write d0/d6/f1f [2118482,51725] 0 2024-09-21T08:02:39.694 INFO:tasks.workunit.client.1.smithi129.stdout:8/776: readlink d0/d6/d7/d18/d27/d60/d97/lb0 0 2024-09-21T08:02:39.694 INFO:tasks.workunit.client.1.smithi129.stdout:8/777: write d0/d6/d7/d18/d61/fd8 [286864,94143] 0 2024-09-21T08:02:39.694 INFO:tasks.workunit.client.0.smithi107.stdout:9/230: rename d11/d27/f29 to d11/d27/d2f/d4d/f59 0 2024-09-21T08:02:39.697 INFO:tasks.workunit.client.1.smithi129.stdout:8/778: creat d0/d6/d7/d24/fec x:0 0 0 2024-09-21T08:02:39.699 INFO:tasks.workunit.client.0.smithi107.stdout:6/209: mkdir d2/d3/d7/d24/d41/d44 0 2024-09-21T08:02:39.699 INFO:tasks.workunit.client.0.smithi107.stdout:6/210: truncate d2/d3/d7/d23/f35 414905 0 2024-09-21T08:02:39.701 INFO:tasks.workunit.client.0.smithi107.stdout:9/231: creat d11/d27/d2f/f5a x:0 0 0 2024-09-21T08:02:39.702 INFO:tasks.workunit.client.0.smithi107.stdout:6/211: truncate d2/d3/d7/d24/f2c 2152496 0 2024-09-21T08:02:39.704 INFO:tasks.workunit.client.0.smithi107.stdout:6/212: mknod d2/d3/d7/d24/c45 0 2024-09-21T08:02:39.707 INFO:tasks.workunit.client.1.smithi129.stdout:6/911: dwrite d7/d1b/d1e/d39/d4b/de8/fac [4194304,4194304] 0 2024-09-21T08:02:39.707 INFO:tasks.workunit.client.1.smithi129.stdout:0/909: dread de/d22/d27/d10a/f8e [0,4194304] 0 2024-09-21T08:02:39.710 INFO:tasks.workunit.client.1.smithi129.stdout:0/910: unlink de/d1f/dd4/db1/cb8 0 2024-09-21T08:02:39.711 INFO:tasks.workunit.client.1.smithi129.stdout:6/912: symlink d7/d10/dcc/l12d 0 2024-09-21T08:02:39.711 INFO:tasks.workunit.client.1.smithi129.stdout:6/913: write f5 [704430,18764] 0 2024-09-21T08:02:39.712 INFO:tasks.workunit.client.1.smithi129.stdout:6/914: symlink d7/d1b/d1e/d39/d4b/de8/d69/dfa/l12e 0 2024-09-21T08:02:39.713 INFO:tasks.workunit.client.1.smithi129.stdout:6/915: unlink d7/d1b/d1e/fb5 0 2024-09-21T08:02:39.714 INFO:tasks.workunit.client.1.smithi129.stdout:6/916: rmdir d7/d1b/d1e/d66/d7c 39 2024-09-21T08:02:39.719 INFO:tasks.workunit.client.1.smithi129.stdout:4/862: dwrite d5/da5/fb3 [0,4194304] 0 2024-09-21T08:02:39.743 INFO:tasks.workunit.client.1.smithi129.stdout:6/917: dread d7/d1b/d1e/d66/dc2/d5e/fa0 [0,4194304] 0 2024-09-21T08:02:39.743 INFO:tasks.workunit.client.1.smithi129.stdout:6/918: truncate d7/fd 4856627 0 2024-09-21T08:02:39.745 INFO:tasks.workunit.client.1.smithi129.stdout:6/919: mkdir d7/d1b/d8d/d12f 0 2024-09-21T08:02:39.745 INFO:tasks.workunit.client.0.smithi107.stdout:5/186: dwrite d7/ff [4194304,4194304] 0 2024-09-21T08:02:39.745 INFO:tasks.workunit.client.0.smithi107.stdout:5/187: chown d7/f39 6 1 2024-09-21T08:02:39.745 INFO:tasks.workunit.client.0.smithi107.stdout:5/188: read - d7/de/d1d/d29/f3c zero size 2024-09-21T08:02:39.745 INFO:tasks.workunit.client.0.smithi107.stdout:4/151: dwrite dc/d13/f2a [0,4194304] 0 2024-09-21T08:02:39.745 INFO:tasks.workunit.client.1.smithi129.stdout:4/863: write d5/d16/d47/d5f/d64/f124 [4139253,88938] 0 2024-09-21T08:02:39.750 INFO:tasks.workunit.client.1.smithi129.stdout:4/864: mkdir d5/da5/d130 0 2024-09-21T08:02:39.752 INFO:tasks.workunit.client.1.smithi129.stdout:6/920: dread d7/d1b/d1e/fe3 [0,4194304] 0 2024-09-21T08:02:39.752 INFO:tasks.workunit.client.1.smithi129.stdout:9/884: dwrite d17/d22/d33/d7a/d89/fb4 [0,4194304] 0 2024-09-21T08:02:39.752 INFO:tasks.workunit.client.1.smithi129.stdout:9/885: fsync d17/ff5 0 2024-09-21T08:02:39.753 INFO:tasks.workunit.client.1.smithi129.stdout:6/921: creat d7/d1b/d1e/d39/d4b/de8/d69/d89/f130 x:0 0 0 2024-09-21T08:02:39.753 INFO:tasks.workunit.client.1.smithi129.stdout:9/886: truncate d17/d22/d33/d7a/d89/d90/db1/f43 5806652 0 2024-09-21T08:02:39.753 INFO:tasks.workunit.client.1.smithi129.stdout:9/887: stat d17/d22/d33/d7a/f10b 0 2024-09-21T08:02:39.753 INFO:tasks.workunit.client.1.smithi129.stdout:9/888: readlink d17/d23/l11a 0 2024-09-21T08:02:39.753 INFO:tasks.workunit.client.0.smithi107.stdout:6/213: dwrite d2/fd [4194304,4194304] 0 2024-09-21T08:02:39.753 INFO:tasks.workunit.client.0.smithi107.stdout:6/214: fdatasync d2/d3/f26 0 2024-09-21T08:02:39.754 INFO:tasks.workunit.client.1.smithi129.stdout:4/865: rmdir d5/d11/d3f 39 2024-09-21T08:02:39.754 INFO:tasks.workunit.client.1.smithi129.stdout:0/911: dwrite f7 [0,4194304] 0 2024-09-21T08:02:39.754 INFO:tasks.workunit.client.1.smithi129.stdout:0/912: write de/d1f/f34 [1234852,92681] 0 2024-09-21T08:02:39.754 INFO:tasks.workunit.client.1.smithi129.stdout:0/913: readlink de/d22/l74 0 2024-09-21T08:02:39.754 INFO:tasks.workunit.client.1.smithi129.stdout:0/914: fsync de/f36 0 2024-09-21T08:02:39.755 INFO:tasks.workunit.client.0.smithi107.stdout:4/152: mkdir dc/d13/d2e 0 2024-09-21T08:02:39.755 INFO:tasks.workunit.client.0.smithi107.stdout:4/153: chown dc/f29 202639 1 2024-09-21T08:02:39.755 INFO:tasks.workunit.client.0.smithi107.stdout:4/154: chown dc/l22 625976958 1 2024-09-21T08:02:39.755 INFO:tasks.workunit.client.0.smithi107.stdout:4/155: readlink dc/lf 0 2024-09-21T08:02:39.761 INFO:tasks.workunit.client.1.smithi129.stdout:4/866: unlink d5/d33/d6d/f11d 0 2024-09-21T08:02:39.761 INFO:tasks.workunit.client.1.smithi129.stdout:4/867: fsync d5/d16/fd3 0 2024-09-21T08:02:39.761 INFO:tasks.workunit.client.1.smithi129.stdout:4/868: stat d5/d33/d4e/lb6 0 2024-09-21T08:02:39.763 INFO:tasks.workunit.client.1.smithi129.stdout:8/779: rmdir d0/d6/d7/d24 39 2024-09-21T08:02:39.768 INFO:tasks.workunit.client.0.smithi107.stdout:9/232: write d11/f20 [2713813,122812] 0 2024-09-21T08:02:39.770 INFO:tasks.workunit.client.0.smithi107.stdout:5/189: dwrite d7/de/d1d/f37 [0,4194304] 0 2024-09-21T08:02:39.770 INFO:tasks.workunit.client.0.smithi107.stdout:5/190: write d7/de/d1d/d29/f33 [1354271,21347] 0 2024-09-21T08:02:39.770 INFO:tasks.workunit.client.0.smithi107.stdout:5/191: readlink d7/de/d1d/d24/l36 0 2024-09-21T08:02:39.770 INFO:tasks.workunit.client.1.smithi129.stdout:9/889: getdents d17/d22/d33/da5 0 2024-09-21T08:02:39.770 INFO:tasks.workunit.client.1.smithi129.stdout:9/890: chown d17/d22/d33/de6/d11d 2075609613 1 2024-09-21T08:02:39.773 INFO:tasks.workunit.client.1.smithi129.stdout:8/780: read d0/d6/d7/d18/d27/f90 [1703292,63787] 0 2024-09-21T08:02:39.781 INFO:tasks.workunit.client.0.smithi107.stdout:5/192: rename d7/f2a to d7/de/d1d/d29/f40 0 2024-09-21T08:02:39.784 INFO:tasks.workunit.client.0.smithi107.stdout:9/233: rmdir d11/d27/d2f/d3a 39 2024-09-21T08:02:39.786 INFO:tasks.workunit.client.1.smithi129.stdout:6/922: dwrite d7/d1b/d1e/d39/d4b/fa2 [0,4194304] 0 2024-09-21T08:02:39.789 INFO:tasks.workunit.client.0.smithi107.stdout:6/215: dwrite d2/d3/f22 [0,4194304] 0 2024-09-21T08:02:39.789 INFO:tasks.workunit.client.0.smithi107.stdout:6/216: truncate d2/d3/d7/d24/f2c 2846836 0 2024-09-21T08:02:39.790 INFO:tasks.workunit.client.0.smithi107.stdout:6/217: readlink d2/d3/l3e 0 2024-09-21T08:02:39.790 INFO:tasks.workunit.client.1.smithi129.stdout:8/781: dwrite d0/d6/d7/d9/d94/fc6 [0,4194304] 0 2024-09-21T08:02:39.790 INFO:tasks.workunit.client.1.smithi129.stdout:8/782: chown d0/d6/d7/d3a/cb1 0 1 2024-09-21T08:02:39.790 INFO:tasks.workunit.client.1.smithi129.stdout:8/783: truncate d0/d6/d7/d18/d27/d60/d85/faa 723664 0 2024-09-21T08:02:39.790 INFO:tasks.workunit.client.1.smithi129.stdout:8/784: truncate d0/d6/d7/d18/fae 1297158 0 2024-09-21T08:02:39.790 INFO:tasks.workunit.client.1.smithi129.stdout:0/915: dwrite de/d81/d94/ffe [0,4194304] 0 2024-09-21T08:02:39.791 INFO:tasks.workunit.client.1.smithi129.stdout:6/923: mknod d7/d1b/d1e/d39/d4b/de8/d69/d89/c131 0 2024-09-21T08:02:39.793 INFO:tasks.workunit.client.0.smithi107.stdout:9/234: truncate d11/f3e 1965759 0 2024-09-21T08:02:39.801 INFO:tasks.workunit.client.1.smithi129.stdout:8/785: mkdir d0/d6/d7/ded 0 2024-09-21T08:02:39.803 INFO:tasks.workunit.client.0.smithi107.stdout:9/235: dread d11/d27/d2a/f41 [0,4194304] 0 2024-09-21T08:02:39.803 INFO:tasks.workunit.client.0.smithi107.stdout:9/236: write d11/f37 [1797118,77390] 0 2024-09-21T08:02:39.804 INFO:tasks.workunit.client.1.smithi129.stdout:0/916: rmdir de/d19/d5e 39 2024-09-21T08:02:39.805 INFO:tasks.workunit.client.0.smithi107.stdout:9/237: write d11/f21 [277241,20187] 0 2024-09-21T08:02:39.805 INFO:tasks.workunit.client.0.smithi107.stdout:9/238: write d11/d27/d2a/f42 [662142,77878] 0 2024-09-21T08:02:39.806 INFO:tasks.workunit.client.0.smithi107.stdout:5/193: dwrite d7/f8 [0,4194304] 0 2024-09-21T08:02:39.807 INFO:tasks.workunit.client.1.smithi129.stdout:6/924: unlink d7/d1b/d1e/d66/dc2/de2/d40/f10e 0 2024-09-21T08:02:39.807 INFO:tasks.workunit.client.1.smithi129.stdout:6/925: dread - d7/d1b/d1e/d66/dc2/d93/f10f zero size 2024-09-21T08:02:39.807 INFO:tasks.workunit.client.0.smithi107.stdout:6/218: dwrite d2/d3/d7/f8 [0,4194304] 0 2024-09-21T08:02:39.807 INFO:tasks.workunit.client.0.smithi107.stdout:6/219: readlink d2/d3/d7/d23/l3d 0 2024-09-21T08:02:39.808 INFO:tasks.workunit.client.1.smithi129.stdout:8/786: truncate d0/d6/d7/d18/d27/d32/f91 172886 0 2024-09-21T08:02:39.808 INFO:tasks.workunit.client.1.smithi129.stdout:8/787: stat d0/d6/d7/d9/c1e 0 2024-09-21T08:02:39.809 INFO:tasks.workunit.client.0.smithi107.stdout:5/194: mknod d7/de/d1d/d24/c41 0 2024-09-21T08:02:39.810 INFO:tasks.workunit.client.1.smithi129.stdout:0/917: chown de/d81/d10e/dc0/dfb/d11e/cd0 172 1 2024-09-21T08:02:39.810 INFO:tasks.workunit.client.1.smithi129.stdout:0/918: chown de/d15/d39 59 1 2024-09-21T08:02:39.810 INFO:tasks.workunit.client.1.smithi129.stdout:0/919: fdatasync de/d1f/dd4/db1/df5/d113/f117 0 2024-09-21T08:02:39.813 INFO:tasks.workunit.client.1.smithi129.stdout:8/788: creat d0/d6/d7/d18/d27/d60/d85/fee x:0 0 0 2024-09-21T08:02:39.816 INFO:tasks.workunit.client.0.smithi107.stdout:6/220: unlink d2/f18 0 2024-09-21T08:02:39.816 INFO:tasks.workunit.client.0.smithi107.stdout:9/239: dread d11/d27/d39/f47 [0,4194304] 0 2024-09-21T08:02:39.816 INFO:tasks.workunit.client.0.smithi107.stdout:9/240: read - d11/d24/d35/f4e zero size 2024-09-21T08:02:39.822 INFO:tasks.workunit.client.1.smithi129.stdout:8/789: dread d0/d6/d7/d18/d27/f2d [4194304,4194304] 0 2024-09-21T08:02:39.824 INFO:tasks.workunit.client.1.smithi129.stdout:6/926: write d7/d1b/d1e/d39/d4b/f1d [3888409,1029] 0 2024-09-21T08:02:39.824 INFO:tasks.workunit.client.1.smithi129.stdout:8/790: truncate d0/d6/d7/d9/f5f 2731132 0 2024-09-21T08:02:39.826 INFO:tasks.workunit.client.1.smithi129.stdout:8/791: getdents d0/d6/d7/d18/d27/d32/d3d/d7b/dbf 0 2024-09-21T08:02:39.829 INFO:tasks.workunit.client.1.smithi129.stdout:8/792: unlink d0/d6/d7/d18/cc3 0 2024-09-21T08:02:39.829 INFO:tasks.workunit.client.1.smithi129.stdout:0/920: dread f0 [0,4194304] 0 2024-09-21T08:02:39.830 INFO:tasks.workunit.client.1.smithi129.stdout:0/921: stat de/d15/d39/d9e/ff6 0 2024-09-21T08:02:39.830 INFO:tasks.workunit.client.1.smithi129.stdout:0/922: readlink de/d15/d44/d45/lf9 0 2024-09-21T08:02:39.830 INFO:tasks.workunit.client.1.smithi129.stdout:8/793: creat d0/d6/d7/d9/fef x:0 0 0 2024-09-21T08:02:39.830 INFO:tasks.workunit.client.1.smithi129.stdout:8/794: readlink d0/d6/d7/l25 0 2024-09-21T08:02:39.830 INFO:tasks.workunit.client.1.smithi129.stdout:8/795: fdatasync d0/d6/d7/d9/f7d 0 2024-09-21T08:02:39.832 INFO:tasks.workunit.client.1.smithi129.stdout:0/923: creat de/d15/d39/d56/def/f125 x:0 0 0 2024-09-21T08:02:39.834 INFO:tasks.workunit.client.0.smithi107.stdout:5/195: dwrite d7/de/d1d/f28 [0,4194304] 0 2024-09-21T08:02:39.839 INFO:tasks.workunit.client.1.smithi129.stdout:8/796: dread d0/f16 [0,4194304] 0 2024-09-21T08:02:39.840 INFO:tasks.workunit.client.0.smithi107.stdout:5/196: rename d7/de/f13 to d7/de/d35/f42 0 2024-09-21T08:02:39.840 INFO:tasks.workunit.client.0.smithi107.stdout:5/197: fdatasync d7/ff 0 2024-09-21T08:02:39.841 INFO:tasks.workunit.client.0.smithi107.stdout:5/198: getdents d7/de/d1d/d24/d3d 0 2024-09-21T08:02:39.843 INFO:tasks.workunit.client.0.smithi107.stdout:5/199: link d7/de/f32 d7/de/d35/f43 0 2024-09-21T08:02:39.845 INFO:tasks.workunit.client.0.smithi107.stdout:5/200: unlink d7/de/l1c 0 2024-09-21T08:02:39.848 INFO:tasks.workunit.client.0.smithi107.stdout:6/221: dwrite d2/d3/d7/f1f [0,4194304] 0 2024-09-21T08:02:39.848 INFO:tasks.workunit.client.0.smithi107.stdout:6/222: truncate d2/d3/d7/d23/d2b/f2f 453929 0 2024-09-21T08:02:39.852 INFO:tasks.workunit.client.1.smithi129.stdout:0/924: dwrite de/d15/d39/d9e/ff6 [0,4194304] 0 2024-09-21T08:02:39.852 INFO:tasks.workunit.client.1.smithi129.stdout:8/797: write d0/f2b [5523617,108237] 0 2024-09-21T08:02:39.853 INFO:tasks.workunit.client.0.smithi107.stdout:9/241: dwrite d11/d27/d2a/f41 [0,4194304] 0 2024-09-21T08:02:39.854 INFO:tasks.workunit.client.1.smithi129.stdout:0/925: fdatasync de/d81/d10e/dc0/dfb/d11e/fc7 0 2024-09-21T08:02:39.854 INFO:tasks.workunit.client.1.smithi129.stdout:0/926: readlink de/d15/d39/d9e/lfc 0 2024-09-21T08:02:39.855 INFO:tasks.workunit.client.0.smithi107.stdout:9/242: getdents d11/d27/d2a 0 2024-09-21T08:02:39.856 INFO:tasks.workunit.client.0.smithi107.stdout:9/243: write d11/f20 [652259,247] 0 2024-09-21T08:02:39.857 INFO:tasks.workunit.client.0.smithi107.stdout:5/201: write d7/de/d35/f43 [3849971,15883] 0 2024-09-21T08:02:39.858 INFO:tasks.workunit.client.0.smithi107.stdout:9/244: mkdir d11/d27/d5b 0 2024-09-21T08:02:39.859 INFO:tasks.workunit.client.0.smithi107.stdout:8/87: sync 2024-09-21T08:02:39.859 INFO:tasks.workunit.client.0.smithi107.stdout:2/108: sync 2024-09-21T08:02:39.859 INFO:tasks.workunit.client.0.smithi107.stdout:7/125: sync 2024-09-21T08:02:39.859 INFO:tasks.workunit.client.0.smithi107.stdout:1/144: sync 2024-09-21T08:02:39.859 INFO:tasks.workunit.client.0.smithi107.stdout:3/147: sync 2024-09-21T08:02:39.859 INFO:tasks.workunit.client.0.smithi107.stdout:7/126: write d7/d22/f2d [578331,29042] 0 2024-09-21T08:02:39.859 INFO:tasks.workunit.client.0.smithi107.stdout:1/145: creat d0/d29/d2c/f30 x:0 0 0 2024-09-21T08:02:39.859 INFO:tasks.workunit.client.0.smithi107.stdout:1/146: dread - d0/d29/d2c/f30 zero size 2024-09-21T08:02:39.861 INFO:tasks.workunit.client.0.smithi107.stdout:9/245: rename d11/d27/d2f/d3a to d11/d27/d2f/d4d/d5c 0 2024-09-21T08:02:39.863 INFO:tasks.workunit.client.0.smithi107.stdout:6/223: dread d2/d3/f22 [0,4194304] 0 2024-09-21T08:02:39.863 INFO:tasks.workunit.client.0.smithi107.stdout:6/224: write d2/d3/f26 [752770,119790] 0 2024-09-21T08:02:39.863 INFO:tasks.workunit.client.0.smithi107.stdout:8/88: unlink f1 0 2024-09-21T08:02:39.864 INFO:tasks.workunit.client.0.smithi107.stdout:3/148: stat c3 0 2024-09-21T08:02:39.865 INFO:tasks.workunit.client.1.smithi129.stdout:0/927: dread de/d22/d27/f2d [0,4194304] 0 2024-09-21T08:02:39.865 INFO:tasks.workunit.client.1.smithi129.stdout:0/928: rename de/d1f to de/d1f/d126 22 2024-09-21T08:02:39.868 INFO:tasks.workunit.client.0.smithi107.stdout:6/225: rmdir d2/d3/d7/d24/d41 39 2024-09-21T08:02:39.869 INFO:tasks.workunit.client.1.smithi129.stdout:4/869: sync 2024-09-21T08:02:39.869 INFO:tasks.workunit.client.1.smithi129.stdout:4/870: fsync d5/d33/d4e/da7/fc1 0 2024-09-21T08:02:39.869 INFO:tasks.workunit.client.1.smithi129.stdout:9/891: sync 2024-09-21T08:02:39.870 INFO:tasks.workunit.client.1.smithi129.stdout:0/929: mknod de/d22/d27/d85/db2/c127 0 2024-09-21T08:02:39.870 INFO:tasks.workunit.client.1.smithi129.stdout:0/930: getdents de/d15/d44/d4b/dcc 0 2024-09-21T08:02:39.870 INFO:tasks.workunit.client.1.smithi129.stdout:0/931: stat de/d22/c2c 0 2024-09-21T08:02:39.873 INFO:tasks.workunit.client.0.smithi107.stdout:8/89: creat d5/d23/f25 x:0 0 0 2024-09-21T08:02:39.874 INFO:tasks.workunit.client.0.smithi107.stdout:8/90: creat d5/d1d/f26 x:0 0 0 2024-09-21T08:02:39.874 INFO:tasks.workunit.client.0.smithi107.stdout:3/149: symlink d8/d14/l27 0 2024-09-21T08:02:39.875 INFO:tasks.workunit.client.1.smithi129.stdout:0/932: mkdir de/d1f/dd4/db1/df5/d128 0 2024-09-21T08:02:39.876 INFO:tasks.workunit.client.0.smithi107.stdout:9/246: getdents d11/d27/d39 0 2024-09-21T08:02:39.878 INFO:tasks.workunit.client.0.smithi107.stdout:2/109: dread d1/d16/f17 [0,4194304] 0 2024-09-21T08:02:39.880 INFO:tasks.workunit.client.0.smithi107.stdout:6/226: dread d2/d3/d7/d24/f2c [0,4194304] 0 2024-09-21T08:02:39.882 INFO:tasks.workunit.client.0.smithi107.stdout:3/150: rmdir d8/d14/d1d 39 2024-09-21T08:02:39.883 INFO:tasks.workunit.client.0.smithi107.stdout:1/147: dwrite d0/d7/f1a [4194304,4194304] 0 2024-09-21T08:02:39.884 INFO:tasks.workunit.client.0.smithi107.stdout:2/110: stat d1/d2/c1d 0 2024-09-21T08:02:39.885 INFO:tasks.workunit.client.1.smithi129.stdout:0/933: rmdir de/d81/d10e 39 2024-09-21T08:02:39.886 INFO:tasks.workunit.client.0.smithi107.stdout:3/151: mknod d8/d14/d1d/c28 0 2024-09-21T08:02:39.887 INFO:tasks.workunit.client.1.smithi129.stdout:0/934: mkdir de/d15/d39/d9e/dac/d129 0 2024-09-21T08:02:39.888 INFO:tasks.workunit.client.0.smithi107.stdout:9/247: getdents d11/d24/d26 0 2024-09-21T08:02:39.889 INFO:tasks.workunit.client.0.smithi107.stdout:2/111: mkdir d1/d1e/d23 0 2024-09-21T08:02:39.889 INFO:tasks.workunit.client.0.smithi107.stdout:2/112: readlink d1/d6/l22 0 2024-09-21T08:02:39.890 INFO:tasks.workunit.client.0.smithi107.stdout:5/202: dwrite d7/de/d1d/f28 [0,4194304] 0 2024-09-21T08:02:39.890 INFO:tasks.workunit.client.0.smithi107.stdout:5/203: truncate d7/f39 512930 0 2024-09-21T08:02:39.890 INFO:tasks.workunit.client.0.smithi107.stdout:7/127: dwrite f3 [0,4194304] 0 2024-09-21T08:02:39.890 INFO:tasks.workunit.client.1.smithi129.stdout:0/935: mkdir de/d15/d39/d56/def/d12a 0 2024-09-21T08:02:39.890 INFO:tasks.workunit.client.1.smithi129.stdout:0/936: fsync de/d15/d44/d4b/f110 0 2024-09-21T08:02:39.891 INFO:tasks.workunit.client.0.smithi107.stdout:9/248: mknod d11/d24/d35/c5d 0 2024-09-21T08:02:39.891 INFO:tasks.workunit.client.0.smithi107.stdout:9/249: fsync d11/d27/d2a/f41 0 2024-09-21T08:02:39.891 INFO:tasks.workunit.client.0.smithi107.stdout:9/250: fsync d11/d27/d39/f54 0 2024-09-21T08:02:39.891 INFO:tasks.workunit.client.0.smithi107.stdout:9/251: write d11/d27/d2f/d4d/f59 [1880349,27405] 0 2024-09-21T08:02:39.891 INFO:tasks.workunit.client.0.smithi107.stdout:9/252: stat d11/f37 0 2024-09-21T08:02:39.892 INFO:tasks.workunit.client.0.smithi107.stdout:2/113: rename d1/d16/c1b to d1/c24 0 2024-09-21T08:02:39.894 INFO:tasks.workunit.client.0.smithi107.stdout:9/253: mkdir d11/d27/d5e 0 2024-09-21T08:02:39.895 INFO:tasks.workunit.client.0.smithi107.stdout:7/128: dread d7/d10/f17 [0,4194304] 0 2024-09-21T08:02:39.895 INFO:tasks.workunit.client.0.smithi107.stdout:9/254: creat d11/f5f x:0 0 0 2024-09-21T08:02:39.895 INFO:tasks.workunit.client.0.smithi107.stdout:9/255: getdents d11/d27/d2a 0 2024-09-21T08:02:39.896 INFO:tasks.workunit.client.0.smithi107.stdout:9/256: chown d11/d27/d2a 17195 1 2024-09-21T08:02:39.896 INFO:tasks.workunit.client.0.smithi107.stdout:6/227: dread d2/fd [4194304,4194304] 0 2024-09-21T08:02:39.897 INFO:tasks.workunit.client.0.smithi107.stdout:5/204: dread d7/f39 [0,4194304] 0 2024-09-21T08:02:39.897 INFO:tasks.workunit.client.1.smithi129.stdout:0/937: dread de/d15/f28 [0,4194304] 0 2024-09-21T08:02:39.907 INFO:tasks.workunit.client.0.smithi107.stdout:6/228: write d2/d3/f22 [1795650,18390] 0 2024-09-21T08:02:39.907 INFO:tasks.workunit.client.0.smithi107.stdout:6/229: fsync d2/d3/d7/f42 0 2024-09-21T08:02:39.908 INFO:tasks.workunit.client.0.smithi107.stdout:7/129: read d7/d18/f19 [3032925,125194] 0 2024-09-21T08:02:39.912 INFO:tasks.workunit.client.0.smithi107.stdout:7/130: rename d7/d10/f21 to d7/d10/d28/f2f 0 2024-09-21T08:02:39.913 INFO:tasks.workunit.client.1.smithi129.stdout:0/938: dread de/d22/d27/d10a/d42/f77 [0,4194304] 0 2024-09-21T08:02:39.913 INFO:tasks.workunit.client.0.smithi107.stdout:8/91: dwrite d5/f14 [0,4194304] 0 2024-09-21T08:02:39.914 INFO:tasks.workunit.client.0.smithi107.stdout:5/205: dread d7/de/d35/f42 [4194304,4194304] 0 2024-09-21T08:02:39.918 INFO:tasks.workunit.client.1.smithi129.stdout:4/871: dwrite d5/d16/f1f [0,4194304] 0 2024-09-21T08:02:39.919 INFO:tasks.workunit.client.1.smithi129.stdout:0/939: creat de/d22/d27/d10a/d42/d102/f12b x:0 0 0 2024-09-21T08:02:39.919 INFO:tasks.workunit.client.1.smithi129.stdout:0/940: fsync de/d81/d10e/f11b 0 2024-09-21T08:02:39.920 INFO:tasks.workunit.client.0.smithi107.stdout:1/148: dwrite d0/d29/d2c/f30 [0,4194304] 0 2024-09-21T08:02:39.920 INFO:tasks.workunit.client.0.smithi107.stdout:5/206: dread d7/de/f1b [0,4194304] 0 2024-09-21T08:02:39.922 INFO:tasks.workunit.client.1.smithi129.stdout:4/872: creat d5/d16/d47/f131 x:0 0 0 2024-09-21T08:02:39.925 INFO:tasks.workunit.client.1.smithi129.stdout:0/941: mkdir de/d15/d44/d45/d12c 0 2024-09-21T08:02:39.925 INFO:tasks.workunit.client.1.smithi129.stdout:0/942: chown de/d81/fa7 446366627 1 2024-09-21T08:02:39.925 INFO:tasks.workunit.client.1.smithi129.stdout:0/943: readlink de/lb0 0 2024-09-21T08:02:39.925 INFO:tasks.workunit.client.0.smithi107.stdout:8/92: chown d5/d1d/f1e 20770 1 2024-09-21T08:02:39.926 INFO:tasks.workunit.client.0.smithi107.stdout:3/152: dwrite d8/f11 [0,4194304] 0 2024-09-21T08:02:39.927 INFO:tasks.workunit.client.0.smithi107.stdout:9/257: dwrite d11/f21 [0,4194304] 0 2024-09-21T08:02:39.927 INFO:tasks.workunit.client.0.smithi107.stdout:2/114: dwrite d1/d16/f17 [0,4194304] 0 2024-09-21T08:02:39.928 INFO:tasks.workunit.client.0.smithi107.stdout:7/131: getdents d7/d18 0 2024-09-21T08:02:39.928 INFO:tasks.workunit.client.0.smithi107.stdout:3/153: read d8/f15 [11248,30634] 0 2024-09-21T08:02:39.928 INFO:tasks.workunit.client.0.smithi107.stdout:3/154: chown d8/ld 23 1 2024-09-21T08:02:39.929 INFO:tasks.workunit.client.0.smithi107.stdout:7/132: write d7/d10/f17 [3646,120697] 0 2024-09-21T08:02:39.930 INFO:tasks.workunit.client.1.smithi129.stdout:4/873: symlink d5/d16/d85/l132 0 2024-09-21T08:02:39.932 INFO:tasks.workunit.client.0.smithi107.stdout:2/115: dread d1/f3 [0,4194304] 0 2024-09-21T08:02:39.932 INFO:tasks.workunit.client.1.smithi129.stdout:0/944: rename de/lb0 to de/d1f/dd4/db1/l12d 0 2024-09-21T08:02:39.932 INFO:tasks.workunit.client.1.smithi129.stdout:0/945: dread - de/d1f/da9/f116 zero size 2024-09-21T08:02:39.933 INFO:tasks.workunit.client.0.smithi107.stdout:5/207: creat d7/de/d1d/d24/d3d/f44 x:0 0 0 2024-09-21T08:02:39.933 INFO:tasks.workunit.client.0.smithi107.stdout:5/208: dread - d7/de/d1d/f31 zero size 2024-09-21T08:02:39.934 INFO:tasks.workunit.client.0.smithi107.stdout:5/209: write d7/f39 [25055,37653] 0 2024-09-21T08:02:39.934 INFO:tasks.workunit.client.0.smithi107.stdout:5/210: write d7/de/f1a [1749023,123453] 0 2024-09-21T08:02:39.935 INFO:tasks.workunit.client.1.smithi129.stdout:4/874: rename d5/da5/db1/ff5 to d5/dbd/f133 0 2024-09-21T08:02:39.941 INFO:tasks.workunit.client.0.smithi107.stdout:1/149: dwrite d0/d29/d2c/f2e [0,4194304] 0 2024-09-21T08:02:39.944 INFO:tasks.workunit.client.1.smithi129.stdout:0/946: dread de/d19/d5e/fbb [0,4194304] 0 2024-09-21T08:02:39.944 INFO:tasks.workunit.client.1.smithi129.stdout:0/947: chown de/d19/f119 48056988 1 2024-09-21T08:02:39.944 INFO:tasks.workunit.client.1.smithi129.stdout:4/875: rmdir d5/d33/d4e/da7/d123/d89 0 2024-09-21T08:02:39.947 INFO:tasks.workunit.client.0.smithi107.stdout:9/258: unlink d11/d27/d2f/d4d/d5c/c55 0 2024-09-21T08:02:39.949 INFO:tasks.workunit.client.1.smithi129.stdout:0/948: mknod de/d1f/dd4/db1/c12e 0 2024-09-21T08:02:39.953 INFO:tasks.workunit.client.1.smithi129.stdout:6/927: sync 2024-09-21T08:02:39.953 INFO:tasks.workunit.client.1.smithi129.stdout:6/928: chown d7/d1b/f49 352775 1 2024-09-21T08:02:39.953 INFO:tasks.workunit.client.1.smithi129.stdout:8/798: sync 2024-09-21T08:02:39.956 INFO:tasks.workunit.client.1.smithi129.stdout:6/929: symlink d7/d1b/d1e/d39/d79/db8/l132 0 2024-09-21T08:02:39.956 INFO:tasks.workunit.client.1.smithi129.stdout:6/930: write d7/d1b/d1e/d39/d4b/fc5 [3806041,49252] 0 2024-09-21T08:02:39.956 INFO:tasks.workunit.client.1.smithi129.stdout:6/931: write f5 [1466064,10086] 0 2024-09-21T08:02:39.956 INFO:tasks.workunit.client.0.smithi107.stdout:3/155: truncate d8/fe 1919310 0 2024-09-21T08:02:39.958 INFO:tasks.workunit.client.1.smithi129.stdout:8/799: link d0/d6/dac/feb d0/d6/d7/d18/d27/d32/d3d/d7b/dbf/ff0 0 2024-09-21T08:02:39.958 INFO:tasks.workunit.client.1.smithi129.stdout:8/800: write d0/d6/d7/d9/f7d [1325015,72899] 0 2024-09-21T08:02:39.958 INFO:tasks.workunit.client.1.smithi129.stdout:8/801: chown d0/d6/d7/d18/d27/d32/d3d/d83/c8b 16224 1 2024-09-21T08:02:39.959 INFO:tasks.workunit.client.1.smithi129.stdout:6/932: creat d7/d1b/d57/d96/d127/f133 x:0 0 0 2024-09-21T08:02:39.959 INFO:tasks.workunit.client.1.smithi129.stdout:6/933: dread - d7/d1b/d1e/d66/f123 zero size 2024-09-21T08:02:39.959 INFO:tasks.workunit.client.0.smithi107.stdout:2/116: creat d1/d1e/d23/f25 x:0 0 0 2024-09-21T08:02:39.959 INFO:tasks.workunit.client.0.smithi107.stdout:2/117: dread - d1/f10 zero size 2024-09-21T08:02:39.960 INFO:tasks.workunit.client.1.smithi129.stdout:0/949: read de/d1f/da9/f98 [3729363,126344] 0 2024-09-21T08:02:39.960 INFO:tasks.workunit.client.0.smithi107.stdout:8/93: mknod d5/c27 0 2024-09-21T08:02:39.961 INFO:tasks.workunit.client.1.smithi129.stdout:8/802: truncate d0/d6/d7/d18/d27/f38 2607914 0 2024-09-21T08:02:39.962 INFO:tasks.workunit.client.1.smithi129.stdout:6/934: mknod d7/d1b/d1e/d66/dba/c134 0 2024-09-21T08:02:39.964 INFO:tasks.workunit.client.1.smithi129.stdout:0/950: unlink de/d19/f66 0 2024-09-21T08:02:39.966 INFO:tasks.workunit.client.0.smithi107.stdout:1/150: rename d0/d7/d1c/d22 to d0/d29/d31 0 2024-09-21T08:02:39.966 INFO:tasks.workunit.client.1.smithi129.stdout:8/803: creat d0/d6/d7/d18/d27/d60/ff1 x:0 0 0 2024-09-21T08:02:39.967 INFO:tasks.workunit.client.0.smithi107.stdout:7/133: mknod d7/d10/c30 0 2024-09-21T08:02:39.967 INFO:tasks.workunit.client.0.smithi107.stdout:7/134: chown d7/d22/l23 62 1 2024-09-21T08:02:39.967 INFO:tasks.workunit.client.0.smithi107.stdout:7/135: fdatasync f4 0 2024-09-21T08:02:39.967 INFO:tasks.workunit.client.0.smithi107.stdout:7/136: stat d7/d10/d28 0 2024-09-21T08:02:39.968 INFO:tasks.workunit.client.1.smithi129.stdout:8/804: unlink d0/d6/d7/c31 0 2024-09-21T08:02:39.969 INFO:tasks.workunit.client.0.smithi107.stdout:5/211: mknod d7/de/c45 0 2024-09-21T08:02:39.970 INFO:tasks.workunit.client.0.smithi107.stdout:8/94: mknod d5/d23/c28 0 2024-09-21T08:02:39.970 INFO:tasks.workunit.client.1.smithi129.stdout:4/876: dwrite d5/d16/d24/d3b/f65 [0,4194304] 0 2024-09-21T08:02:39.971 INFO:tasks.workunit.client.0.smithi107.stdout:9/259: dwrite f7 [0,4194304] 0 2024-09-21T08:02:39.971 INFO:tasks.workunit.client.0.smithi107.stdout:9/260: write d11/f3e [2438705,29628] 0 2024-09-21T08:02:39.971 INFO:tasks.workunit.client.0.smithi107.stdout:9/261: dread - d11/d27/d39/d46/f50 zero size 2024-09-21T08:02:39.971 INFO:tasks.workunit.client.0.smithi107.stdout:5/212: creat d7/de/d1d/d24/f46 x:0 0 0 2024-09-21T08:02:39.971 INFO:tasks.workunit.client.0.smithi107.stdout:5/213: write d7/ff [8881108,74440] 0 2024-09-21T08:02:39.977 INFO:tasks.workunit.client.0.smithi107.stdout:9/262: creat d11/d27/d2f/d4d/f60 x:0 0 0 2024-09-21T08:02:39.981 INFO:tasks.workunit.client.0.smithi107.stdout:5/214: mkdir d7/d47 0 2024-09-21T08:02:39.981 INFO:tasks.workunit.client.0.smithi107.stdout:5/215: write d7/de/d1d/d24/d3d/f44 [726737,119346] 0 2024-09-21T08:02:39.983 INFO:tasks.workunit.client.0.smithi107.stdout:8/95: mknod d5/c29 0 2024-09-21T08:02:39.984 INFO:tasks.workunit.client.0.smithi107.stdout:3/156: dread d8/f11 [0,4194304] 0 2024-09-21T08:02:39.987 INFO:tasks.workunit.client.0.smithi107.stdout:5/216: rename d7/f21 to d7/de/d1d/f48 0 2024-09-21T08:02:39.989 INFO:tasks.workunit.client.0.smithi107.stdout:0/261: sync 2024-09-21T08:02:39.989 INFO:tasks.workunit.client.0.smithi107.stdout:0/262: chown d1/d5/f24 5 1 2024-09-21T08:02:39.990 INFO:tasks.workunit.client.0.smithi107.stdout:0/263: truncate d1/d5/d25/f40 1008685 0 2024-09-21T08:02:39.992 INFO:tasks.workunit.client.0.smithi107.stdout:5/217: rename d7/c38 to d7/de/d2d/c49 0 2024-09-21T08:02:39.993 INFO:tasks.workunit.client.0.smithi107.stdout:5/218: write d7/f34 [4272326,71349] 0 2024-09-21T08:02:39.993 INFO:tasks.workunit.client.0.smithi107.stdout:9/263: read f7 [3645020,109696] 0 2024-09-21T08:02:39.993 INFO:tasks.workunit.client.0.smithi107.stdout:9/264: chown d11/d24/d35/f4e 4123912 1 2024-09-21T08:02:39.995 INFO:tasks.workunit.client.0.smithi107.stdout:5/219: mknod d7/de/d35/c4a 0 2024-09-21T08:02:39.996 INFO:tasks.workunit.client.0.smithi107.stdout:9/265: mkdir d11/d27/d2f/d4d/d5c/d61 0 2024-09-21T08:02:39.997 INFO:tasks.workunit.client.1.smithi129.stdout:6/935: dwrite d7/d1b/d1e/d39/dbf/f102 [0,4194304] 0 2024-09-21T08:02:39.997 INFO:tasks.workunit.client.0.smithi107.stdout:9/266: read d11/d24/d26/f28 [56561,29350] 0 2024-09-21T08:02:39.997 INFO:tasks.workunit.client.0.smithi107.stdout:9/267: readlink d11/d27/d2f/d4d/l52 0 2024-09-21T08:02:39.998 INFO:tasks.workunit.client.0.smithi107.stdout:9/268: truncate d11/d27/d2f/f5a 211081 0 2024-09-21T08:02:39.998 INFO:tasks.workunit.client.0.smithi107.stdout:5/220: symlink d7/de/d2d/l4b 0 2024-09-21T08:02:39.999 INFO:tasks.workunit.client.0.smithi107.stdout:9/269: symlink d11/d27/d39/l62 0 2024-09-21T08:02:40.001 INFO:tasks.workunit.client.1.smithi129.stdout:6/936: link d7/d1b/d1e/d39/dbf/l124 d7/d1b/d1e/d39/dbf/l135 0 2024-09-21T08:02:40.002 INFO:tasks.workunit.client.0.smithi107.stdout:5/221: mknod d7/de/d35/c4c 0 2024-09-21T08:02:40.004 INFO:tasks.workunit.client.0.smithi107.stdout:0/264: dread d1/fe [0,4194304] 0 2024-09-21T08:02:40.006 INFO:tasks.workunit.client.0.smithi107.stdout:8/96: dread d5/f14 [0,4194304] 0 2024-09-21T08:02:40.006 INFO:tasks.workunit.client.0.smithi107.stdout:9/270: dread d11/d27/d2a/f2c [0,4194304] 0 2024-09-21T08:02:40.006 INFO:tasks.workunit.client.0.smithi107.stdout:9/271: write d11/d27/d2f/f3b [2037984,108881] 0 2024-09-21T08:02:40.008 INFO:tasks.workunit.client.0.smithi107.stdout:0/265: creat d1/d5/d25/d2d/f59 x:0 0 0 2024-09-21T08:02:40.008 INFO:tasks.workunit.client.0.smithi107.stdout:0/266: chown d1/d5/l35 44812816 1 2024-09-21T08:02:40.008 INFO:tasks.workunit.client.0.smithi107.stdout:0/267: creat d1/f5a x:0 0 0 2024-09-21T08:02:40.008 INFO:tasks.workunit.client.0.smithi107.stdout:0/268: write d1/d5/d25/f40 [1118196,72514] 0 2024-09-21T08:02:40.009 INFO:tasks.workunit.client.1.smithi129.stdout:4/877: dwrite d5/d16/d24/d3b/fca [0,4194304] 0 2024-09-21T08:02:40.012 INFO:tasks.workunit.client.0.smithi107.stdout:8/97: chown d5/l10 21867 1 2024-09-21T08:02:40.012 INFO:tasks.workunit.client.1.smithi129.stdout:6/937: dread d7/d1b/d1e/d39/dbf/f102 [0,4194304] 0 2024-09-21T08:02:40.012 INFO:tasks.workunit.client.1.smithi129.stdout:6/938: fsync d7/d1b/d1e/d66/f123 0 2024-09-21T08:02:40.012 INFO:tasks.workunit.client.1.smithi129.stdout:6/939: write d7/d1b/d8d/f9e [4364381,34439] 0 2024-09-21T08:02:40.013 INFO:tasks.workunit.client.0.smithi107.stdout:8/98: dread f3 [0,4194304] 0 2024-09-21T08:02:40.016 INFO:tasks.workunit.client.1.smithi129.stdout:8/805: dwrite d0/d6/d7/d18/fae [0,4194304] 0 2024-09-21T08:02:40.016 INFO:tasks.workunit.client.1.smithi129.stdout:0/951: dwrite de/d19/d5e/fbb [0,4194304] 0 2024-09-21T08:02:40.016 INFO:tasks.workunit.client.1.smithi129.stdout:0/952: creat de/d19/dad/f12f x:0 0 0 2024-09-21T08:02:40.017 INFO:tasks.workunit.client.0.smithi107.stdout:8/99: chown d5/c11 0 1 2024-09-21T08:02:40.019 INFO:tasks.workunit.client.0.smithi107.stdout:5/222: dread d7/de/d1d/f28 [0,4194304] 0 2024-09-21T08:02:40.019 INFO:tasks.workunit.client.0.smithi107.stdout:7/137: dwrite d7/d22/f24 [0,4194304] 0 2024-09-21T08:02:40.020 INFO:tasks.workunit.client.0.smithi107.stdout:5/223: rename d7/de/d1d/d29 to d7/de/d1d/d29/d4d 22 2024-09-21T08:02:40.020 INFO:tasks.workunit.client.1.smithi129.stdout:4/878: rmdir d5/d16/d24/d12d 0 2024-09-21T08:02:40.020 INFO:tasks.workunit.client.1.smithi129.stdout:4/879: chown d5/d48/da9/c110 22506 1 2024-09-21T08:02:40.023 INFO:tasks.workunit.client.0.smithi107.stdout:5/224: read d7/de/d1d/d29/f33 [993299,38165] 0 2024-09-21T08:02:40.023 INFO:tasks.workunit.client.0.smithi107.stdout:5/225: readlink d7/de/l2e 0 2024-09-21T08:02:40.023 INFO:tasks.workunit.client.1.smithi129.stdout:6/940: mkdir d7/d1b/d1e/d66/dc2/d93/d136 0 2024-09-21T08:02:40.024 INFO:tasks.workunit.client.0.smithi107.stdout:8/100: mknod d5/d1d/c2a 0 2024-09-21T08:02:40.024 INFO:tasks.workunit.client.0.smithi107.stdout:8/101: write d5/f14 [4662208,48844] 0 2024-09-21T08:02:40.024 INFO:tasks.workunit.client.0.smithi107.stdout:3/157: dread d8/fe [0,4194304] 0 2024-09-21T08:02:40.024 INFO:tasks.workunit.client.0.smithi107.stdout:3/158: write d8/d21/f24 [901908,21853] 0 2024-09-21T08:02:40.030 INFO:tasks.workunit.client.0.smithi107.stdout:7/138: creat d7/f31 x:0 0 0 2024-09-21T08:02:40.031 INFO:tasks.workunit.client.1.smithi129.stdout:4/880: dread d5/d11/f31 [0,4194304] 0 2024-09-21T08:02:40.031 INFO:tasks.workunit.client.1.smithi129.stdout:4/881: chown d5/d16/d47/d5f/cc3 24148 1 2024-09-21T08:02:40.032 INFO:tasks.workunit.client.0.smithi107.stdout:9/272: dwrite d11/d27/d2f/f5a [0,4194304] 0 2024-09-21T08:02:40.034 INFO:tasks.workunit.client.1.smithi129.stdout:8/806: dwrite d0/d6/d7/d24/f35 [0,4194304] 0 2024-09-21T08:02:40.036 INFO:tasks.workunit.client.0.smithi107.stdout:5/226: unlink d7/f1f 0 2024-09-21T08:02:40.037 INFO:tasks.workunit.client.1.smithi129.stdout:6/941: creat d7/d1b/d57/d119/f137 x:0 0 0 2024-09-21T08:02:40.037 INFO:tasks.workunit.client.1.smithi129.stdout:6/942: readlink d7/d1b/d1e/d39/dbf/l11b 0 2024-09-21T08:02:40.040 INFO:tasks.workunit.client.1.smithi129.stdout:4/882: mkdir d5/d33/d4e/da7/d123/da8/dbc/d121/d134 0 2024-09-21T08:02:40.040 INFO:tasks.workunit.client.1.smithi129.stdout:4/883: readlink d5/d33/d4e/lb6 0 2024-09-21T08:02:40.040 INFO:tasks.workunit.client.1.smithi129.stdout:4/884: truncate d5/d33/d4e/da7/fc1 887637 0 2024-09-21T08:02:40.040 INFO:tasks.workunit.client.1.smithi129.stdout:4/885: truncate d5/d16/d47/d5f/d64/fc0 68160 0 2024-09-21T08:02:40.043 INFO:tasks.workunit.client.0.smithi107.stdout:3/159: truncate d8/f11 1265329 0 2024-09-21T08:02:40.050 INFO:tasks.workunit.client.0.smithi107.stdout:7/139: rename d7/l2e to d7/d22/l32 0 2024-09-21T08:02:40.050 INFO:tasks.workunit.client.1.smithi129.stdout:8/807: mknod d0/d6/d7/d18/d61/d7f/dd2/cf2 0 2024-09-21T08:02:40.052 INFO:tasks.workunit.client.1.smithi129.stdout:8/808: mknod d0/d6/d7/cf3 0 2024-09-21T08:02:40.052 INFO:tasks.workunit.client.1.smithi129.stdout:8/809: readlink d0/d6/d7/lf 0 2024-09-21T08:02:40.053 INFO:tasks.workunit.client.0.smithi107.stdout:9/273: creat d11/d27/d2a/f63 x:0 0 0 2024-09-21T08:02:40.055 INFO:tasks.workunit.client.1.smithi129.stdout:8/810: mknod d0/d6/d7/d18/d61/cf4 0 2024-09-21T08:02:40.055 INFO:tasks.workunit.client.1.smithi129.stdout:8/811: chown d0/d6/d7/d5a/f5c 30 1 2024-09-21T08:02:40.055 INFO:tasks.workunit.client.1.smithi129.stdout:8/812: creat d0/d6/d7/d18/d61/d7f/dd2/ff5 x:0 0 0 2024-09-21T08:02:40.056 INFO:tasks.workunit.client.0.smithi107.stdout:5/227: symlink d7/de/d35/l4e 0 2024-09-21T08:02:40.056 INFO:tasks.workunit.client.0.smithi107.stdout:5/228: write d7/de/f19 [1950688,61635] 0 2024-09-21T08:02:40.056 INFO:tasks.workunit.client.0.smithi107.stdout:5/229: creat d7/de/d1d/d24/f4f x:0 0 0 2024-09-21T08:02:40.058 INFO:tasks.workunit.client.0.smithi107.stdout:8/102: rmdir d5/d23 39 2024-09-21T08:02:40.058 INFO:tasks.workunit.client.0.smithi107.stdout:8/103: stat d5/d1d/c2a 0 2024-09-21T08:02:40.058 INFO:tasks.workunit.client.1.smithi129.stdout:8/813: mkdir d0/d6/d7/d9/d94/df6 0 2024-09-21T08:02:40.059 INFO:tasks.workunit.client.0.smithi107.stdout:3/160: creat d8/d25/f29 x:0 0 0 2024-09-21T08:02:40.061 INFO:tasks.workunit.client.1.smithi129.stdout:8/814: mkdir d0/df7 0 2024-09-21T08:02:40.061 INFO:tasks.workunit.client.1.smithi129.stdout:8/815: readlink d0/d6/l1b 0 2024-09-21T08:02:40.061 INFO:tasks.workunit.client.1.smithi129.stdout:8/816: stat d0/d6/dac/db9 0 2024-09-21T08:02:40.061 INFO:tasks.workunit.client.1.smithi129.stdout:8/817: fdatasync d0/d6/d7/d18/d27/d32/d3d/d83/f87 0 2024-09-21T08:02:40.061 INFO:tasks.workunit.client.1.smithi129.stdout:8/818: chown d0/d6/d7/d3a/l58 5 1 2024-09-21T08:02:40.062 INFO:tasks.workunit.client.0.smithi107.stdout:9/274: creat d11/d27/d2f/d4d/d5c/d61/f64 x:0 0 0 2024-09-21T08:02:40.062 INFO:tasks.workunit.client.1.smithi129.stdout:9/892: sync 2024-09-21T08:02:40.063 INFO:tasks.workunit.client.1.smithi129.stdout:6/943: dwrite d7/d1b/d1e/d66/dba/d2b/f3c [4194304,4194304] 0 2024-09-21T08:02:40.064 INFO:tasks.workunit.client.1.smithi129.stdout:8/819: symlink d0/d6/d7/d18/d27/d32/d3d/d7b/dbf/lf8 0 2024-09-21T08:02:40.064 INFO:tasks.workunit.client.1.smithi129.stdout:8/820: chown d0/d6/d7/d18/d61/d7f/dd2/f6e 260796 1 2024-09-21T08:02:40.064 INFO:tasks.workunit.client.1.smithi129.stdout:4/886: dwrite d5/fe8 [4194304,4194304] 0 2024-09-21T08:02:40.065 INFO:tasks.workunit.client.1.smithi129.stdout:9/893: mknod d17/d22/d33/da5/c123 0 2024-09-21T08:02:40.066 INFO:tasks.workunit.client.0.smithi107.stdout:5/230: creat d7/d47/f50 x:0 0 0 2024-09-21T08:02:40.067 INFO:tasks.workunit.client.0.smithi107.stdout:5/231: dread - d7/de/d1d/f48 zero size 2024-09-21T08:02:40.070 INFO:tasks.workunit.client.1.smithi129.stdout:4/887: dread d5/d11/d3f/d50/fa4 [0,4194304] 0 2024-09-21T08:02:40.070 INFO:tasks.workunit.client.1.smithi129.stdout:4/888: creat d5/d33/df2/f135 x:0 0 0 2024-09-21T08:02:40.071 INFO:tasks.workunit.client.0.smithi107.stdout:3/161: symlink d8/l2a 0 2024-09-21T08:02:40.072 INFO:tasks.workunit.client.0.smithi107.stdout:9/275: write d11/d27/d2a/f41 [2671067,121104] 0 2024-09-21T08:02:40.072 INFO:tasks.workunit.client.1.smithi129.stdout:8/821: creat d0/d6/d7/d9/dd5/ff9 x:0 0 0 2024-09-21T08:02:40.074 INFO:tasks.workunit.client.0.smithi107.stdout:7/140: mknod d7/d10/c33 0 2024-09-21T08:02:40.075 INFO:tasks.workunit.client.1.smithi129.stdout:9/894: creat d17/d22/d33/de6/d11d/f124 x:0 0 0 2024-09-21T08:02:40.076 INFO:tasks.workunit.client.1.smithi129.stdout:9/895: fsync d17/d22/d33/de6/d11d/f52 0 2024-09-21T08:02:40.076 INFO:tasks.workunit.client.1.smithi129.stdout:9/896: read d17/f1e [1232724,127264] 0 2024-09-21T08:02:40.076 INFO:tasks.workunit.client.1.smithi129.stdout:9/897: dread - d17/d22/d33/d7a/d89/d90/db1/d31/d5e/fa9 zero size 2024-09-21T08:02:40.077 INFO:tasks.workunit.client.0.smithi107.stdout:8/104: link d5/f19 d5/d23/f2b 0 2024-09-21T08:02:40.078 INFO:tasks.workunit.client.1.smithi129.stdout:8/822: symlink d0/d6/d7/d24/lfa 0 2024-09-21T08:02:40.079 INFO:tasks.workunit.client.0.smithi107.stdout:3/162: mkdir d8/d2b 0 2024-09-21T08:02:40.079 INFO:tasks.workunit.client.0.smithi107.stdout:3/163: chown d8/d2b 39 1 2024-09-21T08:02:40.080 INFO:tasks.workunit.client.1.smithi129.stdout:9/898: creat d17/d55/dd1/f125 x:0 0 0 2024-09-21T08:02:40.080 INFO:tasks.workunit.client.1.smithi129.stdout:6/944: dwrite d7/d1b/d1e/d66/dc2/de2/d40/d41/f61 [0,4194304] 0 2024-09-21T08:02:40.083 INFO:tasks.workunit.client.0.smithi107.stdout:7/141: rename d7/f8 to d7/d10/d28/f34 0 2024-09-21T08:02:40.084 INFO:tasks.workunit.client.1.smithi129.stdout:9/899: truncate d17/d22/d33/d36/d48/db7/fc8 3025728 0 2024-09-21T08:02:40.084 INFO:tasks.workunit.client.1.smithi129.stdout:9/900: truncate d17/d22/d33/d7a/d89/d90/db1/d31/d35/fbb 552631 0 2024-09-21T08:02:40.084 INFO:tasks.workunit.client.0.smithi107.stdout:5/232: mknod d7/de/c51 0 2024-09-21T08:02:40.085 INFO:tasks.workunit.client.0.smithi107.stdout:5/233: chown d7/de/c12 144955327 1 2024-09-21T08:02:40.085 INFO:tasks.workunit.client.1.smithi129.stdout:4/889: dread d5/d6/f7 [4194304,4194304] 0 2024-09-21T08:02:40.087 INFO:tasks.workunit.client.0.smithi107.stdout:8/105: symlink d5/d23/l2c 0 2024-09-21T08:02:40.089 INFO:tasks.workunit.client.0.smithi107.stdout:3/164: symlink d8/l2c 0 2024-09-21T08:02:40.089 INFO:tasks.workunit.client.0.smithi107.stdout:3/165: write d8/f1b [766948,26381] 0 2024-09-21T08:02:40.090 INFO:tasks.workunit.client.1.smithi129.stdout:6/945: mknod d7/d10/dcc/c138 0 2024-09-21T08:02:40.091 INFO:tasks.workunit.client.1.smithi129.stdout:6/946: dread - d7/d1b/d57/d96/d127/f133 zero size 2024-09-21T08:02:40.091 INFO:tasks.workunit.client.1.smithi129.stdout:6/947: read - d7/d1b/d1e/d66/dc2/d5e/fe9 zero size 2024-09-21T08:02:40.091 INFO:tasks.workunit.client.1.smithi129.stdout:6/948: read d7/d1b/d1e/d39/d79/ded/ff3 [374608,72399] 0 2024-09-21T08:02:40.092 INFO:tasks.workunit.client.1.smithi129.stdout:9/901: mkdir d17/d126 0 2024-09-21T08:02:40.093 INFO:tasks.workunit.client.0.smithi107.stdout:7/142: creat d7/d10/d28/f35 x:0 0 0 2024-09-21T08:02:40.093 INFO:tasks.workunit.client.0.smithi107.stdout:7/143: stat d7/d10/f1d 0 2024-09-21T08:02:40.093 INFO:tasks.workunit.client.0.smithi107.stdout:7/144: fsync d7/d22/f2d 0 2024-09-21T08:02:40.094 INFO:tasks.workunit.client.0.smithi107.stdout:7/145: readlink d7/d18/l26 0 2024-09-21T08:02:40.094 INFO:tasks.workunit.client.1.smithi129.stdout:8/823: dwrite d0/d6/d7/d5a/f8a [0,4194304] 0 2024-09-21T08:02:40.094 INFO:tasks.workunit.client.1.smithi129.stdout:8/824: dread - d0/d6/d7/d18/d61/d7f/dd2/fe8 zero size 2024-09-21T08:02:40.094 INFO:tasks.workunit.client.1.smithi129.stdout:9/902: dread d17/d22/d33/d7a/d89/f116 [0,4194304] 0 2024-09-21T08:02:40.094 INFO:tasks.workunit.client.1.smithi129.stdout:9/903: truncate d17/d46/fa2 4360549 0 2024-09-21T08:02:40.094 INFO:tasks.workunit.client.1.smithi129.stdout:4/890: rmdir d5/d48 39 2024-09-21T08:02:40.095 INFO:tasks.workunit.client.0.smithi107.stdout:8/106: link d5/c27 d5/d23/c2d 0 2024-09-21T08:02:40.097 INFO:tasks.workunit.client.1.smithi129.stdout:6/949: mknod d7/d10/dcc/c139 0 2024-09-21T08:02:40.098 INFO:tasks.workunit.client.0.smithi107.stdout:3/166: creat d8/d2b/f2d x:0 0 0 2024-09-21T08:02:40.098 INFO:tasks.workunit.client.0.smithi107.stdout:7/146: dread d7/d10/f17 [0,4194304] 0 2024-09-21T08:02:40.102 INFO:tasks.workunit.client.0.smithi107.stdout:7/147: dread d7/d22/f2d [0,4194304] 0 2024-09-21T08:02:40.103 INFO:tasks.workunit.client.1.smithi129.stdout:9/904: creat d17/d22/d33/d7a/d89/df7/f127 x:0 0 0 2024-09-21T08:02:40.103 INFO:tasks.workunit.client.1.smithi129.stdout:9/905: fdatasync d17/d22/d33/d36/d48/db7/fe2 0 2024-09-21T08:02:40.103 INFO:tasks.workunit.client.1.smithi129.stdout:9/906: readlink d17/d22/d33/d36/de8/leb 0 2024-09-21T08:02:40.103 INFO:tasks.workunit.client.1.smithi129.stdout:9/907: stat d17/d22/d33/d7a/d89/d90/db1/d31/d35 0 2024-09-21T08:02:40.105 INFO:tasks.workunit.client.0.smithi107.stdout:5/234: dwrite d7/de/d1d/f28 [4194304,4194304] 0 2024-09-21T08:02:40.106 INFO:tasks.workunit.client.1.smithi129.stdout:9/908: creat d17/d22/d33/d7a/d89/d90/db1/f128 x:0 0 0 2024-09-21T08:02:40.109 INFO:tasks.workunit.client.1.smithi129.stdout:4/891: getdents d5/d16/d24/d4f/da1 0 2024-09-21T08:02:40.114 INFO:tasks.workunit.client.1.smithi129.stdout:4/892: unlink d5/d16/d85/f126 0 2024-09-21T08:02:40.114 INFO:tasks.workunit.client.1.smithi129.stdout:4/893: fsync d5/d6/f12c 0 2024-09-21T08:02:40.116 INFO:tasks.workunit.client.0.smithi107.stdout:5/235: mkdir d7/de/d52 0 2024-09-21T08:02:40.117 INFO:tasks.workunit.client.1.smithi129.stdout:4/894: mkdir d5/d33/d4e/da7/d123/da8/dbc/d121/d136 0 2024-09-21T08:02:40.118 INFO:tasks.workunit.client.0.smithi107.stdout:5/236: link d7/de/d1d/c3f d7/de/d35/c53 0 2024-09-21T08:02:40.118 INFO:tasks.workunit.client.1.smithi129.stdout:9/909: write d17/d22/f30 [103410,120604] 0 2024-09-21T08:02:40.119 INFO:tasks.workunit.client.0.smithi107.stdout:5/237: symlink d7/de/d52/l54 0 2024-09-21T08:02:40.119 INFO:tasks.workunit.client.0.smithi107.stdout:5/238: rename d7/de/d1d/f31 to d7/de/d2d/f55 0 2024-09-21T08:02:40.121 INFO:tasks.workunit.client.0.smithi107.stdout:5/239: unlink d7/de/f32 0 2024-09-21T08:02:40.126 INFO:tasks.workunit.client.1.smithi129.stdout:8/825: dwrite d0/d6/d7/d18/d27/d32/fc9 [0,4194304] 0 2024-09-21T08:02:40.129 INFO:tasks.workunit.client.1.smithi129.stdout:4/895: write d5/d16/f1f [3016743,89642] 0 2024-09-21T08:02:40.129 INFO:tasks.workunit.client.1.smithi129.stdout:4/896: chown d5/d33/d6d/ca6 121060 1 2024-09-21T08:02:40.129 INFO:tasks.workunit.client.1.smithi129.stdout:4/897: chown d5/da5/l10d 239 1 2024-09-21T08:02:40.132 INFO:tasks.workunit.client.0.smithi107.stdout:5/240: write d7/ff [3718519,61165] 0 2024-09-21T08:02:40.132 INFO:tasks.workunit.client.0.smithi107.stdout:5/241: write d7/d47/f50 [335864,29992] 0 2024-09-21T08:02:40.132 INFO:tasks.workunit.client.0.smithi107.stdout:5/242: read - d7/de/d1d/f48 zero size 2024-09-21T08:02:40.142 INFO:tasks.workunit.client.1.smithi129.stdout:8/826: dread d0/d6/d7/d9/f5f [0,4194304] 0 2024-09-21T08:02:40.144 INFO:tasks.workunit.client.1.smithi129.stdout:8/827: rmdir d0/d6/dac 39 2024-09-21T08:02:40.144 INFO:tasks.workunit.client.0.smithi107.stdout:4/156: sync 2024-09-21T08:02:40.144 INFO:tasks.workunit.client.0.smithi107.stdout:3/167: dwrite d8/d2b/f2d [0,4194304] 0 2024-09-21T08:02:40.146 INFO:tasks.workunit.client.1.smithi129.stdout:8/828: unlink d0/d6/d7/d18/d27/d32/d37/c4f 0 2024-09-21T08:02:40.149 INFO:tasks.workunit.client.0.smithi107.stdout:7/148: dwrite d7/f13 [0,4194304] 0 2024-09-21T08:02:40.150 INFO:tasks.workunit.client.1.smithi129.stdout:8/829: link d0/d6/d7/d9/cb8 d0/d6/d7/d18/d27/d60/cfb 0 2024-09-21T08:02:40.150 INFO:tasks.workunit.client.1.smithi129.stdout:6/950: dwrite d7/d1b/d57/dd6/fde [0,4194304] 0 2024-09-21T08:02:40.150 INFO:tasks.workunit.client.1.smithi129.stdout:6/951: truncate d7/d1b/d1e/d66/d7c/fd1 810303 0 2024-09-21T08:02:40.150 INFO:tasks.workunit.client.1.smithi129.stdout:6/952: chown d7/d1b/d1e/d39/d4b/d6e/de5/l106 32166597 1 2024-09-21T08:02:40.150 INFO:tasks.workunit.client.1.smithi129.stdout:6/953: write d7/d10/f19 [109017,103412] 0 2024-09-21T08:02:40.151 INFO:tasks.workunit.client.0.smithi107.stdout:4/157: rename dc/l1d to dc/d13/l2f 0 2024-09-21T08:02:40.152 INFO:tasks.workunit.client.1.smithi129.stdout:8/830: link d0/d6/d7/d5a/cb4 d0/d6/d7/d18/d27/d60/d85/dcc/cfc 0 2024-09-21T08:02:40.156 INFO:tasks.workunit.client.0.smithi107.stdout:7/149: rename d7/fd to d7/d18/f36 0 2024-09-21T08:02:40.156 INFO:tasks.workunit.client.0.smithi107.stdout:7/150: write d7/f14 [911551,112433] 0 2024-09-21T08:02:40.156 INFO:tasks.workunit.client.0.smithi107.stdout:7/151: chown d7/d22 27560 1 2024-09-21T08:02:40.157 INFO:tasks.workunit.client.0.smithi107.stdout:3/168: write d8/f13 [2831485,38923] 0 2024-09-21T08:02:40.157 INFO:tasks.workunit.client.1.smithi129.stdout:9/910: dwrite d17/d22/d33/de6/d11d/f52 [0,4194304] 0 2024-09-21T08:02:40.159 INFO:tasks.workunit.client.0.smithi107.stdout:5/243: dwrite d7/de/f1a [4194304,4194304] 0 2024-09-21T08:02:40.159 INFO:tasks.workunit.client.0.smithi107.stdout:5/244: write d7/de/d1d/d29/f33 [585645,124660] 0 2024-09-21T08:02:40.159 INFO:tasks.workunit.client.0.smithi107.stdout:5/245: creat d7/de/d1d/d24/d3d/f56 x:0 0 0 2024-09-21T08:02:40.159 INFO:tasks.workunit.client.0.smithi107.stdout:5/246: write d7/de/d1d/d29/f33 [2233234,99279] 0 2024-09-21T08:02:40.160 INFO:tasks.workunit.client.1.smithi129.stdout:4/898: dwrite d5/fe8 [4194304,4194304] 0 2024-09-21T08:02:40.160 INFO:tasks.workunit.client.0.smithi107.stdout:4/158: rmdir dc/d13/d2e 0 2024-09-21T08:02:40.162 INFO:tasks.workunit.client.0.smithi107.stdout:7/152: mkdir d7/d22/d37 0 2024-09-21T08:02:40.162 INFO:tasks.workunit.client.0.smithi107.stdout:7/153: write f4 [1310163,47515] 0 2024-09-21T08:02:40.163 INFO:tasks.workunit.client.0.smithi107.stdout:3/169: mknod d8/d14/d1d/c2e 0 2024-09-21T08:02:40.174 INFO:tasks.workunit.client.0.smithi107.stdout:7/154: write f3 [2734730,112356] 0 2024-09-21T08:02:40.174 INFO:tasks.workunit.client.0.smithi107.stdout:7/155: chown d7/d18/f19 28336 1 2024-09-21T08:02:40.176 INFO:tasks.workunit.client.0.smithi107.stdout:5/247: creat d7/de/d35/f57 x:0 0 0 2024-09-21T08:02:40.179 INFO:tasks.workunit.client.1.smithi129.stdout:6/954: mkdir d7/d1b/d1e/d66/dc2/d93/dd5/de6/d13a 0 2024-09-21T08:02:40.181 INFO:tasks.workunit.client.1.smithi129.stdout:8/831: link d0/d6/d7/d5a/dbc/fe9 d0/d6/d7/d3a/d8e/ffd 0 2024-09-21T08:02:40.182 INFO:tasks.workunit.client.1.smithi129.stdout:9/911: rmdir d17/d46/d9c 39 2024-09-21T08:02:40.184 INFO:tasks.workunit.client.1.smithi129.stdout:6/955: symlink d7/d1b/d1e/d39/d4b/de8/d7a/l13b 0 2024-09-21T08:02:40.185 INFO:tasks.workunit.client.1.smithi129.stdout:6/956: truncate d7/d1b/d1e/d66/d7c/ff4 884803 0 2024-09-21T08:02:40.185 INFO:tasks.workunit.client.1.smithi129.stdout:8/832: mkdir d0/d6/dfe 0 2024-09-21T08:02:40.185 INFO:tasks.workunit.client.1.smithi129.stdout:8/833: write d0/d6/d7/d3a/d8e/fb3 [1620954,74163] 0 2024-09-21T08:02:40.186 INFO:tasks.workunit.client.1.smithi129.stdout:9/912: creat d17/d22/f129 x:0 0 0 2024-09-21T08:02:40.187 INFO:tasks.workunit.client.1.smithi129.stdout:6/957: unlink d7/d1b/d8d/cca 0 2024-09-21T08:02:40.188 INFO:tasks.workunit.client.1.smithi129.stdout:6/958: creat d7/d1b/d1e/d66/dba/f13c x:0 0 0 2024-09-21T08:02:40.188 INFO:tasks.workunit.client.1.smithi129.stdout:6/959: getdents d7/d1b/d1e/d39/d4b/de8/d69/dfa 0 2024-09-21T08:02:40.198 INFO:tasks.workunit.client.1.smithi129.stdout:4/899: dwrite d5/d16/d47/d61/f91 [0,4194304] 0 2024-09-21T08:02:40.198 INFO:tasks.workunit.client.0.smithi107.stdout:3/170: dwrite d8/d14/d1d/f1f [0,4194304] 0 2024-09-21T08:02:40.199 INFO:tasks.workunit.client.0.smithi107.stdout:4/159: dwrite dc/fe [0,4194304] 0 2024-09-21T08:02:40.200 INFO:tasks.workunit.client.1.smithi129.stdout:4/900: creat d5/da5/db1/d12b/f137 x:0 0 0 2024-09-21T08:02:40.201 INFO:tasks.workunit.client.1.smithi129.stdout:9/913: dread d17/d22/d33/d7a/d89/d90/db1/d31/d35/f50 [0,4194304] 0 2024-09-21T08:02:40.201 INFO:tasks.workunit.client.1.smithi129.stdout:9/914: fdatasync d17/f1e 0 2024-09-21T08:02:40.202 INFO:tasks.workunit.client.0.smithi107.stdout:7/156: dread d7/f14 [0,4194304] 0 2024-09-21T08:02:40.202 INFO:tasks.workunit.client.0.smithi107.stdout:7/157: fdatasync f4 0 2024-09-21T08:02:40.202 INFO:tasks.workunit.client.0.smithi107.stdout:7/158: chown d7/d10/f17 127618 1 2024-09-21T08:02:40.206 INFO:tasks.workunit.client.1.smithi129.stdout:4/901: creat d5/d11/d3f/f138 x:0 0 0 2024-09-21T08:02:40.206 INFO:tasks.workunit.client.1.smithi129.stdout:4/902: chown d5/d16/d24/d4f/da1/fa3 178210 1 2024-09-21T08:02:40.207 INFO:tasks.workunit.client.0.smithi107.stdout:3/171: mknod d8/d25/c2f 0 2024-09-21T08:02:40.207 INFO:tasks.workunit.client.0.smithi107.stdout:3/172: write d8/d21/f24 [1339587,128728] 0 2024-09-21T08:02:40.207 INFO:tasks.workunit.client.0.smithi107.stdout:3/173: stat d8/d2b/f2d 0 2024-09-21T08:02:40.208 INFO:tasks.workunit.client.0.smithi107.stdout:4/160: symlink dc/l30 0 2024-09-21T08:02:40.208 INFO:tasks.workunit.client.0.smithi107.stdout:4/161: creat dc/f31 x:0 0 0 2024-09-21T08:02:40.209 INFO:tasks.workunit.client.1.smithi129.stdout:4/903: creat d5/da5/d130/f139 x:0 0 0 2024-09-21T08:02:40.211 INFO:tasks.workunit.client.1.smithi129.stdout:4/904: mkdir d5/d33/d6d/d13a 0 2024-09-21T08:02:40.211 INFO:tasks.workunit.client.1.smithi129.stdout:4/905: fdatasync d5/d16/d24/d4f/da1/dcf/f105 0 2024-09-21T08:02:40.212 INFO:tasks.workunit.client.0.smithi107.stdout:7/159: rmdir d7/d10/d28 39 2024-09-21T08:02:40.212 INFO:tasks.workunit.client.1.smithi129.stdout:4/906: rmdir d5/d33/d4e 39 2024-09-21T08:02:40.213 INFO:tasks.workunit.client.1.smithi129.stdout:4/907: symlink d5/d33/d4e/da7/d123/da8/dbc/d121/l13b 0 2024-09-21T08:02:40.214 INFO:tasks.workunit.client.1.smithi129.stdout:4/908: dread - d5/da5/f10e zero size 2024-09-21T08:02:40.214 INFO:tasks.workunit.client.1.smithi129.stdout:4/909: truncate d5/d16/d24/d4f/f72 4507402 0 2024-09-21T08:02:40.214 INFO:tasks.workunit.client.1.smithi129.stdout:4/910: read - d5/d33/d4e/da7/d123/da8/f100 zero size 2024-09-21T08:02:40.214 INFO:tasks.workunit.client.1.smithi129.stdout:4/911: creat d5/d16/d24/d3b/f13c x:0 0 0 2024-09-21T08:02:40.214 INFO:tasks.workunit.client.0.smithi107.stdout:7/160: mkdir d7/d38 0 2024-09-21T08:02:40.214 INFO:tasks.workunit.client.0.smithi107.stdout:7/161: fdatasync d7/d18/f29 0 2024-09-21T08:02:40.215 INFO:tasks.workunit.client.0.smithi107.stdout:4/162: dread dc/f25 [0,4194304] 0 2024-09-21T08:02:40.215 INFO:tasks.workunit.client.0.smithi107.stdout:7/162: symlink d7/d10/d28/l39 0 2024-09-21T08:02:40.215 INFO:tasks.workunit.client.0.smithi107.stdout:7/163: fdatasync d7/d10/d28/f35 0 2024-09-21T08:02:40.215 INFO:tasks.workunit.client.0.smithi107.stdout:7/164: mkdir d7/d22/d3a 0 2024-09-21T08:02:40.220 INFO:tasks.workunit.client.0.smithi107.stdout:3/174: dread d8/d14/d1d/f1e [0,4194304] 0 2024-09-21T08:02:40.225 INFO:tasks.workunit.client.0.smithi107.stdout:4/163: write dc/fe [838783,85265] 0 2024-09-21T08:02:40.226 INFO:tasks.workunit.client.0.smithi107.stdout:4/164: mknod dc/d13/c32 0 2024-09-21T08:02:40.227 INFO:tasks.workunit.client.0.smithi107.stdout:3/175: read d8/d14/d1d/f1e [40758,85442] 0 2024-09-21T08:02:40.227 INFO:tasks.workunit.client.0.smithi107.stdout:3/176: creat d8/f30 x:0 0 0 2024-09-21T08:02:40.228 INFO:tasks.workunit.client.0.smithi107.stdout:3/177: unlink d8/c19 0 2024-09-21T08:02:40.229 INFO:tasks.workunit.client.0.smithi107.stdout:3/178: symlink d8/d25/l31 0 2024-09-21T08:02:40.230 INFO:tasks.workunit.client.0.smithi107.stdout:3/179: symlink d8/d21/l32 0 2024-09-21T08:02:40.230 INFO:tasks.workunit.client.0.smithi107.stdout:3/180: chown d8/d14/d1d/c2e 84 1 2024-09-21T08:02:40.234 INFO:tasks.workunit.client.0.smithi107.stdout:5/248: dwrite d7/de/d1d/d24/d3d/f44 [0,4194304] 0 2024-09-21T08:02:40.238 INFO:tasks.workunit.client.1.smithi129.stdout:6/960: dwrite d7/d1b/d1e/d39/f46 [0,4194304] 0 2024-09-21T08:02:40.240 INFO:tasks.workunit.client.1.smithi129.stdout:0/953: sync 2024-09-21T08:02:40.251 INFO:tasks.workunit.client.0.smithi107.stdout:5/249: getdents d7/de/d1d/d24/d3d 0 2024-09-21T08:02:40.252 INFO:tasks.workunit.client.0.smithi107.stdout:5/250: creat d7/de/d1d/d24/f58 x:0 0 0 2024-09-21T08:02:40.253 INFO:tasks.workunit.client.1.smithi129.stdout:6/961: read d7/d1b/d1e/d39/d4b/de8/f10a [2405658,25580] 0 2024-09-21T08:02:40.253 INFO:tasks.workunit.client.1.smithi129.stdout:6/962: chown d7/d1b/d1e/d39/leb 0 1 2024-09-21T08:02:40.253 INFO:tasks.workunit.client.1.smithi129.stdout:9/915: dwrite d17/d22/d33/d7a/d89/d90/db1/d31/d35/fbb [0,4194304] 0 2024-09-21T08:02:40.254 INFO:tasks.workunit.client.0.smithi107.stdout:4/165: dwrite dc/d13/f28 [0,4194304] 0 2024-09-21T08:02:40.256 INFO:tasks.workunit.client.0.smithi107.stdout:5/251: symlink d7/de/d2d/l59 0 2024-09-21T08:02:40.257 INFO:tasks.workunit.client.0.smithi107.stdout:3/181: truncate d8/d14/d1d/f1f 3643269 0 2024-09-21T08:02:40.265 INFO:tasks.workunit.client.1.smithi129.stdout:9/916: write d17/d55/fb9 [2433202,82222] 0 2024-09-21T08:02:40.265 INFO:tasks.workunit.client.1.smithi129.stdout:0/954: dwrite de/d15/f43 [0,4194304] 0 2024-09-21T08:02:40.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:39 smithi129 ceph-mon[34472]: Adjusting osd_memory_target on smithi129 to 2581M 2024-09-21T08:02:40.267 INFO:tasks.workunit.client.0.smithi107.stdout:7/165: rmdir d7 39 2024-09-21T08:02:40.271 INFO:tasks.workunit.client.0.smithi107.stdout:5/252: creat d7/de/d1d/d24/d3d/f5a x:0 0 0 2024-09-21T08:02:40.271 INFO:tasks.workunit.client.0.smithi107.stdout:5/253: fdatasync d7/de/f1b 0 2024-09-21T08:02:40.271 INFO:tasks.workunit.client.0.smithi107.stdout:5/254: dread - d7/de/d1d/d24/f4f zero size 2024-09-21T08:02:40.271 INFO:tasks.workunit.client.0.smithi107.stdout:5/255: truncate d7/de/f30 179107 0 2024-09-21T08:02:40.272 INFO:tasks.workunit.client.0.smithi107.stdout:7/166: mkdir d7/d22/d3b 0 2024-09-21T08:02:40.272 INFO:tasks.workunit.client.0.smithi107.stdout:7/167: fsync d7/f11 0 2024-09-21T08:02:40.274 INFO:tasks.workunit.client.0.smithi107.stdout:7/168: creat d7/d10/d28/f3c x:0 0 0 2024-09-21T08:02:40.275 INFO:tasks.workunit.client.0.smithi107.stdout:5/256: dread d7/ff [0,4194304] 0 2024-09-21T08:02:40.275 INFO:tasks.workunit.client.0.smithi107.stdout:5/257: write d7/de/d1d/d29/f33 [2923495,89422] 0 2024-09-21T08:02:40.276 INFO:tasks.workunit.client.1.smithi129.stdout:6/963: rmdir d7/d1b/d1e 39 2024-09-21T08:02:40.278 INFO:tasks.workunit.client.1.smithi129.stdout:9/917: creat d17/d126/f12a x:0 0 0 2024-09-21T08:02:40.279 INFO:tasks.workunit.client.1.smithi129.stdout:0/955: symlink de/d22/d27/d85/db2/l130 0 2024-09-21T08:02:40.279 INFO:tasks.workunit.client.1.smithi129.stdout:0/956: fdatasync de/d19/f4e 0 2024-09-21T08:02:40.280 INFO:tasks.workunit.client.1.smithi129.stdout:6/964: dread d7/d1b/d1e/d39/f4c [4194304,4194304] 0 2024-09-21T08:02:40.286 INFO:tasks.workunit.client.1.smithi129.stdout:9/918: creat d17/d22/d33/d7a/d89/d90/db1/d31/f12b x:0 0 0 2024-09-21T08:02:40.286 INFO:tasks.workunit.client.1.smithi129.stdout:9/919: getdents d17/d22/d33/d7a/d89/d90/dfc 0 2024-09-21T08:02:40.286 INFO:tasks.workunit.client.1.smithi129.stdout:9/920: write d17/d22/d33/f7f [943344,126083] 0 2024-09-21T08:02:40.286 INFO:tasks.workunit.client.1.smithi129.stdout:9/921: chown d17/d46/fa2 0 1 2024-09-21T08:02:40.286 INFO:tasks.workunit.client.1.smithi129.stdout:0/957: truncate de/d1f/f34 469219 0 2024-09-21T08:02:40.286 INFO:tasks.workunit.client.1.smithi129.stdout:0/958: symlink de/d15/d87/l131 0 2024-09-21T08:02:40.286 INFO:tasks.workunit.client.1.smithi129.stdout:0/959: write de/d22/d27/d10a/ff7 [4441327,47239] 0 2024-09-21T08:02:40.287 INFO:tasks.workunit.client.0.smithi107.stdout:5/258: dread d7/de/f1a [4194304,4194304] 0 2024-09-21T08:02:40.287 INFO:tasks.workunit.client.0.smithi107.stdout:5/259: creat d7/de/d1d/f5b x:0 0 0 2024-09-21T08:02:40.288 INFO:tasks.workunit.client.0.smithi107.stdout:5/260: write d7/de/f19 [2707122,53070] 0 2024-09-21T08:02:40.294 INFO:tasks.workunit.client.1.smithi129.stdout:8/834: sync 2024-09-21T08:02:40.294 INFO:tasks.workunit.client.1.smithi129.stdout:4/912: sync 2024-09-21T08:02:40.296 INFO:tasks.workunit.client.1.smithi129.stdout:4/913: mkdir d5/d33/df2/d13d 0 2024-09-21T08:02:40.297 INFO:tasks.workunit.client.0.smithi107.stdout:5/261: write d7/f34 [3486395,36663] 0 2024-09-21T08:02:40.297 INFO:tasks.workunit.client.1.smithi129.stdout:6/965: dread d7/d1b/d1e/d39/d4b/d6e/f73 [0,4194304] 0 2024-09-21T08:02:40.297 INFO:tasks.workunit.client.1.smithi129.stdout:8/835: mkdir d0/d6/d7/d18/d27/dff 0 2024-09-21T08:02:40.297 INFO:tasks.workunit.client.1.smithi129.stdout:8/836: chown d0/d6/d7/d5a/l66 0 1 2024-09-21T08:02:40.297 INFO:tasks.workunit.client.1.smithi129.stdout:8/837: write d0/d6/d7/d18/d27/d32/d3d/d7b/dbf/ff0 [568905,5078] 0 2024-09-21T08:02:40.298 INFO:tasks.workunit.client.1.smithi129.stdout:4/914: mknod d5/d16/c13e 0 2024-09-21T08:02:40.300 INFO:tasks.workunit.client.1.smithi129.stdout:0/960: write de/d19/f46 [1430021,117894] 0 2024-09-21T08:02:40.300 INFO:tasks.workunit.client.1.smithi129.stdout:4/915: creat d5/d33/d4e/d128/f13f x:0 0 0 2024-09-21T08:02:40.301 INFO:tasks.workunit.client.1.smithi129.stdout:6/966: symlink d7/d1b/d57/l13d 0 2024-09-21T08:02:40.301 INFO:tasks.workunit.client.1.smithi129.stdout:6/967: dread - d7/d1b/d1e/d39/d4b/de8/d69/d89/f130 zero size 2024-09-21T08:02:40.302 INFO:tasks.workunit.client.0.smithi107.stdout:5/262: mknod d7/de/c5c 0 2024-09-21T08:02:40.303 INFO:tasks.workunit.client.1.smithi129.stdout:0/961: mkdir de/d81/d132 0 2024-09-21T08:02:40.303 INFO:tasks.workunit.client.1.smithi129.stdout:0/962: chown de/d15/d39/d7f/fb7 938366 1 2024-09-21T08:02:40.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:39 smithi107 ceph-mon[27622]: Adjusting osd_memory_target on smithi129 to 2581M 2024-09-21T08:02:40.304 INFO:tasks.workunit.client.0.smithi107.stdout:5/263: truncate d7/de/f19 1595548 0 2024-09-21T08:02:40.305 INFO:tasks.workunit.client.1.smithi129.stdout:0/963: creat de/d15/d39/d9e/f133 x:0 0 0 2024-09-21T08:02:40.305 INFO:tasks.workunit.client.1.smithi129.stdout:0/964: fsync de/d15/d44/d45/f62 0 2024-09-21T08:02:40.306 INFO:tasks.workunit.client.0.smithi107.stdout:6/230: sync 2024-09-21T08:02:40.308 INFO:tasks.workunit.client.0.smithi107.stdout:6/231: truncate d2/d3/f4 3809360 0 2024-09-21T08:02:40.309 INFO:tasks.workunit.client.0.smithi107.stdout:6/232: mknod d2/d3/d7/d23/d2b/c46 0 2024-09-21T08:02:40.310 INFO:tasks.workunit.client.0.smithi107.stdout:5/264: dread d7/f39 [0,4194304] 0 2024-09-21T08:02:40.311 INFO:tasks.workunit.client.1.smithi129.stdout:8/838: dread d0/d6/d7/d18/d27/f2d [0,4194304] 0 2024-09-21T08:02:40.311 INFO:tasks.workunit.client.1.smithi129.stdout:9/922: dwrite d17/d46/dd4/f10d [0,4194304] 0 2024-09-21T08:02:40.311 INFO:tasks.workunit.client.1.smithi129.stdout:8/839: chown d0/d6/d7/d18/d27/dff 663892 1 2024-09-21T08:02:40.311 INFO:tasks.workunit.client.1.smithi129.stdout:8/840: chown d0/d6/d7/d18/d27/d32/d37 17528 1 2024-09-21T08:02:40.312 INFO:tasks.workunit.client.0.smithi107.stdout:6/233: creat d2/d3/d7/d2a/f47 x:0 0 0 2024-09-21T08:02:40.312 INFO:tasks.workunit.client.0.smithi107.stdout:6/234: fdatasync d2/d3/d7/f15 0 2024-09-21T08:02:40.314 INFO:tasks.workunit.client.1.smithi129.stdout:6/968: read d7/d1b/d1e/d39/d4b/fa2 [2838101,68303] 0 2024-09-21T08:02:40.314 INFO:tasks.workunit.client.1.smithi129.stdout:6/969: truncate d7/d1b/d1e/d66/dba/d2b/db6/fe0 309345 0 2024-09-21T08:02:40.315 INFO:tasks.workunit.client.0.smithi107.stdout:6/235: mkdir d2/d3/d7/d48 0 2024-09-21T08:02:40.317 INFO:tasks.workunit.client.1.smithi129.stdout:9/923: unlink d17/d22/d33/d36/d48/d75/fa8 0 2024-09-21T08:02:40.320 INFO:tasks.workunit.client.1.smithi129.stdout:6/970: creat d7/d10/dcc/f13e x:0 0 0 2024-09-21T08:02:40.320 INFO:tasks.workunit.client.1.smithi129.stdout:6/971: dread - d7/d1b/d1e/d66/dba/f13c zero size 2024-09-21T08:02:40.320 INFO:tasks.workunit.client.1.smithi129.stdout:6/972: write d7/d1b/d1e/d39/d79/ded/ff3 [1510517,124594] 0 2024-09-21T08:02:40.321 INFO:tasks.workunit.client.0.smithi107.stdout:6/236: creat d2/d3/d7/d2a/d31/f49 x:0 0 0 2024-09-21T08:02:40.321 INFO:tasks.workunit.client.0.smithi107.stdout:6/237: write d2/d3/d7/d24/f2c [3205765,24613] 0 2024-09-21T08:02:40.321 INFO:tasks.workunit.client.0.smithi107.stdout:6/238: creat d2/d3/d7/d24/f4a x:0 0 0 2024-09-21T08:02:40.321 INFO:tasks.workunit.client.0.smithi107.stdout:6/239: truncate d2/d3/d7/d24/f4a 350996 0 2024-09-21T08:02:40.322 INFO:tasks.workunit.client.1.smithi129.stdout:6/973: rename d7/d1b/d1e/d66/dba/c29 to d7/d1b/d1e/d66/dba/d2b/db6/c13f 0 2024-09-21T08:02:40.324 INFO:tasks.workunit.client.0.smithi107.stdout:5/265: write d7/f8 [3853484,67648] 0 2024-09-21T08:02:40.324 INFO:tasks.workunit.client.0.smithi107.stdout:6/240: truncate d2/d3/d7/d24/f37 2808011 0 2024-09-21T08:02:40.324 INFO:tasks.workunit.client.0.smithi107.stdout:6/241: write d2/fe [3814623,122426] 0 2024-09-21T08:02:40.324 INFO:tasks.workunit.client.0.smithi107.stdout:6/242: stat d2/d3/d7/f11 0 2024-09-21T08:02:40.324 INFO:tasks.workunit.client.1.smithi129.stdout:8/841: dread d0/d6/d7/d18/d27/f39 [0,4194304] 0 2024-09-21T08:02:40.338 INFO:tasks.workunit.client.1.smithi129.stdout:9/924: write d17/d22/d33/d36/de4/f10a [1954348,101207] 0 2024-09-21T08:02:40.339 INFO:tasks.workunit.client.1.smithi129.stdout:0/965: dwrite de/d15/f18 [0,4194304] 0 2024-09-21T08:02:40.339 INFO:tasks.workunit.client.1.smithi129.stdout:0/966: creat de/f134 x:0 0 0 2024-09-21T08:02:40.339 INFO:tasks.workunit.client.1.smithi129.stdout:9/925: creat d17/d22/d33/d36/d48/db7/f12c x:0 0 0 2024-09-21T08:02:40.353 INFO:tasks.workunit.client.0.smithi107.stdout:5/266: dwrite d7/de/d1d/d24/d3d/f44 [4194304,4194304] 0 2024-09-21T08:02:40.354 INFO:tasks.workunit.client.0.smithi107.stdout:6/243: dwrite d2/d3/d7/d2a/f47 [0,4194304] 0 2024-09-21T08:02:40.354 INFO:tasks.workunit.client.0.smithi107.stdout:6/244: creat d2/d3/d7/d23/d2b/f4b x:0 0 0 2024-09-21T08:02:40.392 INFO:tasks.workunit.client.1.smithi129.stdout:6/974: unlink d7/d1b/d8d/ce1 0 2024-09-21T08:02:40.392 INFO:tasks.workunit.client.1.smithi129.stdout:6/975: fsync f4 0 2024-09-21T08:02:40.392 INFO:tasks.workunit.client.1.smithi129.stdout:6/976: creat d7/d10/f140 x:0 0 0 2024-09-21T08:02:40.393 INFO:tasks.workunit.client.1.smithi129.stdout:8/842: symlink d0/d6/d7/d5a/dbc/l100 0 2024-09-21T08:02:40.399 INFO:tasks.workunit.client.1.smithi129.stdout:0/967: rename de/f13 to de/d15/f135 0 2024-09-21T08:02:40.402 INFO:tasks.workunit.client.1.smithi129.stdout:9/926: creat d17/d22/d33/d7a/d89/f12d x:0 0 0 2024-09-21T08:02:40.402 INFO:tasks.workunit.client.1.smithi129.stdout:9/927: write d17/f49 [3921341,57415] 0 2024-09-21T08:02:40.408 INFO:tasks.workunit.client.0.smithi107.stdout:5/267: mkdir d7/de/d2d/d5d 0 2024-09-21T08:02:40.415 INFO:tasks.workunit.client.1.smithi129.stdout:6/977: creat d7/d1b/d1e/d66/dc2/d93/dd5/de6/f141 x:0 0 0 2024-09-21T08:02:40.416 INFO:tasks.workunit.client.1.smithi129.stdout:0/968: dwrite de/d1f/da9/f37 [4194304,4194304] 0 2024-09-21T08:02:40.416 INFO:tasks.workunit.client.1.smithi129.stdout:0/969: write de/d15/d44/da6/fb9 [935592,83637] 0 2024-09-21T08:02:40.416 INFO:tasks.workunit.client.0.smithi107.stdout:6/245: rename d2/d3/f6 to d2/d2e/f4c 0 2024-09-21T08:02:40.417 INFO:tasks.workunit.client.1.smithi129.stdout:8/843: creat d0/d6/d7/d18/d61/d7f/dd2/f101 x:0 0 0 2024-09-21T08:02:40.419 INFO:tasks.workunit.client.0.smithi107.stdout:6/246: dread d2/d3/d7/f15 [0,4194304] 0 2024-09-21T08:02:40.425 INFO:tasks.workunit.client.0.smithi107.stdout:6/247: mknod d2/d3/d7/d23/d2b/c4d 0 2024-09-21T08:02:40.426 INFO:tasks.workunit.client.1.smithi129.stdout:6/978: creat d7/d1b/d1e/d39/d111/d11f/f142 x:0 0 0 2024-09-21T08:02:40.426 INFO:tasks.workunit.client.1.smithi129.stdout:6/979: chown d7/c33 306234 1 2024-09-21T08:02:40.428 INFO:tasks.workunit.client.0.smithi107.stdout:6/248: creat d2/d3/d7/d24/d41/d44/f4e x:0 0 0 2024-09-21T08:02:40.428 INFO:tasks.workunit.client.0.smithi107.stdout:5/268: dread d7/de/d35/f43 [0,4194304] 0 2024-09-21T08:02:40.430 INFO:tasks.workunit.client.1.smithi129.stdout:0/970: rename de/d15/d51/f5d to de/d22/d27/d10a/f136 0 2024-09-21T08:02:40.431 INFO:tasks.workunit.client.0.smithi107.stdout:5/269: mknod d7/de/d1d/c5e 0 2024-09-21T08:02:40.433 INFO:tasks.workunit.client.1.smithi129.stdout:4/916: sync 2024-09-21T08:02:40.433 INFO:tasks.workunit.client.1.smithi129.stdout:8/844: mkdir d0/d6/dfe/d102 0 2024-09-21T08:02:40.433 INFO:tasks.workunit.client.1.smithi129.stdout:8/845: read - d0/d6/d7/d3a/fd9 zero size 2024-09-21T08:02:40.434 INFO:tasks.workunit.client.1.smithi129.stdout:8/846: truncate d0/d6/d7/d5d/fdb 121093 0 2024-09-21T08:02:40.434 INFO:tasks.workunit.client.1.smithi129.stdout:9/928: truncate d17/d22/d33/d36/de4/f10a 2398442 0 2024-09-21T08:02:40.434 INFO:tasks.workunit.client.0.smithi107.stdout:6/249: dread d2/d3/f22 [0,4194304] 0 2024-09-21T08:02:40.435 INFO:tasks.workunit.client.0.smithi107.stdout:6/250: fdatasync d2/d3/d7/d23/d2b/f4b 0 2024-09-21T08:02:40.435 INFO:tasks.workunit.client.1.smithi129.stdout:6/980: symlink d7/d1b/d1e/d66/dc2/d93/l143 0 2024-09-21T08:02:40.436 INFO:tasks.workunit.client.1.smithi129.stdout:6/981: write d7/fd [837950,19514] 0 2024-09-21T08:02:40.437 INFO:tasks.workunit.client.1.smithi129.stdout:0/971: rename de/d22/d27/d10a/d42/c78 to de/d19/dd9/c137 0 2024-09-21T08:02:40.438 INFO:tasks.workunit.client.1.smithi129.stdout:0/972: write de/d15/d39/d56/f6f [450532,22658] 0 2024-09-21T08:02:40.439 INFO:tasks.workunit.client.0.smithi107.stdout:5/270: rename d7/de/d35/c4a to d7/de/d35/c5f 0 2024-09-21T08:02:40.440 INFO:tasks.workunit.client.1.smithi129.stdout:8/847: write d0/d6/d7/d18/d27/d32/d70/f8c [781628,130329] 0 2024-09-21T08:02:40.441 INFO:tasks.workunit.client.0.smithi107.stdout:5/271: mkdir d7/de/d2d/d5d/d60 0 2024-09-21T08:02:40.441 INFO:tasks.workunit.client.0.smithi107.stdout:5/272: dread - d7/de/d1d/d29/f3c zero size 2024-09-21T08:02:40.441 INFO:tasks.workunit.client.1.smithi129.stdout:0/973: write de/d22/d27/d30/f35 [4564136,10499] 0 2024-09-21T08:02:40.443 INFO:tasks.workunit.client.0.smithi107.stdout:5/273: mknod d7/de/d2d/d5d/d60/c61 0 2024-09-21T08:02:40.445 INFO:tasks.workunit.client.1.smithi129.stdout:4/917: rename d5/d16/d85 to d5/d16/d47/d61/d140 0 2024-09-21T08:02:40.445 INFO:tasks.workunit.client.1.smithi129.stdout:4/918: readlink d5/d33/d4e/da7/d123/da8/ldb 0 2024-09-21T08:02:40.447 INFO:tasks.workunit.client.0.smithi107.stdout:5/274: unlink d7/de/d1d/d24/c41 0 2024-09-21T08:02:40.447 INFO:tasks.workunit.client.1.smithi129.stdout:8/848: read d0/d6/d7/d5a/dbc/fe9 [688003,18296] 0 2024-09-21T08:02:40.447 INFO:tasks.workunit.client.1.smithi129.stdout:6/982: dread d7/d10/f16 [0,4194304] 0 2024-09-21T08:02:40.448 INFO:tasks.workunit.client.1.smithi129.stdout:0/974: creat de/d15/f138 x:0 0 0 2024-09-21T08:02:40.450 INFO:tasks.workunit.client.1.smithi129.stdout:9/929: rename d17/f26 to d17/d22/d33/d36/d48/db7/f12e 0 2024-09-21T08:02:40.451 INFO:tasks.workunit.client.1.smithi129.stdout:4/919: dread d5/d11/f3d [0,4194304] 0 2024-09-21T08:02:40.452 INFO:tasks.workunit.client.0.smithi107.stdout:5/275: creat d7/de/f62 x:0 0 0 2024-09-21T08:02:40.452 INFO:tasks.workunit.client.0.smithi107.stdout:5/276: creat d7/f63 x:0 0 0 2024-09-21T08:02:40.454 INFO:tasks.workunit.client.1.smithi129.stdout:0/975: rename de/d22/d27/d85/cab to de/d22/d27/d85/db2/c139 0 2024-09-21T08:02:40.454 INFO:tasks.workunit.client.1.smithi129.stdout:0/976: stat de/f64 0 2024-09-21T08:02:40.455 INFO:tasks.workunit.client.1.smithi129.stdout:4/920: dread d5/d11/f3d [0,4194304] 0 2024-09-21T08:02:40.455 INFO:tasks.workunit.client.1.smithi129.stdout:6/983: symlink d7/l144 0 2024-09-21T08:02:40.457 INFO:tasks.workunit.client.1.smithi129.stdout:9/930: rename d17/d22/d33/d7a/d89/d90/le0 to d17/d22/d33/d7a/d89/d90/db1/d31/d5e/df9/l12f 0 2024-09-21T08:02:40.457 INFO:tasks.workunit.client.1.smithi129.stdout:9/931: stat d17/d22/c93 0 2024-09-21T08:02:40.458 INFO:tasks.workunit.client.1.smithi129.stdout:4/921: symlink d5/df4/l141 0 2024-09-21T08:02:40.462 INFO:tasks.workunit.client.1.smithi129.stdout:4/922: mkdir d5/d33/d4e/d142 0 2024-09-21T08:02:40.463 INFO:tasks.workunit.client.1.smithi129.stdout:6/984: mkdir d7/d1b/d57/d145 0 2024-09-21T08:02:40.463 INFO:tasks.workunit.client.1.smithi129.stdout:0/977: dread de/d22/f2b [0,4194304] 0 2024-09-21T08:02:40.467 INFO:tasks.workunit.client.1.smithi129.stdout:4/923: creat d5/d16/d24/f143 x:0 0 0 2024-09-21T08:02:40.476 INFO:tasks.workunit.client.1.smithi129.stdout:0/978: write de/d22/d27/d10a/f3e [4614203,120996] 0 2024-09-21T08:02:40.479 INFO:tasks.workunit.client.1.smithi129.stdout:4/924: dread d5/fe8 [0,4194304] 0 2024-09-21T08:02:40.479 INFO:tasks.workunit.client.1.smithi129.stdout:4/925: chown d5/d6/f87 8011657 1 2024-09-21T08:02:40.480 INFO:tasks.workunit.client.1.smithi129.stdout:4/926: rmdir d5/d16/d47/d5f/d64 39 2024-09-21T08:02:40.481 INFO:tasks.workunit.client.1.smithi129.stdout:4/927: rmdir d5/da5/db1 39 2024-09-21T08:02:40.483 INFO:tasks.workunit.client.1.smithi129.stdout:8/849: dwrite d0/d6/d7/d5a/f5c [0,4194304] 0 2024-09-21T08:02:40.484 INFO:tasks.workunit.client.1.smithi129.stdout:4/928: getdents d5/da5 0 2024-09-21T08:02:40.484 INFO:tasks.workunit.client.1.smithi129.stdout:4/929: chown d5/d33/d4e/da7/d123/de1 31105074 1 2024-09-21T08:02:40.484 INFO:tasks.workunit.client.1.smithi129.stdout:4/930: write d5/d16/d24/d3b/f97 [1214492,30942] 0 2024-09-21T08:02:40.484 INFO:tasks.workunit.client.1.smithi129.stdout:4/931: creat d5/d11/d3f/f144 x:0 0 0 2024-09-21T08:02:40.484 INFO:tasks.workunit.client.1.smithi129.stdout:4/932: fsync d5/d33/d4e/da7/d123/f7e 0 2024-09-21T08:02:40.484 INFO:tasks.workunit.client.1.smithi129.stdout:9/932: dwrite d17/d22/d33/f9e [0,4194304] 0 2024-09-21T08:02:40.484 INFO:tasks.workunit.client.0.smithi107.stdout:5/277: dwrite d7/de/d35/f57 [0,4194304] 0 2024-09-21T08:02:40.486 INFO:tasks.workunit.client.0.smithi107.stdout:0/269: sync 2024-09-21T08:02:40.486 INFO:tasks.workunit.client.0.smithi107.stdout:1/151: sync 2024-09-21T08:02:40.486 INFO:tasks.workunit.client.0.smithi107.stdout:1/152: chown d0/d19/d2b/l2d 363797 1 2024-09-21T08:02:40.487 INFO:tasks.workunit.client.0.smithi107.stdout:2/118: sync 2024-09-21T08:02:40.489 INFO:tasks.workunit.client.1.smithi129.stdout:8/850: rename d0/d6/d7/d18/d27/l6f to d0/d6/d7/ded/l103 0 2024-09-21T08:02:40.491 INFO:tasks.workunit.client.0.smithi107.stdout:2/119: dread d1/f3 [0,4194304] 0 2024-09-21T08:02:40.491 INFO:tasks.workunit.client.0.smithi107.stdout:2/120: dread - d1/d1e/d23/f25 zero size 2024-09-21T08:02:40.491 INFO:tasks.workunit.client.0.smithi107.stdout:2/121: dread - d1/d1e/d23/f25 zero size 2024-09-21T08:02:40.491 INFO:tasks.workunit.client.1.smithi129.stdout:0/979: write de/d15/d44/d45/f62 [25776,49972] 0 2024-09-21T08:02:40.493 INFO:tasks.workunit.client.0.smithi107.stdout:0/270: write d1/fe [881261,98518] 0 2024-09-21T08:02:40.495 INFO:tasks.workunit.client.1.smithi129.stdout:4/933: unlink d5/d16/d24/d4f/da1/ld5 0 2024-09-21T08:02:40.495 INFO:tasks.workunit.client.1.smithi129.stdout:4/934: getdents d5/da5 0 2024-09-21T08:02:40.496 INFO:tasks.workunit.client.1.smithi129.stdout:4/935: write d5/f39 [3137492,63428] 0 2024-09-21T08:02:40.502 INFO:tasks.workunit.client.0.smithi107.stdout:5/278: mkdir d7/de/d1d/d29/d64 0 2024-09-21T08:02:40.504 INFO:tasks.workunit.client.0.smithi107.stdout:1/153: mknod d0/d7/d1c/d20/c32 0 2024-09-21T08:02:40.504 INFO:tasks.workunit.client.0.smithi107.stdout:1/154: fdatasync d0/f11 0 2024-09-21T08:02:40.504 INFO:tasks.workunit.client.1.smithi129.stdout:8/851: creat d0/d6/d7/d18/de0/f104 x:0 0 0 2024-09-21T08:02:40.504 INFO:tasks.workunit.client.1.smithi129.stdout:9/933: dwrite d17/d22/d33/d7a/d89/d90/db1/d31/f5a [0,4194304] 0 2024-09-21T08:02:40.506 INFO:tasks.workunit.client.0.smithi107.stdout:1/155: creat d0/d19/f33 x:0 0 0 2024-09-21T08:02:40.507 INFO:tasks.workunit.client.1.smithi129.stdout:4/936: write d5/d16/d24/f42 [3157531,72018] 0 2024-09-21T08:02:40.507 INFO:tasks.workunit.client.0.smithi107.stdout:2/122: getdents d1 0 2024-09-21T08:02:40.507 INFO:tasks.workunit.client.0.smithi107.stdout:2/123: fdatasync d1/d6/f18 0 2024-09-21T08:02:40.507 INFO:tasks.workunit.client.0.smithi107.stdout:2/124: fdatasync d1/d6/f18 0 2024-09-21T08:02:40.508 INFO:tasks.workunit.client.0.smithi107.stdout:0/271: dwrite d1/d23/f3a [0,4194304] 0 2024-09-21T08:02:40.509 INFO:tasks.workunit.client.1.smithi129.stdout:0/980: link de/d15/d44/ldf de/d19/d5e/l13a 0 2024-09-21T08:02:40.510 INFO:tasks.workunit.client.0.smithi107.stdout:2/125: creat d1/f26 x:0 0 0 2024-09-21T08:02:40.510 INFO:tasks.workunit.client.0.smithi107.stdout:2/126: dread - d1/d6/f21 zero size 2024-09-21T08:02:40.510 INFO:tasks.workunit.client.0.smithi107.stdout:1/156: dread d0/d7/f9 [0,4194304] 0 2024-09-21T08:02:40.510 INFO:tasks.workunit.client.0.smithi107.stdout:1/157: chown d0/l14 8 1 2024-09-21T08:02:40.511 INFO:tasks.workunit.client.1.smithi129.stdout:8/852: rename d0/d6/d7/d18/d27/f2d to d0/d6/d7/d18/de0/f105 0 2024-09-21T08:02:40.513 INFO:tasks.workunit.client.0.smithi107.stdout:9/276: sync 2024-09-21T08:02:40.513 INFO:tasks.workunit.client.0.smithi107.stdout:8/107: sync 2024-09-21T08:02:40.513 INFO:tasks.workunit.client.0.smithi107.stdout:4/166: sync 2024-09-21T08:02:40.514 INFO:tasks.workunit.client.1.smithi129.stdout:9/934: mknod d17/d46/d9c/c130 0 2024-09-21T08:02:40.514 INFO:tasks.workunit.client.1.smithi129.stdout:9/935: stat d17/d22/d33/d7a/d89/d90/db1/f66 0 2024-09-21T08:02:40.514 INFO:tasks.workunit.client.1.smithi129.stdout:9/936: fsync d17/d46/fb2 0 2024-09-21T08:02:40.516 INFO:tasks.workunit.client.1.smithi129.stdout:4/937: mkdir d5/d33/d4e/da7/d123/da8/dbc/d145 0 2024-09-21T08:02:40.516 INFO:tasks.workunit.client.1.smithi129.stdout:4/938: dread - d5/d16/d47/ffb zero size 2024-09-21T08:02:40.517 INFO:tasks.workunit.client.1.smithi129.stdout:0/981: mkdir de/d19/d5e/d13b 0 2024-09-21T08:02:40.517 INFO:tasks.workunit.client.1.smithi129.stdout:0/982: read de/f64 [67710,62029] 0 2024-09-21T08:02:40.518 INFO:tasks.workunit.client.0.smithi107.stdout:0/272: mknod d1/d5/d25/d3d/d20/d29/d55/c5b 0 2024-09-21T08:02:40.520 INFO:tasks.workunit.client.1.smithi129.stdout:8/853: creat d0/d6/d7/d18/d27/f106 x:0 0 0 2024-09-21T08:02:40.520 INFO:tasks.workunit.client.0.smithi107.stdout:2/127: mknod d1/d6/c27 0 2024-09-21T08:02:40.522 INFO:tasks.workunit.client.0.smithi107.stdout:1/158: truncate d0/f11 4173940 0 2024-09-21T08:02:40.522 INFO:tasks.workunit.client.0.smithi107.stdout:2/128: dread d1/f3 [0,4194304] 0 2024-09-21T08:02:40.524 INFO:tasks.workunit.client.0.smithi107.stdout:8/108: fdatasync d5/fe 0 2024-09-21T08:02:40.529 INFO:tasks.workunit.client.0.smithi107.stdout:0/273: mkdir d1/d5/d25/d3d/d20/d29/d5c 0 2024-09-21T08:02:40.529 INFO:tasks.workunit.client.0.smithi107.stdout:0/274: chown d1/d23/l56 178455390 1 2024-09-21T08:02:40.530 INFO:tasks.workunit.client.0.smithi107.stdout:2/129: mknod d1/d16/c28 0 2024-09-21T08:02:40.531 INFO:tasks.workunit.client.1.smithi129.stdout:9/937: unlink d17/d46/f10f 0 2024-09-21T08:02:40.532 INFO:tasks.workunit.client.0.smithi107.stdout:8/109: truncate d5/fd 1365751 0 2024-09-21T08:02:40.532 INFO:tasks.workunit.client.0.smithi107.stdout:8/110: fsync f0 0 2024-09-21T08:02:40.536 INFO:tasks.workunit.client.1.smithi129.stdout:4/939: stat d5/c15 0 2024-09-21T08:02:40.537 INFO:tasks.workunit.client.1.smithi129.stdout:0/983: mkdir de/d15/d44/da6/d13c 0 2024-09-21T08:02:40.537 INFO:tasks.workunit.client.1.smithi129.stdout:0/984: read de/d1f/f34 [86679,10881] 0 2024-09-21T08:02:40.538 INFO:tasks.workunit.client.0.smithi107.stdout:8/111: mkdir d5/d2e 0 2024-09-21T08:02:40.539 INFO:tasks.workunit.client.1.smithi129.stdout:9/938: rmdir d17/d22/d33/d7a/d89/d90/db1/d31/d5e/d6b/db6 39 2024-09-21T08:02:40.540 INFO:tasks.workunit.client.1.smithi129.stdout:4/940: mknod d5/d33/d6d/df0/c146 0 2024-09-21T08:02:40.541 INFO:tasks.workunit.client.1.smithi129.stdout:4/941: write d5/d11/f45 [274533,112185] 0 2024-09-21T08:02:40.541 INFO:tasks.workunit.client.0.smithi107.stdout:8/112: creat d5/d23/f2f x:0 0 0 2024-09-21T08:02:40.541 INFO:tasks.workunit.client.1.smithi129.stdout:0/985: truncate de/d81/d10e/dc0/fcb 7949173 0 2024-09-21T08:02:40.542 INFO:tasks.workunit.client.1.smithi129.stdout:4/942: mkdir d5/d33/d6d/df0/d147 0 2024-09-21T08:02:40.544 INFO:tasks.workunit.client.0.smithi107.stdout:8/113: mknod d5/c30 0 2024-09-21T08:02:40.544 INFO:tasks.workunit.client.1.smithi129.stdout:0/986: rename de/d1f/dd4/db1/df5/d113/f117 to de/d19/dad/f13d 0 2024-09-21T08:02:40.545 INFO:tasks.workunit.client.1.smithi129.stdout:4/943: unlink d5/cf 0 2024-09-21T08:02:40.553 INFO:tasks.workunit.client.1.smithi129.stdout:9/939: dread d17/d22/d33/d7a/d89/d90/db1/d31/d35/fd2 [0,4194304] 0 2024-09-21T08:02:40.554 INFO:tasks.workunit.client.1.smithi129.stdout:9/940: mknod d17/d46/dd4/c131 0 2024-09-21T08:02:40.560 INFO:tasks.workunit.client.0.smithi107.stdout:1/159: dwrite d0/d7/d1c/f26 [0,4194304] 0 2024-09-21T08:02:40.560 INFO:tasks.workunit.client.1.smithi129.stdout:6/985: sync 2024-09-21T08:02:40.562 INFO:tasks.workunit.client.1.smithi129.stdout:6/986: truncate d7/d1b/d1e/d39/d4b/de8/d69/faf 332504 0 2024-09-21T08:02:40.562 INFO:tasks.workunit.client.1.smithi129.stdout:6/987: chown d7/d1b/d1e/d39/d4b/c44 6244251 1 2024-09-21T08:02:40.563 INFO:tasks.workunit.client.1.smithi129.stdout:6/988: fsync d7/d1b/d1e/d39/d79/db8/fd3 0 2024-09-21T08:02:40.564 INFO:tasks.workunit.client.0.smithi107.stdout:1/160: symlink d0/d7/l34 0 2024-09-21T08:02:40.565 INFO:tasks.workunit.client.1.smithi129.stdout:6/989: symlink d7/d1b/d1e/d66/dc2/d93/d136/l146 0 2024-09-21T08:02:40.566 INFO:tasks.workunit.client.0.smithi107.stdout:4/167: dwrite dc/d13/f28 [0,4194304] 0 2024-09-21T08:02:40.566 INFO:tasks.workunit.client.0.smithi107.stdout:1/161: mkdir d0/d29/d2c/d35 0 2024-09-21T08:02:40.568 INFO:tasks.workunit.client.1.smithi129.stdout:6/990: link d7/d1b/d57/dd6/l113 d7/d1b/d1e/d39/d111/d11f/l147 0 2024-09-21T08:02:40.578 INFO:tasks.workunit.client.1.smithi129.stdout:8/854: dwrite d0/d6/d7/f21 [0,4194304] 0 2024-09-21T08:02:40.579 INFO:tasks.workunit.client.0.smithi107.stdout:4/168: write dc/d13/f18 [3313968,70570] 0 2024-09-21T08:02:40.581 INFO:tasks.workunit.client.0.smithi107.stdout:0/275: dwrite d1/d5/d25/d3d/d20/d29/f2e [0,4194304] 0 2024-09-21T08:02:40.583 INFO:tasks.workunit.client.0.smithi107.stdout:2/130: dwrite d1/f26 [0,4194304] 0 2024-09-21T08:02:40.583 INFO:tasks.workunit.client.0.smithi107.stdout:8/114: dwrite d5/d23/f2b [0,4194304] 0 2024-09-21T08:02:40.584 INFO:tasks.workunit.client.1.smithi129.stdout:8/855: write d0/d6/d7/d18/d27/d60/d85/fcf [769992,13553] 0 2024-09-21T08:02:40.588 INFO:tasks.workunit.client.0.smithi107.stdout:1/162: write d0/f11 [495409,83409] 0 2024-09-21T08:02:40.588 INFO:tasks.workunit.client.0.smithi107.stdout:1/163: write d0/f11 [3458717,126194] 0 2024-09-21T08:02:40.588 INFO:tasks.workunit.client.0.smithi107.stdout:1/164: chown d0/d7 54 1 2024-09-21T08:02:40.589 INFO:tasks.workunit.client.0.smithi107.stdout:1/165: write d0/d19/f33 [962552,28448] 0 2024-09-21T08:02:40.589 INFO:tasks.workunit.client.1.smithi129.stdout:9/941: dwrite d17/f61 [0,4194304] 0 2024-09-21T08:02:40.590 INFO:tasks.workunit.client.1.smithi129.stdout:6/991: dwrite d7/d1b/d1e/d66/dc2/de2/d40/d41/f70 [0,4194304] 0 2024-09-21T08:02:40.591 INFO:tasks.workunit.client.0.smithi107.stdout:2/131: rename d1/l1a to d1/d2/l29 0 2024-09-21T08:02:40.594 INFO:tasks.workunit.client.0.smithi107.stdout:8/115: symlink d5/d2e/l31 0 2024-09-21T08:02:40.594 INFO:tasks.workunit.client.0.smithi107.stdout:8/116: fdatasync d5/d23/f2b 0 2024-09-21T08:02:40.595 INFO:tasks.workunit.client.1.smithi129.stdout:0/987: dwrite de/fcd [0,4194304] 0 2024-09-21T08:02:40.595 INFO:tasks.workunit.client.1.smithi129.stdout:0/988: dread - de/d22/d27/d85/db2/dc3/ff1 zero size 2024-09-21T08:02:40.595 INFO:tasks.workunit.client.0.smithi107.stdout:0/276: getdents d1/d23 0 2024-09-21T08:02:40.595 INFO:tasks.workunit.client.0.smithi107.stdout:0/277: creat d1/d5/f5d x:0 0 0 2024-09-21T08:02:40.596 INFO:tasks.workunit.client.1.smithi129.stdout:0/989: chown de/f7b 2171 1 2024-09-21T08:02:40.597 INFO:tasks.workunit.client.1.smithi129.stdout:4/944: dwrite d5/d16/d47/f70 [4194304,4194304] 0 2024-09-21T08:02:40.597 INFO:tasks.workunit.client.1.smithi129.stdout:8/856: dread d0/d6/d7/d5a/f5c [0,4194304] 0 2024-09-21T08:02:40.597 INFO:tasks.workunit.client.1.smithi129.stdout:4/945: creat d5/da5/d130/f148 x:0 0 0 2024-09-21T08:02:40.597 INFO:tasks.workunit.client.0.smithi107.stdout:1/166: truncate d0/d7/f1a 4329647 0 2024-09-21T08:02:40.599 INFO:tasks.workunit.client.0.smithi107.stdout:2/132: mknod d1/d1e/c2a 0 2024-09-21T08:02:40.601 INFO:tasks.workunit.client.0.smithi107.stdout:4/169: dread dc/d13/f18 [0,4194304] 0 2024-09-21T08:02:40.601 INFO:tasks.workunit.client.0.smithi107.stdout:4/170: stat dc/f2c 0 2024-09-21T08:02:40.603 INFO:tasks.workunit.client.0.smithi107.stdout:8/117: truncate f3 237042 0 2024-09-21T08:02:40.608 INFO:tasks.workunit.client.1.smithi129.stdout:0/990: mknod de/d22/d27/d85/db2/dbe/c13e 0 2024-09-21T08:02:40.608 INFO:tasks.workunit.client.1.smithi129.stdout:0/991: read de/d22/d27/d10a/fe2 [762020,32680] 0 2024-09-21T08:02:40.608 INFO:tasks.workunit.client.1.smithi129.stdout:0/992: chown de/d22/d27/d85/db2/dbe 0 1 2024-09-21T08:02:40.608 INFO:tasks.workunit.client.1.smithi129.stdout:0/993: truncate de/d15/d87/fc8 37757 0 2024-09-21T08:02:40.611 INFO:tasks.workunit.client.0.smithi107.stdout:1/167: mkdir d0/d7/d1c/d20/d36 0 2024-09-21T08:02:40.612 INFO:tasks.workunit.client.1.smithi129.stdout:8/857: symlink d0/d6/d7/d5a/dbc/l107 0 2024-09-21T08:02:40.612 INFO:tasks.workunit.client.0.smithi107.stdout:2/133: symlink d1/d1e/l2b 0 2024-09-21T08:02:40.615 INFO:tasks.workunit.client.1.smithi129.stdout:8/858: dread d0/d6/d7/d9/f12 [0,4194304] 0 2024-09-21T08:02:40.616 INFO:tasks.workunit.client.0.smithi107.stdout:4/171: mknod dc/c33 0 2024-09-21T08:02:40.618 INFO:tasks.workunit.client.1.smithi129.stdout:4/946: creat d5/d48/f149 x:0 0 0 2024-09-21T08:02:40.618 INFO:tasks.workunit.client.1.smithi129.stdout:4/947: chown d5/d33/d66 398178 1 2024-09-21T08:02:40.619 INFO:tasks.workunit.client.0.smithi107.stdout:8/118: chown d5/l1a 7777 1 2024-09-21T08:02:40.619 INFO:tasks.workunit.client.1.smithi129.stdout:8/859: dread d0/d6/d7/d3a/d8e/ffd [0,4194304] 0 2024-09-21T08:02:40.619 INFO:tasks.workunit.client.1.smithi129.stdout:6/992: dwrite d7/d1b/d1e/d66/ff6 [0,4194304] 0 2024-09-21T08:02:40.619 INFO:tasks.workunit.client.1.smithi129.stdout:9/942: dwrite d17/d22/d33/d36/d48/f95 [0,4194304] 0 2024-09-21T08:02:40.621 INFO:tasks.workunit.client.1.smithi129.stdout:0/994: unlink de/d19/f38 0 2024-09-21T08:02:40.622 INFO:tasks.workunit.client.1.smithi129.stdout:4/948: symlink d5/d33/d4e/d128/l14a 0 2024-09-21T08:02:40.623 INFO:tasks.workunit.client.1.smithi129.stdout:4/949: write d5/d33/d4e/da7/d123/da8/f100 [743729,117035] 0 2024-09-21T08:02:40.626 INFO:tasks.workunit.client.1.smithi129.stdout:6/993: symlink d7/d1b/d1e/d66/dc2/l148 0 2024-09-21T08:02:40.628 INFO:tasks.workunit.client.1.smithi129.stdout:6/994: read d7/d10/fa8 [616492,52431] 0 2024-09-21T08:02:40.628 INFO:tasks.workunit.client.1.smithi129.stdout:8/860: creat d0/d6/d7/d18/d27/d32/d70/f108 x:0 0 0 2024-09-21T08:02:40.634 INFO:tasks.workunit.client.1.smithi129.stdout:4/950: mkdir d5/d11/d3f/d50/d14b 0 2024-09-21T08:02:40.634 INFO:tasks.workunit.client.1.smithi129.stdout:4/951: dread - d5/d16/d47/d5f/f12f zero size 2024-09-21T08:02:40.635 INFO:tasks.workunit.client.1.smithi129.stdout:0/995: dread de/d15/d39/d56/f63 [0,4194304] 0 2024-09-21T08:02:40.635 INFO:tasks.workunit.client.1.smithi129.stdout:0/996: chown de/d1f/dd4/db1/c12e 910 1 2024-09-21T08:02:40.635 INFO:tasks.workunit.client.1.smithi129.stdout:0/997: chown de/d22/c2c 19575 1 2024-09-21T08:02:40.635 INFO:tasks.workunit.client.1.smithi129.stdout:0/998: write de/d22/d27/d10a/d42/f77 [3437614,124106] 0 2024-09-21T08:02:40.636 INFO:tasks.workunit.client.1.smithi129.stdout:8/861: unlink d0/d6/ca8 0 2024-09-21T08:02:40.636 INFO:tasks.workunit.client.1.smithi129.stdout:8/862: fdatasync d0/d6/d7/d24/f56 0 2024-09-21T08:02:40.636 INFO:tasks.workunit.client.0.smithi107.stdout:2/134: dwrite d1/f26 [0,4194304] 0 2024-09-21T08:02:40.636 INFO:tasks.workunit.client.0.smithi107.stdout:1/168: creat d0/d29/f37 x:0 0 0 2024-09-21T08:02:40.637 INFO:tasks.workunit.client.1.smithi129.stdout:9/943: mknod d17/d22/d33/c132 0 2024-09-21T08:02:40.638 INFO:tasks.workunit.client.0.smithi107.stdout:4/172: getdents dc/d13 0 2024-09-21T08:02:40.638 INFO:tasks.workunit.client.0.smithi107.stdout:4/173: write dc/d13/f16 [4835648,8368] 0 2024-09-21T08:02:40.638 INFO:tasks.workunit.client.0.smithi107.stdout:4/174: stat dc/c19 0 2024-09-21T08:02:40.638 INFO:tasks.workunit.client.1.smithi129.stdout:6/995: read d7/d1b/d1e/d39/d4b/de8/fac [1865861,71694] 0 2024-09-21T08:02:40.639 INFO:tasks.workunit.client.1.smithi129.stdout:0/999: truncate f6 440486 0 2024-09-21T08:02:40.641 INFO:tasks.workunit.client.1.smithi129.stdout:9/944: symlink d17/d22/d33/d36/d48/db7/l133 0 2024-09-21T08:02:40.642 INFO:tasks.workunit.client.1.smithi129.stdout:9/945: dread - d17/d55/dd1/f125 zero size 2024-09-21T08:02:40.646 INFO:tasks.workunit.client.1.smithi129.stdout:6/996: creat d7/d1b/d1e/d39/d79/db8/f149 x:0 0 0 2024-09-21T08:02:40.647 INFO:tasks.workunit.client.1.smithi129.stdout:8/863: dread d0/d6/f1f [0,4194304] 0 2024-09-21T08:02:40.647 INFO:tasks.workunit.client.1.smithi129.stdout:8/864: fdatasync d0/d6/f1a 0 2024-09-21T08:02:40.648 INFO:tasks.workunit.client.0.smithi107.stdout:2/135: symlink d1/d16/l2c 0 2024-09-21T08:02:40.648 INFO:tasks.workunit.client.0.smithi107.stdout:2/136: dread - d1/d6/f21 zero size 2024-09-21T08:02:40.649 INFO:tasks.workunit.client.1.smithi129.stdout:9/946: link d17/d22/d33/d36/d48/cdf d17/d22/d33/de6/d11d/c134 0 2024-09-21T08:02:40.649 INFO:tasks.workunit.client.1.smithi129.stdout:9/947: chown d17/d22/d33/d36/d48/cdf 30227 1 2024-09-21T08:02:40.649 INFO:tasks.workunit.client.1.smithi129.stdout:9/948: readlink le 0 2024-09-21T08:02:40.650 INFO:tasks.workunit.client.1.smithi129.stdout:8/865: dread d0/f67 [0,4194304] 0 2024-09-21T08:02:40.651 INFO:tasks.workunit.client.0.smithi107.stdout:1/169: rmdir d0/d29/d2c/d35 0 2024-09-21T08:02:40.653 INFO:tasks.workunit.client.1.smithi129.stdout:6/997: mknod d7/d1b/d1e/d39/d4b/de8/d69/c14a 0 2024-09-21T08:02:40.656 INFO:tasks.workunit.client.1.smithi129.stdout:9/949: creat d17/d60/d7b/dc4/f135 x:0 0 0 2024-09-21T08:02:40.656 INFO:tasks.workunit.client.1.smithi129.stdout:9/950: read - d17/d22/d33/d7a/d89/d90/db1/d31/d35/f11e zero size 2024-09-21T08:02:40.657 INFO:tasks.workunit.client.0.smithi107.stdout:4/175: truncate dc/f12 629666 0 2024-09-21T08:02:40.657 INFO:tasks.workunit.client.0.smithi107.stdout:4/176: read fb [895233,102030] 0 2024-09-21T08:02:40.657 INFO:tasks.workunit.client.0.smithi107.stdout:4/177: readlink dc/l22 0 2024-09-21T08:02:40.657 INFO:tasks.workunit.client.1.smithi129.stdout:8/866: symlink d0/d6/d7/d18/d27/dff/l109 0 2024-09-21T08:02:40.657 INFO:tasks.workunit.client.1.smithi129.stdout:9/951: dread d17/d22/d33/d7a/d89/d90/db1/d31/d35/f54 [0,4194304] 0 2024-09-21T08:02:40.657 INFO:tasks.workunit.client.1.smithi129.stdout:8/867: stat d0/d6/d7/d9/c64 0 2024-09-21T08:02:40.658 INFO:tasks.workunit.client.1.smithi129.stdout:9/952: fsync d17/d22/d33/d7a/d89/d90/db1/d31/f51 0 2024-09-21T08:02:40.660 INFO:tasks.workunit.client.0.smithi107.stdout:2/137: rename f0 to d1/d6/f2d 0 2024-09-21T08:02:40.660 INFO:tasks.workunit.client.0.smithi107.stdout:2/138: fdatasync d1/f26 0 2024-09-21T08:02:40.660 INFO:tasks.workunit.client.0.smithi107.stdout:2/139: creat d1/d6/f2e x:0 0 0 2024-09-21T08:02:40.660 INFO:tasks.workunit.client.0.smithi107.stdout:2/140: chown d1 8015 1 2024-09-21T08:02:40.660 INFO:tasks.workunit.client.0.smithi107.stdout:0/278: rmdir d1/d5 39 2024-09-21T08:02:40.660 INFO:tasks.workunit.client.0.smithi107.stdout:0/279: write d1/d5/d25/d2d/f2f [2627316,96503] 0 2024-09-21T08:02:40.662 INFO:tasks.workunit.client.1.smithi129.stdout:6/998: symlink d7/d1b/d8d/l14b 0 2024-09-21T08:02:40.662 INFO:tasks.workunit.client.1.smithi129.stdout:6/999: chown d7/d1b/d1e/d39/d111/d11f 119121997 1 2024-09-21T08:02:40.663 INFO:tasks.workunit.client.0.smithi107.stdout:1/170: link d0/d7/d1c/d20/c32 d0/d29/c38 0 2024-09-21T08:02:40.663 INFO:tasks.workunit.client.0.smithi107.stdout:1/171: chown d0/d29/d31/c24 685 1 2024-09-21T08:02:40.665 INFO:tasks.workunit.client.1.smithi129.stdout:4/952: dwrite d5/d33/d4e/f7b [0,4194304] 0 2024-09-21T08:02:40.666 INFO:tasks.workunit.client.1.smithi129.stdout:4/953: stat d5/d16/d24/d3b/f90 0 2024-09-21T08:02:40.666 INFO:tasks.workunit.client.0.smithi107.stdout:8/119: dwrite d5/f21 [0,4194304] 0 2024-09-21T08:02:40.667 INFO:tasks.workunit.client.0.smithi107.stdout:4/178: creat dc/d13/f34 x:0 0 0 2024-09-21T08:02:40.667 INFO:tasks.workunit.client.0.smithi107.stdout:4/179: chown dc/d13/l2b 147575 1 2024-09-21T08:02:40.667 INFO:tasks.workunit.client.0.smithi107.stdout:4/180: stat dc/l30 0 2024-09-21T08:02:40.669 INFO:tasks.workunit.client.0.smithi107.stdout:4/181: dread dc/f25 [0,4194304] 0 2024-09-21T08:02:40.670 INFO:tasks.workunit.client.1.smithi129.stdout:8/868: truncate d0/d6/d7/d18/d27/d32/d70/fa1 81589 0 2024-09-21T08:02:40.670 INFO:tasks.workunit.client.1.smithi129.stdout:8/869: stat d0/d6/dac/lcb 0 2024-09-21T08:02:40.670 INFO:tasks.workunit.client.1.smithi129.stdout:8/870: readlink d0/d6/d7/d18/lca 0 2024-09-21T08:02:40.671 INFO:tasks.workunit.client.0.smithi107.stdout:2/141: symlink d1/d2/l2f 0 2024-09-21T08:02:40.673 INFO:tasks.workunit.client.0.smithi107.stdout:1/172: write d0/f2 [6271520,39490] 0 2024-09-21T08:02:40.673 INFO:tasks.workunit.client.0.smithi107.stdout:1/173: write d0/d29/d2c/f2e [4319401,75790] 0 2024-09-21T08:02:40.673 INFO:tasks.workunit.client.0.smithi107.stdout:0/280: creat d1/d5/d25/d3d/d20/d29/d5c/f5e x:0 0 0 2024-09-21T08:02:40.675 INFO:tasks.workunit.client.0.smithi107.stdout:8/120: rename f3 to d5/d23/f32 0 2024-09-21T08:02:40.675 INFO:tasks.workunit.client.0.smithi107.stdout:8/121: fdatasync d5/d1d/f26 0 2024-09-21T08:02:40.675 INFO:tasks.workunit.client.0.smithi107.stdout:8/122: write d5/d23/f25 [181852,12730] 0 2024-09-21T08:02:40.677 INFO:tasks.workunit.client.1.smithi129.stdout:4/954: creat d5/da5/f14c x:0 0 0 2024-09-21T08:02:40.677 INFO:tasks.workunit.client.1.smithi129.stdout:4/955: creat d5/d33/d4e/da7/f14d x:0 0 0 2024-09-21T08:02:40.677 INFO:tasks.workunit.client.0.smithi107.stdout:2/142: symlink d1/d2/l30 0 2024-09-21T08:02:40.677 INFO:tasks.workunit.client.0.smithi107.stdout:2/143: creat d1/f31 x:0 0 0 2024-09-21T08:02:40.681 INFO:tasks.workunit.client.0.smithi107.stdout:0/281: creat d1/d5/d25/d2d/f5f x:0 0 0 2024-09-21T08:02:40.682 INFO:tasks.workunit.client.1.smithi129.stdout:9/953: dwrite f0 [0,4194304] 0 2024-09-21T08:02:40.683 INFO:tasks.workunit.client.0.smithi107.stdout:1/174: mkdir d0/d19/d39 0 2024-09-21T08:02:40.689 INFO:tasks.workunit.client.0.smithi107.stdout:2/144: creat d1/d16/f32 x:0 0 0 2024-09-21T08:02:40.689 INFO:tasks.workunit.client.0.smithi107.stdout:2/145: creat d1/f33 x:0 0 0 2024-09-21T08:02:40.690 INFO:tasks.workunit.client.0.smithi107.stdout:0/282: symlink d1/d5/d25/d2d/l60 0 2024-09-21T08:02:40.692 INFO:tasks.workunit.client.0.smithi107.stdout:1/175: mknod d0/d19/c3a 0 2024-09-21T08:02:40.693 INFO:tasks.workunit.client.1.smithi129.stdout:9/954: symlink d17/d126/l136 0 2024-09-21T08:02:40.695 INFO:tasks.workunit.client.1.smithi129.stdout:9/955: symlink d17/d22/d33/d36/d48/l137 0 2024-09-21T08:02:40.695 INFO:tasks.workunit.client.1.smithi129.stdout:9/956: write d17/d60/d7b/fb3 [2253211,71495] 0 2024-09-21T08:02:40.695 INFO:tasks.workunit.client.0.smithi107.stdout:3/182: sync 2024-09-21T08:02:40.701 INFO:tasks.workunit.client.1.smithi129.stdout:4/956: dwrite d5/f5c [0,4194304] 0 2024-09-21T08:02:40.701 INFO:tasks.workunit.client.1.smithi129.stdout:4/957: chown d5/d48/da9/c101 1 1 2024-09-21T08:02:40.702 INFO:tasks.workunit.client.0.smithi107.stdout:8/123: dwrite d5/fd [0,4194304] 0 2024-09-21T08:02:40.703 INFO:tasks.workunit.client.0.smithi107.stdout:3/183: dread f2 [0,4194304] 0 2024-09-21T08:02:40.703 INFO:tasks.workunit.client.0.smithi107.stdout:3/184: creat d8/d21/f33 x:0 0 0 2024-09-21T08:02:40.710 INFO:tasks.workunit.client.1.smithi129.stdout:4/958: mknod d5/d33/d6d/df0/c14e 0 2024-09-21T08:02:40.710 INFO:tasks.workunit.client.1.smithi129.stdout:4/959: truncate d5/d16/d24/d4f/f122 656772 0 2024-09-21T08:02:40.710 INFO:tasks.workunit.client.1.smithi129.stdout:4/960: write d5/d33/d4e/d128/f13f [923759,59778] 0 2024-09-21T08:02:40.712 INFO:tasks.workunit.client.1.smithi129.stdout:4/961: link d5/d16/d24/d4f/da1/fa3 d5/d33/d4e/da7/d123/de1/f14f 0 2024-09-21T08:02:40.713 INFO:tasks.workunit.client.1.smithi129.stdout:4/962: chown d5/d33/d4e/da7/d123 20 1 2024-09-21T08:02:40.716 INFO:tasks.workunit.client.1.smithi129.stdout:4/963: getdents d5/d16/d47/d61/d140 0 2024-09-21T08:02:40.720 INFO:tasks.workunit.client.1.smithi129.stdout:4/964: rmdir d5/d33/df2/d13d 0 2024-09-21T08:02:40.722 INFO:tasks.workunit.client.0.smithi107.stdout:3/185: mkdir d8/d25/d34 0 2024-09-21T08:02:40.723 INFO:tasks.workunit.client.0.smithi107.stdout:8/124: link d5/c17 d5/d2e/c33 0 2024-09-21T08:02:40.723 INFO:tasks.workunit.client.0.smithi107.stdout:8/125: chown f0 0 1 2024-09-21T08:02:40.724 INFO:tasks.workunit.client.0.smithi107.stdout:3/186: write d8/f1b [273540,28108] 0 2024-09-21T08:02:40.724 INFO:tasks.workunit.client.0.smithi107.stdout:8/126: unlink d5/fe 0 2024-09-21T08:02:40.725 INFO:tasks.workunit.client.0.smithi107.stdout:8/127: truncate d5/d23/f2f 891284 0 2024-09-21T08:02:40.725 INFO:tasks.workunit.client.0.smithi107.stdout:8/128: chown d5/c17 119044046 1 2024-09-21T08:02:40.725 INFO:tasks.workunit.client.0.smithi107.stdout:8/129: stat d5/l1a 0 2024-09-21T08:02:40.725 INFO:tasks.workunit.client.0.smithi107.stdout:0/283: dwrite d1/fe [0,4194304] 0 2024-09-21T08:02:40.725 INFO:tasks.workunit.client.0.smithi107.stdout:0/284: getdents d1/d23 0 2024-09-21T08:02:40.726 INFO:tasks.workunit.client.0.smithi107.stdout:8/130: symlink d5/d1d/l34 0 2024-09-21T08:02:40.726 INFO:tasks.workunit.client.1.smithi129.stdout:4/965: read d5/d33/d66/f68 [320130,36857] 0 2024-09-21T08:02:40.727 INFO:tasks.workunit.client.0.smithi107.stdout:0/285: getdents d1/d5 0 2024-09-21T08:02:40.727 INFO:tasks.workunit.client.0.smithi107.stdout:0/286: chown d1/d5/f2c 230764 1 2024-09-21T08:02:40.729 INFO:tasks.workunit.client.0.smithi107.stdout:8/131: link d5/d1d/f26 d5/d23/f35 0 2024-09-21T08:02:40.732 INFO:tasks.workunit.client.1.smithi129.stdout:4/966: mkdir d5/da5/d130/d150 0 2024-09-21T08:02:40.732 INFO:tasks.workunit.client.1.smithi129.stdout:4/967: fdatasync d5/d11/f4c 0 2024-09-21T08:02:40.734 INFO:tasks.workunit.client.0.smithi107.stdout:0/287: read d1/d5/d25/f4d [169973,95947] 0 2024-09-21T08:02:40.734 INFO:tasks.workunit.client.0.smithi107.stdout:0/288: readlink d1/d23/l30 0 2024-09-21T08:02:40.734 INFO:tasks.workunit.client.0.smithi107.stdout:0/289: getdents d1/d5/d25 0 2024-09-21T08:02:40.736 INFO:tasks.workunit.client.0.smithi107.stdout:0/290: mkdir d1/d23/d61 0 2024-09-21T08:02:40.736 INFO:tasks.workunit.client.0.smithi107.stdout:0/291: chown d1/d23/f2a 7941977 1 2024-09-21T08:02:40.736 INFO:tasks.workunit.client.0.smithi107.stdout:0/292: chown d1/d23/f3a 1 1 2024-09-21T08:02:40.736 INFO:tasks.workunit.client.0.smithi107.stdout:0/293: chown d1/d5/d25/d2d/l60 2179611 1 2024-09-21T08:02:40.737 INFO:tasks.workunit.client.0.smithi107.stdout:0/294: chown d1/d23 2 1 2024-09-21T08:02:40.738 INFO:tasks.workunit.client.0.smithi107.stdout:4/182: rename dc/f12 to dc/d13/f35 0 2024-09-21T08:02:40.738 INFO:tasks.workunit.client.0.smithi107.stdout:4/183: write dc/d13/f18 [270335,9644] 0 2024-09-21T08:02:40.739 INFO:tasks.workunit.client.0.smithi107.stdout:0/295: mknod d1/d5/d25/c62 0 2024-09-21T08:02:40.740 INFO:tasks.workunit.client.0.smithi107.stdout:8/132: read d5/f19 [1794166,63283] 0 2024-09-21T08:02:40.740 INFO:tasks.workunit.client.0.smithi107.stdout:8/133: truncate f0 988228 0 2024-09-21T08:02:40.742 INFO:tasks.workunit.client.0.smithi107.stdout:4/184: rename c2 to dc/d13/c36 0 2024-09-21T08:02:40.745 INFO:tasks.workunit.client.0.smithi107.stdout:1/176: rmdir d0/d7/d1c 39 2024-09-21T08:02:40.746 INFO:tasks.workunit.client.1.smithi129.stdout:4/968: dread d5/d16/d47/f70 [0,4194304] 0 2024-09-21T08:02:40.748 INFO:tasks.workunit.client.0.smithi107.stdout:3/187: rename d8/f11 to d8/d25/d34/f35 0 2024-09-21T08:02:40.748 INFO:tasks.workunit.client.0.smithi107.stdout:3/188: write d8/d21/f33 [396588,18045] 0 2024-09-21T08:02:40.750 INFO:tasks.workunit.client.0.smithi107.stdout:4/185: dread f7 [0,4194304] 0 2024-09-21T08:02:40.753 INFO:tasks.workunit.client.0.smithi107.stdout:0/296: dread d1/d5/f27 [0,4194304] 0 2024-09-21T08:02:40.755 INFO:tasks.workunit.client.0.smithi107.stdout:3/189: rename d8/d21/f33 to d8/d21/f36 0 2024-09-21T08:02:40.755 INFO:tasks.workunit.client.0.smithi107.stdout:4/186: symlink dc/d13/l37 0 2024-09-21T08:02:40.757 INFO:tasks.workunit.client.0.smithi107.stdout:1/177: read d0/d7/d1c/f26 [2917664,95860] 0 2024-09-21T08:02:40.760 INFO:tasks.workunit.client.0.smithi107.stdout:3/190: dread d8/d14/d1d/f1e [0,4194304] 0 2024-09-21T08:02:40.765 INFO:tasks.workunit.client.0.smithi107.stdout:0/297: write d1/d5/d25/d2d/f2f [627877,50115] 0 2024-09-21T08:02:40.765 INFO:tasks.workunit.client.0.smithi107.stdout:4/187: rename dc/f11 to dc/d13/f38 0 2024-09-21T08:02:40.770 INFO:tasks.workunit.client.1.smithi129.stdout:8/871: rename d0/d6/d7/d18/d27/d32 to d0/d6/d7/d18/d27/d60/d85/d10a 0 2024-09-21T08:02:40.774 INFO:tasks.workunit.client.0.smithi107.stdout:3/191: symlink d8/d14/d1d/l37 0 2024-09-21T08:02:40.774 INFO:tasks.workunit.client.0.smithi107.stdout:3/192: stat d8/d14/d1d/c28 0 2024-09-21T08:02:40.776 INFO:tasks.workunit.client.0.smithi107.stdout:1/178: rename d0/d7/f9 to d0/d19/f3b 0 2024-09-21T08:02:40.776 INFO:tasks.workunit.client.1.smithi129.stdout:4/969: dwrite d5/d11/d3f/d50/f51 [0,4194304] 0 2024-09-21T08:02:40.776 INFO:tasks.workunit.client.1.smithi129.stdout:4/970: creat d5/d11/d3f/f151 x:0 0 0 2024-09-21T08:02:40.778 INFO:tasks.workunit.client.0.smithi107.stdout:3/193: mkdir d8/d38 0 2024-09-21T08:02:40.778 INFO:tasks.workunit.client.0.smithi107.stdout:3/194: truncate d8/d25/d34/f35 2237362 0 2024-09-21T08:02:40.780 INFO:tasks.workunit.client.0.smithi107.stdout:1/179: truncate d0/d29/d2c/f30 2039743 0 2024-09-21T08:02:40.780 INFO:tasks.workunit.client.0.smithi107.stdout:1/180: write d0/d29/f37 [411490,72843] 0 2024-09-21T08:02:40.782 INFO:tasks.workunit.client.1.smithi129.stdout:8/872: write d0/d6/d7/d18/d27/d60/d85/dcc/fea [1457065,98054] 0 2024-09-21T08:02:40.782 INFO:tasks.workunit.client.1.smithi129.stdout:4/971: mknod d5/da5/c152 0 2024-09-21T08:02:40.782 INFO:tasks.workunit.client.1.smithi129.stdout:4/972: stat d5/d16/d24/d3b/f65 0 2024-09-21T08:02:40.783 INFO:tasks.workunit.client.0.smithi107.stdout:3/195: symlink d8/d38/l39 0 2024-09-21T08:02:40.784 INFO:tasks.workunit.client.1.smithi129.stdout:8/873: mkdir d0/d6/d7/d18/d27/d60/d85/dcc/d10b 0 2024-09-21T08:02:40.786 INFO:tasks.workunit.client.0.smithi107.stdout:1/181: link d0/f11 d0/f3c 0 2024-09-21T08:02:40.786 INFO:tasks.workunit.client.1.smithi129.stdout:4/973: mknod d5/d6/c153 0 2024-09-21T08:02:40.786 INFO:tasks.workunit.client.1.smithi129.stdout:4/974: chown d5/d11/d3f/d50/cb5 491258 1 2024-09-21T08:02:40.788 INFO:tasks.workunit.client.0.smithi107.stdout:3/196: rename d8/d2b/f2d to d8/d14/d1d/f3a 0 2024-09-21T08:02:40.788 INFO:tasks.workunit.client.0.smithi107.stdout:4/188: dwrite dc/d13/f16 [0,4194304] 0 2024-09-21T08:02:40.791 INFO:tasks.workunit.client.0.smithi107.stdout:1/182: creat d0/d7/d1c/f3d x:0 0 0 2024-09-21T08:02:40.793 INFO:tasks.workunit.client.0.smithi107.stdout:3/197: rename d8/f15 to d8/d2b/f3b 0 2024-09-21T08:02:40.793 INFO:tasks.workunit.client.1.smithi129.stdout:4/975: getdents d5/d48 0 2024-09-21T08:02:40.794 INFO:tasks.workunit.client.1.smithi129.stdout:4/976: creat d5/d33/d4e/da7/d123/da8/dbc/d121/f154 x:0 0 0 2024-09-21T08:02:40.795 INFO:tasks.workunit.client.0.smithi107.stdout:2/146: getdents d1/d16 0 2024-09-21T08:02:40.796 INFO:tasks.workunit.client.0.smithi107.stdout:2/147: truncate d1/d1e/d23/f25 986286 0 2024-09-21T08:02:40.796 INFO:tasks.workunit.client.0.smithi107.stdout:2/148: creat d1/d2/f34 x:0 0 0 2024-09-21T08:02:40.796 INFO:tasks.workunit.client.0.smithi107.stdout:2/149: chown d1/f3 9436492 1 2024-09-21T08:02:40.798 INFO:tasks.workunit.client.0.smithi107.stdout:4/189: rename dc/lf to dc/d13/l39 0 2024-09-21T08:02:40.798 INFO:tasks.workunit.client.0.smithi107.stdout:4/190: read f8 [1290978,69649] 0 2024-09-21T08:02:40.798 INFO:tasks.workunit.client.0.smithi107.stdout:4/191: write f7 [2511593,1663] 0 2024-09-21T08:02:40.798 INFO:tasks.workunit.client.0.smithi107.stdout:3/198: dread d8/d14/d1d/f1e [0,4194304] 0 2024-09-21T08:02:40.799 INFO:tasks.workunit.client.1.smithi129.stdout:4/977: creat d5/d33/d4e/da7/d123/da8/dbc/d121/d136/f155 x:0 0 0 2024-09-21T08:02:40.800 INFO:tasks.workunit.client.0.smithi107.stdout:2/150: truncate d1/d6/f18 3961873 0 2024-09-21T08:02:40.801 INFO:tasks.workunit.client.1.smithi129.stdout:8/874: dwrite d0/d6/d7/d18/d27/d60/d85/d10a/fa7 [0,4194304] 0 2024-09-21T08:02:40.802 INFO:tasks.workunit.client.1.smithi129.stdout:4/978: rename d5/d11/d3f/d50/f11c to d5/d33/d4e/d128/f156 0 2024-09-21T08:02:40.802 INFO:tasks.workunit.client.1.smithi129.stdout:4/979: truncate d5/fba 434320 0 2024-09-21T08:02:40.802 INFO:tasks.workunit.client.1.smithi129.stdout:4/980: write d5/da5/fb3 [4827183,121134] 0 2024-09-21T08:02:40.804 INFO:tasks.workunit.client.0.smithi107.stdout:3/199: creat d8/d38/f3c x:0 0 0 2024-09-21T08:02:40.806 INFO:tasks.workunit.client.0.smithi107.stdout:2/151: mkdir d1/d16/d35 0 2024-09-21T08:02:40.807 INFO:tasks.workunit.client.1.smithi129.stdout:8/875: mknod d0/d6/d7/d18/d27/d60/d85/c10c 0 2024-09-21T08:02:40.807 INFO:tasks.workunit.client.1.smithi129.stdout:9/957: rmdir d17/d22/d33/d36 39 2024-09-21T08:02:40.812 INFO:tasks.workunit.client.0.smithi107.stdout:2/152: stat d1/d2/cd 0 2024-09-21T08:02:40.812 INFO:tasks.workunit.client.1.smithi129.stdout:4/981: rename d5/d16/d24/d3b/fc2 to d5/d33/f157 0 2024-09-21T08:02:40.813 INFO:tasks.workunit.client.0.smithi107.stdout:2/153: mknod d1/d16/c36 0 2024-09-21T08:02:40.813 INFO:tasks.workunit.client.0.smithi107.stdout:2/154: chown d1/d1e/d23/f25 342713 1 2024-09-21T08:02:40.815 INFO:tasks.workunit.client.1.smithi129.stdout:8/876: rename d0/d6/d7/d5a/dbc/le5 to d0/d6/d7/d18/d61/d7f/l10d 0 2024-09-21T08:02:40.816 INFO:tasks.workunit.client.0.smithi107.stdout:2/155: mkdir d1/d1e/d23/d37 0 2024-09-21T08:02:40.818 INFO:tasks.workunit.client.1.smithi129.stdout:8/877: link d0/d6/d7/d5d/fe1 d0/d6/d7/d9/dd5/f10e 0 2024-09-21T08:02:40.818 INFO:tasks.workunit.client.0.smithi107.stdout:2/156: rmdir d1/d16 39 2024-09-21T08:02:40.820 INFO:tasks.workunit.client.1.smithi129.stdout:4/982: write d5/d16/d24/fa0 [798671,42106] 0 2024-09-21T08:02:40.829 INFO:tasks.workunit.client.0.smithi107.stdout:6/251: sync 2024-09-21T08:02:40.830 INFO:tasks.workunit.client.0.smithi107.stdout:7/169: sync 2024-09-21T08:02:40.830 INFO:tasks.workunit.client.0.smithi107.stdout:5/279: sync 2024-09-21T08:02:40.830 INFO:tasks.workunit.client.0.smithi107.stdout:5/280: stat d7/de/d1d/f37 0 2024-09-21T08:02:40.830 INFO:tasks.workunit.client.0.smithi107.stdout:5/281: chown d7/f8 1 1 2024-09-21T08:02:40.830 INFO:tasks.workunit.client.0.smithi107.stdout:6/252: truncate d2/d3/f9 461374 0 2024-09-21T08:02:40.831 INFO:tasks.workunit.client.0.smithi107.stdout:3/200: dwrite d8/d21/f24 [0,4194304] 0 2024-09-21T08:02:40.831 INFO:tasks.workunit.client.0.smithi107.stdout:3/201: stat d8/d14/d1d/c2e 0 2024-09-21T08:02:40.833 INFO:tasks.workunit.client.0.smithi107.stdout:6/253: truncate d2/d3/d7/f15 203385 0 2024-09-21T08:02:40.836 INFO:tasks.workunit.client.0.smithi107.stdout:3/202: mkdir d8/d25/d3d 0 2024-09-21T08:02:40.840 INFO:tasks.workunit.client.0.smithi107.stdout:5/282: getdents d7/de/d1d/d24/d3d 0 2024-09-21T08:02:40.841 INFO:tasks.workunit.client.0.smithi107.stdout:7/170: dread d7/f11 [0,4194304] 0 2024-09-21T08:02:40.842 INFO:tasks.workunit.client.1.smithi129.stdout:9/958: dwrite d17/d22/d33/d7a/d89/d90/db1/d31/d35/fbb [0,4194304] 0 2024-09-21T08:02:40.842 INFO:tasks.workunit.client.1.smithi129.stdout:8/878: dwrite d0/d6/f1a [0,4194304] 0 2024-09-21T08:02:40.843 INFO:tasks.workunit.client.1.smithi129.stdout:8/879: creat d0/d6/d7/d9/dd5/f10f x:0 0 0 2024-09-21T08:02:40.843 INFO:tasks.workunit.client.1.smithi129.stdout:8/880: fdatasync d0/d6/d7/d18/d61/d7f/dd2/f101 0 2024-09-21T08:02:40.843 INFO:tasks.workunit.client.1.smithi129.stdout:8/881: chown d0/d6/d7/d18/d61/cde 4340779 1 2024-09-21T08:02:40.844 INFO:tasks.workunit.client.0.smithi107.stdout:5/283: mkdir d7/de/d1d/d24/d3d/d65 0 2024-09-21T08:02:40.844 INFO:tasks.workunit.client.0.smithi107.stdout:5/284: stat d7/de/d1d/l3b 0 2024-09-21T08:02:40.844 INFO:tasks.workunit.client.0.smithi107.stdout:7/171: rmdir d7/d10 39 2024-09-21T08:02:40.845 INFO:tasks.workunit.client.0.smithi107.stdout:7/172: fsync d7/d18/f29 0 2024-09-21T08:02:40.848 INFO:tasks.workunit.client.0.smithi107.stdout:5/285: stat c4 0 2024-09-21T08:02:40.848 INFO:tasks.workunit.client.0.smithi107.stdout:5/286: dread - d7/de/d2d/f55 zero size 2024-09-21T08:02:40.848 INFO:tasks.workunit.client.0.smithi107.stdout:5/287: write d7/de/f30 [1127173,48047] 0 2024-09-21T08:02:40.849 INFO:tasks.workunit.client.0.smithi107.stdout:9/277: sync 2024-09-21T08:02:40.849 INFO:tasks.workunit.client.0.smithi107.stdout:9/278: dread - d11/d27/d2a/f63 zero size 2024-09-21T08:02:40.850 INFO:tasks.workunit.client.0.smithi107.stdout:7/173: mkdir d7/d22/d3d 0 2024-09-21T08:02:40.852 INFO:tasks.workunit.client.1.smithi129.stdout:9/959: getdents d17/d22/d33/d36/d48 0 2024-09-21T08:02:40.852 INFO:tasks.workunit.client.1.smithi129.stdout:9/960: readlink d17/d126/l136 0 2024-09-21T08:02:40.853 INFO:tasks.workunit.client.0.smithi107.stdout:1/183: write d0/d29/d2c/f30 [3071147,7488] 0 2024-09-21T08:02:40.853 INFO:tasks.workunit.client.0.smithi107.stdout:6/254: dwrite d2/d3/d7/d24/f34 [0,4194304] 0 2024-09-21T08:02:40.854 INFO:tasks.workunit.client.0.smithi107.stdout:5/288: symlink d7/de/d2d/l66 0 2024-09-21T08:02:40.855 INFO:tasks.workunit.client.0.smithi107.stdout:9/279: symlink d11/d27/d2f/l65 0 2024-09-21T08:02:40.859 INFO:tasks.workunit.client.0.smithi107.stdout:7/174: unlink d7/d22/c2c 0 2024-09-21T08:02:40.862 INFO:tasks.workunit.client.0.smithi107.stdout:1/184: link d0/d29/d31/c24 d0/d7/d1c/c3e 0 2024-09-21T08:02:40.862 INFO:tasks.workunit.client.0.smithi107.stdout:1/185: readlink d0/d19/l21 0 2024-09-21T08:02:40.863 INFO:tasks.workunit.client.0.smithi107.stdout:6/255: write d2/d3/d7/d24/f2c [2230860,70327] 0 2024-09-21T08:02:40.864 INFO:tasks.workunit.client.0.smithi107.stdout:1/186: read d0/f12 [1351890,130946] 0 2024-09-21T08:02:40.864 INFO:tasks.workunit.client.0.smithi107.stdout:3/203: dwrite d8/f30 [0,4194304] 0 2024-09-21T08:02:40.865 INFO:tasks.workunit.client.0.smithi107.stdout:3/204: creat d8/f3e x:0 0 0 2024-09-21T08:02:40.865 INFO:tasks.workunit.client.0.smithi107.stdout:1/187: dread d0/d7/d1c/d20/f1d [0,4194304] 0 2024-09-21T08:02:40.865 INFO:tasks.workunit.client.0.smithi107.stdout:1/188: creat d0/d29/f3f x:0 0 0 2024-09-21T08:02:40.867 INFO:tasks.workunit.client.0.smithi107.stdout:9/280: symlink d11/d27/d2a/l66 0 2024-09-21T08:02:40.867 INFO:tasks.workunit.client.0.smithi107.stdout:9/281: fdatasync d11/d27/d2f/d4d/f59 0 2024-09-21T08:02:40.867 INFO:tasks.workunit.client.0.smithi107.stdout:9/282: write f7 [908298,85069] 0 2024-09-21T08:02:40.867 INFO:tasks.workunit.client.0.smithi107.stdout:5/289: dread d7/de/d35/f43 [0,4194304] 0 2024-09-21T08:02:40.867 INFO:tasks.workunit.client.0.smithi107.stdout:5/290: fdatasync d7/f63 0 2024-09-21T08:02:40.868 INFO:tasks.workunit.client.0.smithi107.stdout:1/189: write d0/f12 [605210,129456] 0 2024-09-21T08:02:40.868 INFO:tasks.workunit.client.0.smithi107.stdout:1/190: creat d0/d29/d2c/f40 x:0 0 0 2024-09-21T08:02:40.868 INFO:tasks.workunit.client.0.smithi107.stdout:7/175: truncate d7/f13 5890314 0 2024-09-21T08:02:40.869 INFO:tasks.workunit.client.0.smithi107.stdout:1/191: readlink d0/d29/d31/l23 0 2024-09-21T08:02:40.869 INFO:tasks.workunit.client.0.smithi107.stdout:1/192: write d0/d7/fd [577435,26460] 0 2024-09-21T08:02:40.870 INFO:tasks.workunit.client.0.smithi107.stdout:4/192: rmdir dc 39 2024-09-21T08:02:40.875 INFO:tasks.workunit.client.1.smithi129.stdout:8/882: dwrite d0/d6/f1f [0,4194304] 0 2024-09-21T08:02:40.875 INFO:tasks.workunit.client.1.smithi129.stdout:8/883: dread - d0/d6/d7/d9/fef zero size 2024-09-21T08:02:40.875 INFO:tasks.workunit.client.1.smithi129.stdout:8/884: creat d0/d6/d7/d3a/d8e/f110 x:0 0 0 2024-09-21T08:02:40.880 INFO:tasks.workunit.client.0.smithi107.stdout:9/283: link d11/d27/d2a/d34/l36 d11/l67 0 2024-09-21T08:02:40.881 INFO:tasks.workunit.client.0.smithi107.stdout:9/284: readlink lc 0 2024-09-21T08:02:40.882 INFO:tasks.workunit.client.0.smithi107.stdout:5/291: unlink d7/de/d2d/d5d/d60/c61 0 2024-09-21T08:02:40.888 INFO:tasks.workunit.client.0.smithi107.stdout:1/193: rename d0/d7/fa to d0/d7/d1c/f41 0 2024-09-21T08:02:40.889 INFO:tasks.workunit.client.0.smithi107.stdout:4/193: unlink dc/l14 0 2024-09-21T08:02:40.889 INFO:tasks.workunit.client.0.smithi107.stdout:4/194: truncate dc/fe 4789415 0 2024-09-21T08:02:40.890 INFO:tasks.workunit.client.0.smithi107.stdout:4/195: write dc/f1b [298658,37974] 0 2024-09-21T08:02:40.890 INFO:tasks.workunit.client.1.smithi129.stdout:8/885: read d0/d6/d7/d18/d27/f39 [435921,45321] 0 2024-09-21T08:02:40.890 INFO:tasks.workunit.client.1.smithi129.stdout:8/886: chown d0/d6/d7/d18/d61/d7f/dd2/ff5 210795 1 2024-09-21T08:02:40.891 INFO:tasks.workunit.client.1.smithi129.stdout:9/961: dwrite d17/d46/f8e [0,4194304] 0 2024-09-21T08:02:40.891 INFO:tasks.workunit.client.1.smithi129.stdout:9/962: chown d17/d22/l34 6417582 1 2024-09-21T08:02:40.892 INFO:tasks.workunit.client.0.smithi107.stdout:3/205: link d8/f3e d8/d2b/f3f 0 2024-09-21T08:02:40.892 INFO:tasks.workunit.client.0.smithi107.stdout:3/206: write d8/f13 [4669169,60691] 0 2024-09-21T08:02:40.892 INFO:tasks.workunit.client.1.smithi129.stdout:4/983: dwrite d5/f39 [0,4194304] 0 2024-09-21T08:02:40.892 INFO:tasks.workunit.client.1.smithi129.stdout:4/984: write d5/d11/d3f/f144 [760909,85754] 0 2024-09-21T08:02:40.892 INFO:tasks.workunit.client.0.smithi107.stdout:6/256: dwrite d2/d3/d7/d2a/f47 [4194304,4194304] 0 2024-09-21T08:02:40.893 INFO:tasks.workunit.client.0.smithi107.stdout:7/176: symlink d7/l3e 0 2024-09-21T08:02:40.894 INFO:tasks.workunit.client.1.smithi129.stdout:8/887: link d0/f67 d0/f111 0 2024-09-21T08:02:40.897 INFO:tasks.workunit.client.0.smithi107.stdout:5/292: rename d7/c9 to d7/de/d2d/d5d/d60/c67 0 2024-09-21T08:02:40.897 INFO:tasks.workunit.client.0.smithi107.stdout:5/293: stat d7/f34 0 2024-09-21T08:02:40.900 INFO:tasks.workunit.client.0.smithi107.stdout:3/207: symlink d8/d25/d3d/l40 0 2024-09-21T08:02:40.900 INFO:tasks.workunit.client.0.smithi107.stdout:3/208: chown d8/l2c 7309 1 2024-09-21T08:02:40.902 INFO:tasks.workunit.client.1.smithi129.stdout:9/963: symlink d17/d22/d33/de6/l138 0 2024-09-21T08:02:40.903 INFO:tasks.workunit.client.0.smithi107.stdout:9/285: dwrite d11/d24/d35/f4e [0,4194304] 0 2024-09-21T08:02:40.904 INFO:tasks.workunit.client.0.smithi107.stdout:6/257: mkdir d2/d3/d7/d23/d4f 0 2024-09-21T08:02:40.906 INFO:tasks.workunit.client.0.smithi107.stdout:7/177: creat d7/f3f x:0 0 0 2024-09-21T08:02:40.908 INFO:tasks.workunit.client.0.smithi107.stdout:5/294: mkdir d7/de/d1d/d29/d68 0 2024-09-21T08:02:40.910 INFO:tasks.workunit.client.0.smithi107.stdout:3/209: rename d8/d25/f29 to d8/f41 0 2024-09-21T08:02:40.911 INFO:tasks.workunit.client.0.smithi107.stdout:3/210: stat d8/l2c 0 2024-09-21T08:02:40.911 INFO:tasks.workunit.client.1.smithi129.stdout:8/888: dread d0/d6/d7/d24/f46 [0,4194304] 0 2024-09-21T08:02:40.913 INFO:tasks.workunit.client.0.smithi107.stdout:6/258: dread d2/d3/f4 [0,4194304] 0 2024-09-21T08:02:40.913 INFO:tasks.workunit.client.0.smithi107.stdout:6/259: fdatasync d2/d3/f4 0 2024-09-21T08:02:40.913 INFO:tasks.workunit.client.0.smithi107.stdout:6/260: stat d2/d3/d7/d2a/d31 0 2024-09-21T08:02:40.913 INFO:tasks.workunit.client.0.smithi107.stdout:6/261: write d2/d3/d7/d24/d41/d44/f4e [520235,1911] 0 2024-09-21T08:02:40.914 INFO:tasks.workunit.client.0.smithi107.stdout:9/286: truncate d11/d24/d26/f28 3539 0 2024-09-21T08:02:40.915 INFO:tasks.workunit.client.0.smithi107.stdout:5/295: link d7/de/c3e d7/de/d2d/d5d/d60/c69 0 2024-09-21T08:02:40.917 INFO:tasks.workunit.client.0.smithi107.stdout:6/262: mkdir d2/d3/d7/d24/d41/d50 0 2024-09-21T08:02:40.917 INFO:tasks.workunit.client.0.smithi107.stdout:6/263: fsync d2/d3/f22 0 2024-09-21T08:02:40.917 INFO:tasks.workunit.client.1.smithi129.stdout:9/964: dread d17/d23/f2d [0,4194304] 0 2024-09-21T08:02:40.917 INFO:tasks.workunit.client.1.smithi129.stdout:9/965: truncate d17/d22/d33/d7a/d89/d90/db1/d31/d35/f54 80545 0 2024-09-21T08:02:40.917 INFO:tasks.workunit.client.1.smithi129.stdout:9/966: creat d17/d55/dd1/f139 x:0 0 0 2024-09-21T08:02:40.918 INFO:tasks.workunit.client.0.smithi107.stdout:5/296: write d7/ff [8710762,29407] 0 2024-09-21T08:02:40.918 INFO:tasks.workunit.client.0.smithi107.stdout:9/287: rmdir d11/d24/d26 39 2024-09-21T08:02:40.918 INFO:tasks.workunit.client.0.smithi107.stdout:9/288: write d11/f37 [4586637,25198] 0 2024-09-21T08:02:40.922 INFO:tasks.workunit.client.0.smithi107.stdout:5/297: symlink d7/de/d1d/d29/d68/l6a 0 2024-09-21T08:02:40.922 INFO:tasks.workunit.client.0.smithi107.stdout:5/298: dread - d7/de/d2d/f55 zero size 2024-09-21T08:02:40.923 INFO:tasks.workunit.client.0.smithi107.stdout:3/211: dread d8/d14/d1d/f3a [0,4194304] 0 2024-09-21T08:02:40.923 INFO:tasks.workunit.client.0.smithi107.stdout:3/212: chown d8/d25/d3d 3089 1 2024-09-21T08:02:40.923 INFO:tasks.workunit.client.0.smithi107.stdout:3/213: dread - d8/d2b/f3f zero size 2024-09-21T08:02:40.925 INFO:tasks.workunit.client.0.smithi107.stdout:9/289: mknod d11/d27/c68 0 2024-09-21T08:02:40.926 INFO:tasks.workunit.client.0.smithi107.stdout:3/214: write d8/d14/d1d/f3a [1884616,50236] 0 2024-09-21T08:02:40.927 INFO:tasks.workunit.client.0.smithi107.stdout:5/299: mkdir d7/de/d52/d6b 0 2024-09-21T08:02:40.929 INFO:tasks.workunit.client.0.smithi107.stdout:9/290: link d11/l1e d11/d27/d2f/l69 0 2024-09-21T08:02:40.932 INFO:tasks.workunit.client.0.smithi107.stdout:3/215: mkdir d8/d25/d42 0 2024-09-21T08:02:40.933 INFO:tasks.workunit.client.0.smithi107.stdout:4/196: dwrite dc/f31 [0,4194304] 0 2024-09-21T08:02:40.933 INFO:tasks.workunit.client.1.smithi129.stdout:9/967: rmdir d17/d22/d33/d7a/d89/d90/dfc 0 2024-09-21T08:02:40.935 INFO:tasks.workunit.client.0.smithi107.stdout:5/300: rename d7/de/d1d/l3b to d7/de/d1d/d24/d3d/d65/l6c 0 2024-09-21T08:02:40.935 INFO:tasks.workunit.client.0.smithi107.stdout:5/301: creat d7/f6d x:0 0 0 2024-09-21T08:02:40.939 INFO:tasks.workunit.client.1.smithi129.stdout:9/968: link d17/d22/d33/d7a/d89/d90/db1/d31/f56 d17/d22/d33/d36/f13a 0 2024-09-21T08:02:40.939 INFO:tasks.workunit.client.1.smithi129.stdout:9/969: write d17/d22/d33/d36/f13a [5078056,21361] 0 2024-09-21T08:02:40.940 INFO:tasks.workunit.client.0.smithi107.stdout:1/194: dwrite d0/d29/d2c/f30 [0,4194304] 0 2024-09-21T08:02:40.940 INFO:tasks.workunit.client.1.smithi129.stdout:4/985: dwrite d5/d16/d24/fa0 [4194304,4194304] 0 2024-09-21T08:02:40.940 INFO:tasks.workunit.client.1.smithi129.stdout:8/889: dwrite d0/d6/d7/d5a/fd1 [0,4194304] 0 2024-09-21T08:02:40.941 INFO:tasks.workunit.client.1.smithi129.stdout:9/970: creat d17/d60/d7b/f13b x:0 0 0 2024-09-21T08:02:40.947 INFO:tasks.workunit.client.1.smithi129.stdout:4/986: symlink d5/d33/d4e/da7/d123/da8/dbc/d115/l158 0 2024-09-21T08:02:40.948 INFO:tasks.workunit.client.0.smithi107.stdout:4/197: creat dc/f3a x:0 0 0 2024-09-21T08:02:40.951 INFO:tasks.workunit.client.0.smithi107.stdout:6/264: dwrite d2/ff [0,4194304] 0 2024-09-21T08:02:40.951 INFO:tasks.workunit.client.0.smithi107.stdout:3/216: dread d8/f30 [0,4194304] 0 2024-09-21T08:02:40.954 INFO:tasks.workunit.client.1.smithi129.stdout:9/971: truncate d17/d22/d33/d36/d48/db7/fc8 1659485 0 2024-09-21T08:02:40.955 INFO:tasks.workunit.client.0.smithi107.stdout:5/302: truncate d7/d47/f50 209433 0 2024-09-21T08:02:40.955 INFO:tasks.workunit.client.0.smithi107.stdout:5/303: creat d7/de/d1d/d24/f6e x:0 0 0 2024-09-21T08:02:40.956 INFO:tasks.workunit.client.1.smithi129.stdout:4/987: symlink d5/da5/d130/d150/l159 0 2024-09-21T08:02:40.958 INFO:tasks.workunit.client.0.smithi107.stdout:9/291: getdents d11/d24/d35 0 2024-09-21T08:02:40.961 INFO:tasks.workunit.client.1.smithi129.stdout:9/972: symlink d17/d22/d33/d36/d48/db7/l13c 0 2024-09-21T08:02:40.964 INFO:tasks.workunit.client.0.smithi107.stdout:6/265: dread d2/d3/d7/f1f [0,4194304] 0 2024-09-21T08:02:40.964 INFO:tasks.workunit.client.0.smithi107.stdout:6/266: readlink d2/d3/l3e 0 2024-09-21T08:02:40.964 INFO:tasks.workunit.client.0.smithi107.stdout:1/195: dwrite d0/d29/f37 [0,4194304] 0 2024-09-21T08:02:40.964 INFO:tasks.workunit.client.0.smithi107.stdout:1/196: chown d0/f11 309762348 1 2024-09-21T08:02:40.964 INFO:tasks.workunit.client.0.smithi107.stdout:1/197: stat d0/f3 0 2024-09-21T08:02:40.965 INFO:tasks.workunit.client.1.smithi129.stdout:8/890: dwrite d0/d6/d7/d18/d27/d60/d85/d10a/d70/f75 [0,4194304] 0 2024-09-21T08:02:40.965 INFO:tasks.workunit.client.1.smithi129.stdout:8/891: write d0/d6/dac/fb7 [75399,86240] 0 2024-09-21T08:02:40.966 INFO:tasks.workunit.client.1.smithi129.stdout:9/973: truncate f10 850131 0 2024-09-21T08:02:40.966 INFO:tasks.workunit.client.1.smithi129.stdout:9/974: chown d17/d22/d33/d36/d48/d3f/d53/l113 8364 1 2024-09-21T08:02:40.966 INFO:tasks.workunit.client.1.smithi129.stdout:9/975: dread - d17/d22/d33/d7a/d89/f12d zero size 2024-09-21T08:02:40.967 INFO:tasks.workunit.client.0.smithi107.stdout:4/198: truncate fb 106289 0 2024-09-21T08:02:40.973 INFO:tasks.workunit.client.0.smithi107.stdout:3/217: mknod d8/d38/c43 0 2024-09-21T08:02:40.973 INFO:tasks.workunit.client.0.smithi107.stdout:3/218: chown d8/f30 4 1 2024-09-21T08:02:40.973 INFO:tasks.workunit.client.0.smithi107.stdout:3/219: readlink d8/ld 0 2024-09-21T08:02:40.973 INFO:tasks.workunit.client.0.smithi107.stdout:3/220: stat d8/d25/d34/f35 0 2024-09-21T08:02:40.976 INFO:tasks.workunit.client.0.smithi107.stdout:5/304: mknod d7/de/d1d/d29/d64/c6f 0 2024-09-21T08:02:40.982 INFO:tasks.workunit.client.0.smithi107.stdout:6/267: rename d2/d3/d7/d24/f34 to d2/d3/d7/d2a/f51 0 2024-09-21T08:02:40.983 INFO:tasks.workunit.client.0.smithi107.stdout:4/199: dwrite dc/d13/f26 [0,4194304] 0 2024-09-21T08:02:40.986 INFO:tasks.workunit.client.1.smithi129.stdout:8/892: mknod d0/d6/d7/c112 0 2024-09-21T08:02:40.991 INFO:tasks.workunit.client.0.smithi107.stdout:1/198: unlink d0/c2a 0 2024-09-21T08:02:40.993 INFO:tasks.workunit.client.1.smithi129.stdout:9/976: symlink d17/d22/d33/d36/d48/db7/l13d 0 2024-09-21T08:02:40.993 INFO:tasks.workunit.client.1.smithi129.stdout:9/977: write d17/d22/d33/d36/d48/d3f/f57 [1313139,17540] 0 2024-09-21T08:02:40.994 INFO:tasks.workunit.client.1.smithi129.stdout:8/893: rmdir d0/d6/d7/ded 39 2024-09-21T08:02:40.995 INFO:tasks.workunit.client.0.smithi107.stdout:3/221: mkdir d8/d44 0 2024-09-21T08:02:40.996 INFO:tasks.workunit.client.0.smithi107.stdout:3/222: write d8/f41 [609422,32417] 0 2024-09-21T08:02:40.996 INFO:tasks.workunit.client.0.smithi107.stdout:3/223: getdents d8/d25/d42 0 2024-09-21T08:02:40.997 INFO:tasks.workunit.client.1.smithi129.stdout:8/894: creat d0/d6/d7/d24/f113 x:0 0 0 2024-09-21T08:02:40.997 INFO:tasks.workunit.client.1.smithi129.stdout:8/895: truncate d0/d6/d7/d9/d94/fb5 4202936 0 2024-09-21T08:02:40.997 INFO:tasks.workunit.client.1.smithi129.stdout:8/896: chown d0/d6/d7/d3a/f6d 2 1 2024-09-21T08:02:40.998 INFO:tasks.workunit.client.0.smithi107.stdout:5/305: dwrite d7/de/d1d/f5b [0,4194304] 0 2024-09-21T08:02:40.999 INFO:tasks.workunit.client.0.smithi107.stdout:6/268: link d2/d3/d7/l33 d2/d3/d7/d23/d2b/l52 0 2024-09-21T08:02:41.003 INFO:tasks.workunit.client.0.smithi107.stdout:1/199: link d0/d7/d1c/f41 d0/d29/d31/f42 0 2024-09-21T08:02:41.003 INFO:tasks.workunit.client.0.smithi107.stdout:1/200: truncate d0/d29/d2c/f40 700183 0 2024-09-21T08:02:41.004 INFO:tasks.workunit.client.0.smithi107.stdout:4/200: dwrite dc/f1b [0,4194304] 0 2024-09-21T08:02:41.006 INFO:tasks.workunit.client.1.smithi129.stdout:9/978: write d17/d22/d33/f7f [1051502,72521] 0 2024-09-21T08:02:41.008 INFO:tasks.workunit.client.0.smithi107.stdout:1/201: dread d0/d19/f3b [0,4194304] 0 2024-09-21T08:02:41.008 INFO:tasks.workunit.client.1.smithi129.stdout:8/897: dread d0/d6/d7/d24/f35 [4194304,4194304] 0 2024-09-21T08:02:41.008 INFO:tasks.workunit.client.1.smithi129.stdout:8/898: chown d0/d6/d7/d18/d27/d60/d85/d10a/d70/f8c 207005 1 2024-09-21T08:02:41.009 INFO:tasks.workunit.client.0.smithi107.stdout:6/269: mknod d2/d3/d7/d2a/c53 0 2024-09-21T08:02:41.009 INFO:tasks.workunit.client.0.smithi107.stdout:6/270: write d2/d3/d7/d24/f25 [7622719,87003] 0 2024-09-21T08:02:41.009 INFO:tasks.workunit.client.0.smithi107.stdout:6/271: write d2/d3/f26 [1109832,81506] 0 2024-09-21T08:02:41.011 INFO:tasks.workunit.client.0.smithi107.stdout:4/201: creat dc/d13/f3b x:0 0 0 2024-09-21T08:02:41.011 INFO:tasks.workunit.client.0.smithi107.stdout:4/202: write dc/d13/f18 [1589730,2793] 0 2024-09-21T08:02:41.011 INFO:tasks.workunit.client.0.smithi107.stdout:4/203: creat dc/f3c x:0 0 0 2024-09-21T08:02:41.014 INFO:tasks.workunit.client.0.smithi107.stdout:4/204: symlink dc/l3d 0 2024-09-21T08:02:41.019 INFO:tasks.workunit.client.0.smithi107.stdout:4/205: dread dc/d13/f35 [0,4194304] 0 2024-09-21T08:02:41.020 INFO:tasks.workunit.client.0.smithi107.stdout:4/206: creat dc/d13/f3e x:0 0 0 2024-09-21T08:02:41.021 INFO:tasks.workunit.client.0.smithi107.stdout:5/306: dwrite d7/de/d1d/d29/f40 [0,4194304] 0 2024-09-21T08:02:41.021 INFO:tasks.workunit.client.0.smithi107.stdout:5/307: write d7/f39 [630499,108575] 0 2024-09-21T08:02:41.022 INFO:tasks.workunit.client.0.smithi107.stdout:1/202: read d0/d29/f37 [2858492,8696] 0 2024-09-21T08:02:41.022 INFO:tasks.workunit.client.0.smithi107.stdout:3/224: dwrite d8/f3e [0,4194304] 0 2024-09-21T08:02:41.023 INFO:tasks.workunit.client.0.smithi107.stdout:3/225: chown f2 3117202 1 2024-09-21T08:02:41.023 INFO:tasks.workunit.client.0.smithi107.stdout:3/226: chown d8/f41 5265 1 2024-09-21T08:02:41.023 INFO:tasks.workunit.client.0.smithi107.stdout:4/207: rename dc/f25 to dc/f3f 0 2024-09-21T08:02:41.029 INFO:tasks.workunit.client.0.smithi107.stdout:6/272: dwrite d2/d3/d7/f13 [0,4194304] 0 2024-09-21T08:02:41.030 INFO:tasks.workunit.client.1.smithi129.stdout:9/979: unlink d17/d22/d33/d7a/d89/d90/db1/c84 0 2024-09-21T08:02:41.031 INFO:tasks.workunit.client.0.smithi107.stdout:5/308: mkdir d7/d70 0 2024-09-21T08:02:41.033 INFO:tasks.workunit.client.1.smithi129.stdout:8/899: mkdir d0/d6/d7/d5a/d114 0 2024-09-21T08:02:41.034 INFO:tasks.workunit.client.0.smithi107.stdout:3/227: dread d8/d21/f24 [0,4194304] 0 2024-09-21T08:02:41.036 INFO:tasks.workunit.client.0.smithi107.stdout:4/208: mkdir dc/d13/d40 0 2024-09-21T08:02:41.037 INFO:tasks.workunit.client.1.smithi129.stdout:9/980: mknod d17/d22/d33/c13e 0 2024-09-21T08:02:41.037 INFO:tasks.workunit.client.1.smithi129.stdout:9/981: fsync d17/d22/d33/d7a/f10b 0 2024-09-21T08:02:41.039 INFO:tasks.workunit.client.0.smithi107.stdout:1/203: dwrite d0/d29/f37 [0,4194304] 0 2024-09-21T08:02:41.039 INFO:tasks.workunit.client.0.smithi107.stdout:1/204: stat d0 0 2024-09-21T08:02:41.040 INFO:tasks.workunit.client.0.smithi107.stdout:6/273: mkdir d2/d3/d7/d54 0 2024-09-21T08:02:41.040 INFO:tasks.workunit.client.0.smithi107.stdout:6/274: read d2/fe [3795778,1058] 0 2024-09-21T08:02:41.041 INFO:tasks.workunit.client.1.smithi129.stdout:9/982: creat d17/d22/d33/da5/f13f x:0 0 0 2024-09-21T08:02:41.042 INFO:tasks.workunit.client.0.smithi107.stdout:5/309: mknod d7/de/d52/d6b/c71 0 2024-09-21T08:02:41.042 INFO:tasks.workunit.client.0.smithi107.stdout:5/310: fdatasync d7/de/d35/f43 0 2024-09-21T08:02:41.042 INFO:tasks.workunit.client.0.smithi107.stdout:5/311: chown d7/de 1 1 2024-09-21T08:02:41.042 INFO:tasks.workunit.client.0.smithi107.stdout:5/312: dread - d7/de/d1d/d24/d3d/f5a zero size 2024-09-21T08:02:41.044 INFO:tasks.workunit.client.0.smithi107.stdout:3/228: mkdir d8/d2b/d45 0 2024-09-21T08:02:41.047 INFO:tasks.workunit.client.0.smithi107.stdout:6/275: rename d2/d3/d7/c36 to d2/d3/d7/d24/c55 0 2024-09-21T08:02:41.048 INFO:tasks.workunit.client.0.smithi107.stdout:3/229: symlink d8/d2b/d45/l46 0 2024-09-21T08:02:41.050 INFO:tasks.workunit.client.1.smithi129.stdout:9/983: unlink d17/d22/d33/cbc 0 2024-09-21T08:02:41.050 INFO:tasks.workunit.client.0.smithi107.stdout:5/313: rename d7/de/d1d/d29/d64/c6f to d7/de/d1d/d29/c72 0 2024-09-21T08:02:41.053 INFO:tasks.workunit.client.1.smithi129.stdout:9/984: rename d17/d46/fb2 to d17/d46/dd4/f140 0 2024-09-21T08:02:41.053 INFO:tasks.workunit.client.0.smithi107.stdout:5/314: mkdir d7/d70/d73 0 2024-09-21T08:02:41.054 INFO:tasks.workunit.client.0.smithi107.stdout:5/315: mkdir d7/d74 0 2024-09-21T08:02:41.055 INFO:tasks.workunit.client.0.smithi107.stdout:5/316: link d7/f6d d7/de/d1d/d29/d64/f75 0 2024-09-21T08:02:41.056 INFO:tasks.workunit.client.0.smithi107.stdout:5/317: unlink d7/de/d2d/f55 0 2024-09-21T08:02:41.062 INFO:tasks.workunit.client.0.smithi107.stdout:3/230: write d8/f3e [4228009,20000] 0 2024-09-21T08:02:41.062 INFO:tasks.workunit.client.0.smithi107.stdout:3/231: write f2 [1573967,44409] 0 2024-09-21T08:02:41.063 INFO:tasks.workunit.client.0.smithi107.stdout:4/209: dwrite dc/d13/f35 [0,4194304] 0 2024-09-21T08:02:41.063 INFO:tasks.workunit.client.0.smithi107.stdout:4/210: stat dc/d13/f38 0 2024-09-21T08:02:41.063 INFO:tasks.workunit.client.0.smithi107.stdout:4/211: creat dc/d13/f41 x:0 0 0 2024-09-21T08:02:41.063 INFO:tasks.workunit.client.0.smithi107.stdout:4/212: write dc/f3a [506067,43858] 0 2024-09-21T08:02:41.063 INFO:tasks.workunit.client.0.smithi107.stdout:4/213: fdatasync dc/f3c 0 2024-09-21T08:02:41.066 INFO:tasks.workunit.client.0.smithi107.stdout:1/205: dwrite d0/d7/d1c/d20/f1d [0,4194304] 0 2024-09-21T08:02:41.066 INFO:tasks.workunit.client.0.smithi107.stdout:1/206: chown d0/d7/l1e 2208754 1 2024-09-21T08:02:41.067 INFO:tasks.workunit.client.0.smithi107.stdout:4/214: creat dc/d13/d40/f42 x:0 0 0 2024-09-21T08:02:41.072 INFO:tasks.workunit.client.0.smithi107.stdout:4/215: rename dc/d13/f41 to dc/d13/d40/f43 0 2024-09-21T08:02:41.072 INFO:tasks.workunit.client.0.smithi107.stdout:1/207: getdents d0/d7/d1c 0 2024-09-21T08:02:41.074 INFO:tasks.workunit.client.0.smithi107.stdout:4/216: rename dc/d13/f34 to dc/f44 0 2024-09-21T08:02:41.075 INFO:tasks.workunit.client.0.smithi107.stdout:1/208: symlink d0/d19/d39/l43 0 2024-09-21T08:02:41.077 INFO:tasks.workunit.client.1.smithi129.stdout:9/985: dwrite d17/d60/d7b/dc4/f135 [0,4194304] 0 2024-09-21T08:02:41.077 INFO:tasks.workunit.client.1.smithi129.stdout:9/986: readlink d17/d60/d97/la1 0 2024-09-21T08:02:41.077 INFO:tasks.workunit.client.1.smithi129.stdout:9/987: stat d17/d55/dd1 0 2024-09-21T08:02:41.079 INFO:tasks.workunit.client.1.smithi129.stdout:9/988: rmdir d17/d22/d33/d36/d48/db7 39 2024-09-21T08:02:41.079 INFO:tasks.workunit.client.1.smithi129.stdout:9/989: stat d17/d23/c121 0 2024-09-21T08:02:41.079 INFO:tasks.workunit.client.1.smithi129.stdout:9/990: dread - d17/d22/d33/d7a/d89/df7/f127 zero size 2024-09-21T08:02:41.080 INFO:tasks.workunit.client.1.smithi129.stdout:9/991: dread - d17/d46/d9c/f10e zero size 2024-09-21T08:02:41.086 INFO:tasks.workunit.client.0.smithi107.stdout:1/209: write d0/d7/f1a [3211697,126533] 0 2024-09-21T08:02:41.087 INFO:tasks.workunit.client.0.smithi107.stdout:1/210: unlink d0/d7/d1c/c3e 0 2024-09-21T08:02:41.088 INFO:tasks.workunit.client.1.smithi129.stdout:9/992: dread d17/d22/d33/d36/de4/f10a [0,4194304] 0 2024-09-21T08:02:41.089 INFO:tasks.workunit.client.0.smithi107.stdout:3/232: dwrite d8/f1b [0,4194304] 0 2024-09-21T08:02:41.089 INFO:tasks.workunit.client.0.smithi107.stdout:3/233: write d8/d14/d1d/f1f [3681649,23075] 0 2024-09-21T08:02:41.090 INFO:tasks.workunit.client.0.smithi107.stdout:5/318: dwrite d7/de/d35/f42 [4194304,4194304] 0 2024-09-21T08:02:41.090 INFO:tasks.workunit.client.0.smithi107.stdout:5/319: chown d7/d74 0 1 2024-09-21T08:02:41.090 INFO:tasks.workunit.client.0.smithi107.stdout:1/211: mkdir d0/d7/d44 0 2024-09-21T08:02:41.090 INFO:tasks.workunit.client.0.smithi107.stdout:1/212: chown d0/d7/d44 1282 1 2024-09-21T08:02:41.091 INFO:tasks.workunit.client.0.smithi107.stdout:6/276: dwrite d2/d3/f26 [0,4194304] 0 2024-09-21T08:02:41.097 INFO:tasks.workunit.client.0.smithi107.stdout:5/320: mkdir d7/de/d1d/d29/d76 0 2024-09-21T08:02:41.098 INFO:tasks.workunit.client.0.smithi107.stdout:1/213: symlink d0/d19/d2b/l45 0 2024-09-21T08:02:41.102 INFO:tasks.workunit.client.0.smithi107.stdout:6/277: dread d2/d3/d7/d24/f37 [0,4194304] 0 2024-09-21T08:02:41.102 INFO:tasks.workunit.client.0.smithi107.stdout:6/278: fdatasync d2/d3/d7/f42 0 2024-09-21T08:02:41.111 INFO:tasks.workunit.client.0.smithi107.stdout:5/321: rename d7/de/d2d/l66 to d7/de/d1d/d24/d3d/d65/l77 0 2024-09-21T08:02:41.112 INFO:tasks.workunit.client.1.smithi129.stdout:9/993: dwrite d17/d46/f4f [0,4194304] 0 2024-09-21T08:02:41.112 INFO:tasks.workunit.client.0.smithi107.stdout:1/214: symlink d0/d19/l46 0 2024-09-21T08:02:41.112 INFO:tasks.workunit.client.0.smithi107.stdout:1/215: write d0/f2 [4968147,44285] 0 2024-09-21T08:02:41.113 INFO:tasks.workunit.client.0.smithi107.stdout:5/322: symlink d7/de/d1d/d29/d68/l78 0 2024-09-21T08:02:41.113 INFO:tasks.workunit.client.0.smithi107.stdout:5/323: chown c5 546806388 1 2024-09-21T08:02:41.113 INFO:tasks.workunit.client.0.smithi107.stdout:5/324: chown d7/de/d1d 12916994 1 2024-09-21T08:02:41.113 INFO:tasks.workunit.client.0.smithi107.stdout:3/234: dwrite d8/f1b [0,4194304] 0 2024-09-21T08:02:41.114 INFO:tasks.workunit.client.1.smithi129.stdout:8/900: sync 2024-09-21T08:02:41.114 INFO:tasks.workunit.client.1.smithi129.stdout:4/988: sync 2024-09-21T08:02:41.114 INFO:tasks.workunit.client.1.smithi129.stdout:9/994: truncate d17/d22/d33/d7a/d89/d90/db1/d31/d35/fd2 3021624 0 2024-09-21T08:02:41.117 INFO:tasks.workunit.client.1.smithi129.stdout:8/901: rename d0/d6/d7/d18/d27/d60/d85/d10a/fa7 to d0/d6/d7/d18/d27/d60/d85/d10a/d3d/d7b/dbf/f115 0 2024-09-21T08:02:41.117 INFO:tasks.workunit.client.1.smithi129.stdout:8/902: fdatasync d0/d6/d7/d5a/fe6 0 2024-09-21T08:02:41.118 INFO:tasks.workunit.client.0.smithi107.stdout:1/216: creat d0/d7/d1c/d20/d36/f47 x:0 0 0 2024-09-21T08:02:41.119 INFO:tasks.workunit.client.0.smithi107.stdout:5/325: truncate d7/de/d35/f42 945226 0 2024-09-21T08:02:41.120 INFO:tasks.workunit.client.1.smithi129.stdout:9/995: rename d17/d22/d33/d36/f110 to d17/d22/d33/d7a/d89/d90/db1/f141 0 2024-09-21T08:02:41.121 INFO:tasks.workunit.client.0.smithi107.stdout:1/217: rename d0/d7/l17 to d0/d29/d31/l48 0 2024-09-21T08:02:41.122 INFO:tasks.workunit.client.1.smithi129.stdout:4/989: dread d5/f3c [0,4194304] 0 2024-09-21T08:02:41.122 INFO:tasks.workunit.client.1.smithi129.stdout:8/903: symlink d0/d6/d7/d18/d27/d60/d85/d10a/d3d/d7b/dbf/l116 0 2024-09-21T08:02:41.123 INFO:tasks.workunit.client.0.smithi107.stdout:5/326: rmdir d7/de/d1d/d29/d76 0 2024-09-21T08:02:41.125 INFO:tasks.workunit.client.1.smithi129.stdout:9/996: unlink d17/d126/f12a 0 2024-09-21T08:02:41.125 INFO:tasks.workunit.client.1.smithi129.stdout:9/997: chown d17/d22/d33/d7a/d89/d90/db1/d31/d35/l4c 20575 1 2024-09-21T08:02:41.125 INFO:tasks.workunit.client.1.smithi129.stdout:9/998: write d17/d22/d33/d7a/d89/d90/db1/d31/d5e/d6b/f79 [4990248,48924] 0 2024-09-21T08:02:41.126 INFO:tasks.workunit.client.1.smithi129.stdout:4/990: stat d5/c37 0 2024-09-21T08:02:41.127 INFO:tasks.workunit.client.0.smithi107.stdout:3/235: write d8/f1b [1786176,767] 0 2024-09-21T08:02:41.127 INFO:tasks.workunit.client.0.smithi107.stdout:6/279: dwrite d2/fe [0,4194304] 0 2024-09-21T08:02:41.127 INFO:tasks.workunit.client.0.smithi107.stdout:3/236: dread - d8/d38/f3c zero size 2024-09-21T08:02:41.127 INFO:tasks.workunit.client.0.smithi107.stdout:6/280: creat d2/d3/d7/d24/d41/d44/f56 x:0 0 0 2024-09-21T08:02:41.127 INFO:tasks.workunit.client.1.smithi129.stdout:9/999: unlink d17/d22/d33/d7a/d89/d90/db1/d31/d5e/d6b/f79 0 2024-09-21T08:02:41.130 INFO:tasks.workunit.client.0.smithi107.stdout:3/237: rename d8/d21/l32 to d8/d14/l47 0 2024-09-21T08:02:41.130 INFO:tasks.workunit.client.0.smithi107.stdout:1/218: dread d0/d7/d1c/d20/f1d [0,4194304] 0 2024-09-21T08:02:41.132 INFO:tasks.workunit.client.0.smithi107.stdout:6/281: dread d2/d3/f22 [0,4194304] 0 2024-09-21T08:02:41.133 INFO:tasks.workunit.client.1.smithi129.stdout:8/904: read d0/d6/d7/d18/d27/d60/d85/d10a/fc9 [3021921,106361] 0 2024-09-21T08:02:41.135 INFO:tasks.workunit.client.0.smithi107.stdout:5/327: dread d7/de/f1a [4194304,4194304] 0 2024-09-21T08:02:41.136 INFO:tasks.workunit.client.0.smithi107.stdout:3/238: rename d8/f3e to d8/d21/f48 0 2024-09-21T08:02:41.139 INFO:tasks.workunit.client.1.smithi129.stdout:8/905: mkdir d0/d6/d7/d9/d94/d117 0 2024-09-21T08:02:41.141 INFO:tasks.workunit.client.0.smithi107.stdout:1/219: write d0/d29/f37 [1469180,10860] 0 2024-09-21T08:02:41.141 INFO:tasks.workunit.client.0.smithi107.stdout:6/282: creat d2/d3/d7/d24/d41/d50/f57 x:0 0 0 2024-09-21T08:02:41.141 INFO:tasks.workunit.client.0.smithi107.stdout:6/283: chown d2/d3/d7/f15 58 1 2024-09-21T08:02:41.141 INFO:tasks.workunit.client.0.smithi107.stdout:6/284: getdents d2/d3/d7/d54 0 2024-09-21T08:02:41.141 INFO:tasks.workunit.client.0.smithi107.stdout:6/285: write d2/d3/d7/d23/d2b/f2f [1047631,68807] 0 2024-09-21T08:02:41.142 INFO:tasks.workunit.client.0.smithi107.stdout:3/239: dread d8/f1b [0,4194304] 0 2024-09-21T08:02:41.142 INFO:tasks.workunit.client.0.smithi107.stdout:3/240: stat d8/d38/l39 0 2024-09-21T08:02:41.142 INFO:tasks.workunit.client.0.smithi107.stdout:3/241: read d8/f13 [132333,7827] 0 2024-09-21T08:02:41.142 INFO:tasks.workunit.client.0.smithi107.stdout:3/242: write f2 [758611,5839] 0 2024-09-21T08:02:41.144 INFO:tasks.workunit.client.1.smithi129.stdout:8/906: creat d0/d6/d7/d18/d27/d60/d85/dcc/f118 x:0 0 0 2024-09-21T08:02:41.145 INFO:tasks.workunit.client.0.smithi107.stdout:6/286: dread d2/d3/f4 [0,4194304] 0 2024-09-21T08:02:41.145 INFO:tasks.workunit.client.0.smithi107.stdout:5/328: dread d7/de/d1d/d29/f40 [0,4194304] 0 2024-09-21T08:02:41.157 INFO:tasks.workunit.client.0.smithi107.stdout:5/329: dwrite d7/ff [4194304,4194304] 0 2024-09-21T08:02:41.159 INFO:tasks.workunit.client.0.smithi107.stdout:5/330: write d7/de/f30 [564021,36404] 0 2024-09-21T08:02:41.225 INFO:tasks.workunit.client.0.smithi107.stdout:1/220: rename d0/d19/c25 to d0/d7/d1c/c49 0 2024-09-21T08:02:41.229 INFO:tasks.workunit.client.1.smithi129.stdout:8/907: link d0/d6/d7/d18/d27/f38 d0/f119 0 2024-09-21T08:02:41.231 INFO:tasks.workunit.client.0.smithi107.stdout:3/243: link d8/d14/d1d/f3a d8/d2b/f49 0 2024-09-21T08:02:41.231 INFO:tasks.workunit.client.0.smithi107.stdout:3/244: fsync d8/f13 0 2024-09-21T08:02:41.231 INFO:tasks.workunit.client.0.smithi107.stdout:3/245: chown d8/d21 57 1 2024-09-21T08:02:41.233 INFO:tasks.workunit.client.0.smithi107.stdout:6/287: link d2/d3/d7/d2a/f51 d2/d2e/f58 0 2024-09-21T08:02:41.233 INFO:tasks.workunit.client.0.smithi107.stdout:6/288: creat d2/d3/d7/d24/f59 x:0 0 0 2024-09-21T08:02:41.235 INFO:tasks.workunit.client.0.smithi107.stdout:5/331: creat d7/de/d2d/d5d/d60/f79 x:0 0 0 2024-09-21T08:02:41.236 INFO:tasks.workunit.client.0.smithi107.stdout:1/221: symlink d0/d29/l4a 0 2024-09-21T08:02:41.236 INFO:tasks.workunit.client.0.smithi107.stdout:1/222: chown d0/d29/d31/f42 5409952 1 2024-09-21T08:02:41.241 INFO:tasks.workunit.client.0.smithi107.stdout:1/223: write d0/d7/d1c/d20/f1d [712576,43882] 0 2024-09-21T08:02:41.243 INFO:tasks.workunit.client.1.smithi129.stdout:8/908: dwrite d0/d6/d7/d5a/fe6 [0,4194304] 0 2024-09-21T08:02:41.243 INFO:tasks.workunit.client.1.smithi129.stdout:8/909: readlink d0/d6/d7/d3a/l74 0 2024-09-21T08:02:41.246 INFO:tasks.workunit.client.0.smithi107.stdout:1/224: dread d0/d7/fd [0,4194304] 0 2024-09-21T08:02:41.247 INFO:tasks.workunit.client.0.smithi107.stdout:5/332: dread d7/de/d1d/f28 [4194304,4194304] 0 2024-09-21T08:02:41.247 INFO:tasks.workunit.client.0.smithi107.stdout:5/333: readlink d7/de/d1d/d24/d3d/d65/l6c 0 2024-09-21T08:02:41.247 INFO:tasks.workunit.client.0.smithi107.stdout:1/225: read d0/d7/fd [571582,123928] 0 2024-09-21T08:02:41.248 INFO:tasks.workunit.client.0.smithi107.stdout:3/246: symlink d8/d38/l4a 0 2024-09-21T08:02:41.248 INFO:tasks.workunit.client.1.smithi129.stdout:8/910: write d0/d6/d7/d9/f7d [1243089,85842] 0 2024-09-21T08:02:41.250 INFO:tasks.workunit.client.0.smithi107.stdout:6/289: symlink d2/d3/d7/d24/l5a 0 2024-09-21T08:02:41.252 INFO:tasks.workunit.client.1.smithi129.stdout:8/911: creat d0/d6/d7/d18/d27/dff/f11a x:0 0 0 2024-09-21T08:02:41.252 INFO:tasks.workunit.client.1.smithi129.stdout:8/912: fsync d0/d6/d7/d24/f5e 0 2024-09-21T08:02:41.253 INFO:tasks.workunit.client.1.smithi129.stdout:4/991: sync 2024-09-21T08:02:41.254 INFO:tasks.workunit.client.0.smithi107.stdout:5/334: symlink d7/de/d52/d6b/l7a 0 2024-09-21T08:02:41.256 INFO:tasks.workunit.client.1.smithi129.stdout:4/992: dread d5/d33/d4e/da7/d123/da8/f10c [0,4194304] 0 2024-09-21T08:02:41.258 INFO:tasks.workunit.client.0.smithi107.stdout:5/335: mknod d7/de/d52/d6b/c7b 0 2024-09-21T08:02:41.263 INFO:tasks.workunit.client.0.smithi107.stdout:6/290: rmdir d2/d3/d7/d24/d41/d44 39 2024-09-21T08:02:41.264 INFO:tasks.workunit.client.0.smithi107.stdout:1/226: rename d0/d7 to d0/d19/d2b/d4b 0 2024-09-21T08:02:41.265 INFO:tasks.workunit.client.0.smithi107.stdout:1/227: chown d0/d19/d2b/d4b/d1c 160558 1 2024-09-21T08:02:41.265 INFO:tasks.workunit.client.0.smithi107.stdout:1/228: chown d0/d29/d31/l23 953846601 1 2024-09-21T08:02:41.266 INFO:tasks.workunit.client.0.smithi107.stdout:6/291: creat d2/d3/d7/d3f/f5b x:0 0 0 2024-09-21T08:02:41.266 INFO:tasks.workunit.client.0.smithi107.stdout:6/292: truncate d2/d3/d7/d2a/f51 5189015 0 2024-09-21T08:02:41.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:40 smithi129 ceph-mon[34472]: pgmap v12: 65 pgs: 65 active+clean; 2.1 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 230 MiB/s rd, 284 MiB/s wr, 413 op/s 2024-09-21T08:02:41.267 INFO:tasks.workunit.client.0.smithi107.stdout:5/336: rename c5 to d7/de/d2d/d5d/d60/c7c 0 2024-09-21T08:02:41.269 INFO:tasks.workunit.client.0.smithi107.stdout:1/229: creat d0/d19/d2b/d4b/f4c x:0 0 0 2024-09-21T08:02:41.269 INFO:tasks.workunit.client.0.smithi107.stdout:1/230: read d0/d29/f37 [315377,61644] 0 2024-09-21T08:02:41.270 INFO:tasks.workunit.client.0.smithi107.stdout:1/231: mkdir d0/d29/d4d 0 2024-09-21T08:02:41.271 INFO:tasks.workunit.client.0.smithi107.stdout:1/232: mkdir d0/d4e 0 2024-09-21T08:02:41.271 INFO:tasks.workunit.client.0.smithi107.stdout:1/233: truncate d0/d19/d2b/d4b/fd 1770908 0 2024-09-21T08:02:41.272 INFO:tasks.workunit.client.0.smithi107.stdout:1/234: write d0/f3 [4682072,36083] 0 2024-09-21T08:02:41.272 INFO:tasks.workunit.client.0.smithi107.stdout:1/235: mkdir d0/d29/d31/d4f 0 2024-09-21T08:02:41.273 INFO:tasks.workunit.client.0.smithi107.stdout:1/236: write d0/d29/d2c/f40 [265945,101206] 0 2024-09-21T08:02:41.275 INFO:tasks.workunit.client.0.smithi107.stdout:1/237: link d0/d19/d2b/d4b/l34 d0/d19/d2b/d4b/l50 0 2024-09-21T08:02:41.275 INFO:tasks.workunit.client.0.smithi107.stdout:1/238: read d0/d19/d2b/d4b/fd [400543,24182] 0 2024-09-21T08:02:41.275 INFO:tasks.workunit.client.0.smithi107.stdout:1/239: read d0/d29/d2c/f40 [459424,3615] 0 2024-09-21T08:02:41.275 INFO:tasks.workunit.client.0.smithi107.stdout:1/240: readlink d0/d19/d2b/l45 0 2024-09-21T08:02:41.275 INFO:tasks.workunit.client.1.smithi129.stdout:4/993: dwrite d5/d16/d24/d4f/da1/f59 [0,4194304] 0 2024-09-21T08:02:41.277 INFO:tasks.workunit.client.0.smithi107.stdout:1/241: link d0/d19/l21 d0/d29/d31/d4f/l51 0 2024-09-21T08:02:41.281 INFO:tasks.workunit.client.0.smithi107.stdout:1/242: getdents d0/d19/d39 0 2024-09-21T08:02:41.282 INFO:tasks.workunit.client.1.smithi129.stdout:4/994: creat d5/da5/db1/f15a x:0 0 0 2024-09-21T08:02:41.283 INFO:tasks.workunit.client.0.smithi107.stdout:1/243: rename d0/d29/d2c/f40 to d0/d29/d2c/f52 0 2024-09-21T08:02:41.284 INFO:tasks.workunit.client.1.smithi129.stdout:4/995: mknod d5/d33/d6d/df0/c15b 0 2024-09-21T08:02:41.285 INFO:tasks.workunit.client.0.smithi107.stdout:1/244: symlink d0/d29/d4d/l53 0 2024-09-21T08:02:41.286 INFO:tasks.workunit.client.1.smithi129.stdout:4/996: mknod d5/da5/db1/d12b/c15c 0 2024-09-21T08:02:41.286 INFO:tasks.workunit.client.1.smithi129.stdout:4/997: creat d5/da5/f15d x:0 0 0 2024-09-21T08:02:41.287 INFO:tasks.workunit.client.0.smithi107.stdout:1/245: rename d0/d19/d2b/d4b/l1e to d0/d19/d2b/l54 0 2024-09-21T08:02:41.289 INFO:tasks.workunit.client.1.smithi129.stdout:4/998: mknod d5/d11/d3f/d50/d14b/c15e 0 2024-09-21T08:02:41.289 INFO:tasks.workunit.client.1.smithi129.stdout:4/999: truncate d5/d16/d24/d3b/fca 5144815 0 2024-09-21T08:02:41.290 INFO:tasks.workunit.client.0.smithi107.stdout:1/246: stat d0/d19/d2b/d4b/d1c/d20/c32 0 2024-09-21T08:02:41.301 INFO:tasks.workunit.client.1.smithi129.stdout:8/913: dwrite d0/d6/d7/d18/d27/d60/d85/d10a/d70/fa1 [0,4194304] 0 2024-09-21T08:02:41.301 INFO:tasks.workunit.client.0.smithi107.stdout:5/337: dwrite d7/de/f1a [0,4194304] 0 2024-09-21T08:02:41.301 INFO:tasks.workunit.client.0.smithi107.stdout:5/338: chown d7/de/d1d/d24/c2f 685 1 2024-09-21T08:02:41.301 INFO:tasks.workunit.client.0.smithi107.stdout:5/339: fsync d7/de/f19 0 2024-09-21T08:02:41.303 INFO:tasks.workunit.client.0.smithi107.stdout:5/340: unlink d7/de/d1d/f28 0 2024-09-21T08:02:41.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:40 smithi107 ceph-mon[27622]: pgmap v12: 65 pgs: 65 active+clean; 2.1 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 230 MiB/s rd, 284 MiB/s wr, 413 op/s 2024-09-21T08:02:41.305 INFO:tasks.workunit.client.1.smithi129.stdout:8/914: creat d0/d6/dac/db9/f11b x:0 0 0 2024-09-21T08:02:41.307 INFO:tasks.workunit.client.0.smithi107.stdout:5/341: rename d7/de/d52/d6b/c71 to d7/de/d35/c7d 0 2024-09-21T08:02:41.307 INFO:tasks.workunit.client.0.smithi107.stdout:5/342: readlink d7/de/d2d/l4b 0 2024-09-21T08:02:41.314 INFO:tasks.workunit.client.0.smithi107.stdout:5/343: dread d7/f39 [0,4194304] 0 2024-09-21T08:02:41.314 INFO:tasks.workunit.client.0.smithi107.stdout:5/344: creat d7/de/d52/d6b/f7e x:0 0 0 2024-09-21T08:02:41.314 INFO:tasks.workunit.client.0.smithi107.stdout:5/345: write d7/de/f19 [2166479,52301] 0 2024-09-21T08:02:41.314 INFO:tasks.workunit.client.1.smithi129.stdout:8/915: dread d0/d6/d7/d24/f56 [0,4194304] 0 2024-09-21T08:02:41.314 INFO:tasks.workunit.client.1.smithi129.stdout:8/916: readlink d0/d6/d7/d24/l93 0 2024-09-21T08:02:41.315 INFO:tasks.workunit.client.1.smithi129.stdout:8/917: symlink d0/d6/d7/d24/l11c 0 2024-09-21T08:02:41.317 INFO:tasks.workunit.client.1.smithi129.stdout:8/918: rmdir d0/d6/dfe/d102 0 2024-09-21T08:02:41.317 INFO:tasks.workunit.client.1.smithi129.stdout:8/919: write d0/d6/d7/d18/d27/d60/d85/fee [45446,112481] 0 2024-09-21T08:02:41.319 INFO:tasks.workunit.client.1.smithi129.stdout:8/920: creat d0/d6/d7/d18/d27/d60/d85/d10a/d3d/d7b/f11d x:0 0 0 2024-09-21T08:02:41.320 INFO:tasks.workunit.client.1.smithi129.stdout:8/921: rmdir d0/d6/d7/d18/d61/d7f 39 2024-09-21T08:02:41.321 INFO:tasks.workunit.client.1.smithi129.stdout:8/922: mknod d0/d6/d7/d18/d61/c11e 0 2024-09-21T08:02:41.321 INFO:tasks.workunit.client.1.smithi129.stdout:8/923: write d0/d6/d7/d18/d27/f90 [3375019,122816] 0 2024-09-21T08:02:41.321 INFO:tasks.workunit.client.0.smithi107.stdout:5/346: rmdir d7 39 2024-09-21T08:02:41.323 INFO:tasks.workunit.client.1.smithi129.stdout:8/924: rename d0/d6/d7/d24/l11c to d0/d6/d7/d5a/l11f 0 2024-09-21T08:02:41.323 INFO:tasks.workunit.client.1.smithi129.stdout:8/925: truncate d0/d6/d7/d9/dd5/f10f 6886 0 2024-09-21T08:02:41.323 INFO:tasks.workunit.client.0.smithi107.stdout:5/347: creat d7/de/d1d/d29/d64/f7f x:0 0 0 2024-09-21T08:02:41.323 INFO:tasks.workunit.client.0.smithi107.stdout:5/348: write d7/de/d1d/d24/f46 [354667,562] 0 2024-09-21T08:02:41.324 INFO:tasks.workunit.client.0.smithi107.stdout:5/349: symlink d7/d70/l80 0 2024-09-21T08:02:41.324 INFO:tasks.workunit.client.0.smithi107.stdout:8/134: sync 2024-09-21T08:02:41.324 INFO:tasks.workunit.client.0.smithi107.stdout:5/350: readlink d7/de/d35/l4e 0 2024-09-21T08:02:41.325 INFO:tasks.workunit.client.0.smithi107.stdout:5/351: write d7/f63 [628630,13848] 0 2024-09-21T08:02:41.325 INFO:tasks.workunit.client.0.smithi107.stdout:5/352: truncate d7/de/d1d/d29/d64/f75 644370 0 2024-09-21T08:02:41.325 INFO:tasks.workunit.client.0.smithi107.stdout:5/353: fsync d7/de/f1b 0 2024-09-21T08:02:41.325 INFO:tasks.workunit.client.0.smithi107.stdout:5/354: chown d7/de/d1d/d24 452 1 2024-09-21T08:02:41.325 INFO:tasks.workunit.client.0.smithi107.stdout:5/355: readlink d7/de/l2e 0 2024-09-21T08:02:41.325 INFO:tasks.workunit.client.1.smithi129.stdout:8/926: dread d0/d6/d7/d18/d27/d60/d85/d10a/d37/fba [0,4194304] 0 2024-09-21T08:02:41.325 INFO:tasks.workunit.client.0.smithi107.stdout:8/135: rename d5/c27 to d5/d23/c36 0 2024-09-21T08:02:41.326 INFO:tasks.workunit.client.1.smithi129.stdout:8/927: link d0/d6/d7/d18/lca d0/d6/dfe/l120 0 2024-09-21T08:02:41.327 INFO:tasks.workunit.client.0.smithi107.stdout:8/136: mknod d5/d1d/c37 0 2024-09-21T08:02:41.339 INFO:tasks.workunit.client.0.smithi107.stdout:5/356: dread d7/f8 [0,4194304] 0 2024-09-21T08:02:41.340 INFO:tasks.workunit.client.0.smithi107.stdout:5/357: stat d7/de/d1d/d24/d3d/d65/l6c 0 2024-09-21T08:02:41.341 INFO:tasks.workunit.client.0.smithi107.stdout:5/358: creat d7/de/d2d/d5d/d60/f81 x:0 0 0 2024-09-21T08:02:41.342 INFO:tasks.workunit.client.0.smithi107.stdout:5/359: truncate d7/f8 1069665 0 2024-09-21T08:02:41.344 INFO:tasks.workunit.client.0.smithi107.stdout:5/360: unlink d7/de/d1d/d29/d68/l78 0 2024-09-21T08:02:41.344 INFO:tasks.workunit.client.0.smithi107.stdout:5/361: mknod d7/de/d1d/d24/c82 0 2024-09-21T08:02:41.348 INFO:tasks.workunit.client.1.smithi129.stdout:8/928: dwrite d0/d6/d7/d3a/d8e/fb3 [0,4194304] 0 2024-09-21T08:02:41.348 INFO:tasks.workunit.client.1.smithi129.stdout:8/929: write d0/d6/d7/d18/d27/d60/d85/d10a/d37/f77 [4246011,68318] 0 2024-09-21T08:02:41.352 INFO:tasks.workunit.client.0.smithi107.stdout:8/137: dwrite d5/f6 [0,4194304] 0 2024-09-21T08:02:41.357 INFO:tasks.workunit.client.0.smithi107.stdout:8/138: mkdir d5/d38 0 2024-09-21T08:02:41.357 INFO:tasks.workunit.client.0.smithi107.stdout:8/139: write d5/d23/f35 [498608,79656] 0 2024-09-21T08:02:41.359 INFO:tasks.workunit.client.0.smithi107.stdout:8/140: creat d5/d2e/f39 x:0 0 0 2024-09-21T08:02:41.368 INFO:tasks.workunit.client.1.smithi129.stdout:8/930: dwrite d0/d6/d7/d3a/f6d [0,4194304] 0 2024-09-21T08:02:41.369 INFO:tasks.workunit.client.1.smithi129.stdout:8/931: rmdir d0/d6/d7/d18/d61 39 2024-09-21T08:02:41.369 INFO:tasks.workunit.client.1.smithi129.stdout:8/932: creat d0/d6/d7/d18/d61/d7f/dd2/f121 x:0 0 0 2024-09-21T08:02:41.372 INFO:tasks.workunit.client.0.smithi107.stdout:8/141: dread d5/f1b [0,4194304] 0 2024-09-21T08:02:41.372 INFO:tasks.workunit.client.0.smithi107.stdout:8/142: creat d5/d1d/f3a x:0 0 0 2024-09-21T08:02:41.374 INFO:tasks.workunit.client.0.smithi107.stdout:8/143: unlink d5/d23/c28 0 2024-09-21T08:02:41.378 INFO:tasks.workunit.client.0.smithi107.stdout:8/144: dread d5/f21 [0,4194304] 0 2024-09-21T08:02:41.379 INFO:tasks.workunit.client.0.smithi107.stdout:8/145: link d5/d23/f2f d5/d23/f3b 0 2024-09-21T08:02:41.380 INFO:tasks.workunit.client.0.smithi107.stdout:8/146: mknod d5/d38/c3c 0 2024-09-21T08:02:41.380 INFO:tasks.workunit.client.0.smithi107.stdout:8/147: fdatasync d5/d23/f32 0 2024-09-21T08:02:41.381 INFO:tasks.workunit.client.1.smithi129.stdout:8/933: dwrite d0/d6/d7/d5a/fe6 [0,4194304] 0 2024-09-21T08:02:41.392 INFO:tasks.workunit.client.0.smithi107.stdout:8/148: dread d5/f12 [0,4194304] 0 2024-09-21T08:02:41.393 INFO:tasks.workunit.client.0.smithi107.stdout:8/149: mknod d5/d2e/c3d 0 2024-09-21T08:02:41.394 INFO:tasks.workunit.client.0.smithi107.stdout:8/150: rmdir d5/d1d 39 2024-09-21T08:02:41.395 INFO:tasks.workunit.client.0.smithi107.stdout:8/151: write d5/d1d/f3a [896990,120952] 0 2024-09-21T08:02:41.395 INFO:tasks.workunit.client.0.smithi107.stdout:8/152: stat d5/c30 0 2024-09-21T08:02:41.395 INFO:tasks.workunit.client.0.smithi107.stdout:8/153: creat d5/d38/f3e x:0 0 0 2024-09-21T08:02:41.399 INFO:tasks.workunit.client.1.smithi129.stdout:8/934: dwrite d0/d6/d7/d5a/fd1 [0,4194304] 0 2024-09-21T08:02:41.402 INFO:tasks.workunit.client.1.smithi129.stdout:8/935: rename d0/d6/d7/d9/c73 to d0/d6/d7/d18/d61/d7f/dd2/c122 0 2024-09-21T08:02:41.402 INFO:tasks.workunit.client.1.smithi129.stdout:8/936: creat d0/d6/d7/d24/f123 x:0 0 0 2024-09-21T08:02:41.404 INFO:tasks.workunit.client.1.smithi129.stdout:8/937: link d0/d6/d7/d9/f5f d0/d6/d7/d3a/d8e/f124 0 2024-09-21T08:02:41.405 INFO:tasks.workunit.client.1.smithi129.stdout:8/938: creat d0/f125 x:0 0 0 2024-09-21T08:02:41.408 INFO:tasks.workunit.client.0.smithi107.stdout:8/154: dwrite d5/d23/f2f [0,4194304] 0 2024-09-21T08:02:41.408 INFO:tasks.workunit.client.0.smithi107.stdout:8/155: write d5/d23/f35 [1184112,102714] 0 2024-09-21T08:02:41.416 INFO:tasks.workunit.client.0.smithi107.stdout:8/156: dread d5/d23/f2f [0,4194304] 0 2024-09-21T08:02:41.416 INFO:tasks.workunit.client.0.smithi107.stdout:8/157: fdatasync d5/f12 0 2024-09-21T08:02:41.416 INFO:tasks.workunit.client.0.smithi107.stdout:8/158: chown d5/f6 18918 1 2024-09-21T08:02:41.416 INFO:tasks.workunit.client.0.smithi107.stdout:8/159: creat d5/d38/f3f x:0 0 0 2024-09-21T08:02:41.417 INFO:tasks.workunit.client.0.smithi107.stdout:8/160: chown d5/fa 328 1 2024-09-21T08:02:41.419 INFO:tasks.workunit.client.0.smithi107.stdout:8/161: getdents d5/d2e 0 2024-09-21T08:02:41.422 INFO:tasks.workunit.client.0.smithi107.stdout:8/162: mkdir d5/d40 0 2024-09-21T08:02:41.422 INFO:tasks.workunit.client.1.smithi129.stdout:8/939: rmdir d0 39 2024-09-21T08:02:41.423 INFO:tasks.workunit.client.1.smithi129.stdout:8/940: fsync d0/d6/d7/d3a/d8e/fa6 0 2024-09-21T08:02:41.423 INFO:tasks.workunit.client.1.smithi129.stdout:8/941: dread - d0/d6/d7/d18/d27/f106 zero size 2024-09-21T08:02:41.423 INFO:tasks.workunit.client.1.smithi129.stdout:8/942: readlink d0/d6/d7/d18/d61/d7f/l10d 0 2024-09-21T08:02:41.423 INFO:tasks.workunit.client.1.smithi129.stdout:8/943: chown d0/c78 18360233 1 2024-09-21T08:02:41.423 INFO:tasks.workunit.client.0.smithi107.stdout:8/163: symlink d5/d23/l41 0 2024-09-21T08:02:41.423 INFO:tasks.workunit.client.1.smithi129.stdout:8/944: truncate d0/d6/d7/d9/f5f 2631969 0 2024-09-21T08:02:41.424 INFO:tasks.workunit.client.1.smithi129.stdout:8/945: truncate d0/d6/d7/d9/dd5/f10e 1099034 0 2024-09-21T08:02:41.424 INFO:tasks.workunit.client.1.smithi129.stdout:8/946: dread - d0/f125 zero size 2024-09-21T08:02:41.425 INFO:tasks.workunit.client.1.smithi129.stdout:8/947: unlink d0/d6/d7/d18/d27/d60/d85/d10a/f54 0 2024-09-21T08:02:41.426 INFO:tasks.workunit.client.0.smithi107.stdout:8/164: write d5/d23/f3b [855600,4893] 0 2024-09-21T08:02:41.427 INFO:tasks.workunit.client.0.smithi107.stdout:8/165: mknod d5/d40/c42 0 2024-09-21T08:02:41.427 INFO:tasks.workunit.client.0.smithi107.stdout:8/166: fdatasync d5/f20 0 2024-09-21T08:02:41.428 INFO:tasks.workunit.client.1.smithi129.stdout:8/948: write d0/d6/d7/d18/de0/f105 [8319606,20126] 0 2024-09-21T08:02:41.428 INFO:tasks.workunit.client.1.smithi129.stdout:8/949: chown d0/d6/d7/d18/d27/d60/d85/d10a/d3d 47910 1 2024-09-21T08:02:41.429 INFO:tasks.workunit.client.1.smithi129.stdout:8/950: creat d0/d6/dac/db9/f126 x:0 0 0 2024-09-21T08:02:41.446 INFO:tasks.workunit.client.0.smithi107.stdout:0/298: sync 2024-09-21T08:02:41.446 INFO:tasks.workunit.client.0.smithi107.stdout:2/157: sync 2024-09-21T08:02:41.448 INFO:tasks.workunit.client.0.smithi107.stdout:0/299: creat d1/d5/d25/d3d/d20/f63 x:0 0 0 2024-09-21T08:02:41.448 INFO:tasks.workunit.client.0.smithi107.stdout:0/300: symlink d1/l64 0 2024-09-21T08:02:41.449 INFO:tasks.workunit.client.0.smithi107.stdout:0/301: mknod d1/d5/c65 0 2024-09-21T08:02:41.449 INFO:tasks.workunit.client.0.smithi107.stdout:0/302: read - d1/d5/d25/d3d/f1f zero size 2024-09-21T08:02:41.452 INFO:tasks.workunit.client.1.smithi129.stdout:8/951: dwrite d0/d6/d7/d18/d27/d60/d85/d10a/d3d/d7b/f11d [0,4194304] 0 2024-09-21T08:02:41.452 INFO:tasks.workunit.client.1.smithi129.stdout:8/952: write d0/d6/dac/db9/f126 [275647,24806] 0 2024-09-21T08:02:41.452 INFO:tasks.workunit.client.0.smithi107.stdout:8/167: dwrite d5/d38/f3e [0,4194304] 0 2024-09-21T08:02:41.453 INFO:tasks.workunit.client.0.smithi107.stdout:8/168: dread - d5/d2e/f39 zero size 2024-09-21T08:02:41.456 INFO:tasks.workunit.client.0.smithi107.stdout:8/169: creat d5/d40/f43 x:0 0 0 2024-09-21T08:02:41.457 INFO:tasks.workunit.client.0.smithi107.stdout:2/158: read d1/d2/f15 [872299,48981] 0 2024-09-21T08:02:41.457 INFO:tasks.workunit.client.0.smithi107.stdout:2/159: truncate d1/f10 740718 0 2024-09-21T08:02:41.457 INFO:tasks.workunit.client.0.smithi107.stdout:2/160: readlink d1/d6/l22 0 2024-09-21T08:02:41.458 INFO:tasks.workunit.client.0.smithi107.stdout:8/170: dread d5/d23/f25 [0,4194304] 0 2024-09-21T08:02:41.458 INFO:tasks.workunit.client.0.smithi107.stdout:8/171: stat d5/f12 0 2024-09-21T08:02:41.459 INFO:tasks.workunit.client.0.smithi107.stdout:2/161: rename d1/d16/c28 to d1/d2/c38 0 2024-09-21T08:02:41.459 INFO:tasks.workunit.client.0.smithi107.stdout:2/162: dread - d1/d16/f32 zero size 2024-09-21T08:02:41.459 INFO:tasks.workunit.client.0.smithi107.stdout:2/163: stat d1/d16/d35 0 2024-09-21T08:02:41.460 INFO:tasks.workunit.client.0.smithi107.stdout:2/164: link d1/d6/c12 d1/d6/c39 0 2024-09-21T08:02:41.460 INFO:tasks.workunit.client.0.smithi107.stdout:2/165: dread - d1/f31 zero size 2024-09-21T08:02:41.460 INFO:tasks.workunit.client.0.smithi107.stdout:2/166: fsync d1/d2/f9 0 2024-09-21T08:02:41.461 INFO:tasks.workunit.client.0.smithi107.stdout:2/167: creat d1/d1e/d23/d37/f3a x:0 0 0 2024-09-21T08:02:41.461 INFO:tasks.workunit.client.0.smithi107.stdout:8/172: dread d5/d23/f35 [0,4194304] 0 2024-09-21T08:02:41.461 INFO:tasks.workunit.client.0.smithi107.stdout:2/168: link d1/f33 d1/d16/f3b 0 2024-09-21T08:02:41.464 INFO:tasks.workunit.client.0.smithi107.stdout:0/303: dwrite d1/d5/d25/d2d/f2f [4194304,4194304] 0 2024-09-21T08:02:41.465 INFO:tasks.workunit.client.0.smithi107.stdout:0/304: mknod d1/d5/c66 0 2024-09-21T08:02:41.466 INFO:tasks.workunit.client.0.smithi107.stdout:0/305: creat d1/d5/f67 x:0 0 0 2024-09-21T08:02:41.467 INFO:tasks.workunit.client.0.smithi107.stdout:0/306: symlink d1/d5/l68 0 2024-09-21T08:02:41.469 INFO:tasks.workunit.client.1.smithi129.stdout:8/953: dread d0/d6/d7/d18/d27/d60/d85/d10a/d3d/d7b/dbf/f115 [0,4194304] 0 2024-09-21T08:02:41.469 INFO:tasks.workunit.client.1.smithi129.stdout:8/954: readlink d0/d6/d7/d5a/dbc/l107 0 2024-09-21T08:02:41.469 INFO:tasks.workunit.client.1.smithi129.stdout:8/955: fdatasync d0/d6/d7/d18/d27/d60/d85/d10a/d70/f8c 0 2024-09-21T08:02:41.486 INFO:tasks.workunit.client.0.smithi107.stdout:0/307: write d1/d5/f2c [8332803,30417] 0 2024-09-21T08:02:41.486 INFO:tasks.workunit.client.0.smithi107.stdout:0/308: write d1/d5/d25/d3d/d20/d29/d55/f58 [658125,13184] 0 2024-09-21T08:02:41.487 INFO:tasks.workunit.client.0.smithi107.stdout:0/309: mknod d1/d5/d25/d3d/c69 0 2024-09-21T08:02:41.488 INFO:tasks.workunit.client.0.smithi107.stdout:0/310: mkdir d1/d5/d25/d3d/d20/d29/d6a 0 2024-09-21T08:02:41.488 INFO:tasks.workunit.client.0.smithi107.stdout:2/169: dwrite d1/f10 [0,4194304] 0 2024-09-21T08:02:41.489 INFO:tasks.workunit.client.1.smithi129.stdout:8/956: dwrite d0/f111 [0,4194304] 0 2024-09-21T08:02:41.489 INFO:tasks.workunit.client.1.smithi129.stdout:8/957: chown d0/d6/d7/d18/fae 144 1 2024-09-21T08:02:41.489 INFO:tasks.workunit.client.1.smithi129.stdout:8/958: dread - d0/d6/d7/d18/de0/f104 zero size 2024-09-21T08:02:41.490 INFO:tasks.workunit.client.0.smithi107.stdout:2/170: mknod d1/d1e/c3c 0 2024-09-21T08:02:41.498 INFO:tasks.workunit.client.0.smithi107.stdout:0/311: dread d1/d23/f3a [0,4194304] 0 2024-09-21T08:02:41.499 INFO:tasks.workunit.client.0.smithi107.stdout:0/312: mknod d1/d23/c6b 0 2024-09-21T08:02:41.499 INFO:tasks.workunit.client.0.smithi107.stdout:0/313: creat d1/d5/d25/d3d/d20/f6c x:0 0 0 2024-09-21T08:02:41.508 INFO:tasks.workunit.client.1.smithi129.stdout:8/959: dwrite d0/d6/d7/f7e [0,4194304] 0 2024-09-21T08:02:41.508 INFO:tasks.workunit.client.1.smithi129.stdout:8/960: truncate d0/d6/d7/d18/d61/f9d 2697918 0 2024-09-21T08:02:41.508 INFO:tasks.workunit.client.0.smithi107.stdout:2/171: dwrite d1/d2/f34 [0,4194304] 0 2024-09-21T08:02:41.509 INFO:tasks.workunit.client.0.smithi107.stdout:2/172: creat d1/d6/f3d x:0 0 0 2024-09-21T08:02:41.509 INFO:tasks.workunit.client.0.smithi107.stdout:2/173: stat d1/d2/l30 0 2024-09-21T08:02:41.511 INFO:tasks.workunit.client.0.smithi107.stdout:2/174: creat d1/d1e/f3e x:0 0 0 2024-09-21T08:02:41.512 INFO:tasks.workunit.client.0.smithi107.stdout:2/175: creat d1/d16/d35/f3f x:0 0 0 2024-09-21T08:02:41.512 INFO:tasks.workunit.client.0.smithi107.stdout:2/176: stat d1/d16/c36 0 2024-09-21T08:02:41.513 INFO:tasks.workunit.client.0.smithi107.stdout:2/177: mknod d1/d16/c40 0 2024-09-21T08:02:41.513 INFO:tasks.workunit.client.0.smithi107.stdout:2/178: dread - d1/d1e/d23/d37/f3a zero size 2024-09-21T08:02:41.514 INFO:tasks.workunit.client.0.smithi107.stdout:7/178: sync 2024-09-21T08:02:41.514 INFO:tasks.workunit.client.0.smithi107.stdout:7/179: chown d7/d10/f17 2 1 2024-09-21T08:02:41.523 INFO:tasks.workunit.client.0.smithi107.stdout:2/179: dread d1/d16/f17 [0,4194304] 0 2024-09-21T08:02:41.524 INFO:tasks.workunit.client.0.smithi107.stdout:2/180: creat d1/d16/f41 x:0 0 0 2024-09-21T08:02:41.530 INFO:tasks.workunit.client.1.smithi129.stdout:8/961: dwrite d0/d6/d7/d18/d27/d60/d97/fa2 [0,4194304] 0 2024-09-21T08:02:41.532 INFO:tasks.workunit.client.1.smithi129.stdout:8/962: mknod d0/d6/d7/d18/c127 0 2024-09-21T08:02:41.534 INFO:tasks.workunit.client.1.smithi129.stdout:8/963: unlink d0/d6/c52 0 2024-09-21T08:02:41.534 INFO:tasks.workunit.client.1.smithi129.stdout:8/964: truncate d0/d6/d7/d18/d27/d60/d85/fee 217795 0 2024-09-21T08:02:41.536 INFO:tasks.workunit.client.1.smithi129.stdout:8/965: link d0/d6/d7/d18/d27/f3c d0/d6/d7/d5a/d114/f128 0 2024-09-21T08:02:41.537 INFO:tasks.workunit.client.1.smithi129.stdout:8/966: mkdir d0/d6/d7/d3a/d8e/d129 0 2024-09-21T08:02:41.538 INFO:tasks.workunit.client.1.smithi129.stdout:8/967: write d0/d6/d7/d18/d27/d60/d85/d10a/fda [96569,70678] 0 2024-09-21T08:02:41.539 INFO:tasks.workunit.client.1.smithi129.stdout:8/968: mkdir d0/d6/d7/d9/d94/df6/d12a 0 2024-09-21T08:02:41.540 INFO:tasks.workunit.client.0.smithi107.stdout:7/180: dwrite d7/d10/d28/f35 [0,4194304] 0 2024-09-21T08:02:41.540 INFO:tasks.workunit.client.0.smithi107.stdout:7/181: truncate d7/f31 989939 0 2024-09-21T08:02:41.540 INFO:tasks.workunit.client.1.smithi129.stdout:8/969: link d0/d6/dac/db9/cd0 d0/d6/d7/d18/d27/d60/d85/d10a/d70/c12b 0 2024-09-21T08:02:41.541 INFO:tasks.workunit.client.0.smithi107.stdout:7/182: mkdir d7/d22/d37/d40 0 2024-09-21T08:02:41.542 INFO:tasks.workunit.client.0.smithi107.stdout:7/183: creat d7/d38/f41 x:0 0 0 2024-09-21T08:02:41.542 INFO:tasks.workunit.client.0.smithi107.stdout:7/184: stat d7/d18 0 2024-09-21T08:02:41.543 INFO:tasks.workunit.client.0.smithi107.stdout:7/185: unlink d7/d10/d28/f3c 0 2024-09-21T08:02:41.543 INFO:tasks.workunit.client.0.smithi107.stdout:7/186: chown d7/d22 3463 1 2024-09-21T08:02:41.549 INFO:tasks.workunit.client.1.smithi129.stdout:8/970: write d0/d6/d7/d24/f56 [556323,46990] 0 2024-09-21T08:02:41.563 INFO:tasks.workunit.client.1.smithi129.stdout:8/971: dwrite d0/d6/dac/db9/f11b [0,4194304] 0 2024-09-21T08:02:41.563 INFO:tasks.workunit.client.1.smithi129.stdout:8/972: stat d0/f11 0 2024-09-21T08:02:41.563 INFO:tasks.workunit.client.1.smithi129.stdout:8/973: write d0/d6/d7/d9/dd5/f10f [110370,88663] 0 2024-09-21T08:02:41.564 INFO:tasks.workunit.client.1.smithi129.stdout:8/974: symlink d0/d6/d7/d18/d27/d60/d85/d10a/d3d/d7b/dbf/ddd/l12c 0 2024-09-21T08:02:41.565 INFO:tasks.workunit.client.1.smithi129.stdout:8/975: creat d0/d6/dfe/f12d x:0 0 0 2024-09-21T08:02:41.566 INFO:tasks.workunit.client.1.smithi129.stdout:8/976: mknod d0/d6/d7/d18/d27/d60/d85/c12e 0 2024-09-21T08:02:41.566 INFO:tasks.workunit.client.1.smithi129.stdout:8/977: fsync d0/d6/d7/d18/d27/d60/d85/d10a/d70/fa1 0 2024-09-21T08:02:41.601 INFO:tasks.workunit.client.0.smithi107.stdout:6/293: sync 2024-09-21T08:02:41.601 INFO:tasks.workunit.client.0.smithi107.stdout:4/217: sync 2024-09-21T08:02:41.601 INFO:tasks.workunit.client.0.smithi107.stdout:5/362: sync 2024-09-21T08:02:41.601 INFO:tasks.workunit.client.0.smithi107.stdout:1/247: sync 2024-09-21T08:02:41.601 INFO:tasks.workunit.client.0.smithi107.stdout:9/292: sync 2024-09-21T08:02:41.601 INFO:tasks.workunit.client.0.smithi107.stdout:3/247: sync 2024-09-21T08:02:41.601 INFO:tasks.workunit.client.0.smithi107.stdout:5/363: fdatasync d7/de/d1d/d29/f3c 0 2024-09-21T08:02:41.601 INFO:tasks.workunit.client.0.smithi107.stdout:3/248: chown d8/d25/c2f 24146 1 2024-09-21T08:02:41.601 INFO:tasks.workunit.client.0.smithi107.stdout:6/294: truncate d2/d3/d7/d24/f2c 4127207 0 2024-09-21T08:02:41.601 INFO:tasks.workunit.client.0.smithi107.stdout:4/218: creat dc/d13/d40/f45 x:0 0 0 2024-09-21T08:02:41.617 INFO:tasks.workunit.client.0.smithi107.stdout:9/293: truncate d11/d27/d2a/f42 157638 0 2024-09-21T08:02:41.617 INFO:tasks.workunit.client.0.smithi107.stdout:9/294: read d11/d27/d2f/f3b [593196,22618] 0 2024-09-21T08:02:41.618 INFO:tasks.workunit.client.0.smithi107.stdout:9/295: chown d11/d27/d2a/l40 37383 1 2024-09-21T08:02:41.618 INFO:tasks.workunit.client.0.smithi107.stdout:1/248: mkdir d0/d19/d2b/d4b/d44/d55 0 2024-09-21T08:02:41.619 INFO:tasks.workunit.client.0.smithi107.stdout:5/364: dwrite d7/de/d35/f43 [0,4194304] 0 2024-09-21T08:02:41.619 INFO:tasks.workunit.client.0.smithi107.stdout:5/365: fdatasync d7/f63 0 2024-09-21T08:02:41.619 INFO:tasks.workunit.client.0.smithi107.stdout:3/249: mknod d8/c4b 0 2024-09-21T08:02:41.619 INFO:tasks.workunit.client.0.smithi107.stdout:6/295: mkdir d2/d3/d7/d54/d5c 0 2024-09-21T08:02:41.621 INFO:tasks.workunit.client.0.smithi107.stdout:4/219: mkdir dc/d13/d40/d46 0 2024-09-21T08:02:41.621 INFO:tasks.workunit.client.0.smithi107.stdout:4/220: dread - dc/d13/d40/f43 zero size 2024-09-21T08:02:41.622 INFO:tasks.workunit.client.0.smithi107.stdout:9/296: unlink d11/d27/d2f/d4d/f60 0 2024-09-21T08:02:41.623 INFO:tasks.workunit.client.0.smithi107.stdout:1/249: mknod d0/d19/c56 0 2024-09-21T08:02:41.623 INFO:tasks.workunit.client.0.smithi107.stdout:1/250: chown d0/d19/d2b/d4b/fd 50902 1 2024-09-21T08:02:41.624 INFO:tasks.workunit.client.0.smithi107.stdout:3/250: link d8/d38/f3c d8/d21/f4c 0 2024-09-21T08:02:41.625 INFO:tasks.workunit.client.1.smithi129.stdout:8/978: sync 2024-09-21T08:02:41.625 INFO:tasks.workunit.client.1.smithi129.stdout:8/979: fdatasync d0/d6/d7/d18/d61/d7f/dd2/f6e 0 2024-09-21T08:02:41.625 INFO:tasks.workunit.client.0.smithi107.stdout:6/296: unlink d2/d3/d7/d23/d2b/l38 0 2024-09-21T08:02:41.626 INFO:tasks.workunit.client.0.smithi107.stdout:4/221: link dc/c19 dc/c47 0 2024-09-21T08:02:41.627 INFO:tasks.workunit.client.1.smithi129.stdout:8/980: creat d0/d6/d7/d18/d61/f12f x:0 0 0 2024-09-21T08:02:41.627 INFO:tasks.workunit.client.0.smithi107.stdout:1/251: rmdir d0/d19/d2b/d4b/d1c/d20 39 2024-09-21T08:02:41.629 INFO:tasks.workunit.client.0.smithi107.stdout:3/251: rename d8/d14/l47 to d8/d2b/l4d 0 2024-09-21T08:02:41.631 INFO:tasks.workunit.client.1.smithi129.stdout:8/981: creat d0/d6/d7/d3a/f130 x:0 0 0 2024-09-21T08:02:41.631 INFO:tasks.workunit.client.1.smithi129.stdout:8/982: chown d0/d6/d7/d9/dd5 23941623 1 2024-09-21T08:02:41.631 INFO:tasks.workunit.client.0.smithi107.stdout:6/297: creat d2/d3/d7/d48/f5d x:0 0 0 2024-09-21T08:02:41.633 INFO:tasks.workunit.client.0.smithi107.stdout:4/222: mkdir dc/d13/d40/d46/d48 0 2024-09-21T08:02:41.633 INFO:tasks.workunit.client.0.smithi107.stdout:4/223: chown dc/f2c 194463 1 2024-09-21T08:02:41.634 INFO:tasks.workunit.client.0.smithi107.stdout:9/297: write d11/d24/d26/f2e [918619,1070] 0 2024-09-21T08:02:41.634 INFO:tasks.workunit.client.0.smithi107.stdout:1/252: creat d0/d19/d2b/f57 x:0 0 0 2024-09-21T08:02:41.634 INFO:tasks.workunit.client.0.smithi107.stdout:1/253: creat d0/d19/f58 x:0 0 0 2024-09-21T08:02:41.635 INFO:tasks.workunit.client.0.smithi107.stdout:5/366: dwrite d7/de/f19 [0,4194304] 0 2024-09-21T08:02:41.635 INFO:tasks.workunit.client.0.smithi107.stdout:5/367: readlink d7/de/l22 0 2024-09-21T08:02:41.635 INFO:tasks.workunit.client.0.smithi107.stdout:4/224: creat dc/d13/d40/d46/d48/f49 x:0 0 0 2024-09-21T08:02:41.635 INFO:tasks.workunit.client.0.smithi107.stdout:4/225: chown dc/l10 5 1 2024-09-21T08:02:41.636 INFO:tasks.workunit.client.0.smithi107.stdout:9/298: truncate d11/f20 141721 0 2024-09-21T08:02:41.638 INFO:tasks.workunit.client.0.smithi107.stdout:1/254: mkdir d0/d19/d59 0 2024-09-21T08:02:41.638 INFO:tasks.workunit.client.0.smithi107.stdout:1/255: chown d0/cf 9 1 2024-09-21T08:02:41.644 INFO:tasks.workunit.client.0.smithi107.stdout:4/226: rename dc/d13/f28 to dc/d13/d40/f4a 0 2024-09-21T08:02:41.644 INFO:tasks.workunit.client.0.smithi107.stdout:4/227: creat dc/d13/d40/f4b x:0 0 0 2024-09-21T08:02:41.646 INFO:tasks.workunit.client.0.smithi107.stdout:6/298: dread d2/fd [4194304,4194304] 0 2024-09-21T08:02:41.646 INFO:tasks.workunit.client.0.smithi107.stdout:1/256: dread d0/d19/f3b [0,4194304] 0 2024-09-21T08:02:41.648 INFO:tasks.workunit.client.1.smithi129.stdout:8/983: read d0/d6/d7/d18/fae [1152094,103357] 0 2024-09-21T08:02:41.650 INFO:tasks.workunit.client.0.smithi107.stdout:6/299: unlink d2/d3/f22 0 2024-09-21T08:02:41.651 INFO:tasks.workunit.client.0.smithi107.stdout:1/257: mknod d0/d29/d2c/c5a 0 2024-09-21T08:02:41.651 INFO:tasks.workunit.client.0.smithi107.stdout:1/258: truncate d0/d19/d2b/d4b/d1c/f26 4378880 0 2024-09-21T08:02:41.652 INFO:tasks.workunit.client.1.smithi129.stdout:8/984: symlink d0/d6/d7/d18/d27/l131 0 2024-09-21T08:02:41.652 INFO:tasks.workunit.client.1.smithi129.stdout:8/985: getdents d0/df7 0 2024-09-21T08:02:41.654 INFO:tasks.workunit.client.0.smithi107.stdout:1/259: mkdir d0/d19/d2b/d4b/d5b 0 2024-09-21T08:02:41.655 INFO:tasks.workunit.client.1.smithi129.stdout:8/986: rename d0/d6/d7/d5a/f8a to d0/d6/d7/d18/d27/d60/d85/f132 0 2024-09-21T08:02:41.656 INFO:tasks.workunit.client.1.smithi129.stdout:8/987: stat d0/d6/d7/d18/d61/d7f/dd2/f121 0 2024-09-21T08:02:41.659 INFO:tasks.workunit.client.0.smithi107.stdout:6/300: dread d2/d3/d7/d24/f25 [4194304,4194304] 0 2024-09-21T08:02:41.660 INFO:tasks.workunit.client.0.smithi107.stdout:6/301: creat d2/d3/f5e x:0 0 0 2024-09-21T08:02:41.661 INFO:tasks.workunit.client.0.smithi107.stdout:6/302: mknod d2/d3/d7/d24/d41/c5f 0 2024-09-21T08:02:41.662 INFO:tasks.workunit.client.0.smithi107.stdout:3/252: dwrite d8/d2b/f3b [0,4194304] 0 2024-09-21T08:02:41.662 INFO:tasks.workunit.client.0.smithi107.stdout:6/303: truncate d2/fe 452715 0 2024-09-21T08:02:41.662 INFO:tasks.workunit.client.0.smithi107.stdout:6/304: creat d2/d3/d7/d3f/f60 x:0 0 0 2024-09-21T08:02:41.664 INFO:tasks.workunit.client.0.smithi107.stdout:3/253: symlink d8/d14/l4e 0 2024-09-21T08:02:41.665 INFO:tasks.workunit.client.0.smithi107.stdout:5/368: dwrite d7/de/f19 [0,4194304] 0 2024-09-21T08:02:41.666 INFO:tasks.workunit.client.0.smithi107.stdout:3/254: creat d8/d2b/d45/f4f x:0 0 0 2024-09-21T08:02:41.666 INFO:tasks.workunit.client.0.smithi107.stdout:3/255: dread - d8/d38/f3c zero size 2024-09-21T08:02:41.674 INFO:tasks.workunit.client.0.smithi107.stdout:9/299: dwrite d11/d27/d2a/f2c [0,4194304] 0 2024-09-21T08:02:41.674 INFO:tasks.workunit.client.0.smithi107.stdout:9/300: creat d11/d27/d39/d46/f6a x:0 0 0 2024-09-21T08:02:41.676 INFO:tasks.workunit.client.0.smithi107.stdout:4/228: getdents dc/d13 0 2024-09-21T08:02:41.676 INFO:tasks.workunit.client.0.smithi107.stdout:4/229: fdatasync dc/d13/f3e 0 2024-09-21T08:02:41.679 INFO:tasks.workunit.client.0.smithi107.stdout:9/301: mkdir d11/d27/d2f/d4d/d5c/d61/d6b 0 2024-09-21T08:02:41.684 INFO:tasks.workunit.client.0.smithi107.stdout:9/302: dread d11/d24/d35/f49 [0,4194304] 0 2024-09-21T08:02:41.685 INFO:tasks.workunit.client.0.smithi107.stdout:1/260: dwrite d0/d19/d2b/d4b/d1c/d20/f1d [4194304,4194304] 0 2024-09-21T08:02:41.685 INFO:tasks.workunit.client.0.smithi107.stdout:1/261: creat d0/d29/f5c x:0 0 0 2024-09-21T08:02:41.685 INFO:tasks.workunit.client.0.smithi107.stdout:1/262: chown d0/f12 37516 1 2024-09-21T08:02:41.686 INFO:tasks.workunit.client.0.smithi107.stdout:9/303: creat d11/d27/d39/f6c x:0 0 0 2024-09-21T08:02:41.688 INFO:tasks.workunit.client.0.smithi107.stdout:1/263: symlink d0/d19/d2b/l5d 0 2024-09-21T08:02:41.690 INFO:tasks.workunit.client.0.smithi107.stdout:1/264: mkdir d0/d19/d2b/d4b/d1c/d5e 0 2024-09-21T08:02:41.690 INFO:tasks.workunit.client.0.smithi107.stdout:4/230: write dc/f1e [1355738,114048] 0 2024-09-21T08:02:41.691 INFO:tasks.workunit.client.0.smithi107.stdout:1/265: rename d0/d29/c38 to d0/c5f 0 2024-09-21T08:02:41.693 INFO:tasks.workunit.client.0.smithi107.stdout:1/266: creat d0/d29/d4d/f60 x:0 0 0 2024-09-21T08:02:41.701 INFO:tasks.workunit.client.0.smithi107.stdout:4/231: read fa [2789414,71755] 0 2024-09-21T08:02:41.728 INFO:tasks.workunit.client.1.smithi129.stdout:8/988: sync 2024-09-21T08:02:41.730 INFO:tasks.workunit.client.0.smithi107.stdout:6/305: dwrite d2/d3/d7/d48/f5d [0,4194304] 0 2024-09-21T08:02:41.730 INFO:tasks.workunit.client.0.smithi107.stdout:4/232: dwrite dc/d13/d40/d46/d48/f49 [0,4194304] 0 2024-09-21T08:02:41.730 INFO:tasks.workunit.client.0.smithi107.stdout:4/233: chown l9 44 1 2024-09-21T08:02:41.730 INFO:tasks.workunit.client.0.smithi107.stdout:4/234: fsync dc/f1a 0 2024-09-21T08:02:41.730 INFO:tasks.workunit.client.0.smithi107.stdout:5/369: dwrite d7/de/d1d/d24/d3d/f5a [0,4194304] 0 2024-09-21T08:02:41.730 INFO:tasks.workunit.client.0.smithi107.stdout:5/370: read d7/ff [3611446,20198] 0 2024-09-21T08:02:41.730 INFO:tasks.workunit.client.0.smithi107.stdout:9/304: dwrite d11/d27/d39/f54 [0,4194304] 0 2024-09-21T08:02:41.730 INFO:tasks.workunit.client.0.smithi107.stdout:3/256: dwrite d8/d2b/f3b [0,4194304] 0 2024-09-21T08:02:41.730 INFO:tasks.workunit.client.0.smithi107.stdout:1/267: dwrite d0/d19/f3b [4194304,4194304] 0 2024-09-21T08:02:41.730 INFO:tasks.workunit.client.0.smithi107.stdout:1/268: chown d0/d19/l27 20420 1 2024-09-21T08:02:41.731 INFO:tasks.workunit.client.0.smithi107.stdout:6/306: symlink d2/d3/d7/d24/d41/l61 0 2024-09-21T08:02:41.731 INFO:tasks.workunit.client.0.smithi107.stdout:6/307: chown d2/ff 5339 1 2024-09-21T08:02:41.734 INFO:tasks.workunit.client.0.smithi107.stdout:4/235: mkdir dc/d4c 0 2024-09-21T08:02:41.734 INFO:tasks.workunit.client.0.smithi107.stdout:4/236: stat dc/d13/d40/d46/d48 0 2024-09-21T08:02:41.735 INFO:tasks.workunit.client.0.smithi107.stdout:6/308: dread d2/d3/f4 [0,4194304] 0 2024-09-21T08:02:41.739 INFO:tasks.workunit.client.0.smithi107.stdout:5/371: link d7/de/c51 d7/d74/c83 0 2024-09-21T08:02:41.739 INFO:tasks.workunit.client.0.smithi107.stdout:5/372: write d7/de/d1d/d24/d3d/f56 [646691,48753] 0 2024-09-21T08:02:41.742 INFO:tasks.workunit.client.0.smithi107.stdout:9/305: link d11/d27/d2f/d38/c58 d11/d27/c6d 0 2024-09-21T08:02:41.742 INFO:tasks.workunit.client.1.smithi129.stdout:8/989: dwrite d0/d6/d7/d9/fef [0,4194304] 0 2024-09-21T08:02:41.742 INFO:tasks.workunit.client.1.smithi129.stdout:8/990: fdatasync d0/d6/d7/d18/d61/f9d 0 2024-09-21T08:02:41.742 INFO:tasks.workunit.client.1.smithi129.stdout:8/991: write d0/d6/dac/fb7 [289685,69279] 0 2024-09-21T08:02:41.742 INFO:tasks.workunit.client.1.smithi129.stdout:8/992: write d0/d6/d7/d18/d27/d60/d85/dcc/fea [954328,104203] 0 2024-09-21T08:02:41.742 INFO:tasks.workunit.client.1.smithi129.stdout:8/993: chown d0/d6/d7/d18/d27/dff/f11a 510377 1 2024-09-21T08:02:41.743 INFO:tasks.workunit.client.0.smithi107.stdout:3/257: symlink d8/d25/d34/l50 0 2024-09-21T08:02:41.743 INFO:tasks.workunit.client.0.smithi107.stdout:3/258: chown d8/d2b 12280 1 2024-09-21T08:02:41.743 INFO:tasks.workunit.client.1.smithi129.stdout:8/994: dread d0/d6/d7/d18/d27/d60/d85/faa [0,4194304] 0 2024-09-21T08:02:41.749 INFO:tasks.workunit.client.0.smithi107.stdout:1/269: mkdir d0/d19/d2b/d4b/d61 0 2024-09-21T08:02:41.749 INFO:tasks.workunit.client.0.smithi107.stdout:1/270: chown d0/d29/d2c/f2e 100 1 2024-09-21T08:02:41.750 INFO:tasks.workunit.client.0.smithi107.stdout:5/373: mknod d7/de/d52/d6b/c84 0 2024-09-21T08:02:41.751 INFO:tasks.workunit.client.0.smithi107.stdout:9/306: mkdir d11/d24/d6e 0 2024-09-21T08:02:41.751 INFO:tasks.workunit.client.0.smithi107.stdout:9/307: chown d11/d27/d2a/c53 29 1 2024-09-21T08:02:41.753 INFO:tasks.workunit.client.0.smithi107.stdout:3/259: rename d8/d2b/d45/f4f to d8/d25/d3d/f51 0 2024-09-21T08:02:41.755 INFO:tasks.workunit.client.0.smithi107.stdout:4/237: unlink dc/d13/d40/d46/d48/f49 0 2024-09-21T08:02:41.755 INFO:tasks.workunit.client.0.smithi107.stdout:4/238: stat c3 0 2024-09-21T08:02:41.755 INFO:tasks.workunit.client.0.smithi107.stdout:1/271: dread d0/d19/f33 [0,4194304] 0 2024-09-21T08:02:41.756 INFO:tasks.workunit.client.0.smithi107.stdout:6/309: dwrite d2/d3/f5e [0,4194304] 0 2024-09-21T08:02:41.758 INFO:tasks.workunit.client.0.smithi107.stdout:5/374: link d7/de/d2d/c49 d7/de/d1d/d29/c85 0 2024-09-21T08:02:41.759 INFO:tasks.workunit.client.0.smithi107.stdout:5/375: write d7/de/d1d/d24/f4f [442608,26868] 0 2024-09-21T08:02:41.759 INFO:tasks.workunit.client.0.smithi107.stdout:3/260: mkdir d8/d2b/d52 0 2024-09-21T08:02:41.759 INFO:tasks.workunit.client.0.smithi107.stdout:3/261: fdatasync d8/d2b/f3b 0 2024-09-21T08:02:41.761 INFO:tasks.workunit.client.0.smithi107.stdout:4/239: link dc/fe dc/d4c/f4d 0 2024-09-21T08:02:41.763 INFO:tasks.workunit.client.0.smithi107.stdout:1/272: symlink d0/d19/d39/l62 0 2024-09-21T08:02:41.763 INFO:tasks.workunit.client.0.smithi107.stdout:1/273: stat d0/l14 0 2024-09-21T08:02:41.766 INFO:tasks.workunit.client.0.smithi107.stdout:6/310: creat d2/d3/d7/d54/d5c/f62 x:0 0 0 2024-09-21T08:02:41.767 INFO:tasks.workunit.client.0.smithi107.stdout:5/376: mknod d7/de/d1d/d29/d68/c86 0 2024-09-21T08:02:41.767 INFO:tasks.workunit.client.0.smithi107.stdout:5/377: chown d7/de/f1b 47905 1 2024-09-21T08:02:41.767 INFO:tasks.workunit.client.0.smithi107.stdout:5/378: write d7/f8 [794554,11451] 0 2024-09-21T08:02:41.767 INFO:tasks.workunit.client.0.smithi107.stdout:3/262: rmdir d8/d14/d1d 39 2024-09-21T08:02:41.767 INFO:tasks.workunit.client.0.smithi107.stdout:3/263: truncate d8/d21/f24 4582814 0 2024-09-21T08:02:41.768 INFO:tasks.workunit.client.0.smithi107.stdout:4/240: link dc/d13/l20 dc/d4c/l4e 0 2024-09-21T08:02:41.769 INFO:tasks.workunit.client.0.smithi107.stdout:1/274: creat d0/d19/d2b/d4b/f63 x:0 0 0 2024-09-21T08:02:41.769 INFO:tasks.workunit.client.0.smithi107.stdout:1/275: fdatasync d0/d29/d2c/f30 0 2024-09-21T08:02:41.770 INFO:tasks.workunit.client.0.smithi107.stdout:5/379: mkdir d7/de/d1d/d29/d64/d87 0 2024-09-21T08:02:41.770 INFO:tasks.workunit.client.0.smithi107.stdout:5/380: stat d7/de/c5c 0 2024-09-21T08:02:41.771 INFO:tasks.workunit.client.0.smithi107.stdout:1/276: dread d0/d29/d2c/f52 [0,4194304] 0 2024-09-21T08:02:41.771 INFO:tasks.workunit.client.0.smithi107.stdout:1/277: write d0/d19/d2b/d4b/d1c/f41 [3967931,12893] 0 2024-09-21T08:02:41.772 INFO:tasks.workunit.client.0.smithi107.stdout:0/314: sync 2024-09-21T08:02:41.773 INFO:tasks.workunit.client.0.smithi107.stdout:3/264: rename d8/d25/l31 to d8/d2b/l53 0 2024-09-21T08:02:41.773 INFO:tasks.workunit.client.0.smithi107.stdout:3/265: truncate f2 2067070 0 2024-09-21T08:02:41.773 INFO:tasks.workunit.client.0.smithi107.stdout:2/181: sync 2024-09-21T08:02:41.773 INFO:tasks.workunit.client.0.smithi107.stdout:7/187: sync 2024-09-21T08:02:41.773 INFO:tasks.workunit.client.0.smithi107.stdout:8/173: sync 2024-09-21T08:02:41.774 INFO:tasks.workunit.client.0.smithi107.stdout:4/241: creat dc/d13/f4f x:0 0 0 2024-09-21T08:02:41.774 INFO:tasks.workunit.client.0.smithi107.stdout:4/242: chown dc/f3c 23 1 2024-09-21T08:02:41.774 INFO:tasks.workunit.client.0.smithi107.stdout:5/381: creat d7/de/d1d/d29/f88 x:0 0 0 2024-09-21T08:02:41.774 INFO:tasks.workunit.client.0.smithi107.stdout:5/382: creat d7/de/d1d/d29/d64/f89 x:0 0 0 2024-09-21T08:02:41.776 INFO:tasks.workunit.client.0.smithi107.stdout:1/278: mkdir d0/d19/d2b/d4b/d44/d55/d64 0 2024-09-21T08:02:41.777 INFO:tasks.workunit.client.0.smithi107.stdout:1/279: chown d0/d29/d2c/f30 231765 1 2024-09-21T08:02:41.777 INFO:tasks.workunit.client.0.smithi107.stdout:1/280: read - d0/d19/d2b/d4b/f4c zero size 2024-09-21T08:02:41.777 INFO:tasks.workunit.client.0.smithi107.stdout:3/266: dread d8/fe [0,4194304] 0 2024-09-21T08:02:41.777 INFO:tasks.workunit.client.0.smithi107.stdout:7/188: rename d7/f11 to d7/d22/d3d/f42 0 2024-09-21T08:02:41.777 INFO:tasks.workunit.client.0.smithi107.stdout:2/182: mkdir d1/d1e/d23/d42 0 2024-09-21T08:02:41.780 INFO:tasks.workunit.client.0.smithi107.stdout:5/383: creat d7/de/d35/f8a x:0 0 0 2024-09-21T08:02:41.780 INFO:tasks.workunit.client.0.smithi107.stdout:9/308: dwrite d11/f20 [0,4194304] 0 2024-09-21T08:02:41.781 INFO:tasks.workunit.client.0.smithi107.stdout:1/281: rename d0/d19/c56 to d0/d29/c65 0 2024-09-21T08:02:41.783 INFO:tasks.workunit.client.0.smithi107.stdout:3/267: rename d8/d25/d34/f35 to d8/d14/f54 0 2024-09-21T08:02:41.786 INFO:tasks.workunit.client.0.smithi107.stdout:5/384: rename d7/d47 to d7/de/d52/d8b 0 2024-09-21T08:02:41.792 INFO:tasks.workunit.client.0.smithi107.stdout:6/311: write d2/d3/d7/d2a/f47 [8229288,105795] 0 2024-09-21T08:02:41.793 INFO:tasks.workunit.client.0.smithi107.stdout:6/312: symlink d2/d3/l63 0 2024-09-21T08:02:41.798 INFO:tasks.workunit.client.0.smithi107.stdout:5/385: dread d7/f39 [0,4194304] 0 2024-09-21T08:02:41.802 INFO:tasks.workunit.client.0.smithi107.stdout:5/386: rename d7/de/d1d/f37 to d7/de/d1d/d24/f8c 0 2024-09-21T08:02:41.802 INFO:tasks.workunit.client.0.smithi107.stdout:5/387: read - d7/de/f62 zero size 2024-09-21T08:02:41.802 INFO:tasks.workunit.client.1.smithi129.stdout:8/995: sync 2024-09-21T08:02:41.803 INFO:tasks.workunit.client.1.smithi129.stdout:8/996: write d0/d6/d7/d18/de0/f104 [823161,95748] 0 2024-09-21T08:02:41.804 INFO:tasks.workunit.client.0.smithi107.stdout:9/309: dread f7 [0,4194304] 0 2024-09-21T08:02:41.804 INFO:tasks.workunit.client.0.smithi107.stdout:9/310: write d11/d27/d39/f54 [5223993,91216] 0 2024-09-21T08:02:41.804 INFO:tasks.workunit.client.0.smithi107.stdout:9/311: write d11/d27/d2f/d4d/d5c/f4b [636704,18604] 0 2024-09-21T08:02:41.804 INFO:tasks.workunit.client.0.smithi107.stdout:0/315: write d1/f8 [12484562,16607] 0 2024-09-21T08:02:41.804 INFO:tasks.workunit.client.0.smithi107.stdout:0/316: dread - d1/d5/f67 zero size 2024-09-21T08:02:41.807 INFO:tasks.workunit.client.0.smithi107.stdout:0/317: rmdir d1/d5/d25/d3d 39 2024-09-21T08:02:41.809 INFO:tasks.workunit.client.0.smithi107.stdout:9/312: rmdir d11/d27/d2f/d4d/d5c 39 2024-09-21T08:02:41.809 INFO:tasks.workunit.client.0.smithi107.stdout:9/313: creat d11/d24/d35/f6f x:0 0 0 2024-09-21T08:02:41.811 INFO:tasks.workunit.client.1.smithi129.stdout:8/997: dread d0/d6/d7/d18/d27/d60/d85/fcf [0,4194304] 0 2024-09-21T08:02:41.811 INFO:tasks.workunit.client.0.smithi107.stdout:9/314: creat d11/d24/d4a/f70 x:0 0 0 2024-09-21T08:02:41.811 INFO:tasks.workunit.client.0.smithi107.stdout:9/315: write d11/d27/d2a/f63 [226099,24319] 0 2024-09-21T08:02:41.812 INFO:tasks.workunit.client.0.smithi107.stdout:9/316: mknod d11/d27/d2f/d4d/d5c/d61/c71 0 2024-09-21T08:02:41.813 INFO:tasks.workunit.client.1.smithi129.stdout:8/998: creat d0/d6/d7/d18/d27/dff/f133 x:0 0 0 2024-09-21T08:02:41.813 INFO:tasks.workunit.client.1.smithi129.stdout:8/999: chown d0/d6/d7/d18/d61/f9d 3452458 1 2024-09-21T08:02:41.814 INFO:tasks.workunit.client.0.smithi107.stdout:9/317: creat d11/d27/f72 x:0 0 0 2024-09-21T08:02:41.815 INFO:tasks.workunit.client.0.smithi107.stdout:9/318: getdents d11/d27/d2a/d34 0 2024-09-21T08:02:41.815 INFO:tasks.workunit.client.0.smithi107.stdout:9/319: write d11/f18 [4516534,43712] 0 2024-09-21T08:02:41.816 INFO:tasks.workunit.client.0.smithi107.stdout:9/320: unlink d11/d27/d2a/d34/l36 0 2024-09-21T08:02:41.817 INFO:tasks.workunit.client.0.smithi107.stdout:9/321: symlink d11/d24/d6e/l73 0 2024-09-21T08:02:41.817 INFO:tasks.workunit.client.0.smithi107.stdout:9/322: truncate d11/d27/d2a/f33 119482 0 2024-09-21T08:02:41.818 INFO:tasks.workunit.client.1.smithi129.stderr:+ rm -rf -- ./tmp.DS0BYs9yI1 2024-09-21T08:02:41.818 INFO:tasks.workunit.client.0.smithi107.stdout:9/323: creat d11/d24/f74 x:0 0 0 2024-09-21T08:02:41.819 INFO:tasks.workunit.client.0.smithi107.stdout:9/324: creat d11/d24/d4a/f75 x:0 0 0 2024-09-21T08:02:41.820 INFO:tasks.workunit.client.0.smithi107.stdout:5/388: read d7/de/d35/f43 [1096510,10352] 0 2024-09-21T08:02:41.821 INFO:tasks.workunit.client.0.smithi107.stdout:5/389: chown d7/de/d35/c3a 21801 1 2024-09-21T08:02:41.832 INFO:tasks.workunit.client.0.smithi107.stdout:7/189: dwrite d7/d18/f19 [0,4194304] 0 2024-09-21T08:02:41.836 INFO:tasks.workunit.client.0.smithi107.stdout:7/190: rename d7/d10/c33 to d7/d22/c43 0 2024-09-21T08:02:41.837 INFO:tasks.workunit.client.0.smithi107.stdout:7/191: unlink d7/f31 0 2024-09-21T08:02:41.838 INFO:tasks.workunit.client.0.smithi107.stdout:7/192: truncate d7/d22/d3d/f42 4629371 0 2024-09-21T08:02:41.838 INFO:tasks.workunit.client.0.smithi107.stdout:7/193: chown f4 3355051 1 2024-09-21T08:02:41.840 INFO:tasks.workunit.client.0.smithi107.stdout:7/194: mknod d7/c44 0 2024-09-21T08:02:41.842 INFO:tasks.workunit.client.0.smithi107.stdout:7/195: rename d7/d10/d28/l39 to d7/d10/l45 0 2024-09-21T08:02:41.848 INFO:tasks.workunit.client.0.smithi107.stdout:1/282: dwrite d0/d29/d2c/f52 [0,4194304] 0 2024-09-21T08:02:41.848 INFO:tasks.workunit.client.0.smithi107.stdout:4/243: dwrite dc/d13/f18 [0,4194304] 0 2024-09-21T08:02:41.848 INFO:tasks.workunit.client.0.smithi107.stdout:4/244: readlink dc/l30 0 2024-09-21T08:02:41.848 INFO:tasks.workunit.client.0.smithi107.stdout:4/245: fsync dc/f1b 0 2024-09-21T08:02:41.848 INFO:tasks.workunit.client.0.smithi107.stdout:4/246: chown dc/d13/d40/f4b 13 1 2024-09-21T08:02:41.848 INFO:tasks.workunit.client.0.smithi107.stdout:4/247: creat dc/f50 x:0 0 0 2024-09-21T08:02:41.848 INFO:tasks.workunit.client.0.smithi107.stdout:4/248: write dc/f3a [1531158,15907] 0 2024-09-21T08:02:41.850 INFO:tasks.workunit.client.0.smithi107.stdout:6/313: dwrite d2/d2e/f3c [4194304,4194304] 0 2024-09-21T08:02:41.851 INFO:tasks.workunit.client.0.smithi107.stdout:5/390: dwrite d7/de/f1a [0,4194304] 0 2024-09-21T08:02:41.852 INFO:tasks.workunit.client.0.smithi107.stdout:7/196: dread d7/d22/f24 [0,4194304] 0 2024-09-21T08:02:41.852 INFO:tasks.workunit.client.0.smithi107.stdout:5/391: rename d7/de/d1d/d24 to d7/de/d1d/d24/d3d/d8d 22 2024-09-21T08:02:41.852 INFO:tasks.workunit.client.0.smithi107.stdout:5/392: write d7/ff [3155134,60052] 0 2024-09-21T08:02:41.852 INFO:tasks.workunit.client.0.smithi107.stdout:5/393: chown d7/de/f1b 1405049 1 2024-09-21T08:02:41.853 INFO:tasks.workunit.client.0.smithi107.stdout:2/183: dwrite d1/f33 [0,4194304] 0 2024-09-21T08:02:41.853 INFO:tasks.workunit.client.0.smithi107.stdout:2/184: write d1/d2/f34 [4339949,121610] 0 2024-09-21T08:02:41.853 INFO:tasks.workunit.client.0.smithi107.stdout:9/325: dwrite f7 [4194304,4194304] 0 2024-09-21T08:02:41.853 INFO:tasks.workunit.client.0.smithi107.stdout:9/326: truncate d11/d27/d2f/d4d/d5c/d61/f64 840286 0 2024-09-21T08:02:41.853 INFO:tasks.workunit.client.0.smithi107.stdout:9/327: dread - d11/d27/d39/d46/f6a zero size 2024-09-21T08:02:41.853 INFO:tasks.workunit.client.0.smithi107.stdout:8/174: dwrite d5/d1d/f26 [0,4194304] 0 2024-09-21T08:02:41.854 INFO:tasks.workunit.client.0.smithi107.stdout:1/283: mknod d0/d29/c66 0 2024-09-21T08:02:41.859 INFO:tasks.workunit.client.0.smithi107.stdout:4/249: mknod dc/d13/d40/d46/d48/c51 0 2024-09-21T08:02:41.859 INFO:tasks.workunit.client.0.smithi107.stdout:4/250: creat dc/d13/d40/f52 x:0 0 0 2024-09-21T08:02:41.865 INFO:tasks.workunit.client.0.smithi107.stdout:7/197: link d7/d18/c1f d7/d22/d37/d40/c46 0 2024-09-21T08:02:41.868 INFO:tasks.workunit.client.0.smithi107.stdout:5/394: unlink d7/f63 0 2024-09-21T08:02:41.870 INFO:tasks.workunit.client.0.smithi107.stdout:6/314: dwrite d2/d3/f4 [0,4194304] 0 2024-09-21T08:02:41.875 INFO:tasks.workunit.client.0.smithi107.stdout:2/185: rename d1/d2/c1d to d1/d6/c43 0 2024-09-21T08:02:41.878 INFO:tasks.workunit.client.0.smithi107.stdout:9/328: dwrite d11/d27/d2a/f63 [0,4194304] 0 2024-09-21T08:02:41.878 INFO:tasks.workunit.client.0.smithi107.stdout:9/329: write d11/d24/f74 [960213,118737] 0 2024-09-21T08:02:41.878 INFO:tasks.workunit.client.0.smithi107.stdout:9/330: fdatasync d11/d27/d39/f47 0 2024-09-21T08:02:41.879 INFO:tasks.workunit.client.0.smithi107.stdout:4/251: dwrite fa [0,4194304] 0 2024-09-21T08:02:41.879 INFO:tasks.workunit.client.0.smithi107.stdout:4/252: fsync fb 0 2024-09-21T08:02:41.879 INFO:tasks.workunit.client.0.smithi107.stdout:4/253: dread - dc/d13/d40/f45 zero size 2024-09-21T08:02:41.880 INFO:tasks.workunit.client.0.smithi107.stdout:1/284: symlink d0/d29/l67 0 2024-09-21T08:02:41.882 INFO:tasks.workunit.client.0.smithi107.stdout:7/198: link d7/d10/f1d d7/d22/d3b/f47 0 2024-09-21T08:02:41.884 INFO:tasks.workunit.client.0.smithi107.stdout:6/315: mknod d2/d2e/c64 0 2024-09-21T08:02:41.884 INFO:tasks.workunit.client.0.smithi107.stdout:4/254: dread f7 [0,4194304] 0 2024-09-21T08:02:41.885 INFO:tasks.workunit.client.0.smithi107.stdout:5/395: rename d7/de/d1d/d29/c85 to d7/de/d1d/d29/d64/c8e 0 2024-09-21T08:02:41.886 INFO:tasks.workunit.client.0.smithi107.stdout:2/186: write d1/d16/f3b [897566,1342] 0 2024-09-21T08:02:41.886 INFO:tasks.workunit.client.0.smithi107.stdout:2/187: stat d1/d2/cd 0 2024-09-21T08:02:41.886 INFO:tasks.workunit.client.0.smithi107.stdout:2/188: readlink d1/d2/l29 0 2024-09-21T08:02:41.886 INFO:tasks.workunit.client.0.smithi107.stdout:2/189: read - d1/d16/f32 zero size 2024-09-21T08:02:41.888 INFO:tasks.workunit.client.0.smithi107.stdout:8/175: rmdir d5/d40 39 2024-09-21T08:02:41.894 INFO:tasks.workunit.client.0.smithi107.stdout:1/285: symlink d0/d19/d2b/l68 0 2024-09-21T08:02:41.895 INFO:tasks.workunit.client.0.smithi107.stdout:5/396: write d7/de/d35/f57 [2773056,74748] 0 2024-09-21T08:02:41.896 INFO:tasks.workunit.client.0.smithi107.stdout:5/397: chown d7/d70/l80 19757348 1 2024-09-21T08:02:41.897 INFO:tasks.workunit.client.0.smithi107.stdout:7/199: unlink d7/l3e 0 2024-09-21T08:02:41.902 INFO:tasks.workunit.client.0.smithi107.stdout:2/190: dwrite d1/d2/f15 [0,4194304] 0 2024-09-21T08:02:41.903 INFO:tasks.workunit.client.0.smithi107.stdout:6/316: unlink d2/d3/d7/d23/c3b 0 2024-09-21T08:02:41.911 INFO:tasks.workunit.client.0.smithi107.stdout:5/398: creat d7/de/d1d/d24/d3d/f8f x:0 0 0 2024-09-21T08:02:41.912 INFO:tasks.workunit.client.0.smithi107.stdout:5/399: stat d7/de/d1d/d24 0 2024-09-21T08:02:41.912 INFO:tasks.workunit.client.0.smithi107.stdout:7/200: dwrite d7/f3f [0,4194304] 0 2024-09-21T08:02:41.913 INFO:tasks.workunit.client.0.smithi107.stdout:2/191: mknod d1/d16/d35/c44 0 2024-09-21T08:02:41.935 INFO:tasks.workunit.client.0.smithi107.stdout:6/317: getdents d2/d3/d7/d24/d41 0 2024-09-21T08:02:41.942 INFO:tasks.workunit.client.0.smithi107.stdout:4/255: rmdir dc 39 2024-09-21T08:02:41.944 INFO:tasks.workunit.client.0.smithi107.stdout:6/318: write d2/d3/d7/f13 [979511,110593] 0 2024-09-21T08:02:41.946 INFO:tasks.workunit.client.0.smithi107.stdout:8/176: mkdir d5/d44 0 2024-09-21T08:02:41.953 INFO:tasks.workunit.client.0.smithi107.stdout:1/286: rmdir d0 39 2024-09-21T08:02:41.953 INFO:tasks.workunit.client.0.smithi107.stdout:1/287: write d0/d19/d2b/d4b/d1c/d20/d36/f47 [617688,130360] 0 2024-09-21T08:02:41.953 INFO:tasks.workunit.client.0.smithi107.stdout:6/319: dread d2/d3/f26 [0,4194304] 0 2024-09-21T08:02:41.955 INFO:tasks.workunit.client.0.smithi107.stdout:5/400: unlink d7/de/d1d/d29/c72 0 2024-09-21T08:02:41.956 INFO:tasks.workunit.client.0.smithi107.stdout:5/401: fdatasync d7/de/d35/f43 0 2024-09-21T08:02:41.956 INFO:tasks.workunit.client.0.smithi107.stdout:5/402: creat d7/de/d1d/d29/d64/f90 x:0 0 0 2024-09-21T08:02:41.956 INFO:tasks.workunit.client.0.smithi107.stdout:5/403: fsync d7/de/d1d/d29/d64/f75 0 2024-09-21T08:02:41.956 INFO:tasks.workunit.client.0.smithi107.stdout:5/404: fsync d7/de/d35/f43 0 2024-09-21T08:02:41.956 INFO:tasks.workunit.client.0.smithi107.stdout:5/405: chown d7/de/f1a 31321146 1 2024-09-21T08:02:41.958 INFO:tasks.workunit.client.0.smithi107.stdout:2/192: symlink d1/d1e/l45 0 2024-09-21T08:02:41.962 INFO:tasks.workunit.client.0.smithi107.stdout:4/256: mknod dc/d13/c53 0 2024-09-21T08:02:41.963 INFO:tasks.workunit.client.0.smithi107.stdout:9/331: rename d11/d27/d39/d46 to d11/d27/d5e/d76 0 2024-09-21T08:02:41.966 INFO:tasks.workunit.client.0.smithi107.stdout:8/177: creat d5/f45 x:0 0 0 2024-09-21T08:02:41.966 INFO:tasks.workunit.client.0.smithi107.stdout:8/178: getdents d5/d2e 0 2024-09-21T08:02:41.967 INFO:tasks.workunit.client.0.smithi107.stdout:6/320: unlink d2/ff 0 2024-09-21T08:02:41.969 INFO:tasks.workunit.client.0.smithi107.stdout:2/193: mknod d1/d16/c46 0 2024-09-21T08:02:41.969 INFO:tasks.workunit.client.0.smithi107.stdout:2/194: write d1/d16/f41 [435329,46874] 0 2024-09-21T08:02:41.970 INFO:tasks.workunit.client.0.smithi107.stdout:2/195: write d1/f3 [554933,97973] 0 2024-09-21T08:02:41.971 INFO:tasks.workunit.client.0.smithi107.stdout:2/196: readlink d1/d1e/l45 0 2024-09-21T08:02:41.971 INFO:tasks.workunit.client.0.smithi107.stdout:2/197: stat d1/d6/c27 0 2024-09-21T08:02:41.971 INFO:tasks.workunit.client.0.smithi107.stdout:4/257: creat dc/f54 x:0 0 0 2024-09-21T08:02:41.971 INFO:tasks.workunit.client.0.smithi107.stdout:4/258: dread - dc/f50 zero size 2024-09-21T08:02:41.971 INFO:tasks.workunit.client.0.smithi107.stdout:7/201: rename d7 to d7/d10/d48 22 2024-09-21T08:02:41.971 INFO:tasks.workunit.client.0.smithi107.stdout:9/332: readlink d11/d27/d2f/d4d/l52 0 2024-09-21T08:02:41.972 INFO:tasks.workunit.client.0.smithi107.stdout:8/179: unlink d5/d23/f2b 0 2024-09-21T08:02:41.973 INFO:tasks.workunit.client.0.smithi107.stdout:2/198: mknod d1/d6/c47 0 2024-09-21T08:02:41.973 INFO:tasks.workunit.client.0.smithi107.stdout:2/199: stat d1/d6/f18 0 2024-09-21T08:02:41.974 INFO:tasks.workunit.client.0.smithi107.stdout:4/259: creat dc/d13/d40/d46/f55 x:0 0 0 2024-09-21T08:02:41.975 INFO:tasks.workunit.client.0.smithi107.stdout:6/321: rename d2/d3/d7/d23/d4f to d2/d3/d7/d48/d65 0 2024-09-21T08:02:41.975 INFO:tasks.workunit.client.0.smithi107.stdout:6/322: stat d2/d3/d7/c28 0 2024-09-21T08:02:41.976 INFO:tasks.workunit.client.0.smithi107.stdout:7/202: mkdir d7/d22/d3a/d49 0 2024-09-21T08:02:41.977 INFO:tasks.workunit.client.0.smithi107.stdout:8/180: mkdir d5/d44/d46 0 2024-09-21T08:02:41.978 INFO:tasks.workunit.client.0.smithi107.stdout:8/181: getdents d5/d2e 0 2024-09-21T08:02:41.979 INFO:tasks.workunit.client.0.smithi107.stdout:2/200: link d1/d16/f17 d1/d1e/d23/d42/f48 0 2024-09-21T08:02:41.979 INFO:tasks.workunit.client.0.smithi107.stdout:1/288: dwrite d0/f3 [0,4194304] 0 2024-09-21T08:02:41.979 INFO:tasks.workunit.client.0.smithi107.stdout:5/406: dwrite d7/de/d52/d8b/f50 [0,4194304] 0 2024-09-21T08:02:41.980 INFO:tasks.workunit.client.0.smithi107.stdout:4/260: unlink dc/d13/f3b 0 2024-09-21T08:02:41.981 INFO:tasks.workunit.client.0.smithi107.stdout:6/323: rename d2/l1d to d2/d3/d7/d48/l66 0 2024-09-21T08:02:41.994 INFO:tasks.workunit.client.0.smithi107.stdout:7/203: creat d7/d22/d37/d40/f4a x:0 0 0 2024-09-21T08:02:41.996 INFO:tasks.workunit.client.0.smithi107.stdout:8/182: mkdir d5/d44/d47 0 2024-09-21T08:02:41.998 INFO:tasks.workunit.client.0.smithi107.stdout:2/201: mkdir d1/d1e/d23/d37/d49 0 2024-09-21T08:02:41.999 INFO:tasks.workunit.client.0.smithi107.stdout:1/289: rmdir d0/d4e 0 2024-09-21T08:02:42.002 INFO:tasks.workunit.client.0.smithi107.stdout:5/407: mknod d7/de/d1d/d29/d64/d87/c91 0 2024-09-21T08:02:42.003 INFO:tasks.workunit.client.0.smithi107.stdout:4/261: unlink dc/f44 0 2024-09-21T08:02:42.004 INFO:tasks.workunit.client.0.smithi107.stdout:4/262: chown dc/c21 517 1 2024-09-21T08:02:42.005 INFO:tasks.workunit.client.0.smithi107.stdout:9/333: rename d11/d27/d2f/l57 to d11/d24/d26/l77 0 2024-09-21T08:02:42.006 INFO:tasks.workunit.client.0.smithi107.stdout:7/204: mkdir d7/d22/d37/d4b 0 2024-09-21T08:02:42.009 INFO:tasks.workunit.client.0.smithi107.stdout:8/183: link d5/l10 d5/d44/d47/l48 0 2024-09-21T08:02:42.009 INFO:tasks.workunit.client.0.smithi107.stdout:8/184: getdents d5/d44/d46 0 2024-09-21T08:02:42.009 INFO:tasks.workunit.client.0.smithi107.stdout:8/185: write d5/f45 [355711,70542] 0 2024-09-21T08:02:42.009 INFO:tasks.workunit.client.0.smithi107.stdout:8/186: dread - d5/d38/f3f zero size 2024-09-21T08:02:42.012 INFO:tasks.workunit.client.0.smithi107.stdout:8/187: dread d5/f20 [0,4194304] 0 2024-09-21T08:02:42.019 INFO:tasks.workunit.client.0.smithi107.stdout:1/290: creat d0/d19/d2b/d4b/d1c/d5e/f69 x:0 0 0 2024-09-21T08:02:42.019 INFO:tasks.workunit.client.0.smithi107.stdout:1/291: write d0/d29/d4d/f60 [327413,22671] 0 2024-09-21T08:02:42.020 INFO:tasks.workunit.client.0.smithi107.stdout:5/408: creat d7/de/d52/d6b/f92 x:0 0 0 2024-09-21T08:02:42.024 INFO:tasks.workunit.client.0.smithi107.stdout:4/263: symlink dc/d4c/l56 0 2024-09-21T08:02:42.024 INFO:tasks.workunit.client.0.smithi107.stdout:4/264: fdatasync dc/d13/d40/f4b 0 2024-09-21T08:02:42.025 INFO:tasks.workunit.client.0.smithi107.stdout:7/205: dwrite d7/d22/f2d [0,4194304] 0 2024-09-21T08:02:42.026 INFO:tasks.workunit.client.0.smithi107.stdout:7/206: dread - d7/d22/d3b/f47 zero size 2024-09-21T08:02:42.026 INFO:tasks.workunit.client.0.smithi107.stdout:2/202: dwrite d1/f26 [0,4194304] 0 2024-09-21T08:02:42.026 INFO:tasks.workunit.client.0.smithi107.stdout:7/207: write d7/d10/f20 [533105,56036] 0 2024-09-21T08:02:42.026 INFO:tasks.workunit.client.0.smithi107.stdout:6/324: rename d2/d3/d7/d24/d41/d44 to d2/d3/d67 0 2024-09-21T08:02:42.030 INFO:tasks.workunit.client.0.smithi107.stdout:7/208: dread d7/d22/d3d/f42 [0,4194304] 0 2024-09-21T08:02:42.030 INFO:tasks.workunit.client.0.smithi107.stdout:7/209: write d7/d18/f29 [244143,29179] 0 2024-09-21T08:02:42.031 INFO:tasks.workunit.client.0.smithi107.stdout:8/188: symlink d5/d44/d47/l49 0 2024-09-21T08:02:42.032 INFO:tasks.workunit.client.0.smithi107.stdout:1/292: mknod d0/d19/d2b/d4b/d1c/c6a 0 2024-09-21T08:02:42.033 INFO:tasks.workunit.client.0.smithi107.stdout:4/265: creat dc/d13/f57 x:0 0 0 2024-09-21T08:02:42.033 INFO:tasks.workunit.client.0.smithi107.stdout:4/266: creat dc/d13/f58 x:0 0 0 2024-09-21T08:02:42.035 INFO:tasks.workunit.client.0.smithi107.stdout:2/203: write d1/f10 [2497594,91126] 0 2024-09-21T08:02:42.035 INFO:tasks.workunit.client.0.smithi107.stdout:5/409: dwrite d7/de/d1d/d29/d64/f75 [0,4194304] 0 2024-09-21T08:02:42.036 INFO:tasks.workunit.client.0.smithi107.stdout:6/325: link d2/d2e/f4c d2/d3/d7/d48/f68 0 2024-09-21T08:02:42.041 INFO:tasks.workunit.client.0.smithi107.stdout:9/334: rmdir d11/d24 39 2024-09-21T08:02:42.042 INFO:tasks.workunit.client.0.smithi107.stdout:6/326: dread d2/d3/d7/d24/f2c [0,4194304] 0 2024-09-21T08:02:42.042 INFO:tasks.workunit.client.0.smithi107.stdout:7/210: rmdir d7/d22/d3b 39 2024-09-21T08:02:42.042 INFO:tasks.workunit.client.0.smithi107.stdout:7/211: write d7/d10/f1d [355771,27669] 0 2024-09-21T08:02:42.042 INFO:tasks.workunit.client.0.smithi107.stdout:7/212: truncate d7/d22/f24 5242751 0 2024-09-21T08:02:42.042 INFO:tasks.workunit.client.0.smithi107.stdout:7/213: write d7/d10/f1d [86100,6592] 0 2024-09-21T08:02:42.044 INFO:tasks.workunit.client.0.smithi107.stdout:8/189: getdents d5/d40 0 2024-09-21T08:02:42.044 INFO:tasks.workunit.client.0.smithi107.stdout:7/214: dread d7/f14 [0,4194304] 0 2024-09-21T08:02:42.045 INFO:tasks.workunit.client.0.smithi107.stdout:1/293: getdents d0/d19/d39 0 2024-09-21T08:02:42.045 INFO:tasks.workunit.client.0.smithi107.stdout:1/294: dread - d0/d29/f5c zero size 2024-09-21T08:02:42.045 INFO:tasks.workunit.client.0.smithi107.stdout:1/295: chown d0/d19/c3a 65381 1 2024-09-21T08:02:42.049 INFO:tasks.workunit.client.0.smithi107.stdout:4/267: dwrite dc/fe [4194304,4194304] 0 2024-09-21T08:02:42.050 INFO:tasks.workunit.client.0.smithi107.stdout:4/268: truncate dc/f50 436435 0 2024-09-21T08:02:42.052 INFO:tasks.workunit.client.0.smithi107.stdout:7/215: dread d7/d10/f20 [0,4194304] 0 2024-09-21T08:02:42.057 INFO:tasks.workunit.client.0.smithi107.stdout:5/410: link c4 d7/de/d1d/c93 0 2024-09-21T08:02:42.057 INFO:tasks.workunit.client.0.smithi107.stdout:5/411: chown d7/de/c3e 176 1 2024-09-21T08:02:42.058 INFO:tasks.workunit.client.0.smithi107.stdout:9/335: rmdir d11/d27/d2f/d4d/d5c/d61/d6b 0 2024-09-21T08:02:42.060 INFO:tasks.workunit.client.0.smithi107.stdout:6/327: rename d2/d3/d7/d24/c55 to d2/d3/d7/d48/c69 0 2024-09-21T08:02:42.060 INFO:tasks.workunit.client.0.smithi107.stdout:6/328: creat d2/d3/d7/d23/f6a x:0 0 0 2024-09-21T08:02:42.062 INFO:tasks.workunit.client.0.smithi107.stdout:9/336: dread d11/d27/d2a/f33 [0,4194304] 0 2024-09-21T08:02:42.063 INFO:tasks.workunit.client.0.smithi107.stdout:8/190: creat d5/d2e/f4a x:0 0 0 2024-09-21T08:02:42.063 INFO:tasks.workunit.client.0.smithi107.stdout:8/191: creat d5/d2e/f4b x:0 0 0 2024-09-21T08:02:42.065 INFO:tasks.workunit.client.0.smithi107.stdout:6/329: dread d2/d3/d7/d24/f37 [0,4194304] 0 2024-09-21T08:02:42.065 INFO:tasks.workunit.client.0.smithi107.stdout:6/330: truncate d2/d3/d7/d24/f37 3721474 0 2024-09-21T08:02:42.065 INFO:tasks.workunit.client.0.smithi107.stdout:6/331: write d2/d3/d7/d23/f6a [119881,13097] 0 2024-09-21T08:02:42.065 INFO:tasks.workunit.client.0.smithi107.stdout:6/332: creat d2/d3/d7/d2a/d31/f6b x:0 0 0 2024-09-21T08:02:42.066 INFO:tasks.workunit.client.0.smithi107.stdout:2/204: getdents d1/d16 0 2024-09-21T08:02:42.069 INFO:tasks.workunit.client.0.smithi107.stdout:7/216: creat d7/d22/d37/d4b/f4c x:0 0 0 2024-09-21T08:02:42.070 INFO:tasks.workunit.client.0.smithi107.stdout:5/412: creat d7/de/d1d/d24/d3d/d65/f94 x:0 0 0 2024-09-21T08:02:42.070 INFO:tasks.workunit.client.0.smithi107.stdout:5/413: dread - d7/de/d1d/d24/f6e zero size 2024-09-21T08:02:42.070 INFO:tasks.workunit.client.0.smithi107.stdout:5/414: truncate d7/de/d35/f8a 9365 0 2024-09-21T08:02:42.070 INFO:tasks.workunit.client.0.smithi107.stdout:5/415: dread - d7/de/d1d/d24/f6e zero size 2024-09-21T08:02:42.070 INFO:tasks.workunit.client.0.smithi107.stdout:9/337: write d11/f5f [819487,4252] 0 2024-09-21T08:02:42.073 INFO:tasks.workunit.client.0.smithi107.stdout:1/296: dwrite d0/d29/f5c [0,4194304] 0 2024-09-21T08:02:42.073 INFO:tasks.workunit.client.0.smithi107.stdout:4/269: dwrite dc/d13/f4f [0,4194304] 0 2024-09-21T08:02:42.074 INFO:tasks.workunit.client.0.smithi107.stdout:3/268: sync 2024-09-21T08:02:42.074 INFO:tasks.workunit.client.0.smithi107.stdout:3/269: write d8/d14/d1d/f3a [4084942,90122] 0 2024-09-21T08:02:42.074 INFO:tasks.workunit.client.0.smithi107.stdout:3/270: write d8/d38/f3c [31668,104051] 0 2024-09-21T08:02:42.074 INFO:tasks.workunit.client.0.smithi107.stdout:3/271: chown d8/d25/d34 4955538 1 2024-09-21T08:02:42.074 INFO:tasks.workunit.client.0.smithi107.stdout:3/272: read - d8/d25/d3d/f51 zero size 2024-09-21T08:02:42.077 INFO:tasks.workunit.client.0.smithi107.stdout:2/205: link d1/f26 d1/d1e/d23/d37/f4a 0 2024-09-21T08:02:42.077 INFO:tasks.workunit.client.0.smithi107.stdout:2/206: read - d1/d6/f2e zero size 2024-09-21T08:02:42.078 INFO:tasks.workunit.client.0.smithi107.stdout:2/207: truncate d1/d6/f3d 554795 0 2024-09-21T08:02:42.078 INFO:tasks.workunit.client.0.smithi107.stdout:2/208: chown d1/c20 1422771 1 2024-09-21T08:02:42.078 INFO:tasks.workunit.client.0.smithi107.stdout:7/217: mkdir d7/d22/d37/d40/d4d 0 2024-09-21T08:02:42.078 INFO:tasks.workunit.client.0.smithi107.stdout:7/218: write d7/d22/d37/d40/f4a [979155,27987] 0 2024-09-21T08:02:42.081 INFO:tasks.workunit.client.0.smithi107.stdout:8/192: mkdir d5/d4c 0 2024-09-21T08:02:42.087 INFO:tasks.workunit.client.0.smithi107.stdout:5/416: dwrite d7/de/f19 [0,4194304] 0 2024-09-21T08:02:42.094 INFO:tasks.workunit.client.0.smithi107.stdout:1/297: mkdir d0/d29/d6b 0 2024-09-21T08:02:42.098 INFO:tasks.workunit.client.0.smithi107.stdout:4/270: mknod dc/c59 0 2024-09-21T08:02:42.098 INFO:tasks.workunit.client.0.smithi107.stdout:4/271: chown dc/d13/f58 58233720 1 2024-09-21T08:02:42.098 INFO:tasks.workunit.client.0.smithi107.stdout:4/272: write dc/d13/f3e [21984,30887] 0 2024-09-21T08:02:42.101 INFO:tasks.workunit.client.0.smithi107.stdout:3/273: truncate d8/f41 434081 0 2024-09-21T08:02:42.101 INFO:tasks.workunit.client.0.smithi107.stdout:3/274: chown d8/d25/d34 4 1 2024-09-21T08:02:42.101 INFO:tasks.workunit.client.0.smithi107.stdout:3/275: read d8/d38/f3c [65515,115256] 0 2024-09-21T08:02:42.105 INFO:tasks.workunit.client.0.smithi107.stdout:6/333: rmdir d2/d3/d7/d24 39 2024-09-21T08:02:42.105 INFO:tasks.workunit.client.0.smithi107.stdout:0/318: sync 2024-09-21T08:02:42.108 INFO:tasks.workunit.client.0.smithi107.stdout:2/209: creat d1/d1e/d23/d37/d49/f4b x:0 0 0 2024-09-21T08:02:42.108 INFO:tasks.workunit.client.0.smithi107.stdout:2/210: dread - d1/d16/f32 zero size 2024-09-21T08:02:42.109 INFO:tasks.workunit.client.0.smithi107.stdout:3/276: dread d8/d21/f48 [0,4194304] 0 2024-09-21T08:02:42.110 INFO:tasks.workunit.client.0.smithi107.stdout:3/277: chown d8/d38/l39 245049 1 2024-09-21T08:02:42.110 INFO:tasks.workunit.client.0.smithi107.stdout:7/219: mkdir d7/d22/d37/d4b/d4e 0 2024-09-21T08:02:42.113 INFO:tasks.workunit.client.0.smithi107.stdout:8/193: write d5/d1d/f1e [712829,121562] 0 2024-09-21T08:02:42.113 INFO:tasks.workunit.client.0.smithi107.stdout:8/194: readlink d5/d23/l41 0 2024-09-21T08:02:42.113 INFO:tasks.workunit.client.0.smithi107.stdout:4/273: dwrite dc/d13/d40/f45 [0,4194304] 0 2024-09-21T08:02:42.113 INFO:tasks.workunit.client.0.smithi107.stdout:0/319: dread d1/f8 [4194304,4194304] 0 2024-09-21T08:02:42.114 INFO:tasks.workunit.client.0.smithi107.stdout:5/417: unlink d7/de/d35/c3a 0 2024-09-21T08:02:42.117 INFO:tasks.workunit.client.0.smithi107.stdout:1/298: mknod d0/d19/c6c 0 2024-09-21T08:02:42.117 INFO:tasks.workunit.client.0.smithi107.stdout:5/418: dread d7/de/d1d/d24/d3d/f56 [0,4194304] 0 2024-09-21T08:02:42.123 INFO:tasks.workunit.client.0.smithi107.stdout:2/211: symlink d1/d16/l4c 0 2024-09-21T08:02:42.123 INFO:tasks.workunit.client.0.smithi107.stdout:3/278: mkdir d8/d2b/d52/d55 0 2024-09-21T08:02:42.126 INFO:tasks.workunit.client.0.smithi107.stdout:7/220: truncate d7/d22/f2d 3114034 0 2024-09-21T08:02:42.133 INFO:tasks.workunit.client.0.smithi107.stdout:4/274: mkdir dc/d13/d5a 0 2024-09-21T08:02:42.133 INFO:tasks.workunit.client.0.smithi107.stdout:4/275: dread - dc/d13/d40/f4b zero size 2024-09-21T08:02:42.133 INFO:tasks.workunit.client.0.smithi107.stdout:4/276: readlink dc/d13/l37 0 2024-09-21T08:02:42.133 INFO:tasks.workunit.client.0.smithi107.stdout:4/277: write dc/d13/f58 [870796,46775] 0 2024-09-21T08:02:42.133 INFO:tasks.workunit.client.0.smithi107.stdout:4/278: readlink dc/d13/l39 0 2024-09-21T08:02:42.134 INFO:tasks.workunit.client.0.smithi107.stdout:0/320: dwrite d1/d5/d25/d2d/f5f [0,4194304] 0 2024-09-21T08:02:42.135 INFO:tasks.workunit.client.0.smithi107.stdout:8/195: dwrite d5/d23/f32 [0,4194304] 0 2024-09-21T08:02:42.135 INFO:tasks.workunit.client.0.smithi107.stdout:1/299: symlink d0/d29/l6d 0 2024-09-21T08:02:42.138 INFO:tasks.workunit.client.0.smithi107.stdout:6/334: getdents d2/d3/d7/d2a/d31 0 2024-09-21T08:02:42.138 INFO:tasks.workunit.client.0.smithi107.stdout:6/335: creat d2/d3/d7/d3f/f6c x:0 0 0 2024-09-21T08:02:42.138 INFO:tasks.workunit.client.0.smithi107.stdout:6/336: chown d2/d3/d7/d23/f35 2273 1 2024-09-21T08:02:42.140 INFO:tasks.workunit.client.0.smithi107.stdout:2/212: symlink d1/l4d 0 2024-09-21T08:02:42.140 INFO:tasks.workunit.client.0.smithi107.stdout:2/213: write d1/d1e/d23/f25 [1545234,73491] 0 2024-09-21T08:02:42.145 INFO:tasks.workunit.client.0.smithi107.stdout:1/300: dread d0/d29/d2c/f2e [0,4194304] 0 2024-09-21T08:02:42.145 INFO:tasks.workunit.client.0.smithi107.stdout:1/301: fsync d0/d29/d4d/f60 0 2024-09-21T08:02:42.145 INFO:tasks.workunit.client.0.smithi107.stdout:1/302: chown d0/d29 13023356 1 2024-09-21T08:02:42.146 INFO:tasks.workunit.client.0.smithi107.stdout:3/279: truncate d8/d14/d1d/f1f 2185579 0 2024-09-21T08:02:42.147 INFO:tasks.workunit.client.0.smithi107.stdout:6/337: dread d2/d3/d7/d2a/f47 [0,4194304] 0 2024-09-21T08:02:42.147 INFO:tasks.workunit.client.0.smithi107.stdout:6/338: fsync d2/d3/d7/d2a/d31/f6b 0 2024-09-21T08:02:42.148 INFO:tasks.workunit.client.0.smithi107.stdout:7/221: mkdir d7/d22/d37/d4b/d4e/d4f 0 2024-09-21T08:02:42.152 INFO:tasks.workunit.client.0.smithi107.stdout:4/279: unlink dc/c21 0 2024-09-21T08:02:42.156 INFO:tasks.workunit.client.0.smithi107.stdout:0/321: dwrite d1/d5/d25/d3d/f1f [0,4194304] 0 2024-09-21T08:02:42.158 INFO:tasks.workunit.client.0.smithi107.stdout:2/214: write d1/d1e/d23/d37/f4a [2062873,58169] 0 2024-09-21T08:02:42.158 INFO:tasks.workunit.client.0.smithi107.stdout:2/215: write d1/d1e/d23/f25 [1187630,119473] 0 2024-09-21T08:02:42.159 INFO:tasks.workunit.client.0.smithi107.stdout:7/222: write d7/f13 [4138833,42823] 0 2024-09-21T08:02:42.162 INFO:tasks.workunit.client.0.smithi107.stdout:8/196: creat d5/d1d/f4d x:0 0 0 2024-09-21T08:02:42.162 INFO:tasks.workunit.client.0.smithi107.stdout:8/197: write d5/d1d/f4d [1022744,55088] 0 2024-09-21T08:02:42.164 INFO:tasks.workunit.client.0.smithi107.stdout:1/303: symlink d0/d19/l6e 0 2024-09-21T08:02:42.165 INFO:tasks.workunit.client.0.smithi107.stdout:3/280: rename d8/l20 to d8/d25/d3d/l56 0 2024-09-21T08:02:42.168 INFO:tasks.workunit.client.0.smithi107.stdout:0/322: creat d1/d23/f6d x:0 0 0 2024-09-21T08:02:42.169 INFO:tasks.workunit.client.0.smithi107.stdout:2/216: unlink d1/d2/l2f 0 2024-09-21T08:02:42.170 INFO:tasks.workunit.client.0.smithi107.stdout:8/198: creat d5/d44/d47/f4e x:0 0 0 2024-09-21T08:02:42.171 INFO:tasks.workunit.client.0.smithi107.stdout:1/304: unlink d0/d19/c6c 0 2024-09-21T08:02:42.171 INFO:tasks.workunit.client.0.smithi107.stdout:1/305: chown d0/d29/d4d 8 1 2024-09-21T08:02:42.171 INFO:tasks.workunit.client.0.smithi107.stdout:1/306: write d0/d19/d2b/d4b/f63 [585204,56381] 0 2024-09-21T08:02:42.173 INFO:tasks.workunit.client.0.smithi107.stdout:7/223: rename d7/d10/f20 to d7/d22/d3d/f50 0 2024-09-21T08:02:42.174 INFO:tasks.workunit.client.0.smithi107.stdout:3/281: mkdir d8/d57 0 2024-09-21T08:02:42.174 INFO:tasks.workunit.client.0.smithi107.stdout:3/282: creat d8/d14/f58 x:0 0 0 2024-09-21T08:02:42.175 INFO:tasks.workunit.client.0.smithi107.stdout:3/283: stat d8/d25/d34 0 2024-09-21T08:02:42.175 INFO:tasks.workunit.client.0.smithi107.stdout:4/280: dwrite dc/f3a [0,4194304] 0 2024-09-21T08:02:42.175 INFO:tasks.workunit.client.0.smithi107.stdout:2/217: fsync d1/f26 0 2024-09-21T08:02:42.175 INFO:tasks.workunit.client.0.smithi107.stdout:2/218: readlink d1/d1e/l45 0 2024-09-21T08:02:42.175 INFO:tasks.workunit.client.0.smithi107.stdout:2/219: write d1/d6/f18 [4574883,105588] 0 2024-09-21T08:02:42.175 INFO:tasks.workunit.client.0.smithi107.stdout:2/220: read - d1/d1e/d23/d37/f3a zero size 2024-09-21T08:02:42.175 INFO:tasks.workunit.client.0.smithi107.stdout:2/221: fdatasync d1/d6/f3d 0 2024-09-21T08:02:42.177 INFO:tasks.workunit.client.0.smithi107.stdout:0/323: rmdir d1/d5/d25/d3d/d20/d29/d6a 0 2024-09-21T08:02:42.178 INFO:tasks.workunit.client.0.smithi107.stdout:8/199: creat d5/d40/f4f x:0 0 0 2024-09-21T08:02:42.179 INFO:tasks.workunit.client.0.smithi107.stdout:8/200: fdatasync d5/fa 0 2024-09-21T08:02:42.180 INFO:tasks.workunit.client.0.smithi107.stdout:6/339: dwrite d2/d3/d7/f15 [0,4194304] 0 2024-09-21T08:02:42.180 INFO:tasks.workunit.client.0.smithi107.stdout:6/340: dread - d2/d3/d7/d2a/d31/f6b zero size 2024-09-21T08:02:42.182 INFO:tasks.workunit.client.0.smithi107.stdout:7/224: creat d7/d22/d3d/f51 x:0 0 0 2024-09-21T08:02:42.183 INFO:tasks.workunit.client.0.smithi107.stdout:7/225: truncate d7/d10/f1d 764415 0 2024-09-21T08:02:42.183 INFO:tasks.workunit.client.0.smithi107.stdout:7/226: chown d7/d22/d3d 506573054 1 2024-09-21T08:02:42.183 INFO:tasks.workunit.client.0.smithi107.stdout:7/227: write d7/d18/f29 [200851,35482] 0 2024-09-21T08:02:42.187 INFO:tasks.workunit.client.0.smithi107.stdout:3/284: mkdir d8/d2b/d52/d59 0 2024-09-21T08:02:42.190 INFO:tasks.workunit.client.0.smithi107.stdout:1/307: dwrite d0/d29/f37 [0,4194304] 0 2024-09-21T08:02:42.190 INFO:tasks.workunit.client.0.smithi107.stdout:2/222: creat d1/d16/f4e x:0 0 0 2024-09-21T08:02:42.190 INFO:tasks.workunit.client.0.smithi107.stdout:2/223: creat d1/d1e/d23/d37/d49/f4f x:0 0 0 2024-09-21T08:02:42.192 INFO:tasks.workunit.client.0.smithi107.stdout:2/224: read d1/d16/f41 [2646,113707] 0 2024-09-21T08:02:42.192 INFO:tasks.workunit.client.0.smithi107.stdout:0/324: unlink d1/d5/d25/f50 0 2024-09-21T08:02:42.192 INFO:tasks.workunit.client.0.smithi107.stdout:7/228: fdatasync d7/d18/f29 0 2024-09-21T08:02:42.194 INFO:tasks.workunit.client.0.smithi107.stdout:8/201: creat d5/d44/f50 x:0 0 0 2024-09-21T08:02:42.194 INFO:tasks.workunit.client.0.smithi107.stdout:8/202: chown d5/d2e/c33 341924717 1 2024-09-21T08:02:42.194 INFO:tasks.workunit.client.0.smithi107.stdout:8/203: fdatasync d5/d23/f35 0 2024-09-21T08:02:42.194 INFO:tasks.workunit.client.0.smithi107.stdout:8/204: chown d5/l1a 132 1 2024-09-21T08:02:42.194 INFO:tasks.workunit.client.0.smithi107.stdout:8/205: creat d5/d2e/f51 x:0 0 0 2024-09-21T08:02:42.199 INFO:tasks.workunit.client.0.smithi107.stdout:3/285: rmdir d8/d2b/d52/d59 0 2024-09-21T08:02:42.202 INFO:tasks.workunit.client.0.smithi107.stdout:1/308: dread d0/f3 [0,4194304] 0 2024-09-21T08:02:42.204 INFO:tasks.workunit.client.0.smithi107.stdout:2/225: unlink d1/d6/c39 0 2024-09-21T08:02:42.204 INFO:tasks.workunit.client.0.smithi107.stdout:7/229: write d7/d10/d28/f35 [2943026,68663] 0 2024-09-21T08:02:42.205 INFO:tasks.workunit.client.0.smithi107.stdout:7/230: chown d7/d22/d3a/d49 0 1 2024-09-21T08:02:42.205 INFO:tasks.workunit.client.0.smithi107.stdout:0/325: mknod d1/d23/c6e 0 2024-09-21T08:02:42.209 INFO:tasks.workunit.client.0.smithi107.stdout:8/206: unlink d5/d1d/c2a 0 2024-09-21T08:02:42.209 INFO:tasks.workunit.client.0.smithi107.stdout:8/207: chown d5/f6 1605 1 2024-09-21T08:02:42.210 INFO:tasks.workunit.client.0.smithi107.stdout:3/286: mknod d8/d25/c5a 0 2024-09-21T08:02:42.210 INFO:tasks.workunit.client.0.smithi107.stdout:4/281: dwrite dc/d13/d40/f52 [0,4194304] 0 2024-09-21T08:02:42.210 INFO:tasks.workunit.client.0.smithi107.stdout:4/282: chown dc/d13/l2b 72728576 1 2024-09-21T08:02:42.210 INFO:tasks.workunit.client.0.smithi107.stdout:6/341: dwrite d2/d3/d7/d2a/f47 [4194304,4194304] 0 2024-09-21T08:02:42.210 INFO:tasks.workunit.client.0.smithi107.stdout:6/342: write d2/d3/d7/f11 [951511,89852] 0 2024-09-21T08:02:42.211 INFO:tasks.workunit.client.0.smithi107.stdout:1/309: creat d0/d19/d59/f6f x:0 0 0 2024-09-21T08:02:42.213 INFO:tasks.workunit.client.0.smithi107.stdout:2/226: rename d1/d1e/d23/f25 to d1/d16/d35/f50 0 2024-09-21T08:02:42.217 INFO:tasks.workunit.client.0.smithi107.stdout:7/231: creat d7/f52 x:0 0 0 2024-09-21T08:02:42.218 INFO:tasks.workunit.client.0.smithi107.stdout:2/227: dread d1/d16/f17 [0,4194304] 0 2024-09-21T08:02:42.218 INFO:tasks.workunit.client.0.smithi107.stdout:2/228: truncate d1/f3 972515 0 2024-09-21T08:02:42.219 INFO:tasks.workunit.client.0.smithi107.stdout:0/326: unlink d1/d5/d25/f3e 0 2024-09-21T08:02:42.221 INFO:tasks.workunit.client.0.smithi107.stdout:8/208: mkdir d5/d4c/d52 0 2024-09-21T08:02:42.221 INFO:tasks.workunit.client.0.smithi107.stdout:8/209: write d5/d2e/f4b [894164,27549] 0 2024-09-21T08:02:42.221 INFO:tasks.workunit.client.0.smithi107.stdout:8/210: getdents d5/d4c/d52 0 2024-09-21T08:02:42.221 INFO:tasks.workunit.client.0.smithi107.stdout:8/211: truncate d5/f45 833138 0 2024-09-21T08:02:42.222 INFO:tasks.workunit.client.0.smithi107.stdout:2/229: dread d1/d16/f41 [0,4194304] 0 2024-09-21T08:02:42.222 INFO:tasks.workunit.client.0.smithi107.stdout:3/287: mknod d8/d2b/d52/d55/c5b 0 2024-09-21T08:02:42.225 INFO:tasks.workunit.client.0.smithi107.stdout:7/232: dread d7/d18/f19 [0,4194304] 0 2024-09-21T08:02:42.225 INFO:tasks.workunit.client.0.smithi107.stdout:7/233: chown d7/d22/d3d/f51 0 1 2024-09-21T08:02:42.226 INFO:tasks.workunit.client.0.smithi107.stdout:7/234: write d7/d10/f1d [382070,92445] 0 2024-09-21T08:02:42.226 INFO:tasks.workunit.client.0.smithi107.stdout:7/235: chown f4 1381195845 1 2024-09-21T08:02:42.226 INFO:tasks.workunit.client.0.smithi107.stdout:7/236: fdatasync f4 0 2024-09-21T08:02:42.226 INFO:tasks.workunit.client.0.smithi107.stdout:7/237: write d7/d10/f1d [190791,100408] 0 2024-09-21T08:02:42.227 INFO:tasks.workunit.client.0.smithi107.stdout:6/343: symlink d2/d3/d7/d23/l6d 0 2024-09-21T08:02:42.228 INFO:tasks.workunit.client.0.smithi107.stdout:1/310: truncate d0/d29/d2c/f2e 3763281 0 2024-09-21T08:02:42.230 INFO:tasks.workunit.client.0.smithi107.stdout:4/283: rename dc/d13/f16 to dc/d13/d5a/f5b 0 2024-09-21T08:02:42.230 INFO:tasks.workunit.client.0.smithi107.stdout:4/284: fsync dc/f31 0 2024-09-21T08:02:42.232 INFO:tasks.workunit.client.0.smithi107.stdout:8/212: creat d5/d44/d46/f53 x:0 0 0 2024-09-21T08:02:42.234 INFO:tasks.workunit.client.0.smithi107.stdout:2/230: truncate d1/d1e/d23/d37/f4a 2451444 0 2024-09-21T08:02:42.234 INFO:tasks.workunit.client.0.smithi107.stdout:2/231: write d1/f33 [1277969,3250] 0 2024-09-21T08:02:42.234 INFO:tasks.workunit.client.0.smithi107.stdout:2/232: creat d1/d6/f51 x:0 0 0 2024-09-21T08:02:42.234 INFO:tasks.workunit.client.0.smithi107.stdout:2/233: write d1/d2/f34 [5131111,29677] 0 2024-09-21T08:02:42.235 INFO:tasks.workunit.client.0.smithi107.stdout:7/238: getdents d7/d22/d3a 0 2024-09-21T08:02:42.237 INFO:tasks.workunit.client.0.smithi107.stdout:6/344: mkdir d2/d3/d7/d24/d41/d50/d6e 0 2024-09-21T08:02:42.240 INFO:tasks.workunit.client.0.smithi107.stdout:8/213: unlink d5/d1d/c37 0 2024-09-21T08:02:42.240 INFO:tasks.workunit.client.0.smithi107.stdout:8/214: write d5/d40/f4f [458413,37986] 0 2024-09-21T08:02:42.241 INFO:tasks.workunit.client.0.smithi107.stdout:4/285: write fa [1573809,33874] 0 2024-09-21T08:02:42.243 INFO:tasks.workunit.client.0.smithi107.stdout:2/234: getdents d1/d1e/d23/d42 0 2024-09-21T08:02:42.244 INFO:tasks.workunit.client.0.smithi107.stdout:2/235: creat d1/d1e/d23/f52 x:0 0 0 2024-09-21T08:02:42.246 INFO:tasks.workunit.client.0.smithi107.stdout:7/239: symlink d7/d22/d37/d4b/d4e/l53 0 2024-09-21T08:02:42.248 INFO:tasks.workunit.client.0.smithi107.stdout:6/345: creat d2/d3/d7/d2a/d31/f6f x:0 0 0 2024-09-21T08:02:42.251 INFO:tasks.workunit.client.0.smithi107.stdout:8/215: mkdir d5/d4c/d54 0 2024-09-21T08:02:42.251 INFO:tasks.workunit.client.0.smithi107.stdout:8/216: dread - d5/d38/f3f zero size 2024-09-21T08:02:42.251 INFO:tasks.workunit.client.0.smithi107.stdout:8/217: chown d5/c30 57 1 2024-09-21T08:02:42.251 INFO:tasks.workunit.client.0.smithi107.stdout:0/327: dwrite d1/d5/f48 [0,4194304] 0 2024-09-21T08:02:42.255 INFO:tasks.workunit.client.0.smithi107.stdout:7/240: symlink d7/d22/d3a/l54 0 2024-09-21T08:02:42.255 INFO:tasks.workunit.client.0.smithi107.stdout:0/328: dread d1/d5/d25/d3d/d20/d29/d55/f58 [0,4194304] 0 2024-09-21T08:02:42.255 INFO:tasks.workunit.client.0.smithi107.stdout:0/329: write d1/d5/d25/d2d/f59 [595747,92081] 0 2024-09-21T08:02:42.255 INFO:tasks.workunit.client.0.smithi107.stdout:1/311: dwrite d0/f3c [0,4194304] 0 2024-09-21T08:02:42.255 INFO:tasks.workunit.client.0.smithi107.stdout:1/312: write d0/f12 [444793,40648] 0 2024-09-21T08:02:42.255 INFO:tasks.workunit.client.0.smithi107.stdout:1/313: chown d0/d19/d2b/l2d 654791 1 2024-09-21T08:02:42.255 INFO:tasks.workunit.client.0.smithi107.stdout:3/288: dwrite d8/f13 [0,4194304] 0 2024-09-21T08:02:42.256 INFO:tasks.workunit.client.0.smithi107.stdout:6/346: mknod d2/d3/d7/d23/c70 0 2024-09-21T08:02:42.258 INFO:tasks.workunit.client.0.smithi107.stdout:8/218: symlink d5/d2e/l55 0 2024-09-21T08:02:42.259 INFO:tasks.workunit.client.0.smithi107.stdout:2/236: write d1/d2/f15 [3855179,30091] 0 2024-09-21T08:02:42.264 INFO:tasks.workunit.client.0.smithi107.stdout:4/286: dwrite dc/d13/d40/f43 [0,4194304] 0 2024-09-21T08:02:42.266 INFO:tasks.workunit.client.0.smithi107.stdout:7/241: creat d7/d10/f55 x:0 0 0 2024-09-21T08:02:42.267 INFO:tasks.workunit.client.0.smithi107.stdout:0/330: mkdir d1/d6f 0 2024-09-21T08:02:42.268 INFO:tasks.workunit.client.0.smithi107.stdout:1/314: write d0/d29/d2c/f2e [2688852,46886] 0 2024-09-21T08:02:42.268 INFO:tasks.workunit.client.0.smithi107.stdout:1/315: write d0/f3c [4355265,48683] 0 2024-09-21T08:02:42.268 INFO:tasks.workunit.client.0.smithi107.stdout:1/316: readlink d0/d19/d2b/l5d 0 2024-09-21T08:02:42.269 INFO:tasks.workunit.client.0.smithi107.stdout:2/237: mknod d1/d1e/d23/d42/c53 0 2024-09-21T08:02:42.273 INFO:tasks.workunit.client.0.smithi107.stdout:7/242: mkdir d7/d22/d3a/d49/d56 0 2024-09-21T08:02:42.276 INFO:tasks.workunit.client.0.smithi107.stdout:0/331: link d1/d5/d25/d3d/d20/d29/l4f d1/l70 0 2024-09-21T08:02:42.276 INFO:tasks.workunit.client.0.smithi107.stdout:0/332: chown d1/d5/d25/d3d/d20/d29/l4f 1080 1 2024-09-21T08:02:42.276 INFO:tasks.workunit.client.0.smithi107.stdout:7/243: dread d7/d18/f29 [0,4194304] 0 2024-09-21T08:02:42.278 INFO:tasks.workunit.client.0.smithi107.stdout:1/317: unlink d0/d19/d2b/d4b/d1c/c6a 0 2024-09-21T08:02:42.280 INFO:tasks.workunit.client.0.smithi107.stdout:7/244: link d7/d22/d37/d40/c46 d7/d10/d28/c57 0 2024-09-21T08:02:42.280 INFO:tasks.workunit.client.0.smithi107.stdout:6/347: dwrite d2/d3/d7/d2a/d31/f6b [0,4194304] 0 2024-09-21T08:02:42.282 INFO:tasks.workunit.client.0.smithi107.stdout:6/348: mknod d2/c71 0 2024-09-21T08:02:42.282 INFO:tasks.workunit.client.0.smithi107.stdout:6/349: stat d2/d2e/c40 0 2024-09-21T08:02:42.282 INFO:tasks.workunit.client.0.smithi107.stdout:6/350: creat d2/d3/d7/d48/f72 x:0 0 0 2024-09-21T08:02:42.283 INFO:tasks.workunit.client.0.smithi107.stdout:7/245: mknod d7/d10/c58 0 2024-09-21T08:02:42.283 INFO:tasks.workunit.client.0.smithi107.stdout:7/246: chown d7/d22/d37/d4b/f4c 0 1 2024-09-21T08:02:42.283 INFO:tasks.workunit.client.0.smithi107.stdout:7/247: creat d7/d10/d28/f59 x:0 0 0 2024-09-21T08:02:42.284 INFO:tasks.workunit.client.0.smithi107.stdout:6/351: mknod d2/d3/d7/d54/d5c/c73 0 2024-09-21T08:02:42.286 INFO:tasks.workunit.client.0.smithi107.stdout:1/318: dread d0/d29/d4d/f60 [0,4194304] 0 2024-09-21T08:02:42.289 INFO:tasks.workunit.client.0.smithi107.stdout:1/319: getdents d0/d19/d2b/d4b/d44/d55 0 2024-09-21T08:02:42.293 INFO:tasks.workunit.client.0.smithi107.stdout:8/219: rename d5/d4c to d5/d38/d56 0 2024-09-21T08:02:42.293 INFO:tasks.workunit.client.0.smithi107.stdout:8/220: fsync d5/f20 0 2024-09-21T08:02:42.293 INFO:tasks.workunit.client.0.smithi107.stdout:3/289: dwrite d8/d21/f24 [0,4194304] 0 2024-09-21T08:02:42.295 INFO:tasks.workunit.client.0.smithi107.stdout:4/287: rename dc/d13/l2f to dc/d13/d40/d46/d48/l5c 0 2024-09-21T08:02:42.295 INFO:tasks.workunit.client.0.smithi107.stdout:4/288: readlink l9 0 2024-09-21T08:02:42.296 INFO:tasks.workunit.client.0.smithi107.stdout:8/221: truncate d5/f1b 669137 0 2024-09-21T08:02:42.296 INFO:tasks.workunit.client.0.smithi107.stdout:8/222: truncate d5/f45 883589 0 2024-09-21T08:02:42.297 INFO:tasks.workunit.client.0.smithi107.stdout:8/223: stat d5/c7 0 2024-09-21T08:02:42.297 INFO:tasks.workunit.client.0.smithi107.stdout:8/224: write d5/d44/f50 [464186,109983] 0 2024-09-21T08:02:42.298 INFO:tasks.workunit.client.0.smithi107.stdout:8/225: creat d5/d23/f57 x:0 0 0 2024-09-21T08:02:42.298 INFO:tasks.workunit.client.0.smithi107.stdout:8/226: dread - d5/d44/d46/f53 zero size 2024-09-21T08:02:42.298 INFO:tasks.workunit.client.0.smithi107.stdout:8/227: dread - d5/d23/f57 zero size 2024-09-21T08:02:42.298 INFO:tasks.workunit.client.0.smithi107.stdout:8/228: fsync d5/d23/f32 0 2024-09-21T08:02:42.299 INFO:tasks.workunit.client.0.smithi107.stdout:4/289: dread f7 [0,4194304] 0 2024-09-21T08:02:42.301 INFO:tasks.workunit.client.0.smithi107.stdout:8/229: rename d5/d2e/l55 to d5/d23/l58 0 2024-09-21T08:02:42.307 INFO:tasks.workunit.client.0.smithi107.stdout:2/238: dwrite d1/f26 [0,4194304] 0 2024-09-21T08:02:42.307 INFO:tasks.workunit.client.0.smithi107.stdout:2/239: chown d1/d6/c47 12 1 2024-09-21T08:02:42.307 INFO:tasks.workunit.client.0.smithi107.stdout:2/240: creat d1/d1e/d23/d37/f54 x:0 0 0 2024-09-21T08:02:42.311 INFO:tasks.workunit.client.0.smithi107.stdout:6/352: dwrite d2/d3/d7/d48/f5d [0,4194304] 0 2024-09-21T08:02:42.311 INFO:tasks.workunit.client.0.smithi107.stdout:0/333: dwrite d1/d5/d25/d2d/f5f [0,4194304] 0 2024-09-21T08:02:42.311 INFO:tasks.workunit.client.0.smithi107.stdout:3/290: dread d8/d2b/f3b [0,4194304] 0 2024-09-21T08:02:42.314 INFO:tasks.workunit.client.0.smithi107.stdout:4/290: write dc/d13/d40/f52 [1368947,86025] 0 2024-09-21T08:02:42.314 INFO:tasks.workunit.client.0.smithi107.stdout:7/248: rmdir d7/d22 39 2024-09-21T08:02:42.315 INFO:tasks.workunit.client.0.smithi107.stdout:6/353: dread d2/d3/f9 [0,4194304] 0 2024-09-21T08:02:42.315 INFO:tasks.workunit.client.0.smithi107.stdout:6/354: fsync d2/d3/f26 0 2024-09-21T08:02:42.315 INFO:tasks.workunit.client.0.smithi107.stdout:6/355: creat d2/d3/d7/d23/d2b/f74 x:0 0 0 2024-09-21T08:02:42.315 INFO:tasks.workunit.client.0.smithi107.stdout:6/356: truncate d2/d3/d7/d24/f59 581856 0 2024-09-21T08:02:42.317 INFO:tasks.workunit.client.0.smithi107.stdout:3/291: creat d8/d14/d1d/f5c x:0 0 0 2024-09-21T08:02:42.318 INFO:tasks.workunit.client.0.smithi107.stdout:4/291: truncate dc/f3a 2104160 0 2024-09-21T08:02:42.319 INFO:tasks.workunit.client.0.smithi107.stdout:7/249: mkdir d7/d22/d37/d5a 0 2024-09-21T08:02:42.319 INFO:tasks.workunit.client.0.smithi107.stdout:7/250: write d7/d10/d28/f59 [291079,60523] 0 2024-09-21T08:02:42.321 INFO:tasks.workunit.client.0.smithi107.stdout:6/357: creat d2/d3/d7/d54/f75 x:0 0 0 2024-09-21T08:02:42.323 INFO:tasks.workunit.client.0.smithi107.stdout:0/334: getdents d1/d5/d25 0 2024-09-21T08:02:42.326 INFO:tasks.workunit.client.0.smithi107.stdout:7/251: creat d7/d22/d37/d5a/f5b x:0 0 0 2024-09-21T08:02:42.326 INFO:tasks.workunit.client.0.smithi107.stdout:7/252: readlink d7/d18/l26 0 2024-09-21T08:02:42.328 INFO:tasks.workunit.client.0.smithi107.stdout:7/253: write d7/f14 [771876,88909] 0 2024-09-21T08:02:42.328 INFO:tasks.workunit.client.0.smithi107.stdout:7/254: dread - d7/f52 zero size 2024-09-21T08:02:42.329 INFO:tasks.workunit.client.0.smithi107.stdout:0/335: link d1/d5/d25/c2b d1/d23/c71 0 2024-09-21T08:02:42.330 INFO:tasks.workunit.client.0.smithi107.stdout:3/292: getdents d8/d2b/d45 0 2024-09-21T08:02:42.333 INFO:tasks.workunit.client.0.smithi107.stdout:4/292: dread dc/d13/d40/f43 [0,4194304] 0 2024-09-21T08:02:42.333 INFO:tasks.workunit.client.0.smithi107.stdout:4/293: creat dc/d13/f5d x:0 0 0 2024-09-21T08:02:42.333 INFO:tasks.workunit.client.0.smithi107.stdout:7/255: rename d7/d10/d28/f34 to d7/d22/f5c 0 2024-09-21T08:02:42.333 INFO:tasks.workunit.client.0.smithi107.stdout:7/256: write d7/d10/f1d [1240877,113699] 0 2024-09-21T08:02:42.334 INFO:tasks.workunit.client.0.smithi107.stdout:0/336: symlink d1/d5/d25/d3d/d20/d29/l72 0 2024-09-21T08:02:42.335 INFO:tasks.workunit.client.0.smithi107.stdout:3/293: mkdir d8/d57/d5d 0 2024-09-21T08:02:42.338 INFO:tasks.workunit.client.0.smithi107.stdout:4/294: mkdir dc/d13/d40/d5e 0 2024-09-21T08:02:42.339 INFO:tasks.workunit.client.0.smithi107.stdout:7/257: symlink d7/d38/l5d 0 2024-09-21T08:02:42.339 INFO:tasks.workunit.client.0.smithi107.stdout:7/258: dread - d7/d22/d37/d5a/f5b zero size 2024-09-21T08:02:42.341 INFO:tasks.workunit.client.0.smithi107.stdout:7/259: creat d7/d22/d37/d4b/f5e x:0 0 0 2024-09-21T08:02:42.342 INFO:tasks.workunit.client.0.smithi107.stdout:3/294: dread f2 [0,4194304] 0 2024-09-21T08:02:42.342 INFO:tasks.workunit.client.0.smithi107.stdout:3/295: fdatasync d8/fe 0 2024-09-21T08:02:42.343 INFO:tasks.workunit.client.0.smithi107.stdout:7/260: chown l1 0 1 2024-09-21T08:02:42.344 INFO:tasks.workunit.client.0.smithi107.stdout:3/296: mknod d8/d14/c5e 0 2024-09-21T08:02:42.345 INFO:tasks.workunit.client.0.smithi107.stdout:7/261: truncate f3 744053 0 2024-09-21T08:02:42.347 INFO:tasks.workunit.client.0.smithi107.stdout:3/297: rmdir d8/d38 39 2024-09-21T08:02:42.351 INFO:tasks.workunit.client.0.smithi107.stdout:1/320: dwrite d0/d29/d31/f42 [0,4194304] 0 2024-09-21T08:02:42.352 INFO:tasks.workunit.client.0.smithi107.stdout:4/295: write dc/d13/d5a/f5b [3352061,64820] 0 2024-09-21T08:02:42.352 INFO:tasks.workunit.client.0.smithi107.stdout:4/296: write dc/d13/f57 [277952,58136] 0 2024-09-21T08:02:42.353 INFO:tasks.workunit.client.0.smithi107.stdout:6/358: dwrite d2/d3/d7/f42 [0,4194304] 0 2024-09-21T08:02:42.356 INFO:tasks.workunit.client.0.smithi107.stdout:1/321: rename d0/d29/c66 to d0/d19/d2b/d4b/c70 0 2024-09-21T08:02:42.358 INFO:tasks.workunit.client.0.smithi107.stdout:4/297: unlink l9 0 2024-09-21T08:02:42.359 INFO:tasks.workunit.client.0.smithi107.stdout:8/230: dwrite d5/d1d/f26 [0,4194304] 0 2024-09-21T08:02:42.359 INFO:tasks.workunit.client.0.smithi107.stdout:8/231: read - d5/d23/f57 zero size 2024-09-21T08:02:42.359 INFO:tasks.workunit.client.0.smithi107.stdout:2/241: dwrite d1/f33 [0,4194304] 0 2024-09-21T08:02:42.362 INFO:tasks.workunit.client.0.smithi107.stdout:0/337: dwrite d1/d5/d25/d3d/f1f [0,4194304] 0 2024-09-21T08:02:42.362 INFO:tasks.workunit.client.0.smithi107.stdout:0/338: dread - d1/d5/f67 zero size 2024-09-21T08:02:42.362 INFO:tasks.workunit.client.0.smithi107.stdout:0/339: fdatasync d1/d5/d25/d3d/d20/d29/d5c/f5e 0 2024-09-21T08:02:42.365 INFO:tasks.workunit.client.0.smithi107.stdout:6/359: mknod d2/d3/d7/d3f/c76 0 2024-09-21T08:02:42.370 INFO:tasks.workunit.client.0.smithi107.stdout:8/232: link d5/d23/c36 d5/d38/d56/d52/c59 0 2024-09-21T08:02:42.371 INFO:tasks.workunit.client.0.smithi107.stdout:4/298: write dc/d13/f4f [1406932,60899] 0 2024-09-21T08:02:42.371 INFO:tasks.workunit.client.0.smithi107.stdout:4/299: chown dc/d13/d40/f52 130991987 1 2024-09-21T08:02:42.373 INFO:tasks.workunit.client.0.smithi107.stdout:8/233: read d5/fa [605304,30128] 0 2024-09-21T08:02:42.375 INFO:tasks.workunit.client.0.smithi107.stdout:2/242: rename d1/d1e/d23/d37/d49/f4f to d1/d16/f55 0 2024-09-21T08:02:42.376 INFO:tasks.workunit.client.0.smithi107.stdout:2/243: chown d1/d16/f41 26214948 1 2024-09-21T08:02:42.378 INFO:tasks.workunit.client.0.smithi107.stdout:1/322: dwrite d0/d19/d2b/d4b/f4c [0,4194304] 0 2024-09-21T08:02:42.378 INFO:tasks.workunit.client.0.smithi107.stdout:1/323: stat d0/d29/l4a 0 2024-09-21T08:02:42.378 INFO:tasks.workunit.client.0.smithi107.stdout:1/324: dread - d0/d19/d59/f6f zero size 2024-09-21T08:02:42.378 INFO:tasks.workunit.client.0.smithi107.stdout:1/325: truncate d0/d19/d59/f6f 343299 0 2024-09-21T08:02:42.379 INFO:tasks.workunit.client.0.smithi107.stdout:7/262: dwrite d7/d10/f1d [0,4194304] 0 2024-09-21T08:02:42.379 INFO:tasks.workunit.client.0.smithi107.stdout:7/263: truncate d7/d10/f55 845753 0 2024-09-21T08:02:42.418 INFO:tasks.workunit.client.0.smithi107.stdout:6/360: unlink d2/d3/d7/d2a/d31/f6b 0 2024-09-21T08:02:42.421 INFO:tasks.workunit.client.0.smithi107.stdout:4/300: rmdir dc/d13/d40 39 2024-09-21T08:02:42.424 INFO:tasks.workunit.client.0.smithi107.stdout:8/234: unlink d5/d40/f4f 0 2024-09-21T08:02:42.424 INFO:tasks.workunit.client.0.smithi107.stdout:8/235: fsync d5/d23/f3b 0 2024-09-21T08:02:42.425 INFO:tasks.workunit.client.0.smithi107.stdout:0/340: rename d1/f5a to d1/d23/d61/f73 0 2024-09-21T08:02:42.425 INFO:tasks.workunit.client.0.smithi107.stdout:0/341: fdatasync d1/d5/d25/f4d 0 2024-09-21T08:02:42.426 INFO:tasks.workunit.client.0.smithi107.stdout:2/244: getdents d1/d1e/d23/d42 0 2024-09-21T08:02:42.426 INFO:tasks.workunit.client.0.smithi107.stdout:2/245: chown d1/d16/l4c 0 1 2024-09-21T08:02:42.427 INFO:tasks.workunit.client.0.smithi107.stdout:1/326: creat d0/f71 x:0 0 0 2024-09-21T08:02:42.429 INFO:tasks.workunit.client.0.smithi107.stdout:7/264: symlink d7/d22/d37/l5f 0 2024-09-21T08:02:42.429 INFO:tasks.workunit.client.0.smithi107.stdout:7/265: chown d7 0 1 2024-09-21T08:02:42.433 INFO:tasks.workunit.client.0.smithi107.stdout:4/301: symlink dc/l5f 0 2024-09-21T08:02:42.435 INFO:tasks.workunit.client.0.smithi107.stdout:8/236: dread d5/fd [0,4194304] 0 2024-09-21T08:02:42.436 INFO:tasks.workunit.client.0.smithi107.stdout:0/342: write d1/d5/f27 [9711493,104137] 0 2024-09-21T08:02:42.437 INFO:tasks.workunit.client.0.smithi107.stdout:6/361: dwrite d2/d3/d7/d23/d2b/f2f [0,4194304] 0 2024-09-21T08:02:42.439 INFO:tasks.workunit.client.0.smithi107.stdout:2/246: symlink d1/d1e/d23/d42/l56 0 2024-09-21T08:02:42.442 INFO:tasks.workunit.client.0.smithi107.stdout:1/327: rename d0/d19/d2b/d4b/d1c/d20 to d0/d19/d2b/d4b/d44/d72 0 2024-09-21T08:02:42.442 INFO:tasks.workunit.client.0.smithi107.stdout:1/328: write d0/d29/f3f [786255,30539] 0 2024-09-21T08:02:42.444 INFO:tasks.workunit.client.0.smithi107.stdout:4/302: dread dc/d13/f26 [0,4194304] 0 2024-09-21T08:02:42.444 INFO:tasks.workunit.client.0.smithi107.stdout:7/266: link d7/f52 d7/d38/f60 0 2024-09-21T08:02:42.450 INFO:tasks.workunit.client.0.smithi107.stdout:6/362: link d2/d3/d7/d2a/c53 d2/d2e/c77 0 2024-09-21T08:02:42.451 INFO:tasks.workunit.client.0.smithi107.stdout:8/237: dread d5/d38/f3e [0,4194304] 0 2024-09-21T08:02:42.452 INFO:tasks.workunit.client.0.smithi107.stdout:0/343: rename d1/d5/d25/c43 to d1/d5/d25/d3d/d20/c74 0 2024-09-21T08:02:42.452 INFO:tasks.workunit.client.0.smithi107.stdout:0/344: truncate d1/d5/d25/d3d/d20/d29/d5c/f5e 857963 0 2024-09-21T08:02:42.452 INFO:tasks.workunit.client.0.smithi107.stdout:4/303: write dc/f1b [456996,124903] 0 2024-09-21T08:02:42.456 INFO:tasks.workunit.client.0.smithi107.stdout:1/329: creat d0/d19/d2b/d4b/d44/d72/d36/f73 x:0 0 0 2024-09-21T08:02:42.460 INFO:tasks.workunit.client.0.smithi107.stdout:8/238: link d5/d40/c42 d5/d38/d56/d52/c5a 0 2024-09-21T08:02:42.462 INFO:tasks.workunit.client.0.smithi107.stdout:7/267: rename d7/d10/l12 to d7/d10/d28/l61 0 2024-09-21T08:02:42.465 INFO:tasks.workunit.client.0.smithi107.stdout:1/330: mknod d0/d19/d2b/d4b/d44/d55/c74 0 2024-09-21T08:02:42.465 INFO:tasks.workunit.client.0.smithi107.stdout:1/331: chown d0/d19/d2b/d4b/c70 3 1 2024-09-21T08:02:42.467 INFO:tasks.workunit.client.0.smithi107.stdout:2/247: dwrite d1/d16/f17 [0,4194304] 0 2024-09-21T08:02:42.467 INFO:tasks.workunit.client.0.smithi107.stdout:2/248: readlink d1/d1e/l45 0 2024-09-21T08:02:42.467 INFO:tasks.workunit.client.0.smithi107.stdout:1/332: dread d0/d29/d4d/f60 [0,4194304] 0 2024-09-21T08:02:42.468 INFO:tasks.workunit.client.0.smithi107.stdout:7/268: rename f3 to d7/d22/d37/d4b/d4e/f62 0 2024-09-21T08:02:42.469 INFO:tasks.workunit.client.0.smithi107.stdout:8/239: rmdir d5/d44/d46 39 2024-09-21T08:02:42.471 INFO:tasks.workunit.client.0.smithi107.stdout:2/249: symlink d1/d1e/l57 0 2024-09-21T08:02:42.471 INFO:tasks.workunit.client.0.smithi107.stdout:2/250: creat d1/d16/d35/f58 x:0 0 0 2024-09-21T08:02:42.471 INFO:tasks.workunit.client.0.smithi107.stdout:2/251: write d1/d16/f55 [939528,24826] 0 2024-09-21T08:02:42.473 INFO:tasks.workunit.client.0.smithi107.stdout:1/333: mkdir d0/d19/d2b/d4b/d61/d75 0 2024-09-21T08:02:42.473 INFO:tasks.workunit.client.0.smithi107.stdout:1/334: chown d0/d19/l21 3378 1 2024-09-21T08:02:42.474 INFO:tasks.workunit.client.0.smithi107.stdout:7/269: mknod d7/d22/d3a/d49/d56/c63 0 2024-09-21T08:02:42.474 INFO:tasks.workunit.client.0.smithi107.stdout:7/270: write d7/d38/f41 [467771,95238] 0 2024-09-21T08:02:42.479 INFO:tasks.workunit.client.0.smithi107.stdout:1/335: creat d0/d29/d31/d4f/f76 x:0 0 0 2024-09-21T08:02:42.479 INFO:tasks.workunit.client.0.smithi107.stdout:1/336: chown d0/d19/d2b/d4b/d1c/c49 3818069 1 2024-09-21T08:02:42.483 INFO:tasks.workunit.client.0.smithi107.stdout:1/337: rename d0/f11 to d0/d29/d31/f77 0 2024-09-21T08:02:42.483 INFO:tasks.workunit.client.0.smithi107.stdout:1/338: rmdir d0/d19/d2b/d4b/d44/d72 39 2024-09-21T08:02:42.485 INFO:tasks.workunit.client.0.smithi107.stdout:1/339: link d0/d19/d2b/d4b/d1c/f3d d0/d19/d2b/d4b/d44/d72/f78 0 2024-09-21T08:02:42.485 INFO:tasks.workunit.client.0.smithi107.stdout:1/340: chown d0/d19/d2b/d4b/d61 1 1 2024-09-21T08:02:42.487 INFO:tasks.workunit.client.0.smithi107.stdout:6/363: dwrite d2/d3/d7/d24/f4a [0,4194304] 0 2024-09-21T08:02:42.488 INFO:tasks.workunit.client.0.smithi107.stdout:6/364: write d2/d3/d7/d3f/f6c [325993,77185] 0 2024-09-21T08:02:42.489 INFO:tasks.workunit.client.0.smithi107.stdout:6/365: mknod d2/d3/d7/d2a/c78 0 2024-09-21T08:02:42.489 INFO:tasks.workunit.client.0.smithi107.stdout:1/341: dread d0/f2 [0,4194304] 0 2024-09-21T08:02:42.490 INFO:tasks.workunit.client.0.smithi107.stdout:1/342: rmdir d0/d19/d59 39 2024-09-21T08:02:42.498 INFO:tasks.workunit.client.0.smithi107.stdout:0/345: dwrite d1/d5/d25/d3d/d20/d29/d5c/f5e [0,4194304] 0 2024-09-21T08:02:42.498 INFO:tasks.workunit.client.0.smithi107.stdout:4/304: dwrite dc/fe [0,4194304] 0 2024-09-21T08:02:42.500 INFO:tasks.workunit.client.0.smithi107.stdout:7/271: dwrite d7/d18/f36 [4194304,4194304] 0 2024-09-21T08:02:42.501 INFO:tasks.workunit.client.0.smithi107.stdout:8/240: dwrite d5/d23/f25 [0,4194304] 0 2024-09-21T08:02:42.505 INFO:tasks.workunit.client.0.smithi107.stdout:4/305: dread fa [0,4194304] 0 2024-09-21T08:02:42.508 INFO:tasks.workunit.client.0.smithi107.stdout:6/366: dwrite d2/d3/d7/f15 [0,4194304] 0 2024-09-21T08:02:42.508 INFO:tasks.workunit.client.0.smithi107.stdout:6/367: write d2/d3/d7/d54/f75 [361790,90342] 0 2024-09-21T08:02:42.515 INFO:tasks.workunit.client.0.smithi107.stdout:7/272: rmdir d7/d22/d37 39 2024-09-21T08:02:42.515 INFO:tasks.workunit.client.0.smithi107.stdout:2/252: rmdir d1/d16 39 2024-09-21T08:02:42.515 INFO:tasks.workunit.client.0.smithi107.stdout:2/253: write d1/d16/d35/f3f [1006614,47990] 0 2024-09-21T08:02:42.515 INFO:tasks.workunit.client.0.smithi107.stdout:2/254: chown d1/d16/d35/f58 2309 1 2024-09-21T08:02:42.517 INFO:tasks.workunit.client.0.smithi107.stdout:4/306: mkdir dc/d60 0 2024-09-21T08:02:42.518 INFO:tasks.workunit.client.0.smithi107.stdout:4/307: dread dc/f50 [0,4194304] 0 2024-09-21T08:02:42.520 INFO:tasks.workunit.client.0.smithi107.stdout:7/273: mkdir d7/d10/d64 0 2024-09-21T08:02:42.521 INFO:tasks.workunit.client.0.smithi107.stdout:7/274: getdents d7/d22/d3a 0 2024-09-21T08:02:42.521 INFO:tasks.workunit.client.0.smithi107.stdout:7/275: write d7/d22/f5c [2469439,69477] 0 2024-09-21T08:02:42.523 INFO:tasks.workunit.client.0.smithi107.stdout:4/308: dread fa [0,4194304] 0 2024-09-21T08:02:42.523 INFO:tasks.workunit.client.0.smithi107.stdout:4/309: write dc/d13/f18 [4373133,8557] 0 2024-09-21T08:02:42.523 INFO:tasks.workunit.client.0.smithi107.stdout:1/343: rmdir d0/d19/d2b/d4b/d1c 39 2024-09-21T08:02:42.523 INFO:tasks.workunit.client.0.smithi107.stdout:1/344: write d0/d19/f58 [900160,57496] 0 2024-09-21T08:02:42.523 INFO:tasks.workunit.client.0.smithi107.stdout:1/345: fdatasync d0/f2 0 2024-09-21T08:02:42.526 INFO:tasks.workunit.client.0.smithi107.stdout:7/276: dread d7/d10/f17 [0,4194304] 0 2024-09-21T08:02:42.531 INFO:tasks.workunit.client.0.smithi107.stdout:2/255: write d1/d16/f3b [4128193,48128] 0 2024-09-21T08:02:42.532 INFO:tasks.workunit.client.0.smithi107.stdout:2/256: creat d1/d16/d35/f59 x:0 0 0 2024-09-21T08:02:42.533 INFO:tasks.workunit.client.0.smithi107.stdout:2/257: truncate d1/d1e/f3e 874510 0 2024-09-21T08:02:42.533 INFO:tasks.workunit.client.0.smithi107.stdout:2/258: chown d1/d16 1863037 1 2024-09-21T08:02:42.534 INFO:tasks.workunit.client.0.smithi107.stdout:2/259: mknod d1/d1e/d23/d37/c5a 0 2024-09-21T08:02:42.534 INFO:tasks.workunit.client.0.smithi107.stdout:9/338: sync 2024-09-21T08:02:42.534 INFO:tasks.workunit.client.0.smithi107.stdout:2/260: write d1/d16/d35/f59 [104139,128721] 0 2024-09-21T08:02:42.536 INFO:tasks.workunit.client.0.smithi107.stdout:9/339: getdents d11/d27/d2a 0 2024-09-21T08:02:42.542 INFO:tasks.workunit.client.0.smithi107.stdout:9/340: unlink d11/d24/c30 0 2024-09-21T08:02:42.542 INFO:tasks.workunit.client.0.smithi107.stdout:9/341: write d11/f5f [910850,53797] 0 2024-09-21T08:02:42.542 INFO:tasks.workunit.client.0.smithi107.stdout:9/342: mknod d11/d27/d2f/d4d/d5c/c78 0 2024-09-21T08:02:42.543 INFO:tasks.workunit.client.0.smithi107.stdout:9/343: getdents d11/d27/d5e 0 2024-09-21T08:02:42.543 INFO:tasks.workunit.client.0.smithi107.stdout:0/346: dwrite d1/d5/d25/d3d/d20/f63 [0,4194304] 0 2024-09-21T08:02:42.544 INFO:tasks.workunit.client.0.smithi107.stdout:8/241: dwrite d5/fd [0,4194304] 0 2024-09-21T08:02:42.544 INFO:tasks.workunit.client.0.smithi107.stdout:6/368: dwrite d2/d3/d7/d3f/f5b [0,4194304] 0 2024-09-21T08:02:42.544 INFO:tasks.workunit.client.0.smithi107.stdout:8/242: creat d5/d1d/f5b x:0 0 0 2024-09-21T08:02:42.544 INFO:tasks.workunit.client.0.smithi107.stdout:6/369: write d2/d3/d7/f11 [2079447,86131] 0 2024-09-21T08:02:42.545 INFO:tasks.workunit.client.0.smithi107.stdout:9/344: rename d11/d27/d39/l62 to d11/d27/d2f/l79 0 2024-09-21T08:02:42.546 INFO:tasks.workunit.client.0.smithi107.stdout:7/277: fdatasync d7/f13 0 2024-09-21T08:02:42.546 INFO:tasks.workunit.client.0.smithi107.stdout:7/278: chown d7/d22/l2a 10603 1 2024-09-21T08:02:42.546 INFO:tasks.workunit.client.0.smithi107.stdout:3/298: sync 2024-09-21T08:02:42.547 INFO:tasks.workunit.client.0.smithi107.stdout:4/310: dwrite dc/f3f [0,4194304] 0 2024-09-21T08:02:42.547 INFO:tasks.workunit.client.0.smithi107.stdout:4/311: chown dc/d13/l24 92542322 1 2024-09-21T08:02:42.551 INFO:tasks.workunit.client.0.smithi107.stdout:5/419: sync 2024-09-21T08:02:42.551 INFO:tasks.workunit.client.0.smithi107.stdout:5/420: readlink d7/de/d52/l54 0 2024-09-21T08:02:42.551 INFO:tasks.workunit.client.0.smithi107.stdout:2/261: dwrite d1/d16/d35/f58 [0,4194304] 0 2024-09-21T08:02:42.551 INFO:tasks.workunit.client.0.smithi107.stdout:2/262: chown d1/d2 3972215 1 2024-09-21T08:02:42.561 INFO:tasks.workunit.client.0.smithi107.stdout:8/243: truncate d5/d2e/f4b 821128 0 2024-09-21T08:02:42.561 INFO:tasks.workunit.client.0.smithi107.stdout:8/244: chown d5/d44/d46/f53 3 1 2024-09-21T08:02:42.563 INFO:tasks.workunit.client.0.smithi107.stdout:8/245: write d5/f45 [145086,48915] 0 2024-09-21T08:02:42.563 INFO:tasks.workunit.client.0.smithi107.stdout:8/246: chown d5/d40/f43 98647 1 2024-09-21T08:02:42.563 INFO:tasks.workunit.client.0.smithi107.stdout:3/299: dread d8/d21/f24 [0,4194304] 0 2024-09-21T08:02:42.563 INFO:tasks.workunit.client.0.smithi107.stdout:6/370: mkdir d2/d3/d7/d79 0 2024-09-21T08:02:42.564 INFO:tasks.workunit.client.0.smithi107.stdout:7/279: dread d7/d22/d3b/f47 [0,4194304] 0 2024-09-21T08:02:42.564 INFO:tasks.workunit.client.0.smithi107.stdout:7/280: read - d7/d22/d3d/f51 zero size 2024-09-21T08:02:42.564 INFO:tasks.workunit.client.0.smithi107.stdout:7/281: read d7/d10/d28/f2f [1166375,74074] 0 2024-09-21T08:02:42.565 INFO:tasks.workunit.client.0.smithi107.stdout:9/345: mknod d11/d24/d26/c7a 0 2024-09-21T08:02:42.567 INFO:tasks.workunit.client.0.smithi107.stdout:4/312: link dc/d13/f35 dc/d13/d40/d5e/f61 0 2024-09-21T08:02:42.570 INFO:tasks.workunit.client.0.smithi107.stdout:8/247: stat d5/d23/c2d 0 2024-09-21T08:02:42.571 INFO:tasks.workunit.client.0.smithi107.stdout:5/421: dwrite d7/de/d1d/d24/f8c [0,4194304] 0 2024-09-21T08:02:42.572 INFO:tasks.workunit.client.0.smithi107.stdout:3/300: creat d8/d25/d42/f5f x:0 0 0 2024-09-21T08:02:42.574 INFO:tasks.workunit.client.0.smithi107.stdout:6/371: symlink d2/d3/d7/d54/l7a 0 2024-09-21T08:02:42.574 INFO:tasks.workunit.client.0.smithi107.stdout:6/372: dread - d2/d3/d7/d23/d2b/f74 zero size 2024-09-21T08:02:42.575 INFO:tasks.workunit.client.0.smithi107.stdout:7/282: mknod d7/d22/d37/d4b/d4e/d4f/c65 0 2024-09-21T08:02:42.575 INFO:tasks.workunit.client.0.smithi107.stdout:7/283: stat d7/f13 0 2024-09-21T08:02:42.575 INFO:tasks.workunit.client.0.smithi107.stdout:7/284: creat d7/d22/d37/d5a/f66 x:0 0 0 2024-09-21T08:02:42.575 INFO:tasks.workunit.client.0.smithi107.stdout:7/285: stat d7/d22/l23 0 2024-09-21T08:02:42.579 INFO:tasks.workunit.client.0.smithi107.stdout:9/346: rmdir d11/d27/d5e/d76 39 2024-09-21T08:02:42.580 INFO:tasks.workunit.client.0.smithi107.stdout:5/422: link d7/d70/l80 d7/de/d2d/d5d/d60/l95 0 2024-09-21T08:02:42.582 INFO:tasks.workunit.client.0.smithi107.stdout:0/347: dwrite d1/d5/d25/f4d [0,4194304] 0 2024-09-21T08:02:42.585 INFO:tasks.workunit.client.0.smithi107.stdout:1/346: dwrite d0/d19/f58 [0,4194304] 0 2024-09-21T08:02:42.585 INFO:tasks.workunit.client.0.smithi107.stdout:1/347: readlink d0/d19/d39/l62 0 2024-09-21T08:02:42.586 INFO:tasks.workunit.client.0.smithi107.stdout:9/347: symlink d11/d27/d2f/l7b 0 2024-09-21T08:02:42.586 INFO:tasks.workunit.client.0.smithi107.stdout:9/348: write d11/d24/d35/f6f [517093,49895] 0 2024-09-21T08:02:42.586 INFO:tasks.workunit.client.0.smithi107.stdout:9/349: creat d11/d27/d39/f7c x:0 0 0 2024-09-21T08:02:42.586 INFO:tasks.workunit.client.0.smithi107.stdout:9/350: creat d11/d27/d2f/f7d x:0 0 0 2024-09-21T08:02:42.586 INFO:tasks.workunit.client.0.smithi107.stdout:3/301: write d8/d14/f54 [741227,94384] 0 2024-09-21T08:02:42.587 INFO:tasks.workunit.client.0.smithi107.stdout:4/313: write dc/d13/f18 [797953,124800] 0 2024-09-21T08:02:42.587 INFO:tasks.workunit.client.0.smithi107.stdout:4/314: fsync dc/d13/d40/f42 0 2024-09-21T08:02:42.588 INFO:tasks.workunit.client.0.smithi107.stdout:8/248: dread d5/d23/f25 [0,4194304] 0 2024-09-21T08:02:42.588 INFO:tasks.workunit.client.0.smithi107.stdout:6/373: getdents d2/d3/d7/d3f 0 2024-09-21T08:02:42.588 INFO:tasks.workunit.client.0.smithi107.stdout:6/374: chown d2/d3/d7/d54/d5c/f62 3512229 1 2024-09-21T08:02:42.588 INFO:tasks.workunit.client.0.smithi107.stdout:6/375: fdatasync d2/d3/d7/d23/d2b/f74 0 2024-09-21T08:02:42.589 INFO:tasks.workunit.client.0.smithi107.stdout:5/423: dread d7/de/d35/f42 [0,4194304] 0 2024-09-21T08:02:42.589 INFO:tasks.workunit.client.0.smithi107.stdout:5/424: truncate d7/de/d1d/d24/f4f 520432 0 2024-09-21T08:02:42.589 INFO:tasks.workunit.client.0.smithi107.stdout:5/425: truncate d7/de/d1d/d24/f4f 683653 0 2024-09-21T08:02:42.592 INFO:tasks.workunit.client.0.smithi107.stdout:2/263: dwrite d1/d16/f55 [0,4194304] 0 2024-09-21T08:02:42.593 INFO:tasks.workunit.client.0.smithi107.stdout:0/348: mkdir d1/d5/d75 0 2024-09-21T08:02:42.594 INFO:tasks.workunit.client.0.smithi107.stdout:8/249: dread d5/d1d/f3a [0,4194304] 0 2024-09-21T08:02:42.596 INFO:tasks.workunit.client.0.smithi107.stdout:1/348: symlink d0/d19/d2b/d4b/d44/d72/d36/l79 0 2024-09-21T08:02:42.600 INFO:tasks.workunit.client.0.smithi107.stdout:9/351: creat d11/d27/d2f/d4d/d5c/d61/f7e x:0 0 0 2024-09-21T08:02:42.603 INFO:tasks.workunit.client.0.smithi107.stdout:0/349: write d1/d23/f3a [1779660,695] 0 2024-09-21T08:02:42.603 INFO:tasks.workunit.client.0.smithi107.stdout:0/350: fdatasync d1/d23/f3f 0 2024-09-21T08:02:42.603 INFO:tasks.workunit.client.0.smithi107.stdout:3/302: truncate d8/d14/d1d/f1f 148928 0 2024-09-21T08:02:42.610 INFO:tasks.workunit.client.0.smithi107.stdout:2/264: dwrite d1/f10 [0,4194304] 0 2024-09-21T08:02:42.612 INFO:tasks.workunit.client.0.smithi107.stdout:6/376: creat d2/d3/d7/d3f/f7b x:0 0 0 2024-09-21T08:02:42.614 INFO:tasks.workunit.client.0.smithi107.stdout:9/352: write d11/d27/d39/f54 [1839049,109239] 0 2024-09-21T08:02:42.620 INFO:tasks.workunit.client.0.smithi107.stdout:3/303: dwrite d8/d14/d1d/f5c [0,4194304] 0 2024-09-21T08:02:42.622 INFO:tasks.workunit.client.0.smithi107.stdout:8/250: unlink d5/d38/d56/d52/c5a 0 2024-09-21T08:02:42.622 INFO:tasks.workunit.client.0.smithi107.stdout:6/377: write d2/d3/d7/d24/f4a [2878284,78358] 0 2024-09-21T08:02:42.625 INFO:tasks.workunit.client.0.smithi107.stdout:0/351: mknod d1/d5/d25/d2d/c76 0 2024-09-21T08:02:42.625 INFO:tasks.workunit.client.0.smithi107.stdout:0/352: chown d1/f4c 231 1 2024-09-21T08:02:42.625 INFO:tasks.workunit.client.0.smithi107.stdout:0/353: fsync d1/d5/f24 0 2024-09-21T08:02:42.627 INFO:tasks.workunit.client.0.smithi107.stdout:4/315: getdents dc 0 2024-09-21T08:02:42.627 INFO:tasks.workunit.client.0.smithi107.stdout:4/316: fdatasync dc/d13/d40/d5e/f61 0 2024-09-21T08:02:42.627 INFO:tasks.workunit.client.0.smithi107.stdout:4/317: stat dc/d13/c1f 0 2024-09-21T08:02:42.627 INFO:tasks.workunit.client.0.smithi107.stdout:4/318: readlink dc/l3d 0 2024-09-21T08:02:42.627 INFO:tasks.workunit.client.0.smithi107.stdout:4/319: chown dc/d13/f18 84 1 2024-09-21T08:02:42.631 INFO:tasks.workunit.client.0.smithi107.stdout:9/353: mkdir d11/d27/d2a/d7f 0 2024-09-21T08:02:42.635 INFO:tasks.workunit.client.0.smithi107.stdout:3/304: symlink d8/l60 0 2024-09-21T08:02:42.635 INFO:tasks.workunit.client.0.smithi107.stdout:3/305: stat d8/d14/d1d/f3a 0 2024-09-21T08:02:42.636 INFO:tasks.workunit.client.0.smithi107.stdout:8/251: creat d5/f5c x:0 0 0 2024-09-21T08:02:42.637 INFO:tasks.workunit.client.0.smithi107.stdout:8/252: write d5/f5c [273665,130109] 0 2024-09-21T08:02:42.639 INFO:tasks.workunit.client.0.smithi107.stdout:6/378: symlink d2/d3/d7/d79/l7c 0 2024-09-21T08:02:42.642 INFO:tasks.workunit.client.0.smithi107.stdout:0/354: creat d1/d5/d25/f77 x:0 0 0 2024-09-21T08:02:42.642 INFO:tasks.workunit.client.0.smithi107.stdout:0/355: creat d1/d5/f78 x:0 0 0 2024-09-21T08:02:42.643 INFO:tasks.workunit.client.0.smithi107.stdout:4/320: mknod dc/d13/d40/c62 0 2024-09-21T08:02:42.650 INFO:tasks.workunit.client.0.smithi107.stdout:2/265: rmdir d1 39 2024-09-21T08:02:42.650 INFO:tasks.workunit.client.0.smithi107.stdout:2/266: stat d1/d16/f3b 0 2024-09-21T08:02:42.651 INFO:tasks.workunit.client.0.smithi107.stdout:9/354: mknod d11/d27/c80 0 2024-09-21T08:02:42.652 INFO:tasks.workunit.client.0.smithi107.stdout:3/306: mknod d8/d14/d1d/c61 0 2024-09-21T08:02:42.653 INFO:tasks.workunit.client.0.smithi107.stdout:8/253: mkdir d5/d44/d5d 0 2024-09-21T08:02:42.654 INFO:tasks.workunit.client.0.smithi107.stdout:6/379: mknod d2/d3/d7/d3f/c7d 0 2024-09-21T08:02:42.656 INFO:tasks.workunit.client.0.smithi107.stdout:6/380: dread d2/d3/f9 [0,4194304] 0 2024-09-21T08:02:42.657 INFO:tasks.workunit.client.0.smithi107.stdout:0/356: mkdir d1/d5/d79 0 2024-09-21T08:02:42.658 INFO:tasks.workunit.client.0.smithi107.stdout:4/321: mkdir dc/d13/d40/d46/d48/d63 0 2024-09-21T08:02:42.658 INFO:tasks.workunit.client.0.smithi107.stdout:4/322: write dc/f2c [723118,12164] 0 2024-09-21T08:02:42.659 INFO:tasks.workunit.client.0.smithi107.stdout:4/323: stat dc/c33 0 2024-09-21T08:02:42.660 INFO:tasks.workunit.client.0.smithi107.stdout:2/267: unlink d1/d1e/l2b 0 2024-09-21T08:02:42.661 INFO:tasks.workunit.client.0.smithi107.stdout:9/355: creat d11/d27/d2a/d34/f81 x:0 0 0 2024-09-21T08:02:42.661 INFO:tasks.workunit.client.0.smithi107.stdout:9/356: dread - d11/d27/d39/f6c zero size 2024-09-21T08:02:42.663 INFO:tasks.workunit.client.0.smithi107.stdout:3/307: creat d8/d44/f62 x:0 0 0 2024-09-21T08:02:42.665 INFO:tasks.workunit.client.0.smithi107.stdout:0/357: mkdir d1/d5/d25/d3d/d20/d29/d55/d7a 0 2024-09-21T08:02:42.665 INFO:tasks.workunit.client.0.smithi107.stdout:0/358: stat d1/d23/f3a 0 2024-09-21T08:02:42.665 INFO:tasks.workunit.client.0.smithi107.stdout:0/359: truncate d1/d5/d25/f77 681000 0 2024-09-21T08:02:42.665 INFO:tasks.workunit.client.0.smithi107.stdout:0/360: chown d1/d23/c6b 154627493 1 2024-09-21T08:02:42.665 INFO:tasks.workunit.client.0.smithi107.stdout:0/361: dread - d1/d5/f5d zero size 2024-09-21T08:02:42.665 INFO:tasks.workunit.client.0.smithi107.stdout:0/362: readlink d1/d23/l56 0 2024-09-21T08:02:42.665 INFO:tasks.workunit.client.0.smithi107.stdout:0/363: creat d1/d5/d25/d2d/f7b x:0 0 0 2024-09-21T08:02:42.666 INFO:tasks.workunit.client.0.smithi107.stdout:4/324: mkdir dc/d64 0 2024-09-21T08:02:42.666 INFO:tasks.workunit.client.0.smithi107.stdout:4/325: write dc/d13/f58 [1893982,55242] 0 2024-09-21T08:02:42.666 INFO:tasks.workunit.client.0.smithi107.stdout:2/268: creat d1/d1e/d23/f5b x:0 0 0 2024-09-21T08:02:42.669 INFO:tasks.workunit.client.0.smithi107.stdout:3/308: rename d8/fe to d8/d57/d5d/f63 0 2024-09-21T08:02:42.671 INFO:tasks.workunit.client.0.smithi107.stdout:0/364: getdents d1/d23/d61 0 2024-09-21T08:02:42.671 INFO:tasks.workunit.client.0.smithi107.stdout:0/365: chown d1/d5/c38 34730 1 2024-09-21T08:02:42.671 INFO:tasks.workunit.client.0.smithi107.stdout:4/326: rmdir dc/d13/d5a 39 2024-09-21T08:02:42.671 INFO:tasks.workunit.client.0.smithi107.stdout:4/327: readlink dc/l22 0 2024-09-21T08:02:42.671 INFO:tasks.workunit.client.0.smithi107.stdout:4/328: fdatasync dc/d4c/f4d 0 2024-09-21T08:02:42.673 INFO:tasks.workunit.client.0.smithi107.stdout:2/269: creat d1/d1e/f5c x:0 0 0 2024-09-21T08:02:42.673 INFO:tasks.workunit.client.0.smithi107.stdout:9/357: dread d11/d24/d35/f4e [0,4194304] 0 2024-09-21T08:02:42.674 INFO:tasks.workunit.client.0.smithi107.stdout:0/366: unlink d1/c36 0 2024-09-21T08:02:42.674 INFO:tasks.workunit.client.0.smithi107.stdout:0/367: readlink d1/d5/d25/d2d/l60 0 2024-09-21T08:02:42.674 INFO:tasks.workunit.client.0.smithi107.stdout:0/368: truncate d1/f4c 485062 0 2024-09-21T08:02:42.675 INFO:tasks.workunit.client.0.smithi107.stdout:0/369: dread - d1/d5/d25/d3d/d20/f6c zero size 2024-09-21T08:02:42.675 INFO:tasks.workunit.client.0.smithi107.stdout:2/270: creat d1/d1e/d23/d42/f5d x:0 0 0 2024-09-21T08:02:42.677 INFO:tasks.workunit.client.0.smithi107.stdout:0/370: unlink d1/d5/d25/c1b 0 2024-09-21T08:02:42.677 INFO:tasks.workunit.client.0.smithi107.stdout:0/371: chown d1/d23/f2a 2771 1 2024-09-21T08:02:42.677 INFO:tasks.workunit.client.0.smithi107.stdout:0/372: write d1/d23/f26 [4712902,101867] 0 2024-09-21T08:02:42.678 INFO:tasks.workunit.client.0.smithi107.stdout:0/373: chown d1/d5/d25/d3d/f1f 0 1 2024-09-21T08:02:42.678 INFO:tasks.workunit.client.0.smithi107.stdout:0/374: stat d1/d5/d25/d2d/f2f 0 2024-09-21T08:02:42.679 INFO:tasks.workunit.client.0.smithi107.stdout:2/271: rename d1/d1e/d23/d42/f5d to d1/d1e/d23/d37/d49/f5e 0 2024-09-21T08:02:42.679 INFO:tasks.workunit.client.0.smithi107.stdout:2/272: creat d1/d1e/d23/f5f x:0 0 0 2024-09-21T08:02:42.679 INFO:tasks.workunit.client.0.smithi107.stdout:4/329: dread dc/d13/d40/f52 [0,4194304] 0 2024-09-21T08:02:42.679 INFO:tasks.workunit.client.0.smithi107.stdout:4/330: chown dc/f1e 2296 1 2024-09-21T08:02:42.680 INFO:tasks.workunit.client.0.smithi107.stdout:3/309: dread d8/d21/f24 [0,4194304] 0 2024-09-21T08:02:42.680 INFO:tasks.workunit.client.0.smithi107.stdout:3/310: creat d8/d44/f64 x:0 0 0 2024-09-21T08:02:42.680 INFO:tasks.workunit.client.0.smithi107.stdout:8/254: dwrite d5/d23/f57 [0,4194304] 0 2024-09-21T08:02:42.681 INFO:tasks.workunit.client.0.smithi107.stdout:0/375: rename d1/d5/d25/d2d/f5f to d1/d5/d75/f7c 0 2024-09-21T08:02:42.681 INFO:tasks.workunit.client.0.smithi107.stdout:0/376: creat d1/d5/d25/d3d/d20/f7d x:0 0 0 2024-09-21T08:02:42.681 INFO:tasks.workunit.client.0.smithi107.stdout:6/381: dwrite d2/d3/d7/d24/d41/d50/f57 [0,4194304] 0 2024-09-21T08:02:42.683 INFO:tasks.workunit.client.0.smithi107.stdout:2/273: creat d1/d16/f60 x:0 0 0 2024-09-21T08:02:42.683 INFO:tasks.workunit.client.0.smithi107.stdout:2/274: creat d1/d16/f61 x:0 0 0 2024-09-21T08:02:42.683 INFO:tasks.workunit.client.0.smithi107.stdout:2/275: truncate d1/d1e/f3e 1396724 0 2024-09-21T08:02:42.685 INFO:tasks.workunit.client.0.smithi107.stdout:3/311: creat d8/d57/d5d/f65 x:0 0 0 2024-09-21T08:02:42.689 INFO:tasks.workunit.client.0.smithi107.stdout:8/255: mkdir d5/d44/d47/d5e 0 2024-09-21T08:02:42.690 INFO:tasks.workunit.client.0.smithi107.stdout:9/358: dwrite d11/d27/d2f/f7d [0,4194304] 0 2024-09-21T08:02:42.692 INFO:tasks.workunit.client.0.smithi107.stdout:6/382: read d2/d3/d7/d48/f5d [2721467,85989] 0 2024-09-21T08:02:42.692 INFO:tasks.workunit.client.0.smithi107.stdout:6/383: write d2/d3/d7/d23/f35 [1169325,58213] 0 2024-09-21T08:02:42.694 INFO:tasks.workunit.client.0.smithi107.stdout:2/276: mknod d1/c62 0 2024-09-21T08:02:42.695 INFO:tasks.workunit.client.0.smithi107.stdout:6/384: dread d2/d3/d7/d24/f2c [0,4194304] 0 2024-09-21T08:02:42.696 INFO:tasks.workunit.client.0.smithi107.stdout:8/256: mknod d5/d40/c5f 0 2024-09-21T08:02:42.698 INFO:tasks.workunit.client.0.smithi107.stdout:3/312: dread d8/d2b/f3b [0,4194304] 0 2024-09-21T08:02:42.703 INFO:tasks.workunit.client.0.smithi107.stdout:2/277: symlink d1/d6/l63 0 2024-09-21T08:02:42.704 INFO:tasks.workunit.client.0.smithi107.stdout:2/278: read d1/d16/f3b [635139,48636] 0 2024-09-21T08:02:42.705 INFO:tasks.workunit.client.0.smithi107.stdout:6/385: mknod d2/d3/d7/d3f/c7e 0 2024-09-21T08:02:42.710 INFO:tasks.workunit.client.0.smithi107.stdout:3/313: creat d8/d57/f66 x:0 0 0 2024-09-21T08:02:42.712 INFO:tasks.workunit.client.0.smithi107.stdout:9/359: symlink d11/d27/d2a/d34/l82 0 2024-09-21T08:02:42.714 INFO:tasks.workunit.client.0.smithi107.stdout:6/386: mkdir d2/d3/d7/d24/d7f 0 2024-09-21T08:02:42.714 INFO:tasks.workunit.client.0.smithi107.stdout:6/387: write d2/d3/d7/f42 [5187570,103456] 0 2024-09-21T08:02:42.715 INFO:tasks.workunit.client.0.smithi107.stdout:8/257: symlink d5/l60 0 2024-09-21T08:02:42.717 INFO:tasks.workunit.client.0.smithi107.stdout:8/258: read d5/d1d/f3a [437583,8940] 0 2024-09-21T08:02:42.717 INFO:tasks.workunit.client.0.smithi107.stdout:8/259: fdatasync d5/d1d/f4d 0 2024-09-21T08:02:42.717 INFO:tasks.workunit.client.0.smithi107.stdout:9/360: symlink d11/d27/d2f/l83 0 2024-09-21T08:02:42.717 INFO:tasks.workunit.client.0.smithi107.stdout:9/361: truncate d11/d27/d5e/d76/f6a 136530 0 2024-09-21T08:02:42.718 INFO:tasks.workunit.client.0.smithi107.stdout:2/279: rename d1/d16/c36 to d1/d1e/d23/d42/c64 0 2024-09-21T08:02:42.719 INFO:tasks.workunit.client.0.smithi107.stdout:6/388: mknod d2/d3/d7/d23/c80 0 2024-09-21T08:02:42.720 INFO:tasks.workunit.client.0.smithi107.stdout:8/260: creat d5/f61 x:0 0 0 2024-09-21T08:02:42.721 INFO:tasks.workunit.client.0.smithi107.stdout:9/362: symlink d11/d27/d5e/l84 0 2024-09-21T08:02:42.721 INFO:tasks.workunit.client.0.smithi107.stdout:2/280: getdents d1/d1e/d23/d37 0 2024-09-21T08:02:42.722 INFO:tasks.workunit.client.0.smithi107.stdout:6/389: truncate d2/d3/d7/f1f 3765848 0 2024-09-21T08:02:42.723 INFO:tasks.workunit.client.0.smithi107.stdout:6/390: write d2/d3/d7/f11 [1034704,104148] 0 2024-09-21T08:02:42.723 INFO:tasks.workunit.client.0.smithi107.stdout:6/391: chown d2/fe 372934 1 2024-09-21T08:02:42.724 INFO:tasks.workunit.client.0.smithi107.stdout:8/261: creat d5/d38/d56/d54/f62 x:0 0 0 2024-09-21T08:02:42.724 INFO:tasks.workunit.client.0.smithi107.stdout:8/262: fdatasync d5/d1d/f4d 0 2024-09-21T08:02:42.726 INFO:tasks.workunit.client.0.smithi107.stdout:2/281: rename d1/d1e/d23/d37/f54 to d1/d1e/d23/d37/f65 0 2024-09-21T08:02:42.726 INFO:tasks.workunit.client.0.smithi107.stdout:3/314: dwrite d8/d25/d3d/f51 [0,4194304] 0 2024-09-21T08:02:42.727 INFO:tasks.workunit.client.0.smithi107.stdout:8/263: mknod d5/d44/d46/c63 0 2024-09-21T08:02:42.729 INFO:tasks.workunit.client.0.smithi107.stdout:2/282: creat d1/d6/f66 x:0 0 0 2024-09-21T08:02:42.729 INFO:tasks.workunit.client.0.smithi107.stdout:2/283: write d1/f31 [189075,101229] 0 2024-09-21T08:02:42.732 INFO:tasks.workunit.client.0.smithi107.stdout:3/315: mkdir d8/d57/d5d/d67 0 2024-09-21T08:02:42.732 INFO:tasks.workunit.client.0.smithi107.stdout:3/316: chown d8/d21/f24 52507089 1 2024-09-21T08:02:42.737 INFO:tasks.workunit.client.0.smithi107.stdout:2/284: rename d1/d16/l2c to d1/l67 0 2024-09-21T08:02:42.739 INFO:tasks.workunit.client.0.smithi107.stdout:3/317: creat d8/d2b/d52/f68 x:0 0 0 2024-09-21T08:02:42.739 INFO:tasks.workunit.client.0.smithi107.stdout:3/318: read - d8/d44/f64 zero size 2024-09-21T08:02:42.739 INFO:tasks.workunit.client.0.smithi107.stdout:3/319: chown d8/f41 4916530 1 2024-09-21T08:02:42.748 INFO:tasks.workunit.client.0.smithi107.stdout:6/392: dwrite d2/d3/d7/d24/d41/d50/f57 [0,4194304] 0 2024-09-21T08:02:42.748 INFO:tasks.workunit.client.0.smithi107.stdout:8/264: rmdir d5 39 2024-09-21T08:02:42.749 INFO:tasks.workunit.client.0.smithi107.stdout:9/363: dwrite d11/d27/d2f/f3b [0,4194304] 0 2024-09-21T08:02:42.761 INFO:tasks.workunit.client.0.smithi107.stdout:3/320: symlink d8/d14/d1d/l69 0 2024-09-21T08:02:42.763 INFO:tasks.workunit.client.0.smithi107.stdout:6/393: symlink d2/d3/l81 0 2024-09-21T08:02:42.763 INFO:tasks.workunit.client.0.smithi107.stdout:6/394: write d2/d3/d7/d24/f25 [8875764,68864] 0 2024-09-21T08:02:42.763 INFO:tasks.workunit.client.0.smithi107.stdout:6/395: truncate d2/d3/d67/f56 621129 0 2024-09-21T08:02:42.763 INFO:tasks.workunit.client.0.smithi107.stdout:6/396: truncate d2/d3/d7/d24/d41/d50/f57 4859946 0 2024-09-21T08:02:42.763 INFO:tasks.workunit.client.0.smithi107.stdout:6/397: chown d2/d3/d7/d23/d2b 66 1 2024-09-21T08:02:42.764 INFO:tasks.workunit.client.0.smithi107.stdout:8/265: symlink d5/d1d/l64 0 2024-09-21T08:02:42.766 INFO:tasks.workunit.client.0.smithi107.stdout:2/285: getdents d1/d6 0 2024-09-21T08:02:42.768 INFO:tasks.workunit.client.0.smithi107.stdout:2/286: dread d1/d16/f41 [0,4194304] 0 2024-09-21T08:02:42.769 INFO:tasks.workunit.client.0.smithi107.stdout:3/321: unlink d8/f41 0 2024-09-21T08:02:42.770 INFO:tasks.workunit.client.0.smithi107.stdout:8/266: creat d5/d38/d56/f65 x:0 0 0 2024-09-21T08:02:42.773 INFO:tasks.workunit.client.0.smithi107.stdout:6/398: write d2/d3/d7/d24/d41/d50/f57 [3209103,98269] 0 2024-09-21T08:02:42.773 INFO:tasks.workunit.client.0.smithi107.stdout:6/399: chown d2/d2e/c64 1030 1 2024-09-21T08:02:42.773 INFO:tasks.workunit.client.0.smithi107.stdout:3/322: rename d8/d57/f66 to d8/d2b/d45/f6a 0 2024-09-21T08:02:42.773 INFO:tasks.workunit.client.0.smithi107.stdout:3/323: creat d8/d21/f6b x:0 0 0 2024-09-21T08:02:42.773 INFO:tasks.workunit.client.0.smithi107.stdout:3/324: creat d8/d21/f6c x:0 0 0 2024-09-21T08:02:42.778 INFO:tasks.workunit.client.0.smithi107.stdout:3/325: rename d8/d2b/d45/l46 to d8/d25/d34/l6d 0 2024-09-21T08:02:42.778 INFO:tasks.workunit.client.0.smithi107.stdout:9/364: dread d11/f21 [0,4194304] 0 2024-09-21T08:02:42.778 INFO:tasks.workunit.client.0.smithi107.stdout:9/365: rename d11/d27 to d11/d27/d2f/d4d/d85 22 2024-09-21T08:02:42.778 INFO:tasks.workunit.client.0.smithi107.stdout:9/366: chown d11/d24/d35/f4e 18396 1 2024-09-21T08:02:42.778 INFO:tasks.workunit.client.0.smithi107.stdout:9/367: chown d11/d24/d26/f2e 2 1 2024-09-21T08:02:42.779 INFO:tasks.workunit.client.0.smithi107.stdout:3/326: mkdir d8/d57/d5d/d6e 0 2024-09-21T08:02:42.780 INFO:tasks.workunit.client.0.smithi107.stdout:2/287: write d1/d16/f55 [678452,24743] 0 2024-09-21T08:02:42.781 INFO:tasks.workunit.client.0.smithi107.stdout:3/327: mknod d8/d25/c6f 0 2024-09-21T08:02:42.781 INFO:tasks.workunit.client.0.smithi107.stdout:3/328: fsync d8/f13 0 2024-09-21T08:02:42.782 INFO:tasks.workunit.client.0.smithi107.stdout:8/267: write d5/d1d/f26 [3981065,39350] 0 2024-09-21T08:02:42.783 INFO:tasks.workunit.client.0.smithi107.stdout:2/288: link d1/d6/f3d d1/d2/f68 0 2024-09-21T08:02:42.785 INFO:tasks.workunit.client.0.smithi107.stdout:8/268: fdatasync d5/d23/f35 0 2024-09-21T08:02:42.786 INFO:tasks.workunit.client.0.smithi107.stdout:2/289: mkdir d1/d1e/d69 0 2024-09-21T08:02:42.786 INFO:tasks.workunit.client.0.smithi107.stdout:2/290: write d1/d1e/d23/d37/f65 [277721,118172] 0 2024-09-21T08:02:42.786 INFO:tasks.workunit.client.0.smithi107.stdout:6/400: dread d2/d3/f5e [0,4194304] 0 2024-09-21T08:02:42.791 INFO:tasks.workunit.client.0.smithi107.stdout:3/329: dread d8/d2b/f3f [0,4194304] 0 2024-09-21T08:02:42.791 INFO:tasks.workunit.client.0.smithi107.stdout:3/330: rmdir d8/d25/d34 39 2024-09-21T08:02:42.792 INFO:tasks.workunit.client.0.smithi107.stdout:3/331: write d8/d2b/f3b [4608796,63062] 0 2024-09-21T08:02:42.792 INFO:tasks.workunit.client.0.smithi107.stdout:3/332: fsync d8/d2b/d52/f68 0 2024-09-21T08:02:42.793 INFO:tasks.workunit.client.0.smithi107.stdout:3/333: creat d8/d2b/d52/d55/f70 x:0 0 0 2024-09-21T08:02:42.794 INFO:tasks.workunit.client.0.smithi107.stdout:3/334: mkdir d8/d2b/d52/d71 0 2024-09-21T08:02:42.794 INFO:tasks.workunit.client.0.smithi107.stdout:3/335: write d8/f1c [89502,15032] 0 2024-09-21T08:02:42.796 INFO:tasks.workunit.client.0.smithi107.stdout:3/336: mkdir d8/d25/d3d/d72 0 2024-09-21T08:02:42.797 INFO:tasks.workunit.client.0.smithi107.stdout:3/337: getdents d8/d14 0 2024-09-21T08:02:42.800 INFO:tasks.workunit.client.0.smithi107.stdout:2/291: dread d1/d1e/d23/d42/f48 [0,4194304] 0 2024-09-21T08:02:42.810 INFO:tasks.workunit.client.0.smithi107.stdout:3/338: read d8/f30 [1230409,46399] 0 2024-09-21T08:02:42.811 INFO:tasks.workunit.client.0.smithi107.stdout:3/339: rename c3 to d8/d2b/d52/d71/c73 0 2024-09-21T08:02:42.812 INFO:tasks.workunit.client.0.smithi107.stdout:3/340: mknod d8/d44/c74 0 2024-09-21T08:02:42.812 INFO:tasks.workunit.client.0.smithi107.stdout:3/341: truncate d8/d21/f6b 726002 0 2024-09-21T08:02:42.812 INFO:tasks.workunit.client.0.smithi107.stdout:3/342: creat d8/d21/f75 x:0 0 0 2024-09-21T08:02:42.812 INFO:tasks.workunit.client.0.smithi107.stdout:3/343: chown d8/d2b/d52/d55/c5b 887398 1 2024-09-21T08:02:42.813 INFO:tasks.workunit.client.0.smithi107.stdout:8/269: dwrite d5/f21 [0,4194304] 0 2024-09-21T08:02:42.814 INFO:tasks.workunit.client.0.smithi107.stdout:8/270: dread - d5/f61 zero size 2024-09-21T08:02:42.814 INFO:tasks.workunit.client.0.smithi107.stdout:3/344: rename d8/d21/f6c to d8/d25/f76 0 2024-09-21T08:02:42.815 INFO:tasks.workunit.client.0.smithi107.stdout:2/292: write d1/d16/f17 [2006623,76816] 0 2024-09-21T08:02:42.815 INFO:tasks.workunit.client.0.smithi107.stdout:8/271: mknod d5/d44/d47/d5e/c66 0 2024-09-21T08:02:42.815 INFO:tasks.workunit.client.0.smithi107.stdout:8/272: readlink d5/d23/l58 0 2024-09-21T08:02:42.815 INFO:tasks.workunit.client.0.smithi107.stdout:6/401: dwrite d2/d3/d7/d24/f59 [0,4194304] 0 2024-09-21T08:02:42.815 INFO:tasks.workunit.client.0.smithi107.stdout:6/402: write d2/d3/d7/f15 [4262583,11330] 0 2024-09-21T08:02:42.816 INFO:tasks.workunit.client.0.smithi107.stdout:8/273: write d5/d38/d56/f65 [696627,93192] 0 2024-09-21T08:02:42.816 INFO:tasks.workunit.client.0.smithi107.stdout:9/368: dwrite d11/d27/d5e/d76/f6a [0,4194304] 0 2024-09-21T08:02:42.816 INFO:tasks.workunit.client.0.smithi107.stdout:9/369: write d11/d24/d4a/f70 [319167,19346] 0 2024-09-21T08:02:42.816 INFO:tasks.workunit.client.0.smithi107.stdout:3/345: link d8/c4b d8/d2b/d52/d71/c77 0 2024-09-21T08:02:42.816 INFO:tasks.workunit.client.0.smithi107.stdout:3/346: fdatasync d8/d21/f36 0 2024-09-21T08:02:42.817 INFO:tasks.workunit.client.0.smithi107.stdout:2/293: mknod d1/d1e/c6a 0 2024-09-21T08:02:42.820 INFO:tasks.workunit.client.0.smithi107.stdout:6/403: rename d2/d3/d7/l1c to d2/d3/d7/d54/l82 0 2024-09-21T08:02:42.821 INFO:tasks.workunit.client.0.smithi107.stdout:8/274: rmdir d5/d44/d47 39 2024-09-21T08:02:42.824 INFO:tasks.workunit.client.0.smithi107.stdout:2/294: write d1/d16/d35/f58 [716555,80454] 0 2024-09-21T08:02:42.824 INFO:tasks.workunit.client.0.smithi107.stdout:2/295: creat d1/d16/f6b x:0 0 0 2024-09-21T08:02:42.824 INFO:tasks.workunit.client.0.smithi107.stdout:2/296: fdatasync d1/d1e/d23/f52 0 2024-09-21T08:02:42.825 INFO:tasks.workunit.client.0.smithi107.stdout:9/370: mknod d11/d27/d2a/c86 0 2024-09-21T08:02:42.826 INFO:tasks.workunit.client.0.smithi107.stdout:3/347: rename d8/l2a to d8/d14/l78 0 2024-09-21T08:02:42.826 INFO:tasks.workunit.client.0.smithi107.stdout:3/348: write d8/d2b/f49 [749525,64791] 0 2024-09-21T08:02:42.827 INFO:tasks.workunit.client.0.smithi107.stdout:6/404: rmdir d2/d3/d7/d24 39 2024-09-21T08:02:42.827 INFO:tasks.workunit.client.0.smithi107.stdout:6/405: truncate d2/d3/d7/d23/d2b/f74 940996 0 2024-09-21T08:02:42.828 INFO:tasks.workunit.client.0.smithi107.stdout:3/349: dread d8/d21/f36 [0,4194304] 0 2024-09-21T08:02:42.831 INFO:tasks.workunit.client.0.smithi107.stdout:9/371: link d11/d24/d26/f2e d11/d27/d2a/f87 0 2024-09-21T08:02:42.832 INFO:tasks.workunit.client.0.smithi107.stdout:8/275: write d5/f21 [1806977,84715] 0 2024-09-21T08:02:42.832 INFO:tasks.workunit.client.0.smithi107.stdout:8/276: fsync d5/d23/f25 0 2024-09-21T08:02:42.833 INFO:tasks.workunit.client.0.smithi107.stdout:8/277: write d5/d44/d47/f4e [712457,47084] 0 2024-09-21T08:02:42.833 INFO:tasks.workunit.client.0.smithi107.stdout:8/278: fsync d5/d23/f2f 0 2024-09-21T08:02:42.834 INFO:tasks.workunit.client.0.smithi107.stdout:6/406: link d2/d3/d7/d54/d5c/c73 d2/d3/d7/d2a/d31/c83 0 2024-09-21T08:02:42.835 INFO:tasks.workunit.client.0.smithi107.stdout:2/297: write d1/d6/f18 [3685968,27827] 0 2024-09-21T08:02:42.835 INFO:tasks.workunit.client.0.smithi107.stdout:2/298: fsync d1/d16/f3b 0 2024-09-21T08:02:42.835 INFO:tasks.workunit.client.0.smithi107.stdout:2/299: creat d1/d1e/d23/f6c x:0 0 0 2024-09-21T08:02:42.835 INFO:tasks.workunit.client.0.smithi107.stdout:2/300: truncate d1/d16/f55 4817665 0 2024-09-21T08:02:42.836 INFO:tasks.workunit.client.0.smithi107.stdout:9/372: rename d11/d27/d2a/l66 to d11/d24/d35/l88 0 2024-09-21T08:02:42.837 INFO:tasks.workunit.client.0.smithi107.stdout:3/350: read d8/f13 [4066016,55708] 0 2024-09-21T08:02:42.838 INFO:tasks.workunit.client.0.smithi107.stdout:8/279: chown d5/lc 28886582 1 2024-09-21T08:02:42.841 INFO:tasks.workunit.client.0.smithi107.stdout:6/407: mkdir d2/d3/d7/d23/d2b/d84 0 2024-09-21T08:02:42.845 INFO:tasks.workunit.client.0.smithi107.stdout:9/373: link d11/d27/d2f/d38/c3f d11/d27/d5b/c89 0 2024-09-21T08:02:42.845 INFO:tasks.workunit.client.0.smithi107.stdout:9/374: chown f7 59440 1 2024-09-21T08:02:42.851 INFO:tasks.workunit.client.0.smithi107.stdout:8/280: dread d5/d23/f35 [0,4194304] 0 2024-09-21T08:02:42.855 INFO:tasks.workunit.client.0.smithi107.stdout:9/375: creat d11/d27/d5e/d76/f8a x:0 0 0 2024-09-21T08:02:42.857 INFO:tasks.workunit.client.0.smithi107.stdout:8/281: mkdir d5/d38/d67 0 2024-09-21T08:02:42.867 INFO:tasks.workunit.client.0.smithi107.stdout:9/376: read d11/d27/d2a/f63 [1694519,48362] 0 2024-09-21T08:02:42.868 INFO:tasks.workunit.client.0.smithi107.stdout:9/377: dread d11/d27/d2f/d4d/d5c/d61/f64 [0,4194304] 0 2024-09-21T08:02:42.869 INFO:tasks.workunit.client.0.smithi107.stdout:9/378: mknod d11/d27/c8b 0 2024-09-21T08:02:42.869 INFO:tasks.workunit.client.0.smithi107.stdout:9/379: creat d11/d27/d5e/d76/f8c x:0 0 0 2024-09-21T08:02:42.870 INFO:tasks.workunit.client.0.smithi107.stdout:9/380: unlink d11/d24/c2b 0 2024-09-21T08:02:42.876 INFO:tasks.workunit.client.0.smithi107.stdout:9/381: dread d11/d27/d2f/f3b [0,4194304] 0 2024-09-21T08:02:42.877 INFO:tasks.workunit.client.0.smithi107.stdout:9/382: symlink d11/d27/l8d 0 2024-09-21T08:02:42.877 INFO:tasks.workunit.client.0.smithi107.stdout:9/383: chown l6 5867 1 2024-09-21T08:02:42.877 INFO:tasks.workunit.client.0.smithi107.stdout:9/384: stat d11/d27/c80 0 2024-09-21T08:02:42.878 INFO:tasks.workunit.client.0.smithi107.stdout:9/385: link d11/d27/d5e/d76/f6a d11/d24/d4a/f8e 0 2024-09-21T08:02:42.909 INFO:tasks.workunit.client.0.smithi107.stdout:3/351: dwrite d8/d2b/f3b [0,4194304] 0 2024-09-21T08:02:42.910 INFO:tasks.workunit.client.0.smithi107.stdout:6/408: dwrite d2/d3/d7/d2a/f51 [0,4194304] 0 2024-09-21T08:02:42.910 INFO:tasks.workunit.client.0.smithi107.stdout:3/352: mknod d8/d57/d5d/d67/c79 0 2024-09-21T08:02:42.911 INFO:tasks.workunit.client.0.smithi107.stdout:6/409: getdents d2/d3/d7/d24 0 2024-09-21T08:02:42.912 INFO:tasks.workunit.client.0.smithi107.stdout:2/301: rename d1/d1e/d23 to d1/d2/d6d 0 2024-09-21T08:02:42.918 INFO:tasks.workunit.client.0.smithi107.stdout:8/282: dwrite d5/d1d/f1e [0,4194304] 0 2024-09-21T08:02:42.923 INFO:tasks.workunit.client.0.smithi107.stdout:3/353: read d8/d14/d1d/f5c [1577722,39140] 0 2024-09-21T08:02:42.923 INFO:tasks.workunit.client.0.smithi107.stdout:3/354: chown d8/d14/c5e 120762 1 2024-09-21T08:02:42.930 INFO:tasks.workunit.client.0.smithi107.stdout:6/410: dwrite d2/d3/d7/f1f [0,4194304] 0 2024-09-21T08:02:42.931 INFO:tasks.workunit.client.0.smithi107.stdout:6/411: chown d2/d3/d7/d24/d41/d50/d6e 0 1 2024-09-21T08:02:42.931 INFO:tasks.workunit.client.0.smithi107.stdout:6/412: chown d2/l29 384184537 1 2024-09-21T08:02:42.945 INFO:tasks.workunit.client.0.smithi107.stdout:2/302: link d1/d6/c47 d1/d16/c6e 0 2024-09-21T08:02:42.946 INFO:tasks.workunit.client.0.smithi107.stdout:2/303: fdatasync d1/d2/f34 0 2024-09-21T08:02:42.946 INFO:tasks.workunit.client.0.smithi107.stdout:8/283: creat d5/d44/d5d/f68 x:0 0 0 2024-09-21T08:02:43.080 INFO:tasks.workunit.client.0.smithi107.stdout:6/413: mkdir d2/d3/d7/d24/d41/d50/d6e/d85 0 2024-09-21T08:02:43.080 INFO:tasks.workunit.client.0.smithi107.stdout:6/414: chown d2/d3/d7/d3f 56840 1 2024-09-21T08:02:43.080 INFO:tasks.workunit.client.0.smithi107.stdout:6/415: chown d2/d3/d7/d2a/f51 56688336 1 2024-09-21T08:02:43.085 INFO:tasks.workunit.client.0.smithi107.stdout:8/284: mkdir d5/d23/d69 0 2024-09-21T08:02:43.091 INFO:tasks.workunit.client.0.smithi107.stdout:6/416: mkdir d2/d3/d7/d48/d86 0 2024-09-21T08:02:43.091 INFO:tasks.workunit.client.0.smithi107.stdout:6/417: fsync d2/d3/f4 0 2024-09-21T08:02:43.092 INFO:tasks.workunit.client.0.smithi107.stdout:9/386: rename d11/d27/d2a/d34 to d11/d27/d2f/d4d/d5c/d61/d8f 0 2024-09-21T08:02:43.093 INFO:tasks.workunit.client.0.smithi107.stdout:9/387: truncate d11/d27/d5e/d76/f8a 523760 0 2024-09-21T08:02:43.093 INFO:tasks.workunit.client.0.smithi107.stdout:2/304: unlink d1/d2/d6d/d37/d49/f4b 0 2024-09-21T08:02:43.094 INFO:tasks.workunit.client.0.smithi107.stdout:8/285: creat d5/d44/d46/f6a x:0 0 0 2024-09-21T08:02:43.095 INFO:tasks.workunit.client.0.smithi107.stdout:6/418: mkdir d2/d3/d7/d23/d2b/d87 0 2024-09-21T08:02:43.096 INFO:tasks.workunit.client.0.smithi107.stdout:6/419: chown d2/d2e 230 1 2024-09-21T08:02:43.096 INFO:tasks.workunit.client.0.smithi107.stdout:6/420: creat d2/d3/d7/d2a/d31/f88 x:0 0 0 2024-09-21T08:02:43.099 INFO:tasks.workunit.client.0.smithi107.stdout:8/286: rmdir d5/d38/d56 39 2024-09-21T08:02:43.101 INFO:tasks.workunit.client.0.smithi107.stdout:8/287: symlink d5/d44/d47/d5e/l6b 0 2024-09-21T08:02:43.101 INFO:tasks.workunit.client.0.smithi107.stdout:8/288: dread - d5/d44/d46/f53 zero size 2024-09-21T08:02:43.101 INFO:tasks.workunit.client.0.smithi107.stdout:8/289: getdents d5/d38/d67 0 2024-09-21T08:02:43.101 INFO:tasks.workunit.client.0.smithi107.stdout:8/290: read d5/d23/f3b [2166569,107260] 0 2024-09-21T08:02:43.103 INFO:tasks.workunit.client.0.smithi107.stdout:2/305: dread d1/f10 [0,4194304] 0 2024-09-21T08:02:43.103 INFO:tasks.workunit.client.0.smithi107.stdout:2/306: fsync d1/f10 0 2024-09-21T08:02:43.103 INFO:tasks.workunit.client.0.smithi107.stdout:8/291: rmdir d5/d44/d47/d5e 39 2024-09-21T08:02:43.105 INFO:tasks.workunit.client.0.smithi107.stdout:6/421: read d2/fd [1167690,50781] 0 2024-09-21T08:02:43.105 INFO:tasks.workunit.client.0.smithi107.stdout:6/422: creat d2/d3/d7/d54/d5c/f89 x:0 0 0 2024-09-21T08:02:43.105 INFO:tasks.workunit.client.0.smithi107.stdout:2/307: symlink d1/d1e/l6f 0 2024-09-21T08:02:43.105 INFO:tasks.workunit.client.0.smithi107.stdout:9/388: write d11/f18 [3508305,53232] 0 2024-09-21T08:02:43.108 INFO:tasks.workunit.client.0.smithi107.stdout:2/308: link d1/d1e/c6a d1/d2/c70 0 2024-09-21T08:02:43.110 INFO:tasks.workunit.client.0.smithi107.stdout:6/423: dread d2/d3/d7/d48/f68 [4194304,4194304] 0 2024-09-21T08:02:43.110 INFO:tasks.workunit.client.0.smithi107.stdout:6/424: truncate d2/d3/d7/d2a/d31/f88 831409 0 2024-09-21T08:02:43.110 INFO:tasks.workunit.client.0.smithi107.stdout:9/389: chown d11/f37 1 1 2024-09-21T08:02:43.110 INFO:tasks.workunit.client.0.smithi107.stdout:6/425: creat d2/d3/f8a x:0 0 0 2024-09-21T08:02:43.110 INFO:tasks.workunit.client.0.smithi107.stdout:6/426: creat d2/d3/d7/d2a/f8b x:0 0 0 2024-09-21T08:02:43.111 INFO:tasks.workunit.client.0.smithi107.stdout:6/427: truncate d2/d3/f9 982250 0 2024-09-21T08:02:43.112 INFO:tasks.workunit.client.0.smithi107.stdout:6/428: dread d2/d3/d67/f4e [0,4194304] 0 2024-09-21T08:02:43.112 INFO:tasks.workunit.client.0.smithi107.stdout:2/309: unlink d1/d2/c38 0 2024-09-21T08:02:43.113 INFO:tasks.workunit.client.0.smithi107.stdout:2/310: dread d1/d2/f68 [0,4194304] 0 2024-09-21T08:02:43.113 INFO:tasks.workunit.client.0.smithi107.stdout:2/311: chown d1/d2/d6d/d37 65 1 2024-09-21T08:02:43.114 INFO:tasks.workunit.client.0.smithi107.stdout:9/390: fdatasync d11/f20 0 2024-09-21T08:02:43.118 INFO:tasks.workunit.client.0.smithi107.stdout:2/312: creat d1/d2/d6d/f71 x:0 0 0 2024-09-21T08:02:43.118 INFO:tasks.workunit.client.0.smithi107.stdout:2/313: dread - d1/d6/f2e zero size 2024-09-21T08:02:43.124 INFO:tasks.workunit.client.0.smithi107.stdout:6/429: write d2/fd [5381929,50232] 0 2024-09-21T08:02:43.124 INFO:tasks.workunit.client.0.smithi107.stdout:8/292: dwrite d5/d23/f3b [0,4194304] 0 2024-09-21T08:02:43.124 INFO:tasks.workunit.client.0.smithi107.stdout:8/293: dread - d5/d1d/f5b zero size 2024-09-21T08:02:43.124 INFO:tasks.workunit.client.0.smithi107.stdout:6/430: creat d2/d3/d7/d54/d5c/f8c x:0 0 0 2024-09-21T08:02:43.126 INFO:tasks.workunit.client.0.smithi107.stdout:8/294: getdents d5/d44/d47 0 2024-09-21T08:02:43.127 INFO:tasks.workunit.client.0.smithi107.stdout:6/431: dread d2/d3/f9 [0,4194304] 0 2024-09-21T08:02:43.128 INFO:tasks.workunit.client.0.smithi107.stdout:8/295: rename d5/d40/c5f to d5/d40/c6c 0 2024-09-21T08:02:43.128 INFO:tasks.workunit.client.0.smithi107.stdout:8/296: write d5/d23/f2f [4531248,49112] 0 2024-09-21T08:02:43.131 INFO:tasks.workunit.client.0.smithi107.stdout:8/297: creat d5/d44/d47/d5e/f6d x:0 0 0 2024-09-21T08:02:43.131 INFO:tasks.workunit.client.0.smithi107.stdout:8/298: fdatasync d5/d1d/f4d 0 2024-09-21T08:02:43.131 INFO:tasks.workunit.client.0.smithi107.stdout:8/299: fsync d5/d2e/f4a 0 2024-09-21T08:02:43.131 INFO:tasks.workunit.client.0.smithi107.stdout:8/300: dread - d5/d38/f3f zero size 2024-09-21T08:02:43.135 INFO:tasks.workunit.client.0.smithi107.stdout:7/286: sync 2024-09-21T08:02:43.136 INFO:tasks.workunit.client.0.smithi107.stdout:7/287: creat d7/d22/d3a/f67 x:0 0 0 2024-09-21T08:02:43.137 INFO:tasks.workunit.client.0.smithi107.stdout:9/391: dwrite d11/d27/d2f/d4d/d5c/d61/d8f/f81 [0,4194304] 0 2024-09-21T08:02:43.137 INFO:tasks.workunit.client.0.smithi107.stdout:2/314: dwrite d1/d2/d6d/f5b [0,4194304] 0 2024-09-21T08:02:43.137 INFO:tasks.workunit.client.0.smithi107.stdout:7/288: symlink d7/d22/d37/d4b/l68 0 2024-09-21T08:02:43.138 INFO:tasks.workunit.client.0.smithi107.stdout:6/432: write d2/d3/d7/f8 [3049852,21779] 0 2024-09-21T08:02:43.147 INFO:tasks.workunit.client.0.smithi107.stdout:2/315: link d1/f3 d1/d6/f72 0 2024-09-21T08:02:43.147 INFO:tasks.workunit.client.0.smithi107.stdout:2/316: read - d1/d16/f32 zero size 2024-09-21T08:02:43.149 INFO:tasks.workunit.client.0.smithi107.stdout:7/289: mkdir d7/d10/d28/d69 0 2024-09-21T08:02:43.150 INFO:tasks.workunit.client.0.smithi107.stdout:6/433: getdents d2/d3/d7/d24/d41/d50 0 2024-09-21T08:02:43.150 INFO:tasks.workunit.client.0.smithi107.stdout:6/434: dread - d2/d3/d7/d2a/d31/f6f zero size 2024-09-21T08:02:43.154 INFO:tasks.workunit.client.0.smithi107.stdout:9/392: unlink d11/l67 0 2024-09-21T08:02:43.154 INFO:tasks.workunit.client.0.smithi107.stdout:2/317: dread d1/f33 [0,4194304] 0 2024-09-21T08:02:43.155 INFO:tasks.workunit.client.0.smithi107.stdout:9/393: rename d11/d27/c6d to d11/d27/d2f/c90 0 2024-09-21T08:02:43.156 INFO:tasks.workunit.client.0.smithi107.stdout:2/318: unlink d1/d2/f68 0 2024-09-21T08:02:43.157 INFO:tasks.workunit.client.0.smithi107.stdout:9/394: creat d11/d27/d2f/d4d/d5c/d61/d8f/f91 x:0 0 0 2024-09-21T08:02:43.158 INFO:tasks.workunit.client.0.smithi107.stdout:6/435: dread d2/d3/f14 [0,4194304] 0 2024-09-21T08:02:43.159 INFO:tasks.workunit.client.0.smithi107.stdout:2/319: rename d1/d2/d6d/d42/l56 to d1/d2/d6d/d37/d49/l73 0 2024-09-21T08:02:43.161 INFO:tasks.workunit.client.0.smithi107.stdout:6/436: symlink d2/d3/d7/l8d 0 2024-09-21T08:02:43.161 INFO:tasks.workunit.client.0.smithi107.stdout:6/437: stat d2/c21 0 2024-09-21T08:02:43.168 INFO:tasks.workunit.client.0.smithi107.stdout:9/395: dread f7 [4194304,4194304] 0 2024-09-21T08:02:43.168 INFO:tasks.workunit.client.0.smithi107.stdout:9/396: readlink d11/d27/d2f/d4d/d5c/d61/d8f/l82 0 2024-09-21T08:02:43.168 INFO:tasks.workunit.client.0.smithi107.stdout:9/397: write d11/d27/d2f/d4d/d5c/d61/f7e [153861,126637] 0 2024-09-21T08:02:43.168 INFO:tasks.workunit.client.0.smithi107.stdout:9/398: fdatasync d11/d27/d2f/f3b 0 2024-09-21T08:02:43.169 INFO:tasks.workunit.client.0.smithi107.stdout:9/399: mkdir d11/d27/d2f/d4d/d92 0 2024-09-21T08:02:43.171 INFO:tasks.workunit.client.0.smithi107.stdout:9/400: link d11/d27/d2f/d38/c58 d11/d24/c93 0 2024-09-21T08:02:43.171 INFO:tasks.workunit.client.0.smithi107.stdout:9/401: truncate d11/d27/d2f/f3b 1764986 0 2024-09-21T08:02:43.172 INFO:tasks.workunit.client.0.smithi107.stdout:9/402: creat d11/d24/d6e/f94 x:0 0 0 2024-09-21T08:02:43.183 INFO:tasks.workunit.client.0.smithi107.stdout:9/403: read d11/d24/d4a/f8e [2330195,86263] 0 2024-09-21T08:02:43.184 INFO:tasks.workunit.client.0.smithi107.stdout:6/438: dwrite d2/d3/f4 [4194304,4194304] 0 2024-09-21T08:02:43.185 INFO:tasks.workunit.client.0.smithi107.stdout:2/320: dwrite d1/d16/d35/f58 [0,4194304] 0 2024-09-21T08:02:43.186 INFO:tasks.workunit.client.0.smithi107.stdout:9/404: dread d11/d24/d4a/f70 [0,4194304] 0 2024-09-21T08:02:43.189 INFO:tasks.workunit.client.0.smithi107.stdout:9/405: symlink d11/l95 0 2024-09-21T08:02:43.192 INFO:tasks.workunit.client.0.smithi107.stdout:9/406: rename d11/d27/d2f/d38/l48 to d11/l96 0 2024-09-21T08:02:43.193 INFO:tasks.workunit.client.0.smithi107.stdout:9/407: mkdir d11/d27/d39/d97 0 2024-09-21T08:02:43.208 INFO:tasks.workunit.client.0.smithi107.stdout:9/408: rename d11/d27/d39 to d11/d27/d98 0 2024-09-21T08:02:43.208 INFO:tasks.workunit.client.0.smithi107.stdout:9/409: readlink l6 0 2024-09-21T08:02:43.209 INFO:tasks.workunit.client.0.smithi107.stdout:9/410: mknod d11/d27/d5e/d76/c99 0 2024-09-21T08:02:43.210 INFO:tasks.workunit.client.0.smithi107.stdout:9/411: creat d11/d24/f9a x:0 0 0 2024-09-21T08:02:43.214 INFO:tasks.workunit.client.0.smithi107.stdout:6/439: dwrite d2/d3/d7/d3f/f7b [0,4194304] 0 2024-09-21T08:02:43.214 INFO:tasks.workunit.client.0.smithi107.stdout:6/440: fsync d2/d3/d7/d24/f2d 0 2024-09-21T08:02:43.214 INFO:tasks.workunit.client.0.smithi107.stdout:2/321: dwrite d1/d16/f61 [0,4194304] 0 2024-09-21T08:02:43.216 INFO:tasks.workunit.client.0.smithi107.stdout:9/412: dread d11/d27/d2f/d4d/f59 [0,4194304] 0 2024-09-21T08:02:43.230 INFO:tasks.workunit.client.0.smithi107.stdout:2/322: dwrite d1/d2/d6d/d37/f65 [0,4194304] 0 2024-09-21T08:02:43.231 INFO:tasks.workunit.client.0.smithi107.stdout:6/441: mknod d2/d3/d7/d24/d41/d50/d6e/c8e 0 2024-09-21T08:02:43.233 INFO:tasks.workunit.client.0.smithi107.stdout:0/377: sync 2024-09-21T08:02:43.234 INFO:tasks.workunit.client.0.smithi107.stdout:4/331: sync 2024-09-21T08:02:43.234 INFO:tasks.workunit.client.0.smithi107.stdout:1/349: sync 2024-09-21T08:02:43.234 INFO:tasks.workunit.client.0.smithi107.stdout:4/332: stat dc/d4c/f4d 0 2024-09-21T08:02:43.234 INFO:tasks.workunit.client.0.smithi107.stdout:1/350: write d0/d19/f58 [4915049,90679] 0 2024-09-21T08:02:43.236 INFO:tasks.workunit.client.0.smithi107.stdout:5/426: sync 2024-09-21T08:02:43.236 INFO:tasks.workunit.client.0.smithi107.stdout:3/355: sync 2024-09-21T08:02:43.237 INFO:tasks.workunit.client.0.smithi107.stdout:3/356: read d8/d21/f36 [126407,24064] 0 2024-09-21T08:02:43.244 INFO:tasks.workunit.client.0.smithi107.stdout:2/323: symlink d1/d16/l74 0 2024-09-21T08:02:43.244 INFO:tasks.workunit.client.0.smithi107.stdout:2/324: write d1/d2/d6d/f6c [103576,123757] 0 2024-09-21T08:02:43.244 INFO:tasks.workunit.client.0.smithi107.stdout:2/325: creat d1/d16/f75 x:0 0 0 2024-09-21T08:02:43.245 INFO:tasks.workunit.client.0.smithi107.stdout:6/442: mknod d2/d3/d7/d54/c8f 0 2024-09-21T08:02:43.245 INFO:tasks.workunit.client.0.smithi107.stdout:6/443: creat d2/d3/d7/d23/d2b/f90 x:0 0 0 2024-09-21T08:02:43.245 INFO:tasks.workunit.client.0.smithi107.stdout:5/427: dread d7/f34 [0,4194304] 0 2024-09-21T08:02:43.246 INFO:tasks.workunit.client.0.smithi107.stdout:4/333: mknod dc/c65 0 2024-09-21T08:02:43.246 INFO:tasks.workunit.client.0.smithi107.stdout:4/334: dread - dc/d13/d40/f4b zero size 2024-09-21T08:02:43.246 INFO:tasks.workunit.client.0.smithi107.stdout:4/335: write fb [978756,109685] 0 2024-09-21T08:02:43.249 INFO:tasks.workunit.client.0.smithi107.stdout:3/357: dread d8/d21/f24 [0,4194304] 0 2024-09-21T08:02:43.249 INFO:tasks.workunit.client.0.smithi107.stdout:3/358: readlink d8/d14/d1d/l37 0 2024-09-21T08:02:43.250 INFO:tasks.workunit.client.0.smithi107.stdout:9/413: rename d11/l1e to d11/d24/l9b 0 2024-09-21T08:02:43.250 INFO:tasks.workunit.client.0.smithi107.stdout:4/336: write dc/d13/d40/f43 [3271645,80754] 0 2024-09-21T08:02:43.253 INFO:tasks.workunit.client.0.smithi107.stdout:6/444: link d2/d3/d7/d48/f72 d2/d3/d7/d24/d41/d50/f91 0 2024-09-21T08:02:43.257 INFO:tasks.workunit.client.0.smithi107.stdout:5/428: write d7/de/d1d/d29/f40 [3768214,32476] 0 2024-09-21T08:02:43.259 INFO:tasks.workunit.client.0.smithi107.stdout:0/378: rename d1/d5/d25/d2d/f59 to d1/d5/f7e 0 2024-09-21T08:02:43.262 INFO:tasks.workunit.client.0.smithi107.stdout:4/337: link dc/d13/c36 dc/d13/d5a/c66 0 2024-09-21T08:02:43.265 INFO:tasks.workunit.client.0.smithi107.stdout:3/359: rename d8/lc to d8/d25/d34/l7a 0 2024-09-21T08:02:43.265 INFO:tasks.workunit.client.0.smithi107.stdout:0/379: getdents d1/d5/d25/d3d 0 2024-09-21T08:02:43.265 INFO:tasks.workunit.client.0.smithi107.stdout:0/380: dread - d1/d5/d25/d3d/d20/f51 zero size 2024-09-21T08:02:43.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:42 smithi129 ceph-mon[34472]: pgmap v13: 65 pgs: 65 active+clean; 2.1 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 202 MiB/s rd, 253 MiB/s wr, 338 op/s 2024-09-21T08:02:43.268 INFO:tasks.workunit.client.0.smithi107.stdout:4/338: mknod dc/d13/d40/d46/d48/d63/c67 0 2024-09-21T08:02:43.268 INFO:tasks.workunit.client.0.smithi107.stdout:3/360: mknod d8/d14/d1d/c7b 0 2024-09-21T08:02:43.269 INFO:tasks.workunit.client.0.smithi107.stdout:5/429: dread d7/de/f1b [0,4194304] 0 2024-09-21T08:02:43.270 INFO:tasks.workunit.client.0.smithi107.stdout:4/339: creat dc/f68 x:0 0 0 2024-09-21T08:02:43.270 INFO:tasks.workunit.client.0.smithi107.stdout:4/340: chown dc/d13/d40/f42 480888 1 2024-09-21T08:02:43.270 INFO:tasks.workunit.client.0.smithi107.stdout:4/341: chown dc/l5f 14232196 1 2024-09-21T08:02:43.270 INFO:tasks.workunit.client.0.smithi107.stdout:4/342: dread - dc/f54 zero size 2024-09-21T08:02:43.272 INFO:tasks.workunit.client.0.smithi107.stdout:2/326: dwrite d1/d2/d6d/d37/d49/f5e [0,4194304] 0 2024-09-21T08:02:43.273 INFO:tasks.workunit.client.0.smithi107.stdout:5/430: unlink d7/de/d1d/d29/f33 0 2024-09-21T08:02:43.274 INFO:tasks.workunit.client.0.smithi107.stdout:4/343: creat dc/d13/d40/f69 x:0 0 0 2024-09-21T08:02:43.274 INFO:tasks.workunit.client.0.smithi107.stdout:4/344: truncate dc/f68 902334 0 2024-09-21T08:02:43.276 INFO:tasks.workunit.client.0.smithi107.stdout:9/414: dwrite d11/d27/d2f/f7d [0,4194304] 0 2024-09-21T08:02:43.278 INFO:tasks.workunit.client.0.smithi107.stdout:6/445: dwrite d2/d3/d7/d24/f37 [4194304,4194304] 0 2024-09-21T08:02:43.279 INFO:tasks.workunit.client.0.smithi107.stdout:6/446: read d2/d3/d7/d2a/d31/f88 [421721,75850] 0 2024-09-21T08:02:43.280 INFO:tasks.workunit.client.0.smithi107.stdout:5/431: unlink d7/d70/l80 0 2024-09-21T08:02:43.282 INFO:tasks.workunit.client.0.smithi107.stdout:9/415: mknod d11/d24/d35/c9c 0 2024-09-21T08:02:43.286 INFO:tasks.workunit.client.0.smithi107.stdout:6/447: symlink d2/d3/d7/l92 0 2024-09-21T08:02:43.288 INFO:tasks.workunit.client.0.smithi107.stdout:0/381: dread d1/d5/f48 [0,4194304] 0 2024-09-21T08:02:43.289 INFO:tasks.workunit.client.0.smithi107.stdout:2/327: dread d1/d16/f17 [0,4194304] 0 2024-09-21T08:02:43.289 INFO:tasks.workunit.client.0.smithi107.stdout:2/328: write d1/d16/f75 [161826,27442] 0 2024-09-21T08:02:43.291 INFO:tasks.workunit.client.0.smithi107.stdout:5/432: rename d7/f8 to d7/de/f96 0 2024-09-21T08:02:43.291 INFO:tasks.workunit.client.0.smithi107.stdout:0/382: rmdir d1/d23/d61 39 2024-09-21T08:02:43.293 INFO:tasks.workunit.client.0.smithi107.stdout:5/433: dread d7/de/d1d/d24/d3d/f56 [0,4194304] 0 2024-09-21T08:02:43.297 INFO:tasks.workunit.client.0.smithi107.stdout:4/345: dwrite dc/d13/f5d [0,4194304] 0 2024-09-21T08:02:43.297 INFO:tasks.workunit.client.0.smithi107.stdout:9/416: rename d11/d27/d2f/d38/l44 to d11/d27/d2f/d4d/d5c/l9d 0 2024-09-21T08:02:43.297 INFO:tasks.workunit.client.0.smithi107.stdout:9/417: creat d11/d27/d5e/d76/f9e x:0 0 0 2024-09-21T08:02:43.297 INFO:tasks.workunit.client.0.smithi107.stdout:9/418: chown d11/d24/d35/l88 27 1 2024-09-21T08:02:43.297 INFO:tasks.workunit.client.0.smithi107.stdout:9/419: chown d11/d27/c80 630 1 2024-09-21T08:02:43.297 INFO:tasks.workunit.client.0.smithi107.stdout:3/361: dwrite d8/d2b/d45/f6a [0,4194304] 0 2024-09-21T08:02:43.297 INFO:tasks.workunit.client.0.smithi107.stdout:3/362: chown d8/d14/l4e 105474619 1 2024-09-21T08:02:43.299 INFO:tasks.workunit.client.0.smithi107.stdout:5/434: mknod d7/de/d1d/c97 0 2024-09-21T08:02:43.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:42 smithi107 ceph-mon[27622]: pgmap v13: 65 pgs: 65 active+clean; 2.1 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 202 MiB/s rd, 253 MiB/s wr, 338 op/s 2024-09-21T08:02:43.305 INFO:tasks.workunit.client.0.smithi107.stdout:4/346: mknod dc/d13/d40/c6a 0 2024-09-21T08:02:43.305 INFO:tasks.workunit.client.0.smithi107.stdout:4/347: dread - dc/d13/d40/f42 zero size 2024-09-21T08:02:43.306 INFO:tasks.workunit.client.0.smithi107.stdout:6/448: rename d2/d3/d7/d48/c69 to d2/d3/d7/d24/c93 0 2024-09-21T08:02:43.307 INFO:tasks.workunit.client.0.smithi107.stdout:6/449: creat d2/d3/d7/d23/f94 x:0 0 0 2024-09-21T08:02:43.307 INFO:tasks.workunit.client.0.smithi107.stdout:6/450: readlink d2/d3/l32 0 2024-09-21T08:02:43.310 INFO:tasks.workunit.client.0.smithi107.stdout:9/420: mkdir d11/d24/d4a/d9f 0 2024-09-21T08:02:43.310 INFO:tasks.workunit.client.0.smithi107.stdout:9/421: fdatasync d11/d27/d2a/f2c 0 2024-09-21T08:02:43.313 INFO:tasks.workunit.client.0.smithi107.stdout:9/422: dread d11/d27/d5e/d76/f6a [0,4194304] 0 2024-09-21T08:02:43.317 INFO:tasks.workunit.client.0.smithi107.stdout:5/435: dwrite d7/de/d1d/d24/d3d/f5a [0,4194304] 0 2024-09-21T08:02:43.326 INFO:tasks.workunit.client.0.smithi107.stdout:4/348: mkdir dc/d64/d6b 0 2024-09-21T08:02:43.331 INFO:tasks.workunit.client.0.smithi107.stdout:9/423: symlink d11/d27/d2f/d4d/d5c/d61/la0 0 2024-09-21T08:02:43.334 INFO:tasks.workunit.client.0.smithi107.stdout:3/363: getdents d8/d2b 0 2024-09-21T08:02:43.335 INFO:tasks.workunit.client.0.smithi107.stdout:2/329: rename d1/d1e/d69 to d1/d2/d6d/d42/d76 0 2024-09-21T08:02:43.336 INFO:tasks.workunit.client.0.smithi107.stdout:2/330: write d1/d2/f9 [227465,37060] 0 2024-09-21T08:02:43.338 INFO:tasks.workunit.client.0.smithi107.stdout:3/364: mknod d8/d14/d1d/c7c 0 2024-09-21T08:02:43.342 INFO:tasks.workunit.client.0.smithi107.stdout:6/451: rename d2/d3/d7/d54/f75 to d2/d3/d7/d24/d41/d50/d6e/f95 0 2024-09-21T08:02:43.345 INFO:tasks.workunit.client.0.smithi107.stdout:2/331: creat d1/d2/d6d/d37/d49/f77 x:0 0 0 2024-09-21T08:02:43.345 INFO:tasks.workunit.client.0.smithi107.stdout:2/332: write d1/d16/f60 [569972,38634] 0 2024-09-21T08:02:43.345 INFO:tasks.workunit.client.0.smithi107.stdout:2/333: write d1/d6/f66 [14555,98453] 0 2024-09-21T08:02:43.345 INFO:tasks.workunit.client.0.smithi107.stdout:2/334: write d1/d6/f18 [933153,16278] 0 2024-09-21T08:02:43.345 INFO:tasks.workunit.client.0.smithi107.stdout:2/335: chown d1/d16/d35/c44 3725 1 2024-09-21T08:02:43.351 INFO:tasks.workunit.client.0.smithi107.stdout:3/365: mknod d8/c7d 0 2024-09-21T08:02:43.351 INFO:tasks.workunit.client.0.smithi107.stdout:3/366: truncate d8/d14/d1d/f1f 956414 0 2024-09-21T08:02:43.351 INFO:tasks.workunit.client.0.smithi107.stdout:3/367: chown d8/d21/f75 2179 1 2024-09-21T08:02:43.352 INFO:tasks.workunit.client.0.smithi107.stdout:3/368: mkdir d8/d21/d7e 0 2024-09-21T08:02:43.354 INFO:tasks.workunit.client.0.smithi107.stdout:3/369: rename d8/d25/d42/f5f to d8/d57/f7f 0 2024-09-21T08:02:43.354 INFO:tasks.workunit.client.0.smithi107.stdout:4/349: dwrite dc/f3f [0,4194304] 0 2024-09-21T08:02:43.354 INFO:tasks.workunit.client.0.smithi107.stdout:4/350: stat dc/c59 0 2024-09-21T08:02:43.356 INFO:tasks.workunit.client.0.smithi107.stdout:4/351: rename dc/d13/d40/f69 to dc/d13/d40/d46/f6c 0 2024-09-21T08:02:43.357 INFO:tasks.workunit.client.0.smithi107.stdout:4/352: mknod dc/d13/d40/d46/d48/d63/c6d 0 2024-09-21T08:02:43.359 INFO:tasks.workunit.client.0.smithi107.stdout:4/353: unlink dc/f3c 0 2024-09-21T08:02:43.362 INFO:tasks.workunit.client.0.smithi107.stdout:9/424: dwrite d11/d27/d2a/f33 [0,4194304] 0 2024-09-21T08:02:43.365 INFO:tasks.workunit.client.0.smithi107.stdout:9/425: getdents d11/d27 0 2024-09-21T08:02:43.365 INFO:tasks.workunit.client.0.smithi107.stdout:9/426: getdents d11/d27/d5b 0 2024-09-21T08:02:43.376 INFO:tasks.workunit.client.0.smithi107.stdout:4/354: dread dc/d13/f18 [0,4194304] 0 2024-09-21T08:02:43.377 INFO:tasks.workunit.client.0.smithi107.stdout:6/452: dwrite d2/d3/d7/d23/d2b/f90 [0,4194304] 0 2024-09-21T08:02:43.377 INFO:tasks.workunit.client.0.smithi107.stdout:2/336: dwrite d1/d16/f6b [0,4194304] 0 2024-09-21T08:02:43.378 INFO:tasks.workunit.client.0.smithi107.stdout:4/355: mkdir dc/d13/d40/d5e/d6e 0 2024-09-21T08:02:43.379 INFO:tasks.workunit.client.0.smithi107.stdout:6/453: dread d2/d3/d7/d23/f6a [0,4194304] 0 2024-09-21T08:02:43.388 INFO:tasks.workunit.client.0.smithi107.stdout:3/370: dwrite d8/d44/f62 [0,4194304] 0 2024-09-21T08:02:43.388 INFO:tasks.workunit.client.0.smithi107.stdout:3/371: write d8/d57/f7f [716665,43915] 0 2024-09-21T08:02:43.388 INFO:tasks.workunit.client.0.smithi107.stdout:9/427: dwrite d11/d27/d5e/d76/f6a [0,4194304] 0 2024-09-21T08:02:43.391 INFO:tasks.workunit.client.0.smithi107.stdout:6/454: mkdir d2/d3/d7/d54/d96 0 2024-09-21T08:02:43.391 INFO:tasks.workunit.client.0.smithi107.stdout:6/455: stat d2/d3/d7/d2a/d31/c39 0 2024-09-21T08:02:43.391 INFO:tasks.workunit.client.0.smithi107.stdout:6/456: chown d2/d3/d7/c28 110258 1 2024-09-21T08:02:43.393 INFO:tasks.workunit.client.0.smithi107.stdout:6/457: write d2/d3/d7/f15 [4245091,70962] 0 2024-09-21T08:02:43.393 INFO:tasks.workunit.client.0.smithi107.stdout:6/458: chown d2/d3/d7/l92 179844 1 2024-09-21T08:02:43.393 INFO:tasks.workunit.client.0.smithi107.stdout:6/459: write d2/d3/d7/d2a/d31/f6f [1019878,78854] 0 2024-09-21T08:02:43.393 INFO:tasks.workunit.client.0.smithi107.stdout:6/460: fdatasync d2/d3/d7/d24/f2d 0 2024-09-21T08:02:43.395 INFO:tasks.workunit.client.0.smithi107.stdout:4/356: dread dc/d4c/f4d [0,4194304] 0 2024-09-21T08:02:43.395 INFO:tasks.workunit.client.0.smithi107.stdout:4/357: chown dc/d13/f38 62392 1 2024-09-21T08:02:43.396 INFO:tasks.workunit.client.0.smithi107.stdout:9/428: creat d11/d27/d5e/fa1 x:0 0 0 2024-09-21T08:02:43.399 INFO:tasks.workunit.client.0.smithi107.stdout:4/358: mkdir dc/d13/d40/d46/d48/d63/d6f 0 2024-09-21T08:02:43.401 INFO:tasks.workunit.client.0.smithi107.stdout:9/429: creat d11/d27/d2f/d4d/d5c/fa2 x:0 0 0 2024-09-21T08:02:43.401 INFO:tasks.workunit.client.0.smithi107.stdout:9/430: creat d11/d27/d2f/fa3 x:0 0 0 2024-09-21T08:02:43.401 INFO:tasks.workunit.client.0.smithi107.stdout:9/431: stat d11/d27/d98/d97 0 2024-09-21T08:02:43.401 INFO:tasks.workunit.client.0.smithi107.stdout:2/337: dwrite d1/d2/d6d/d42/f48 [0,4194304] 0 2024-09-21T08:02:43.401 INFO:tasks.workunit.client.0.smithi107.stdout:2/338: fdatasync d1/d16/f4e 0 2024-09-21T08:02:43.403 INFO:tasks.workunit.client.0.smithi107.stdout:4/359: truncate dc/d13/f2a 449156 0 2024-09-21T08:02:43.407 INFO:tasks.workunit.client.0.smithi107.stdout:3/372: dwrite d8/d57/d5d/f63 [0,4194304] 0 2024-09-21T08:02:43.407 INFO:tasks.workunit.client.0.smithi107.stdout:3/373: stat d8/d2b/d45/f6a 0 2024-09-21T08:02:43.407 INFO:tasks.workunit.client.0.smithi107.stdout:3/374: readlink d8/l60 0 2024-09-21T08:02:43.407 INFO:tasks.workunit.client.0.smithi107.stdout:3/375: chown d8/d21 6860521 1 2024-09-21T08:02:43.407 INFO:tasks.workunit.client.0.smithi107.stdout:9/432: symlink d11/d27/d2a/d7f/la4 0 2024-09-21T08:02:43.407 INFO:tasks.workunit.client.0.smithi107.stdout:9/433: write f7 [1532208,96456] 0 2024-09-21T08:02:43.408 INFO:tasks.workunit.client.0.smithi107.stdout:2/339: mknod d1/d16/c78 0 2024-09-21T08:02:43.410 INFO:tasks.workunit.client.0.smithi107.stdout:9/434: dread d11/d24/d35/f6f [0,4194304] 0 2024-09-21T08:02:43.411 INFO:tasks.workunit.client.0.smithi107.stdout:4/360: mkdir dc/d13/d40/d46/d48/d70 0 2024-09-21T08:02:43.414 INFO:tasks.workunit.client.0.smithi107.stdout:9/435: stat d11/c23 0 2024-09-21T08:02:43.414 INFO:tasks.workunit.client.0.smithi107.stdout:6/461: dwrite d2/d3/d7/d23/d2b/f4b [0,4194304] 0 2024-09-21T08:02:43.420 INFO:tasks.workunit.client.0.smithi107.stdout:9/436: rmdir d11/d27/d2a 39 2024-09-21T08:02:43.421 INFO:tasks.workunit.client.0.smithi107.stdout:3/376: rename d8/d57 to d8/d25/d3d/d72/d80 0 2024-09-21T08:02:43.424 INFO:tasks.workunit.client.0.smithi107.stdout:3/377: unlink d8/d25/f76 0 2024-09-21T08:02:43.427 INFO:tasks.workunit.client.0.smithi107.stdout:3/378: symlink d8/d25/d3d/l81 0 2024-09-21T08:02:43.429 INFO:tasks.workunit.client.0.smithi107.stdout:9/437: write d11/d27/d5e/d76/f6a [2019725,39616] 0 2024-09-21T08:02:43.430 INFO:tasks.workunit.client.0.smithi107.stdout:3/379: symlink d8/d21/d7e/l82 0 2024-09-21T08:02:43.431 INFO:tasks.workunit.client.0.smithi107.stdout:6/462: rename d2/d3/d7/d2a/d31 to d2/d2e/d97 0 2024-09-21T08:02:43.431 INFO:tasks.workunit.client.0.smithi107.stdout:6/463: fsync d2/d2e/f58 0 2024-09-21T08:02:43.434 INFO:tasks.workunit.client.0.smithi107.stdout:9/438: rmdir d11/d24/d35 39 2024-09-21T08:02:43.437 INFO:tasks.workunit.client.0.smithi107.stdout:3/380: creat d8/d21/d7e/f83 x:0 0 0 2024-09-21T08:02:43.437 INFO:tasks.workunit.client.0.smithi107.stdout:9/439: write d11/d27/d2f/f3b [761758,88867] 0 2024-09-21T08:02:43.437 INFO:tasks.workunit.client.0.smithi107.stdout:9/440: chown d11/d27/d2a/c53 1052909163 1 2024-09-21T08:02:43.440 INFO:tasks.workunit.client.0.smithi107.stdout:6/464: symlink d2/d3/d7/d23/d2b/d87/l98 0 2024-09-21T08:02:43.441 INFO:tasks.workunit.client.0.smithi107.stdout:6/465: write d2/d3/d7/d23/f35 [1354093,19143] 0 2024-09-21T08:02:43.441 INFO:tasks.workunit.client.0.smithi107.stdout:6/466: write d2/d3/f4 [8797495,75334] 0 2024-09-21T08:02:43.441 INFO:tasks.workunit.client.0.smithi107.stdout:6/467: write d2/d2e/d97/f88 [1078072,89883] 0 2024-09-21T08:02:43.442 INFO:tasks.workunit.client.0.smithi107.stdout:3/381: creat d8/d2b/d52/d71/f84 x:0 0 0 2024-09-21T08:02:43.444 INFO:tasks.workunit.client.0.smithi107.stdout:6/468: truncate d2/d2e/f58 3646108 0 2024-09-21T08:02:43.445 INFO:tasks.workunit.client.0.smithi107.stdout:9/441: dread d11/d27/d2f/d4d/d5c/d61/d8f/f81 [0,4194304] 0 2024-09-21T08:02:43.447 INFO:tasks.workunit.client.0.smithi107.stdout:6/469: truncate d2/d3/d7/d3f/f7b 1492304 0 2024-09-21T08:02:43.447 INFO:tasks.workunit.client.0.smithi107.stdout:6/470: fsync d2/d3/d7/d2a/f8b 0 2024-09-21T08:02:43.447 INFO:tasks.workunit.client.0.smithi107.stdout:6/471: write d2/d3/d7/d3f/f60 [165168,34209] 0 2024-09-21T08:02:43.447 INFO:tasks.workunit.client.0.smithi107.stdout:6/472: fdatasync d2/d2e/f3c 0 2024-09-21T08:02:43.449 INFO:tasks.workunit.client.0.smithi107.stdout:9/442: creat d11/d27/fa5 x:0 0 0 2024-09-21T08:02:43.449 INFO:tasks.workunit.client.0.smithi107.stdout:9/443: write d11/d27/fa5 [948910,77700] 0 2024-09-21T08:02:43.452 INFO:tasks.workunit.client.0.smithi107.stdout:9/444: creat d11/d27/d2f/d38/fa6 x:0 0 0 2024-09-21T08:02:43.461 INFO:tasks.workunit.client.0.smithi107.stdout:3/382: dwrite d8/d21/f36 [0,4194304] 0 2024-09-21T08:02:43.464 INFO:tasks.workunit.client.0.smithi107.stdout:3/383: dread d8/d21/f6b [0,4194304] 0 2024-09-21T08:02:43.472 INFO:tasks.workunit.client.0.smithi107.stdout:6/473: dwrite d2/d3/d7/d23/d2b/f4b [0,4194304] 0 2024-09-21T08:02:43.482 INFO:tasks.workunit.client.0.smithi107.stdout:9/445: dwrite d11/d27/d2f/d4d/d5c/fa2 [0,4194304] 0 2024-09-21T08:02:43.483 INFO:tasks.workunit.client.0.smithi107.stdout:6/474: dread d2/d3/d7/f42 [0,4194304] 0 2024-09-21T08:02:43.483 INFO:tasks.workunit.client.0.smithi107.stdout:6/475: dread - d2/d3/d7/d48/f72 zero size 2024-09-21T08:02:43.484 INFO:tasks.workunit.client.0.smithi107.stdout:6/476: getdents d2/d3/d7/d23/d2b/d84 0 2024-09-21T08:02:43.486 INFO:tasks.workunit.client.0.smithi107.stdout:9/446: mknod d11/d27/d5b/ca7 0 2024-09-21T08:02:43.488 INFO:tasks.workunit.client.0.smithi107.stdout:3/384: dwrite d8/d44/f62 [0,4194304] 0 2024-09-21T08:02:43.492 INFO:tasks.workunit.client.0.smithi107.stdout:9/447: creat d11/d24/d35/fa8 x:0 0 0 2024-09-21T08:02:43.493 INFO:tasks.workunit.client.0.smithi107.stdout:9/448: creat d11/d27/d5e/fa9 x:0 0 0 2024-09-21T08:02:43.493 INFO:tasks.workunit.client.0.smithi107.stdout:9/449: fdatasync d11/d27/d2f/fa3 0 2024-09-21T08:02:43.497 INFO:tasks.workunit.client.0.smithi107.stdout:9/450: mkdir d11/d27/d2f/d38/daa 0 2024-09-21T08:02:43.497 INFO:tasks.workunit.client.0.smithi107.stdout:9/451: truncate d11/d24/d26/f28 780923 0 2024-09-21T08:02:43.498 INFO:tasks.workunit.client.0.smithi107.stdout:9/452: creat d11/d27/d2f/d4d/d5c/d61/fab x:0 0 0 2024-09-21T08:02:43.498 INFO:tasks.workunit.client.0.smithi107.stdout:9/453: dread - d11/d24/d4a/f75 zero size 2024-09-21T08:02:43.508 INFO:tasks.workunit.client.0.smithi107.stdout:6/477: dwrite d2/d3/d7/d23/f35 [0,4194304] 0 2024-09-21T08:02:43.508 INFO:tasks.workunit.client.0.smithi107.stdout:3/385: dwrite d8/d21/f36 [0,4194304] 0 2024-09-21T08:02:43.511 INFO:tasks.workunit.client.0.smithi107.stdout:6/478: symlink d2/d2e/l99 0 2024-09-21T08:02:43.515 INFO:tasks.workunit.client.0.smithi107.stdout:6/479: unlink d2/d3/d7/d3f/c76 0 2024-09-21T08:02:43.515 INFO:tasks.workunit.client.0.smithi107.stdout:6/480: fdatasync d2/d3/d7/d24/d41/d50/f57 0 2024-09-21T08:02:43.516 INFO:tasks.workunit.client.0.smithi107.stdout:6/481: rename d2/d3/d7/d54/d96 to d2/d3/d7/d24/d7f/d9a 0 2024-09-21T08:02:43.517 INFO:tasks.workunit.client.0.smithi107.stdout:6/482: chown d2/d3/d7/d24/d7f 326 1 2024-09-21T08:02:43.517 INFO:tasks.workunit.client.0.smithi107.stdout:6/483: readlink d2/d3/l81 0 2024-09-21T08:02:43.519 INFO:tasks.workunit.client.0.smithi107.stdout:9/454: rmdir d11/d27/d2f/d4d/d5c 39 2024-09-21T08:02:43.521 INFO:tasks.workunit.client.0.smithi107.stdout:9/455: rename d11/d27/l4c to d11/d27/lac 0 2024-09-21T08:02:43.523 INFO:tasks.workunit.client.0.smithi107.stdout:9/456: mknod d11/d27/d2f/d4d/d5c/d61/cad 0 2024-09-21T08:02:43.540 INFO:tasks.workunit.client.0.smithi107.stdout:9/457: dwrite d11/d27/d5e/fa1 [0,4194304] 0 2024-09-21T08:02:43.543 INFO:tasks.workunit.client.0.smithi107.stdout:9/458: mknod d11/d27/d2f/d4d/d5c/d61/cae 0 2024-09-21T08:02:43.543 INFO:tasks.workunit.client.0.smithi107.stdout:9/459: dread - d11/d27/d5e/fa9 zero size 2024-09-21T08:02:43.543 INFO:tasks.workunit.client.0.smithi107.stdout:9/460: write d11/d27/d2a/f63 [4434146,127047] 0 2024-09-21T08:02:43.558 INFO:tasks.workunit.client.0.smithi107.stdout:9/461: dwrite d11/d27/d2a/f87 [0,4194304] 0 2024-09-21T08:02:43.567 INFO:tasks.workunit.client.0.smithi107.stdout:9/462: write d11/d27/d98/f47 [3585585,90029] 0 2024-09-21T08:02:43.569 INFO:tasks.workunit.client.0.smithi107.stdout:9/463: symlink d11/d27/d5b/laf 0 2024-09-21T08:02:43.582 INFO:tasks.workunit.client.0.smithi107.stdout:9/464: dwrite d11/d24/d4a/f8e [0,4194304] 0 2024-09-21T08:02:43.584 INFO:tasks.workunit.client.0.smithi107.stdout:9/465: symlink d11/d24/lb0 0 2024-09-21T08:02:43.584 INFO:tasks.workunit.client.0.smithi107.stdout:9/466: write d11/d24/d35/fa8 [317952,56272] 0 2024-09-21T08:02:43.585 INFO:tasks.workunit.client.0.smithi107.stdout:9/467: symlink d11/d27/d2f/lb1 0 2024-09-21T08:02:43.667 INFO:tasks.workunit.client.0.smithi107.stdout:8/301: sync 2024-09-21T08:02:43.667 INFO:tasks.workunit.client.0.smithi107.stdout:7/290: sync 2024-09-21T08:02:43.675 INFO:tasks.workunit.client.0.smithi107.stdout:8/302: dread d5/d23/f35 [0,4194304] 0 2024-09-21T08:02:43.676 INFO:tasks.workunit.client.0.smithi107.stdout:8/303: fdatasync d5/d38/f3f 0 2024-09-21T08:02:43.682 INFO:tasks.workunit.client.0.smithi107.stdout:8/304: write d5/f14 [2228849,114555] 0 2024-09-21T08:02:43.693 INFO:tasks.workunit.client.0.smithi107.stdout:7/291: creat d7/d22/d37/d40/d4d/f6a x:0 0 0 2024-09-21T08:02:43.693 INFO:tasks.workunit.client.0.smithi107.stdout:7/292: stat d7/f14 0 2024-09-21T08:02:43.693 INFO:tasks.workunit.client.0.smithi107.stdout:7/293: fdatasync d7/d22/f2d 0 2024-09-21T08:02:43.693 INFO:tasks.workunit.client.0.smithi107.stdout:7/294: truncate d7/d18/f29 1157015 0 2024-09-21T08:02:43.694 INFO:tasks.workunit.client.0.smithi107.stdout:7/295: dread - d7/d22/d37/d4b/f5e zero size 2024-09-21T08:02:43.695 INFO:tasks.workunit.client.0.smithi107.stdout:8/305: getdents d5/d44/d5d 0 2024-09-21T08:02:43.697 INFO:tasks.workunit.client.0.smithi107.stdout:8/306: getdents d5/d38/d56/d54 0 2024-09-21T08:02:43.697 INFO:tasks.workunit.client.0.smithi107.stdout:8/307: chown d5/lc 117 1 2024-09-21T08:02:43.713 INFO:tasks.workunit.client.0.smithi107.stdout:8/308: dwrite d5/d23/f3b [4194304,4194304] 0 2024-09-21T08:02:43.715 INFO:tasks.workunit.client.0.smithi107.stdout:8/309: rename d5/d44/d46/c63 to d5/d38/d67/c6e 0 2024-09-21T08:02:43.715 INFO:tasks.workunit.client.0.smithi107.stdout:8/310: fdatasync d5/d2e/f39 0 2024-09-21T08:02:43.715 INFO:tasks.workunit.client.0.smithi107.stdout:8/311: truncate d5/d44/d47/d5e/f6d 1003529 0 2024-09-21T08:02:43.716 INFO:tasks.workunit.client.0.smithi107.stdout:8/312: fdatasync d5/d23/f2f 0 2024-09-21T08:02:43.717 INFO:tasks.workunit.client.0.smithi107.stdout:8/313: creat d5/d1d/f6f x:0 0 0 2024-09-21T08:02:43.717 INFO:tasks.workunit.client.0.smithi107.stdout:8/314: creat d5/d44/d46/f70 x:0 0 0 2024-09-21T08:02:43.726 INFO:tasks.workunit.client.0.smithi107.stdout:8/315: write d5/d23/f3b [8329650,57115] 0 2024-09-21T08:02:43.726 INFO:tasks.workunit.client.0.smithi107.stdout:8/316: stat d5/f61 0 2024-09-21T08:02:43.727 INFO:tasks.workunit.client.0.smithi107.stdout:8/317: symlink d5/d44/d47/d5e/l71 0 2024-09-21T08:02:43.728 INFO:tasks.workunit.client.0.smithi107.stdout:8/318: creat d5/f72 x:0 0 0 2024-09-21T08:02:43.729 INFO:tasks.workunit.client.0.smithi107.stdout:8/319: unlink d5/d23/c2d 0 2024-09-21T08:02:43.730 INFO:tasks.workunit.client.0.smithi107.stdout:8/320: getdents d5/d2e 0 2024-09-21T08:02:43.734 INFO:tasks.workunit.client.0.smithi107.stdout:8/321: mknod d5/d44/d47/c73 0 2024-09-21T08:02:43.735 INFO:tasks.workunit.client.0.smithi107.stdout:8/322: rmdir d5/d44/d47 39 2024-09-21T08:02:43.735 INFO:tasks.workunit.client.0.smithi107.stdout:8/323: write d5/d44/d47/f4e [1688356,19576] 0 2024-09-21T08:02:43.735 INFO:tasks.workunit.client.0.smithi107.stdout:8/324: stat d5/d2e/f51 0 2024-09-21T08:02:43.736 INFO:tasks.workunit.client.0.smithi107.stdout:8/325: creat d5/d38/f74 x:0 0 0 2024-09-21T08:02:43.738 INFO:tasks.workunit.client.0.smithi107.stdout:8/326: fsync d5/d44/d47/f4e 0 2024-09-21T08:02:43.738 INFO:tasks.workunit.client.0.smithi107.stdout:8/327: chown d5/d23/f3b 609581 1 2024-09-21T08:02:43.739 INFO:tasks.workunit.client.0.smithi107.stdout:8/328: symlink d5/d38/d67/l75 0 2024-09-21T08:02:43.739 INFO:tasks.workunit.client.0.smithi107.stdout:8/329: dread - d5/d44/d46/f53 zero size 2024-09-21T08:02:43.739 INFO:tasks.workunit.client.0.smithi107.stdout:8/330: fdatasync d5/d1d/f24 0 2024-09-21T08:02:43.741 INFO:tasks.workunit.client.0.smithi107.stdout:8/331: rename d5/d2e/c3d to d5/d23/c76 0 2024-09-21T08:02:43.744 INFO:tasks.workunit.client.0.smithi107.stdout:8/332: creat d5/d2e/f77 x:0 0 0 2024-09-21T08:02:43.745 INFO:tasks.workunit.client.0.smithi107.stdout:8/333: truncate d5/f12 3716737 0 2024-09-21T08:02:43.745 INFO:tasks.workunit.client.0.smithi107.stdout:8/334: truncate d5/f5c 1225432 0 2024-09-21T08:02:43.747 INFO:tasks.workunit.client.0.smithi107.stdout:8/335: mknod d5/d44/d5d/c78 0 2024-09-21T08:02:43.748 INFO:tasks.workunit.client.0.smithi107.stdout:8/336: truncate d5/d23/f2f 6895433 0 2024-09-21T08:02:43.774 INFO:tasks.workunit.client.0.smithi107.stdout:8/337: dwrite d5/d23/f2f [4194304,4194304] 0 2024-09-21T08:02:43.774 INFO:tasks.workunit.client.0.smithi107.stdout:8/338: fsync d5/d1d/f26 0 2024-09-21T08:02:43.774 INFO:tasks.workunit.client.0.smithi107.stdout:8/339: dread d5/d38/d56/f65 [0,4194304] 0 2024-09-21T08:02:43.774 INFO:tasks.workunit.client.0.smithi107.stdout:8/340: mknod d5/d38/d56/c79 0 2024-09-21T08:02:43.777 INFO:tasks.workunit.client.0.smithi107.stdout:8/341: mkdir d5/d38/d56/d52/d7a 0 2024-09-21T08:02:43.777 INFO:tasks.workunit.client.0.smithi107.stdout:8/342: write d5/d1d/f24 [590644,38548] 0 2024-09-21T08:02:43.777 INFO:tasks.workunit.client.0.smithi107.stdout:8/343: fdatasync d5/d1d/f5b 0 2024-09-21T08:02:43.777 INFO:tasks.workunit.client.0.smithi107.stdout:8/344: fdatasync d5/f21 0 2024-09-21T08:02:43.777 INFO:tasks.workunit.client.0.smithi107.stdout:8/345: fdatasync d5/d1d/f6f 0 2024-09-21T08:02:43.783 INFO:tasks.workunit.client.0.smithi107.stdout:8/346: dread d5/f21 [0,4194304] 0 2024-09-21T08:02:43.787 INFO:tasks.workunit.client.0.smithi107.stdout:8/347: dread d5/f19 [0,4194304] 0 2024-09-21T08:02:43.787 INFO:tasks.workunit.client.0.smithi107.stdout:8/348: fdatasync d5/d23/f2f 0 2024-09-21T08:02:43.788 INFO:tasks.workunit.client.0.smithi107.stdout:8/349: readlink d5/d23/l58 0 2024-09-21T08:02:43.804 INFO:tasks.workunit.client.0.smithi107.stdout:1/351: sync 2024-09-21T08:02:43.806 INFO:tasks.workunit.client.0.smithi107.stdout:1/352: write d0/d29/f3f [431151,58026] 0 2024-09-21T08:02:43.806 INFO:tasks.workunit.client.0.smithi107.stdout:1/353: symlink d0/d19/l7a 0 2024-09-21T08:02:43.808 INFO:tasks.workunit.client.0.smithi107.stdout:1/354: mknod d0/d19/d2b/d4b/d61/c7b 0 2024-09-21T08:02:43.824 INFO:tasks.workunit.client.0.smithi107.stdout:1/355: dwrite d0/f71 [0,4194304] 0 2024-09-21T08:02:43.832 INFO:tasks.workunit.client.0.smithi107.stdout:1/356: read d0/d29/d2c/f52 [2773450,66492] 0 2024-09-21T08:02:43.832 INFO:tasks.workunit.client.0.smithi107.stdout:1/357: fsync d0/d19/d2b/d4b/d1c/f41 0 2024-09-21T08:02:43.833 INFO:tasks.workunit.client.0.smithi107.stdout:1/358: rmdir d0/d29/d2c 39 2024-09-21T08:02:43.833 INFO:tasks.workunit.client.0.smithi107.stdout:1/359: write d0/d29/d2c/f2e [475512,108866] 0 2024-09-21T08:02:43.851 INFO:tasks.workunit.client.0.smithi107.stdout:1/360: dwrite d0/d29/d31/f42 [0,4194304] 0 2024-09-21T08:02:43.851 INFO:tasks.workunit.client.0.smithi107.stdout:1/361: fdatasync d0/d19/d2b/d4b/d44/d72/f78 0 2024-09-21T08:02:43.860 INFO:tasks.workunit.client.0.smithi107.stdout:1/362: write d0/f71 [2942128,20504] 0 2024-09-21T08:02:43.860 INFO:tasks.workunit.client.0.smithi107.stdout:1/363: truncate d0/d19/f33 1398359 0 2024-09-21T08:02:43.877 INFO:tasks.workunit.client.0.smithi107.stdout:1/364: dwrite d0/d19/d2b/f57 [0,4194304] 0 2024-09-21T08:02:43.877 INFO:tasks.workunit.client.0.smithi107.stdout:1/365: fdatasync d0/d29/d2c/f30 0 2024-09-21T08:02:43.877 INFO:tasks.workunit.client.0.smithi107.stdout:1/366: write d0/d19/d2b/d4b/d1c/d5e/f69 [252457,112358] 0 2024-09-21T08:02:43.883 INFO:tasks.workunit.client.0.smithi107.stdout:1/367: rename d0/d19/d2b/d4b/d1c/c49 to d0/d19/d59/c7c 0 2024-09-21T08:02:43.883 INFO:tasks.workunit.client.0.smithi107.stdout:1/368: chown d0/d19 5905 1 2024-09-21T08:02:43.898 INFO:tasks.workunit.client.0.smithi107.stdout:1/369: dwrite d0/d19/d2b/d4b/d1c/f26 [0,4194304] 0 2024-09-21T08:02:43.899 INFO:tasks.workunit.client.0.smithi107.stdout:1/370: chown d0/d19/d2b/d4b/d44/d72/d36 1501 1 2024-09-21T08:02:43.899 INFO:tasks.workunit.client.0.smithi107.stdout:1/371: read - d0/d29/d31/d4f/f76 zero size 2024-09-21T08:02:43.899 INFO:tasks.workunit.client.0.smithi107.stdout:1/372: write d0/d29/d31/d4f/f76 [96655,110613] 0 2024-09-21T08:02:43.907 INFO:tasks.workunit.client.0.smithi107.stdout:1/373: dread d0/d19/d2b/f57 [0,4194304] 0 2024-09-21T08:02:43.908 INFO:tasks.workunit.client.0.smithi107.stdout:1/374: stat d0/d29/c65 0 2024-09-21T08:02:43.910 INFO:tasks.workunit.client.0.smithi107.stdout:1/375: creat d0/d19/d2b/d4b/d61/d75/f7d x:0 0 0 2024-09-21T08:02:43.912 INFO:tasks.workunit.client.0.smithi107.stdout:1/376: link d0/f3 d0/d19/d39/f7e 0 2024-09-21T08:02:43.915 INFO:tasks.workunit.client.0.smithi107.stdout:1/377: dread d0/d19/d2b/d4b/d1c/d5e/f69 [0,4194304] 0 2024-09-21T08:02:43.917 INFO:tasks.workunit.client.0.smithi107.stdout:1/378: write d0/d19/f33 [256885,11195] 0 2024-09-21T08:02:43.921 INFO:tasks.workunit.client.0.smithi107.stdout:1/379: dread d0/d19/f33 [0,4194304] 0 2024-09-21T08:02:43.922 INFO:tasks.workunit.client.0.smithi107.stdout:1/380: chown d0/d19/l27 50629748 1 2024-09-21T08:02:43.932 INFO:tasks.workunit.client.0.smithi107.stdout:5/436: sync 2024-09-21T08:02:43.932 INFO:tasks.workunit.client.0.smithi107.stdout:2/340: sync 2024-09-21T08:02:43.932 INFO:tasks.workunit.client.0.smithi107.stdout:0/383: sync 2024-09-21T08:02:43.932 INFO:tasks.workunit.client.0.smithi107.stdout:2/341: chown d1/d16/f17 145809 1 2024-09-21T08:02:43.932 INFO:tasks.workunit.client.0.smithi107.stdout:2/342: creat d1/d1e/f79 x:0 0 0 2024-09-21T08:02:43.933 INFO:tasks.workunit.client.0.smithi107.stdout:5/437: mknod d7/de/d1d/d29/d64/d87/c98 0 2024-09-21T08:02:43.933 INFO:tasks.workunit.client.0.smithi107.stdout:5/438: write d7/de/d1d/d29/f40 [4059125,113082] 0 2024-09-21T08:02:43.937 INFO:tasks.workunit.client.0.smithi107.stdout:5/439: rename d7/de/d2d/d5d/d60/f79 to d7/de/f99 0 2024-09-21T08:02:43.940 INFO:tasks.workunit.client.0.smithi107.stdout:5/440: mknod d7/de/d1d/d24/d3d/c9a 0 2024-09-21T08:02:43.940 INFO:tasks.workunit.client.0.smithi107.stdout:5/441: chown d7/de/d1d/d24 52074598 1 2024-09-21T08:02:43.940 INFO:tasks.workunit.client.0.smithi107.stdout:5/442: chown d7/de/d52 3834044 1 2024-09-21T08:02:43.942 INFO:tasks.workunit.client.0.smithi107.stdout:5/443: dread d7/de/d1d/d24/f46 [0,4194304] 0 2024-09-21T08:02:43.942 INFO:tasks.workunit.client.0.smithi107.stdout:5/444: read d7/de/f96 [702462,108145] 0 2024-09-21T08:02:43.952 INFO:tasks.workunit.client.0.smithi107.stdout:5/445: write d7/de/d1d/d24/d3d/f5a [2418711,113794] 0 2024-09-21T08:02:43.952 INFO:tasks.workunit.client.0.smithi107.stdout:5/446: fsync d7/de/f1a 0 2024-09-21T08:02:43.953 INFO:tasks.workunit.client.0.smithi107.stdout:0/384: dwrite d1/d5/d25/d3d/d20/d29/d55/f58 [0,4194304] 0 2024-09-21T08:02:43.956 INFO:tasks.workunit.client.0.smithi107.stdout:5/447: mkdir d7/de/d35/d9b 0 2024-09-21T08:02:43.958 INFO:tasks.workunit.client.0.smithi107.stdout:5/448: dread d7/de/d1d/d24/f46 [0,4194304] 0 2024-09-21T08:02:43.958 INFO:tasks.workunit.client.0.smithi107.stdout:5/449: chown d7/de/d1d/d24/d3d/d65/f94 860 1 2024-09-21T08:02:43.962 INFO:tasks.workunit.client.0.smithi107.stdout:5/450: getdents d7/de/d1d/d29/d64 0 2024-09-21T08:02:43.969 INFO:tasks.workunit.client.0.smithi107.stdout:5/451: dread d7/de/d1d/d24/f8c [0,4194304] 0 2024-09-21T08:02:43.973 INFO:tasks.workunit.client.0.smithi107.stdout:5/452: dread d7/de/d1d/d24/f8c [0,4194304] 0 2024-09-21T08:02:43.976 INFO:tasks.workunit.client.0.smithi107.stdout:5/453: creat d7/de/d1d/d29/d64/f9c x:0 0 0 2024-09-21T08:02:43.991 INFO:tasks.workunit.client.0.smithi107.stdout:5/454: dwrite d7/de/d35/f57 [0,4194304] 0 2024-09-21T08:02:43.994 INFO:tasks.workunit.client.0.smithi107.stdout:5/455: unlink d7/de/d52/d6b/c7b 0 2024-09-21T08:02:43.994 INFO:tasks.workunit.client.0.smithi107.stdout:5/456: symlink d7/de/d2d/l9d 0 2024-09-21T08:02:44.063 INFO:tasks.workunit.client.0.smithi107.stdout:4/361: sync 2024-09-21T08:02:44.063 INFO:tasks.workunit.client.0.smithi107.stdout:7/296: sync 2024-09-21T08:02:44.063 INFO:tasks.workunit.client.0.smithi107.stdout:3/386: sync 2024-09-21T08:02:44.063 INFO:tasks.workunit.client.0.smithi107.stdout:6/484: sync 2024-09-21T08:02:44.063 INFO:tasks.workunit.client.0.smithi107.stdout:9/468: sync 2024-09-21T08:02:44.063 INFO:tasks.workunit.client.0.smithi107.stdout:8/350: sync 2024-09-21T08:02:44.063 INFO:tasks.workunit.client.0.smithi107.stdout:9/469: fsync d11/d27/fa5 0 2024-09-21T08:02:44.064 INFO:tasks.workunit.client.0.smithi107.stdout:7/297: mknod d7/d22/d37/d5a/c6b 0 2024-09-21T08:02:44.064 INFO:tasks.workunit.client.0.smithi107.stdout:7/298: chown d7/d22/d37/l5f 60 1 2024-09-21T08:02:44.067 INFO:tasks.workunit.client.0.smithi107.stdout:8/351: mkdir d5/d40/d7b 0 2024-09-21T08:02:44.073 INFO:tasks.workunit.client.0.smithi107.stdout:6/485: getdents d2/d3/d7/d54/d5c 0 2024-09-21T08:02:44.076 INFO:tasks.workunit.client.0.smithi107.stdout:9/470: rename d11/d27/d2a/c53 to d11/d27/d2f/d4d/d5c/d61/d8f/cb2 0 2024-09-21T08:02:44.076 INFO:tasks.workunit.client.0.smithi107.stdout:9/471: dread - d11/d27/d2f/d38/fa6 zero size 2024-09-21T08:02:44.077 INFO:tasks.workunit.client.0.smithi107.stdout:6/486: truncate d2/d3/d7/f11 1911903 0 2024-09-21T08:02:44.079 INFO:tasks.workunit.client.0.smithi107.stdout:7/299: rename d7/d18/l26 to d7/d22/d37/d40/l6c 0 2024-09-21T08:02:44.081 INFO:tasks.workunit.client.0.smithi107.stdout:9/472: creat d11/d27/d2a/fb3 x:0 0 0 2024-09-21T08:02:44.082 INFO:tasks.workunit.client.0.smithi107.stdout:6/487: rename d2/d3/d7/d24/d7f/d9a to d2/d3/d7/d24/d41/d50/d6e/d85/d9b 0 2024-09-21T08:02:44.082 INFO:tasks.workunit.client.0.smithi107.stdout:6/488: write d2/d3/f9 [216881,6538] 0 2024-09-21T08:02:44.083 INFO:tasks.workunit.client.0.smithi107.stdout:6/489: getdents d2/d3/d7/d23/d2b/d84 0 2024-09-21T08:02:44.083 INFO:tasks.workunit.client.0.smithi107.stdout:6/490: creat d2/d3/d7/f9c x:0 0 0 2024-09-21T08:02:44.084 INFO:tasks.workunit.client.0.smithi107.stdout:9/473: mkdir d11/d27/d2f/d4d/d5c/d61/db4 0 2024-09-21T08:02:44.084 INFO:tasks.workunit.client.0.smithi107.stdout:9/474: chown d11/l96 0 1 2024-09-21T08:02:44.084 INFO:tasks.workunit.client.0.smithi107.stdout:9/475: readlink d11/d27/d2f/d4d/l52 0 2024-09-21T08:02:44.086 INFO:tasks.workunit.client.0.smithi107.stdout:6/491: truncate d2/d3/d7/d24/f25 4265516 0 2024-09-21T08:02:44.086 INFO:tasks.workunit.client.0.smithi107.stdout:6/492: dread - d2/d3/d7/d24/f2d zero size 2024-09-21T08:02:44.086 INFO:tasks.workunit.client.0.smithi107.stdout:6/493: chown d2/d3/d7/d3f/f60 43157 1 2024-09-21T08:02:44.087 INFO:tasks.workunit.client.0.smithi107.stdout:3/387: dwrite d8/d14/d1d/f3a [0,4194304] 0 2024-09-21T08:02:44.087 INFO:tasks.workunit.client.0.smithi107.stdout:3/388: truncate d8/d21/f4c 423068 0 2024-09-21T08:02:44.087 INFO:tasks.workunit.client.0.smithi107.stdout:3/389: truncate d8/d14/f58 360739 0 2024-09-21T08:02:44.088 INFO:tasks.workunit.client.0.smithi107.stdout:9/476: rmdir d11/d27/d2f/d4d/d5c/d61/d8f 39 2024-09-21T08:02:44.089 INFO:tasks.workunit.client.0.smithi107.stdout:6/494: mkdir d2/d3/d7/d24/d41/d50/d6e/d85/d9d 0 2024-09-21T08:02:44.091 INFO:tasks.workunit.client.0.smithi107.stdout:7/300: write d7/d22/f24 [2047416,70471] 0 2024-09-21T08:02:44.091 INFO:tasks.workunit.client.0.smithi107.stdout:3/390: dread d8/d14/d1d/f5c [0,4194304] 0 2024-09-21T08:02:44.091 INFO:tasks.workunit.client.0.smithi107.stdout:6/495: mknod d2/c9e 0 2024-09-21T08:02:44.095 INFO:tasks.workunit.client.0.smithi107.stdout:6/496: creat d2/d3/d7/d24/d41/d50/d6e/f9f x:0 0 0 2024-09-21T08:02:44.095 INFO:tasks.workunit.client.0.smithi107.stdout:4/362: dwrite dc/f50 [0,4194304] 0 2024-09-21T08:02:44.096 INFO:tasks.workunit.client.0.smithi107.stdout:7/301: getdents d7/d38 0 2024-09-21T08:02:44.098 INFO:tasks.workunit.client.0.smithi107.stdout:9/477: dread d11/d27/d2f/f7d [0,4194304] 0 2024-09-21T08:02:44.099 INFO:tasks.workunit.client.0.smithi107.stdout:8/352: dwrite d5/f45 [0,4194304] 0 2024-09-21T08:02:44.099 INFO:tasks.workunit.client.0.smithi107.stdout:8/353: write d5/d40/f43 [20734,30920] 0 2024-09-21T08:02:44.100 INFO:tasks.workunit.client.0.smithi107.stdout:6/497: unlink d2/c9e 0 2024-09-21T08:02:44.104 INFO:tasks.workunit.client.0.smithi107.stdout:4/363: creat dc/d13/d40/d5e/d6e/f71 x:0 0 0 2024-09-21T08:02:44.106 INFO:tasks.workunit.client.0.smithi107.stdout:7/302: mknod d7/d38/c6d 0 2024-09-21T08:02:44.107 INFO:tasks.workunit.client.0.smithi107.stdout:4/364: dread dc/d13/f57 [0,4194304] 0 2024-09-21T08:02:44.108 INFO:tasks.workunit.client.0.smithi107.stdout:9/478: rename d11/d24/d26/f28 to d11/d24/d4a/fb5 0 2024-09-21T08:02:44.109 INFO:tasks.workunit.client.0.smithi107.stdout:3/391: dwrite d8/f1b [0,4194304] 0 2024-09-21T08:02:44.109 INFO:tasks.workunit.client.0.smithi107.stdout:3/392: chown d8/d2b/d52/d71/c77 477332 1 2024-09-21T08:02:44.109 INFO:tasks.workunit.client.0.smithi107.stdout:3/393: dread - d8/d21/f75 zero size 2024-09-21T08:02:44.111 INFO:tasks.workunit.client.0.smithi107.stdout:8/354: write d5/d38/f3e [1289561,41568] 0 2024-09-21T08:02:44.124 INFO:tasks.workunit.client.0.smithi107.stdout:6/498: creat d2/d3/d7/d24/d41/fa0 x:0 0 0 2024-09-21T08:02:44.128 INFO:tasks.workunit.client.0.smithi107.stdout:7/303: dread d7/d38/f41 [0,4194304] 0 2024-09-21T08:02:44.129 INFO:tasks.workunit.client.0.smithi107.stdout:7/304: chown d7/d22/d37/d4b/d4e/f62 1678 1 2024-09-21T08:02:44.129 INFO:tasks.workunit.client.0.smithi107.stdout:7/305: write d7/d22/d3d/f50 [844228,78033] 0 2024-09-21T08:02:44.131 INFO:tasks.workunit.client.0.smithi107.stdout:9/479: rename d11/d24/d26/l3c to d11/d27/d2f/d4d/lb6 0 2024-09-21T08:02:44.131 INFO:tasks.workunit.client.0.smithi107.stdout:9/480: stat d11/d24/d6e/l73 0 2024-09-21T08:02:44.138 INFO:tasks.workunit.client.0.smithi107.stdout:8/355: mkdir d5/d2e/d7c 0 2024-09-21T08:02:44.140 INFO:tasks.workunit.client.0.smithi107.stdout:8/356: dread d5/d1d/f3a [0,4194304] 0 2024-09-21T08:02:44.140 INFO:tasks.workunit.client.0.smithi107.stdout:8/357: write d5/d2e/f39 [905368,85680] 0 2024-09-21T08:02:44.140 INFO:tasks.workunit.client.0.smithi107.stdout:8/358: fdatasync d5/d1d/f24 0 2024-09-21T08:02:44.142 INFO:tasks.workunit.client.0.smithi107.stdout:6/499: link d2/d3/d7/d2a/c53 d2/d3/d7/d23/d2b/ca1 0 2024-09-21T08:02:44.145 INFO:tasks.workunit.client.0.smithi107.stdout:6/500: dread d2/d3/d7/f1b [0,4194304] 0 2024-09-21T08:02:44.145 INFO:tasks.workunit.client.0.smithi107.stdout:6/501: chown d2/d3/d7/d23/d2b/d87/l98 29 1 2024-09-21T08:02:44.146 INFO:tasks.workunit.client.0.smithi107.stdout:3/394: rename d8/f1c to d8/d14/d1d/f85 0 2024-09-21T08:02:44.146 INFO:tasks.workunit.client.0.smithi107.stdout:3/395: creat d8/d25/d42/f86 x:0 0 0 2024-09-21T08:02:44.148 INFO:tasks.workunit.client.0.smithi107.stdout:9/481: dwrite d11/d24/d6e/f94 [0,4194304] 0 2024-09-21T08:02:44.150 INFO:tasks.workunit.client.0.smithi107.stdout:8/359: rmdir d5/d40/d7b 0 2024-09-21T08:02:44.150 INFO:tasks.workunit.client.0.smithi107.stdout:8/360: dread - d5/d2e/f77 zero size 2024-09-21T08:02:44.150 INFO:tasks.workunit.client.0.smithi107.stdout:6/502: symlink d2/d3/d7/d24/d41/d50/d6e/d85/la2 0 2024-09-21T08:02:44.154 INFO:tasks.workunit.client.0.smithi107.stdout:3/396: mkdir d8/d87 0 2024-09-21T08:02:44.155 INFO:tasks.workunit.client.0.smithi107.stdout:3/397: creat d8/d21/f88 x:0 0 0 2024-09-21T08:02:44.160 INFO:tasks.workunit.client.0.smithi107.stdout:8/361: mkdir d5/d38/d67/d7d 0 2024-09-21T08:02:44.161 INFO:tasks.workunit.client.0.smithi107.stdout:8/362: getdents d5/d38/d67/d7d 0 2024-09-21T08:02:44.162 INFO:tasks.workunit.client.0.smithi107.stdout:9/482: dwrite d11/d27/d5e/fa9 [0,4194304] 0 2024-09-21T08:02:44.162 INFO:tasks.workunit.client.0.smithi107.stdout:9/483: stat d11/d27/d2f/d4d/d5c/d61/d8f/f91 0 2024-09-21T08:02:44.172 INFO:tasks.workunit.client.0.smithi107.stdout:6/503: rename d2/d3/d7/d24/d41/d50/d6e to d2/d3/d7/d48/da3 0 2024-09-21T08:02:44.172 INFO:tasks.workunit.client.0.smithi107.stdout:6/504: creat d2/d3/d7/d48/fa4 x:0 0 0 2024-09-21T08:02:44.175 INFO:tasks.workunit.client.0.smithi107.stdout:9/484: dread d11/d27/d2f/d4d/d5c/fa2 [0,4194304] 0 2024-09-21T08:02:44.178 INFO:tasks.workunit.client.0.smithi107.stdout:8/363: dwrite d5/d23/f3b [4194304,4194304] 0 2024-09-21T08:02:44.182 INFO:tasks.workunit.client.0.smithi107.stdout:8/364: symlink d5/d23/l7e 0 2024-09-21T08:02:44.182 INFO:tasks.workunit.client.0.smithi107.stdout:8/365: fsync d5/f12 0 2024-09-21T08:02:44.182 INFO:tasks.workunit.client.0.smithi107.stdout:8/366: rename d5/f45 to d5/d1d/f7f 0 2024-09-21T08:02:44.182 INFO:tasks.workunit.client.0.smithi107.stdout:8/367: fdatasync d5/f6 0 2024-09-21T08:02:44.184 INFO:tasks.workunit.client.0.smithi107.stdout:8/368: rename d5/d44/f50 to d5/d38/d56/d54/f80 0 2024-09-21T08:02:44.190 INFO:tasks.workunit.client.0.smithi107.stdout:8/369: dread d5/f14 [0,4194304] 0 2024-09-21T08:02:44.191 INFO:tasks.workunit.client.0.smithi107.stdout:8/370: link d5/l10 d5/d44/l81 0 2024-09-21T08:02:44.195 INFO:tasks.workunit.client.0.smithi107.stdout:8/371: symlink d5/d44/l82 0 2024-09-21T08:02:44.196 INFO:tasks.workunit.client.0.smithi107.stdout:6/505: dwrite d2/d3/d7/d23/d2b/f2f [4194304,4194304] 0 2024-09-21T08:02:44.197 INFO:tasks.workunit.client.0.smithi107.stdout:9/485: dwrite d11/d27/f72 [0,4194304] 0 2024-09-21T08:02:44.197 INFO:tasks.workunit.client.0.smithi107.stdout:9/486: chown d11/d27/d5b/c89 1423 1 2024-09-21T08:02:44.197 INFO:tasks.workunit.client.0.smithi107.stdout:9/487: creat d11/d27/d5e/d76/fb7 x:0 0 0 2024-09-21T08:02:44.198 INFO:tasks.workunit.client.0.smithi107.stdout:8/372: dread d5/d38/d56/d54/f80 [0,4194304] 0 2024-09-21T08:02:44.200 INFO:tasks.workunit.client.0.smithi107.stdout:6/506: truncate d2/d3/d7/d48/da3/f95 10843 0 2024-09-21T08:02:44.209 INFO:tasks.workunit.client.0.smithi107.stdout:6/507: dread d2/fd [0,4194304] 0 2024-09-21T08:02:44.209 INFO:tasks.workunit.client.0.smithi107.stdout:6/508: write d2/d3/d7/d24/f37 [3396192,116026] 0 2024-09-21T08:02:44.209 INFO:tasks.workunit.client.0.smithi107.stdout:6/509: chown d2/d3/d7/d23/f35 711691382 1 2024-09-21T08:02:44.209 INFO:tasks.workunit.client.0.smithi107.stdout:9/488: rename d11/d27/d5e/d76/f8a to d11/d24/d26/fb8 0 2024-09-21T08:02:44.209 INFO:tasks.workunit.client.0.smithi107.stdout:9/489: write d11/d27/d2f/d4d/d5c/d61/fab [865816,44232] 0 2024-09-21T08:02:44.211 INFO:tasks.workunit.client.0.smithi107.stdout:6/510: creat d2/d3/d7/d48/da3/d85/fa5 x:0 0 0 2024-09-21T08:02:44.212 INFO:tasks.workunit.client.0.smithi107.stdout:6/511: write d2/d3/d7/d48/da3/f95 [321189,122118] 0 2024-09-21T08:02:44.213 INFO:tasks.workunit.client.0.smithi107.stdout:8/373: mknod d5/c83 0 2024-09-21T08:02:44.213 INFO:tasks.workunit.client.0.smithi107.stdout:8/374: dread - d5/d2e/f77 zero size 2024-09-21T08:02:44.214 INFO:tasks.workunit.client.0.smithi107.stdout:6/512: mknod d2/d3/d7/d3f/ca6 0 2024-09-21T08:02:44.215 INFO:tasks.workunit.client.0.smithi107.stdout:9/490: getdents d11/d27/d2f/d4d 0 2024-09-21T08:02:44.220 INFO:tasks.workunit.client.0.smithi107.stdout:8/375: dread d5/d23/f3b [0,4194304] 0 2024-09-21T08:02:44.222 INFO:tasks.workunit.client.0.smithi107.stdout:6/513: write d2/d3/f14 [3005634,118105] 0 2024-09-21T08:02:44.225 INFO:tasks.workunit.client.0.smithi107.stdout:8/376: rename d5/d38/d56/c79 to d5/d38/d56/d54/c84 0 2024-09-21T08:02:44.225 INFO:tasks.workunit.client.0.smithi107.stdout:6/514: mknod d2/d3/d7/d54/d5c/ca7 0 2024-09-21T08:02:44.225 INFO:tasks.workunit.client.0.smithi107.stdout:6/515: dread - d2/d3/d7/f9c zero size 2024-09-21T08:02:44.226 INFO:tasks.workunit.client.0.smithi107.stdout:6/516: read - d2/d3/d7/f9c zero size 2024-09-21T08:02:44.226 INFO:tasks.workunit.client.0.smithi107.stdout:9/491: write d11/d24/d4a/f8e [1867220,87454] 0 2024-09-21T08:02:44.226 INFO:tasks.workunit.client.0.smithi107.stdout:9/492: readlink d11/d27/d2f/d4d/l52 0 2024-09-21T08:02:44.227 INFO:tasks.workunit.client.0.smithi107.stdout:6/517: creat d2/d3/d7/d54/d5c/fa8 x:0 0 0 2024-09-21T08:02:44.228 INFO:tasks.workunit.client.0.smithi107.stdout:9/493: mkdir d11/d24/d6e/db9 0 2024-09-21T08:02:44.229 INFO:tasks.workunit.client.0.smithi107.stdout:9/494: creat d11/d27/d2f/d38/fba x:0 0 0 2024-09-21T08:02:44.230 INFO:tasks.workunit.client.0.smithi107.stdout:6/518: rename d2/d3/d7/d3f/ca6 to d2/d3/d7/d48/da3/ca9 0 2024-09-21T08:02:44.233 INFO:tasks.workunit.client.0.smithi107.stdout:9/495: mkdir d11/d27/d2f/d4d/d5c/d61/db4/dbb 0 2024-09-21T08:02:44.235 INFO:tasks.workunit.client.0.smithi107.stdout:6/519: symlink d2/d3/d7/d54/d5c/laa 0 2024-09-21T08:02:44.235 INFO:tasks.workunit.client.0.smithi107.stdout:6/520: creat d2/d3/d7/d54/d5c/fab x:0 0 0 2024-09-21T08:02:44.238 INFO:tasks.workunit.client.0.smithi107.stdout:6/521: symlink d2/d3/d7/d3f/lac 0 2024-09-21T08:02:44.239 INFO:tasks.workunit.client.0.smithi107.stdout:6/522: symlink d2/d3/d7/d54/d5c/lad 0 2024-09-21T08:02:44.243 INFO:tasks.workunit.client.0.smithi107.stdout:8/377: dwrite d5/d38/f74 [0,4194304] 0 2024-09-21T08:02:44.248 INFO:tasks.workunit.client.0.smithi107.stdout:8/378: dread f0 [0,4194304] 0 2024-09-21T08:02:44.250 INFO:tasks.workunit.client.0.smithi107.stdout:8/379: link d5/l10 d5/d38/d56/d52/d7a/l85 0 2024-09-21T08:02:44.251 INFO:tasks.workunit.client.0.smithi107.stdout:8/380: symlink d5/d44/d47/d5e/l86 0 2024-09-21T08:02:44.252 INFO:tasks.workunit.client.0.smithi107.stdout:8/381: truncate d5/f6 2820824 0 2024-09-21T08:02:44.254 INFO:tasks.workunit.client.0.smithi107.stdout:9/496: dwrite d11/d27/d2f/d4d/d5c/d61/f64 [0,4194304] 0 2024-09-21T08:02:44.254 INFO:tasks.workunit.client.0.smithi107.stdout:9/497: stat d11/d27/d2f/l7b 0 2024-09-21T08:02:44.254 INFO:tasks.workunit.client.0.smithi107.stdout:9/498: chown d11/d24/d35 24652221 1 2024-09-21T08:02:44.257 INFO:tasks.workunit.client.0.smithi107.stdout:9/499: creat d11/d27/d2a/d7f/fbc x:0 0 0 2024-09-21T08:02:44.261 INFO:tasks.workunit.client.0.smithi107.stdout:6/523: dwrite d2/d3/d7/d24/d41/d50/f91 [0,4194304] 0 2024-09-21T08:02:44.261 INFO:tasks.workunit.client.0.smithi107.stdout:6/524: truncate d2/d3/d7/d48/da3/f9f 626613 0 2024-09-21T08:02:44.261 INFO:tasks.workunit.client.0.smithi107.stdout:6/525: stat d2/d3/d7/d23/f35 0 2024-09-21T08:02:44.261 INFO:tasks.workunit.client.0.smithi107.stdout:6/526: fdatasync d2/d3/d7/d2a/f47 0 2024-09-21T08:02:44.262 INFO:tasks.workunit.client.0.smithi107.stdout:8/382: dread d5/f12 [0,4194304] 0 2024-09-21T08:02:44.262 INFO:tasks.workunit.client.0.smithi107.stdout:8/383: rename d5/d44 to d5/d44/d47/d5e/d87 22 2024-09-21T08:02:44.267 INFO:tasks.workunit.client.0.smithi107.stdout:6/527: mkdir d2/d3/d7/d54/dae 0 2024-09-21T08:02:44.267 INFO:tasks.workunit.client.0.smithi107.stdout:6/528: fsync d2/fe 0 2024-09-21T08:02:44.271 INFO:tasks.workunit.client.0.smithi107.stdout:6/529: getdents d2/d3/d7 0 2024-09-21T08:02:44.271 INFO:tasks.workunit.client.0.smithi107.stdout:6/530: write d2/d3/d7/d23/f94 [176857,127499] 0 2024-09-21T08:02:44.271 INFO:tasks.workunit.client.0.smithi107.stdout:6/531: chown d2/d3/d7/d24/f59 35045 1 2024-09-21T08:02:44.283 INFO:tasks.workunit.client.0.smithi107.stdout:8/384: dwrite d5/d2e/f77 [0,4194304] 0 2024-09-21T08:02:44.286 INFO:tasks.workunit.client.0.smithi107.stdout:1/381: sync 2024-09-21T08:02:44.288 INFO:tasks.workunit.client.0.smithi107.stdout:1/382: symlink d0/d19/d39/l7f 0 2024-09-21T08:02:44.290 INFO:tasks.workunit.client.0.smithi107.stdout:1/383: dread d0/d19/f33 [0,4194304] 0 2024-09-21T08:02:44.292 INFO:tasks.workunit.client.0.smithi107.stdout:1/384: mkdir d0/d80 0 2024-09-21T08:02:44.292 INFO:tasks.workunit.client.0.smithi107.stdout:1/385: dread - d0/d19/d2b/d4b/d61/d75/f7d zero size 2024-09-21T08:02:44.295 INFO:tasks.workunit.client.0.smithi107.stdout:8/385: read d5/d38/f74 [3825908,6403] 0 2024-09-21T08:02:44.295 INFO:tasks.workunit.client.0.smithi107.stdout:6/532: dwrite d2/d2e/d97/f88 [0,4194304] 0 2024-09-21T08:02:44.298 INFO:tasks.workunit.client.0.smithi107.stdout:6/533: unlink d2/d3/d7/ca 0 2024-09-21T08:02:44.300 INFO:tasks.workunit.client.0.smithi107.stdout:6/534: unlink d2/d3/f9 0 2024-09-21T08:02:44.302 INFO:tasks.workunit.client.0.smithi107.stdout:1/386: dread d0/d19/d2b/f57 [0,4194304] 0 2024-09-21T08:02:44.303 INFO:tasks.workunit.client.0.smithi107.stdout:1/387: fdatasync d0/d19/d2b/d4b/d44/d72/f78 0 2024-09-21T08:02:44.303 INFO:tasks.workunit.client.0.smithi107.stdout:1/388: fdatasync d0/d29/d2c/f2e 0 2024-09-21T08:02:44.303 INFO:tasks.workunit.client.0.smithi107.stdout:1/389: write d0/d19/d2b/d4b/d44/d72/f78 [859607,110178] 0 2024-09-21T08:02:44.303 INFO:tasks.workunit.client.0.smithi107.stdout:1/390: symlink d0/d29/d31/d4f/l81 0 2024-09-21T08:02:44.304 INFO:tasks.workunit.client.0.smithi107.stdout:1/391: mknod d0/d19/d2b/d4b/d1c/d5e/c82 0 2024-09-21T08:02:44.305 INFO:tasks.workunit.client.0.smithi107.stdout:8/386: write d5/d23/f3b [5196216,69204] 0 2024-09-21T08:02:44.306 INFO:tasks.workunit.client.0.smithi107.stdout:1/392: symlink d0/d80/l83 0 2024-09-21T08:02:44.306 INFO:tasks.workunit.client.0.smithi107.stdout:1/393: write d0/d19/d39/f7e [9359874,62255] 0 2024-09-21T08:02:44.308 INFO:tasks.workunit.client.0.smithi107.stdout:6/535: dread d2/fd [4194304,4194304] 0 2024-09-21T08:02:44.308 INFO:tasks.workunit.client.0.smithi107.stdout:1/394: mkdir d0/d29/d4d/d84 0 2024-09-21T08:02:44.310 INFO:tasks.workunit.client.0.smithi107.stdout:1/395: link d0/d29/l6d d0/d29/d2c/l85 0 2024-09-21T08:02:44.312 INFO:tasks.workunit.client.0.smithi107.stdout:6/536: write d2/d3/d7/d3f/f7b [868396,50986] 0 2024-09-21T08:02:44.312 INFO:tasks.workunit.client.0.smithi107.stdout:6/537: chown d2/d3/d7/d23/d2b/f4b 1 1 2024-09-21T08:02:44.312 INFO:tasks.workunit.client.0.smithi107.stdout:6/538: fsync d2/d3/d7/d2a/f51 0 2024-09-21T08:02:44.312 INFO:tasks.workunit.client.0.smithi107.stdout:6/539: stat d2/d3/l63 0 2024-09-21T08:02:44.312 INFO:tasks.workunit.client.0.smithi107.stdout:6/540: chown d2/fe 597735 1 2024-09-21T08:02:44.312 INFO:tasks.workunit.client.0.smithi107.stdout:6/541: truncate d2/d3/d7/f1f 4653994 0 2024-09-21T08:02:44.312 INFO:tasks.workunit.client.0.smithi107.stdout:6/542: chown d2/d3/d7/d23/l6d 750056294 1 2024-09-21T08:02:44.313 INFO:tasks.workunit.client.0.smithi107.stdout:6/543: rmdir d2/d3/d67 39 2024-09-21T08:02:44.318 INFO:tasks.workunit.client.0.smithi107.stdout:1/396: write d0/d29/f37 [1013656,10354] 0 2024-09-21T08:02:44.319 INFO:tasks.workunit.client.0.smithi107.stdout:1/397: stat d0/d19/l27 0 2024-09-21T08:02:44.319 INFO:tasks.workunit.client.0.smithi107.stdout:1/398: write d0/f3c [5059720,61912] 0 2024-09-21T08:02:44.322 INFO:tasks.workunit.client.0.smithi107.stdout:6/544: dread d2/d3/d7/d23/d2b/f4b [0,4194304] 0 2024-09-21T08:02:44.324 INFO:tasks.workunit.client.0.smithi107.stdout:8/387: dwrite d5/f5c [0,4194304] 0 2024-09-21T08:02:44.325 INFO:tasks.workunit.client.0.smithi107.stdout:8/388: chown d5/d38/d56/d54/c84 6295338 1 2024-09-21T08:02:44.325 INFO:tasks.workunit.client.0.smithi107.stdout:1/399: dread d0/d19/d2b/d4b/f63 [0,4194304] 0 2024-09-21T08:02:44.325 INFO:tasks.workunit.client.0.smithi107.stdout:1/400: chown d0/d19/d39/l62 33 1 2024-09-21T08:02:44.325 INFO:tasks.workunit.client.0.smithi107.stdout:1/401: write d0/d19/d2b/d4b/d44/d72/d36/f47 [1105773,36750] 0 2024-09-21T08:02:44.335 INFO:tasks.workunit.client.0.smithi107.stdout:6/545: dread d2/d3/d7/f13 [0,4194304] 0 2024-09-21T08:02:44.339 INFO:tasks.workunit.client.0.smithi107.stdout:1/402: rename d0/d29/d31/d4f to d0/d19/d2b/d86 0 2024-09-21T08:02:44.349 INFO:tasks.workunit.client.0.smithi107.stdout:6/546: dread d2/d3/d7/d23/f35 [0,4194304] 0 2024-09-21T08:02:44.351 INFO:tasks.workunit.client.0.smithi107.stdout:6/547: rename d2/d3/l81 to d2/d3/d7/d2a/laf 0 2024-09-21T08:02:44.357 INFO:tasks.workunit.client.0.smithi107.stdout:6/548: dread d2/d2e/f58 [0,4194304] 0 2024-09-21T08:02:44.359 INFO:tasks.workunit.client.0.smithi107.stdout:6/549: creat d2/d3/d7/d23/d2b/d84/fb0 x:0 0 0 2024-09-21T08:02:44.359 INFO:tasks.workunit.client.0.smithi107.stdout:6/550: chown d2/d3/f26 114 1 2024-09-21T08:02:44.360 INFO:tasks.workunit.client.0.smithi107.stdout:1/403: dwrite d0/d19/d39/f7e [0,4194304] 0 2024-09-21T08:02:44.366 INFO:tasks.workunit.client.0.smithi107.stdout:6/551: mknod d2/d3/d7/d48/d65/cb1 0 2024-09-21T08:02:44.367 INFO:tasks.workunit.client.0.smithi107.stdout:6/552: write d2/d3/d7/d3f/f60 [972238,31623] 0 2024-09-21T08:02:44.376 INFO:tasks.workunit.client.0.smithi107.stdout:1/404: dwrite d0/d29/d4d/f60 [0,4194304] 0 2024-09-21T08:02:44.376 INFO:tasks.workunit.client.0.smithi107.stdout:6/553: write d2/d3/d7/d23/d2b/f90 [1816828,130322] 0 2024-09-21T08:02:44.376 INFO:tasks.workunit.client.0.smithi107.stdout:6/554: write d2/d3/d7/d48/f68 [2214347,4939] 0 2024-09-21T08:02:44.376 INFO:tasks.workunit.client.0.smithi107.stdout:6/555: fsync d2/d2e/d97/f88 0 2024-09-21T08:02:44.381 INFO:tasks.workunit.client.0.smithi107.stdout:2/343: sync 2024-09-21T08:02:44.385 INFO:tasks.workunit.client.0.smithi107.stdout:1/405: truncate d0/d19/d59/f6f 290410 0 2024-09-21T08:02:44.389 INFO:tasks.workunit.client.0.smithi107.stdout:6/556: mkdir d2/d2e/db2 0 2024-09-21T08:02:44.400 INFO:tasks.workunit.client.0.smithi107.stdout:1/406: creat d0/d19/f87 x:0 0 0 2024-09-21T08:02:44.403 INFO:tasks.workunit.client.0.smithi107.stdout:6/557: link d2/d3/d7/d2a/f47 d2/d3/d7/d48/da3/fb3 0 2024-09-21T08:02:44.407 INFO:tasks.workunit.client.0.smithi107.stdout:2/344: rmdir d1/d2 39 2024-09-21T08:02:44.409 INFO:tasks.workunit.client.0.smithi107.stdout:6/558: link d2/d3/d7/d48/da3/fb3 d2/d3/d7/d48/d86/fb4 0 2024-09-21T08:02:44.412 INFO:tasks.workunit.client.0.smithi107.stdout:2/345: creat d1/d2/f7a x:0 0 0 2024-09-21T08:02:44.413 INFO:tasks.workunit.client.0.smithi107.stdout:6/559: dread d2/d3/d7/d3f/f60 [0,4194304] 0 2024-09-21T08:02:44.415 INFO:tasks.workunit.client.0.smithi107.stdout:2/346: dread d1/d16/d35/f59 [0,4194304] 0 2024-09-21T08:02:44.416 INFO:tasks.workunit.client.0.smithi107.stdout:6/560: link d2/d3/d7/d23/f35 d2/d3/d7/d79/fb5 0 2024-09-21T08:02:44.417 INFO:tasks.workunit.client.0.smithi107.stdout:6/561: mkdir d2/d3/d7/d48/da3/d85/d9b/db6 0 2024-09-21T08:02:44.418 INFO:tasks.workunit.client.0.smithi107.stdout:1/407: dwrite d0/d29/d2c/f2e [0,4194304] 0 2024-09-21T08:02:44.419 INFO:tasks.workunit.client.0.smithi107.stdout:1/408: link d0/d19/d2b/d4b/d61/c7b d0/d19/d2b/d4b/d61/d75/c88 0 2024-09-21T08:02:44.420 INFO:tasks.workunit.client.0.smithi107.stdout:1/409: mknod d0/d29/d31/c89 0 2024-09-21T08:02:44.421 INFO:tasks.workunit.client.0.smithi107.stdout:1/410: fsync d0/d19/d2b/d4b/f4c 0 2024-09-21T08:02:44.421 INFO:tasks.workunit.client.0.smithi107.stdout:1/411: chown d0/d19/d2b/d4b/d44/d72/f1d 573 1 2024-09-21T08:02:44.432 INFO:tasks.workunit.client.0.smithi107.stdout:1/412: write d0/d19/f58 [1818847,122585] 0 2024-09-21T08:02:44.433 INFO:tasks.workunit.client.0.smithi107.stdout:1/413: mkdir d0/d8a 0 2024-09-21T08:02:44.434 INFO:tasks.workunit.client.0.smithi107.stdout:6/562: dwrite d2/d3/d67/f4e [0,4194304] 0 2024-09-21T08:02:44.435 INFO:tasks.workunit.client.0.smithi107.stdout:6/563: write d2/d3/d7/d48/f68 [5254414,52603] 0 2024-09-21T08:02:44.435 INFO:tasks.workunit.client.0.smithi107.stdout:1/414: unlink d0/f12 0 2024-09-21T08:02:44.441 INFO:tasks.workunit.client.0.smithi107.stdout:6/564: creat d2/d3/d7/fb7 x:0 0 0 2024-09-21T08:02:44.442 INFO:tasks.workunit.client.0.smithi107.stdout:6/565: dread - d2/d3/f8a zero size 2024-09-21T08:02:44.443 INFO:tasks.workunit.client.0.smithi107.stdout:1/415: dread d0/f2 [4194304,4194304] 0 2024-09-21T08:02:44.445 INFO:tasks.workunit.client.0.smithi107.stdout:6/566: fsync d2/d3/d7/f42 0 2024-09-21T08:02:44.447 INFO:tasks.workunit.client.0.smithi107.stdout:1/416: creat d0/d19/d2b/f8b x:0 0 0 2024-09-21T08:02:44.447 INFO:tasks.workunit.client.0.smithi107.stdout:1/417: stat d0/d19/d2b/d4b/d1c/d5e 0 2024-09-21T08:02:44.448 INFO:tasks.workunit.client.0.smithi107.stdout:6/567: write d2/d3/d7/d24/f4a [4842041,109336] 0 2024-09-21T08:02:44.449 INFO:tasks.workunit.client.0.smithi107.stdout:1/418: mkdir d0/d29/d4d/d84/d8c 0 2024-09-21T08:02:44.449 INFO:tasks.workunit.client.0.smithi107.stdout:1/419: creat d0/f8d x:0 0 0 2024-09-21T08:02:44.451 INFO:tasks.workunit.client.0.smithi107.stdout:6/568: unlink d2/d3/d7/d23/c3a 0 2024-09-21T08:02:44.453 INFO:tasks.workunit.client.0.smithi107.stdout:6/569: rename d2/d3/d7/d3f/f6c to d2/d3/d7/d23/d2b/d84/fb8 0 2024-09-21T08:02:44.453 INFO:tasks.workunit.client.0.smithi107.stdout:6/570: creat d2/d3/d7/d3f/fb9 x:0 0 0 2024-09-21T08:02:44.453 INFO:tasks.workunit.client.0.smithi107.stdout:6/571: write d2/d2e/f4c [5802076,103927] 0 2024-09-21T08:02:44.454 INFO:tasks.workunit.client.0.smithi107.stdout:6/572: symlink d2/d2e/lba 0 2024-09-21T08:02:44.456 INFO:tasks.workunit.client.0.smithi107.stdout:6/573: fdatasync d2/d3/d7/d54/d5c/fa8 0 2024-09-21T08:02:44.456 INFO:tasks.workunit.client.0.smithi107.stdout:6/574: creat d2/d3/d7/d23/d2b/d84/fbb x:0 0 0 2024-09-21T08:02:44.464 INFO:tasks.workunit.client.0.smithi107.stdout:1/420: dwrite d0/d19/d2b/d4b/d61/d75/f7d [0,4194304] 0 2024-09-21T08:02:44.465 INFO:tasks.workunit.client.0.smithi107.stdout:1/421: fsync d0/d29/d31/f77 0 2024-09-21T08:02:44.465 INFO:tasks.workunit.client.0.smithi107.stdout:1/422: chown d0/d19/d2b/d86/l81 7 1 2024-09-21T08:02:44.465 INFO:tasks.workunit.client.0.smithi107.stdout:1/423: write d0/d19/f58 [678279,65367] 0 2024-09-21T08:02:44.465 INFO:tasks.workunit.client.0.smithi107.stdout:1/424: write d0/f3c [5217015,100888] 0 2024-09-21T08:02:44.476 INFO:tasks.workunit.client.0.smithi107.stdout:1/425: write d0/f3 [3246827,23713] 0 2024-09-21T08:02:44.486 INFO:tasks.workunit.client.0.smithi107.stdout:1/426: dread d0/d19/d2b/d4b/f4c [0,4194304] 0 2024-09-21T08:02:44.766 INFO:tasks.workunit.client.0.smithi107.stdout:1/427: rmdir d0/d19 39 2024-09-21T08:02:44.767 INFO:tasks.workunit.client.0.smithi107.stdout:1/428: rmdir d0/d19/d2b/d4b/d44/d72/d36 39 2024-09-21T08:02:44.769 INFO:tasks.workunit.client.0.smithi107.stdout:1/429: rename d0/d8a to d0/d19/d2b/d4b/d44/d72/d36/d8e 0 2024-09-21T08:02:44.770 INFO:tasks.workunit.client.0.smithi107.stdout:5/457: sync 2024-09-21T08:02:44.770 INFO:tasks.workunit.client.0.smithi107.stdout:4/365: sync 2024-09-21T08:02:44.771 INFO:tasks.workunit.client.0.smithi107.stdout:8/389: sync 2024-09-21T08:02:44.771 INFO:tasks.workunit.client.0.smithi107.stdout:8/390: write d5/d1d/f3a [203080,25012] 0 2024-09-21T08:02:44.771 INFO:tasks.workunit.client.0.smithi107.stdout:8/391: truncate d5/d2e/f39 1901187 0 2024-09-21T08:02:44.771 INFO:tasks.workunit.client.0.smithi107.stdout:3/398: sync 2024-09-21T08:02:44.771 INFO:tasks.workunit.client.0.smithi107.stdout:2/347: sync 2024-09-21T08:02:44.771 INFO:tasks.workunit.client.0.smithi107.stdout:6/575: sync 2024-09-21T08:02:44.771 INFO:tasks.workunit.client.0.smithi107.stdout:9/500: sync 2024-09-21T08:02:44.771 INFO:tasks.workunit.client.0.smithi107.stdout:0/385: sync 2024-09-21T08:02:44.772 INFO:tasks.workunit.client.0.smithi107.stdout:0/386: write d1/d5/f67 [770673,10408] 0 2024-09-21T08:02:44.772 INFO:tasks.workunit.client.0.smithi107.stdout:7/306: sync 2024-09-21T08:02:44.772 INFO:tasks.workunit.client.0.smithi107.stdout:7/307: chown d7/d22/d3d/f42 40 1 2024-09-21T08:02:44.774 INFO:tasks.workunit.client.0.smithi107.stdout:4/366: rename dc/f54 to dc/d13/f72 0 2024-09-21T08:02:44.775 INFO:tasks.workunit.client.0.smithi107.stdout:8/392: unlink d5/d38/f74 0 2024-09-21T08:02:44.776 INFO:tasks.workunit.client.0.smithi107.stdout:3/399: symlink d8/d21/d7e/l89 0 2024-09-21T08:02:44.776 INFO:tasks.workunit.client.0.smithi107.stdout:3/400: write d8/d21/f4c [1228465,68213] 0 2024-09-21T08:02:44.776 INFO:tasks.workunit.client.0.smithi107.stdout:3/401: read - d8/d25/d42/f86 zero size 2024-09-21T08:02:44.776 INFO:tasks.workunit.client.0.smithi107.stdout:3/402: stat d8/d2b/d45 0 2024-09-21T08:02:44.777 INFO:tasks.workunit.client.0.smithi107.stdout:2/348: truncate d1/f10 1240564 0 2024-09-21T08:02:44.779 INFO:tasks.workunit.client.0.smithi107.stdout:9/501: symlink d11/d27/d2f/d38/daa/lbd 0 2024-09-21T08:02:44.779 INFO:tasks.workunit.client.0.smithi107.stdout:0/387: truncate d1/d5/d25/d3d/d20/f53 119427 0 2024-09-21T08:02:44.781 INFO:tasks.workunit.client.0.smithi107.stdout:7/308: truncate d7/d38/f60 417113 0 2024-09-21T08:02:44.783 INFO:tasks.workunit.client.0.smithi107.stdout:4/367: rename dc/f1a to dc/d13/d40/d46/d48/d63/f73 0 2024-09-21T08:02:44.783 INFO:tasks.workunit.client.0.smithi107.stdout:8/393: mknod d5/d38/d67/c88 0 2024-09-21T08:02:44.786 INFO:tasks.workunit.client.0.smithi107.stdout:6/576: truncate d2/d3/d7/f1f 3995161 0 2024-09-21T08:02:44.787 INFO:tasks.workunit.client.0.smithi107.stdout:6/577: dread d2/d3/d7/d23/f6a [0,4194304] 0 2024-09-21T08:02:44.794 INFO:tasks.workunit.client.0.smithi107.stdout:0/388: getdents d1/d5 0 2024-09-21T08:02:44.794 INFO:tasks.workunit.client.0.smithi107.stdout:7/309: truncate f4 1208646 0 2024-09-21T08:02:44.794 INFO:tasks.workunit.client.0.smithi107.stdout:8/394: unlink d5/f61 0 2024-09-21T08:02:44.794 INFO:tasks.workunit.client.0.smithi107.stdout:4/368: dread dc/f50 [0,4194304] 0 2024-09-21T08:02:44.794 INFO:tasks.workunit.client.0.smithi107.stdout:4/369: chown dc/d13/d5a/c66 749318 1 2024-09-21T08:02:44.795 INFO:tasks.workunit.client.0.smithi107.stdout:4/370: fsync dc/d13/f5d 0 2024-09-21T08:02:44.795 INFO:tasks.workunit.client.0.smithi107.stdout:9/502: getdents d11/d27/d2f/d38 0 2024-09-21T08:02:44.795 INFO:tasks.workunit.client.0.smithi107.stdout:9/503: chown d11/d27/d2a/f63 7508 1 2024-09-21T08:02:44.795 INFO:tasks.workunit.client.0.smithi107.stdout:9/504: truncate d11/d24/d4a/fb5 981525 0 2024-09-21T08:02:44.799 INFO:tasks.workunit.client.0.smithi107.stdout:5/458: dwrite d7/de/d35/f57 [0,4194304] 0 2024-09-21T08:02:44.800 INFO:tasks.workunit.client.0.smithi107.stdout:5/459: write d7/de/d1d/d24/f4f [560976,78395] 0 2024-09-21T08:02:44.801 INFO:tasks.workunit.client.0.smithi107.stdout:8/395: truncate d5/d38/d56/f65 711812 0 2024-09-21T08:02:44.804 INFO:tasks.workunit.client.0.smithi107.stdout:7/310: creat d7/d22/d3d/f6e x:0 0 0 2024-09-21T08:02:44.804 INFO:tasks.workunit.client.0.smithi107.stdout:9/505: mkdir d11/d24/d26/dbe 0 2024-09-21T08:02:44.810 INFO:tasks.workunit.client.0.smithi107.stdout:3/403: creat d8/f8a x:0 0 0 2024-09-21T08:02:44.810 INFO:tasks.workunit.client.0.smithi107.stdout:3/404: write d8/d38/f3c [2088277,29596] 0 2024-09-21T08:02:44.812 INFO:tasks.workunit.client.0.smithi107.stdout:9/506: truncate f7 6606472 0 2024-09-21T08:02:44.820 INFO:tasks.workunit.client.0.smithi107.stdout:3/405: mknod d8/c8b 0 2024-09-21T08:02:44.820 INFO:tasks.workunit.client.0.smithi107.stdout:3/406: chown d8/d25/d3d/d72/d80/d5d/d67 1555596808 1 2024-09-21T08:02:44.820 INFO:tasks.workunit.client.0.smithi107.stdout:3/407: fsync d8/d2b/d52/d71/f84 0 2024-09-21T08:02:44.822 INFO:tasks.workunit.client.0.smithi107.stdout:0/389: rename d1/d5/f27 to d1/d5/d25/d3d/d20/d29/d55/d7a/f7f 0 2024-09-21T08:02:44.825 INFO:tasks.workunit.client.0.smithi107.stdout:0/390: readlink d1/d5/d25/d3d/d20/l42 0 2024-09-21T08:02:44.825 INFO:tasks.workunit.client.0.smithi107.stdout:0/391: fdatasync d1/d5/d25/d3d/d20/d29/d55/d7a/f7f 0 2024-09-21T08:02:44.826 INFO:tasks.workunit.client.0.smithi107.stdout:7/311: dwrite d7/d38/f41 [0,4194304] 0 2024-09-21T08:02:44.826 INFO:tasks.workunit.client.0.smithi107.stdout:7/312: fdatasync d7/d22/d3d/f6e 0 2024-09-21T08:02:44.826 INFO:tasks.workunit.client.0.smithi107.stdout:7/313: write d7/d22/d37/d40/d4d/f6a [219723,22380] 0 2024-09-21T08:02:44.827 INFO:tasks.workunit.client.0.smithi107.stdout:9/507: getdents d11/d27/d5e/d76 0 2024-09-21T08:02:44.827 INFO:tasks.workunit.client.0.smithi107.stdout:5/460: rename d7/de/f1a to d7/de/d2d/d5d/f9e 0 2024-09-21T08:02:44.829 INFO:tasks.workunit.client.0.smithi107.stdout:0/392: mkdir d1/d6f/d80 0 2024-09-21T08:02:44.835 INFO:tasks.workunit.client.0.smithi107.stdout:7/314: link d7/d10/d28/f59 d7/d22/d3a/d49/f6f 0 2024-09-21T08:02:44.835 INFO:tasks.workunit.client.0.smithi107.stdout:1/430: rmdir d0/d19/d59 39 2024-09-21T08:02:44.837 INFO:tasks.workunit.client.0.smithi107.stdout:8/396: dwrite d5/f6 [0,4194304] 0 2024-09-21T08:02:44.837 INFO:tasks.workunit.client.0.smithi107.stdout:7/315: dread d7/d38/f60 [0,4194304] 0 2024-09-21T08:02:44.840 INFO:tasks.workunit.client.0.smithi107.stdout:9/508: mkdir d11/d27/d2f/d38/dbf 0 2024-09-21T08:02:44.840 INFO:tasks.workunit.client.0.smithi107.stdout:9/509: chown d11/d27/d2f/d4d/d5c/d61/d8f/f81 25 1 2024-09-21T08:02:44.841 INFO:tasks.workunit.client.0.smithi107.stdout:9/510: fdatasync d11/d27/d2f/d4d/d5c/d61/d8f/f81 0 2024-09-21T08:02:44.842 INFO:tasks.workunit.client.0.smithi107.stdout:5/461: mknod d7/d74/c9f 0 2024-09-21T08:02:44.845 INFO:tasks.workunit.client.0.smithi107.stdout:1/431: mknod d0/d19/d2b/d4b/d44/d72/d36/c8f 0 2024-09-21T08:02:44.845 INFO:tasks.workunit.client.0.smithi107.stdout:1/432: chown d0/d29/d2c 8 1 2024-09-21T08:02:44.848 INFO:tasks.workunit.client.0.smithi107.stdout:2/349: truncate d1/f10 1512262 0 2024-09-21T08:02:44.848 INFO:tasks.workunit.client.0.smithi107.stdout:3/408: dwrite d8/d2b/f3f [0,4194304] 0 2024-09-21T08:02:44.849 INFO:tasks.workunit.client.0.smithi107.stdout:8/397: mkdir d5/d2e/d89 0 2024-09-21T08:02:44.849 INFO:tasks.workunit.client.0.smithi107.stdout:3/409: write d8/d38/f3c [1556758,76465] 0 2024-09-21T08:02:44.854 INFO:tasks.workunit.client.0.smithi107.stdout:7/316: rename d7/d10/d28/l61 to d7/d22/d37/d4b/d4e/l70 0 2024-09-21T08:02:44.854 INFO:tasks.workunit.client.0.smithi107.stdout:7/317: stat d7/d22/f2d 0 2024-09-21T08:02:44.854 INFO:tasks.workunit.client.0.smithi107.stdout:7/318: write d7/d22/d3d/f51 [54927,49811] 0 2024-09-21T08:02:44.854 INFO:tasks.workunit.client.0.smithi107.stdout:7/319: write d7/d22/f5c [1502475,128722] 0 2024-09-21T08:02:44.859 INFO:tasks.workunit.client.0.smithi107.stdout:5/462: mknod d7/de/d52/d8b/ca0 0 2024-09-21T08:02:44.859 INFO:tasks.workunit.client.0.smithi107.stdout:1/433: mkdir d0/d19/d2b/d4b/d90 0 2024-09-21T08:02:44.862 INFO:tasks.workunit.client.0.smithi107.stdout:8/398: mkdir d5/d40/d8a 0 2024-09-21T08:02:44.862 INFO:tasks.workunit.client.0.smithi107.stdout:8/399: chown d5/d44/d5d/f68 426349332 1 2024-09-21T08:02:44.863 INFO:tasks.workunit.client.0.smithi107.stdout:9/511: rename d11/d24/f9a to d11/d24/d4a/d9f/fc0 0 2024-09-21T08:02:44.863 INFO:tasks.workunit.client.0.smithi107.stdout:9/512: readlink d11/d27/d2f/l7b 0 2024-09-21T08:02:44.867 INFO:tasks.workunit.client.0.smithi107.stdout:5/463: creat d7/de/d2d/d5d/fa1 x:0 0 0 2024-09-21T08:02:44.867 INFO:tasks.workunit.client.0.smithi107.stdout:7/320: symlink d7/d22/d37/d4b/l71 0 2024-09-21T08:02:44.867 INFO:tasks.workunit.client.0.smithi107.stdout:7/321: fdatasync d7/d22/d37/d4b/f5e 0 2024-09-21T08:02:44.871 INFO:tasks.workunit.client.0.smithi107.stdout:1/434: creat d0/d19/d59/f91 x:0 0 0 2024-09-21T08:02:44.875 INFO:tasks.workunit.client.0.smithi107.stdout:9/513: stat d11/d27/d2f/d4d/d5c/d61/d8f/cb2 0 2024-09-21T08:02:44.877 INFO:tasks.workunit.client.0.smithi107.stdout:5/464: getdents d7/de/d2d 0 2024-09-21T08:02:44.879 INFO:tasks.workunit.client.0.smithi107.stdout:2/350: dwrite d1/d2/d6d/d37/d49/f77 [0,4194304] 0 2024-09-21T08:02:44.883 INFO:tasks.workunit.client.0.smithi107.stdout:1/435: symlink d0/d19/d2b/d4b/d44/d55/l92 0 2024-09-21T08:02:44.885 INFO:tasks.workunit.client.0.smithi107.stdout:9/514: link d11/d27/d98/f7c d11/d24/d35/fc1 0 2024-09-21T08:02:44.885 INFO:tasks.workunit.client.0.smithi107.stdout:9/515: truncate d11/d24/d35/f49 1108917 0 2024-09-21T08:02:44.885 INFO:tasks.workunit.client.0.smithi107.stdout:0/393: dwrite d1/d5/d25/d3d/d20/f53 [0,4194304] 0 2024-09-21T08:02:44.887 INFO:tasks.workunit.client.0.smithi107.stdout:8/400: dwrite d5/d1d/f1e [0,4194304] 0 2024-09-21T08:02:44.887 INFO:tasks.workunit.client.0.smithi107.stdout:8/401: chown d5/f14 6484 1 2024-09-21T08:02:44.889 INFO:tasks.workunit.client.0.smithi107.stdout:5/465: symlink d7/de/d1d/la2 0 2024-09-21T08:02:44.896 INFO:tasks.workunit.client.0.smithi107.stdout:2/351: rename d1/d1e/c2a to d1/d1e/c7b 0 2024-09-21T08:02:44.898 INFO:tasks.workunit.client.0.smithi107.stdout:7/322: getdents d7/d22/d3d 0 2024-09-21T08:02:44.902 INFO:tasks.workunit.client.0.smithi107.stdout:1/436: creat d0/d19/f93 x:0 0 0 2024-09-21T08:02:44.902 INFO:tasks.workunit.client.0.smithi107.stdout:1/437: write d0/d19/d59/f91 [255330,90918] 0 2024-09-21T08:02:44.904 INFO:tasks.workunit.client.0.smithi107.stdout:7/323: dread d7/d22/f24 [0,4194304] 0 2024-09-21T08:02:44.905 INFO:tasks.workunit.client.0.smithi107.stdout:9/516: link d11/d27/d2f/fa3 d11/d27/d5b/fc2 0 2024-09-21T08:02:44.906 INFO:tasks.workunit.client.0.smithi107.stdout:0/394: dwrite d1/d5/d25/d3d/d20/d29/d55/f58 [0,4194304] 0 2024-09-21T08:02:44.914 INFO:tasks.workunit.client.0.smithi107.stdout:8/402: rename d5/d1d/l34 to d5/d38/l8b 0 2024-09-21T08:02:44.917 INFO:tasks.workunit.client.0.smithi107.stdout:2/352: symlink d1/d2/d6d/d42/d76/l7c 0 2024-09-21T08:02:44.919 INFO:tasks.workunit.client.0.smithi107.stdout:7/324: mknod d7/d22/d37/d5a/c72 0 2024-09-21T08:02:44.919 INFO:tasks.workunit.client.0.smithi107.stdout:7/325: fdatasync f4 0 2024-09-21T08:02:44.924 INFO:tasks.workunit.client.0.smithi107.stdout:8/403: mknod d5/d38/d67/d7d/c8c 0 2024-09-21T08:02:44.924 INFO:tasks.workunit.client.0.smithi107.stdout:8/404: fsync d5/d44/d46/f6a 0 2024-09-21T08:02:44.924 INFO:tasks.workunit.client.0.smithi107.stdout:8/405: write d5/d44/d5d/f68 [133260,76619] 0 2024-09-21T08:02:44.925 INFO:tasks.workunit.client.0.smithi107.stdout:7/326: link d7/d22/l32 d7/d22/d37/d5a/l73 0 2024-09-21T08:02:44.926 INFO:tasks.workunit.client.0.smithi107.stdout:1/438: dwrite d0/d29/d31/f42 [4194304,4194304] 0 2024-09-21T08:02:44.941 INFO:tasks.workunit.client.0.smithi107.stdout:9/517: dwrite d11/f37 [4194304,4194304] 0 2024-09-21T08:02:44.945 INFO:tasks.workunit.client.0.smithi107.stdout:2/353: dwrite d1/d2/d6d/d37/d49/f5e [0,4194304] 0 2024-09-21T08:02:44.946 INFO:tasks.workunit.client.0.smithi107.stdout:2/354: dread d1/d1e/f3e [0,4194304] 0 2024-09-21T08:02:44.947 INFO:tasks.workunit.client.0.smithi107.stdout:1/439: dwrite d0/f8d [0,4194304] 0 2024-09-21T08:02:44.947 INFO:tasks.workunit.client.0.smithi107.stdout:1/440: write d0/d19/d2b/f8b [71726,73997] 0 2024-09-21T08:02:44.951 INFO:tasks.workunit.client.0.smithi107.stdout:7/327: dread d7/d22/f5c [0,4194304] 0 2024-09-21T08:02:44.962 INFO:tasks.workunit.client.0.smithi107.stdout:7/328: read d7/d22/d3d/f42 [2989863,59670] 0 2024-09-21T08:02:44.983 INFO:tasks.workunit.client.0.smithi107.stdout:0/395: creat d1/d5/d75/f81 x:0 0 0 2024-09-21T08:02:44.984 INFO:tasks.workunit.client.0.smithi107.stdout:5/466: rename d7/de/d35/d9b to d7/de/da3 0 2024-09-21T08:02:44.984 INFO:tasks.workunit.client.0.smithi107.stdout:2/355: rename d1/d16/d35 to d1/d16/d35/d7d 22 2024-09-21T08:02:44.985 INFO:tasks.workunit.client.0.smithi107.stdout:8/406: readlink d5/l1c 0 2024-09-21T08:02:44.985 INFO:tasks.workunit.client.0.smithi107.stdout:8/407: fdatasync d5/d1d/f26 0 2024-09-21T08:02:44.985 INFO:tasks.workunit.client.0.smithi107.stdout:8/408: chown d5/d2e/c33 613053587 1 2024-09-21T08:02:44.985 INFO:tasks.workunit.client.0.smithi107.stdout:8/409: readlink d5/d23/l7e 0 2024-09-21T08:02:44.985 INFO:tasks.workunit.client.0.smithi107.stdout:8/410: write d5/f21 [3449148,43805] 0 2024-09-21T08:02:44.986 INFO:tasks.workunit.client.0.smithi107.stdout:9/518: symlink d11/d27/d98/d97/lc3 0 2024-09-21T08:02:45.007 INFO:tasks.workunit.client.0.smithi107.stdout:1/441: symlink d0/d29/d2c/l94 0 2024-09-21T08:02:45.008 INFO:tasks.workunit.client.0.smithi107.stdout:7/329: creat d7/d22/d3a/d49/f74 x:0 0 0 2024-09-21T08:02:45.015 INFO:tasks.workunit.client.0.smithi107.stdout:2/356: symlink d1/d2/d6d/l7e 0 2024-09-21T08:02:45.017 INFO:tasks.workunit.client.0.smithi107.stdout:8/411: creat d5/d40/f8d x:0 0 0 2024-09-21T08:02:45.018 INFO:tasks.workunit.client.0.smithi107.stdout:8/412: write d5/d1d/f5b [837644,40429] 0 2024-09-21T08:02:45.018 INFO:tasks.workunit.client.0.smithi107.stdout:9/519: mknod d11/d27/d2f/d38/dbf/cc4 0 2024-09-21T08:02:45.018 INFO:tasks.workunit.client.0.smithi107.stdout:9/520: chown d11/d27/d98/f7c 22922944 1 2024-09-21T08:02:45.018 INFO:tasks.workunit.client.0.smithi107.stdout:9/521: chown d11/d27/d2f/d38/fba 3615 1 2024-09-21T08:02:45.018 INFO:tasks.workunit.client.0.smithi107.stdout:9/522: write d11/d24/d35/f6f [1029635,30983] 0 2024-09-21T08:02:45.023 INFO:tasks.workunit.client.0.smithi107.stdout:9/523: read d11/d24/d35/f49 [216436,100494] 0 2024-09-21T08:02:45.024 INFO:tasks.workunit.client.0.smithi107.stdout:0/396: dread d1/d5/f2c [4194304,4194304] 0 2024-09-21T08:02:45.024 INFO:tasks.workunit.client.0.smithi107.stdout:9/524: write d11/d27/d98/f6c [357709,45018] 0 2024-09-21T08:02:45.036 INFO:tasks.workunit.client.0.smithi107.stdout:5/467: getdents d7/de/d35 0 2024-09-21T08:02:45.036 INFO:tasks.workunit.client.0.smithi107.stdout:5/468: fdatasync d7/f34 0 2024-09-21T08:02:45.036 INFO:tasks.workunit.client.0.smithi107.stdout:5/469: fsync d7/de/d35/f42 0 2024-09-21T08:02:45.036 INFO:tasks.workunit.client.0.smithi107.stdout:5/470: read - d7/de/d1d/f48 zero size 2024-09-21T08:02:45.037 INFO:tasks.workunit.client.0.smithi107.stdout:8/413: creat d5/f8e x:0 0 0 2024-09-21T08:02:45.040 INFO:tasks.workunit.client.0.smithi107.stdout:7/330: dwrite d7/d10/d28/f2f [0,4194304] 0 2024-09-21T08:02:45.040 INFO:tasks.workunit.client.0.smithi107.stdout:9/525: mkdir d11/d27/d2f/d4d/d92/dc5 0 2024-09-21T08:02:45.043 INFO:tasks.workunit.client.0.smithi107.stdout:5/471: symlink d7/de/d35/la4 0 2024-09-21T08:02:45.044 INFO:tasks.workunit.client.0.smithi107.stdout:8/414: getdents d5/d38/d56/d52/d7a 0 2024-09-21T08:02:45.044 INFO:tasks.workunit.client.0.smithi107.stdout:8/415: dread - d5/d44/d46/f6a zero size 2024-09-21T08:02:45.044 INFO:tasks.workunit.client.0.smithi107.stdout:8/416: chown d5/d2e/f51 281993500 1 2024-09-21T08:02:45.046 INFO:tasks.workunit.client.0.smithi107.stdout:0/397: unlink d1/d5/f24 0 2024-09-21T08:02:45.049 INFO:tasks.workunit.client.0.smithi107.stdout:7/331: link d7/d22/c43 d7/d22/d37/d4b/c75 0 2024-09-21T08:02:45.050 INFO:tasks.workunit.client.0.smithi107.stdout:9/526: mknod d11/d24/d4a/cc6 0 2024-09-21T08:02:45.053 INFO:tasks.workunit.client.0.smithi107.stdout:5/472: creat d7/de/d1d/d29/d64/d87/fa5 x:0 0 0 2024-09-21T08:02:45.055 INFO:tasks.workunit.client.0.smithi107.stdout:8/417: rename d5/d44/d47/d5e/f6d to d5/d38/d56/d52/f8f 0 2024-09-21T08:02:45.056 INFO:tasks.workunit.client.0.smithi107.stdout:0/398: chown d1/d5/d79 11 1 2024-09-21T08:02:45.056 INFO:tasks.workunit.client.0.smithi107.stdout:0/399: truncate d1/d5/d25/d2d/f2f 8541494 0 2024-09-21T08:02:45.059 INFO:tasks.workunit.client.0.smithi107.stdout:7/332: creat d7/d22/f76 x:0 0 0 2024-09-21T08:02:45.061 INFO:tasks.workunit.client.0.smithi107.stdout:8/418: getdents d5/d38/d56 0 2024-09-21T08:02:45.065 INFO:tasks.workunit.client.0.smithi107.stdout:5/473: rename d7/de/d1d/d29/f40 to d7/de/d2d/d5d/d60/fa6 0 2024-09-21T08:02:45.065 INFO:tasks.workunit.client.0.smithi107.stdout:5/474: fdatasync d7/de/f1b 0 2024-09-21T08:02:45.066 INFO:tasks.workunit.client.0.smithi107.stdout:8/419: mkdir d5/d1d/d90 0 2024-09-21T08:02:45.066 INFO:tasks.workunit.client.0.smithi107.stdout:8/420: truncate d5/f5c 5237646 0 2024-09-21T08:02:45.067 INFO:tasks.workunit.client.0.smithi107.stdout:7/333: mknod d7/c77 0 2024-09-21T08:02:45.070 INFO:tasks.workunit.client.0.smithi107.stdout:5/475: rmdir d7/d70/d73 0 2024-09-21T08:02:45.072 INFO:tasks.workunit.client.0.smithi107.stdout:5/476: getdents d7/de/d1d/d24 0 2024-09-21T08:02:45.072 INFO:tasks.workunit.client.0.smithi107.stdout:5/477: stat d7/de/d1d/d29/d64/f89 0 2024-09-21T08:02:45.075 INFO:tasks.workunit.client.0.smithi107.stdout:7/334: symlink d7/d38/l78 0 2024-09-21T08:02:45.075 INFO:tasks.workunit.client.0.smithi107.stdout:5/478: dread d7/de/f30 [0,4194304] 0 2024-09-21T08:02:45.075 INFO:tasks.workunit.client.0.smithi107.stdout:5/479: read - d7/de/d1d/d24/f58 zero size 2024-09-21T08:02:45.076 INFO:tasks.workunit.client.0.smithi107.stdout:7/335: symlink d7/d22/d3a/l79 0 2024-09-21T08:02:45.076 INFO:tasks.workunit.client.0.smithi107.stdout:7/336: creat d7/d22/d3a/f7a x:0 0 0 2024-09-21T08:02:45.083 INFO:tasks.workunit.client.0.smithi107.stdout:5/480: read d7/de/d1d/d24/f8c [35555,19691] 0 2024-09-21T08:02:45.083 INFO:tasks.workunit.client.0.smithi107.stdout:5/481: write d7/de/d1d/d24/d3d/d65/f94 [470265,81218] 0 2024-09-21T08:02:45.084 INFO:tasks.workunit.client.0.smithi107.stdout:7/337: dread d7/f13 [4194304,4194304] 0 2024-09-21T08:02:45.086 INFO:tasks.workunit.client.0.smithi107.stdout:5/482: rename d7/de/f62 to d7/fa7 0 2024-09-21T08:02:45.086 INFO:tasks.workunit.client.0.smithi107.stdout:5/483: chown d7 6752 1 2024-09-21T08:02:45.088 INFO:tasks.workunit.client.0.smithi107.stdout:5/484: symlink d7/de/d1d/la8 0 2024-09-21T08:02:45.088 INFO:tasks.workunit.client.0.smithi107.stdout:5/485: write d7/f39 [1263831,117204] 0 2024-09-21T08:02:45.092 INFO:tasks.workunit.client.0.smithi107.stdout:7/338: dread d7/f3f [0,4194304] 0 2024-09-21T08:02:45.092 INFO:tasks.workunit.client.0.smithi107.stdout:7/339: readlink d7/d10/l1c 0 2024-09-21T08:02:45.093 INFO:tasks.workunit.client.0.smithi107.stdout:7/340: mknod d7/d22/d3a/c7b 0 2024-09-21T08:02:45.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:44 smithi129 ceph-mon[34472]: pgmap v14: 65 pgs: 65 active+clean; 2.8 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 317 MiB/s rd, 387 MiB/s wr, 535 op/s 2024-09-21T08:02:45.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:44 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:45.271 INFO:tasks.workunit.client.0.smithi107.stdout:2/357: dwrite d1/d1e/f5c [0,4194304] 0 2024-09-21T08:02:45.271 INFO:tasks.workunit.client.0.smithi107.stdout:2/358: write d1/d2/d6d/f52 [601320,95487] 0 2024-09-21T08:02:45.273 INFO:tasks.workunit.client.0.smithi107.stdout:2/359: mkdir d1/d2/d6d/d37/d49/d7f 0 2024-09-21T08:02:45.278 INFO:tasks.workunit.client.0.smithi107.stdout:5/486: dwrite d7/de/d1d/d29/d64/f89 [0,4194304] 0 2024-09-21T08:02:45.278 INFO:tasks.workunit.client.0.smithi107.stdout:8/421: dwrite d5/f19 [0,4194304] 0 2024-09-21T08:02:45.278 INFO:tasks.workunit.client.0.smithi107.stdout:2/360: rename d1/d2/d6d/d37/d49/f5e to d1/d16/f80 0 2024-09-21T08:02:45.283 INFO:tasks.workunit.client.0.smithi107.stdout:5/487: link d7/de/c3e d7/de/d1d/d24/d3d/d65/ca9 0 2024-09-21T08:02:45.284 INFO:tasks.workunit.client.0.smithi107.stdout:2/361: symlink d1/d2/d6d/d37/d49/l81 0 2024-09-21T08:02:45.284 INFO:tasks.workunit.client.0.smithi107.stdout:2/362: chown d1/d2/d6d/d37/d49/d7f 53 1 2024-09-21T08:02:45.284 INFO:tasks.workunit.client.0.smithi107.stdout:8/422: dread d5/f12 [0,4194304] 0 2024-09-21T08:02:45.287 INFO:tasks.workunit.client.0.smithi107.stdout:5/488: symlink d7/de/d2d/d5d/d60/laa 0 2024-09-21T08:02:45.295 INFO:tasks.workunit.client.0.smithi107.stdout:7/341: getdents d7/d22/d37/d4b 0 2024-09-21T08:02:45.297 INFO:tasks.workunit.client.0.smithi107.stdout:7/342: creat d7/d22/d3d/f7c x:0 0 0 2024-09-21T08:02:45.298 INFO:tasks.workunit.client.0.smithi107.stdout:7/343: creat d7/d38/f7d x:0 0 0 2024-09-21T08:02:45.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:44 smithi107 ceph-mon[27622]: pgmap v14: 65 pgs: 65 active+clean; 2.8 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 317 MiB/s rd, 387 MiB/s wr, 535 op/s 2024-09-21T08:02:45.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:44 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:45.305 INFO:tasks.workunit.client.0.smithi107.stdout:5/489: getdents d7/de/d1d/d29/d64/d87 0 2024-09-21T08:02:45.309 INFO:tasks.workunit.client.0.smithi107.stdout:2/363: dwrite d1/f3 [0,4194304] 0 2024-09-21T08:02:45.309 INFO:tasks.workunit.client.0.smithi107.stdout:2/364: chown d1/d2/d6d/d37/d49/l81 106419692 1 2024-09-21T08:02:45.309 INFO:tasks.workunit.client.0.smithi107.stdout:8/423: dwrite d5/f1b [0,4194304] 0 2024-09-21T08:02:45.313 INFO:tasks.workunit.client.0.smithi107.stdout:8/424: mkdir d5/d38/d67/d7d/d91 0 2024-09-21T08:02:45.314 INFO:tasks.workunit.client.0.smithi107.stdout:2/365: mkdir d1/d2/d6d/d37/d82 0 2024-09-21T08:02:45.315 INFO:tasks.workunit.client.0.smithi107.stdout:2/366: write d1/d16/f41 [281735,105420] 0 2024-09-21T08:02:45.317 INFO:tasks.workunit.client.0.smithi107.stdout:8/425: unlink d5/d23/l58 0 2024-09-21T08:02:45.318 INFO:tasks.workunit.client.0.smithi107.stdout:8/426: unlink d5/d1d/l64 0 2024-09-21T08:02:45.320 INFO:tasks.workunit.client.0.smithi107.stdout:5/490: dwrite d7/de/d1d/f5b [0,4194304] 0 2024-09-21T08:02:45.321 INFO:tasks.workunit.client.0.smithi107.stdout:5/491: symlink d7/de/d1d/d24/d3d/d65/lab 0 2024-09-21T08:02:45.337 INFO:tasks.workunit.client.0.smithi107.stdout:2/367: dwrite d1/d16/f55 [0,4194304] 0 2024-09-21T08:02:45.337 INFO:tasks.workunit.client.0.smithi107.stdout:2/368: chown d1/d1e/c6a 16379731 1 2024-09-21T08:02:45.348 INFO:tasks.workunit.client.0.smithi107.stdout:8/427: dwrite d5/d1d/f26 [4194304,4194304] 0 2024-09-21T08:02:45.351 INFO:tasks.workunit.client.0.smithi107.stdout:2/369: dread d1/d16/f55 [0,4194304] 0 2024-09-21T08:02:45.351 INFO:tasks.workunit.client.0.smithi107.stdout:2/370: readlink d1/d16/l4c 0 2024-09-21T08:02:45.351 INFO:tasks.workunit.client.0.smithi107.stdout:5/492: dwrite d7/de/d1d/d24/d3d/d65/f94 [0,4194304] 0 2024-09-21T08:02:45.351 INFO:tasks.workunit.client.0.smithi107.stdout:5/493: readlink d7/de/d1d/d24/l36 0 2024-09-21T08:02:45.351 INFO:tasks.workunit.client.0.smithi107.stdout:5/494: dread - d7/de/d1d/d24/d3d/f8f zero size 2024-09-21T08:02:45.352 INFO:tasks.workunit.client.0.smithi107.stdout:7/344: rmdir d7/d38 39 2024-09-21T08:02:45.358 INFO:tasks.workunit.client.0.smithi107.stdout:2/371: creat d1/d2/d6d/d37/d49/f83 x:0 0 0 2024-09-21T08:02:45.359 INFO:tasks.workunit.client.0.smithi107.stdout:5/495: symlink d7/d74/lac 0 2024-09-21T08:02:45.362 INFO:tasks.workunit.client.0.smithi107.stdout:7/345: rename d7/f52 to d7/d22/d37/d4b/f7e 0 2024-09-21T08:02:45.366 INFO:tasks.workunit.client.0.smithi107.stdout:8/428: rmdir d5/d38 39 2024-09-21T08:02:45.371 INFO:tasks.workunit.client.0.smithi107.stdout:7/346: symlink d7/d38/l7f 0 2024-09-21T08:02:45.373 INFO:tasks.workunit.client.0.smithi107.stdout:5/496: dwrite d7/de/d1d/d29/d64/f9c [0,4194304] 0 2024-09-21T08:02:45.373 INFO:tasks.workunit.client.0.smithi107.stdout:7/347: creat d7/d10/d64/f80 x:0 0 0 2024-09-21T08:02:45.378 INFO:tasks.workunit.client.0.smithi107.stdout:5/497: rename d7/de/d1d/d24/f58 to d7/fad 0 2024-09-21T08:02:45.379 INFO:tasks.workunit.client.0.smithi107.stdout:7/348: creat d7/d22/d37/d4b/d4e/f81 x:0 0 0 2024-09-21T08:02:45.381 INFO:tasks.workunit.client.0.smithi107.stdout:5/498: unlink d7/de/d2d/l59 0 2024-09-21T08:02:45.383 INFO:tasks.workunit.client.0.smithi107.stdout:5/499: unlink d7/de/d1d/c3f 0 2024-09-21T08:02:45.385 INFO:tasks.workunit.client.0.smithi107.stdout:7/349: rename d7/d22/d37/d4b/l68 to d7/d10/l82 0 2024-09-21T08:02:45.387 INFO:tasks.workunit.client.0.smithi107.stdout:7/350: mkdir d7/d22/d37/d5a/d83 0 2024-09-21T08:02:45.387 INFO:tasks.workunit.client.0.smithi107.stdout:5/500: rmdir d7/de/d2d/d5d 39 2024-09-21T08:02:45.389 INFO:tasks.workunit.client.0.smithi107.stdout:8/429: dwrite d5/d2e/f77 [0,4194304] 0 2024-09-21T08:02:45.389 INFO:tasks.workunit.client.0.smithi107.stdout:8/430: chown d5/d23/f35 287 1 2024-09-21T08:02:45.390 INFO:tasks.workunit.client.0.smithi107.stdout:7/351: link d7/d22/d3a/d49/d56/c63 d7/d22/d37/d5a/c84 0 2024-09-21T08:02:45.390 INFO:tasks.workunit.client.0.smithi107.stdout:5/501: write d7/de/d2d/d5d/d60/f81 [470017,91905] 0 2024-09-21T08:02:45.397 INFO:tasks.workunit.client.0.smithi107.stdout:7/352: symlink d7/d18/l85 0 2024-09-21T08:02:45.397 INFO:tasks.workunit.client.0.smithi107.stdout:7/353: chown d7/d10/c30 220664195 1 2024-09-21T08:02:45.402 INFO:tasks.workunit.client.0.smithi107.stdout:7/354: getdents d7/d22/d3d 0 2024-09-21T08:02:45.402 INFO:tasks.workunit.client.0.smithi107.stdout:7/355: chown d7/d22/d37/d4b/d4e 8 1 2024-09-21T08:02:45.402 INFO:tasks.workunit.client.0.smithi107.stdout:7/356: chown d7 15148956 1 2024-09-21T08:02:45.402 INFO:tasks.workunit.client.0.smithi107.stdout:5/502: write d7/de/d2d/d5d/f9e [6668298,91466] 0 2024-09-21T08:02:45.404 INFO:tasks.workunit.client.0.smithi107.stdout:5/503: creat d7/de/d1d/d24/fae x:0 0 0 2024-09-21T08:02:45.406 INFO:tasks.workunit.client.0.smithi107.stdout:5/504: getdents d7/de 0 2024-09-21T08:02:45.406 INFO:tasks.workunit.client.0.smithi107.stdout:5/505: write d7/de/d2d/d5d/fa1 [1019275,51847] 0 2024-09-21T08:02:45.408 INFO:tasks.workunit.client.0.smithi107.stdout:5/506: link d7/d74/lac d7/de/d1d/d24/d3d/laf 0 2024-09-21T08:02:45.408 INFO:tasks.workunit.client.0.smithi107.stdout:5/507: truncate d7/de/d52/d6b/f92 585496 0 2024-09-21T08:02:45.409 INFO:tasks.workunit.client.0.smithi107.stdout:5/508: creat d7/de/d52/fb0 x:0 0 0 2024-09-21T08:02:45.410 INFO:tasks.workunit.client.0.smithi107.stdout:8/431: dwrite d5/f21 [4194304,4194304] 0 2024-09-21T08:02:45.413 INFO:tasks.workunit.client.0.smithi107.stdout:5/509: rename d7/de/d1d/d24/d3d/f56 to d7/de/d2d/d5d/d60/fb1 0 2024-09-21T08:02:45.415 INFO:tasks.workunit.client.0.smithi107.stdout:5/510: mknod d7/de/d1d/d29/cb2 0 2024-09-21T08:02:45.415 INFO:tasks.workunit.client.0.smithi107.stdout:5/511: write d7/de/f99 [256846,65514] 0 2024-09-21T08:02:45.416 INFO:tasks.workunit.client.0.smithi107.stdout:5/512: rename d7/de/d52/l54 to d7/de/d52/d6b/lb3 0 2024-09-21T08:02:45.416 INFO:tasks.workunit.client.0.smithi107.stdout:5/513: stat d7/de/d1d/d29/d64 0 2024-09-21T08:02:45.418 INFO:tasks.workunit.client.0.smithi107.stdout:5/514: mknod d7/cb4 0 2024-09-21T08:02:45.418 INFO:tasks.workunit.client.0.smithi107.stdout:5/515: creat d7/de/d1d/d29/d64/fb5 x:0 0 0 2024-09-21T08:02:45.418 INFO:tasks.workunit.client.0.smithi107.stdout:5/516: readlink d7/de/d1d/d29/d68/l6a 0 2024-09-21T08:02:45.418 INFO:tasks.workunit.client.0.smithi107.stdout:7/357: dwrite d7/d18/f19 [4194304,4194304] 0 2024-09-21T08:02:45.431 INFO:tasks.workunit.client.0.smithi107.stdout:5/517: unlink d7/de/d2d/l4b 0 2024-09-21T08:02:45.434 INFO:tasks.workunit.client.0.smithi107.stdout:7/358: rmdir d7/d22/d37/d4b/d4e/d4f 39 2024-09-21T08:02:45.434 INFO:tasks.workunit.client.0.smithi107.stdout:7/359: chown d7/c44 427623 1 2024-09-21T08:02:45.434 INFO:tasks.workunit.client.0.smithi107.stdout:7/360: dread - d7/d22/d37/d4b/f4c zero size 2024-09-21T08:02:45.436 INFO:tasks.workunit.client.0.smithi107.stdout:5/518: rmdir d7/de/d1d 39 2024-09-21T08:02:45.436 INFO:tasks.workunit.client.0.smithi107.stdout:5/519: write d7/ff [3649600,7871] 0 2024-09-21T08:02:45.437 INFO:tasks.workunit.client.0.smithi107.stdout:7/361: symlink d7/d22/d37/l86 0 2024-09-21T08:02:45.437 INFO:tasks.workunit.client.0.smithi107.stdout:7/362: write d7/d38/f41 [4451780,71383] 0 2024-09-21T08:02:45.440 INFO:tasks.workunit.client.0.smithi107.stdout:7/363: dread d7/d10/d28/f59 [0,4194304] 0 2024-09-21T08:02:45.440 INFO:tasks.workunit.client.0.smithi107.stdout:7/364: chown d7/d10/l82 1433 1 2024-09-21T08:02:45.442 INFO:tasks.workunit.client.0.smithi107.stdout:7/365: mknod d7/d22/d3a/c87 0 2024-09-21T08:02:45.444 INFO:tasks.workunit.client.0.smithi107.stdout:5/520: dread d7/de/d1d/d29/d64/f89 [0,4194304] 0 2024-09-21T08:02:45.445 INFO:tasks.workunit.client.0.smithi107.stdout:7/366: link d7/d18/c1b d7/d10/d64/c88 0 2024-09-21T08:02:45.447 INFO:tasks.workunit.client.0.smithi107.stdout:5/521: creat d7/de/d1d/fb6 x:0 0 0 2024-09-21T08:02:45.448 INFO:tasks.workunit.client.0.smithi107.stdout:7/367: truncate d7/f3f 841957 0 2024-09-21T08:02:45.449 INFO:tasks.workunit.client.0.smithi107.stdout:5/522: mknod d7/de/d1d/d29/d68/cb7 0 2024-09-21T08:02:45.451 INFO:tasks.workunit.client.0.smithi107.stdout:5/523: rename d7/de/d1d/d29/f88 to d7/de/d2d/d5d/d60/fb8 0 2024-09-21T08:02:45.451 INFO:tasks.workunit.client.0.smithi107.stdout:5/524: stat d7/de/d1d/f5b 0 2024-09-21T08:02:45.451 INFO:tasks.workunit.client.0.smithi107.stdout:5/525: fsync d7/f34 0 2024-09-21T08:02:45.456 INFO:tasks.workunit.client.0.smithi107.stdout:5/526: getdents d7/de/d52/d6b 0 2024-09-21T08:02:45.456 INFO:tasks.workunit.client.0.smithi107.stdout:5/527: chown d7/de/d1d/d29/d64/f9c 459976 1 2024-09-21T08:02:45.463 INFO:tasks.workunit.client.0.smithi107.stdout:7/368: dwrite d7/d10/d28/f59 [0,4194304] 0 2024-09-21T08:02:45.465 INFO:tasks.workunit.client.0.smithi107.stdout:7/369: symlink d7/d10/d64/l89 0 2024-09-21T08:02:45.465 INFO:tasks.workunit.client.0.smithi107.stdout:7/370: fdatasync d7/d10/f55 0 2024-09-21T08:02:45.467 INFO:tasks.workunit.client.0.smithi107.stdout:7/371: dread d7/d10/f17 [0,4194304] 0 2024-09-21T08:02:45.467 INFO:tasks.workunit.client.0.smithi107.stdout:7/372: readlink d7/d22/d37/l86 0 2024-09-21T08:02:45.468 INFO:tasks.workunit.client.0.smithi107.stdout:7/373: unlink d7/d10/d64/f80 0 2024-09-21T08:02:45.472 INFO:tasks.workunit.client.0.smithi107.stdout:5/528: dwrite d7/de/d52/d6b/f7e [0,4194304] 0 2024-09-21T08:02:45.475 INFO:tasks.workunit.client.0.smithi107.stdout:7/374: dread d7/d22/d3b/f47 [0,4194304] 0 2024-09-21T08:02:45.479 INFO:tasks.workunit.client.0.smithi107.stdout:7/375: mkdir d7/d22/d3d/d8a 0 2024-09-21T08:02:45.480 INFO:tasks.workunit.client.0.smithi107.stdout:7/376: dread d7/d38/f60 [0,4194304] 0 2024-09-21T08:02:45.480 INFO:tasks.workunit.client.0.smithi107.stdout:7/377: truncate d7/d38/f7d 706881 0 2024-09-21T08:02:45.483 INFO:tasks.workunit.client.0.smithi107.stdout:7/378: rename d7/d10/l45 to d7/d22/l8b 0 2024-09-21T08:02:45.483 INFO:tasks.workunit.client.0.smithi107.stdout:7/379: creat d7/d22/d37/d5a/f8c x:0 0 0 2024-09-21T08:02:45.483 INFO:tasks.workunit.client.0.smithi107.stdout:7/380: fdatasync d7/f14 0 2024-09-21T08:02:45.491 INFO:tasks.workunit.client.0.smithi107.stdout:5/529: dwrite d7/de/d1d/d24/f8c [0,4194304] 0 2024-09-21T08:02:45.491 INFO:tasks.workunit.client.0.smithi107.stdout:5/530: chown d7/de/d1d/d29/d68/cb7 5011 1 2024-09-21T08:02:45.495 INFO:tasks.workunit.client.0.smithi107.stdout:5/531: rename d7/de/d2d/d5d/d60/l95 to d7/de/d1d/d29/d64/d87/lb9 0 2024-09-21T08:02:45.495 INFO:tasks.workunit.client.0.smithi107.stdout:5/532: stat d7/de/d2d/l9d 0 2024-09-21T08:02:45.495 INFO:tasks.workunit.client.0.smithi107.stdout:4/371: sync 2024-09-21T08:02:45.495 INFO:tasks.workunit.client.0.smithi107.stdout:4/372: stat dc/d13/d40/d46 0 2024-09-21T08:02:45.495 INFO:tasks.workunit.client.0.smithi107.stdout:6/578: sync 2024-09-21T08:02:45.495 INFO:tasks.workunit.client.0.smithi107.stdout:3/410: sync 2024-09-21T08:02:45.496 INFO:tasks.workunit.client.0.smithi107.stdout:3/411: fdatasync d8/d14/f58 0 2024-09-21T08:02:45.496 INFO:tasks.workunit.client.0.smithi107.stdout:3/412: truncate d8/d44/f62 5043362 0 2024-09-21T08:02:45.496 INFO:tasks.workunit.client.0.smithi107.stdout:6/579: write d2/d3/d7/d24/f25 [3114907,51742] 0 2024-09-21T08:02:45.500 INFO:tasks.workunit.client.0.smithi107.stdout:4/373: rename dc/c65 to dc/d13/d40/d46/c74 0 2024-09-21T08:02:45.503 INFO:tasks.workunit.client.0.smithi107.stdout:3/413: mknod d8/d21/d7e/c8c 0 2024-09-21T08:02:45.503 INFO:tasks.workunit.client.0.smithi107.stdout:4/374: truncate dc/d13/d40/f4a 1713171 0 2024-09-21T08:02:45.505 INFO:tasks.workunit.client.0.smithi107.stdout:3/414: mknod d8/d21/d7e/c8d 0 2024-09-21T08:02:45.505 INFO:tasks.workunit.client.0.smithi107.stdout:3/415: write d8/f30 [382074,12531] 0 2024-09-21T08:02:45.505 INFO:tasks.workunit.client.0.smithi107.stdout:3/416: write d8/f8a [641702,26282] 0 2024-09-21T08:02:45.506 INFO:tasks.workunit.client.0.smithi107.stdout:4/375: symlink dc/l75 0 2024-09-21T08:02:45.507 INFO:tasks.workunit.client.0.smithi107.stdout:4/376: fdatasync dc/d13/d40/f52 0 2024-09-21T08:02:45.508 INFO:tasks.workunit.client.0.smithi107.stdout:3/417: mknod d8/d2b/d45/c8e 0 2024-09-21T08:02:45.508 INFO:tasks.workunit.client.0.smithi107.stdout:3/418: dread - d8/d2b/d52/d71/f84 zero size 2024-09-21T08:02:45.508 INFO:tasks.workunit.client.0.smithi107.stdout:3/419: chown d8/f30 3 1 2024-09-21T08:02:45.509 INFO:tasks.workunit.client.0.smithi107.stdout:4/377: mknod dc/c76 0 2024-09-21T08:02:45.511 INFO:tasks.workunit.client.0.smithi107.stdout:4/378: mkdir dc/d13/d40/d5e/d77 0 2024-09-21T08:02:45.511 INFO:tasks.workunit.client.0.smithi107.stdout:4/379: chown dc/d13/l39 739014192 1 2024-09-21T08:02:45.512 INFO:tasks.workunit.client.0.smithi107.stdout:3/420: rmdir d8/d2b/d52/d55 39 2024-09-21T08:02:45.513 INFO:tasks.workunit.client.0.smithi107.stdout:4/380: creat dc/d13/d5a/f78 x:0 0 0 2024-09-21T08:02:45.514 INFO:tasks.workunit.client.0.smithi107.stdout:3/421: symlink d8/d44/l8f 0 2024-09-21T08:02:45.515 INFO:tasks.workunit.client.0.smithi107.stdout:3/422: readlink d8/d25/d34/l6d 0 2024-09-21T08:02:45.519 INFO:tasks.workunit.client.0.smithi107.stdout:5/533: dwrite d7/de/d1d/d24/d3d/f44 [0,4194304] 0 2024-09-21T08:02:45.521 INFO:tasks.workunit.client.0.smithi107.stdout:6/580: dwrite d2/d2e/d97/f6f [0,4194304] 0 2024-09-21T08:02:45.529 INFO:tasks.workunit.client.0.smithi107.stdout:3/423: dread d8/d21/f36 [0,4194304] 0 2024-09-21T08:02:45.541 INFO:tasks.workunit.client.0.smithi107.stdout:4/381: dwrite dc/d13/d40/f45 [0,4194304] 0 2024-09-21T08:02:45.541 INFO:tasks.workunit.client.0.smithi107.stdout:4/382: write dc/d13/f18 [513150,27731] 0 2024-09-21T08:02:45.541 INFO:tasks.workunit.client.0.smithi107.stdout:5/534: dwrite d7/de/d2d/d5d/d60/fa6 [0,4194304] 0 2024-09-21T08:02:45.542 INFO:tasks.workunit.client.0.smithi107.stdout:4/383: link dc/d13/f57 dc/d64/f79 0 2024-09-21T08:02:45.544 INFO:tasks.workunit.client.0.smithi107.stdout:5/535: mkdir d7/de/d1d/d24/d3d/d65/dba 0 2024-09-21T08:02:45.544 INFO:tasks.workunit.client.0.smithi107.stdout:5/536: chown d7/de/d1d/d24/d3d/d65/l77 7611570 1 2024-09-21T08:02:45.544 INFO:tasks.workunit.client.0.smithi107.stdout:5/537: fdatasync d7/de/d52/d6b/f7e 0 2024-09-21T08:02:45.544 INFO:tasks.workunit.client.0.smithi107.stdout:5/538: creat d7/de/d1d/fbb x:0 0 0 2024-09-21T08:02:45.546 INFO:tasks.workunit.client.0.smithi107.stdout:5/539: mkdir d7/de/d1d/dbc 0 2024-09-21T08:02:45.547 INFO:tasks.workunit.client.0.smithi107.stdout:4/384: dread f8 [0,4194304] 0 2024-09-21T08:02:45.547 INFO:tasks.workunit.client.0.smithi107.stdout:4/385: truncate dc/d64/f79 912181 0 2024-09-21T08:02:45.552 INFO:tasks.workunit.client.0.smithi107.stdout:4/386: write f7 [2495628,5931] 0 2024-09-21T08:02:45.564 INFO:tasks.workunit.client.0.smithi107.stdout:5/540: dwrite d7/de/d52/d6b/f7e [0,4194304] 0 2024-09-21T08:02:45.566 INFO:tasks.workunit.client.0.smithi107.stdout:5/541: link d7/de/d1d/d29/d64/d87/c98 d7/de/d52/d8b/cbd 0 2024-09-21T08:02:45.566 INFO:tasks.workunit.client.0.smithi107.stdout:5/542: write d7/de/d1d/d24/f46 [687505,13748] 0 2024-09-21T08:02:45.568 INFO:tasks.workunit.client.0.smithi107.stdout:5/543: creat d7/de/d1d/d29/d64/d87/fbe x:0 0 0 2024-09-21T08:02:45.568 INFO:tasks.workunit.client.0.smithi107.stdout:5/544: chown d7/de/d1d/d29/d68/cb7 20848288 1 2024-09-21T08:02:45.569 INFO:tasks.workunit.client.0.smithi107.stdout:5/545: symlink d7/de/d1d/d24/d3d/lbf 0 2024-09-21T08:02:45.572 INFO:tasks.workunit.client.0.smithi107.stdout:4/387: dwrite dc/d13/f5d [0,4194304] 0 2024-09-21T08:02:45.577 INFO:tasks.workunit.client.0.smithi107.stdout:5/546: dread d7/de/d52/d6b/f7e [0,4194304] 0 2024-09-21T08:02:45.578 INFO:tasks.workunit.client.0.smithi107.stdout:5/547: mkdir d7/de/d1d/d24/d3d/d65/dc0 0 2024-09-21T08:02:45.579 INFO:tasks.workunit.client.0.smithi107.stdout:5/548: symlink d7/de/da3/lc1 0 2024-09-21T08:02:45.590 INFO:tasks.workunit.client.0.smithi107.stdout:5/549: truncate d7/de/d1d/d24/d3d/f44 8065974 0 2024-09-21T08:02:45.616 INFO:tasks.workunit.client.0.smithi107.stdout:5/550: rename d7/de/d52/d8b/ca0 to d7/de/d35/cc2 0 2024-09-21T08:02:45.616 INFO:tasks.workunit.client.0.smithi107.stdout:5/551: read - d7/de/d1d/d24/d3d/f8f zero size 2024-09-21T08:02:45.616 INFO:tasks.workunit.client.0.smithi107.stdout:5/552: creat d7/de/d1d/d29/fc3 x:0 0 0 2024-09-21T08:02:45.620 INFO:tasks.workunit.client.0.smithi107.stdout:5/553: symlink d7/de/d35/lc4 0 2024-09-21T08:02:45.620 INFO:tasks.workunit.client.0.smithi107.stdout:5/554: truncate d7/de/d1d/d24/f6e 891964 0 2024-09-21T08:02:45.620 INFO:tasks.workunit.client.0.smithi107.stdout:5/555: chown d7/de/d1d/d24/c2f 979 1 2024-09-21T08:02:45.621 INFO:tasks.workunit.client.0.smithi107.stdout:5/556: write d7/de/d1d/d24/f4f [213562,37764] 0 2024-09-21T08:02:45.621 INFO:tasks.workunit.client.0.smithi107.stdout:5/557: write d7/de/d1d/d29/d64/f89 [4720458,11512] 0 2024-09-21T08:02:45.622 INFO:tasks.workunit.client.0.smithi107.stdout:5/558: truncate d7/de/d1d/d24/d3d/f44 7022885 0 2024-09-21T08:02:45.637 INFO:tasks.workunit.client.0.smithi107.stdout:5/559: dwrite d7/de/d1d/d29/d64/f90 [0,4194304] 0 2024-09-21T08:02:45.643 INFO:tasks.workunit.client.0.smithi107.stdout:5/560: mkdir d7/de/d2d/d5d/d60/dc5 0 2024-09-21T08:02:45.661 INFO:tasks.workunit.client.0.smithi107.stdout:5/561: dwrite d7/de/d1d/fbb [0,4194304] 0 2024-09-21T08:02:45.664 INFO:tasks.workunit.client.0.smithi107.stdout:5/562: rename d7/de/d1d/d29/d64/f75 to d7/de/d1d/d29/fc6 0 2024-09-21T08:02:45.665 INFO:tasks.workunit.client.0.smithi107.stdout:5/563: mknod d7/d74/cc7 0 2024-09-21T08:02:45.666 INFO:tasks.workunit.client.0.smithi107.stdout:5/564: creat d7/de/fc8 x:0 0 0 2024-09-21T08:02:45.668 INFO:tasks.workunit.client.0.smithi107.stdout:5/565: link d7/de/d1d/d24/fae d7/de/d1d/dbc/fc9 0 2024-09-21T08:02:45.669 INFO:tasks.workunit.client.0.smithi107.stdout:5/566: creat d7/d70/fca x:0 0 0 2024-09-21T08:02:45.669 INFO:tasks.workunit.client.0.smithi107.stdout:5/567: chown d7/de/d35/f43 263463 1 2024-09-21T08:02:45.669 INFO:tasks.workunit.client.0.smithi107.stdout:5/568: chown d7/de/d35/f8a 109 1 2024-09-21T08:02:45.670 INFO:tasks.workunit.client.0.smithi107.stdout:5/569: getdents d7/de/d35 0 2024-09-21T08:02:45.670 INFO:tasks.workunit.client.0.smithi107.stdout:5/570: chown d7/de/d1d/d24/c2f 73387 1 2024-09-21T08:02:45.670 INFO:tasks.workunit.client.0.smithi107.stdout:5/571: readlink d7/de/d1d/d29/d68/l6a 0 2024-09-21T08:02:45.671 INFO:tasks.workunit.client.0.smithi107.stdout:5/572: mknod d7/de/d1d/d24/ccb 0 2024-09-21T08:02:45.671 INFO:tasks.workunit.client.0.smithi107.stdout:5/573: chown d7/de/d52/fb0 3 1 2024-09-21T08:02:45.672 INFO:tasks.workunit.client.0.smithi107.stdout:5/574: mkdir d7/de/d1d/d24/d3d/d65/dcc 0 2024-09-21T08:02:45.692 INFO:tasks.workunit.client.0.smithi107.stdout:5/575: dwrite d7/de/d2d/d5d/d60/fb1 [0,4194304] 0 2024-09-21T08:02:45.718 INFO:tasks.workunit.client.0.smithi107.stdout:5/576: dwrite d7/de/d1d/d29/d64/d87/fbe [0,4194304] 0 2024-09-21T08:02:45.764 INFO:tasks.workunit.client.0.smithi107.stdout:9/527: sync 2024-09-21T08:02:45.764 INFO:tasks.workunit.client.0.smithi107.stdout:0/400: sync 2024-09-21T08:02:45.764 INFO:tasks.workunit.client.0.smithi107.stdout:1/442: sync 2024-09-21T08:02:45.787 INFO:tasks.workunit.client.0.smithi107.stdout:1/443: dwrite d0/d29/f5c [0,4194304] 0 2024-09-21T08:02:45.791 INFO:tasks.workunit.client.0.smithi107.stdout:1/444: dread d0/d19/d2b/d4b/fd [0,4194304] 0 2024-09-21T08:02:45.797 INFO:tasks.workunit.client.0.smithi107.stdout:1/445: write d0/f3c [425354,81038] 0 2024-09-21T08:02:45.803 INFO:tasks.workunit.client.0.smithi107.stdout:5/577: creat d7/de/d2d/fcd x:0 0 0 2024-09-21T08:02:45.805 INFO:tasks.workunit.client.0.smithi107.stdout:0/401: creat d1/d5/d25/d3d/d20/d29/d55/d7a/f82 x:0 0 0 2024-09-21T08:02:45.805 INFO:tasks.workunit.client.0.smithi107.stdout:0/402: creat d1/d5/d25/d3d/d20/d29/d55/d7a/f83 x:0 0 0 2024-09-21T08:02:45.809 INFO:tasks.workunit.client.0.smithi107.stdout:5/578: symlink d7/de/d35/lce 0 2024-09-21T08:02:45.809 INFO:tasks.workunit.client.0.smithi107.stdout:5/579: dread - d7/de/d1d/d29/d64/fb5 zero size 2024-09-21T08:02:45.812 INFO:tasks.workunit.client.0.smithi107.stdout:5/580: rename d7/de/d2d/c49 to d7/de/d52/ccf 0 2024-09-21T08:02:45.814 INFO:tasks.workunit.client.0.smithi107.stdout:5/581: truncate d7/ff 2043048 0 2024-09-21T08:02:45.816 INFO:tasks.workunit.client.0.smithi107.stdout:0/403: dread d1/d5/d25/d3d/f1f [0,4194304] 0 2024-09-21T08:02:45.822 INFO:tasks.workunit.client.0.smithi107.stdout:1/446: dwrite d0/d19/d2b/d4b/d61/d75/f7d [0,4194304] 0 2024-09-21T08:02:45.828 INFO:tasks.workunit.client.0.smithi107.stdout:1/447: rename d0/d29/d6b to d0/d19/d2b/d86/d95 0 2024-09-21T08:02:45.832 INFO:tasks.workunit.client.0.smithi107.stdout:1/448: creat d0/d19/d39/f96 x:0 0 0 2024-09-21T08:02:45.832 INFO:tasks.workunit.client.0.smithi107.stdout:1/449: chown d0/d19/f93 216900593 1 2024-09-21T08:02:45.838 INFO:tasks.workunit.client.0.smithi107.stdout:1/450: getdents d0/d19 0 2024-09-21T08:02:45.841 INFO:tasks.workunit.client.0.smithi107.stdout:2/372: sync 2024-09-21T08:02:45.841 INFO:tasks.workunit.client.0.smithi107.stdout:2/373: write d1/d16/f4e [45769,112281] 0 2024-09-21T08:02:45.841 INFO:tasks.workunit.client.0.smithi107.stdout:0/404: dwrite d1/d5/d25/d3d/d20/d29/d55/d7a/f83 [0,4194304] 0 2024-09-21T08:02:45.843 INFO:tasks.workunit.client.0.smithi107.stdout:1/451: rename d0/d19/d2b/d4b/le to d0/d29/d4d/d84/l97 0 2024-09-21T08:02:45.848 INFO:tasks.workunit.client.0.smithi107.stdout:5/582: rmdir d7/de/d52 39 2024-09-21T08:02:45.852 INFO:tasks.workunit.client.0.smithi107.stdout:1/452: truncate d0/f3 1204750 0 2024-09-21T08:02:45.852 INFO:tasks.workunit.client.0.smithi107.stdout:1/453: write d0/d19/d2b/d4b/d1c/f26 [4883646,105483] 0 2024-09-21T08:02:45.859 INFO:tasks.workunit.client.0.smithi107.stdout:2/374: rmdir d1/d1e 39 2024-09-21T08:02:45.867 INFO:tasks.workunit.client.0.smithi107.stdout:1/454: symlink d0/d80/l98 0 2024-09-21T08:02:45.869 INFO:tasks.workunit.client.0.smithi107.stdout:2/375: rename d1/d16/l74 to d1/d1e/l84 0 2024-09-21T08:02:45.870 INFO:tasks.workunit.client.0.smithi107.stdout:1/455: truncate d0/d29/d31/f77 8124709 0 2024-09-21T08:02:45.871 INFO:tasks.workunit.client.0.smithi107.stdout:1/456: dread - d0/d19/f93 zero size 2024-09-21T08:02:45.871 INFO:tasks.workunit.client.0.smithi107.stdout:1/457: dread - d0/d19/f93 zero size 2024-09-21T08:02:45.875 INFO:tasks.workunit.client.0.smithi107.stdout:0/405: dwrite d1/d5/d25/d3d/d20/f63 [0,4194304] 0 2024-09-21T08:02:45.879 INFO:tasks.workunit.client.0.smithi107.stdout:0/406: fdatasync d1/d5/f78 0 2024-09-21T08:02:45.879 INFO:tasks.workunit.client.0.smithi107.stdout:0/407: chown d1/d23/l30 339967 1 2024-09-21T08:02:45.880 INFO:tasks.workunit.client.0.smithi107.stdout:5/583: dwrite d7/de/d1d/d29/d64/f90 [0,4194304] 0 2024-09-21T08:02:45.882 INFO:tasks.workunit.client.0.smithi107.stdout:5/584: rename d7/de/d1d/d29/d64/f9c to d7/d70/fd0 0 2024-09-21T08:02:45.882 INFO:tasks.workunit.client.0.smithi107.stdout:5/585: fsync d7/de/d35/f42 0 2024-09-21T08:02:45.882 INFO:tasks.workunit.client.0.smithi107.stdout:5/586: chown d7/de/da3 92077 1 2024-09-21T08:02:45.896 INFO:tasks.workunit.client.0.smithi107.stdout:5/587: dread d7/de/d52/d8b/f50 [0,4194304] 0 2024-09-21T08:02:45.897 INFO:tasks.workunit.client.0.smithi107.stdout:5/588: link d7/de/d1d/d29/d64/d87/c98 d7/de/da3/cd1 0 2024-09-21T08:02:45.898 INFO:tasks.workunit.client.0.smithi107.stdout:5/589: truncate d7/d70/fca 995931 0 2024-09-21T08:02:45.898 INFO:tasks.workunit.client.0.smithi107.stdout:5/590: creat d7/de/d1d/d24/d3d/fd2 x:0 0 0 2024-09-21T08:02:45.903 INFO:tasks.workunit.client.0.smithi107.stdout:2/376: dwrite d1/d16/f4e [0,4194304] 0 2024-09-21T08:02:45.904 INFO:tasks.workunit.client.0.smithi107.stdout:0/408: dwrite d1/d5/d25/d3d/d20/d29/f44 [0,4194304] 0 2024-09-21T08:02:45.910 INFO:tasks.workunit.client.0.smithi107.stdout:0/409: symlink d1/d5/d25/d3d/d20/d29/l84 0 2024-09-21T08:02:45.919 INFO:tasks.workunit.client.0.smithi107.stdout:0/410: write d1/d5/d25/d3d/f4a [37405,73798] 0 2024-09-21T08:02:45.919 INFO:tasks.workunit.client.0.smithi107.stdout:2/377: read d1/d2/d6d/d37/f4a [567956,114262] 0 2024-09-21T08:02:45.920 INFO:tasks.workunit.client.0.smithi107.stdout:0/411: mkdir d1/d5/d25/d3d/d20/d85 0 2024-09-21T08:02:45.921 INFO:tasks.workunit.client.0.smithi107.stdout:2/378: mkdir d1/d2/d6d/d37/d49/d85 0 2024-09-21T08:02:45.921 INFO:tasks.workunit.client.0.smithi107.stdout:2/379: readlink d1/d6/l22 0 2024-09-21T08:02:45.923 INFO:tasks.workunit.client.0.smithi107.stdout:0/412: truncate d1/d5/d25/f4d 1806007 0 2024-09-21T08:02:45.923 INFO:tasks.workunit.client.0.smithi107.stdout:2/380: fsync d1/d2/d6d/d37/f3a 0 2024-09-21T08:02:45.925 INFO:tasks.workunit.client.0.smithi107.stdout:0/413: dread - d1/d5/f5d zero size 2024-09-21T08:02:45.927 INFO:tasks.workunit.client.0.smithi107.stdout:2/381: dread d1/f10 [0,4194304] 0 2024-09-21T08:02:45.929 INFO:tasks.workunit.client.0.smithi107.stdout:2/382: link d1/d16/f80 d1/d2/d6d/f86 0 2024-09-21T08:02:45.929 INFO:tasks.workunit.client.0.smithi107.stdout:2/383: write d1/d1e/f79 [913146,32035] 0 2024-09-21T08:02:45.930 INFO:tasks.workunit.client.0.smithi107.stdout:2/384: mknod d1/c87 0 2024-09-21T08:02:45.932 INFO:tasks.workunit.client.0.smithi107.stdout:2/385: dread d1/d16/f55 [4194304,4194304] 0 2024-09-21T08:02:45.932 INFO:tasks.workunit.client.0.smithi107.stdout:2/386: write d1/d16/f60 [1582029,19093] 0 2024-09-21T08:02:45.933 INFO:tasks.workunit.client.0.smithi107.stdout:2/387: dread - d1/d2/d6d/f5f zero size 2024-09-21T08:02:45.933 INFO:tasks.workunit.client.0.smithi107.stdout:2/388: chown d1/d2/cf 9 1 2024-09-21T08:02:45.943 INFO:tasks.workunit.client.0.smithi107.stdout:0/414: dwrite d1/d5/d25/f77 [0,4194304] 0 2024-09-21T08:02:45.959 INFO:tasks.workunit.client.0.smithi107.stdout:2/389: dwrite d1/d1e/f79 [0,4194304] 0 2024-09-21T08:02:45.962 INFO:tasks.workunit.client.0.smithi107.stdout:2/390: symlink d1/d2/d6d/d42/l88 0 2024-09-21T08:02:45.962 INFO:tasks.workunit.client.0.smithi107.stdout:2/391: fsync d1/d1e/f3e 0 2024-09-21T08:02:45.964 INFO:tasks.workunit.client.0.smithi107.stdout:2/392: rename d1/d2/c1f to d1/d2/d6d/d37/d49/d85/c89 0 2024-09-21T08:02:45.968 INFO:tasks.workunit.client.0.smithi107.stdout:0/415: dwrite d1/d5/d25/d3d/d20/f51 [0,4194304] 0 2024-09-21T08:02:45.968 INFO:tasks.workunit.client.0.smithi107.stdout:0/416: chown d1/d5/f78 0 1 2024-09-21T08:02:45.973 INFO:tasks.workunit.client.0.smithi107.stdout:0/417: dread d1/d5/d25/f40 [0,4194304] 0 2024-09-21T08:02:45.973 INFO:tasks.workunit.client.0.smithi107.stdout:0/418: chown d1/c3c 3 1 2024-09-21T08:02:45.977 INFO:tasks.workunit.client.0.smithi107.stdout:2/393: write d1/f3 [4026152,112732] 0 2024-09-21T08:02:45.977 INFO:tasks.workunit.client.0.smithi107.stdout:2/394: write d1/d2/d6d/f5f [774721,64678] 0 2024-09-21T08:02:45.977 INFO:tasks.workunit.client.0.smithi107.stdout:2/395: truncate d1/d6/f51 179709 0 2024-09-21T08:02:45.978 INFO:tasks.workunit.client.0.smithi107.stdout:2/396: dread d1/d6/f51 [0,4194304] 0 2024-09-21T08:02:45.978 INFO:tasks.workunit.client.0.smithi107.stdout:2/397: chown d1/d6/c27 645905 1 2024-09-21T08:02:45.980 INFO:tasks.workunit.client.0.smithi107.stdout:2/398: symlink d1/d2/d6d/d37/l8a 0 2024-09-21T08:02:45.981 INFO:tasks.workunit.client.0.smithi107.stdout:2/399: creat d1/d16/f8b x:0 0 0 2024-09-21T08:02:45.991 INFO:tasks.workunit.client.0.smithi107.stdout:0/419: dwrite d1/d5/d25/d2d/f7b [0,4194304] 0 2024-09-21T08:02:45.994 INFO:tasks.workunit.client.0.smithi107.stdout:2/400: dread d1/d2/d6d/d37/f65 [0,4194304] 0 2024-09-21T08:02:45.994 INFO:tasks.workunit.client.0.smithi107.stdout:2/401: chown d1/f26 1 1 2024-09-21T08:02:45.994 INFO:tasks.workunit.client.0.smithi107.stdout:2/402: write d1/d6/f21 [851830,69750] 0 2024-09-21T08:02:45.999 INFO:tasks.workunit.client.0.smithi107.stdout:0/420: rename d1/d23/f26 to d1/d6f/d80/f86 0 2024-09-21T08:02:45.999 INFO:tasks.workunit.client.0.smithi107.stdout:0/421: chown d1/d23/c6b 2819499 1 2024-09-21T08:02:46.003 INFO:tasks.workunit.client.0.smithi107.stdout:0/422: creat d1/f87 x:0 0 0 2024-09-21T08:02:46.004 INFO:tasks.workunit.client.0.smithi107.stdout:0/423: creat d1/d6f/d80/f88 x:0 0 0 2024-09-21T08:02:46.005 INFO:tasks.workunit.client.0.smithi107.stdout:0/424: rename d1/f87 to d1/d6f/f89 0 2024-09-21T08:02:46.005 INFO:tasks.workunit.client.0.smithi107.stdout:2/403: write d1/d2/d6d/f86 [2518564,53756] 0 2024-09-21T08:02:46.006 INFO:tasks.workunit.client.0.smithi107.stdout:2/404: fsync d1/d16/f41 0 2024-09-21T08:02:46.009 INFO:tasks.workunit.client.0.smithi107.stdout:0/425: read d1/d5/f67 [418470,28876] 0 2024-09-21T08:02:46.011 INFO:tasks.workunit.client.0.smithi107.stdout:0/426: mkdir d1/d5/d25/d3d/d20/d85/d8a 0 2024-09-21T08:02:46.013 INFO:tasks.workunit.client.0.smithi107.stdout:0/427: truncate d1/d23/f3f 2627461 0 2024-09-21T08:02:46.013 INFO:tasks.workunit.client.0.smithi107.stdout:0/428: creat d1/d23/f8b x:0 0 0 2024-09-21T08:02:46.013 INFO:tasks.workunit.client.0.smithi107.stdout:0/429: chown d1/d5/f5d 3302661 1 2024-09-21T08:02:46.013 INFO:tasks.workunit.client.0.smithi107.stdout:0/430: chown d1/d6f 3742 1 2024-09-21T08:02:46.023 INFO:tasks.workunit.client.0.smithi107.stdout:0/431: write d1/d5/d25/d3d/d20/d29/d5c/f5e [4096888,81901] 0 2024-09-21T08:02:46.024 INFO:tasks.workunit.client.0.smithi107.stdout:0/432: chown d1/d5/f78 390 1 2024-09-21T08:02:46.025 INFO:tasks.workunit.client.0.smithi107.stdout:2/405: dwrite d1/d1e/f5c [0,4194304] 0 2024-09-21T08:02:46.026 INFO:tasks.workunit.client.0.smithi107.stdout:0/433: getdents d1/d5/d75 0 2024-09-21T08:02:46.029 INFO:tasks.workunit.client.0.smithi107.stdout:0/434: unlink d1/d5/d25/l49 0 2024-09-21T08:02:46.032 INFO:tasks.workunit.client.0.smithi107.stdout:2/406: mknod d1/d2/d6d/d37/c8c 0 2024-09-21T08:02:46.034 INFO:tasks.workunit.client.0.smithi107.stdout:2/407: symlink d1/d2/l8d 0 2024-09-21T08:02:46.037 INFO:tasks.workunit.client.0.smithi107.stdout:2/408: stat d1/d2/d6d/d37/c5a 0 2024-09-21T08:02:46.037 INFO:tasks.workunit.client.0.smithi107.stdout:2/409: stat d1/d16 0 2024-09-21T08:02:46.038 INFO:tasks.workunit.client.0.smithi107.stdout:2/410: link d1/d2/l29 d1/l8e 0 2024-09-21T08:02:46.038 INFO:tasks.workunit.client.0.smithi107.stdout:2/411: truncate d1/d6/f2d 9292911 0 2024-09-21T08:02:46.038 INFO:tasks.workunit.client.0.smithi107.stdout:2/412: read - d1/d16/f8b zero size 2024-09-21T08:02:46.041 INFO:tasks.workunit.client.0.smithi107.stdout:2/413: unlink d1/d6/f3d 0 2024-09-21T08:02:46.044 INFO:tasks.workunit.client.0.smithi107.stdout:6/581: sync 2024-09-21T08:02:46.044 INFO:tasks.workunit.client.0.smithi107.stdout:4/388: sync 2024-09-21T08:02:46.044 INFO:tasks.workunit.client.0.smithi107.stdout:3/424: sync 2024-09-21T08:02:46.045 INFO:tasks.workunit.client.0.smithi107.stdout:9/528: sync 2024-09-21T08:02:46.046 INFO:tasks.workunit.client.0.smithi107.stdout:8/432: sync 2024-09-21T08:02:46.046 INFO:tasks.workunit.client.0.smithi107.stdout:7/381: sync 2024-09-21T08:02:46.046 INFO:tasks.workunit.client.0.smithi107.stdout:6/582: creat d2/d3/d7/d23/d2b/fbc x:0 0 0 2024-09-21T08:02:46.048 INFO:tasks.workunit.client.0.smithi107.stdout:3/425: rename d8/d14/d1d/f3a to d8/d25/d3d/f90 0 2024-09-21T08:02:46.048 INFO:tasks.workunit.client.0.smithi107.stdout:3/426: fsync d8/d2b/d52/d71/f84 0 2024-09-21T08:02:46.048 INFO:tasks.workunit.client.0.smithi107.stdout:3/427: stat d8/d25/d34 0 2024-09-21T08:02:46.052 INFO:tasks.workunit.client.0.smithi107.stdout:8/433: rmdir d5/d38/d56 39 2024-09-21T08:02:46.052 INFO:tasks.workunit.client.0.smithi107.stdout:8/434: chown d5/d1d/f3a 3 1 2024-09-21T08:02:46.053 INFO:tasks.workunit.client.0.smithi107.stdout:6/583: unlink d2/d3/f14 0 2024-09-21T08:02:46.054 INFO:tasks.workunit.client.0.smithi107.stdout:6/584: creat d2/d2e/fbd x:0 0 0 2024-09-21T08:02:46.054 INFO:tasks.workunit.client.0.smithi107.stdout:6/585: readlink d2/d3/d7/d54/d5c/laa 0 2024-09-21T08:02:46.055 INFO:tasks.workunit.client.0.smithi107.stdout:4/389: dread dc/fe [0,4194304] 0 2024-09-21T08:02:46.055 INFO:tasks.workunit.client.0.smithi107.stdout:4/390: chown dc/d4c/f4d 1 1 2024-09-21T08:02:46.055 INFO:tasks.workunit.client.0.smithi107.stdout:4/391: dread - dc/d13/d40/f42 zero size 2024-09-21T08:02:46.056 INFO:tasks.workunit.client.0.smithi107.stdout:9/529: rename d11/d27/d2a/d7f/la4 to d11/d27/d5e/lc7 0 2024-09-21T08:02:46.057 INFO:tasks.workunit.client.0.smithi107.stdout:3/428: mkdir d8/d2b/d91 0 2024-09-21T08:02:46.058 INFO:tasks.workunit.client.0.smithi107.stdout:8/435: truncate d5/d1d/f4d 1073343 0 2024-09-21T08:02:46.060 INFO:tasks.workunit.client.0.smithi107.stdout:6/586: write d2/d3/d7/f8 [3748762,36486] 0 2024-09-21T08:02:46.060 INFO:tasks.workunit.client.0.smithi107.stdout:6/587: dread - d2/d3/f8a zero size 2024-09-21T08:02:46.060 INFO:tasks.workunit.client.0.smithi107.stdout:4/392: mknod dc/d13/d40/d46/d48/d63/d6f/c7a 0 2024-09-21T08:02:46.060 INFO:tasks.workunit.client.0.smithi107.stdout:4/393: stat dc/d13/d40/d46/f6c 0 2024-09-21T08:02:46.062 INFO:tasks.workunit.client.0.smithi107.stdout:3/429: creat d8/d25/d3d/f92 x:0 0 0 2024-09-21T08:02:46.063 INFO:tasks.workunit.client.0.smithi107.stdout:9/530: write d11/d27/d2f/f7d [1559678,43876] 0 2024-09-21T08:02:46.065 INFO:tasks.workunit.client.0.smithi107.stdout:8/436: creat d5/d2e/d89/f92 x:0 0 0 2024-09-21T08:02:46.067 INFO:tasks.workunit.client.0.smithi107.stdout:6/588: creat d2/d3/d67/fbe x:0 0 0 2024-09-21T08:02:46.067 INFO:tasks.workunit.client.0.smithi107.stdout:7/382: dwrite d7/d22/d3d/f6e [0,4194304] 0 2024-09-21T08:02:46.067 INFO:tasks.workunit.client.0.smithi107.stdout:8/437: read d5/f5c [4634139,27996] 0 2024-09-21T08:02:46.068 INFO:tasks.workunit.client.0.smithi107.stdout:8/438: chown d5/c83 6973 1 2024-09-21T08:02:46.068 INFO:tasks.workunit.client.0.smithi107.stdout:3/430: symlink d8/d44/l93 0 2024-09-21T08:02:46.070 INFO:tasks.workunit.client.0.smithi107.stdout:2/414: dwrite d1/d16/f6b [0,4194304] 0 2024-09-21T08:02:46.070 INFO:tasks.workunit.client.0.smithi107.stdout:2/415: dread - d1/d16/f8b zero size 2024-09-21T08:02:46.070 INFO:tasks.workunit.client.0.smithi107.stdout:2/416: chown d1/d2/cd 7 1 2024-09-21T08:02:46.072 INFO:tasks.workunit.client.0.smithi107.stdout:6/589: write d2/d3/d7/f1b [869725,54854] 0 2024-09-21T08:02:46.073 INFO:tasks.workunit.client.0.smithi107.stdout:3/431: creat d8/d38/f94 x:0 0 0 2024-09-21T08:02:46.082 INFO:tasks.workunit.client.0.smithi107.stdout:8/439: dread d5/d23/f3b [4194304,4194304] 0 2024-09-21T08:02:46.083 INFO:tasks.workunit.client.0.smithi107.stdout:4/394: dwrite dc/d13/f2a [0,4194304] 0 2024-09-21T08:02:46.085 INFO:tasks.workunit.client.0.smithi107.stdout:3/432: symlink d8/l95 0 2024-09-21T08:02:46.088 INFO:tasks.workunit.client.0.smithi107.stdout:8/440: symlink d5/d40/l93 0 2024-09-21T08:02:46.089 INFO:tasks.workunit.client.0.smithi107.stdout:8/441: dread - d5/d44/d46/f53 zero size 2024-09-21T08:02:46.091 INFO:tasks.workunit.client.0.smithi107.stdout:4/395: unlink dc/d13/c36 0 2024-09-21T08:02:46.092 INFO:tasks.workunit.client.0.smithi107.stdout:9/531: dwrite d11/d27/d2f/d4d/d5c/fa2 [0,4194304] 0 2024-09-21T08:02:46.092 INFO:tasks.workunit.client.0.smithi107.stdout:9/532: readlink d11/d24/d6e/l73 0 2024-09-21T08:02:46.092 INFO:tasks.workunit.client.0.smithi107.stdout:9/533: write d11/d27/d2a/f41 [2935231,55591] 0 2024-09-21T08:02:46.095 INFO:tasks.workunit.client.0.smithi107.stdout:3/433: mkdir d8/d14/d96 0 2024-09-21T08:02:46.095 INFO:tasks.workunit.client.0.smithi107.stdout:3/434: creat d8/d38/f97 x:0 0 0 2024-09-21T08:02:46.096 INFO:tasks.workunit.client.0.smithi107.stdout:8/442: mkdir d5/d2e/d94 0 2024-09-21T08:02:46.099 INFO:tasks.workunit.client.0.smithi107.stdout:4/396: truncate dc/f1e 3514480 0 2024-09-21T08:02:46.103 INFO:tasks.workunit.client.0.smithi107.stdout:9/534: getdents d11/d24/d4a/d9f 0 2024-09-21T08:02:46.103 INFO:tasks.workunit.client.0.smithi107.stdout:9/535: fsync d11/d27/d2a/f2c 0 2024-09-21T08:02:46.103 INFO:tasks.workunit.client.0.smithi107.stdout:9/536: fsync d11/d27/f72 0 2024-09-21T08:02:46.103 INFO:tasks.workunit.client.0.smithi107.stdout:9/537: write d11/f21 [4905299,60627] 0 2024-09-21T08:02:46.103 INFO:tasks.workunit.client.0.smithi107.stdout:9/538: write d11/d24/d26/fb8 [979598,22912] 0 2024-09-21T08:02:46.103 INFO:tasks.workunit.client.0.smithi107.stdout:9/539: fsync d11/d24/d4a/f75 0 2024-09-21T08:02:46.103 INFO:tasks.workunit.client.0.smithi107.stdout:9/540: chown d11 63889 1 2024-09-21T08:02:46.104 INFO:tasks.workunit.client.0.smithi107.stdout:2/417: dwrite d1/d2/d6d/d37/f4a [0,4194304] 0 2024-09-21T08:02:46.105 INFO:tasks.workunit.client.0.smithi107.stdout:2/418: chown d1/d16/f3b 7050 1 2024-09-21T08:02:46.105 INFO:tasks.workunit.client.0.smithi107.stdout:6/590: dwrite d2/d3/d7/d48/f5d [0,4194304] 0 2024-09-21T08:02:46.107 INFO:tasks.workunit.client.0.smithi107.stdout:3/435: symlink d8/d14/d1d/l98 0 2024-09-21T08:02:46.109 INFO:tasks.workunit.client.0.smithi107.stdout:8/443: symlink d5/d38/d56/d52/l95 0 2024-09-21T08:02:46.112 INFO:tasks.workunit.client.0.smithi107.stdout:9/541: creat d11/d27/d2f/d4d/d92/dc5/fc8 x:0 0 0 2024-09-21T08:02:46.116 INFO:tasks.workunit.client.0.smithi107.stdout:9/542: rmdir d11/d27/d2f/d38 39 2024-09-21T08:02:46.118 INFO:tasks.workunit.client.0.smithi107.stdout:2/419: rmdir d1/d2 39 2024-09-21T08:02:46.118 INFO:tasks.workunit.client.0.smithi107.stdout:8/444: getdents d5/d44/d46 0 2024-09-21T08:02:46.121 INFO:tasks.workunit.client.0.smithi107.stdout:2/420: symlink d1/d2/d6d/d37/d49/d7f/l8f 0 2024-09-21T08:02:46.121 INFO:tasks.workunit.client.0.smithi107.stdout:2/421: chown d1/d2/d6d/d42/l88 6087 1 2024-09-21T08:02:46.121 INFO:tasks.workunit.client.0.smithi107.stdout:4/397: dwrite dc/d64/f79 [0,4194304] 0 2024-09-21T08:02:46.121 INFO:tasks.workunit.client.0.smithi107.stdout:4/398: chown c5 0 1 2024-09-21T08:02:46.121 INFO:tasks.workunit.client.0.smithi107.stdout:3/436: dread d8/f30 [0,4194304] 0 2024-09-21T08:02:46.121 INFO:tasks.workunit.client.0.smithi107.stdout:3/437: write d8/d2b/d52/f68 [753624,121691] 0 2024-09-21T08:02:46.121 INFO:tasks.workunit.client.0.smithi107.stdout:3/438: readlink d8/ld 0 2024-09-21T08:02:46.122 INFO:tasks.workunit.client.0.smithi107.stdout:8/445: truncate d5/d38/d56/f65 161541 0 2024-09-21T08:02:46.122 INFO:tasks.workunit.client.0.smithi107.stdout:8/446: write d5/d40/f8d [475634,25527] 0 2024-09-21T08:02:46.124 INFO:tasks.workunit.client.0.smithi107.stdout:9/543: dread d11/d27/d2f/f3b [0,4194304] 0 2024-09-21T08:02:46.133 INFO:tasks.workunit.client.0.smithi107.stdout:2/422: symlink d1/d2/d6d/d37/d82/l90 0 2024-09-21T08:02:46.134 INFO:tasks.workunit.client.0.smithi107.stdout:3/439: creat d8/d2b/f99 x:0 0 0 2024-09-21T08:02:46.139 INFO:tasks.workunit.client.0.smithi107.stdout:4/399: dwrite dc/f1b [4194304,4194304] 0 2024-09-21T08:02:46.139 INFO:tasks.workunit.client.0.smithi107.stdout:9/544: chown d11/f3e 97529 1 2024-09-21T08:02:46.140 INFO:tasks.workunit.client.0.smithi107.stdout:2/423: creat d1/d2/d6d/d37/f91 x:0 0 0 2024-09-21T08:02:46.141 INFO:tasks.workunit.client.0.smithi107.stdout:2/424: write d1/d2/d6d/d37/f91 [932915,35935] 0 2024-09-21T08:02:46.143 INFO:tasks.workunit.client.0.smithi107.stdout:3/440: symlink d8/d44/l9a 0 2024-09-21T08:02:46.156 INFO:tasks.workunit.client.0.smithi107.stdout:8/447: rmdir d5 39 2024-09-21T08:02:46.157 INFO:tasks.workunit.client.0.smithi107.stdout:8/448: dread - d5/d44/d46/f6a zero size 2024-09-21T08:02:46.160 INFO:tasks.workunit.client.0.smithi107.stdout:9/545: unlink d11/d27/d2f/d38/dbf/cc4 0 2024-09-21T08:02:46.161 INFO:tasks.workunit.client.0.smithi107.stdout:9/546: read d11/d24/d4a/f70 [238676,97500] 0 2024-09-21T08:02:46.161 INFO:tasks.workunit.client.0.smithi107.stdout:9/547: chown d11/d27/d2f/d4d/d5c/f4b 13 1 2024-09-21T08:02:46.161 INFO:tasks.workunit.client.0.smithi107.stdout:2/425: mkdir d1/d6/d92 0 2024-09-21T08:02:46.162 INFO:tasks.workunit.client.0.smithi107.stdout:2/426: write d1/d1e/f3e [671720,97204] 0 2024-09-21T08:02:46.162 INFO:tasks.workunit.client.0.smithi107.stdout:2/427: write d1/d16/d35/f59 [541279,37868] 0 2024-09-21T08:02:46.165 INFO:tasks.workunit.client.0.smithi107.stdout:3/441: getdents d8/d2b/d52/d71 0 2024-09-21T08:02:46.165 INFO:tasks.workunit.client.0.smithi107.stdout:3/442: chown d8/d25/d3d/d72/d80/d5d 0 1 2024-09-21T08:02:46.165 INFO:tasks.workunit.client.0.smithi107.stdout:3/443: write d8/d2b/d52/d55/f70 [463768,76160] 0 2024-09-21T08:02:46.167 INFO:tasks.workunit.client.0.smithi107.stdout:8/449: dread d5/f5c [0,4194304] 0 2024-09-21T08:02:46.168 INFO:tasks.workunit.client.0.smithi107.stdout:2/428: unlink d1/d16/f80 0 2024-09-21T08:02:46.168 INFO:tasks.workunit.client.0.smithi107.stdout:2/429: write d1/d2/d6d/f5f [1061411,71975] 0 2024-09-21T08:02:46.168 INFO:tasks.workunit.client.0.smithi107.stdout:2/430: chown d1/d6/f2d 31 1 2024-09-21T08:02:46.170 INFO:tasks.workunit.client.0.smithi107.stdout:8/450: mknod d5/d44/c96 0 2024-09-21T08:02:46.172 INFO:tasks.workunit.client.0.smithi107.stdout:4/400: dread dc/d64/f79 [0,4194304] 0 2024-09-21T08:02:46.173 INFO:tasks.workunit.client.0.smithi107.stdout:2/431: rmdir d1 39 2024-09-21T08:02:46.176 INFO:tasks.workunit.client.0.smithi107.stdout:2/432: write d1/f10 [1351324,15552] 0 2024-09-21T08:02:46.178 INFO:tasks.workunit.client.0.smithi107.stdout:8/451: write d5/d44/d47/f4e [981762,94951] 0 2024-09-21T08:02:46.179 INFO:tasks.workunit.client.0.smithi107.stdout:2/433: creat d1/d2/d6d/d37/d82/f93 x:0 0 0 2024-09-21T08:02:46.189 INFO:tasks.workunit.client.0.smithi107.stdout:4/401: dread dc/fe [4194304,4194304] 0 2024-09-21T08:02:46.191 INFO:tasks.workunit.client.0.smithi107.stdout:4/402: read - dc/d13/d40/f4b zero size 2024-09-21T08:02:46.191 INFO:tasks.workunit.client.0.smithi107.stdout:9/548: dwrite d11/d24/d4a/f70 [0,4194304] 0 2024-09-21T08:02:46.191 INFO:tasks.workunit.client.0.smithi107.stdout:9/549: fsync d11/d27/d2a/f2c 0 2024-09-21T08:02:46.191 INFO:tasks.workunit.client.0.smithi107.stdout:9/550: chown d11/d27/d2f/d38/fba 23 1 2024-09-21T08:02:46.191 INFO:tasks.workunit.client.0.smithi107.stdout:9/551: write d11/f18 [2766594,5605] 0 2024-09-21T08:02:46.192 INFO:tasks.workunit.client.0.smithi107.stdout:3/444: dwrite d8/f13 [0,4194304] 0 2024-09-21T08:02:46.192 INFO:tasks.workunit.client.0.smithi107.stdout:8/452: dread d5/fd [0,4194304] 0 2024-09-21T08:02:46.192 INFO:tasks.workunit.client.0.smithi107.stdout:2/434: dread d1/d16/d35/f58 [0,4194304] 0 2024-09-21T08:02:46.193 INFO:tasks.workunit.client.0.smithi107.stdout:9/552: unlink d11/d24/d4a/fb5 0 2024-09-21T08:02:46.193 INFO:tasks.workunit.client.0.smithi107.stdout:9/553: chown d11/d27/d2f/l79 12975436 1 2024-09-21T08:02:46.194 INFO:tasks.workunit.client.0.smithi107.stdout:8/453: mknod d5/d23/d69/c97 0 2024-09-21T08:02:46.197 INFO:tasks.workunit.client.0.smithi107.stdout:9/554: creat d11/d27/d98/d97/fc9 x:0 0 0 2024-09-21T08:02:46.197 INFO:tasks.workunit.client.0.smithi107.stdout:9/555: fdatasync d11/d27/d2f/d4d/d5c/f4b 0 2024-09-21T08:02:46.197 INFO:tasks.workunit.client.0.smithi107.stdout:9/556: dread - d11/d27/d2f/d38/fa6 zero size 2024-09-21T08:02:46.197 INFO:tasks.workunit.client.0.smithi107.stdout:9/557: write d11/d27/d2a/f42 [1143896,104031] 0 2024-09-21T08:02:46.197 INFO:tasks.workunit.client.0.smithi107.stdout:9/558: fsync d11/d24/d35/fc1 0 2024-09-21T08:02:46.198 INFO:tasks.workunit.client.0.smithi107.stdout:3/445: getdents d8/d2b/d52 0 2024-09-21T08:02:46.198 INFO:tasks.workunit.client.0.smithi107.stdout:3/446: stat d8/d2b/f3b 0 2024-09-21T08:02:46.199 INFO:tasks.workunit.client.0.smithi107.stdout:8/454: mkdir d5/d44/d46/d98 0 2024-09-21T08:02:46.201 INFO:tasks.workunit.client.0.smithi107.stdout:9/559: mkdir d11/d27/d2f/d4d/d5c/d61/dca 0 2024-09-21T08:02:46.202 INFO:tasks.workunit.client.0.smithi107.stdout:4/403: write dc/f31 [364891,83660] 0 2024-09-21T08:02:46.203 INFO:tasks.workunit.client.0.smithi107.stdout:3/447: mknod d8/d25/d42/c9b 0 2024-09-21T08:02:46.206 INFO:tasks.workunit.client.0.smithi107.stdout:9/560: dread d11/d27/d2f/d4d/d5c/d61/f7e [0,4194304] 0 2024-09-21T08:02:46.206 INFO:tasks.workunit.client.0.smithi107.stdout:9/561: dread - d11/d27/d2f/d38/fba zero size 2024-09-21T08:02:46.209 INFO:tasks.workunit.client.0.smithi107.stdout:8/455: rename d5/d38/d67/l75 to d5/d2e/d94/l99 0 2024-09-21T08:02:46.210 INFO:tasks.workunit.client.0.smithi107.stdout:2/435: dwrite d1/d2/d6d/f5b [4194304,4194304] 0 2024-09-21T08:02:46.217 INFO:tasks.workunit.client.0.smithi107.stdout:4/404: dread dc/f31 [0,4194304] 0 2024-09-21T08:02:46.218 INFO:tasks.workunit.client.0.smithi107.stdout:4/405: chown dc 12326921 1 2024-09-21T08:02:46.220 INFO:tasks.workunit.client.0.smithi107.stdout:3/448: getdents d8/d44 0 2024-09-21T08:02:46.220 INFO:tasks.workunit.client.0.smithi107.stdout:4/406: unlink dc/d13/d40/d46/d48/l5c 0 2024-09-21T08:02:46.221 INFO:tasks.workunit.client.0.smithi107.stdout:2/436: creat d1/d2/d6d/d37/f94 x:0 0 0 2024-09-21T08:02:46.221 INFO:tasks.workunit.client.0.smithi107.stdout:2/437: stat d1/d2/d6d/d37/f91 0 2024-09-21T08:02:46.234 INFO:tasks.workunit.client.0.smithi107.stdout:3/449: write d8/d25/d3d/f51 [1386294,17440] 0 2024-09-21T08:02:46.234 INFO:tasks.workunit.client.0.smithi107.stdout:4/407: dread dc/d13/d40/f4a [0,4194304] 0 2024-09-21T08:02:46.234 INFO:tasks.workunit.client.0.smithi107.stdout:9/562: dwrite d11/d27/d2f/d4d/d5c/d61/d8f/f91 [0,4194304] 0 2024-09-21T08:02:46.234 INFO:tasks.workunit.client.0.smithi107.stdout:3/450: fsync d8/d2b/f99 0 2024-09-21T08:02:46.234 INFO:tasks.workunit.client.0.smithi107.stdout:3/451: chown d8/d25/d3d/d72/d80/d5d/f63 50 1 2024-09-21T08:02:46.235 INFO:tasks.workunit.client.0.smithi107.stdout:8/456: dwrite d5/d1d/f4d [0,4194304] 0 2024-09-21T08:02:46.237 INFO:tasks.workunit.client.0.smithi107.stdout:2/438: dread d1/d16/f4e [0,4194304] 0 2024-09-21T08:02:46.239 INFO:tasks.workunit.client.0.smithi107.stdout:2/439: dread d1/d16/d35/f50 [0,4194304] 0 2024-09-21T08:02:46.239 INFO:tasks.workunit.client.0.smithi107.stdout:4/408: link dc/l10 dc/d13/d40/d46/d48/l7b 0 2024-09-21T08:02:46.241 INFO:tasks.workunit.client.0.smithi107.stdout:9/563: creat d11/d27/d98/fcb x:0 0 0 2024-09-21T08:02:46.241 INFO:tasks.workunit.client.0.smithi107.stdout:9/564: chown d11/d27/d5b/fc2 494 1 2024-09-21T08:02:46.242 INFO:tasks.workunit.client.0.smithi107.stdout:3/452: creat d8/d44/f9c x:0 0 0 2024-09-21T08:02:46.242 INFO:tasks.workunit.client.0.smithi107.stdout:3/453: fsync d8/d21/f75 0 2024-09-21T08:02:46.245 INFO:tasks.workunit.client.0.smithi107.stdout:8/457: rename d5/d44/d46 to d5/d2e/d7c/d9a 0 2024-09-21T08:02:46.248 INFO:tasks.workunit.client.0.smithi107.stdout:9/565: mkdir d11/d27/d2f/d38/dcc 0 2024-09-21T08:02:46.249 INFO:tasks.workunit.client.0.smithi107.stdout:9/566: chown d11/d27/d2f/d38/c56 2437 1 2024-09-21T08:02:46.250 INFO:tasks.workunit.client.0.smithi107.stdout:3/454: truncate d8/d2b/f49 1990843 0 2024-09-21T08:02:46.251 INFO:tasks.workunit.client.0.smithi107.stdout:3/455: readlink d8/d14/l78 0 2024-09-21T08:02:46.252 INFO:tasks.workunit.client.0.smithi107.stdout:8/458: creat d5/d40/f9b x:0 0 0 2024-09-21T08:02:46.252 INFO:tasks.workunit.client.0.smithi107.stdout:8/459: chown d5/d1d/d90 1115 1 2024-09-21T08:02:46.255 INFO:tasks.workunit.client.0.smithi107.stdout:2/440: rmdir d1/d16 39 2024-09-21T08:02:46.256 INFO:tasks.workunit.client.0.smithi107.stdout:4/409: getdents dc/d13/d40/d46 0 2024-09-21T08:02:46.259 INFO:tasks.workunit.client.0.smithi107.stdout:9/567: creat d11/d27/d2f/d4d/d5c/d61/fcd x:0 0 0 2024-09-21T08:02:46.259 INFO:tasks.workunit.client.0.smithi107.stdout:9/568: readlink d11/d24/lb0 0 2024-09-21T08:02:46.260 INFO:tasks.workunit.client.0.smithi107.stdout:3/456: dread d8/d21/f48 [0,4194304] 0 2024-09-21T08:02:46.260 INFO:tasks.workunit.client.0.smithi107.stdout:3/457: chown d8/d14/d1d/l69 384 1 2024-09-21T08:02:46.260 INFO:tasks.workunit.client.0.smithi107.stdout:9/569: write d11/d27/d2a/f42 [66241,64726] 0 2024-09-21T08:02:46.261 INFO:tasks.workunit.client.0.smithi107.stdout:8/460: mkdir d5/d44/d5d/d9c 0 2024-09-21T08:02:46.262 INFO:tasks.workunit.client.0.smithi107.stdout:2/441: creat d1/d6/f95 x:0 0 0 2024-09-21T08:02:46.263 INFO:tasks.workunit.client.0.smithi107.stdout:3/458: rename d8/c7d to d8/d25/d34/c9d 0 2024-09-21T08:02:46.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:45 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:46.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:45 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:46.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:45 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:46.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:45 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:46.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:45 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:46.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:45 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:46.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:45 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:46.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:45 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:46.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:45 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:46.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:45 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:46.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:45 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:02:46.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:45 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:02:46.269 INFO:tasks.workunit.client.0.smithi107.stdout:9/570: creat d11/d27/d2f/fce x:0 0 0 2024-09-21T08:02:46.269 INFO:tasks.workunit.client.0.smithi107.stdout:9/571: write d11/d27/d2a/f2c [2520309,30964] 0 2024-09-21T08:02:46.273 INFO:tasks.workunit.client.0.smithi107.stdout:3/459: rename d8/d14/d1d/c7b to d8/d2b/c9e 0 2024-09-21T08:02:46.273 INFO:tasks.workunit.client.0.smithi107.stdout:3/460: truncate d8/d25/d3d/d72/d80/d5d/f65 146320 0 2024-09-21T08:02:46.274 INFO:tasks.workunit.client.0.smithi107.stdout:9/572: link d11/l96 d11/d27/d2a/d7f/lcf 0 2024-09-21T08:02:46.274 INFO:tasks.workunit.client.0.smithi107.stdout:9/573: dread - d11/d27/d98/f7c zero size 2024-09-21T08:02:46.274 INFO:tasks.workunit.client.0.smithi107.stdout:9/574: chown d11/d27/d2f/f3b 798905348 1 2024-09-21T08:02:46.275 INFO:tasks.workunit.client.0.smithi107.stdout:2/442: symlink d1/d2/d6d/d37/l96 0 2024-09-21T08:02:46.280 INFO:tasks.workunit.client.0.smithi107.stdout:9/575: unlink d11/d27/d2a/f2c 0 2024-09-21T08:02:46.283 INFO:tasks.workunit.client.0.smithi107.stdout:8/461: dwrite d5/f14 [0,4194304] 0 2024-09-21T08:02:46.284 INFO:tasks.workunit.client.0.smithi107.stdout:9/576: mkdir d11/d24/d26/dd0 0 2024-09-21T08:02:46.284 INFO:tasks.workunit.client.0.smithi107.stdout:9/577: fdatasync d11/d24/d6e/f94 0 2024-09-21T08:02:46.284 INFO:tasks.workunit.client.0.smithi107.stdout:9/578: fdatasync d11/f37 0 2024-09-21T08:02:46.284 INFO:tasks.workunit.client.0.smithi107.stdout:8/462: dread d5/d38/d56/f65 [0,4194304] 0 2024-09-21T08:02:46.285 INFO:tasks.workunit.client.0.smithi107.stdout:4/410: dwrite dc/d64/f79 [0,4194304] 0 2024-09-21T08:02:46.288 INFO:tasks.workunit.client.0.smithi107.stdout:2/443: write d1/d2/f34 [1325440,123249] 0 2024-09-21T08:02:46.291 INFO:tasks.workunit.client.0.smithi107.stdout:3/461: getdents d8/d2b 0 2024-09-21T08:02:46.302 INFO:tasks.workunit.client.0.smithi107.stdout:9/579: creat d11/d24/fd1 x:0 0 0 2024-09-21T08:02:46.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:45 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:46.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:45 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:46.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:45 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:46.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:45 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:46.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:45 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:46.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:45 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:46.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:45 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:46.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:45 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:46.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:45 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T08:02:46.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:45 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:46.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:45 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:02:46.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:45 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:02:46.305 INFO:tasks.workunit.client.0.smithi107.stdout:3/462: dwrite d8/d2b/f99 [0,4194304] 0 2024-09-21T08:02:46.318 INFO:tasks.workunit.client.0.smithi107.stdout:3/463: dwrite d8/d21/f6b [0,4194304] 0 2024-09-21T08:02:46.331 INFO:tasks.workunit.client.0.smithi107.stdout:8/463: creat d5/d23/f9d x:0 0 0 2024-09-21T08:02:46.333 INFO:tasks.workunit.client.0.smithi107.stdout:4/411: mknod dc/d13/d40/d5e/d6e/c7c 0 2024-09-21T08:02:46.335 INFO:tasks.workunit.client.0.smithi107.stdout:2/444: rename d1/d6/f66 to d1/d2/d6d/d37/d49/d85/f97 0 2024-09-21T08:02:46.338 INFO:tasks.workunit.client.0.smithi107.stdout:2/445: dread d1/d16/d35/f3f [0,4194304] 0 2024-09-21T08:02:46.339 INFO:tasks.workunit.client.0.smithi107.stdout:2/446: fsync d1/d16/f41 0 2024-09-21T08:02:46.339 INFO:tasks.workunit.client.0.smithi107.stdout:2/447: write d1/d16/f3b [461940,19099] 0 2024-09-21T08:02:46.348 INFO:tasks.workunit.client.0.smithi107.stdout:2/448: write d1/d1e/f5c [3929629,124662] 0 2024-09-21T08:02:46.349 INFO:tasks.workunit.client.0.smithi107.stdout:2/449: read - d1/d2/d6d/d37/f94 zero size 2024-09-21T08:02:46.353 INFO:tasks.workunit.client.0.smithi107.stdout:3/464: creat d8/d2b/d52/f9f x:0 0 0 2024-09-21T08:02:46.354 INFO:tasks.workunit.client.0.smithi107.stdout:3/465: creat d8/d14/d1d/fa0 x:0 0 0 2024-09-21T08:02:46.354 INFO:tasks.workunit.client.0.smithi107.stdout:3/466: truncate d8/d2b/d52/f9f 668106 0 2024-09-21T08:02:46.354 INFO:tasks.workunit.client.0.smithi107.stdout:3/467: fdatasync f2 0 2024-09-21T08:02:46.354 INFO:tasks.workunit.client.0.smithi107.stdout:3/468: chown d8/ld 3 1 2024-09-21T08:02:46.354 INFO:tasks.workunit.client.0.smithi107.stdout:4/412: symlink dc/d13/d40/d46/d48/d63/l7d 0 2024-09-21T08:02:46.355 INFO:tasks.workunit.client.0.smithi107.stdout:9/580: mknod d11/cd2 0 2024-09-21T08:02:46.358 INFO:tasks.workunit.client.0.smithi107.stdout:4/413: rename dc/l3d to dc/d64/d6b/l7e 0 2024-09-21T08:02:46.361 INFO:tasks.workunit.client.0.smithi107.stdout:4/414: rmdir dc/d13/d40/d46/d48/d63/d6f 39 2024-09-21T08:02:46.362 INFO:tasks.workunit.client.0.smithi107.stdout:3/469: read d8/d44/f62 [916642,1216] 0 2024-09-21T08:02:46.363 INFO:tasks.workunit.client.0.smithi107.stdout:9/581: symlink d11/d27/d2f/d4d/d5c/d61/db4/dbb/ld3 0 2024-09-21T08:02:46.363 INFO:tasks.workunit.client.0.smithi107.stdout:9/582: write d11/d27/d2a/f41 [975275,32717] 0 2024-09-21T08:02:46.365 INFO:tasks.workunit.client.0.smithi107.stdout:3/470: rename d8/d2b/d52/d71/c73 to d8/d21/ca1 0 2024-09-21T08:02:46.365 INFO:tasks.workunit.client.0.smithi107.stdout:3/471: chown d8/d87 8237227 1 2024-09-21T08:02:46.369 INFO:tasks.workunit.client.0.smithi107.stdout:3/472: mknod d8/d25/d34/ca2 0 2024-09-21T08:02:46.369 INFO:tasks.workunit.client.0.smithi107.stdout:3/473: readlink d8/d38/l4a 0 2024-09-21T08:02:46.369 INFO:tasks.workunit.client.0.smithi107.stdout:3/474: chown f2 2 1 2024-09-21T08:02:46.378 INFO:tasks.workunit.client.0.smithi107.stdout:3/475: dread d8/d44/f62 [0,4194304] 0 2024-09-21T08:02:46.378 INFO:tasks.workunit.client.0.smithi107.stdout:3/476: fsync d8/d44/f64 0 2024-09-21T08:02:46.379 INFO:tasks.workunit.client.0.smithi107.stdout:3/477: unlink d8/d25/d3d/d72/d80/d5d/f65 0 2024-09-21T08:02:46.379 INFO:tasks.workunit.client.0.smithi107.stdout:3/478: stat d8/f8a 0 2024-09-21T08:02:46.379 INFO:tasks.workunit.client.0.smithi107.stdout:3/479: getdents d8/d25/d3d/d72/d80/d5d/d67 0 2024-09-21T08:02:46.381 INFO:tasks.workunit.client.0.smithi107.stdout:3/480: truncate d8/d25/d3d/d72/d80/d5d/f63 289401 0 2024-09-21T08:02:46.381 INFO:tasks.workunit.client.0.smithi107.stdout:3/481: fdatasync d8/d14/d1d/f1e 0 2024-09-21T08:02:46.381 INFO:tasks.workunit.client.0.smithi107.stdout:3/482: dread - d8/d25/d3d/f92 zero size 2024-09-21T08:02:46.383 INFO:tasks.workunit.client.0.smithi107.stdout:3/483: symlink d8/d38/la3 0 2024-09-21T08:02:46.383 INFO:tasks.workunit.client.0.smithi107.stdout:3/484: readlink d8/d25/d34/l6d 0 2024-09-21T08:02:46.383 INFO:tasks.workunit.client.0.smithi107.stdout:3/485: creat d8/d38/fa4 x:0 0 0 2024-09-21T08:02:46.384 INFO:tasks.workunit.client.0.smithi107.stdout:3/486: link d8/d14/l18 d8/d2b/la5 0 2024-09-21T08:02:46.386 INFO:tasks.workunit.client.0.smithi107.stdout:3/487: rename d8/d2b/f99 to d8/fa6 0 2024-09-21T08:02:46.387 INFO:tasks.workunit.client.0.smithi107.stdout:3/488: creat d8/d87/fa7 x:0 0 0 2024-09-21T08:02:46.389 INFO:tasks.workunit.client.0.smithi107.stdout:3/489: unlink d8/d44/f9c 0 2024-09-21T08:02:46.389 INFO:tasks.workunit.client.0.smithi107.stdout:3/490: write f2 [2504890,13014] 0 2024-09-21T08:02:46.390 INFO:tasks.workunit.client.0.smithi107.stdout:4/415: dwrite dc/d13/d40/f52 [0,4194304] 0 2024-09-21T08:02:46.390 INFO:tasks.workunit.client.0.smithi107.stdout:4/416: stat dc/d13/d40/d46/d48/d63/c6d 0 2024-09-21T08:02:46.390 INFO:tasks.workunit.client.0.smithi107.stdout:9/583: dwrite d11/d27/d2f/f7d [0,4194304] 0 2024-09-21T08:02:46.391 INFO:tasks.workunit.client.0.smithi107.stdout:3/491: mknod d8/d2b/d52/d55/ca8 0 2024-09-21T08:02:46.391 INFO:tasks.workunit.client.0.smithi107.stdout:3/492: truncate d8/d44/f64 260048 0 2024-09-21T08:02:46.395 INFO:tasks.workunit.client.0.smithi107.stdout:4/417: link dc/l22 dc/d13/d40/d5e/l7f 0 2024-09-21T08:02:46.395 INFO:tasks.workunit.client.0.smithi107.stdout:4/418: write dc/d13/d40/f43 [201141,130640] 0 2024-09-21T08:02:46.396 INFO:tasks.workunit.client.0.smithi107.stdout:5/591: sync 2024-09-21T08:02:46.396 INFO:tasks.workunit.client.0.smithi107.stdout:1/458: sync 2024-09-21T08:02:46.396 INFO:tasks.workunit.client.0.smithi107.stdout:3/493: rename d8/d25/d34/l50 to d8/d38/la9 0 2024-09-21T08:02:46.397 INFO:tasks.workunit.client.0.smithi107.stdout:3/494: fsync d8/d21/f88 0 2024-09-21T08:02:46.400 INFO:tasks.workunit.client.0.smithi107.stdout:5/592: rename d7/de/d1d/d24/c2c to d7/de/d1d/dbc/cd3 0 2024-09-21T08:02:46.404 INFO:tasks.workunit.client.0.smithi107.stdout:3/495: mkdir d8/d14/d1d/daa 0 2024-09-21T08:02:46.407 INFO:tasks.workunit.client.0.smithi107.stdout:1/459: rename d0/f8d to d0/d19/d2b/d4b/d1c/d5e/f99 0 2024-09-21T08:02:46.410 INFO:tasks.workunit.client.0.smithi107.stdout:3/496: mknod d8/d25/d3d/d72/d80/d5d/d6e/cab 0 2024-09-21T08:02:46.412 INFO:tasks.workunit.client.0.smithi107.stdout:3/497: creat d8/d44/fac x:0 0 0 2024-09-21T08:02:46.414 INFO:tasks.workunit.client.0.smithi107.stdout:3/498: mkdir d8/d44/dad 0 2024-09-21T08:02:46.414 INFO:tasks.workunit.client.0.smithi107.stdout:3/499: fdatasync d8/d14/f58 0 2024-09-21T08:02:46.418 INFO:tasks.workunit.client.0.smithi107.stdout:3/500: getdents d8/d25/d3d 0 2024-09-21T08:02:46.421 INFO:tasks.workunit.client.0.smithi107.stdout:3/501: write d8/d21/f36 [1969908,114983] 0 2024-09-21T08:02:46.422 INFO:tasks.workunit.client.0.smithi107.stdout:1/460: write d0/d29/f5c [80319,3904] 0 2024-09-21T08:02:46.423 INFO:tasks.workunit.client.0.smithi107.stdout:3/502: mkdir d8/d25/d42/dae 0 2024-09-21T08:02:46.424 INFO:tasks.workunit.client.0.smithi107.stdout:9/584: dwrite d11/d24/d35/f6f [0,4194304] 0 2024-09-21T08:02:46.424 INFO:tasks.workunit.client.0.smithi107.stdout:5/593: dwrite d7/de/d52/d6b/f7e [4194304,4194304] 0 2024-09-21T08:02:46.425 INFO:tasks.workunit.client.0.smithi107.stdout:5/594: creat d7/de/d2d/fd4 x:0 0 0 2024-09-21T08:02:46.425 INFO:tasks.workunit.client.0.smithi107.stdout:4/419: dwrite fa [0,4194304] 0 2024-09-21T08:02:46.425 INFO:tasks.workunit.client.0.smithi107.stdout:3/503: unlink f2 0 2024-09-21T08:02:46.426 INFO:tasks.workunit.client.0.smithi107.stdout:3/504: fdatasync d8/d14/d1d/f1f 0 2024-09-21T08:02:46.429 INFO:tasks.workunit.client.0.smithi107.stdout:3/505: dread d8/d14/d1d/f85 [0,4194304] 0 2024-09-21T08:02:46.431 INFO:tasks.workunit.client.0.smithi107.stdout:5/595: creat d7/fd5 x:0 0 0 2024-09-21T08:02:46.432 INFO:tasks.workunit.client.0.smithi107.stdout:9/585: creat d11/d27/d2f/d38/dbf/fd4 x:0 0 0 2024-09-21T08:02:46.433 INFO:tasks.workunit.client.0.smithi107.stdout:3/506: rename d8/d14/d1d/f85 to d8/d25/d34/faf 0 2024-09-21T08:02:46.435 INFO:tasks.workunit.client.0.smithi107.stdout:3/507: unlink d8/d2b/f49 0 2024-09-21T08:02:46.436 INFO:tasks.workunit.client.0.smithi107.stdout:3/508: mkdir d8/d14/d96/db0 0 2024-09-21T08:02:46.444 INFO:tasks.workunit.client.0.smithi107.stdout:1/461: dwrite d0/d19/d2b/d4b/f4c [4194304,4194304] 0 2024-09-21T08:02:46.444 INFO:tasks.workunit.client.0.smithi107.stdout:1/462: chown d0/cf 780371978 1 2024-09-21T08:02:46.445 INFO:tasks.workunit.client.0.smithi107.stdout:1/463: getdents d0/d19/d2b/d4b/d5b 0 2024-09-21T08:02:46.447 INFO:tasks.workunit.client.0.smithi107.stdout:1/464: truncate d0/d29/d2c/f2e 2317392 0 2024-09-21T08:02:46.452 INFO:tasks.workunit.client.0.smithi107.stdout:5/596: getdents d7/de/d1d/dbc 0 2024-09-21T08:02:46.453 INFO:tasks.workunit.client.0.smithi107.stdout:1/465: dread d0/d19/d59/f91 [0,4194304] 0 2024-09-21T08:02:46.453 INFO:tasks.workunit.client.0.smithi107.stdout:1/466: write d0/f71 [4499327,90519] 0 2024-09-21T08:02:46.453 INFO:tasks.workunit.client.0.smithi107.stdout:1/467: read d0/d29/f5c [1230703,4928] 0 2024-09-21T08:02:46.454 INFO:tasks.workunit.client.0.smithi107.stdout:5/597: truncate d7/de/d1d/d29/d64/f90 988777 0 2024-09-21T08:02:46.455 INFO:tasks.workunit.client.0.smithi107.stdout:1/468: mkdir d0/d19/d2b/d4b/d44/d9a 0 2024-09-21T08:02:46.455 INFO:tasks.workunit.client.0.smithi107.stdout:1/469: chown d0/d29/d4d/d84 168 1 2024-09-21T08:02:46.457 INFO:tasks.workunit.client.0.smithi107.stdout:9/586: dwrite d11/d27/d5e/d76/fb7 [0,4194304] 0 2024-09-21T08:02:46.458 INFO:tasks.workunit.client.0.smithi107.stdout:3/509: dwrite d8/d25/d3d/f92 [0,4194304] 0 2024-09-21T08:02:46.458 INFO:tasks.workunit.client.0.smithi107.stdout:3/510: fsync d8/f8a 0 2024-09-21T08:02:46.469 INFO:tasks.workunit.client.0.smithi107.stdout:3/511: unlink d8/d38/f3c 0 2024-09-21T08:02:46.470 INFO:tasks.workunit.client.0.smithi107.stdout:3/512: chown d8/d44/dad 17076117 1 2024-09-21T08:02:46.470 INFO:tasks.workunit.client.0.smithi107.stdout:3/513: write d8/d2b/d52/f9f [1135679,5510] 0 2024-09-21T08:02:46.471 INFO:tasks.workunit.client.0.smithi107.stdout:3/514: mkdir d8/d25/d42/dae/db1 0 2024-09-21T08:02:46.472 INFO:tasks.workunit.client.0.smithi107.stdout:3/515: symlink d8/d25/d3d/d72/d80/d5d/lb2 0 2024-09-21T08:02:46.473 INFO:tasks.workunit.client.0.smithi107.stdout:3/516: mkdir d8/d2b/d52/d71/db3 0 2024-09-21T08:02:46.475 INFO:tasks.workunit.client.0.smithi107.stdout:3/517: creat d8/d2b/d52/d71/db3/fb4 x:0 0 0 2024-09-21T08:02:46.476 INFO:tasks.workunit.client.0.smithi107.stdout:3/518: truncate d8/d2b/d45/f6a 3755044 0 2024-09-21T08:02:46.477 INFO:tasks.workunit.client.0.smithi107.stdout:3/519: symlink d8/d38/lb5 0 2024-09-21T08:02:46.478 INFO:tasks.workunit.client.0.smithi107.stdout:9/587: write d11/d27/d2f/f5a [2430160,11861] 0 2024-09-21T08:02:46.478 INFO:tasks.workunit.client.0.smithi107.stdout:1/470: dwrite d0/d19/d2b/d4b/d1c/d5e/f69 [0,4194304] 0 2024-09-21T08:02:46.480 INFO:tasks.workunit.client.0.smithi107.stdout:5/598: dwrite d7/de/d1d/f48 [0,4194304] 0 2024-09-21T08:02:46.480 INFO:tasks.workunit.client.0.smithi107.stdout:5/599: fsync d7/de/d52/fb0 0 2024-09-21T08:02:46.480 INFO:tasks.workunit.client.0.smithi107.stdout:5/600: chown d7 44 1 2024-09-21T08:02:46.481 INFO:tasks.workunit.client.0.smithi107.stdout:9/588: rename d11/d27/d2f/d4d/lb6 to d11/d27/d2f/d4d/ld5 0 2024-09-21T08:02:46.484 INFO:tasks.workunit.client.0.smithi107.stdout:1/471: mknod d0/d19/d2b/d86/d95/c9b 0 2024-09-21T08:02:46.503 INFO:tasks.workunit.client.0.smithi107.stdout:9/589: rmdir d11/d27/d2f/d38/daa 39 2024-09-21T08:02:46.503 INFO:tasks.workunit.client.0.smithi107.stdout:9/590: fsync d11/d27/d5e/d76/f9e 0 2024-09-21T08:02:46.503 INFO:tasks.workunit.client.0.smithi107.stdout:3/520: dwrite d8/d25/d3d/f51 [0,4194304] 0 2024-09-21T08:02:46.504 INFO:tasks.workunit.client.0.smithi107.stdout:1/472: creat d0/d19/d2b/d4b/d44/d55/d64/f9c x:0 0 0 2024-09-21T08:02:46.505 INFO:tasks.workunit.client.0.smithi107.stdout:5/601: dwrite d7/d70/fd0 [0,4194304] 0 2024-09-21T08:02:46.509 INFO:tasks.workunit.client.0.smithi107.stdout:3/521: truncate d8/f13 1055367 0 2024-09-21T08:02:46.510 INFO:tasks.workunit.client.0.smithi107.stdout:5/602: dread d7/de/f30 [0,4194304] 0 2024-09-21T08:02:46.510 INFO:tasks.workunit.client.0.smithi107.stdout:1/473: mknod d0/d19/d59/c9d 0 2024-09-21T08:02:46.510 INFO:tasks.workunit.client.0.smithi107.stdout:1/474: fsync d0/d19/d2b/d4b/d1c/f26 0 2024-09-21T08:02:46.511 INFO:tasks.workunit.client.0.smithi107.stdout:9/591: getdents d11/d27/d2f/d38/daa 0 2024-09-21T08:02:46.512 INFO:tasks.workunit.client.0.smithi107.stdout:1/475: dread d0/d19/d59/f91 [0,4194304] 0 2024-09-21T08:02:46.513 INFO:tasks.workunit.client.0.smithi107.stdout:1/476: dread d0/d19/d59/f91 [0,4194304] 0 2024-09-21T08:02:46.514 INFO:tasks.workunit.client.0.smithi107.stdout:5/603: link d7/de/d52/d6b/l7a d7/de/d1d/d24/ld6 0 2024-09-21T08:02:46.514 INFO:tasks.workunit.client.0.smithi107.stdout:5/604: fdatasync d7/de/f99 0 2024-09-21T08:02:46.515 INFO:tasks.workunit.client.0.smithi107.stdout:9/592: rmdir d11 39 2024-09-21T08:02:46.515 INFO:tasks.workunit.client.0.smithi107.stdout:9/593: chown d11/d27/d2f/d4d/ld5 393883 1 2024-09-21T08:02:46.517 INFO:tasks.workunit.client.0.smithi107.stdout:3/522: rmdir d8/d2b/d52 39 2024-09-21T08:02:46.517 INFO:tasks.workunit.client.0.smithi107.stdout:3/523: truncate d8/d14/d1d/fa0 1031798 0 2024-09-21T08:02:46.521 INFO:tasks.workunit.client.0.smithi107.stdout:1/477: rename d0/d19/d2b/d86/l51 to d0/d19/d2b/d4b/d44/d72/d36/l9e 0 2024-09-21T08:02:46.522 INFO:tasks.workunit.client.0.smithi107.stdout:5/605: mknod d7/de/d1d/d24/d3d/d65/dcc/cd7 0 2024-09-21T08:02:46.524 INFO:tasks.workunit.client.0.smithi107.stdout:9/594: write d11/d27/d2f/f7d [1121954,81653] 0 2024-09-21T08:02:46.524 INFO:tasks.workunit.client.0.smithi107.stdout:9/595: getdents d11/d27/d2f/d38/daa 0 2024-09-21T08:02:46.524 INFO:tasks.workunit.client.0.smithi107.stdout:9/596: truncate d11/d27/d2f/d4d/d5c/d61/fab 1725868 0 2024-09-21T08:02:46.526 INFO:tasks.workunit.client.0.smithi107.stdout:1/478: symlink d0/d19/d2b/d4b/d44/d55/l9f 0 2024-09-21T08:02:46.526 INFO:tasks.workunit.client.0.smithi107.stdout:1/479: write d0/f2 [1116588,122596] 0 2024-09-21T08:02:46.528 INFO:tasks.workunit.client.0.smithi107.stdout:5/606: mkdir d7/de/d1d/d24/d3d/d65/dd8 0 2024-09-21T08:02:46.528 INFO:tasks.workunit.client.0.smithi107.stdout:5/607: fdatasync d7/de/d1d/d24/d3d/fd2 0 2024-09-21T08:02:46.532 INFO:tasks.workunit.client.0.smithi107.stdout:3/524: dwrite d8/d14/d1d/fa0 [0,4194304] 0 2024-09-21T08:02:46.533 INFO:tasks.workunit.client.0.smithi107.stdout:5/608: mkdir d7/de/d1d/d24/d3d/d65/dd8/dd9 0 2024-09-21T08:02:46.533 INFO:tasks.workunit.client.0.smithi107.stdout:5/609: write d7/de/fc8 [112566,74454] 0 2024-09-21T08:02:46.533 INFO:tasks.workunit.client.0.smithi107.stdout:5/610: write d7/d70/fd0 [4445809,74955] 0 2024-09-21T08:02:46.534 INFO:tasks.workunit.client.0.smithi107.stdout:9/597: write d11/d27/d2f/d4d/d5c/fa2 [1615104,66765] 0 2024-09-21T08:02:46.534 INFO:tasks.workunit.client.0.smithi107.stdout:9/598: chown d11/d27/d98/f47 185 1 2024-09-21T08:02:46.534 INFO:tasks.workunit.client.0.smithi107.stdout:9/599: write d11/d27/d5e/fa9 [5214609,29082] 0 2024-09-21T08:02:46.538 INFO:tasks.workunit.client.0.smithi107.stdout:3/525: creat d8/d2b/d52/fb6 x:0 0 0 2024-09-21T08:02:46.538 INFO:tasks.workunit.client.0.smithi107.stdout:3/526: creat d8/d25/d42/fb7 x:0 0 0 2024-09-21T08:02:46.544 INFO:tasks.workunit.client.0.smithi107.stdout:5/611: mknod d7/de/d2d/d5d/cda 0 2024-09-21T08:02:46.544 INFO:tasks.workunit.client.0.smithi107.stdout:5/612: truncate d7/de/d1d/d24/d3d/f8f 655646 0 2024-09-21T08:02:46.545 INFO:tasks.workunit.client.0.smithi107.stdout:9/600: unlink d11/d27/d2f/d38/fba 0 2024-09-21T08:02:46.551 INFO:tasks.workunit.client.0.smithi107.stdout:3/527: link d8/d14/c5e d8/d2b/d45/cb8 0 2024-09-21T08:02:46.553 INFO:tasks.workunit.client.0.smithi107.stdout:5/613: unlink d7/de/f19 0 2024-09-21T08:02:46.556 INFO:tasks.workunit.client.0.smithi107.stdout:9/601: rename d11/d24/d35/fc1 to d11/d24/d4a/fd6 0 2024-09-21T08:02:46.556 INFO:tasks.workunit.client.0.smithi107.stdout:9/602: stat d11/d24/d4a/cc6 0 2024-09-21T08:02:46.556 INFO:tasks.workunit.client.0.smithi107.stdout:9/603: creat d11/d24/d35/fd7 x:0 0 0 2024-09-21T08:02:46.560 INFO:tasks.workunit.client.0.smithi107.stdout:0/435: sync 2024-09-21T08:02:46.564 INFO:tasks.workunit.client.0.smithi107.stdout:0/436: dread d1/d5/d25/f40 [0,4194304] 0 2024-09-21T08:02:46.564 INFO:tasks.workunit.client.0.smithi107.stdout:0/437: write d1/d23/d61/f73 [689891,116638] 0 2024-09-21T08:02:46.564 INFO:tasks.workunit.client.0.smithi107.stdout:0/438: dread - d1/d6f/d80/f88 zero size 2024-09-21T08:02:46.564 INFO:tasks.workunit.client.0.smithi107.stdout:9/604: rename cd to d11/d27/d2f/d38/dbf/cd8 0 2024-09-21T08:02:46.577 INFO:tasks.workunit.client.0.smithi107.stdout:0/439: write d1/d5/d25/d3d/d20/d29/d55/d7a/f7f [1908940,23327] 0 2024-09-21T08:02:46.577 INFO:tasks.workunit.client.0.smithi107.stdout:0/440: creat d1/d5/d25/d3d/d20/d29/d55/d7a/f8c x:0 0 0 2024-09-21T08:02:46.577 INFO:tasks.workunit.client.0.smithi107.stdout:0/441: chown d1/d5/d25/d3d/d20/d29/d55/d7a/f8c 4381071 1 2024-09-21T08:02:46.577 INFO:tasks.workunit.client.0.smithi107.stdout:0/442: chown d1/d5/d25/d3d/d20/c54 3423 1 2024-09-21T08:02:46.577 INFO:tasks.workunit.client.0.smithi107.stdout:3/528: dwrite d8/d38/f94 [0,4194304] 0 2024-09-21T08:02:46.577 INFO:tasks.workunit.client.0.smithi107.stdout:3/529: truncate d8/d38/f97 619352 0 2024-09-21T08:02:46.578 INFO:tasks.workunit.client.0.smithi107.stdout:5/614: dwrite d7/de/d35/f57 [0,4194304] 0 2024-09-21T08:02:46.580 INFO:tasks.workunit.client.0.smithi107.stdout:0/443: creat d1/d5/d25/d3d/d20/d29/d55/f8d x:0 0 0 2024-09-21T08:02:46.584 INFO:tasks.workunit.client.0.smithi107.stdout:5/615: unlink d7/de/d35/f57 0 2024-09-21T08:02:46.585 INFO:tasks.workunit.client.0.smithi107.stdout:9/605: dwrite d11/f3e [0,4194304] 0 2024-09-21T08:02:46.585 INFO:tasks.workunit.client.0.smithi107.stdout:3/530: dread d8/d21/f36 [0,4194304] 0 2024-09-21T08:02:46.586 INFO:tasks.workunit.client.0.smithi107.stdout:0/444: mkdir d1/d5/d25/d2d/d8e 0 2024-09-21T08:02:46.586 INFO:tasks.workunit.client.0.smithi107.stdout:0/445: readlink d1/d5/d25/d3d/d20/d29/l4f 0 2024-09-21T08:02:46.586 INFO:tasks.workunit.client.0.smithi107.stdout:5/616: dread d7/de/d1d/d24/d3d/f8f [0,4194304] 0 2024-09-21T08:02:46.586 INFO:tasks.workunit.client.0.smithi107.stdout:0/446: creat d1/d5/d25/d2d/f8f x:0 0 0 2024-09-21T08:02:46.669 INFO:tasks.workunit.client.0.smithi107.stdout:9/606: link d11/d27/d2f/d4d/d5c/d61/d8f/f91 d11/d24/fd9 0 2024-09-21T08:02:46.703 INFO:tasks.workunit.client.0.smithi107.stdout:3/531: rename d8/d2b/d52/f9f to d8/d2b/d52/d71/db3/fb9 0 2024-09-21T08:02:46.707 INFO:tasks.workunit.client.0.smithi107.stdout:5/617: mkdir d7/de/d1d/d29/d68/ddb 0 2024-09-21T08:02:46.707 INFO:tasks.workunit.client.0.smithi107.stdout:5/618: write d7/de/d2d/fd4 [822325,70375] 0 2024-09-21T08:02:46.707 INFO:tasks.workunit.client.0.smithi107.stdout:5/619: chown d7/de/d1d/d24/d3d/d65/dcc 3 1 2024-09-21T08:02:46.707 INFO:tasks.workunit.client.0.smithi107.stdout:5/620: write d7/f39 [497940,100805] 0 2024-09-21T08:02:46.709 INFO:tasks.workunit.client.0.smithi107.stdout:0/447: mkdir d1/d5/d25/d3d/d20/d29/d5c/d90 0 2024-09-21T08:02:46.709 INFO:tasks.workunit.client.0.smithi107.stdout:0/448: getdents d1/d5/d25/d3d/d20/d29/d5c/d90 0 2024-09-21T08:02:46.728 INFO:tasks.workunit.client.0.smithi107.stdout:9/607: mkdir d11/d27/d2f/d38/dbf/dda 0 2024-09-21T08:02:46.729 INFO:tasks.workunit.client.0.smithi107.stdout:3/532: symlink d8/d2b/d52/lba 0 2024-09-21T08:02:46.730 INFO:tasks.workunit.client.0.smithi107.stdout:3/533: read d8/d38/f97 [182835,112893] 0 2024-09-21T08:02:46.731 INFO:tasks.workunit.client.0.smithi107.stdout:3/534: write d8/d2b/d52/f68 [211829,50390] 0 2024-09-21T08:02:46.732 INFO:tasks.workunit.client.0.smithi107.stdout:5/621: link d7/de/d1d/f5b d7/de/d1d/d29/d64/fdc 0 2024-09-21T08:02:46.733 INFO:tasks.workunit.client.0.smithi107.stdout:0/449: truncate d1/d5/d25/d3d/f1f 24098 0 2024-09-21T08:02:46.735 INFO:tasks.workunit.client.0.smithi107.stdout:9/608: mknod d11/d24/d6e/db9/cdb 0 2024-09-21T08:02:46.737 INFO:tasks.workunit.client.0.smithi107.stdout:3/535: creat d8/d25/d42/dae/db1/fbb x:0 0 0 2024-09-21T08:02:46.738 INFO:tasks.workunit.client.0.smithi107.stdout:5/622: truncate d7/de/d1d/d29/d64/fdc 3223248 0 2024-09-21T08:02:46.738 INFO:tasks.workunit.client.0.smithi107.stdout:5/623: chown d7/de/c27 2124056795 1 2024-09-21T08:02:46.738 INFO:tasks.workunit.client.0.smithi107.stdout:5/624: creat d7/de/d1d/d24/d3d/d65/fdd x:0 0 0 2024-09-21T08:02:46.739 INFO:tasks.workunit.client.0.smithi107.stdout:9/609: creat d11/d24/d26/dd0/fdc x:0 0 0 2024-09-21T08:02:46.739 INFO:tasks.workunit.client.0.smithi107.stdout:9/610: readlink d11/d27/d2f/d38/l45 0 2024-09-21T08:02:46.740 INFO:tasks.workunit.client.0.smithi107.stdout:3/536: dread d8/f8a [0,4194304] 0 2024-09-21T08:02:46.751 INFO:tasks.workunit.client.0.smithi107.stdout:9/611: dread d11/d24/d4a/f8e [0,4194304] 0 2024-09-21T08:02:46.751 INFO:tasks.workunit.client.0.smithi107.stdout:9/612: stat d11/d24/d4a/fd6 0 2024-09-21T08:02:46.751 INFO:tasks.workunit.client.0.smithi107.stdout:9/613: write d11/d27/d2a/f63 [224564,2207] 0 2024-09-21T08:02:46.751 INFO:tasks.workunit.client.0.smithi107.stdout:3/537: write d8/fa6 [1841465,7430] 0 2024-09-21T08:02:46.751 INFO:tasks.workunit.client.0.smithi107.stdout:3/538: write d8/d21/f36 [771160,86056] 0 2024-09-21T08:02:46.753 INFO:tasks.workunit.client.0.smithi107.stdout:0/450: dwrite d1/d5/f78 [0,4194304] 0 2024-09-21T08:02:46.754 INFO:tasks.workunit.client.0.smithi107.stdout:3/539: link d8/d25/d42/f86 d8/d25/d34/fbc 0 2024-09-21T08:02:46.755 INFO:tasks.workunit.client.0.smithi107.stdout:3/540: dread d8/d25/d34/faf [0,4194304] 0 2024-09-21T08:02:46.758 INFO:tasks.workunit.client.0.smithi107.stdout:3/541: dread d8/f8a [0,4194304] 0 2024-09-21T08:02:46.758 INFO:tasks.workunit.client.0.smithi107.stdout:3/542: dread d8/d44/f64 [0,4194304] 0 2024-09-21T08:02:46.758 INFO:tasks.workunit.client.0.smithi107.stdout:3/543: chown d8/d14/f54 63597847 1 2024-09-21T08:02:46.760 INFO:tasks.workunit.client.0.smithi107.stdout:3/544: dread - d8/d21/f88 zero size 2024-09-21T08:02:46.760 INFO:tasks.workunit.client.0.smithi107.stdout:7/383: sync 2024-09-21T08:02:46.761 INFO:tasks.workunit.client.0.smithi107.stdout:3/545: mknod d8/d2b/d52/d55/cbd 0 2024-09-21T08:02:46.762 INFO:tasks.workunit.client.0.smithi107.stdout:7/384: truncate d7/d22/f2d 45209 0 2024-09-21T08:02:46.764 INFO:tasks.workunit.client.0.smithi107.stdout:3/546: link d8/l60 d8/d25/d42/dae/db1/lbe 0 2024-09-21T08:02:46.766 INFO:tasks.workunit.client.0.smithi107.stdout:3/547: mkdir d8/d2b/d45/dbf 0 2024-09-21T08:02:46.767 INFO:tasks.workunit.client.0.smithi107.stdout:3/548: mknod d8/d25/d3d/d72/cc0 0 2024-09-21T08:02:46.770 INFO:tasks.workunit.client.0.smithi107.stdout:3/549: creat d8/d2b/d45/fc1 x:0 0 0 2024-09-21T08:02:46.773 INFO:tasks.workunit.client.0.smithi107.stdout:3/550: mkdir d8/d2b/d52/d71/db3/dc2 0 2024-09-21T08:02:46.780 INFO:tasks.workunit.client.0.smithi107.stdout:7/385: dwrite d7/d22/d3a/d49/f74 [0,4194304] 0 2024-09-21T08:02:46.781 INFO:tasks.workunit.client.0.smithi107.stdout:5/625: rename d7/de/d1d/d24/d3d/d65 to d7/de/d1d/d29/d68/ddb/dde 0 2024-09-21T08:02:46.781 INFO:tasks.workunit.client.0.smithi107.stdout:5/626: write d7/de/d1d/d29/d64/f90 [1687178,88587] 0 2024-09-21T08:02:46.784 INFO:tasks.workunit.client.0.smithi107.stdout:0/451: rename d1/d5/d79 to d1/d5/d25/d3d/d20/d29/d55/d91 0 2024-09-21T08:02:46.788 INFO:tasks.workunit.client.0.smithi107.stdout:7/386: rename d7/d22/d37/d40/f4a to d7/d22/d3d/d8a/f8d 0 2024-09-21T08:02:46.788 INFO:tasks.workunit.client.0.smithi107.stdout:7/387: write d7/d38/f60 [1121260,117216] 0 2024-09-21T08:02:46.788 INFO:tasks.workunit.client.0.smithi107.stdout:7/388: stat d7/f3f 0 2024-09-21T08:02:46.789 INFO:tasks.workunit.client.0.smithi107.stdout:5/627: rmdir d7/de/d1d/d29/d64 39 2024-09-21T08:02:46.792 INFO:tasks.workunit.client.0.smithi107.stdout:5/628: creat d7/de/da3/fdf x:0 0 0 2024-09-21T08:02:46.795 INFO:tasks.workunit.client.0.smithi107.stdout:3/551: dwrite d8/d2b/f3b [0,4194304] 0 2024-09-21T08:02:46.798 INFO:tasks.workunit.client.0.smithi107.stdout:7/389: write f4 [2985536,29893] 0 2024-09-21T08:02:46.800 INFO:tasks.workunit.client.0.smithi107.stdout:7/390: mknod d7/d22/d3a/c8e 0 2024-09-21T08:02:46.802 INFO:tasks.workunit.client.0.smithi107.stdout:7/391: rename d7/d22/l8b to d7/d22/d37/d4b/d4e/l8f 0 2024-09-21T08:02:46.804 INFO:tasks.workunit.client.0.smithi107.stdout:0/452: dwrite d1/d5/d25/d3d/d20/f51 [0,4194304] 0 2024-09-21T08:02:46.805 INFO:tasks.workunit.client.0.smithi107.stdout:0/453: stat d1/d5/c66 0 2024-09-21T08:02:46.816 INFO:tasks.workunit.client.0.smithi107.stdout:7/392: dread d7/d22/f24 [0,4194304] 0 2024-09-21T08:02:46.816 INFO:tasks.workunit.client.0.smithi107.stdout:7/393: readlink d7/d38/l7f 0 2024-09-21T08:02:46.816 INFO:tasks.workunit.client.0.smithi107.stdout:7/394: read d7/d22/d37/d4b/f7e [1196692,13322] 0 2024-09-21T08:02:46.818 INFO:tasks.workunit.client.0.smithi107.stdout:3/552: dwrite d8/d2b/d52/d71/f84 [0,4194304] 0 2024-09-21T08:02:46.818 INFO:tasks.workunit.client.0.smithi107.stdout:3/553: chown d8/d2b/d52/d71 1000300 1 2024-09-21T08:02:46.818 INFO:tasks.workunit.client.0.smithi107.stdout:7/395: truncate d7/f13 7393487 0 2024-09-21T08:02:46.826 INFO:tasks.workunit.client.0.smithi107.stdout:0/454: dwrite d1/d23/f3a [0,4194304] 0 2024-09-21T08:02:46.826 INFO:tasks.workunit.client.0.smithi107.stdout:0/455: dread - d1/d23/f6d zero size 2024-09-21T08:02:46.826 INFO:tasks.workunit.client.0.smithi107.stdout:0/456: readlink d1/d5/d25/d3d/d20/d29/l34 0 2024-09-21T08:02:46.828 INFO:tasks.workunit.client.0.smithi107.stdout:3/554: getdents d8/d38 0 2024-09-21T08:02:46.828 INFO:tasks.workunit.client.0.smithi107.stdout:3/555: creat d8/d44/fc3 x:0 0 0 2024-09-21T08:02:46.832 INFO:tasks.workunit.client.0.smithi107.stdout:7/396: rename d7/d10/d28/f59 to d7/d10/f90 0 2024-09-21T08:02:46.845 INFO:tasks.workunit.client.0.smithi107.stdout:3/556: creat d8/d2b/d52/d55/fc4 x:0 0 0 2024-09-21T08:02:46.845 INFO:tasks.workunit.client.0.smithi107.stdout:3/557: fdatasync d8/d14/d1d/f1e 0 2024-09-21T08:02:46.848 INFO:tasks.workunit.client.0.smithi107.stdout:7/397: creat d7/d10/d28/d69/f91 x:0 0 0 2024-09-21T08:02:46.849 INFO:tasks.workunit.client.0.smithi107.stdout:0/457: getdents d1/d5/d25 0 2024-09-21T08:02:46.849 INFO:tasks.workunit.client.0.smithi107.stdout:0/458: readlink d1/d23/l56 0 2024-09-21T08:02:46.851 INFO:tasks.workunit.client.0.smithi107.stdout:3/558: symlink d8/d2b/d52/d55/lc5 0 2024-09-21T08:02:46.854 INFO:tasks.workunit.client.0.smithi107.stdout:0/459: creat d1/d5/d25/d3d/f92 x:0 0 0 2024-09-21T08:02:46.854 INFO:tasks.workunit.client.0.smithi107.stdout:0/460: creat d1/d5/d25/d3d/d20/d29/d55/f93 x:0 0 0 2024-09-21T08:02:46.889 INFO:tasks.workunit.client.0.smithi107.stdout:3/559: dwrite d8/d25/d42/dae/db1/fbb [0,4194304] 0 2024-09-21T08:02:46.889 INFO:tasks.workunit.client.0.smithi107.stdout:3/560: write d8/d38/f97 [41040,55198] 0 2024-09-21T08:02:46.891 INFO:tasks.workunit.client.0.smithi107.stdout:0/461: dwrite d1/f4c [0,4194304] 0 2024-09-21T08:02:46.891 INFO:tasks.workunit.client.0.smithi107.stdout:0/462: chown d1/d5/f67 146470 1 2024-09-21T08:02:46.894 INFO:tasks.workunit.client.0.smithi107.stdout:3/561: mkdir d8/dc6 0 2024-09-21T08:02:46.894 INFO:tasks.workunit.client.0.smithi107.stdout:3/562: chown d8/f1b 258359852 1 2024-09-21T08:02:46.898 INFO:tasks.workunit.client.0.smithi107.stdout:3/563: truncate d8/d14/d1d/f5c 499845 0 2024-09-21T08:02:46.903 INFO:tasks.workunit.client.0.smithi107.stdout:3/564: getdents d8/d25/d42/dae/db1 0 2024-09-21T08:02:46.903 INFO:tasks.workunit.client.0.smithi107.stdout:3/565: creat d8/d14/d1d/fc7 x:0 0 0 2024-09-21T08:02:46.908 INFO:tasks.workunit.client.0.smithi107.stdout:3/566: creat d8/d2b/d52/d71/fc8 x:0 0 0 2024-09-21T08:02:46.910 INFO:tasks.workunit.client.0.smithi107.stdout:3/567: mkdir d8/d87/dc9 0 2024-09-21T08:02:46.911 INFO:tasks.workunit.client.0.smithi107.stdout:3/568: chown d8/d21/f4c 2 1 2024-09-21T08:02:46.913 INFO:tasks.workunit.client.0.smithi107.stdout:3/569: truncate d8/d25/d3d/f92 724017 0 2024-09-21T08:02:46.921 INFO:tasks.workunit.client.0.smithi107.stdout:7/398: dwrite d7/d18/f36 [0,4194304] 0 2024-09-21T08:02:46.921 INFO:tasks.workunit.client.0.smithi107.stdout:7/399: fdatasync d7/d22/d3d/f7c 0 2024-09-21T08:02:46.921 INFO:tasks.workunit.client.0.smithi107.stdout:7/400: chown d7/d22/d3d 3429 1 2024-09-21T08:02:46.922 INFO:tasks.workunit.client.0.smithi107.stdout:0/463: dwrite d1/d5/d25/d3d/d20/d29/f44 [0,4194304] 0 2024-09-21T08:02:46.922 INFO:tasks.workunit.client.0.smithi107.stdout:0/464: fsync d1/d5/d25/f4e 0 2024-09-21T08:02:46.924 INFO:tasks.workunit.client.0.smithi107.stdout:0/465: creat d1/d5/d25/d3d/d20/d29/f94 x:0 0 0 2024-09-21T08:02:46.927 INFO:tasks.workunit.client.0.smithi107.stdout:7/401: getdents d7/d10/d64 0 2024-09-21T08:02:46.931 INFO:tasks.workunit.client.0.smithi107.stdout:6/591: sync 2024-09-21T08:02:46.931 INFO:tasks.workunit.client.0.smithi107.stdout:4/420: sync 2024-09-21T08:02:46.931 INFO:tasks.workunit.client.0.smithi107.stdout:6/592: chown d2/d3/d7/d48/f72 89973505 1 2024-09-21T08:02:46.931 INFO:tasks.workunit.client.0.smithi107.stdout:0/466: link d1/d5/d25/d3d/f4a d1/d5/d25/d3d/d20/d29/d55/d7a/f95 0 2024-09-21T08:02:46.932 INFO:tasks.workunit.client.0.smithi107.stdout:8/464: sync 2024-09-21T08:02:46.932 INFO:tasks.workunit.client.0.smithi107.stdout:1/480: sync 2024-09-21T08:02:46.932 INFO:tasks.workunit.client.0.smithi107.stdout:8/465: stat d5/d44/d47/c73 0 2024-09-21T08:02:46.933 INFO:tasks.workunit.client.0.smithi107.stdout:2/450: sync 2024-09-21T08:02:46.933 INFO:tasks.workunit.client.0.smithi107.stdout:2/451: dread - d1/d16/f32 zero size 2024-09-21T08:02:46.933 INFO:tasks.workunit.client.0.smithi107.stdout:2/452: chown d1/c87 0 1 2024-09-21T08:02:46.934 INFO:tasks.workunit.client.0.smithi107.stdout:7/402: write d7/d10/f55 [270762,54654] 0 2024-09-21T08:02:46.936 INFO:tasks.workunit.client.0.smithi107.stdout:1/481: unlink d0/d19/d39/f7e 0 2024-09-21T08:02:46.942 INFO:tasks.workunit.client.0.smithi107.stdout:6/593: unlink d2/d3/d7/c28 0 2024-09-21T08:02:46.942 INFO:tasks.workunit.client.0.smithi107.stdout:6/594: chown d2/d3/d7/d23/d2b/ca1 15971622 1 2024-09-21T08:02:46.942 INFO:tasks.workunit.client.0.smithi107.stdout:6/595: dread - d2/d3/d7/d23/d2b/fbc zero size 2024-09-21T08:02:46.942 INFO:tasks.workunit.client.0.smithi107.stdout:6/596: creat d2/d3/d7/d24/d41/fbf x:0 0 0 2024-09-21T08:02:46.942 INFO:tasks.workunit.client.0.smithi107.stdout:6/597: stat d2/d3/d7/d48/da3/d85/la2 0 2024-09-21T08:02:46.942 INFO:tasks.workunit.client.0.smithi107.stdout:6/598: write d2/d3/d7/d24/d41/fbf [402940,61629] 0 2024-09-21T08:02:46.945 INFO:tasks.workunit.client.0.smithi107.stdout:2/453: mknod d1/d2/d6d/d42/d76/c98 0 2024-09-21T08:02:46.946 INFO:tasks.workunit.client.0.smithi107.stdout:6/599: symlink d2/d3/d7/d54/lc0 0 2024-09-21T08:02:46.950 INFO:tasks.workunit.client.0.smithi107.stdout:7/403: dread d7/d18/f36 [4194304,4194304] 0 2024-09-21T08:02:46.951 INFO:tasks.workunit.client.0.smithi107.stdout:1/482: dread d0/d19/d2b/d4b/f63 [0,4194304] 0 2024-09-21T08:02:46.952 INFO:tasks.workunit.client.0.smithi107.stdout:7/404: truncate d7/d22/d3b/f47 1448789 0 2024-09-21T08:02:46.955 INFO:tasks.workunit.client.0.smithi107.stdout:7/405: mknod d7/d22/d37/d5a/d83/c92 0 2024-09-21T08:02:46.962 INFO:tasks.workunit.client.0.smithi107.stdout:1/483: dread d0/d29/d2c/f52 [0,4194304] 0 2024-09-21T08:02:46.963 INFO:tasks.workunit.client.0.smithi107.stdout:1/484: mknod d0/d19/d2b/d4b/d44/d55/ca0 0 2024-09-21T08:02:46.963 INFO:tasks.workunit.client.0.smithi107.stdout:1/485: chown d0/d19/d2b/d4b/d44/d72/c28 167365 1 2024-09-21T08:02:46.964 INFO:tasks.workunit.client.0.smithi107.stdout:1/486: mkdir d0/d29/da1 0 2024-09-21T08:02:46.975 INFO:tasks.workunit.client.0.smithi107.stdout:1/487: rename d0/d19/d2b/d86/f76 to d0/d19/fa2 0 2024-09-21T08:02:46.975 INFO:tasks.workunit.client.0.smithi107.stdout:1/488: dread - d0/d19/f87 zero size 2024-09-21T08:02:46.975 INFO:tasks.workunit.client.0.smithi107.stdout:3/570: dwrite d8/d38/fa4 [0,4194304] 0 2024-09-21T08:02:46.975 INFO:tasks.workunit.client.0.smithi107.stdout:1/489: creat d0/d19/d2b/d4b/d44/d55/d64/fa3 x:0 0 0 2024-09-21T08:02:46.979 INFO:tasks.workunit.client.0.smithi107.stdout:8/466: dwrite d5/d44/d5d/f68 [0,4194304] 0 2024-09-21T08:02:46.979 INFO:tasks.workunit.client.0.smithi107.stdout:4/421: dwrite dc/d13/f5d [0,4194304] 0 2024-09-21T08:02:46.980 INFO:tasks.workunit.client.0.smithi107.stdout:2/454: dwrite d1/d16/d35/f58 [0,4194304] 0 2024-09-21T08:02:46.984 INFO:tasks.workunit.client.0.smithi107.stdout:7/406: dwrite d7/d18/f29 [0,4194304] 0 2024-09-21T08:02:46.985 INFO:tasks.workunit.client.0.smithi107.stdout:7/407: truncate d7/d22/f76 472823 0 2024-09-21T08:02:46.986 INFO:tasks.workunit.client.0.smithi107.stdout:3/571: truncate d8/f30 1709081 0 2024-09-21T08:02:46.989 INFO:tasks.workunit.client.0.smithi107.stdout:1/490: mkdir d0/d19/d2b/d86/da4 0 2024-09-21T08:02:46.990 INFO:tasks.workunit.client.0.smithi107.stdout:1/491: creat d0/d19/d2b/d4b/d61/d75/fa5 x:0 0 0 2024-09-21T08:02:46.990 INFO:tasks.workunit.client.0.smithi107.stdout:1/492: fdatasync d0/d19/d2b/d4b/d44/d55/d64/fa3 0 2024-09-21T08:02:46.999 INFO:tasks.workunit.client.0.smithi107.stdout:8/467: mkdir d5/d2e/d7c/d9a/d9e 0 2024-09-21T08:02:47.008 INFO:tasks.workunit.client.0.smithi107.stdout:4/422: mkdir dc/d13/d40/d80 0 2024-09-21T08:02:47.013 INFO:tasks.workunit.client.0.smithi107.stdout:2/455: creat d1/d2/d6d/d37/d49/d7f/f99 x:0 0 0 2024-09-21T08:02:47.013 INFO:tasks.workunit.client.0.smithi107.stdout:2/456: chown d1/d16/f75 14 1 2024-09-21T08:02:47.021 INFO:tasks.workunit.client.0.smithi107.stdout:7/408: rename d7/d18/c1f to d7/d22/d37/d40/d4d/c93 0 2024-09-21T08:02:47.025 INFO:tasks.workunit.client.0.smithi107.stdout:7/409: read d7/d38/f60 [175199,40474] 0 2024-09-21T08:02:47.025 INFO:tasks.workunit.client.0.smithi107.stdout:3/572: link d8/d2b/l53 d8/d25/d3d/d72/d80/d5d/d67/lca 0 2024-09-21T08:02:47.027 INFO:tasks.workunit.client.0.smithi107.stdout:1/493: truncate d0/d29/d2c/f52 2874995 0 2024-09-21T08:02:47.028 INFO:tasks.workunit.client.0.smithi107.stdout:2/457: getdents d1/d2/d6d 0 2024-09-21T08:02:47.028 INFO:tasks.workunit.client.0.smithi107.stdout:2/458: fdatasync d1/d6/f95 0 2024-09-21T08:02:47.028 INFO:tasks.workunit.client.0.smithi107.stdout:8/468: dwrite d5/f21 [4194304,4194304] 0 2024-09-21T08:02:47.030 INFO:tasks.workunit.client.0.smithi107.stdout:2/459: dread d1/d6/f51 [0,4194304] 0 2024-09-21T08:02:47.031 INFO:tasks.workunit.client.0.smithi107.stdout:7/410: symlink d7/d22/d37/l94 0 2024-09-21T08:02:47.031 INFO:tasks.workunit.client.0.smithi107.stdout:7/411: write d7/f14 [1805041,70866] 0 2024-09-21T08:02:47.031 INFO:tasks.workunit.client.0.smithi107.stdout:7/412: readlink d7/d22/l32 0 2024-09-21T08:02:47.031 INFO:tasks.workunit.client.0.smithi107.stdout:7/413: readlink d7/d22/d3a/l79 0 2024-09-21T08:02:47.034 INFO:tasks.workunit.client.0.smithi107.stdout:3/573: link d8/d25/d3d/l40 d8/d2b/d52/d71/db3/dc2/lcb 0 2024-09-21T08:02:47.034 INFO:tasks.workunit.client.0.smithi107.stdout:3/574: readlink d8/d25/d3d/d72/d80/d5d/lb2 0 2024-09-21T08:02:47.038 INFO:tasks.workunit.client.0.smithi107.stdout:1/494: mknod d0/d19/ca6 0 2024-09-21T08:02:47.043 INFO:tasks.workunit.client.0.smithi107.stdout:7/414: symlink d7/d22/d37/d4b/d4e/d4f/l95 0 2024-09-21T08:02:47.046 INFO:tasks.workunit.client.0.smithi107.stdout:1/495: rename d0/d19/d2b/d4b/d44/d55/l92 to d0/d19/d2b/la7 0 2024-09-21T08:02:47.048 INFO:tasks.workunit.client.0.smithi107.stdout:8/469: dread d5/d44/d5d/f68 [0,4194304] 0 2024-09-21T08:02:47.048 INFO:tasks.workunit.client.0.smithi107.stdout:4/423: dwrite dc/d13/f38 [0,4194304] 0 2024-09-21T08:02:47.048 INFO:tasks.workunit.client.0.smithi107.stdout:8/470: write d5/d2e/f4a [628322,96567] 0 2024-09-21T08:02:47.048 INFO:tasks.workunit.client.0.smithi107.stdout:8/471: chown d5/d44/d47/l49 308163547 1 2024-09-21T08:02:47.053 INFO:tasks.workunit.client.0.smithi107.stdout:7/415: rename d7/d22/f5c to d7/d22/d37/d4b/d4e/f96 0 2024-09-21T08:02:47.055 INFO:tasks.workunit.client.0.smithi107.stdout:1/496: creat d0/d80/fa8 x:0 0 0 2024-09-21T08:02:47.055 INFO:tasks.workunit.client.0.smithi107.stdout:1/497: chown d0/d19/d2b/d4b/d44/d72/d36/l9e 5888552 1 2024-09-21T08:02:47.055 INFO:tasks.workunit.client.0.smithi107.stdout:1/498: chown d0/d19/d2b/d4b/d1c/f26 452387201 1 2024-09-21T08:02:47.063 INFO:tasks.workunit.client.0.smithi107.stdout:3/575: dwrite d8/d25/d42/fb7 [0,4194304] 0 2024-09-21T08:02:47.071 INFO:tasks.workunit.client.0.smithi107.stdout:4/424: rename dc/d4c/l56 to dc/d13/d40/d5e/l81 0 2024-09-21T08:02:47.072 INFO:tasks.workunit.client.0.smithi107.stdout:7/416: creat d7/d22/d3d/d8a/f97 x:0 0 0 2024-09-21T08:02:47.072 INFO:tasks.workunit.client.0.smithi107.stdout:7/417: read d7/d22/d37/d4b/d4e/f62 [600387,31223] 0 2024-09-21T08:02:47.072 INFO:tasks.workunit.client.0.smithi107.stdout:8/472: dwrite d5/d44/d5d/f68 [0,4194304] 0 2024-09-21T08:02:47.072 INFO:tasks.workunit.client.0.smithi107.stdout:8/473: write d5/d1d/f3a [49386,29443] 0 2024-09-21T08:02:47.076 INFO:tasks.workunit.client.0.smithi107.stdout:1/499: mkdir d0/d19/d2b/d4b/d1c/da9 0 2024-09-21T08:02:47.081 INFO:tasks.workunit.client.0.smithi107.stdout:1/500: read d0/d19/d59/f6f [131448,128817] 0 2024-09-21T08:02:47.081 INFO:tasks.workunit.client.0.smithi107.stdout:3/576: dread d8/f1b [0,4194304] 0 2024-09-21T08:02:47.089 INFO:tasks.workunit.client.0.smithi107.stdout:4/425: dread f8 [0,4194304] 0 2024-09-21T08:02:47.090 INFO:tasks.workunit.client.0.smithi107.stdout:4/426: dread - dc/d13/d5a/f78 zero size 2024-09-21T08:02:47.091 INFO:tasks.workunit.client.0.smithi107.stdout:8/474: symlink d5/d44/d47/d5e/l9f 0 2024-09-21T08:02:47.093 INFO:tasks.workunit.client.0.smithi107.stdout:1/501: rename d0/d19/d2b/d4b/l2f to d0/d29/laa 0 2024-09-21T08:02:47.093 INFO:tasks.workunit.client.0.smithi107.stdout:1/502: chown d0/d19/l46 859 1 2024-09-21T08:02:47.094 INFO:tasks.workunit.client.0.smithi107.stdout:1/503: dread - d0/d19/d2b/d4b/d44/d72/d36/f73 zero size 2024-09-21T08:02:47.094 INFO:tasks.workunit.client.0.smithi107.stdout:1/504: chown d0/d29/d31/f42 14 1 2024-09-21T08:02:47.094 INFO:tasks.workunit.client.0.smithi107.stdout:3/577: dread d8/d14/d1d/fa0 [0,4194304] 0 2024-09-21T08:02:47.096 INFO:tasks.workunit.client.0.smithi107.stdout:7/418: dwrite d7/d22/d37/d4b/f7e [0,4194304] 0 2024-09-21T08:02:47.096 INFO:tasks.workunit.client.0.smithi107.stdout:7/419: stat d7/d22/d3a 0 2024-09-21T08:02:47.096 INFO:tasks.workunit.client.0.smithi107.stdout:7/420: fdatasync d7/d22/f24 0 2024-09-21T08:02:47.096 INFO:tasks.workunit.client.0.smithi107.stdout:4/427: creat dc/d13/d40/d46/f82 x:0 0 0 2024-09-21T08:02:47.097 INFO:tasks.workunit.client.0.smithi107.stdout:8/475: symlink d5/d44/d5d/la0 0 2024-09-21T08:02:47.097 INFO:tasks.workunit.client.0.smithi107.stdout:2/460: dwrite d1/d2/d6d/f5b [4194304,4194304] 0 2024-09-21T08:02:47.097 INFO:tasks.workunit.client.0.smithi107.stdout:2/461: fdatasync d1/d16/f32 0 2024-09-21T08:02:47.098 INFO:tasks.workunit.client.0.smithi107.stdout:3/578: rmdir d8/d2b/d52/d71/db3 39 2024-09-21T08:02:47.102 INFO:tasks.workunit.client.0.smithi107.stdout:7/421: unlink d7/d22/d3d/d8a/f97 0 2024-09-21T08:02:47.102 INFO:tasks.workunit.client.0.smithi107.stdout:7/422: fdatasync d7/d22/d3a/f67 0 2024-09-21T08:02:47.103 INFO:tasks.workunit.client.0.smithi107.stdout:7/423: read d7/d38/f7d [229813,76232] 0 2024-09-21T08:02:47.103 INFO:tasks.workunit.client.0.smithi107.stdout:7/424: chown d7/d22/d37/d4b/d4e/l70 29992 1 2024-09-21T08:02:47.103 INFO:tasks.workunit.client.0.smithi107.stdout:7/425: stat d7/d22/d3a 0 2024-09-21T08:02:47.104 INFO:tasks.workunit.client.0.smithi107.stdout:2/462: dread d1/d2/d6d/f52 [0,4194304] 0 2024-09-21T08:02:47.104 INFO:tasks.workunit.client.0.smithi107.stdout:2/463: rename d1/d2 to d1/d2/d6d/d37/d82/d9a 22 2024-09-21T08:02:47.104 INFO:tasks.workunit.client.0.smithi107.stdout:8/476: symlink d5/d23/d69/la1 0 2024-09-21T08:02:47.108 INFO:tasks.workunit.client.0.smithi107.stdout:3/579: unlink d8/d14/d1d/fa0 0 2024-09-21T08:02:47.110 INFO:tasks.workunit.client.0.smithi107.stdout:7/426: mknod d7/d22/d3d/c98 0 2024-09-21T08:02:47.110 INFO:tasks.workunit.client.0.smithi107.stdout:1/505: dread d0/d19/d2b/d4b/d44/d72/f1d [4194304,4194304] 0 2024-09-21T08:02:47.110 INFO:tasks.workunit.client.0.smithi107.stdout:1/506: write d0/d19/d59/f91 [541264,13119] 0 2024-09-21T08:02:47.110 INFO:tasks.workunit.client.0.smithi107.stdout:1/507: truncate d0/d19/d2b/d4b/d44/d72/d36/f47 1987282 0 2024-09-21T08:02:47.111 INFO:tasks.workunit.client.0.smithi107.stdout:8/477: mknod d5/d38/d67/ca2 0 2024-09-21T08:02:47.112 INFO:tasks.workunit.client.0.smithi107.stdout:8/478: mkdir d5/d38/d56/da3 0 2024-09-21T08:02:47.112 INFO:tasks.workunit.client.0.smithi107.stdout:8/479: truncate d5/d2e/d7c/d9a/f70 589598 0 2024-09-21T08:02:47.112 INFO:tasks.workunit.client.0.smithi107.stdout:8/480: readlink d5/d44/d5d/la0 0 2024-09-21T08:02:47.113 INFO:tasks.workunit.client.0.smithi107.stdout:8/481: dread d5/d38/d56/d52/f8f [0,4194304] 0 2024-09-21T08:02:47.115 INFO:tasks.workunit.client.0.smithi107.stdout:8/482: symlink d5/d44/la4 0 2024-09-21T08:02:47.115 INFO:tasks.workunit.client.0.smithi107.stdout:8/483: fdatasync d5/d1d/f5b 0 2024-09-21T08:02:47.117 INFO:tasks.workunit.client.0.smithi107.stdout:8/484: mknod d5/d23/ca5 0 2024-09-21T08:02:47.117 INFO:tasks.workunit.client.0.smithi107.stdout:8/485: readlink d5/d23/d69/la1 0 2024-09-21T08:02:47.119 INFO:tasks.workunit.client.0.smithi107.stdout:5/629: sync 2024-09-21T08:02:47.119 INFO:tasks.workunit.client.0.smithi107.stdout:9/614: sync 2024-09-21T08:02:47.120 INFO:tasks.workunit.client.0.smithi107.stdout:5/630: write d7/de/d1d/d24/f6e [497372,36499] 0 2024-09-21T08:02:47.125 INFO:tasks.workunit.client.0.smithi107.stdout:5/631: rmdir d7/de/d1d/d29 39 2024-09-21T08:02:47.127 INFO:tasks.workunit.client.0.smithi107.stdout:5/632: creat d7/de/d2d/d5d/d60/dc5/fe0 x:0 0 0 2024-09-21T08:02:47.128 INFO:tasks.workunit.client.0.smithi107.stdout:5/633: write d7/fd5 [115748,72824] 0 2024-09-21T08:02:47.128 INFO:tasks.workunit.client.0.smithi107.stdout:5/634: chown d7/d74/c83 56 1 2024-09-21T08:02:47.128 INFO:tasks.workunit.client.0.smithi107.stdout:3/580: dread d8/d2b/d45/f6a [0,4194304] 0 2024-09-21T08:02:47.128 INFO:tasks.workunit.client.0.smithi107.stdout:3/581: chown d8/l95 6988 1 2024-09-21T08:02:47.128 INFO:tasks.workunit.client.0.smithi107.stdout:3/582: truncate d8/d25/d3d/d72/d80/f7f 1341365 0 2024-09-21T08:02:47.128 INFO:tasks.workunit.client.0.smithi107.stdout:9/615: dread d11/d27/d2f/f3b [0,4194304] 0 2024-09-21T08:02:47.129 INFO:tasks.workunit.client.0.smithi107.stdout:5/635: creat d7/de/d2d/d5d/d60/fe1 x:0 0 0 2024-09-21T08:02:47.129 INFO:tasks.workunit.client.0.smithi107.stdout:5/636: readlink d7/de/d1d/d24/ld6 0 2024-09-21T08:02:47.130 INFO:tasks.workunit.client.0.smithi107.stdout:9/616: symlink d11/d27/d2f/d4d/d5c/ldd 0 2024-09-21T08:02:47.132 INFO:tasks.workunit.client.0.smithi107.stdout:5/637: mknod d7/de/d35/ce2 0 2024-09-21T08:02:47.132 INFO:tasks.workunit.client.0.smithi107.stdout:5/638: dread - d7/de/d2d/d5d/d60/fb8 zero size 2024-09-21T08:02:47.132 INFO:tasks.workunit.client.0.smithi107.stdout:5/639: stat d7/de/d1d/d29/d68/ddb/dde/lab 0 2024-09-21T08:02:47.132 INFO:tasks.workunit.client.0.smithi107.stdout:5/640: readlink d7/de/d1d/d29/d68/ddb/dde/lab 0 2024-09-21T08:02:47.133 INFO:tasks.workunit.client.0.smithi107.stdout:9/617: mknod d11/d27/d2f/d4d/d5c/cde 0 2024-09-21T08:02:47.133 INFO:tasks.workunit.client.0.smithi107.stdout:8/486: dread d5/d23/f2f [4194304,4194304] 0 2024-09-21T08:02:47.133 INFO:tasks.workunit.client.0.smithi107.stdout:9/618: truncate d11/d27/d98/f47 4436512 0 2024-09-21T08:02:47.133 INFO:tasks.workunit.client.0.smithi107.stdout:9/619: truncate d11/d27/d5e/d76/f8c 654491 0 2024-09-21T08:02:47.135 INFO:tasks.workunit.client.0.smithi107.stdout:5/641: unlink d7/de/d1d/c93 0 2024-09-21T08:02:47.135 INFO:tasks.workunit.client.0.smithi107.stdout:5/642: chown d7/de/d2d/d5d/d60/c67 63 1 2024-09-21T08:02:47.137 INFO:tasks.workunit.client.0.smithi107.stdout:4/428: dwrite dc/d13/d40/d46/f82 [0,4194304] 0 2024-09-21T08:02:47.137 INFO:tasks.workunit.client.0.smithi107.stdout:4/429: chown dc/d13/l37 57 1 2024-09-21T08:02:47.137 INFO:tasks.workunit.client.0.smithi107.stdout:2/464: dwrite d1/d1e/f5c [0,4194304] 0 2024-09-21T08:02:47.141 INFO:tasks.workunit.client.0.smithi107.stdout:0/467: sync 2024-09-21T08:02:47.141 INFO:tasks.workunit.client.0.smithi107.stdout:0/468: creat d1/d5/d25/d2d/f96 x:0 0 0 2024-09-21T08:02:47.141 INFO:tasks.workunit.client.0.smithi107.stdout:0/469: write d1/d6f/d80/f86 [833940,12356] 0 2024-09-21T08:02:47.141 INFO:tasks.workunit.client.0.smithi107.stdout:6/600: sync 2024-09-21T08:02:47.142 INFO:tasks.workunit.client.0.smithi107.stdout:5/643: dread d7/de/f99 [0,4194304] 0 2024-09-21T08:02:47.143 INFO:tasks.workunit.client.0.smithi107.stdout:6/601: read d2/d3/f4 [8412747,98219] 0 2024-09-21T08:02:47.145 INFO:tasks.workunit.client.0.smithi107.stdout:2/465: mkdir d1/d2/d6d/d9b 0 2024-09-21T08:02:47.150 INFO:tasks.workunit.client.0.smithi107.stdout:3/583: rename d8/d14/d1d to d8/d2b/d45/dcc 0 2024-09-21T08:02:47.150 INFO:tasks.workunit.client.0.smithi107.stdout:3/584: creat d8/d25/fcd x:0 0 0 2024-09-21T08:02:47.152 INFO:tasks.workunit.client.0.smithi107.stdout:0/470: write d1/d5/d25/d2d/f2f [4277340,6264] 0 2024-09-21T08:02:47.152 INFO:tasks.workunit.client.0.smithi107.stdout:2/466: mkdir d1/d16/d9c 0 2024-09-21T08:02:47.152 INFO:tasks.workunit.client.0.smithi107.stdout:0/471: write d1/f8 [5242186,46950] 0 2024-09-21T08:02:47.152 INFO:tasks.workunit.client.0.smithi107.stdout:2/467: write d1/d2/f7a [298321,16149] 0 2024-09-21T08:02:47.154 INFO:tasks.workunit.client.0.smithi107.stdout:2/468: link d1/d16/c40 d1/d16/d9c/c9d 0 2024-09-21T08:02:47.156 INFO:tasks.workunit.client.0.smithi107.stdout:5/644: write d7/de/d1d/f48 [2780868,87165] 0 2024-09-21T08:02:47.156 INFO:tasks.workunit.client.0.smithi107.stdout:0/472: rename d1/d5/d25/d3d/c69 to d1/d5/d25/d3d/d20/d85/d8a/c97 0 2024-09-21T08:02:47.159 INFO:tasks.workunit.client.0.smithi107.stdout:2/469: getdents d1/d2 0 2024-09-21T08:02:47.160 INFO:tasks.workunit.client.0.smithi107.stdout:5/645: unlink d7/f39 0 2024-09-21T08:02:47.160 INFO:tasks.workunit.client.0.smithi107.stdout:5/646: fsync d7/de/d1d/dbc/fc9 0 2024-09-21T08:02:47.161 INFO:tasks.workunit.client.0.smithi107.stdout:0/473: fsync d1/d5/f7e 0 2024-09-21T08:02:47.162 INFO:tasks.workunit.client.0.smithi107.stdout:6/602: dread d2/d3/d7/d79/fb5 [0,4194304] 0 2024-09-21T08:02:47.162 INFO:tasks.workunit.client.0.smithi107.stdout:2/470: mkdir d1/d6/d9e 0 2024-09-21T08:02:47.164 INFO:tasks.workunit.client.0.smithi107.stdout:5/647: dread d7/de/d52/d6b/f7e [0,4194304] 0 2024-09-21T08:02:47.167 INFO:tasks.workunit.client.0.smithi107.stdout:6/603: rename d2/d3/d7/d2a/f47 to d2/d3/d7/d24/d41/fc1 0 2024-09-21T08:02:47.167 INFO:tasks.workunit.client.0.smithi107.stdout:6/604: write d2/d3/d7/d24/f37 [2622779,68520] 0 2024-09-21T08:02:47.168 INFO:tasks.workunit.client.0.smithi107.stdout:2/471: rmdir d1/d2/d6d/d42 39 2024-09-21T08:02:47.168 INFO:tasks.workunit.client.0.smithi107.stdout:2/472: readlink d1/d2/d6d/d42/l88 0 2024-09-21T08:02:47.168 INFO:tasks.workunit.client.0.smithi107.stdout:5/648: read d7/de/d1d/d29/d64/f90 [627066,60184] 0 2024-09-21T08:02:47.170 INFO:tasks.workunit.client.0.smithi107.stdout:6/605: dread d2/d3/d7/f1b [0,4194304] 0 2024-09-21T08:02:47.170 INFO:tasks.workunit.client.0.smithi107.stdout:6/606: getdents d2/d2e/db2 0 2024-09-21T08:02:47.170 INFO:tasks.workunit.client.0.smithi107.stdout:6/607: getdents d2/d2e/db2 0 2024-09-21T08:02:47.170 INFO:tasks.workunit.client.0.smithi107.stdout:6/608: fdatasync d2/d3/d7/fb7 0 2024-09-21T08:02:47.172 INFO:tasks.workunit.client.0.smithi107.stdout:0/474: rmdir d1/d5/d25/d3d/d20/d29 39 2024-09-21T08:02:47.175 INFO:tasks.workunit.client.0.smithi107.stdout:2/473: rename d1/d16/f3b to d1/d6/d92/f9f 0 2024-09-21T08:02:47.176 INFO:tasks.workunit.client.0.smithi107.stdout:5/649: mkdir d7/d70/de3 0 2024-09-21T08:02:47.176 INFO:tasks.workunit.client.0.smithi107.stdout:5/650: readlink d7/de/d35/la4 0 2024-09-21T08:02:47.176 INFO:tasks.workunit.client.0.smithi107.stdout:5/651: truncate d7/de/d2d/d5d/d60/fe1 215077 0 2024-09-21T08:02:47.176 INFO:tasks.workunit.client.0.smithi107.stdout:6/609: symlink d2/d3/d7/d48/lc2 0 2024-09-21T08:02:47.179 INFO:tasks.workunit.client.0.smithi107.stdout:8/487: dwrite d5/d1d/f3a [0,4194304] 0 2024-09-21T08:02:47.179 INFO:tasks.workunit.client.0.smithi107.stdout:5/652: link d7/de/d52/d6b/lb3 d7/de/d1d/d29/d64/le4 0 2024-09-21T08:02:47.182 INFO:tasks.workunit.client.0.smithi107.stdout:8/488: rename d5/d38/d56/d54/f62 to d5/d38/d67/d7d/d91/fa6 0 2024-09-21T08:02:47.182 INFO:tasks.workunit.client.0.smithi107.stdout:5/653: getdents d7/de/d1d/d29/d68 0 2024-09-21T08:02:47.183 INFO:tasks.workunit.client.0.smithi107.stdout:4/430: dwrite dc/d64/f79 [0,4194304] 0 2024-09-21T08:02:47.184 INFO:tasks.workunit.client.0.smithi107.stdout:8/489: symlink d5/d38/d56/d52/d7a/la7 0 2024-09-21T08:02:47.184 INFO:tasks.workunit.client.0.smithi107.stdout:8/490: fsync d5/d38/d56/d54/f80 0 2024-09-21T08:02:47.185 INFO:tasks.workunit.client.0.smithi107.stdout:4/431: read dc/f68 [12464,119922] 0 2024-09-21T08:02:47.187 INFO:tasks.workunit.client.0.smithi107.stdout:8/491: dread d5/d1d/f24 [0,4194304] 0 2024-09-21T08:02:47.188 INFO:tasks.workunit.client.0.smithi107.stdout:3/585: dwrite d8/d25/d42/dae/db1/fbb [0,4194304] 0 2024-09-21T08:02:47.192 INFO:tasks.workunit.client.0.smithi107.stdout:8/492: rename d5/d44/d47/d5e/l71 to d5/d2e/d7c/d9a/d9e/la8 0 2024-09-21T08:02:47.193 INFO:tasks.workunit.client.0.smithi107.stdout:3/586: mknod d8/d2b/d52/d71/db3/cce 0 2024-09-21T08:02:47.206 INFO:tasks.workunit.client.0.smithi107.stdout:8/493: dread d5/d23/f35 [4194304,4194304] 0 2024-09-21T08:02:47.226 INFO:tasks.workunit.client.0.smithi107.stdout:8/494: dread d5/d44/d5d/f68 [0,4194304] 0 2024-09-21T08:02:47.227 INFO:tasks.workunit.client.0.smithi107.stdout:8/495: rename d5/d38/d67/ca2 to d5/d1d/ca9 0 2024-09-21T08:02:47.229 INFO:tasks.workunit.client.0.smithi107.stdout:2/474: dwrite d1/d16/f61 [0,4194304] 0 2024-09-21T08:02:47.230 INFO:tasks.workunit.client.0.smithi107.stdout:2/475: symlink d1/d1e/la0 0 2024-09-21T08:02:47.236 INFO:tasks.workunit.client.0.smithi107.stdout:4/432: dwrite dc/d13/f2a [4194304,4194304] 0 2024-09-21T08:02:47.236 INFO:tasks.workunit.client.0.smithi107.stdout:4/433: truncate dc/d13/f5d 4622083 0 2024-09-21T08:02:47.236 INFO:tasks.workunit.client.0.smithi107.stdout:4/434: fsync dc/d13/d40/f42 0 2024-09-21T08:02:47.236 INFO:tasks.workunit.client.0.smithi107.stdout:3/587: dwrite d8/d38/f97 [0,4194304] 0 2024-09-21T08:02:47.236 INFO:tasks.workunit.client.0.smithi107.stdout:6/610: dwrite d2/d3/d7/d24/d41/d50/f91 [0,4194304] 0 2024-09-21T08:02:47.241 INFO:tasks.workunit.client.0.smithi107.stdout:3/588: mkdir d8/dcf 0 2024-09-21T08:02:47.241 INFO:tasks.workunit.client.0.smithi107.stdout:3/589: dread - d8/d25/d42/f86 zero size 2024-09-21T08:02:47.242 INFO:tasks.workunit.client.0.smithi107.stdout:6/611: symlink d2/d2e/lc3 0 2024-09-21T08:02:47.242 INFO:tasks.workunit.client.0.smithi107.stdout:6/612: chown d2/d3/d7/d54/d5c 103 1 2024-09-21T08:02:47.243 INFO:tasks.workunit.client.0.smithi107.stdout:4/435: getdents dc/d13 0 2024-09-21T08:02:47.243 INFO:tasks.workunit.client.0.smithi107.stdout:4/436: fdatasync dc/d13/d40/f42 0 2024-09-21T08:02:47.243 INFO:tasks.workunit.client.0.smithi107.stdout:4/437: truncate dc/d13/f3e 1099146 0 2024-09-21T08:02:47.245 INFO:tasks.workunit.client.0.smithi107.stdout:4/438: getdents dc/d13/d40/d5e/d6e 0 2024-09-21T08:02:47.248 INFO:tasks.workunit.client.0.smithi107.stdout:3/590: dread d8/f13 [0,4194304] 0 2024-09-21T08:02:47.248 INFO:tasks.workunit.client.0.smithi107.stdout:3/591: truncate d8/f8a 1366396 0 2024-09-21T08:02:47.248 INFO:tasks.workunit.client.0.smithi107.stdout:3/592: write d8/d25/d3d/d72/d80/f7f [2102760,61451] 0 2024-09-21T08:02:47.248 INFO:tasks.workunit.client.0.smithi107.stdout:3/593: mkdir d8/d25/d34/dd0 0 2024-09-21T08:02:47.250 INFO:tasks.workunit.client.0.smithi107.stdout:3/594: creat d8/d2b/d45/dbf/fd1 x:0 0 0 2024-09-21T08:02:47.265 INFO:tasks.workunit.client.0.smithi107.stdout:4/439: dwrite dc/d13/d40/d46/d48/d63/f73 [0,4194304] 0 2024-09-21T08:02:47.266 INFO:tasks.workunit.client.0.smithi107.stdout:4/440: mkdir dc/d13/d83 0 2024-09-21T08:02:47.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:46 smithi129 ceph-mon[34472]: pgmap v15: 65 pgs: 65 active+clean; 2.8 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 216 MiB/s rd, 264 MiB/s wr, 368 op/s 2024-09-21T08:02:47.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:46 smithi129 ceph-mon[34472]: Adjusting osd_memory_target on smithi107 to 1557M 2024-09-21T08:02:47.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:46 smithi129 ceph-mon[34472]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-21T08:02:47.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:46 smithi129 ceph-mon[34472]: Updating smithi129:/etc/ceph/ceph.conf 2024-09-21T08:02:47.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:46 smithi129 ceph-mon[34472]: Updating smithi129:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T08:02:47.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:46 smithi129 ceph-mon[34472]: Updating smithi107:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T08:02:47.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:46 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:47.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:46 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:47.267 INFO:tasks.workunit.client.0.smithi107.stdout:4/441: mknod dc/d60/c84 0 2024-09-21T08:02:47.268 INFO:tasks.workunit.client.0.smithi107.stdout:4/442: unlink dc/d60/c84 0 2024-09-21T08:02:47.270 INFO:tasks.workunit.client.0.smithi107.stdout:4/443: link dc/d64/d6b/l7e dc/d13/d40/d46/d48/l85 0 2024-09-21T08:02:47.273 INFO:tasks.workunit.client.0.smithi107.stdout:8/496: dwrite d5/d38/d56/d54/f80 [0,4194304] 0 2024-09-21T08:02:47.275 INFO:tasks.workunit.client.0.smithi107.stdout:2/476: dwrite d1/d6/f95 [0,4194304] 0 2024-09-21T08:02:47.275 INFO:tasks.workunit.client.0.smithi107.stdout:6/613: dwrite d2/d3/d7/d54/d5c/f62 [0,4194304] 0 2024-09-21T08:02:47.275 INFO:tasks.workunit.client.0.smithi107.stdout:6/614: readlink d2/d3/d7/d79/l7c 0 2024-09-21T08:02:47.278 INFO:tasks.workunit.client.0.smithi107.stdout:2/477: creat d1/d6/d9e/fa1 x:0 0 0 2024-09-21T08:02:47.278 INFO:tasks.workunit.client.0.smithi107.stdout:2/478: dread - d1/d6/f2e zero size 2024-09-21T08:02:47.285 INFO:tasks.workunit.client.0.smithi107.stdout:2/479: dread d1/d2/d6d/d37/f91 [0,4194304] 0 2024-09-21T08:02:47.290 INFO:tasks.workunit.client.0.smithi107.stdout:2/480: rename d1/d2/d6d/d37/l96 to d1/d2/d6d/d37/d82/la2 0 2024-09-21T08:02:47.290 INFO:tasks.workunit.client.0.smithi107.stdout:2/481: write d1/d2/f15 [1579948,74395] 0 2024-09-21T08:02:47.290 INFO:tasks.workunit.client.0.smithi107.stdout:4/444: truncate dc/d13/f3e 1017770 0 2024-09-21T08:02:47.293 INFO:tasks.workunit.client.0.smithi107.stdout:2/482: rmdir d1/d2/d6d/d37/d49 39 2024-09-21T08:02:47.293 INFO:tasks.workunit.client.0.smithi107.stdout:2/483: write d1/d16/d35/f59 [979982,78589] 0 2024-09-21T08:02:47.296 INFO:tasks.workunit.client.0.smithi107.stdout:4/445: creat dc/d13/d83/f86 x:0 0 0 2024-09-21T08:02:47.298 INFO:tasks.workunit.client.0.smithi107.stdout:2/484: mkdir d1/d6/d9e/da3 0 2024-09-21T08:02:47.298 INFO:tasks.workunit.client.0.smithi107.stdout:2/485: read - d1/d2/d6d/d37/d49/f83 zero size 2024-09-21T08:02:47.298 INFO:tasks.workunit.client.0.smithi107.stdout:2/486: write d1/d2/f34 [512214,102600] 0 2024-09-21T08:02:47.298 INFO:tasks.workunit.client.0.smithi107.stdout:2/487: readlink d1/l4 0 2024-09-21T08:02:47.298 INFO:tasks.workunit.client.0.smithi107.stdout:2/488: fsync d1/d2/d6d/d37/d49/f77 0 2024-09-21T08:02:47.298 INFO:tasks.workunit.client.0.smithi107.stdout:4/446: mknod dc/d13/d40/d5e/c87 0 2024-09-21T08:02:47.298 INFO:tasks.workunit.client.0.smithi107.stdout:4/447: fdatasync dc/f1e 0 2024-09-21T08:02:47.298 INFO:tasks.workunit.client.0.smithi107.stdout:4/448: write dc/d13/f4f [1850142,124302] 0 2024-09-21T08:02:47.299 INFO:tasks.workunit.client.0.smithi107.stdout:6/615: dwrite d2/d3/d7/f11 [0,4194304] 0 2024-09-21T08:02:47.300 INFO:tasks.workunit.client.0.smithi107.stdout:2/489: creat d1/d2/fa4 x:0 0 0 2024-09-21T08:02:47.301 INFO:tasks.workunit.client.0.smithi107.stdout:4/449: rmdir dc/d64/d6b 39 2024-09-21T08:02:47.302 INFO:tasks.workunit.client.0.smithi107.stdout:6/616: unlink d2/d3/f5e 0 2024-09-21T08:02:47.302 INFO:tasks.workunit.client.0.smithi107.stdout:4/450: rmdir dc/d13/d40/d5e/d6e 39 2024-09-21T08:02:47.304 INFO:tasks.workunit.client.0.smithi107.stdout:6/617: symlink d2/d3/d7/d54/lc4 0 2024-09-21T08:02:47.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:46 smithi107 ceph-mon[27622]: pgmap v15: 65 pgs: 65 active+clean; 2.8 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 216 MiB/s rd, 264 MiB/s wr, 368 op/s 2024-09-21T08:02:47.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:46 smithi107 ceph-mon[27622]: Adjusting osd_memory_target on smithi107 to 1557M 2024-09-21T08:02:47.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:46 smithi107 ceph-mon[27622]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-21T08:02:47.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:46 smithi107 ceph-mon[27622]: Updating smithi129:/etc/ceph/ceph.conf 2024-09-21T08:02:47.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:46 smithi107 ceph-mon[27622]: Updating smithi129:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T08:02:47.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:46 smithi107 ceph-mon[27622]: Updating smithi107:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T08:02:47.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:46 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:47.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:46 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:47.307 INFO:tasks.workunit.client.0.smithi107.stdout:6/618: truncate d2/d3/d7/d3f/f7b 891303 0 2024-09-21T08:02:47.307 INFO:tasks.workunit.client.0.smithi107.stdout:2/490: write d1/d6/f95 [3015449,97502] 0 2024-09-21T08:02:47.311 INFO:tasks.workunit.client.0.smithi107.stdout:6/619: dread d2/fe [0,4194304] 0 2024-09-21T08:02:47.311 INFO:tasks.workunit.client.0.smithi107.stdout:6/620: fdatasync d2/d2e/f4c 0 2024-09-21T08:02:47.311 INFO:tasks.workunit.client.0.smithi107.stdout:6/621: readlink d2/d3/d7/l33 0 2024-09-21T08:02:47.312 INFO:tasks.workunit.client.0.smithi107.stdout:6/622: write d2/d3/d7/d2a/f8b [746819,83458] 0 2024-09-21T08:02:47.312 INFO:tasks.workunit.client.0.smithi107.stdout:6/623: write d2/fd [8678090,104415] 0 2024-09-21T08:02:47.315 INFO:tasks.workunit.client.0.smithi107.stdout:6/624: unlink d2/d3/d7/d23/d2b/l52 0 2024-09-21T08:02:47.315 INFO:tasks.workunit.client.0.smithi107.stdout:6/625: dread - d2/d3/d7/fb7 zero size 2024-09-21T08:02:47.317 INFO:tasks.workunit.client.0.smithi107.stdout:6/626: dread d2/d3/d7/d24/d41/fbf [0,4194304] 0 2024-09-21T08:02:47.323 INFO:tasks.workunit.client.0.smithi107.stdout:4/451: write dc/d13/f3e [1407774,78116] 0 2024-09-21T08:02:47.324 INFO:tasks.workunit.client.0.smithi107.stdout:4/452: mknod dc/d13/d40/c88 0 2024-09-21T08:02:47.326 INFO:tasks.workunit.client.0.smithi107.stdout:4/453: creat dc/d13/d40/d5e/d77/f89 x:0 0 0 2024-09-21T08:02:47.327 INFO:tasks.workunit.client.0.smithi107.stdout:2/491: dwrite d1/d6/d9e/fa1 [0,4194304] 0 2024-09-21T08:02:47.328 INFO:tasks.workunit.client.0.smithi107.stdout:4/454: mkdir dc/d13/d83/d8a 0 2024-09-21T08:02:47.330 INFO:tasks.workunit.client.0.smithi107.stdout:6/627: read d2/d3/f4 [6458839,97722] 0 2024-09-21T08:02:47.334 INFO:tasks.workunit.client.0.smithi107.stdout:2/492: creat d1/d16/fa5 x:0 0 0 2024-09-21T08:02:47.337 INFO:tasks.workunit.client.0.smithi107.stdout:6/628: link d2/d3/d7/f1f d2/d3/d7/d23/d2b/d84/fc5 0 2024-09-21T08:02:47.339 INFO:tasks.workunit.client.0.smithi107.stdout:2/493: symlink d1/d16/la6 0 2024-09-21T08:02:47.339 INFO:tasks.workunit.client.0.smithi107.stdout:2/494: fdatasync d1/d1e/f3e 0 2024-09-21T08:02:47.340 INFO:tasks.workunit.client.0.smithi107.stdout:4/455: getdents dc/d13/d83 0 2024-09-21T08:02:47.342 INFO:tasks.workunit.client.0.smithi107.stdout:6/629: unlink d2/d3/d7/d48/lc2 0 2024-09-21T08:02:47.345 INFO:tasks.workunit.client.0.smithi107.stdout:2/495: rename d1/d6/f21 to d1/d2/d6d/d42/d76/fa7 0 2024-09-21T08:02:47.345 INFO:tasks.workunit.client.0.smithi107.stdout:6/630: creat d2/d3/d7/d2a/fc6 x:0 0 0 2024-09-21T08:02:47.348 INFO:tasks.workunit.client.0.smithi107.stdout:2/496: dread d1/d2/d6d/f5f [0,4194304] 0 2024-09-21T08:02:47.348 INFO:tasks.workunit.client.0.smithi107.stdout:2/497: write d1/d2/d6d/d37/d49/f83 [680617,4959] 0 2024-09-21T08:02:47.348 INFO:tasks.workunit.client.0.smithi107.stdout:2/498: creat d1/d2/d6d/d37/d49/d7f/fa8 x:0 0 0 2024-09-21T08:02:47.349 INFO:tasks.workunit.client.0.smithi107.stdout:6/631: unlink d2/d3/f26 0 2024-09-21T08:02:47.349 INFO:tasks.workunit.client.0.smithi107.stdout:4/456: read dc/d4c/f4d [3810148,41818] 0 2024-09-21T08:02:47.349 INFO:tasks.workunit.client.0.smithi107.stdout:4/457: stat dc/d13/d40/d46/c74 0 2024-09-21T08:02:47.350 INFO:tasks.workunit.client.0.smithi107.stdout:2/499: rename d1/d2/d6d/d37/d49/l73 to d1/d2/d6d/d9b/la9 0 2024-09-21T08:02:47.352 INFO:tasks.workunit.client.0.smithi107.stdout:6/632: mknod d2/d3/d7/d48/da3/cc7 0 2024-09-21T08:02:47.354 INFO:tasks.workunit.client.0.smithi107.stdout:4/458: rename dc/d13/d83/f86 to dc/d60/f8b 0 2024-09-21T08:02:47.356 INFO:tasks.workunit.client.0.smithi107.stdout:2/500: truncate d1/f33 3799804 0 2024-09-21T08:02:47.357 INFO:tasks.workunit.client.0.smithi107.stdout:4/459: truncate dc/d13/d40/d46/d48/d63/f73 2943953 0 2024-09-21T08:02:47.360 INFO:tasks.workunit.client.0.smithi107.stdout:2/501: mkdir d1/d2/d6d/d37/d82/daa 0 2024-09-21T08:02:47.360 INFO:tasks.workunit.client.0.smithi107.stdout:2/502: fsync d1/d2/f7a 0 2024-09-21T08:02:47.361 INFO:tasks.workunit.client.0.smithi107.stdout:2/503: mkdir d1/d6/d9e/dab 0 2024-09-21T08:02:47.363 INFO:tasks.workunit.client.0.smithi107.stdout:6/633: write d2/d3/d7/d48/f5d [2470270,73120] 0 2024-09-21T08:02:47.363 INFO:tasks.workunit.client.0.smithi107.stdout:6/634: creat d2/d3/d7/d54/d5c/fc8 x:0 0 0 2024-09-21T08:02:47.363 INFO:tasks.workunit.client.0.smithi107.stdout:2/504: creat d1/d6/d92/fac x:0 0 0 2024-09-21T08:02:47.368 INFO:tasks.workunit.client.0.smithi107.stdout:2/505: rename d1/d6/d9e/dab to d1/d2/d6d/d9b/dad 0 2024-09-21T08:02:47.372 INFO:tasks.workunit.client.0.smithi107.stdout:2/506: mknod d1/d2/d6d/d42/d76/cae 0 2024-09-21T08:02:47.376 INFO:tasks.workunit.client.0.smithi107.stdout:2/507: symlink d1/d2/d6d/d9b/laf 0 2024-09-21T08:02:47.389 INFO:tasks.workunit.client.0.smithi107.stdout:4/460: dwrite dc/d13/d40/d5e/f61 [0,4194304] 0 2024-09-21T08:02:47.389 INFO:tasks.workunit.client.0.smithi107.stdout:6/635: dwrite d2/d2e/d97/f88 [0,4194304] 0 2024-09-21T08:02:47.390 INFO:tasks.workunit.client.0.smithi107.stdout:4/461: rename dc/d13/d40/d46/d48/d63/d6f to dc/d60/d8c 0 2024-09-21T08:02:47.390 INFO:tasks.workunit.client.0.smithi107.stdout:6/636: dread d2/fe [0,4194304] 0 2024-09-21T08:02:47.401 INFO:tasks.workunit.client.0.smithi107.stdout:4/462: write dc/f50 [3938396,3845] 0 2024-09-21T08:02:47.403 INFO:tasks.workunit.client.0.smithi107.stdout:2/508: rmdir d1/d2 39 2024-09-21T08:02:47.408 INFO:tasks.workunit.client.0.smithi107.stdout:6/637: chown d2/d3/d7/f15 140 1 2024-09-21T08:02:47.408 INFO:tasks.workunit.client.0.smithi107.stdout:6/638: write d2/d3/d7/d48/f72 [4720913,118190] 0 2024-09-21T08:02:47.409 INFO:tasks.workunit.client.0.smithi107.stdout:4/463: mknod dc/d13/d40/d46/c8d 0 2024-09-21T08:02:47.410 INFO:tasks.workunit.client.0.smithi107.stdout:2/509: mkdir d1/d2/d6d/d42/db0 0 2024-09-21T08:02:47.410 INFO:tasks.workunit.client.0.smithi107.stdout:2/510: write d1/d6/f18 [4703395,40973] 0 2024-09-21T08:02:47.410 INFO:tasks.workunit.client.0.smithi107.stdout:2/511: chown d1/d2/d6d/d37/d49/d85/c89 46596735 1 2024-09-21T08:02:47.411 INFO:tasks.workunit.client.0.smithi107.stdout:2/512: truncate d1/d1e/f79 1344975 0 2024-09-21T08:02:47.411 INFO:tasks.workunit.client.0.smithi107.stdout:2/513: fdatasync d1/d2/f7a 0 2024-09-21T08:02:47.422 INFO:tasks.workunit.client.0.smithi107.stdout:6/639: read d2/d3/d7/d23/d2b/d84/fc5 [69607,51244] 0 2024-09-21T08:02:47.424 INFO:tasks.workunit.client.0.smithi107.stdout:6/640: link d2/d3/d7/d48/l66 d2/d3/d7/d23/d2b/lc9 0 2024-09-21T08:02:47.425 INFO:tasks.workunit.client.0.smithi107.stdout:6/641: mknod d2/d3/d7/d24/cca 0 2024-09-21T08:02:47.425 INFO:tasks.workunit.client.0.smithi107.stdout:6/642: creat d2/d3/d7/d2a/fcb x:0 0 0 2024-09-21T08:02:47.427 INFO:tasks.workunit.client.0.smithi107.stdout:6/643: symlink d2/d3/d7/d48/lcc 0 2024-09-21T08:02:47.429 INFO:tasks.workunit.client.0.smithi107.stdout:6/644: creat d2/fcd x:0 0 0 2024-09-21T08:02:47.437 INFO:tasks.workunit.client.0.smithi107.stdout:4/464: dwrite dc/d60/f8b [0,4194304] 0 2024-09-21T08:02:47.445 INFO:tasks.workunit.client.0.smithi107.stdout:4/465: creat dc/d4c/f8e x:0 0 0 2024-09-21T08:02:47.446 INFO:tasks.workunit.client.0.smithi107.stdout:6/645: dwrite d2/d3/d7/d54/d5c/fab [0,4194304] 0 2024-09-21T08:02:47.449 INFO:tasks.workunit.client.0.smithi107.stdout:4/466: write dc/f3a [540595,9120] 0 2024-09-21T08:02:47.450 INFO:tasks.workunit.client.0.smithi107.stdout:4/467: fsync dc/f29 0 2024-09-21T08:02:47.451 INFO:tasks.workunit.client.0.smithi107.stdout:6/646: unlink d2/d3/d7/d54/d5c/f62 0 2024-09-21T08:02:47.454 INFO:tasks.workunit.client.0.smithi107.stdout:4/468: mknod dc/d60/c8f 0 2024-09-21T08:02:47.458 INFO:tasks.workunit.client.0.smithi107.stdout:4/469: rename dc/d13/d40/d46/d48/d63 to dc/d13/d83/d90 0 2024-09-21T08:02:47.459 INFO:tasks.workunit.client.0.smithi107.stdout:4/470: symlink dc/d13/d83/l91 0 2024-09-21T08:02:47.463 INFO:tasks.workunit.client.0.smithi107.stdout:4/471: dread dc/d13/f3e [0,4194304] 0 2024-09-21T08:02:47.467 INFO:tasks.workunit.client.0.smithi107.stdout:4/472: rmdir dc/d13/d83/d90 39 2024-09-21T08:02:47.469 INFO:tasks.workunit.client.0.smithi107.stdout:0/475: sync 2024-09-21T08:02:47.469 INFO:tasks.workunit.client.0.smithi107.stdout:9/620: sync 2024-09-21T08:02:47.469 INFO:tasks.workunit.client.0.smithi107.stdout:1/508: sync 2024-09-21T08:02:47.469 INFO:tasks.workunit.client.0.smithi107.stdout:7/427: sync 2024-09-21T08:02:47.469 INFO:tasks.workunit.client.0.smithi107.stdout:7/428: write d7/d22/d37/d4b/f4c [264945,43261] 0 2024-09-21T08:02:47.469 INFO:tasks.workunit.client.0.smithi107.stdout:7/429: chown d7/d10/l27 74557 1 2024-09-21T08:02:47.473 INFO:tasks.workunit.client.0.smithi107.stdout:0/476: mknod d1/d5/d25/d3d/d20/d29/d55/d91/c98 0 2024-09-21T08:02:47.473 INFO:tasks.workunit.client.0.smithi107.stdout:1/509: symlink d0/d19/d2b/d4b/d44/d55/d64/lab 0 2024-09-21T08:02:47.475 INFO:tasks.workunit.client.0.smithi107.stdout:7/430: mknod d7/d10/d64/c99 0 2024-09-21T08:02:47.475 INFO:tasks.workunit.client.0.smithi107.stdout:7/431: fsync d7/d22/d37/d4b/f5e 0 2024-09-21T08:02:47.477 INFO:tasks.workunit.client.0.smithi107.stdout:1/510: dread d0/d19/d2b/d4b/d44/d72/f78 [0,4194304] 0 2024-09-21T08:02:47.477 INFO:tasks.workunit.client.0.smithi107.stdout:1/511: stat d0/cf 0 2024-09-21T08:02:47.477 INFO:tasks.workunit.client.0.smithi107.stdout:4/473: rmdir dc/d13/d40/d46 39 2024-09-21T08:02:47.477 INFO:tasks.workunit.client.0.smithi107.stdout:9/621: read d11/f21 [1008316,39401] 0 2024-09-21T08:02:47.477 INFO:tasks.workunit.client.0.smithi107.stdout:9/622: creat d11/d27/d2f/d38/dbf/fdf x:0 0 0 2024-09-21T08:02:47.480 INFO:tasks.workunit.client.0.smithi107.stdout:7/432: truncate d7/d38/f41 1717298 0 2024-09-21T08:02:47.481 INFO:tasks.workunit.client.0.smithi107.stdout:4/474: truncate dc/d13/f35 2340829 0 2024-09-21T08:02:47.485 INFO:tasks.workunit.client.0.smithi107.stdout:9/623: creat d11/d27/d5e/d76/fe0 x:0 0 0 2024-09-21T08:02:47.485 INFO:tasks.workunit.client.0.smithi107.stdout:9/624: readlink d11/d27/d2f/d4d/d5c/d61/db4/dbb/ld3 0 2024-09-21T08:02:47.487 INFO:tasks.workunit.client.0.smithi107.stdout:1/512: dread d0/d19/d2b/d4b/d1c/f26 [0,4194304] 0 2024-09-21T08:02:47.487 INFO:tasks.workunit.client.0.smithi107.stdout:1/513: fdatasync d0/d19/d2b/d4b/d1c/f41 0 2024-09-21T08:02:47.487 INFO:tasks.workunit.client.0.smithi107.stdout:7/433: mknod d7/d10/d28/d69/c9a 0 2024-09-21T08:02:47.487 INFO:tasks.workunit.client.0.smithi107.stdout:7/434: creat d7/d10/d28/f9b x:0 0 0 2024-09-21T08:02:47.489 INFO:tasks.workunit.client.0.smithi107.stdout:4/475: link dc/d13/f2a dc/d13/d40/d5e/f92 0 2024-09-21T08:02:47.491 INFO:tasks.workunit.client.0.smithi107.stdout:9/625: symlink d11/d27/d5e/le1 0 2024-09-21T08:02:47.492 INFO:tasks.workunit.client.0.smithi107.stdout:0/477: dwrite d1/f8 [4194304,4194304] 0 2024-09-21T08:02:47.492 INFO:tasks.workunit.client.0.smithi107.stdout:0/478: truncate d1/d5/d25/d3d/d20/d29/d55/d7a/f82 908289 0 2024-09-21T08:02:47.492 INFO:tasks.workunit.client.0.smithi107.stdout:1/514: symlink d0/d19/d2b/d4b/d1c/da9/lac 0 2024-09-21T08:02:47.496 INFO:tasks.workunit.client.0.smithi107.stdout:9/626: creat d11/fe2 x:0 0 0 2024-09-21T08:02:47.496 INFO:tasks.workunit.client.0.smithi107.stdout:9/627: truncate d11/d27/d2f/f7d 4434533 0 2024-09-21T08:02:47.499 INFO:tasks.workunit.client.0.smithi107.stdout:0/479: creat d1/d5/d25/f99 x:0 0 0 2024-09-21T08:02:47.500 INFO:tasks.workunit.client.0.smithi107.stdout:1/515: getdents d0/d29/d2c 0 2024-09-21T08:02:47.500 INFO:tasks.workunit.client.0.smithi107.stdout:1/516: chown d0/d19/ca6 83548 1 2024-09-21T08:02:47.503 INFO:tasks.workunit.client.0.smithi107.stdout:0/480: mkdir d1/d5/d25/d3d/d20/d29/d55/d91/d9a 0 2024-09-21T08:02:47.504 INFO:tasks.workunit.client.0.smithi107.stdout:0/481: fdatasync d1/d5/f67 0 2024-09-21T08:02:47.505 INFO:tasks.workunit.client.0.smithi107.stdout:1/517: symlink d0/d19/d2b/d4b/d44/d55/d64/lad 0 2024-09-21T08:02:47.507 INFO:tasks.workunit.client.0.smithi107.stdout:4/476: dwrite dc/d13/d40/d46/f55 [0,4194304] 0 2024-09-21T08:02:47.509 INFO:tasks.workunit.client.0.smithi107.stdout:1/518: mknod d0/d19/d2b/d86/da4/cae 0 2024-09-21T08:02:47.514 INFO:tasks.workunit.client.0.smithi107.stdout:1/519: mkdir d0/d19/d2b/d4b/d44/d72/d36/daf 0 2024-09-21T08:02:47.517 INFO:tasks.workunit.client.0.smithi107.stdout:1/520: dread d0/d19/d2b/d4b/d1c/f3d [0,4194304] 0 2024-09-21T08:02:47.518 INFO:tasks.workunit.client.0.smithi107.stdout:0/482: rmdir d1/d5/d25/d3d/d20/d29/d5c/d90 0 2024-09-21T08:02:47.518 INFO:tasks.workunit.client.0.smithi107.stdout:0/483: chown d1/d5/d25/d3d/d20/d29/l84 61 1 2024-09-21T08:02:47.518 INFO:tasks.workunit.client.0.smithi107.stdout:0/484: chown d1/d5/d25/d3d/d20/d29/d55/c5b 567994799 1 2024-09-21T08:02:47.518 INFO:tasks.workunit.client.0.smithi107.stdout:9/628: dwrite d11/d27/d2f/fce [0,4194304] 0 2024-09-21T08:02:47.520 INFO:tasks.workunit.client.0.smithi107.stdout:1/521: creat d0/d19/d2b/d4b/d44/d72/d36/d8e/fb0 x:0 0 0 2024-09-21T08:02:47.526 INFO:tasks.workunit.client.0.smithi107.stdout:9/629: mkdir d11/d24/d26/dbe/de3 0 2024-09-21T08:02:47.528 INFO:tasks.workunit.client.0.smithi107.stdout:9/630: mknod d11/d24/d26/dbe/ce4 0 2024-09-21T08:02:47.535 INFO:tasks.workunit.client.0.smithi107.stdout:1/522: read d0/d29/d4d/f60 [3589318,109659] 0 2024-09-21T08:02:47.537 INFO:tasks.workunit.client.0.smithi107.stdout:0/485: dwrite d1/d5/d25/d2d/f96 [0,4194304] 0 2024-09-21T08:02:47.537 INFO:tasks.workunit.client.0.smithi107.stdout:1/523: rename d0/d19/d2b/d86/d95/c9b to d0/d19/d2b/d4b/d44/d55/cb1 0 2024-09-21T08:02:47.540 INFO:tasks.workunit.client.0.smithi107.stdout:4/477: dwrite f7 [0,4194304] 0 2024-09-21T08:02:47.543 INFO:tasks.workunit.client.0.smithi107.stdout:0/486: creat d1/d5/d25/d3d/d20/d85/d8a/f9b x:0 0 0 2024-09-21T08:02:47.544 INFO:tasks.workunit.client.0.smithi107.stdout:1/524: creat d0/d29/d2c/fb2 x:0 0 0 2024-09-21T08:02:47.544 INFO:tasks.workunit.client.0.smithi107.stdout:1/525: fsync d0/d29/d31/f77 0 2024-09-21T08:02:47.544 INFO:tasks.workunit.client.0.smithi107.stdout:1/526: write d0/d19/fa2 [309868,124342] 0 2024-09-21T08:02:47.544 INFO:tasks.workunit.client.0.smithi107.stdout:1/527: stat d0/d19/d39/l62 0 2024-09-21T08:02:47.545 INFO:tasks.workunit.client.0.smithi107.stdout:9/631: dwrite d11/d27/d2f/f3b [0,4194304] 0 2024-09-21T08:02:47.548 INFO:tasks.workunit.client.0.smithi107.stdout:4/478: unlink dc/d13/d40/d5e/f61 0 2024-09-21T08:02:47.550 INFO:tasks.workunit.client.0.smithi107.stdout:1/528: symlink d0/d19/d2b/d4b/lb3 0 2024-09-21T08:02:47.554 INFO:tasks.workunit.client.0.smithi107.stdout:1/529: dread d0/d19/d2b/d4b/d44/d72/d36/f47 [0,4194304] 0 2024-09-21T08:02:47.555 INFO:tasks.workunit.client.0.smithi107.stdout:9/632: mknod d11/d27/d2f/d4d/d5c/d61/ce5 0 2024-09-21T08:02:47.557 INFO:tasks.workunit.client.0.smithi107.stdout:0/487: dwrite d1/d5/f7e [0,4194304] 0 2024-09-21T08:02:47.557 INFO:tasks.workunit.client.0.smithi107.stdout:0/488: creat d1/d23/f9c x:0 0 0 2024-09-21T08:02:47.557 INFO:tasks.workunit.client.0.smithi107.stdout:0/489: chown d1/d5/f67 71200116 1 2024-09-21T08:02:47.557 INFO:tasks.workunit.client.0.smithi107.stdout:0/490: write d1/d6f/f89 [678890,100760] 0 2024-09-21T08:02:47.558 INFO:tasks.workunit.client.0.smithi107.stdout:4/479: creat dc/d13/d40/d80/f93 x:0 0 0 2024-09-21T08:02:47.560 INFO:tasks.workunit.client.0.smithi107.stdout:1/530: rename d0/d19/d2b/d4b/d44/d55/c74 to d0/d19/d2b/d86/d95/cb4 0 2024-09-21T08:02:47.562 INFO:tasks.workunit.client.0.smithi107.stdout:1/531: read d0/d19/d2b/d4b/d44/d72/f78 [49681,8443] 0 2024-09-21T08:02:47.563 INFO:tasks.workunit.client.0.smithi107.stdout:9/633: unlink d11/d24/d26/c7a 0 2024-09-21T08:02:47.567 INFO:tasks.workunit.client.0.smithi107.stdout:0/491: symlink d1/d5/d25/d3d/d20/d85/l9d 0 2024-09-21T08:02:47.567 INFO:tasks.workunit.client.0.smithi107.stdout:0/492: dread - d1/d5/d25/d3d/f92 zero size 2024-09-21T08:02:47.568 INFO:tasks.workunit.client.0.smithi107.stdout:4/480: unlink dc/d13/f35 0 2024-09-21T08:02:47.581 INFO:tasks.workunit.client.0.smithi107.stdout:1/532: mkdir d0/d19/d59/db5 0 2024-09-21T08:02:47.581 INFO:tasks.workunit.client.0.smithi107.stdout:1/533: chown d0/c16 4 1 2024-09-21T08:02:47.584 INFO:tasks.workunit.client.0.smithi107.stdout:9/634: creat d11/d27/d2f/d4d/d5c/d61/dca/fe6 x:0 0 0 2024-09-21T08:02:47.585 INFO:tasks.workunit.client.0.smithi107.stdout:0/493: truncate d1/d5/d25/f40 1038977 0 2024-09-21T08:02:47.585 INFO:tasks.workunit.client.0.smithi107.stdout:0/494: fsync d1/d5/f78 0 2024-09-21T08:02:47.588 INFO:tasks.workunit.client.0.smithi107.stdout:4/481: creat dc/d13/d40/d46/d48/d70/f94 x:0 0 0 2024-09-21T08:02:47.588 INFO:tasks.workunit.client.0.smithi107.stdout:4/482: stat dc/d13/d83 0 2024-09-21T08:02:47.589 INFO:tasks.workunit.client.0.smithi107.stdout:1/534: getdents d0/d19/d2b/d4b/d1c 0 2024-09-21T08:02:47.589 INFO:tasks.workunit.client.0.smithi107.stdout:1/535: fsync d0/d19/d2b/f57 0 2024-09-21T08:02:47.591 INFO:tasks.workunit.client.0.smithi107.stdout:4/483: unlink dc/d13/f38 0 2024-09-21T08:02:47.592 INFO:tasks.workunit.client.0.smithi107.stdout:1/536: mkdir d0/d19/d2b/d4b/d44/d9a/db6 0 2024-09-21T08:02:47.598 INFO:tasks.workunit.client.0.smithi107.stdout:0/495: write d1/d5/f78 [1273248,95972] 0 2024-09-21T08:02:47.598 INFO:tasks.workunit.client.0.smithi107.stdout:1/537: rename d0/d19/d59/c7c to d0/d19/d2b/cb7 0 2024-09-21T08:02:47.598 INFO:tasks.workunit.client.0.smithi107.stdout:1/538: fsync d0/d19/f93 0 2024-09-21T08:02:47.600 INFO:tasks.workunit.client.0.smithi107.stdout:0/496: mkdir d1/d5/d25/d9e 0 2024-09-21T08:02:47.600 INFO:tasks.workunit.client.0.smithi107.stdout:0/497: creat d1/d5/d25/f9f x:0 0 0 2024-09-21T08:02:47.600 INFO:tasks.workunit.client.0.smithi107.stdout:0/498: chown d1/d23/l30 2 1 2024-09-21T08:02:47.602 INFO:tasks.workunit.client.0.smithi107.stdout:1/539: link d0/d19/f3b d0/d19/d39/fb8 0 2024-09-21T08:02:47.604 INFO:tasks.workunit.client.0.smithi107.stdout:0/499: mkdir d1/d5/d25/d3d/d20/da0 0 2024-09-21T08:02:47.604 INFO:tasks.workunit.client.0.smithi107.stdout:0/500: write d1/d5/d25/d3d/d20/d29/d55/f93 [15563,35195] 0 2024-09-21T08:02:47.606 INFO:tasks.workunit.client.0.smithi107.stdout:9/635: dwrite d11/d24/d26/f2e [0,4194304] 0 2024-09-21T08:02:47.606 INFO:tasks.workunit.client.0.smithi107.stdout:9/636: truncate d11/d27/d5e/d76/fe0 468236 0 2024-09-21T08:02:47.606 INFO:tasks.workunit.client.0.smithi107.stdout:1/540: rename d0/d19/d2b/d4b/d44/d72/d36/f47 to d0/d19/d2b/d4b/d44/d72/fb9 0 2024-09-21T08:02:47.607 INFO:tasks.workunit.client.0.smithi107.stdout:0/501: mkdir d1/d5/d25/d3d/da1 0 2024-09-21T08:02:47.609 INFO:tasks.workunit.client.0.smithi107.stdout:9/637: mkdir d11/d27/d2f/d38/dcc/de7 0 2024-09-21T08:02:47.611 INFO:tasks.workunit.client.0.smithi107.stdout:0/502: link d1/d23/l30 d1/d6f/d80/la2 0 2024-09-21T08:02:47.611 INFO:tasks.workunit.client.0.smithi107.stdout:0/503: chown d1/d5/d25/d3d/d20/f51 2 1 2024-09-21T08:02:47.611 INFO:tasks.workunit.client.0.smithi107.stdout:0/504: chown d1/d5/d25/d3d/d20/d29/d55/d7a/f83 34 1 2024-09-21T08:02:47.611 INFO:tasks.workunit.client.0.smithi107.stdout:9/638: dread d11/d27/d5e/d76/f8c [0,4194304] 0 2024-09-21T08:02:47.613 INFO:tasks.workunit.client.0.smithi107.stdout:4/484: dwrite dc/d13/f5d [0,4194304] 0 2024-09-21T08:02:47.613 INFO:tasks.workunit.client.0.smithi107.stdout:9/639: creat d11/d27/fe8 x:0 0 0 2024-09-21T08:02:47.615 INFO:tasks.workunit.client.0.smithi107.stdout:4/485: mknod dc/d60/c95 0 2024-09-21T08:02:47.617 INFO:tasks.workunit.client.0.smithi107.stdout:9/640: link d11/d27/d2f/d4d/d92/dc5/fc8 d11/d27/d2f/d38/dbf/dda/fe9 0 2024-09-21T08:02:47.618 INFO:tasks.workunit.client.0.smithi107.stdout:4/486: creat dc/d13/d83/d90/f96 x:0 0 0 2024-09-21T08:02:47.619 INFO:tasks.workunit.client.0.smithi107.stdout:9/641: mknod d11/d27/d2f/d38/dbf/dda/cea 0 2024-09-21T08:02:47.620 INFO:tasks.workunit.client.0.smithi107.stdout:4/487: truncate dc/f3f 168258 0 2024-09-21T08:02:47.621 INFO:tasks.workunit.client.0.smithi107.stdout:4/488: truncate fb 1147574 0 2024-09-21T08:02:47.621 INFO:tasks.workunit.client.0.smithi107.stdout:4/489: write dc/d13/f57 [4205927,23775] 0 2024-09-21T08:02:47.622 INFO:tasks.workunit.client.0.smithi107.stdout:9/642: rename d11/d27/d2f/lb1 to d11/d27/d2f/d4d/d5c/d61/db4/dbb/leb 0 2024-09-21T08:02:47.624 INFO:tasks.workunit.client.0.smithi107.stdout:4/490: mkdir dc/d13/d83/d97 0 2024-09-21T08:02:47.625 INFO:tasks.workunit.client.0.smithi107.stdout:4/491: chown dc/d64/f79 870625 1 2024-09-21T08:02:47.625 INFO:tasks.workunit.client.0.smithi107.stdout:1/541: dwrite d0/d19/d2b/d4b/d1c/d5e/f69 [0,4194304] 0 2024-09-21T08:02:47.625 INFO:tasks.workunit.client.0.smithi107.stdout:1/542: chown d0/d19/l6e 3304 1 2024-09-21T08:02:47.625 INFO:tasks.workunit.client.0.smithi107.stdout:0/505: read d1/d5/d25/d3d/d20/f63 [3385327,55180] 0 2024-09-21T08:02:47.625 INFO:tasks.workunit.client.0.smithi107.stdout:9/643: rename d11/d27/d2f/d4d/d5c/d61/d8f to d11/d24/d26/dd0/dec 0 2024-09-21T08:02:47.626 INFO:tasks.workunit.client.0.smithi107.stdout:9/644: mkdir d11/d24/d6e/db9/ded 0 2024-09-21T08:02:47.627 INFO:tasks.workunit.client.0.smithi107.stdout:9/645: dread - d11/d27/d2f/fa3 zero size 2024-09-21T08:02:47.631 INFO:tasks.workunit.client.0.smithi107.stdout:9/646: getdents d11/d27/d2a/d7f 0 2024-09-21T08:02:47.631 INFO:tasks.workunit.client.0.smithi107.stdout:9/647: getdents d11/d24/d26/dbe/de3 0 2024-09-21T08:02:47.633 INFO:tasks.workunit.client.0.smithi107.stdout:9/648: mknod d11/d24/d26/cee 0 2024-09-21T08:02:47.638 INFO:tasks.workunit.client.0.smithi107.stdout:4/492: write dc/d13/d40/f45 [3792029,99888] 0 2024-09-21T08:02:47.638 INFO:tasks.workunit.client.0.smithi107.stdout:5/654: sync 2024-09-21T08:02:47.642 INFO:tasks.workunit.client.0.smithi107.stdout:4/493: truncate dc/d13/d40/d5e/f92 3720391 0 2024-09-21T08:02:47.642 INFO:tasks.workunit.client.0.smithi107.stdout:4/494: getdents dc/d13/d40/d5e/d6e 0 2024-09-21T08:02:47.642 INFO:tasks.workunit.client.0.smithi107.stdout:1/543: write d0/d19/d2b/d4b/d1c/d5e/f69 [115129,126346] 0 2024-09-21T08:02:47.642 INFO:tasks.workunit.client.0.smithi107.stdout:1/544: chown d0/d29/d4d/d84/d8c 432 1 2024-09-21T08:02:47.643 INFO:tasks.workunit.client.0.smithi107.stdout:5/655: mknod d7/de/d1d/d29/d64/d87/ce5 0 2024-09-21T08:02:47.643 INFO:tasks.workunit.client.0.smithi107.stdout:5/656: creat d7/d70/fe6 x:0 0 0 2024-09-21T08:02:47.648 INFO:tasks.workunit.client.0.smithi107.stdout:9/649: read d11/d27/d2f/d4d/d5c/d61/f64 [4077199,78640] 0 2024-09-21T08:02:47.649 INFO:tasks.workunit.client.0.smithi107.stdout:9/650: chown d11/d24/d26/dd0/dec/f81 217538667 1 2024-09-21T08:02:47.650 INFO:tasks.workunit.client.0.smithi107.stdout:0/506: write d1/d23/f2a [1214695,49971] 0 2024-09-21T08:02:47.650 INFO:tasks.workunit.client.0.smithi107.stdout:1/545: unlink d0/d19/c3a 0 2024-09-21T08:02:47.656 INFO:tasks.workunit.client.0.smithi107.stdout:5/657: rmdir d7/de/d1d/d29/d68/ddb/dde/dcc 39 2024-09-21T08:02:47.656 INFO:tasks.workunit.client.0.smithi107.stdout:4/495: dwrite dc/d13/d40/d80/f93 [0,4194304] 0 2024-09-21T08:02:47.674 INFO:tasks.workunit.client.0.smithi107.stdout:0/507: symlink d1/d5/d25/d3d/d20/d29/d55/d91/d9a/la3 0 2024-09-21T08:02:47.674 INFO:tasks.workunit.client.0.smithi107.stdout:0/508: stat d1/d5/d25/d3d/d20/f6c 0 2024-09-21T08:02:47.674 INFO:tasks.workunit.client.0.smithi107.stdout:9/651: mkdir d11/d27/d2f/def 0 2024-09-21T08:02:47.674 INFO:tasks.workunit.client.0.smithi107.stdout:9/652: dread - d11/d27/d2f/d38/fa6 zero size 2024-09-21T08:02:47.677 INFO:tasks.workunit.client.0.smithi107.stdout:1/546: dwrite d0/d19/d2b/d4b/d44/d72/d36/f73 [0,4194304] 0 2024-09-21T08:02:47.678 INFO:tasks.workunit.client.0.smithi107.stdout:1/547: chown d0/d19/d2b/d4b/lb3 2018 1 2024-09-21T08:02:47.678 INFO:tasks.workunit.client.0.smithi107.stdout:1/548: chown d0 0 1 2024-09-21T08:02:47.678 INFO:tasks.workunit.client.0.smithi107.stdout:5/658: dwrite d7/de/d52/d6b/f92 [0,4194304] 0 2024-09-21T08:02:47.678 INFO:tasks.workunit.client.0.smithi107.stdout:4/496: mkdir dc/d13/d40/d5e/d98 0 2024-09-21T08:02:47.679 INFO:tasks.workunit.client.0.smithi107.stdout:0/509: creat d1/d5/d25/d9e/fa4 x:0 0 0 2024-09-21T08:02:47.679 INFO:tasks.workunit.client.0.smithi107.stdout:0/510: read - d1/d6f/d80/f88 zero size 2024-09-21T08:02:47.679 INFO:tasks.workunit.client.0.smithi107.stdout:0/511: chown d1/d5/d25/d3d/d20/d29/d5c 154356398 1 2024-09-21T08:02:47.683 INFO:tasks.workunit.client.0.smithi107.stdout:9/653: truncate d11/d24/d35/f6f 2359184 0 2024-09-21T08:02:47.689 INFO:tasks.workunit.client.0.smithi107.stdout:4/497: mkdir dc/d13/d40/d5e/d77/d99 0 2024-09-21T08:02:47.690 INFO:tasks.workunit.client.0.smithi107.stdout:0/512: symlink d1/d5/d25/d9e/la5 0 2024-09-21T08:02:47.692 INFO:tasks.workunit.client.0.smithi107.stdout:9/654: mkdir d11/d24/d26/df0 0 2024-09-21T08:02:47.693 INFO:tasks.workunit.client.0.smithi107.stdout:9/655: stat d11/d24/d35/l88 0 2024-09-21T08:02:47.693 INFO:tasks.workunit.client.0.smithi107.stdout:9/656: stat d11/f3e 0 2024-09-21T08:02:47.694 INFO:tasks.workunit.client.0.smithi107.stdout:4/498: rename c3 to dc/d13/c9a 0 2024-09-21T08:02:47.698 INFO:tasks.workunit.client.0.smithi107.stdout:0/513: rename d1/f8 to d1/d5/d25/fa6 0 2024-09-21T08:02:47.699 INFO:tasks.workunit.client.0.smithi107.stdout:9/657: getdents d11/d24/d6e 0 2024-09-21T08:02:47.709 INFO:tasks.workunit.client.0.smithi107.stdout:1/549: dwrite d0/d19/d2b/d4b/d44/d72/f1d [8388608,4194304] 0 2024-09-21T08:02:47.710 INFO:tasks.workunit.client.0.smithi107.stdout:1/550: truncate d0/d19/d59/f91 506991 0 2024-09-21T08:02:47.710 INFO:tasks.workunit.client.0.smithi107.stdout:1/551: chown d0/d19/d2b/d86/l81 1961894 1 2024-09-21T08:02:47.713 INFO:tasks.workunit.client.0.smithi107.stdout:1/552: unlink d0/d19/d2b/d4b/d61/d75/fa5 0 2024-09-21T08:02:47.714 INFO:tasks.workunit.client.0.smithi107.stdout:1/553: link d0/d29/d4d/l53 d0/d19/d2b/d4b/d44/d9a/db6/lba 0 2024-09-21T08:02:47.731 INFO:tasks.workunit.client.0.smithi107.stdout:4/499: dwrite dc/d13/d40/d46/d48/d70/f94 [0,4194304] 0 2024-09-21T08:02:47.732 INFO:tasks.workunit.client.0.smithi107.stdout:5/659: dwrite d7/de/d1d/d29/d68/ddb/dde/fdd [0,4194304] 0 2024-09-21T08:02:47.732 INFO:tasks.workunit.client.0.smithi107.stdout:5/660: creat d7/de/d2d/d5d/d60/dc5/fe7 x:0 0 0 2024-09-21T08:02:47.733 INFO:tasks.workunit.client.0.smithi107.stdout:9/658: dwrite d11/d24/d6e/f94 [0,4194304] 0 2024-09-21T08:02:47.737 INFO:tasks.workunit.client.0.smithi107.stdout:5/661: creat d7/de/da3/fe8 x:0 0 0 2024-09-21T08:02:47.738 INFO:tasks.workunit.client.0.smithi107.stdout:5/662: truncate d7/de/d1d/d24/d3d/fd2 854954 0 2024-09-21T08:02:47.738 INFO:tasks.workunit.client.0.smithi107.stdout:5/663: chown d7/de/d1d/d24/f8c 20238058 1 2024-09-21T08:02:47.740 INFO:tasks.workunit.client.0.smithi107.stdout:0/514: link d1/d5/d25/fa6 d1/d5/d25/d3d/d20/da0/fa7 0 2024-09-21T08:02:47.740 INFO:tasks.workunit.client.0.smithi107.stdout:0/515: write d1/d5/d25/d3d/d20/d85/d8a/f9b [1030278,84764] 0 2024-09-21T08:02:47.743 INFO:tasks.workunit.client.0.smithi107.stdout:4/500: dread dc/d13/d40/d5e/f92 [0,4194304] 0 2024-09-21T08:02:47.744 INFO:tasks.workunit.client.0.smithi107.stdout:5/664: mkdir d7/de/d1d/d29/d68/de9 0 2024-09-21T08:02:47.745 INFO:tasks.workunit.client.0.smithi107.stdout:0/516: mkdir d1/d5/d25/d3d/d20/d85/da8 0 2024-09-21T08:02:47.746 INFO:tasks.workunit.client.0.smithi107.stdout:4/501: mkdir dc/d13/d5a/d9b 0 2024-09-21T08:02:47.747 INFO:tasks.workunit.client.0.smithi107.stdout:9/659: dwrite d11/d27/d98/f7c [0,4194304] 0 2024-09-21T08:02:47.751 INFO:tasks.workunit.client.0.smithi107.stdout:5/665: getdents d7/de/d1d/d24/d3d 0 2024-09-21T08:02:47.751 INFO:tasks.workunit.client.0.smithi107.stdout:4/502: dread dc/d13/f58 [0,4194304] 0 2024-09-21T08:02:47.752 INFO:tasks.workunit.client.0.smithi107.stdout:4/503: chown dc/c19 30201 1 2024-09-21T08:02:47.754 INFO:tasks.workunit.client.0.smithi107.stdout:9/660: mkdir d11/d27/d5e/df1 0 2024-09-21T08:02:47.756 INFO:tasks.workunit.client.0.smithi107.stdout:5/666: mknod d7/de/d1d/d29/d68/ddb/dde/dd8/dd9/cea 0 2024-09-21T08:02:47.757 INFO:tasks.workunit.client.0.smithi107.stdout:4/504: link dc/d13/c9a dc/d4c/c9c 0 2024-09-21T08:02:47.759 INFO:tasks.workunit.client.0.smithi107.stdout:9/661: creat d11/d27/d2f/d4d/d5c/d61/db4/dbb/ff2 x:0 0 0 2024-09-21T08:02:47.765 INFO:tasks.workunit.client.0.smithi107.stdout:5/667: dread d7/de/d1d/f5b [0,4194304] 0 2024-09-21T08:02:47.765 INFO:tasks.workunit.client.0.smithi107.stdout:5/668: creat d7/d70/feb x:0 0 0 2024-09-21T08:02:47.767 INFO:tasks.workunit.client.0.smithi107.stdout:4/505: write dc/d13/d40/d80/f93 [3103976,57588] 0 2024-09-21T08:02:47.768 INFO:tasks.workunit.client.0.smithi107.stdout:5/669: dread d7/de/d1d/d24/f6e [0,4194304] 0 2024-09-21T08:02:47.768 INFO:tasks.workunit.client.0.smithi107.stdout:5/670: readlink d7/de/d52/d6b/l7a 0 2024-09-21T08:02:47.768 INFO:tasks.workunit.client.0.smithi107.stdout:0/517: dwrite d1/d5/d25/d9e/fa4 [0,4194304] 0 2024-09-21T08:02:47.774 INFO:tasks.workunit.client.0.smithi107.stdout:0/518: symlink d1/d5/d25/d3d/d20/d85/d8a/la9 0 2024-09-21T08:02:47.776 INFO:tasks.workunit.client.0.smithi107.stdout:0/519: mknod d1/d5/d75/caa 0 2024-09-21T08:02:47.778 INFO:tasks.workunit.client.0.smithi107.stdout:5/671: write d7/de/d2d/d5d/f9e [2813906,67225] 0 2024-09-21T08:02:47.778 INFO:tasks.workunit.client.0.smithi107.stdout:0/520: mkdir d1/d5/d25/d3d/d20/d85/dab 0 2024-09-21T08:02:47.779 INFO:tasks.workunit.client.0.smithi107.stdout:5/672: getdents d7/de/d2d/d5d 0 2024-09-21T08:02:47.779 INFO:tasks.workunit.client.0.smithi107.stdout:5/673: stat d7/de/d52 0 2024-09-21T08:02:47.779 INFO:tasks.workunit.client.0.smithi107.stdout:5/674: chown d7/de/d1d/c5e 517146713 1 2024-09-21T08:02:47.779 INFO:tasks.workunit.client.0.smithi107.stdout:5/675: creat d7/fec x:0 0 0 2024-09-21T08:02:47.779 INFO:tasks.workunit.client.0.smithi107.stdout:0/521: creat d1/d5/d25/d3d/d20/d29/d55/fac x:0 0 0 2024-09-21T08:02:47.780 INFO:tasks.workunit.client.0.smithi107.stdout:0/522: symlink d1/d5/d25/d3d/lad 0 2024-09-21T08:02:47.781 INFO:tasks.workunit.client.0.smithi107.stdout:0/523: dread - d1/d23/f8b zero size 2024-09-21T08:02:47.781 INFO:tasks.workunit.client.0.smithi107.stdout:9/662: dwrite d11/d27/d2f/d38/fa6 [0,4194304] 0 2024-09-21T08:02:47.781 INFO:tasks.workunit.client.0.smithi107.stdout:9/663: creat d11/d27/d5e/ff3 x:0 0 0 2024-09-21T08:02:47.782 INFO:tasks.workunit.client.0.smithi107.stdout:0/524: rename d1/d5/d75/caa to d1/d5/d25/d3d/d20/d85/cae 0 2024-09-21T08:02:47.784 INFO:tasks.workunit.client.0.smithi107.stdout:4/506: dwrite dc/d4c/f8e [0,4194304] 0 2024-09-21T08:02:47.784 INFO:tasks.workunit.client.0.smithi107.stdout:4/507: write fb [1923649,5390] 0 2024-09-21T08:02:47.784 INFO:tasks.workunit.client.0.smithi107.stdout:4/508: write dc/d13/d40/d46/f6c [229094,34044] 0 2024-09-21T08:02:47.784 INFO:tasks.workunit.client.0.smithi107.stdout:4/509: chown dc/c59 3905460 1 2024-09-21T08:02:47.787 INFO:tasks.workunit.client.0.smithi107.stdout:9/664: creat d11/d27/d2f/def/ff4 x:0 0 0 2024-09-21T08:02:47.788 INFO:tasks.workunit.client.0.smithi107.stdout:0/525: symlink d1/d5/d75/laf 0 2024-09-21T08:02:47.788 INFO:tasks.workunit.client.0.smithi107.stdout:0/526: readlink d1/d5/d25/d3d/d20/l32 0 2024-09-21T08:02:47.791 INFO:tasks.workunit.client.0.smithi107.stdout:0/527: creat d1/d5/d25/d2d/d8e/fb0 x:0 0 0 2024-09-21T08:02:47.791 INFO:tasks.workunit.client.0.smithi107.stdout:0/528: write d1/d5/d25/d3d/d20/d29/d55/d7a/f8c [498125,2343] 0 2024-09-21T08:02:47.792 INFO:tasks.workunit.client.0.smithi107.stdout:0/529: mknod d1/d6f/d80/cb1 0 2024-09-21T08:02:47.793 INFO:tasks.workunit.client.0.smithi107.stdout:4/510: dread dc/d13/d40/d46/f82 [0,4194304] 0 2024-09-21T08:02:47.795 INFO:tasks.workunit.client.0.smithi107.stdout:4/511: creat dc/d13/d40/d46/d48/f9d x:0 0 0 2024-09-21T08:02:47.796 INFO:tasks.workunit.client.0.smithi107.stdout:5/676: dwrite d7/fd5 [0,4194304] 0 2024-09-21T08:02:47.796 INFO:tasks.workunit.client.0.smithi107.stdout:5/677: readlink d7/de/d1d/d29/d68/ddb/dde/l77 0 2024-09-21T08:02:47.800 INFO:tasks.workunit.client.0.smithi107.stdout:9/665: read d11/f20 [2798644,52783] 0 2024-09-21T08:02:47.800 INFO:tasks.workunit.client.0.smithi107.stdout:4/512: getdents dc/d4c 0 2024-09-21T08:02:47.807 INFO:tasks.workunit.client.0.smithi107.stdout:5/678: link d7/de/fc8 d7/de/da3/fed 0 2024-09-21T08:02:47.809 INFO:tasks.workunit.client.0.smithi107.stdout:4/513: getdents dc/d64 0 2024-09-21T08:02:47.810 INFO:tasks.workunit.client.0.smithi107.stdout:5/679: rename d7/de/d35/lce to d7/lee 0 2024-09-21T08:02:47.811 INFO:tasks.workunit.client.0.smithi107.stdout:4/514: write dc/d13/d40/f4a [1362589,76315] 0 2024-09-21T08:02:47.811 INFO:tasks.workunit.client.0.smithi107.stdout:4/515: chown dc/d13/d40/d80 608836 1 2024-09-21T08:02:47.812 INFO:tasks.workunit.client.0.smithi107.stdout:5/680: mknod d7/de/d1d/d29/d68/ddb/cef 0 2024-09-21T08:02:47.813 INFO:tasks.workunit.client.0.smithi107.stdout:5/681: creat d7/de/da3/ff0 x:0 0 0 2024-09-21T08:02:47.814 INFO:tasks.workunit.client.0.smithi107.stdout:4/516: dread dc/d13/f2a [0,4194304] 0 2024-09-21T08:02:47.815 INFO:tasks.workunit.client.0.smithi107.stdout:4/517: rmdir dc/d13/d83 39 2024-09-21T08:02:47.816 INFO:tasks.workunit.client.0.smithi107.stdout:4/518: chown dc/d4c/l4e 1666308 1 2024-09-21T08:02:47.817 INFO:tasks.workunit.client.0.smithi107.stdout:4/519: symlink dc/d13/d40/d5e/d6e/l9e 0 2024-09-21T08:02:47.819 INFO:tasks.workunit.client.0.smithi107.stdout:4/520: rename dc/d13/d40/d5e/c87 to dc/d13/d40/d5e/d77/c9f 0 2024-09-21T08:02:47.824 INFO:tasks.workunit.client.0.smithi107.stdout:4/521: write dc/d13/d83/d90/f73 [2028579,47379] 0 2024-09-21T08:02:47.824 INFO:tasks.workunit.client.0.smithi107.stdout:9/666: dwrite d11/d27/d2f/d4d/d5c/d61/dca/fe6 [0,4194304] 0 2024-09-21T08:02:47.824 INFO:tasks.workunit.client.0.smithi107.stdout:4/522: write dc/d60/f8b [5082204,76001] 0 2024-09-21T08:02:47.825 INFO:tasks.workunit.client.0.smithi107.stdout:4/523: write dc/f31 [509382,46508] 0 2024-09-21T08:02:47.825 INFO:tasks.workunit.client.0.smithi107.stdout:4/524: creat dc/d13/d40/d5e/d77/fa0 x:0 0 0 2024-09-21T08:02:47.827 INFO:tasks.workunit.client.0.smithi107.stdout:4/525: dread dc/f2c [0,4194304] 0 2024-09-21T08:02:47.828 INFO:tasks.workunit.client.0.smithi107.stdout:9/667: mknod d11/d24/d26/cf5 0 2024-09-21T08:02:47.828 INFO:tasks.workunit.client.0.smithi107.stdout:9/668: readlink l6 0 2024-09-21T08:02:47.829 INFO:tasks.workunit.client.0.smithi107.stdout:4/526: read dc/d13/f58 [515221,1054] 0 2024-09-21T08:02:47.830 INFO:tasks.workunit.client.0.smithi107.stdout:5/682: dread d7/de/d1d/d29/d68/ddb/dde/fdd [0,4194304] 0 2024-09-21T08:02:47.830 INFO:tasks.workunit.client.0.smithi107.stdout:9/669: symlink d11/d24/d6e/db9/lf6 0 2024-09-21T08:02:47.831 INFO:tasks.workunit.client.0.smithi107.stdout:4/527: creat dc/fa1 x:0 0 0 2024-09-21T08:02:47.831 INFO:tasks.workunit.client.0.smithi107.stdout:4/528: write dc/d13/f4f [3102124,27317] 0 2024-09-21T08:02:47.832 INFO:tasks.workunit.client.0.smithi107.stdout:9/670: dread d11/d27/d2f/d4d/d5c/d61/fab [0,4194304] 0 2024-09-21T08:02:47.832 INFO:tasks.workunit.client.0.smithi107.stdout:9/671: write d11/d27/d98/d97/fc9 [355794,105653] 0 2024-09-21T08:02:47.832 INFO:tasks.workunit.client.0.smithi107.stdout:5/683: chown d7/de/d2d/d5d/d60/c7c 211225821 1 2024-09-21T08:02:47.833 INFO:tasks.workunit.client.0.smithi107.stdout:5/684: write d7/de/da3/fdf [177019,60392] 0 2024-09-21T08:02:47.836 INFO:tasks.workunit.client.0.smithi107.stdout:4/529: unlink dc/d13/f4f 0 2024-09-21T08:02:47.837 INFO:tasks.workunit.client.0.smithi107.stdout:9/672: mknod d11/d27/d2f/d4d/d92/cf7 0 2024-09-21T08:02:47.837 INFO:tasks.workunit.client.0.smithi107.stdout:9/673: write d11/d27/d2f/d38/dbf/dda/fe9 [619672,82026] 0 2024-09-21T08:02:47.837 INFO:tasks.workunit.client.0.smithi107.stdout:9/674: readlink d11/d27/d5b/laf 0 2024-09-21T08:02:47.839 INFO:tasks.workunit.client.0.smithi107.stdout:9/675: read d11/d27/d2f/d4d/f59 [1095423,87935] 0 2024-09-21T08:02:47.839 INFO:tasks.workunit.client.0.smithi107.stdout:5/685: truncate d7/de/d35/f43 3199364 0 2024-09-21T08:02:47.842 INFO:tasks.workunit.client.0.smithi107.stdout:9/676: mknod d11/d24/cf8 0 2024-09-21T08:02:47.844 INFO:tasks.workunit.client.0.smithi107.stdout:5/686: symlink d7/lf1 0 2024-09-21T08:02:47.844 INFO:tasks.workunit.client.0.smithi107.stdout:5/687: write d7/de/f96 [1355544,60308] 0 2024-09-21T08:02:47.845 INFO:tasks.workunit.client.0.smithi107.stdout:9/677: symlink d11/d27/d2f/d38/lf9 0 2024-09-21T08:02:47.845 INFO:tasks.workunit.client.0.smithi107.stdout:9/678: fdatasync d11/d27/d2f/d38/dbf/fdf 0 2024-09-21T08:02:47.848 INFO:tasks.workunit.client.0.smithi107.stdout:9/679: symlink d11/d27/d98/d97/lfa 0 2024-09-21T08:02:47.853 INFO:tasks.workunit.client.0.smithi107.stdout:9/680: unlink d11/l1a 0 2024-09-21T08:02:47.853 INFO:tasks.workunit.client.0.smithi107.stdout:9/681: read d11/d27/d2a/f63 [2312068,42484] 0 2024-09-21T08:02:47.855 INFO:tasks.workunit.client.0.smithi107.stdout:9/682: mkdir d11/d27/d2f/def/dfb 0 2024-09-21T08:02:47.857 INFO:tasks.workunit.client.0.smithi107.stdout:9/683: truncate d11/d27/d2f/d4d/f59 1321135 0 2024-09-21T08:02:47.858 INFO:tasks.workunit.client.0.smithi107.stdout:9/684: symlink d11/d24/d4a/d9f/lfc 0 2024-09-21T08:02:47.861 INFO:tasks.workunit.client.0.smithi107.stdout:8/497: sync 2024-09-21T08:02:47.861 INFO:tasks.workunit.client.0.smithi107.stdout:3/595: sync 2024-09-21T08:02:47.861 INFO:tasks.workunit.client.0.smithi107.stdout:3/596: dread - d8/d87/fa7 zero size 2024-09-21T08:02:47.862 INFO:tasks.workunit.client.0.smithi107.stdout:4/530: dwrite dc/fe [0,4194304] 0 2024-09-21T08:02:47.862 INFO:tasks.workunit.client.0.smithi107.stdout:5/688: dwrite d7/de/d35/f8a [0,4194304] 0 2024-09-21T08:02:47.863 INFO:tasks.workunit.client.0.smithi107.stdout:5/689: fsync d7/de/f1b 0 2024-09-21T08:02:47.863 INFO:tasks.workunit.client.0.smithi107.stdout:5/690: write d7/de/fc8 [970034,119474] 0 2024-09-21T08:02:47.863 INFO:tasks.workunit.client.0.smithi107.stdout:5/691: read - d7/de/d2d/fcd zero size 2024-09-21T08:02:47.865 INFO:tasks.workunit.client.0.smithi107.stdout:9/685: creat d11/d27/d2f/d38/daa/ffd x:0 0 0 2024-09-21T08:02:47.866 INFO:tasks.workunit.client.0.smithi107.stdout:9/686: fsync d11/d27/d2a/d7f/fbc 0 2024-09-21T08:02:47.866 INFO:tasks.workunit.client.0.smithi107.stdout:8/498: mknod d5/d38/d56/d54/caa 0 2024-09-21T08:02:47.867 INFO:tasks.workunit.client.0.smithi107.stdout:8/499: chown d5/d1d/f6f 474 1 2024-09-21T08:02:47.867 INFO:tasks.workunit.client.0.smithi107.stdout:3/597: creat d8/d21/d7e/fd2 x:0 0 0 2024-09-21T08:02:47.867 INFO:tasks.workunit.client.0.smithi107.stdout:3/598: chown d8/d14/d96/db0 7164922 1 2024-09-21T08:02:47.871 INFO:tasks.workunit.client.0.smithi107.stdout:4/531: creat dc/d13/d83/d8a/fa2 x:0 0 0 2024-09-21T08:02:47.886 INFO:tasks.workunit.client.0.smithi107.stdout:5/692: dwrite d7/de/f99 [0,4194304] 0 2024-09-21T08:02:47.886 INFO:tasks.workunit.client.0.smithi107.stdout:5/693: creat d7/d70/ff2 x:0 0 0 2024-09-21T08:02:47.886 INFO:tasks.workunit.client.0.smithi107.stdout:8/500: dwrite f0 [0,4194304] 0 2024-09-21T08:02:47.891 INFO:tasks.workunit.client.0.smithi107.stdout:9/687: creat d11/d24/d6e/ffe x:0 0 0 2024-09-21T08:02:47.893 INFO:tasks.workunit.client.0.smithi107.stdout:3/599: unlink d8/d2b/d52/d55/f70 0 2024-09-21T08:02:47.893 INFO:tasks.workunit.client.0.smithi107.stdout:4/532: symlink dc/la3 0 2024-09-21T08:02:47.897 INFO:tasks.workunit.client.0.smithi107.stdout:5/694: mknod d7/de/d2d/cf3 0 2024-09-21T08:02:47.897 INFO:tasks.workunit.client.0.smithi107.stdout:5/695: creat d7/de/d1d/ff4 x:0 0 0 2024-09-21T08:02:47.899 INFO:tasks.workunit.client.0.smithi107.stdout:8/501: mkdir d5/d2e/dab 0 2024-09-21T08:02:47.901 INFO:tasks.workunit.client.0.smithi107.stdout:9/688: creat d11/d27/d2f/d4d/d92/fff x:0 0 0 2024-09-21T08:02:47.901 INFO:tasks.workunit.client.0.smithi107.stdout:9/689: write d11/d24/d4a/d9f/fc0 [54518,111396] 0 2024-09-21T08:02:47.902 INFO:tasks.workunit.client.0.smithi107.stdout:3/600: truncate d8/d2b/d52/d71/db3/fb9 659567 0 2024-09-21T08:02:47.903 INFO:tasks.workunit.client.0.smithi107.stdout:9/690: dread d11/d24/d26/fb8 [0,4194304] 0 2024-09-21T08:02:47.905 INFO:tasks.workunit.client.0.smithi107.stdout:4/533: unlink dc/d13/f26 0 2024-09-21T08:02:47.908 INFO:tasks.workunit.client.0.smithi107.stdout:8/502: unlink d5/d1d/ca9 0 2024-09-21T08:02:47.909 INFO:tasks.workunit.client.0.smithi107.stdout:4/534: truncate dc/f2c 428673 0 2024-09-21T08:02:47.909 INFO:tasks.workunit.client.0.smithi107.stdout:4/535: creat dc/d13/d83/d8a/fa4 x:0 0 0 2024-09-21T08:02:47.911 INFO:tasks.workunit.client.0.smithi107.stdout:4/536: creat dc/d13/d40/d5e/fa5 x:0 0 0 2024-09-21T08:02:47.912 INFO:tasks.workunit.client.0.smithi107.stdout:4/537: creat dc/d60/d8c/fa6 x:0 0 0 2024-09-21T08:02:47.912 INFO:tasks.workunit.client.0.smithi107.stdout:4/538: chown dc/d13/d40/d46/f82 0 1 2024-09-21T08:02:47.913 INFO:tasks.workunit.client.0.smithi107.stdout:4/539: rename dc/l30 to dc/d13/d83/d97/la7 0 2024-09-21T08:02:47.915 INFO:tasks.workunit.client.0.smithi107.stdout:4/540: mkdir dc/d13/d40/d5e/da8 0 2024-09-21T08:02:47.926 INFO:tasks.workunit.client.0.smithi107.stdout:4/541: dread dc/f3a [0,4194304] 0 2024-09-21T08:02:47.935 INFO:tasks.workunit.client.0.smithi107.stdout:3/601: dwrite d8/d38/f94 [0,4194304] 0 2024-09-21T08:02:47.935 INFO:tasks.workunit.client.0.smithi107.stdout:9/691: dwrite d11/d27/d2f/d4d/d5c/d61/f7e [0,4194304] 0 2024-09-21T08:02:47.935 INFO:tasks.workunit.client.0.smithi107.stdout:3/602: write d8/d25/d34/fbc [178577,17011] 0 2024-09-21T08:02:47.940 INFO:tasks.workunit.client.0.smithi107.stdout:3/603: rename d8/d44/fac to d8/d38/fd3 0 2024-09-21T08:02:47.942 INFO:tasks.workunit.client.0.smithi107.stdout:3/604: symlink d8/d21/ld4 0 2024-09-21T08:02:47.953 INFO:tasks.workunit.client.0.smithi107.stdout:4/542: dwrite dc/d13/d40/d5e/d77/fa0 [0,4194304] 0 2024-09-21T08:02:47.953 INFO:tasks.workunit.client.0.smithi107.stdout:9/692: dwrite d11/d24/d26/fb8 [0,4194304] 0 2024-09-21T08:02:47.954 INFO:tasks.workunit.client.0.smithi107.stdout:2/514: sync 2024-09-21T08:02:47.954 INFO:tasks.workunit.client.0.smithi107.stdout:7/435: sync 2024-09-21T08:02:47.954 INFO:tasks.workunit.client.0.smithi107.stdout:6/647: sync 2024-09-21T08:02:47.954 INFO:tasks.workunit.client.0.smithi107.stdout:3/605: dread d8/d38/fa4 [0,4194304] 0 2024-09-21T08:02:47.957 INFO:tasks.workunit.client.0.smithi107.stdout:4/543: rename dc/d4c/f4d to dc/d13/d40/d5e/d77/fa9 0 2024-09-21T08:02:47.957 INFO:tasks.workunit.client.0.smithi107.stdout:7/436: rename d7/d22/d37 to d7/d22/d37/d5a/d9c 22 2024-09-21T08:02:47.960 INFO:tasks.workunit.client.0.smithi107.stdout:3/606: dread d8/d2b/f3f [0,4194304] 0 2024-09-21T08:02:47.962 INFO:tasks.workunit.client.0.smithi107.stdout:9/693: creat d11/d27/d2f/f100 x:0 0 0 2024-09-21T08:02:47.962 INFO:tasks.workunit.client.0.smithi107.stdout:9/694: fsync d11/d27/d5e/d76/f50 0 2024-09-21T08:02:47.963 INFO:tasks.workunit.client.0.smithi107.stdout:2/515: unlink d1/c24 0 2024-09-21T08:02:47.965 INFO:tasks.workunit.client.0.smithi107.stdout:6/648: readlink d2/d3/d7/l20 0 2024-09-21T08:02:47.966 INFO:tasks.workunit.client.0.smithi107.stdout:7/437: creat d7/d22/d37/d4b/f9d x:0 0 0 2024-09-21T08:02:47.967 INFO:tasks.workunit.client.0.smithi107.stdout:3/607: mknod d8/d25/d34/cd5 0 2024-09-21T08:02:47.968 INFO:tasks.workunit.client.0.smithi107.stdout:9/695: truncate d11/d24/d35/f4e 3476551 0 2024-09-21T08:02:47.968 INFO:tasks.workunit.client.0.smithi107.stdout:9/696: dread - d11/d27/d2a/fb3 zero size 2024-09-21T08:02:47.970 INFO:tasks.workunit.client.0.smithi107.stdout:2/516: rename d1/d2/cf to d1/d2/d6d/d42/d76/cb1 0 2024-09-21T08:02:47.971 INFO:tasks.workunit.client.0.smithi107.stdout:7/438: mkdir d7/d22/d37/d5a/d83/d9e 0 2024-09-21T08:02:47.972 INFO:tasks.workunit.client.0.smithi107.stdout:3/608: mkdir d8/d25/d42/dae/db1/dd6 0 2024-09-21T08:02:47.973 INFO:tasks.workunit.client.0.smithi107.stdout:4/544: dwrite dc/d13/d5a/f78 [0,4194304] 0 2024-09-21T08:02:47.973 INFO:tasks.workunit.client.0.smithi107.stdout:4/545: fdatasync dc/d13/d40/f4b 0 2024-09-21T08:02:47.973 INFO:tasks.workunit.client.0.smithi107.stdout:9/697: mknod d11/d27/d2f/d4d/d5c/d61/db4/c101 0 2024-09-21T08:02:47.975 INFO:tasks.workunit.client.0.smithi107.stdout:6/649: rename d2/d3/d7/d23/c80 to d2/cce 0 2024-09-21T08:02:47.975 INFO:tasks.workunit.client.0.smithi107.stdout:7/439: symlink d7/d22/d37/l9f 0 2024-09-21T08:02:47.979 INFO:tasks.workunit.client.0.smithi107.stdout:4/546: getdents dc/d13/d40/d5e/d6e 0 2024-09-21T08:02:47.980 INFO:tasks.workunit.client.0.smithi107.stdout:2/517: write d1/d16/f4e [668066,44785] 0 2024-09-21T08:02:47.982 INFO:tasks.workunit.client.0.smithi107.stdout:9/698: rename d11/d27/d2f/d38/daa/lbd to d11/d27/d5e/df1/l102 0 2024-09-21T08:02:47.982 INFO:tasks.workunit.client.0.smithi107.stdout:9/699: chown d11/d27/d2f/d4d 404838 1 2024-09-21T08:02:47.983 INFO:tasks.workunit.client.0.smithi107.stdout:7/440: dread d7/d22/d3b/f47 [0,4194304] 0 2024-09-21T08:02:47.983 INFO:tasks.workunit.client.0.smithi107.stdout:7/441: fsync d7/d22/d3d/d8a/f8d 0 2024-09-21T08:02:47.983 INFO:tasks.workunit.client.0.smithi107.stdout:7/442: dread - d7/d22/d3d/f7c zero size 2024-09-21T08:02:47.983 INFO:tasks.workunit.client.0.smithi107.stdout:4/547: unlink dc/d13/c32 0 2024-09-21T08:02:47.983 INFO:tasks.workunit.client.0.smithi107.stdout:4/548: chown dc/d13/d83/d97/la7 33 1 2024-09-21T08:02:47.985 INFO:tasks.workunit.client.0.smithi107.stdout:3/609: dread d8/d25/d3d/f51 [0,4194304] 0 2024-09-21T08:02:47.988 INFO:tasks.workunit.client.0.smithi107.stdout:2/518: unlink d1/d16/f4e 0 2024-09-21T08:02:47.988 INFO:tasks.workunit.client.0.smithi107.stdout:2/519: write d1/f31 [747647,69298] 0 2024-09-21T08:02:47.991 INFO:tasks.workunit.client.0.smithi107.stdout:7/443: write d7/d22/d37/d4b/d4e/f96 [5322496,100623] 0 2024-09-21T08:02:47.991 INFO:tasks.workunit.client.0.smithi107.stdout:7/444: fdatasync d7/d22/f2d 0 2024-09-21T08:02:47.991 INFO:tasks.workunit.client.0.smithi107.stdout:6/650: dread d2/d3/d7/d79/fb5 [0,4194304] 0 2024-09-21T08:02:47.992 INFO:tasks.workunit.client.0.smithi107.stdout:9/700: creat d11/d27/d2f/f103 x:0 0 0 2024-09-21T08:02:47.992 INFO:tasks.workunit.client.0.smithi107.stdout:9/701: write d11/d27/d98/fcb [1010846,53572] 0 2024-09-21T08:02:47.994 INFO:tasks.workunit.client.0.smithi107.stdout:4/549: dread dc/d13/f5d [0,4194304] 0 2024-09-21T08:02:47.994 INFO:tasks.workunit.client.0.smithi107.stdout:4/550: write dc/d13/d40/f42 [961654,75201] 0 2024-09-21T08:02:47.994 INFO:tasks.workunit.client.0.smithi107.stdout:4/551: write dc/f68 [659288,49426] 0 2024-09-21T08:02:47.994 INFO:tasks.workunit.client.0.smithi107.stdout:2/520: dread d1/d6/f95 [0,4194304] 0 2024-09-21T08:02:47.994 INFO:tasks.workunit.client.0.smithi107.stdout:2/521: write d1/d6/f95 [5223215,128278] 0 2024-09-21T08:02:47.994 INFO:tasks.workunit.client.0.smithi107.stdout:2/522: fdatasync d1/d16/d35/f50 0 2024-09-21T08:02:47.995 INFO:tasks.workunit.client.0.smithi107.stdout:3/610: creat d8/d25/d3d/d72/d80/fd7 x:0 0 0 2024-09-21T08:02:47.998 INFO:tasks.workunit.client.0.smithi107.stdout:6/651: mkdir d2/d3/d7/d48/da3/d85/d9d/dcf 0 2024-09-21T08:02:48.000 INFO:tasks.workunit.client.0.smithi107.stdout:3/611: dread d8/d2b/f3f [0,4194304] 0 2024-09-21T08:02:48.001 INFO:tasks.workunit.client.0.smithi107.stdout:4/552: mkdir dc/d13/d40/d5e/d77/d99/daa 0 2024-09-21T08:02:48.002 INFO:tasks.workunit.client.0.smithi107.stdout:9/702: write d11/d27/d5e/d76/fb7 [1941371,11032] 0 2024-09-21T08:02:48.005 INFO:tasks.workunit.client.0.smithi107.stdout:2/523: symlink d1/lb2 0 2024-09-21T08:02:48.007 INFO:tasks.workunit.client.0.smithi107.stdout:4/553: rename dc/d13/d83/d8a/fa4 to dc/d60/fab 0 2024-09-21T08:02:48.009 INFO:tasks.workunit.client.0.smithi107.stdout:9/703: symlink d11/d24/d6e/db9/l104 0 2024-09-21T08:02:48.010 INFO:tasks.workunit.client.0.smithi107.stdout:2/524: truncate d1/d16/f60 242630 0 2024-09-21T08:02:48.012 INFO:tasks.workunit.client.0.smithi107.stdout:4/554: rename dc/c17 to dc/d64/cac 0 2024-09-21T08:02:48.013 INFO:tasks.workunit.client.0.smithi107.stdout:2/525: symlink d1/d2/d6d/d9b/lb3 0 2024-09-21T08:02:48.015 INFO:tasks.workunit.client.0.smithi107.stdout:4/555: truncate dc/d13/d40/d5e/d77/fa9 7113063 0 2024-09-21T08:02:48.018 INFO:tasks.workunit.client.0.smithi107.stdout:4/556: mknod dc/d60/d8c/cad 0 2024-09-21T08:02:48.019 INFO:tasks.workunit.client.0.smithi107.stdout:2/526: mknod d1/d2/d6d/d37/cb4 0 2024-09-21T08:02:48.019 INFO:tasks.workunit.client.0.smithi107.stdout:2/527: chown d1/d1e/l57 49256 1 2024-09-21T08:02:48.019 INFO:tasks.workunit.client.0.smithi107.stdout:2/528: truncate d1/d2/d6d/f71 67857 0 2024-09-21T08:02:48.020 INFO:tasks.workunit.client.0.smithi107.stdout:9/704: rename d11/d27/d2f/d4d/d92/dc5 to d11/d27/d5e/df1/d105 0 2024-09-21T08:02:48.021 INFO:tasks.workunit.client.0.smithi107.stdout:2/529: dread d1/d2/d6d/f6c [0,4194304] 0 2024-09-21T08:02:48.023 INFO:tasks.workunit.client.0.smithi107.stdout:9/705: truncate d11/d24/d35/f6f 1946793 0 2024-09-21T08:02:48.023 INFO:tasks.workunit.client.0.smithi107.stdout:9/706: dread - d11/d27/d5e/d76/f9e zero size 2024-09-21T08:02:48.024 INFO:tasks.workunit.client.0.smithi107.stdout:2/530: mknod d1/d2/cb5 0 2024-09-21T08:02:48.024 INFO:tasks.workunit.client.0.smithi107.stdout:2/531: fsync d1/d6/f2d 0 2024-09-21T08:02:48.025 INFO:tasks.workunit.client.0.smithi107.stdout:7/445: dwrite d7/d22/d37/d5a/f66 [0,4194304] 0 2024-09-21T08:02:48.025 INFO:tasks.workunit.client.0.smithi107.stdout:6/652: dwrite d2/fe [0,4194304] 0 2024-09-21T08:02:48.025 INFO:tasks.workunit.client.0.smithi107.stdout:7/446: dread - d7/d22/d3a/f7a zero size 2024-09-21T08:02:48.025 INFO:tasks.workunit.client.0.smithi107.stdout:6/653: creat d2/d3/d7/d3f/fd0 x:0 0 0 2024-09-21T08:02:48.025 INFO:tasks.workunit.client.0.smithi107.stdout:3/612: dwrite d8/d21/f4c [0,4194304] 0 2024-09-21T08:02:48.026 INFO:tasks.workunit.client.0.smithi107.stdout:3/613: readlink d8/d21/d7e/l82 0 2024-09-21T08:02:48.026 INFO:tasks.workunit.client.0.smithi107.stdout:7/447: dread d7/d22/f76 [0,4194304] 0 2024-09-21T08:02:48.028 INFO:tasks.workunit.client.0.smithi107.stdout:2/532: rmdir d1/d2/d6d/d37/d82 39 2024-09-21T08:02:48.034 INFO:tasks.workunit.client.0.smithi107.stdout:6/654: creat d2/d3/d7/d48/da3/d85/d9d/fd1 x:0 0 0 2024-09-21T08:02:48.035 INFO:tasks.workunit.client.0.smithi107.stdout:3/614: mkdir d8/d2b/d52/d71/dd8 0 2024-09-21T08:02:48.039 INFO:tasks.workunit.client.0.smithi107.stdout:7/448: mkdir d7/d10/d28/d69/da0 0 2024-09-21T08:02:48.039 INFO:tasks.workunit.client.0.smithi107.stdout:7/449: chown d7/d22/d37/d40/l6c 31228 1 2024-09-21T08:02:48.039 INFO:tasks.workunit.client.0.smithi107.stdout:2/533: write d1/d2/d6d/d37/d49/f77 [2524710,71623] 0 2024-09-21T08:02:48.039 INFO:tasks.workunit.client.0.smithi107.stdout:2/534: write d1/d6/f2e [935166,121447] 0 2024-09-21T08:02:48.039 INFO:tasks.workunit.client.0.smithi107.stdout:2/535: write d1/d6/f2e [433123,94150] 0 2024-09-21T08:02:48.040 INFO:tasks.workunit.client.0.smithi107.stdout:6/655: creat d2/d3/d7/d48/da3/fd2 x:0 0 0 2024-09-21T08:02:48.041 INFO:tasks.workunit.client.0.smithi107.stdout:3/615: creat d8/d25/d34/dd0/fd9 x:0 0 0 2024-09-21T08:02:48.043 INFO:tasks.workunit.client.0.smithi107.stdout:7/450: symlink d7/d10/d28/d69/da0/la1 0 2024-09-21T08:02:48.043 INFO:tasks.workunit.client.0.smithi107.stdout:7/451: dread - d7/d22/d37/d5a/f8c zero size 2024-09-21T08:02:48.043 INFO:tasks.workunit.client.0.smithi107.stdout:7/452: fdatasync d7/d22/d3a/d49/f6f 0 2024-09-21T08:02:48.043 INFO:tasks.workunit.client.0.smithi107.stdout:4/557: dwrite dc/d13/d83/d90/f73 [0,4194304] 0 2024-09-21T08:02:48.043 INFO:tasks.workunit.client.0.smithi107.stdout:7/453: write d7/d22/d37/d40/d4d/f6a [876868,66212] 0 2024-09-21T08:02:48.043 INFO:tasks.workunit.client.0.smithi107.stdout:7/454: truncate d7/d38/f60 5182419 0 2024-09-21T08:02:48.044 INFO:tasks.workunit.client.0.smithi107.stdout:2/536: symlink d1/d6/lb6 0 2024-09-21T08:02:48.045 INFO:tasks.workunit.client.0.smithi107.stdout:9/707: dread d11/d24/d35/f4e [0,4194304] 0 2024-09-21T08:02:48.046 INFO:tasks.workunit.client.0.smithi107.stdout:4/558: rename dc/d13/d5a/f5b to dc/d13/d5a/fae 0 2024-09-21T08:02:48.047 INFO:tasks.workunit.client.0.smithi107.stdout:7/455: creat d7/d22/d3d/fa2 x:0 0 0 2024-09-21T08:02:48.049 INFO:tasks.workunit.client.0.smithi107.stdout:2/537: link d1/f10 d1/d1e/fb7 0 2024-09-21T08:02:48.050 INFO:tasks.workunit.client.0.smithi107.stdout:9/708: creat d11/d24/d26/f106 x:0 0 0 2024-09-21T08:02:48.050 INFO:tasks.workunit.client.0.smithi107.stdout:9/709: chown d11/d27/d2a/l40 2715961 1 2024-09-21T08:02:48.052 INFO:tasks.workunit.client.0.smithi107.stdout:4/559: symlink dc/laf 0 2024-09-21T08:02:48.052 INFO:tasks.workunit.client.0.smithi107.stdout:4/560: fdatasync fb 0 2024-09-21T08:02:48.052 INFO:tasks.workunit.client.0.smithi107.stdout:4/561: dread - dc/d13/d83/d8a/fa2 zero size 2024-09-21T08:02:48.052 INFO:tasks.workunit.client.0.smithi107.stdout:4/562: chown dc/d13/d40 756 1 2024-09-21T08:02:48.053 INFO:tasks.workunit.client.0.smithi107.stdout:7/456: creat d7/d22/d3b/fa3 x:0 0 0 2024-09-21T08:02:48.053 INFO:tasks.workunit.client.0.smithi107.stdout:3/616: dread d8/d2b/f3b [0,4194304] 0 2024-09-21T08:02:48.054 INFO:tasks.workunit.client.0.smithi107.stdout:2/538: mkdir d1/d2/d6d/d42/db0/db8 0 2024-09-21T08:02:48.056 INFO:tasks.workunit.client.0.smithi107.stdout:4/563: symlink dc/d13/d5a/lb0 0 2024-09-21T08:02:48.056 INFO:tasks.workunit.client.0.smithi107.stdout:4/564: creat dc/d13/d40/d5e/fb1 x:0 0 0 2024-09-21T08:02:48.059 INFO:tasks.workunit.client.0.smithi107.stdout:6/656: dwrite d2/d3/d7/d3f/fd0 [0,4194304] 0 2024-09-21T08:02:48.060 INFO:tasks.workunit.client.0.smithi107.stdout:3/617: mknod d8/d25/d3d/d72/d80/d5d/d67/cda 0 2024-09-21T08:02:48.060 INFO:tasks.workunit.client.0.smithi107.stdout:3/618: readlink d8/d14/l78 0 2024-09-21T08:02:48.062 INFO:tasks.workunit.client.0.smithi107.stdout:2/539: rename d1/d2/d6d/d37/d82/l90 to d1/d2/lb9 0 2024-09-21T08:02:48.067 INFO:tasks.workunit.client.0.smithi107.stdout:3/619: link d8/l10 d8/d2b/d52/d71/db3/ldb 0 2024-09-21T08:02:48.069 INFO:tasks.workunit.client.0.smithi107.stdout:6/657: rename d2/d3/d7/f13 to d2/d3/d7/d48/da3/d85/d9d/dcf/fd3 0 2024-09-21T08:02:48.071 INFO:tasks.workunit.client.0.smithi107.stdout:9/710: dwrite d11/d27/d2f/d4d/f59 [0,4194304] 0 2024-09-21T08:02:48.071 INFO:tasks.workunit.client.0.smithi107.stdout:2/540: rmdir d1/d2/d6d/d37/d49/d7f 39 2024-09-21T08:02:48.074 INFO:tasks.workunit.client.0.smithi107.stdout:3/620: mkdir d8/d25/d34/ddc 0 2024-09-21T08:02:48.076 INFO:tasks.workunit.client.0.smithi107.stdout:4/565: dwrite dc/fa1 [0,4194304] 0 2024-09-21T08:02:48.078 INFO:tasks.workunit.client.0.smithi107.stdout:2/541: getdents d1/d2/d6d/d37/d49 0 2024-09-21T08:02:48.081 INFO:tasks.workunit.client.0.smithi107.stdout:4/566: unlink dc/d13/d40/d5e/l7f 0 2024-09-21T08:02:48.081 INFO:tasks.workunit.client.0.smithi107.stdout:4/567: write dc/d13/d40/d5e/d6e/f71 [752133,19869] 0 2024-09-21T08:02:48.082 INFO:tasks.workunit.client.0.smithi107.stdout:6/658: write d2/d3/d7/d2a/f51 [2975348,72860] 0 2024-09-21T08:02:48.083 INFO:tasks.workunit.client.0.smithi107.stdout:2/542: rename d1/d6/f72 to d1/d2/fba 0 2024-09-21T08:02:48.083 INFO:tasks.workunit.client.0.smithi107.stdout:2/543: chown d1/d2/d6d/d37/d49/d85/c89 4154431 1 2024-09-21T08:02:48.083 INFO:tasks.workunit.client.0.smithi107.stdout:7/457: rmdir d7/d22/d3b 39 2024-09-21T08:02:48.084 INFO:tasks.workunit.client.0.smithi107.stdout:4/568: getdents dc/d13/d83/d97 0 2024-09-21T08:02:48.085 INFO:tasks.workunit.client.0.smithi107.stdout:2/544: truncate d1/d1e/f5c 2066635 0 2024-09-21T08:02:48.085 INFO:tasks.workunit.client.0.smithi107.stdout:3/621: dread d8/f8a [0,4194304] 0 2024-09-21T08:02:48.086 INFO:tasks.workunit.client.0.smithi107.stdout:7/458: rmdir d7/d10/d28/d69/da0 39 2024-09-21T08:02:48.086 INFO:tasks.workunit.client.0.smithi107.stdout:7/459: truncate d7/d22/d3d/f51 870696 0 2024-09-21T08:02:48.088 INFO:tasks.workunit.client.0.smithi107.stdout:6/659: dread d2/d3/d7/d2a/f8b [0,4194304] 0 2024-09-21T08:02:48.089 INFO:tasks.workunit.client.0.smithi107.stdout:7/460: rmdir d7/d22/d3d/d8a 39 2024-09-21T08:02:48.089 INFO:tasks.workunit.client.0.smithi107.stdout:7/461: creat d7/d22/d37/d5a/fa4 x:0 0 0 2024-09-21T08:02:48.089 INFO:tasks.workunit.client.0.smithi107.stdout:7/462: dread - d7/d22/d3a/f7a zero size 2024-09-21T08:02:48.090 INFO:tasks.workunit.client.0.smithi107.stdout:7/463: fsync d7/d22/d37/d4b/f7e 0 2024-09-21T08:02:48.090 INFO:tasks.workunit.client.0.smithi107.stdout:6/660: truncate d2/d3/d7/f9c 453729 0 2024-09-21T08:02:48.091 INFO:tasks.workunit.client.0.smithi107.stdout:2/545: fdatasync d1/d6/f2e 0 2024-09-21T08:02:48.092 INFO:tasks.workunit.client.0.smithi107.stdout:9/711: dwrite d11/d27/d2f/d4d/d5c/d61/f7e [0,4194304] 0 2024-09-21T08:02:48.092 INFO:tasks.workunit.client.0.smithi107.stdout:9/712: fdatasync d11/d24/f74 0 2024-09-21T08:02:48.095 INFO:tasks.workunit.client.0.smithi107.stdout:7/464: truncate d7/d10/d28/f35 863946 0 2024-09-21T08:02:48.095 INFO:tasks.workunit.client.0.smithi107.stdout:7/465: fsync d7/d22/d37/d5a/f66 0 2024-09-21T08:02:48.095 INFO:tasks.workunit.client.0.smithi107.stdout:6/661: symlink d2/d3/d7/d54/dae/ld4 0 2024-09-21T08:02:48.096 INFO:tasks.workunit.client.0.smithi107.stdout:9/713: dread d11/d27/d2f/d38/dbf/dda/fe9 [0,4194304] 0 2024-09-21T08:02:48.096 INFO:tasks.workunit.client.0.smithi107.stdout:9/714: write d11/d27/d2f/d4d/d5c/d61/db4/dbb/ff2 [946496,19995] 0 2024-09-21T08:02:48.098 INFO:tasks.workunit.client.0.smithi107.stdout:4/569: dread dc/d13/d40/f52 [0,4194304] 0 2024-09-21T08:02:48.098 INFO:tasks.workunit.client.0.smithi107.stdout:4/570: stat dc/d13/d5a/f78 0 2024-09-21T08:02:48.098 INFO:tasks.workunit.client.0.smithi107.stdout:4/571: stat dc/d13/d40/f42 0 2024-09-21T08:02:48.100 INFO:tasks.workunit.client.0.smithi107.stdout:7/466: write d7/f3f [703956,33953] 0 2024-09-21T08:02:48.103 INFO:tasks.workunit.client.0.smithi107.stdout:3/622: dwrite d8/d25/d3d/d72/d80/d5d/f63 [0,4194304] 0 2024-09-21T08:02:48.104 INFO:tasks.workunit.client.0.smithi107.stdout:3/623: chown d8/d2b/d45/dcc 7 1 2024-09-21T08:02:48.106 INFO:tasks.workunit.client.0.smithi107.stdout:7/467: dread d7/d22/d37/d40/d4d/f6a [0,4194304] 0 2024-09-21T08:02:48.107 INFO:tasks.workunit.client.0.smithi107.stdout:9/715: dread d11/d27/f72 [0,4194304] 0 2024-09-21T08:02:48.107 INFO:tasks.workunit.client.0.smithi107.stdout:9/716: write d11/d27/d2f/d38/daa/ffd [987702,114810] 0 2024-09-21T08:02:48.108 INFO:tasks.workunit.client.0.smithi107.stdout:6/662: read d2/d3/d7/d3f/fd0 [3713682,52702] 0 2024-09-21T08:02:48.108 INFO:tasks.workunit.client.0.smithi107.stdout:6/663: truncate d2/d3/d7/d48/da3/fd2 66382 0 2024-09-21T08:02:48.116 INFO:tasks.workunit.client.0.smithi107.stdout:9/717: dread d11/d27/d2a/f41 [0,4194304] 0 2024-09-21T08:02:48.116 INFO:tasks.workunit.client.0.smithi107.stdout:9/718: write d11/d27/d2f/f100 [51566,72085] 0 2024-09-21T08:02:48.116 INFO:tasks.workunit.client.0.smithi107.stdout:9/719: fsync d11/d27/d5e/d76/f50 0 2024-09-21T08:02:48.118 INFO:tasks.workunit.client.0.smithi107.stdout:2/546: dread d1/d1e/f5c [0,4194304] 0 2024-09-21T08:02:48.118 INFO:tasks.workunit.client.0.smithi107.stdout:2/547: dread - d1/d2/d6d/d37/d49/d7f/fa8 zero size 2024-09-21T08:02:48.120 INFO:tasks.workunit.client.0.smithi107.stdout:4/572: mkdir dc/d13/d83/d90/db2 0 2024-09-21T08:02:48.120 INFO:tasks.workunit.client.0.smithi107.stdout:3/624: symlink d8/d2b/d45/dcc/daa/ldd 0 2024-09-21T08:02:48.121 INFO:tasks.workunit.client.0.smithi107.stdout:6/664: creat d2/d3/d7/d54/dae/fd5 x:0 0 0 2024-09-21T08:02:48.122 INFO:tasks.workunit.client.0.smithi107.stdout:9/720: mknod d11/d27/d98/d97/c107 0 2024-09-21T08:02:48.122 INFO:tasks.workunit.client.0.smithi107.stdout:9/721: dread - d11/d27/d2f/d38/dbf/fdf zero size 2024-09-21T08:02:48.122 INFO:tasks.workunit.client.0.smithi107.stdout:6/665: dread d2/d3/d7/f9c [0,4194304] 0 2024-09-21T08:02:48.123 INFO:tasks.workunit.client.0.smithi107.stdout:2/548: mkdir d1/d16/d9c/dbb 0 2024-09-21T08:02:48.123 INFO:tasks.workunit.client.0.smithi107.stdout:2/549: fdatasync d1/d6/f18 0 2024-09-21T08:02:48.123 INFO:tasks.workunit.client.0.smithi107.stdout:3/625: stat d8/d25/d42/dae/db1/lbe 0 2024-09-21T08:02:48.123 INFO:tasks.workunit.client.0.smithi107.stdout:3/626: dread - d8/d38/fd3 zero size 2024-09-21T08:02:48.129 INFO:tasks.workunit.client.0.smithi107.stdout:4/573: dread dc/d13/d40/f43 [0,4194304] 0 2024-09-21T08:02:48.129 INFO:tasks.workunit.client.0.smithi107.stdout:4/574: write dc/f31 [2296090,71683] 0 2024-09-21T08:02:48.129 INFO:tasks.workunit.client.0.smithi107.stdout:4/575: chown dc/d13/d40/f52 14 1 2024-09-21T08:02:48.129 INFO:tasks.workunit.client.0.smithi107.stdout:4/576: chown dc/f50 101173257 1 2024-09-21T08:02:48.129 INFO:tasks.workunit.client.0.smithi107.stdout:4/577: chown dc/f1e 112 1 2024-09-21T08:02:48.130 INFO:tasks.workunit.client.0.smithi107.stdout:7/468: dwrite d7/d18/f29 [4194304,4194304] 0 2024-09-21T08:02:48.131 INFO:tasks.workunit.client.0.smithi107.stdout:4/578: mknod dc/d13/d40/d80/cb3 0 2024-09-21T08:02:48.136 INFO:tasks.workunit.client.0.smithi107.stdout:7/469: rename d7/f14 to d7/d22/d3a/fa5 0 2024-09-21T08:02:48.176 INFO:tasks.workunit.client.0.smithi107.stdout:2/550: dwrite d1/d16/d35/f59 [0,4194304] 0 2024-09-21T08:02:48.176 INFO:tasks.workunit.client.0.smithi107.stdout:2/551: getdents d1/d16/d9c/dbb 0 2024-09-21T08:02:48.184 INFO:tasks.workunit.client.0.smithi107.stdout:9/722: dwrite d11/d27/d2f/d4d/d5c/f4b [0,4194304] 0 2024-09-21T08:02:48.184 INFO:tasks.workunit.client.0.smithi107.stdout:9/723: readlink d11/d27/d5e/le1 0 2024-09-21T08:02:48.185 INFO:tasks.workunit.client.0.smithi107.stdout:3/627: dwrite d8/d87/fa7 [0,4194304] 0 2024-09-21T08:02:48.185 INFO:tasks.workunit.client.0.smithi107.stdout:3/628: dread - d8/d2b/d45/dcc/fc7 zero size 2024-09-21T08:02:48.185 INFO:tasks.workunit.client.0.smithi107.stdout:1/554: sync 2024-09-21T08:02:48.185 INFO:tasks.workunit.client.0.smithi107.stdout:1/555: chown d0/d19/d2b/d4b/d61 424238823 1 2024-09-21T08:02:48.187 INFO:tasks.workunit.client.0.smithi107.stdout:4/579: dwrite dc/f1e [0,4194304] 0 2024-09-21T08:02:48.187 INFO:tasks.workunit.client.0.smithi107.stdout:9/724: symlink d11/d27/d2f/def/dfb/l108 0 2024-09-21T08:02:48.187 INFO:tasks.workunit.client.0.smithi107.stdout:9/725: fsync d11/d27/d2f/fce 0 2024-09-21T08:02:48.187 INFO:tasks.workunit.client.0.smithi107.stdout:7/470: dwrite d7/d38/f7d [0,4194304] 0 2024-09-21T08:02:48.192 INFO:tasks.workunit.client.0.smithi107.stdout:3/629: link d8/d14/f58 d8/d44/dad/fde 0 2024-09-21T08:02:48.192 INFO:tasks.workunit.client.0.smithi107.stdout:2/552: write d1/d6/d9e/fa1 [2174716,89315] 0 2024-09-21T08:02:48.192 INFO:tasks.workunit.client.0.smithi107.stdout:6/666: dwrite d2/d2e/f58 [0,4194304] 0 2024-09-21T08:02:48.193 INFO:tasks.workunit.client.0.smithi107.stdout:1/556: getdents d0/d29/d4d 0 2024-09-21T08:02:48.194 INFO:tasks.workunit.client.0.smithi107.stdout:9/726: symlink d11/d24/d4a/l109 0 2024-09-21T08:02:48.204 INFO:tasks.workunit.client.0.smithi107.stdout:7/471: creat d7/d18/fa6 x:0 0 0 2024-09-21T08:02:48.211 INFO:tasks.workunit.client.0.smithi107.stdout:4/580: dwrite dc/d13/f2a [0,4194304] 0 2024-09-21T08:02:48.211 INFO:tasks.workunit.client.0.smithi107.stdout:2/553: link d1/d1e/l45 d1/d16/d9c/lbc 0 2024-09-21T08:02:48.211 INFO:tasks.workunit.client.0.smithi107.stdout:2/554: dread - d1/d2/d6d/d37/f3a zero size 2024-09-21T08:02:48.211 INFO:tasks.workunit.client.0.smithi107.stdout:2/555: dread - d1/d16/f32 zero size 2024-09-21T08:02:48.211 INFO:tasks.workunit.client.0.smithi107.stdout:2/556: truncate d1/d16/f41 552183 0 2024-09-21T08:02:48.214 INFO:tasks.workunit.client.0.smithi107.stdout:6/667: symlink d2/d3/d7/d48/da3/d85/d9b/ld6 0 2024-09-21T08:02:48.215 INFO:tasks.workunit.client.0.smithi107.stdout:9/727: symlink d11/d27/d2a/l10a 0 2024-09-21T08:02:48.215 INFO:tasks.workunit.client.0.smithi107.stdout:6/668: read d2/d3/d7/f42 [4998030,75240] 0 2024-09-21T08:02:48.216 INFO:tasks.workunit.client.0.smithi107.stdout:7/472: creat d7/d22/d37/fa7 x:0 0 0 2024-09-21T08:02:48.219 INFO:tasks.workunit.client.0.smithi107.stdout:3/630: dwrite d8/f8a [0,4194304] 0 2024-09-21T08:02:48.219 INFO:tasks.workunit.client.0.smithi107.stdout:3/631: getdents d8/d87/dc9 0 2024-09-21T08:02:48.220 INFO:tasks.workunit.client.0.smithi107.stdout:9/728: link d11/d27/c68 d11/d27/d98/d97/c10b 0 2024-09-21T08:02:48.220 INFO:tasks.workunit.client.0.smithi107.stdout:9/729: readlink d11/d24/d6e/db9/l104 0 2024-09-21T08:02:48.221 INFO:tasks.workunit.client.0.smithi107.stdout:1/557: dwrite d0/d29/d31/f77 [0,4194304] 0 2024-09-21T08:02:48.221 INFO:tasks.workunit.client.0.smithi107.stdout:1/558: chown d0/d19/d2b/d4b/d44/d55/d64/fa3 284 1 2024-09-21T08:02:48.224 INFO:tasks.workunit.client.0.smithi107.stdout:3/632: mknod d8/d25/d42/dae/db1/dd6/cdf 0 2024-09-21T08:02:48.224 INFO:tasks.workunit.client.0.smithi107.stdout:3/633: dread - d8/d21/d7e/fd2 zero size 2024-09-21T08:02:48.225 INFO:tasks.workunit.client.0.smithi107.stdout:3/634: chown d8/d38/f94 5430 1 2024-09-21T08:02:48.225 INFO:tasks.workunit.client.0.smithi107.stdout:3/635: write d8/d44/f64 [1098356,24427] 0 2024-09-21T08:02:48.225 INFO:tasks.workunit.client.0.smithi107.stdout:3/636: creat d8/d2b/d52/d55/fe0 x:0 0 0 2024-09-21T08:02:48.225 INFO:tasks.workunit.client.0.smithi107.stdout:2/557: dread d1/d16/f55 [0,4194304] 0 2024-09-21T08:02:48.227 INFO:tasks.workunit.client.0.smithi107.stdout:1/559: creat d0/d19/d2b/d4b/d61/fbb x:0 0 0 2024-09-21T08:02:48.229 INFO:tasks.workunit.client.0.smithi107.stdout:7/473: dread d7/d22/d3a/fa5 [0,4194304] 0 2024-09-21T08:02:48.229 INFO:tasks.workunit.client.0.smithi107.stdout:9/730: dread d11/d24/f74 [0,4194304] 0 2024-09-21T08:02:48.234 INFO:tasks.workunit.client.0.smithi107.stdout:4/581: dwrite dc/d60/fab [0,4194304] 0 2024-09-21T08:02:48.234 INFO:tasks.workunit.client.0.smithi107.stdout:4/582: fdatasync dc/d13/d40/f4a 0 2024-09-21T08:02:48.234 INFO:tasks.workunit.client.0.smithi107.stdout:4/583: read - dc/d13/d40/d5e/fa5 zero size 2024-09-21T08:02:48.235 INFO:tasks.workunit.client.0.smithi107.stdout:2/558: creat d1/d2/d6d/d9b/fbd x:0 0 0 2024-09-21T08:02:48.237 INFO:tasks.workunit.client.0.smithi107.stdout:1/560: mknod d0/d19/d2b/d4b/d1c/cbc 0 2024-09-21T08:02:48.237 INFO:tasks.workunit.client.0.smithi107.stdout:1/561: truncate d0/f71 5351168 0 2024-09-21T08:02:48.238 INFO:tasks.workunit.client.0.smithi107.stdout:6/669: dwrite d2/d3/d7/d48/f72 [0,4194304] 0 2024-09-21T08:02:48.238 INFO:tasks.workunit.client.0.smithi107.stdout:6/670: creat d2/d3/d7/d24/d41/fd7 x:0 0 0 2024-09-21T08:02:48.238 INFO:tasks.workunit.client.0.smithi107.stdout:7/474: mknod d7/d22/d3d/ca8 0 2024-09-21T08:02:48.239 INFO:tasks.workunit.client.0.smithi107.stdout:7/475: write d7/d22/f24 [4886447,45047] 0 2024-09-21T08:02:48.249 INFO:tasks.workunit.client.0.smithi107.stdout:0/530: sync 2024-09-21T08:02:48.249 INFO:tasks.workunit.client.0.smithi107.stdout:0/531: creat d1/d5/d25/d9e/fb2 x:0 0 0 2024-09-21T08:02:48.252 INFO:tasks.workunit.client.0.smithi107.stdout:6/671: mkdir d2/d3/d7/d48/da3/d85/d9d/dcf/dd8 0 2024-09-21T08:02:48.252 INFO:tasks.workunit.client.0.smithi107.stdout:6/672: write d2/d3/d7/d2a/fc6 [386058,81453] 0 2024-09-21T08:02:48.255 INFO:tasks.workunit.client.0.smithi107.stdout:7/476: creat d7/fa9 x:0 0 0 2024-09-21T08:02:48.255 INFO:tasks.workunit.client.0.smithi107.stdout:7/477: chown d7/d22/c43 33 1 2024-09-21T08:02:48.255 INFO:tasks.workunit.client.0.smithi107.stdout:7/478: chown d7/d10/d64/l89 499315 1 2024-09-21T08:02:48.255 INFO:tasks.workunit.client.0.smithi107.stdout:7/479: fdatasync d7/d22/d3d/f51 0 2024-09-21T08:02:48.255 INFO:tasks.workunit.client.0.smithi107.stdout:7/480: stat d7/d22/d3a/l79 0 2024-09-21T08:02:48.257 INFO:tasks.workunit.client.0.smithi107.stdout:0/532: mknod d1/d5/d25/d3d/d20/d29/d5c/cb3 0 2024-09-21T08:02:48.258 INFO:tasks.workunit.client.0.smithi107.stdout:6/673: mkdir d2/d3/d7/d48/da3/d85/dd9 0 2024-09-21T08:02:48.265 INFO:tasks.workunit.client.0.smithi107.stdout:9/731: dwrite d11/d24/d35/fa8 [0,4194304] 0 2024-09-21T08:02:48.265 INFO:tasks.workunit.client.0.smithi107.stdout:9/732: write d11/d27/d2f/d4d/d92/fff [936108,49433] 0 2024-09-21T08:02:48.265 INFO:tasks.workunit.client.0.smithi107.stdout:9/733: chown d11/d24/d26 0 1 2024-09-21T08:02:48.270 INFO:tasks.workunit.client.0.smithi107.stdout:9/734: mkdir d11/d27/d98/d10c 0 2024-09-21T08:02:48.273 INFO:tasks.workunit.client.0.smithi107.stdout:9/735: mkdir d11/d24/d26/dd0/dec/d10d 0 2024-09-21T08:02:48.273 INFO:tasks.workunit.client.0.smithi107.stdout:6/674: dread d2/d3/d7/f11 [0,4194304] 0 2024-09-21T08:02:48.274 INFO:tasks.workunit.client.0.smithi107.stdout:9/736: creat d11/d24/d26/dd0/dec/f10e x:0 0 0 2024-09-21T08:02:48.274 INFO:tasks.workunit.client.0.smithi107.stdout:1/562: dwrite d0/d29/d31/f42 [0,4194304] 0 2024-09-21T08:02:48.274 INFO:tasks.workunit.client.0.smithi107.stdout:1/563: chown d0/d19/d2b/d4b 556079 1 2024-09-21T08:02:48.277 INFO:tasks.workunit.client.0.smithi107.stdout:4/584: dwrite dc/d13/f3e [0,4194304] 0 2024-09-21T08:02:48.277 INFO:tasks.workunit.client.0.smithi107.stdout:4/585: read - dc/d13/d83/d8a/fa2 zero size 2024-09-21T08:02:48.277 INFO:tasks.workunit.client.0.smithi107.stdout:4/586: chown dc/d13/d83/d90/l7d 311673 1 2024-09-21T08:02:48.277 INFO:tasks.workunit.client.0.smithi107.stdout:4/587: fdatasync dc/d13/d83/d8a/fa2 0 2024-09-21T08:02:48.278 INFO:tasks.workunit.client.0.smithi107.stdout:6/675: mkdir d2/d3/d7/d48/da3/dda 0 2024-09-21T08:02:48.278 INFO:tasks.workunit.client.0.smithi107.stdout:6/676: chown d2/d3/d7/d24/l5a 30633569 1 2024-09-21T08:02:48.278 INFO:tasks.workunit.client.0.smithi107.stdout:6/677: fsync d2/d2e/d97/f88 0 2024-09-21T08:02:48.279 INFO:tasks.workunit.client.0.smithi107.stdout:2/559: dwrite d1/d2/d6d/d37/d49/d7f/f99 [0,4194304] 0 2024-09-21T08:02:48.280 INFO:tasks.workunit.client.0.smithi107.stdout:1/564: mknod d0/d29/d4d/d84/cbd 0 2024-09-21T08:02:48.284 INFO:tasks.workunit.client.0.smithi107.stdout:7/481: dwrite d7/d18/f36 [4194304,4194304] 0 2024-09-21T08:02:48.286 INFO:tasks.workunit.client.0.smithi107.stdout:6/678: mknod d2/d3/d7/d48/da3/d85/d9d/dcf/cdb 0 2024-09-21T08:02:48.286 INFO:tasks.workunit.client.0.smithi107.stdout:0/533: dwrite d1/d5/f48 [0,4194304] 0 2024-09-21T08:02:48.287 INFO:tasks.workunit.client.0.smithi107.stdout:8/503: sync 2024-09-21T08:02:48.287 INFO:tasks.workunit.client.0.smithi107.stdout:5/696: sync 2024-09-21T08:02:48.287 INFO:tasks.workunit.client.0.smithi107.stdout:5/697: chown d7/de/d35/c7d 14858 1 2024-09-21T08:02:48.287 INFO:tasks.workunit.client.0.smithi107.stdout:5/698: fdatasync d7/de/fc8 0 2024-09-21T08:02:48.289 INFO:tasks.workunit.client.0.smithi107.stdout:2/560: symlink d1/d6/d9e/lbe 0 2024-09-21T08:02:48.290 INFO:tasks.workunit.client.0.smithi107.stdout:1/565: rename d0/d19/d39/l7f to d0/lbe 0 2024-09-21T08:02:48.290 INFO:tasks.workunit.client.0.smithi107.stdout:1/566: write d0/d29/f5c [3657231,102629] 0 2024-09-21T08:02:48.290 INFO:tasks.workunit.client.0.smithi107.stdout:1/567: dread - d0/d19/d2b/d4b/d44/d55/d64/f9c zero size 2024-09-21T08:02:48.292 INFO:tasks.workunit.client.0.smithi107.stdout:6/679: symlink d2/d2e/db2/ldc 0 2024-09-21T08:02:48.293 INFO:tasks.workunit.client.0.smithi107.stdout:5/699: dread d7/de/d2d/d5d/fa1 [0,4194304] 0 2024-09-21T08:02:48.294 INFO:tasks.workunit.client.0.smithi107.stdout:8/504: symlink d5/d1d/d90/lac 0 2024-09-21T08:02:48.294 INFO:tasks.workunit.client.0.smithi107.stdout:2/561: symlink d1/d1e/lbf 0 2024-09-21T08:02:48.296 INFO:tasks.workunit.client.0.smithi107.stdout:1/568: mknod d0/d80/cbf 0 2024-09-21T08:02:48.296 INFO:tasks.workunit.client.0.smithi107.stdout:1/569: chown d0/d29/l67 5 1 2024-09-21T08:02:48.296 INFO:tasks.workunit.client.0.smithi107.stdout:1/570: chown d0/d19/d59 96378247 1 2024-09-21T08:02:48.299 INFO:tasks.workunit.client.0.smithi107.stdout:5/700: link d7/de/c12 d7/de/da3/cf5 0 2024-09-21T08:02:48.301 INFO:tasks.workunit.client.0.smithi107.stdout:1/571: rmdir d0/d29/d4d/d84/d8c 0 2024-09-21T08:02:48.303 INFO:tasks.workunit.client.0.smithi107.stdout:5/701: creat d7/de/d52/d8b/ff6 x:0 0 0 2024-09-21T08:02:48.304 INFO:tasks.workunit.client.0.smithi107.stdout:5/702: write d7/de/d1d/d24/f4f [986859,30952] 0 2024-09-21T08:02:48.308 INFO:tasks.workunit.client.0.smithi107.stdout:0/534: write d1/d5/d25/d3d/d20/f53 [1472074,94129] 0 2024-09-21T08:02:48.313 INFO:tasks.workunit.client.0.smithi107.stdout:9/737: dwrite d11/d27/d2f/f5a [0,4194304] 0 2024-09-21T08:02:48.328 INFO:tasks.workunit.client.0.smithi107.stdout:4/588: dwrite dc/d64/f79 [0,4194304] 0 2024-09-21T08:02:48.328 INFO:tasks.workunit.client.0.smithi107.stdout:0/535: dread d1/d5/d25/d3d/d20/f51 [0,4194304] 0 2024-09-21T08:02:48.328 INFO:tasks.workunit.client.0.smithi107.stdout:4/589: read dc/d13/d40/d46/f6c [261213,86929] 0 2024-09-21T08:02:48.329 INFO:tasks.workunit.client.0.smithi107.stdout:0/536: mknod d1/cb4 0 2024-09-21T08:02:48.330 INFO:tasks.workunit.client.0.smithi107.stdout:4/590: rename dc/d13/d40/d5e/d77/f89 to dc/d13/d40/d5e/d77/d99/daa/fb4 0 2024-09-21T08:02:48.331 INFO:tasks.workunit.client.0.smithi107.stdout:0/537: getdents d1/d5/d25/d9e 0 2024-09-21T08:02:48.333 INFO:tasks.workunit.client.0.smithi107.stdout:0/538: getdents d1/d5/d25/d2d/d8e 0 2024-09-21T08:02:48.333 INFO:tasks.workunit.client.0.smithi107.stdout:0/539: dread - d1/d5/d25/d3d/d20/f6c zero size 2024-09-21T08:02:48.333 INFO:tasks.workunit.client.0.smithi107.stdout:0/540: creat d1/d5/d25/d3d/fb5 x:0 0 0 2024-09-21T08:02:48.333 INFO:tasks.workunit.client.0.smithi107.stdout:0/541: chown d1/d5/d25/d3d/d20/c54 740632 1 2024-09-21T08:02:48.333 INFO:tasks.workunit.client.0.smithi107.stdout:0/542: rename d1 to d1/d5/d25/d3d/d20/d85/da8/db6 22 2024-09-21T08:02:48.338 INFO:tasks.workunit.client.0.smithi107.stdout:7/482: dwrite d7/d10/f1d [0,4194304] 0 2024-09-21T08:02:48.344 INFO:tasks.workunit.client.0.smithi107.stdout:8/505: dwrite d5/d2e/d89/f92 [0,4194304] 0 2024-09-21T08:02:48.344 INFO:tasks.workunit.client.0.smithi107.stdout:8/506: read - d5/d38/f3f zero size 2024-09-21T08:02:48.346 INFO:tasks.workunit.client.0.smithi107.stdout:4/591: dread dc/d13/f18 [0,4194304] 0 2024-09-21T08:02:48.347 INFO:tasks.workunit.client.0.smithi107.stdout:4/592: mknod dc/d13/d5a/cb5 0 2024-09-21T08:02:48.347 INFO:tasks.workunit.client.0.smithi107.stdout:4/593: chown dc/f31 3258394 1 2024-09-21T08:02:48.354 INFO:tasks.workunit.client.0.smithi107.stdout:6/680: dwrite d2/fd [4194304,4194304] 0 2024-09-21T08:02:48.366 INFO:tasks.workunit.client.0.smithi107.stdout:5/703: dwrite d7/de/da3/fdf [0,4194304] 0 2024-09-21T08:02:48.366 INFO:tasks.workunit.client.0.smithi107.stdout:5/704: stat d7/de/d1d/d24/fae 0 2024-09-21T08:02:48.368 INFO:tasks.workunit.client.0.smithi107.stdout:5/705: mkdir d7/de/d1d/d29/d68/ddb/dde/df7 0 2024-09-21T08:02:48.368 INFO:tasks.workunit.client.0.smithi107.stdout:5/706: write d7/de/d1d/d24/f6e [1072091,32662] 0 2024-09-21T08:02:48.368 INFO:tasks.workunit.client.0.smithi107.stdout:5/707: fdatasync d7/de/f99 0 2024-09-21T08:02:48.368 INFO:tasks.workunit.client.0.smithi107.stdout:5/708: dread - d7/de/da3/fe8 zero size 2024-09-21T08:02:48.380 INFO:tasks.workunit.client.0.smithi107.stdout:5/709: dread d7/d70/fd0 [0,4194304] 0 2024-09-21T08:02:48.380 INFO:tasks.workunit.client.0.smithi107.stdout:5/710: dread - d7/de/d1d/fb6 zero size 2024-09-21T08:02:48.382 INFO:tasks.workunit.client.0.smithi107.stdout:9/738: dwrite d11/d24/d35/f49 [0,4194304] 0 2024-09-21T08:02:48.382 INFO:tasks.workunit.client.0.smithi107.stdout:9/739: dread - d11/d27/d5e/d76/f50 zero size 2024-09-21T08:02:48.383 INFO:tasks.workunit.client.0.smithi107.stdout:1/572: dwrite d0/d29/d2c/f2e [0,4194304] 0 2024-09-21T08:02:48.383 INFO:tasks.workunit.client.0.smithi107.stdout:0/543: dwrite d1/d5/d25/f4e [0,4194304] 0 2024-09-21T08:02:48.383 INFO:tasks.workunit.client.0.smithi107.stdout:0/544: creat d1/d5/d25/d3d/d20/d85/d8a/fb7 x:0 0 0 2024-09-21T08:02:48.384 INFO:tasks.workunit.client.0.smithi107.stdout:0/545: read d1/d5/f67 [110347,85453] 0 2024-09-21T08:02:48.384 INFO:tasks.workunit.client.0.smithi107.stdout:0/546: dread - d1/d5/d25/f9f zero size 2024-09-21T08:02:48.384 INFO:tasks.workunit.client.0.smithi107.stdout:4/594: dwrite dc/d13/d40/f52 [4194304,4194304] 0 2024-09-21T08:02:48.385 INFO:tasks.workunit.client.0.smithi107.stdout:4/595: fsync dc/d60/f8b 0 2024-09-21T08:02:48.385 INFO:tasks.workunit.client.0.smithi107.stdout:8/507: dwrite d5/d23/f57 [0,4194304] 0 2024-09-21T08:02:48.385 INFO:tasks.workunit.client.0.smithi107.stdout:6/681: dwrite d2/d3/d7/fb7 [0,4194304] 0 2024-09-21T08:02:48.388 INFO:tasks.workunit.client.0.smithi107.stdout:1/573: mkdir d0/d19/d2b/d4b/d61/d75/dc0 0 2024-09-21T08:02:48.394 INFO:tasks.workunit.client.0.smithi107.stdout:0/547: dread d1/d5/d25/d3d/d20/d29/d55/d7a/f95 [0,4194304] 0 2024-09-21T08:02:48.394 INFO:tasks.workunit.client.0.smithi107.stdout:0/548: stat d1/d6f 0 2024-09-21T08:02:48.396 INFO:tasks.workunit.client.0.smithi107.stdout:4/596: creat dc/d13/d40/d5e/d6e/fb6 x:0 0 0 2024-09-21T08:02:48.396 INFO:tasks.workunit.client.0.smithi107.stdout:4/597: creat dc/d13/d40/d5e/d77/fb7 x:0 0 0 2024-09-21T08:02:48.396 INFO:tasks.workunit.client.0.smithi107.stdout:4/598: write dc/d13/d5a/fae [5840886,96304] 0 2024-09-21T08:02:48.398 INFO:tasks.workunit.client.0.smithi107.stdout:8/508: dread d5/d1d/f1e [0,4194304] 0 2024-09-21T08:02:48.401 INFO:tasks.workunit.client.0.smithi107.stdout:5/711: dwrite d7/de/f1b [0,4194304] 0 2024-09-21T08:02:48.401 INFO:tasks.workunit.client.0.smithi107.stdout:5/712: dread - d7/fec zero size 2024-09-21T08:02:48.402 INFO:tasks.workunit.client.0.smithi107.stdout:1/574: symlink d0/d19/d2b/d86/lc1 0 2024-09-21T08:02:48.405 INFO:tasks.workunit.client.0.smithi107.stdout:8/509: link d5/d23/c36 d5/d2e/cad 0 2024-09-21T08:02:48.406 INFO:tasks.workunit.client.0.smithi107.stdout:6/682: link d2/d3/d7/l16 d2/d3/d7/d48/da3/d85/d9b/ldd 0 2024-09-21T08:02:48.409 INFO:tasks.workunit.client.0.smithi107.stdout:5/713: creat d7/de/d1d/d29/d68/ddb/dde/dd8/ff8 x:0 0 0 2024-09-21T08:02:48.411 INFO:tasks.workunit.client.0.smithi107.stdout:1/575: mkdir d0/d19/d2b/d86/dc2 0 2024-09-21T08:02:48.413 INFO:tasks.workunit.client.0.smithi107.stdout:8/510: creat d5/d38/d56/d54/fae x:0 0 0 2024-09-21T08:02:48.414 INFO:tasks.workunit.client.0.smithi107.stdout:6/683: rename d2/d2e/c40 to d2/cde 0 2024-09-21T08:02:48.414 INFO:tasks.workunit.client.0.smithi107.stdout:6/684: chown d2/d3/d7/d48/da3/d85/d9d/dcf/cdb 3 1 2024-09-21T08:02:48.414 INFO:tasks.workunit.client.0.smithi107.stdout:6/685: creat d2/d3/d7/d23/d2b/fdf x:0 0 0 2024-09-21T08:02:48.416 INFO:tasks.workunit.client.0.smithi107.stdout:5/714: mknod d7/de/d1d/d29/d64/cf9 0 2024-09-21T08:02:48.421 INFO:tasks.workunit.client.0.smithi107.stdout:8/511: mkdir d5/d2e/d94/daf 0 2024-09-21T08:02:48.421 INFO:tasks.workunit.client.0.smithi107.stdout:8/512: fdatasync d5/f14 0 2024-09-21T08:02:48.421 INFO:tasks.workunit.client.0.smithi107.stdout:8/513: write d5/d1d/f4d [4795891,75226] 0 2024-09-21T08:02:48.424 INFO:tasks.workunit.client.0.smithi107.stdout:6/686: rename d2/d3/d7/d23/d2b/f74 to d2/d3/fe0 0 2024-09-21T08:02:48.424 INFO:tasks.workunit.client.0.smithi107.stdout:0/549: dwrite d1/d5/d25/d3d/f92 [0,4194304] 0 2024-09-21T08:02:48.424 INFO:tasks.workunit.client.0.smithi107.stdout:0/550: chown d1/d5/d25/d9e/fa4 31018 1 2024-09-21T08:02:48.424 INFO:tasks.workunit.client.0.smithi107.stdout:5/715: mkdir d7/de/d1d/d24/d3d/dfa 0 2024-09-21T08:02:48.425 INFO:tasks.workunit.client.0.smithi107.stdout:6/687: truncate d2/d3/d7/f11 2152645 0 2024-09-21T08:02:48.425 INFO:tasks.workunit.client.0.smithi107.stdout:4/599: dwrite dc/d13/d40/d5e/d77/fa9 [0,4194304] 0 2024-09-21T08:02:48.428 INFO:tasks.workunit.client.0.smithi107.stdout:5/716: creat d7/de/d52/ffb x:0 0 0 2024-09-21T08:02:48.428 INFO:tasks.workunit.client.0.smithi107.stdout:5/717: chown d7/de/d52/d8b 3786 1 2024-09-21T08:02:48.428 INFO:tasks.workunit.client.0.smithi107.stdout:6/688: mknod d2/d3/d7/d48/da3/d85/d9b/db6/ce1 0 2024-09-21T08:02:48.432 INFO:tasks.workunit.client.0.smithi107.stdout:6/689: rename d2/d3/d7/d54/lc4 to d2/d3/le2 0 2024-09-21T08:02:48.433 INFO:tasks.workunit.client.0.smithi107.stdout:5/718: getdents d7/de/d2d/d5d/d60/dc5 0 2024-09-21T08:02:48.434 INFO:tasks.workunit.client.0.smithi107.stdout:0/551: write d1/d5/d25/d3d/f1d [2324176,77859] 0 2024-09-21T08:02:48.435 INFO:tasks.workunit.client.0.smithi107.stdout:6/690: mknod d2/d3/d7/d24/d41/ce3 0 2024-09-21T08:02:48.437 INFO:tasks.workunit.client.0.smithi107.stdout:5/719: mkdir d7/de/d1d/d29/dfc 0 2024-09-21T08:02:48.438 INFO:tasks.workunit.client.0.smithi107.stdout:5/720: dread - d7/de/d1d/d29/fc3 zero size 2024-09-21T08:02:48.439 INFO:tasks.workunit.client.0.smithi107.stdout:6/691: mkdir d2/d3/d7/d48/da3/d85/dd9/de4 0 2024-09-21T08:02:48.440 INFO:tasks.workunit.client.0.smithi107.stdout:4/600: write dc/d13/f5d [3539429,21558] 0 2024-09-21T08:02:48.441 INFO:tasks.workunit.client.0.smithi107.stdout:1/576: dwrite d0/f2 [0,4194304] 0 2024-09-21T08:02:48.441 INFO:tasks.workunit.client.0.smithi107.stdout:5/721: creat d7/de/d2d/d5d/d60/dc5/ffd x:0 0 0 2024-09-21T08:02:48.441 INFO:tasks.workunit.client.0.smithi107.stdout:5/722: write d7/d70/fe6 [651355,12780] 0 2024-09-21T08:02:48.442 INFO:tasks.workunit.client.0.smithi107.stdout:5/723: readlink d7/de/d1d/d29/d68/ddb/dde/lab 0 2024-09-21T08:02:48.442 INFO:tasks.workunit.client.0.smithi107.stdout:6/692: mknod d2/d3/d7/d54/dae/ce5 0 2024-09-21T08:02:48.446 INFO:tasks.workunit.client.0.smithi107.stdout:4/601: mkdir dc/d13/d83/d90/db2/db8 0 2024-09-21T08:02:48.454 INFO:tasks.workunit.client.0.smithi107.stdout:1/577: unlink d0/d29/d2c/f2e 0 2024-09-21T08:02:48.454 INFO:tasks.workunit.client.0.smithi107.stdout:1/578: fsync d0/d19/f3b 0 2024-09-21T08:02:48.455 INFO:tasks.workunit.client.0.smithi107.stdout:6/693: dread d2/d3/d7/d2a/f51 [0,4194304] 0 2024-09-21T08:02:48.455 INFO:tasks.workunit.client.0.smithi107.stdout:6/694: chown d2/d3/d7/d23/l6d 126012919 1 2024-09-21T08:02:48.455 INFO:tasks.workunit.client.0.smithi107.stdout:6/695: dread - d2/d2e/fbd zero size 2024-09-21T08:02:48.455 INFO:tasks.workunit.client.0.smithi107.stdout:6/696: chown d2/d3/d7/d54/l82 1 1 2024-09-21T08:02:48.459 INFO:tasks.workunit.client.0.smithi107.stdout:5/724: creat d7/de/d1d/d29/d68/de9/ffe x:0 0 0 2024-09-21T08:02:48.459 INFO:tasks.workunit.client.0.smithi107.stdout:5/725: truncate d7/f6d 5236219 0 2024-09-21T08:02:48.462 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:48 smithi107 ceph-mon[27622]: Updating smithi129:/etc/ceph/ceph.client.admin.keyring 2024-09-21T08:02:48.462 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:48 smithi107 ceph-mon[27622]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-09-21T08:02:48.462 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:48 smithi107 ceph-mon[27622]: Updating smithi129:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T08:02:48.462 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:48 smithi107 ceph-mon[27622]: Updating smithi107:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T08:02:48.462 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:48 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:48.462 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:48 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:48.462 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:48 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:48.462 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:48 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:48.462 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:48 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:48.462 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:48 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:48.462 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:48 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:48.463 INFO:tasks.workunit.client.0.smithi107.stdout:1/579: mkdir d0/d29/d4d/d84/dc3 0 2024-09-21T08:02:48.463 INFO:tasks.workunit.client.0.smithi107.stdout:1/580: creat d0/d19/fc4 x:0 0 0 2024-09-21T08:02:48.474 INFO:tasks.workunit.client.0.smithi107.stdout:5/726: write d7/de/f99 [3514219,104031] 0 2024-09-21T08:02:48.475 INFO:tasks.workunit.client.0.smithi107.stdout:5/727: mkdir d7/de/d1d/d29/d68/ddb/dde/dd8/dff 0 2024-09-21T08:02:48.476 INFO:tasks.workunit.client.0.smithi107.stdout:5/728: truncate d7/de/d1d/d24/fae 510886 0 2024-09-21T08:02:48.476 INFO:tasks.workunit.client.0.smithi107.stdout:5/729: mkdir d7/de/d1d/d29/d64/d100 0 2024-09-21T08:02:48.477 INFO:tasks.workunit.client.0.smithi107.stdout:5/730: stat d7/de/d52/d6b/f92 0 2024-09-21T08:02:48.478 INFO:tasks.workunit.client.0.smithi107.stdout:5/731: mknod d7/d70/c101 0 2024-09-21T08:02:48.478 INFO:tasks.workunit.client.0.smithi107.stdout:5/732: write d7/d70/ff2 [771926,91573] 0 2024-09-21T08:02:48.479 INFO:tasks.workunit.client.0.smithi107.stdout:5/733: symlink d7/de/d1d/d29/d68/de9/l102 0 2024-09-21T08:02:48.479 INFO:tasks.workunit.client.0.smithi107.stdout:5/734: write d7/de/da3/fe8 [638052,123537] 0 2024-09-21T08:02:48.479 INFO:tasks.workunit.client.0.smithi107.stdout:5/735: chown d7/de/d1d/d24/c2f 0 1 2024-09-21T08:02:48.479 INFO:tasks.workunit.client.0.smithi107.stdout:5/736: fdatasync d7/de/d1d/dbc/fc9 0 2024-09-21T08:02:48.480 INFO:tasks.workunit.client.0.smithi107.stdout:5/737: rename d7/de/da3/fdf to d7/de/d52/d8b/f103 0 2024-09-21T08:02:48.509 INFO:tasks.workunit.client.0.smithi107.stdout:8/514: dwrite d5/d1d/f4d [4194304,4194304] 0 2024-09-21T08:02:48.509 INFO:tasks.workunit.client.0.smithi107.stdout:0/552: dwrite d1/d5/d25/fa6 [8388608,4194304] 0 2024-09-21T08:02:48.512 INFO:tasks.workunit.client.0.smithi107.stdout:8/515: creat d5/d44/d5d/fb0 x:0 0 0 2024-09-21T08:02:48.514 INFO:tasks.workunit.client.0.smithi107.stdout:0/553: unlink d1/d23/l47 0 2024-09-21T08:02:48.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:48 smithi129 ceph-mon[34472]: Updating smithi129:/etc/ceph/ceph.client.admin.keyring 2024-09-21T08:02:48.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:48 smithi129 ceph-mon[34472]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-09-21T08:02:48.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:48 smithi129 ceph-mon[34472]: Updating smithi129:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T08:02:48.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:48 smithi129 ceph-mon[34472]: Updating smithi107:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T08:02:48.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:48 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:48.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:48 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:48.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:48 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:48.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:48 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:48.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:48 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:48.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:48 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:48.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:48 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:48.518 INFO:tasks.workunit.client.0.smithi107.stdout:0/554: mknod d1/d5/d25/d9e/cb8 0 2024-09-21T08:02:48.518 INFO:tasks.workunit.client.0.smithi107.stdout:1/581: dwrite d0/d19/d59/f6f [0,4194304] 0 2024-09-21T08:02:48.518 INFO:tasks.workunit.client.0.smithi107.stdout:4/602: dwrite dc/d13/d83/d8a/fa2 [0,4194304] 0 2024-09-21T08:02:48.520 INFO:tasks.workunit.client.0.smithi107.stdout:6/697: dwrite d2/d3/d7/f9c [0,4194304] 0 2024-09-21T08:02:48.520 INFO:tasks.workunit.client.0.smithi107.stdout:5/738: dwrite d7/de/f30 [0,4194304] 0 2024-09-21T08:02:48.520 INFO:tasks.workunit.client.0.smithi107.stdout:5/739: fdatasync d7/de/d2d/d5d/d60/fb8 0 2024-09-21T08:02:48.523 INFO:tasks.workunit.client.0.smithi107.stdout:1/582: rename d0/d19/d2b/d4b/d1c to d0/d29/d4d/d84/dc5 0 2024-09-21T08:02:48.531 INFO:tasks.workunit.client.0.smithi107.stdout:0/555: write d1/d5/d25/d3d/d20/d29/f2e [2620605,10941] 0 2024-09-21T08:02:48.531 INFO:tasks.workunit.client.0.smithi107.stdout:0/556: readlink d1/d5/d25/d2d/l60 0 2024-09-21T08:02:48.570 INFO:tasks.workunit.client.0.smithi107.stdout:5/740: mknod d7/de/d1d/d29/d68/ddb/dde/dcc/c104 0 2024-09-21T08:02:48.571 INFO:tasks.workunit.client.0.smithi107.stdout:8/516: dwrite d5/d1d/f4d [4194304,4194304] 0 2024-09-21T08:02:48.571 INFO:tasks.workunit.client.0.smithi107.stdout:8/517: readlink d5/d1d/d90/lac 0 2024-09-21T08:02:48.582 INFO:tasks.workunit.client.0.smithi107.stdout:6/698: mknod d2/d3/d7/ce6 0 2024-09-21T08:02:48.583 INFO:tasks.workunit.client.0.smithi107.stdout:5/741: mkdir d7/de/d1d/d29/d68/ddb/dde/dd8/d105 0 2024-09-21T08:02:48.584 INFO:tasks.workunit.client.0.smithi107.stdout:1/583: truncate d0/f3 3478779 0 2024-09-21T08:02:48.585 INFO:tasks.workunit.client.0.smithi107.stdout:4/603: dwrite dc/d13/d5a/f78 [0,4194304] 0 2024-09-21T08:02:48.585 INFO:tasks.workunit.client.0.smithi107.stdout:0/557: dwrite d1/d5/d25/f4d [0,4194304] 0 2024-09-21T08:02:48.585 INFO:tasks.workunit.client.0.smithi107.stdout:0/558: write d1/d5/d25/f9f [679383,96677] 0 2024-09-21T08:02:48.586 INFO:tasks.workunit.client.0.smithi107.stdout:6/699: dread d2/d3/d7/d3f/f7b [0,4194304] 0 2024-09-21T08:02:48.586 INFO:tasks.workunit.client.0.smithi107.stdout:1/584: read d0/d19/d2b/d4b/f63 [487742,49026] 0 2024-09-21T08:02:48.586 INFO:tasks.workunit.client.0.smithi107.stdout:8/518: creat d5/d1d/fb1 x:0 0 0 2024-09-21T08:02:48.586 INFO:tasks.workunit.client.0.smithi107.stdout:8/519: chown d5/f8e 389638 1 2024-09-21T08:02:48.586 INFO:tasks.workunit.client.0.smithi107.stdout:8/520: fdatasync d5/f19 0 2024-09-21T08:02:48.588 INFO:tasks.workunit.client.0.smithi107.stdout:5/742: mkdir d7/de/d52/d6b/d106 0 2024-09-21T08:02:48.590 INFO:tasks.workunit.client.0.smithi107.stdout:4/604: symlink dc/d60/lb9 0 2024-09-21T08:02:48.590 INFO:tasks.workunit.client.0.smithi107.stdout:4/605: creat dc/d13/d40/d5e/d6e/fba x:0 0 0 2024-09-21T08:02:48.590 INFO:tasks.workunit.client.0.smithi107.stdout:4/606: creat dc/d13/d40/d80/fbb x:0 0 0 2024-09-21T08:02:48.591 INFO:tasks.workunit.client.0.smithi107.stdout:8/521: mknod d5/d2e/dab/cb2 0 2024-09-21T08:02:48.595 INFO:tasks.workunit.client.0.smithi107.stdout:5/743: mknod d7/de/d2d/d5d/c107 0 2024-09-21T08:02:48.599 INFO:tasks.workunit.client.0.smithi107.stdout:8/522: truncate d5/f14 1989272 0 2024-09-21T08:02:48.599 INFO:tasks.workunit.client.0.smithi107.stdout:8/523: write d5/d2e/d89/f92 [5064289,75836] 0 2024-09-21T08:02:48.601 INFO:tasks.workunit.client.0.smithi107.stdout:0/559: dread d1/d5/d25/d3d/f92 [0,4194304] 0 2024-09-21T08:02:48.602 INFO:tasks.workunit.client.0.smithi107.stdout:0/560: creat d1/d5/d25/fb9 x:0 0 0 2024-09-21T08:02:48.615 INFO:tasks.workunit.client.0.smithi107.stdout:8/524: write d5/d44/d5d/f68 [3489966,12352] 0 2024-09-21T08:02:48.618 INFO:tasks.workunit.client.0.smithi107.stdout:8/525: creat d5/d38/fb3 x:0 0 0 2024-09-21T08:02:48.618 INFO:tasks.workunit.client.0.smithi107.stdout:8/526: write d5/d2e/d7c/d9a/f6a [1030913,122590] 0 2024-09-21T08:02:48.620 INFO:tasks.workunit.client.0.smithi107.stdout:8/527: link d5/f14 d5/d2e/d7c/d9a/d98/fb4 0 2024-09-21T08:02:48.621 INFO:tasks.workunit.client.0.smithi107.stdout:8/528: symlink d5/d2e/d7c/lb5 0 2024-09-21T08:02:48.622 INFO:tasks.workunit.client.0.smithi107.stdout:8/529: truncate d5/d23/f2f 1195746 0 2024-09-21T08:02:48.622 INFO:tasks.workunit.client.0.smithi107.stdout:8/530: chown d5/d44/l81 0 1 2024-09-21T08:02:48.624 INFO:tasks.workunit.client.0.smithi107.stdout:8/531: creat d5/d44/d47/d5e/fb6 x:0 0 0 2024-09-21T08:02:48.625 INFO:tasks.workunit.client.0.smithi107.stdout:8/532: mkdir d5/d44/db7 0 2024-09-21T08:02:48.626 INFO:tasks.workunit.client.0.smithi107.stdout:8/533: symlink d5/lb8 0 2024-09-21T08:02:48.633 INFO:tasks.workunit.client.0.smithi107.stdout:5/744: write d7/de/d1d/fbb [3763515,114516] 0 2024-09-21T08:02:48.639 INFO:tasks.workunit.client.0.smithi107.stdout:1/585: dwrite d0/d19/d2b/f8b [0,4194304] 0 2024-09-21T08:02:48.643 INFO:tasks.workunit.client.0.smithi107.stdout:6/700: dwrite d2/d3/d7/d24/f59 [0,4194304] 0 2024-09-21T08:02:48.643 INFO:tasks.workunit.client.0.smithi107.stdout:0/561: dwrite d1/d5/d25/f9f [0,4194304] 0 2024-09-21T08:02:48.643 INFO:tasks.workunit.client.0.smithi107.stdout:0/562: dread - d1/d5/d25/d3d/fb5 zero size 2024-09-21T08:02:48.643 INFO:tasks.workunit.client.0.smithi107.stdout:1/586: truncate d0/d29/d31/f42 6812739 0 2024-09-21T08:02:48.653 INFO:tasks.workunit.client.0.smithi107.stdout:6/701: truncate d2/d3/d7/d24/d41/d50/f57 309583 0 2024-09-21T08:02:48.653 INFO:tasks.workunit.client.0.smithi107.stdout:6/702: readlink d2/d3/d7/d79/l7c 0 2024-09-21T08:02:48.653 INFO:tasks.workunit.client.0.smithi107.stdout:0/563: readlink d1/d5/l68 0 2024-09-21T08:02:48.653 INFO:tasks.workunit.client.0.smithi107.stdout:4/607: dwrite dc/d60/fab [0,4194304] 0 2024-09-21T08:02:48.655 INFO:tasks.workunit.client.0.smithi107.stdout:6/703: unlink d2/d3/d7/d48/da3/f9f 0 2024-09-21T08:02:48.656 INFO:tasks.workunit.client.0.smithi107.stdout:0/564: mknod d1/d23/d61/cba 0 2024-09-21T08:02:48.657 INFO:tasks.workunit.client.0.smithi107.stdout:4/608: truncate dc/f2c 187657 0 2024-09-21T08:02:48.657 INFO:tasks.workunit.client.0.smithi107.stdout:4/609: chown dc/d13/d40/d5e/da8 17762618 1 2024-09-21T08:02:48.659 INFO:tasks.workunit.client.0.smithi107.stdout:4/610: mkdir dc/d13/d5a/d9b/dbc 0 2024-09-21T08:02:48.659 INFO:tasks.workunit.client.0.smithi107.stdout:4/611: symlink dc/d13/d5a/d9b/dbc/lbd 0 2024-09-21T08:02:48.660 INFO:tasks.workunit.client.0.smithi107.stdout:4/612: mkdir dc/d13/d40/d5e/d98/dbe 0 2024-09-21T08:02:48.662 INFO:tasks.workunit.client.0.smithi107.stdout:4/613: getdents dc/d13/d40/d5e/d6e 0 2024-09-21T08:02:48.662 INFO:tasks.workunit.client.0.smithi107.stdout:4/614: stat dc/d13/d5a/c66 0 2024-09-21T08:02:48.664 INFO:tasks.workunit.client.0.smithi107.stdout:8/534: dwrite d5/d38/d56/d52/f8f [0,4194304] 0 2024-09-21T08:02:48.664 INFO:tasks.workunit.client.0.smithi107.stdout:5/745: dwrite d7/d70/fca [0,4194304] 0 2024-09-21T08:02:48.669 INFO:tasks.workunit.client.0.smithi107.stdout:5/746: symlink d7/de/d1d/d29/d64/d100/l108 0 2024-09-21T08:02:48.672 INFO:tasks.workunit.client.0.smithi107.stdout:5/747: creat d7/de/d1d/d24/d3d/dfa/f109 x:0 0 0 2024-09-21T08:02:48.674 INFO:tasks.workunit.client.0.smithi107.stdout:5/748: creat d7/de/d1d/dbc/f10a x:0 0 0 2024-09-21T08:02:48.674 INFO:tasks.workunit.client.0.smithi107.stdout:5/749: creat d7/de/d1d/f10b x:0 0 0 2024-09-21T08:02:48.685 INFO:tasks.workunit.client.0.smithi107.stdout:8/535: dwrite d5/d38/d67/d7d/d91/fa6 [0,4194304] 0 2024-09-21T08:02:48.685 INFO:tasks.workunit.client.0.smithi107.stdout:8/536: truncate d5/f8e 44931 0 2024-09-21T08:02:48.697 INFO:tasks.workunit.client.0.smithi107.stdout:1/587: write d0/d29/d31/f42 [338892,110395] 0 2024-09-21T08:02:48.698 INFO:tasks.workunit.client.0.smithi107.stdout:3/637: sync 2024-09-21T08:02:48.698 INFO:tasks.workunit.client.0.smithi107.stdout:7/483: sync 2024-09-21T08:02:48.698 INFO:tasks.workunit.client.0.smithi107.stdout:2/562: sync 2024-09-21T08:02:48.698 INFO:tasks.workunit.client.0.smithi107.stdout:9/740: sync 2024-09-21T08:02:48.700 INFO:tasks.workunit.client.0.smithi107.stdout:6/704: rename d2/d3/d7/d24/d41/d50/f57 to d2/fe7 0 2024-09-21T08:02:48.702 INFO:tasks.workunit.client.0.smithi107.stdout:7/484: symlink d7/d10/d64/laa 0 2024-09-21T08:02:48.704 INFO:tasks.workunit.client.0.smithi107.stdout:3/638: write d8/f13 [421448,19817] 0 2024-09-21T08:02:48.704 INFO:tasks.workunit.client.0.smithi107.stdout:5/750: dwrite d7/de/d1d/fbb [0,4194304] 0 2024-09-21T08:02:48.714 INFO:tasks.workunit.client.0.smithi107.stdout:6/705: mknod d2/d3/d7/d48/da3/d85/dd9/ce8 0 2024-09-21T08:02:48.717 INFO:tasks.workunit.client.0.smithi107.stdout:9/741: dwrite d11/d24/d4a/f75 [0,4194304] 0 2024-09-21T08:02:48.717 INFO:tasks.workunit.client.0.smithi107.stdout:9/742: fdatasync d11/d24/d4a/f75 0 2024-09-21T08:02:48.717 INFO:tasks.workunit.client.0.smithi107.stdout:9/743: write d11/d27/d2f/d38/daa/ffd [1968859,114264] 0 2024-09-21T08:02:48.717 INFO:tasks.workunit.client.0.smithi107.stdout:4/615: truncate dc/d60/fab 2277928 0 2024-09-21T08:02:48.718 INFO:tasks.workunit.client.0.smithi107.stdout:7/485: symlink d7/d22/d3a/d49/d56/lab 0 2024-09-21T08:02:48.721 INFO:tasks.workunit.client.0.smithi107.stdout:3/639: link d8/ld d8/d2b/d52/d55/le1 0 2024-09-21T08:02:48.723 INFO:tasks.workunit.client.0.smithi107.stdout:5/751: unlink d7/de/d1d/f48 0 2024-09-21T08:02:48.723 INFO:tasks.workunit.client.0.smithi107.stdout:5/752: fsync d7/de/f30 0 2024-09-21T08:02:48.727 INFO:tasks.workunit.client.0.smithi107.stdout:6/706: mkdir d2/d3/d7/d23/de9 0 2024-09-21T08:02:48.727 INFO:tasks.workunit.client.0.smithi107.stdout:4/616: write dc/d13/d40/d5e/d77/fa0 [3383260,117392] 0 2024-09-21T08:02:48.730 INFO:tasks.workunit.client.0.smithi107.stdout:0/565: rename d1/d5/d25/f99 to d1/d5/fbb 0 2024-09-21T08:02:48.734 INFO:tasks.workunit.client.0.smithi107.stdout:7/486: mknod d7/d22/d3d/cac 0 2024-09-21T08:02:48.738 INFO:tasks.workunit.client.0.smithi107.stdout:5/753: link d7/de/d1d/d24/f46 d7/de/d1d/dbc/f10c 0 2024-09-21T08:02:48.738 INFO:tasks.workunit.client.0.smithi107.stdout:5/754: fdatasync d7/d70/ff2 0 2024-09-21T08:02:48.739 INFO:tasks.workunit.client.0.smithi107.stdout:6/707: mknod d2/d3/d7/d54/cea 0 2024-09-21T08:02:48.740 INFO:tasks.workunit.client.0.smithi107.stdout:7/487: dread d7/d10/d28/f2f [0,4194304] 0 2024-09-21T08:02:48.740 INFO:tasks.workunit.client.0.smithi107.stdout:7/488: chown d7/f3f 791 1 2024-09-21T08:02:48.742 INFO:tasks.workunit.client.0.smithi107.stdout:4/617: mkdir dc/d13/d40/d5e/d98/dbf 0 2024-09-21T08:02:48.745 INFO:tasks.workunit.client.0.smithi107.stdout:9/744: getdents d11/d27/d2f/d4d/d5c/d61/db4/dbb 0 2024-09-21T08:02:48.747 INFO:tasks.workunit.client.0.smithi107.stdout:6/708: symlink d2/d3/d7/d54/leb 0 2024-09-21T08:02:48.751 INFO:tasks.workunit.client.0.smithi107.stdout:6/709: symlink d2/d3/d7/d48/da3/d85/d9b/db6/lec 0 2024-09-21T08:02:48.751 INFO:tasks.workunit.client.0.smithi107.stdout:6/710: readlink d2/d3/d7/d54/l82 0 2024-09-21T08:02:48.751 INFO:tasks.workunit.client.0.smithi107.stdout:6/711: truncate d2/d3/d7/d48/da3/d85/fa5 491782 0 2024-09-21T08:02:48.752 INFO:tasks.workunit.client.0.smithi107.stdout:3/640: dwrite d8/d2b/d45/f6a [0,4194304] 0 2024-09-21T08:02:48.757 INFO:tasks.workunit.client.0.smithi107.stdout:9/745: rmdir d11/d27/d2f/d38 39 2024-09-21T08:02:48.761 INFO:tasks.workunit.client.0.smithi107.stdout:8/537: rename d5/d44/d47/d5e to d5/db9 0 2024-09-21T08:02:48.761 INFO:tasks.workunit.client.0.smithi107.stdout:8/538: truncate d5/d2e/f51 844494 0 2024-09-21T08:02:48.761 INFO:tasks.workunit.client.0.smithi107.stdout:6/712: dread d2/d3/d7/d24/f2c [0,4194304] 0 2024-09-21T08:02:48.763 INFO:tasks.workunit.client.0.smithi107.stdout:9/746: rmdir d11/d27/d2f/d4d/d5c/d61/db4/dbb 39 2024-09-21T08:02:48.767 INFO:tasks.workunit.client.0.smithi107.stdout:9/747: mkdir d11/d27/d2f/d4d/d5c/d61/db4/d10f 0 2024-09-21T08:02:48.770 INFO:tasks.workunit.client.0.smithi107.stdout:9/748: creat d11/d27/d2f/d38/f110 x:0 0 0 2024-09-21T08:02:48.772 INFO:tasks.workunit.client.0.smithi107.stdout:7/489: dwrite d7/d22/d3b/f47 [0,4194304] 0 2024-09-21T08:02:48.772 INFO:tasks.workunit.client.0.smithi107.stdout:7/490: fdatasync d7/d10/d28/f9b 0 2024-09-21T08:02:48.774 INFO:tasks.workunit.client.0.smithi107.stdout:3/641: dwrite d8/d21/d7e/f83 [0,4194304] 0 2024-09-21T08:02:48.775 INFO:tasks.workunit.client.0.smithi107.stdout:1/588: rename d0/d29/d2c to d0/dc6 0 2024-09-21T08:02:48.775 INFO:tasks.workunit.client.0.smithi107.stdout:1/589: dread - d0/d19/f87 zero size 2024-09-21T08:02:48.776 INFO:tasks.workunit.client.0.smithi107.stdout:8/539: dread d5/f1b [0,4194304] 0 2024-09-21T08:02:48.776 INFO:tasks.workunit.client.0.smithi107.stdout:8/540: truncate d5/d1d/f3a 4973819 0 2024-09-21T08:02:48.779 INFO:tasks.workunit.client.0.smithi107.stdout:5/755: dwrite d7/d70/ff2 [0,4194304] 0 2024-09-21T08:02:48.779 INFO:tasks.workunit.client.0.smithi107.stdout:5/756: chown d7/de/d52/d8b/f50 13182470 1 2024-09-21T08:02:48.785 INFO:tasks.workunit.client.0.smithi107.stdout:2/563: rename d1/d2/l30 to d1/d2/d6d/d42/db0/db8/lc0 0 2024-09-21T08:02:48.785 INFO:tasks.workunit.client.0.smithi107.stdout:2/564: read - d1/d2/d6d/d37/d49/d7f/fa8 zero size 2024-09-21T08:02:48.785 INFO:tasks.workunit.client.0.smithi107.stdout:2/565: fdatasync d1/d1e/f5c 0 2024-09-21T08:02:48.785 INFO:tasks.workunit.client.0.smithi107.stdout:8/541: getdents d5/db9 0 2024-09-21T08:02:48.785 INFO:tasks.workunit.client.0.smithi107.stdout:8/542: chown d5/d1d/fb1 1910 1 2024-09-21T08:02:48.786 INFO:tasks.workunit.client.0.smithi107.stdout:8/543: write d5/d2e/d7c/d9a/f53 [345148,10554] 0 2024-09-21T08:02:48.793 INFO:tasks.workunit.client.0.smithi107.stdout:0/566: rename d1/d5/f2c to d1/d5/d25/d3d/d20/d29/d55/d91/fbc 0 2024-09-21T08:02:48.793 INFO:tasks.workunit.client.0.smithi107.stdout:0/567: truncate d1/d23/f8b 642390 0 2024-09-21T08:02:48.795 INFO:tasks.workunit.client.0.smithi107.stdout:2/566: symlink d1/d6/d92/lc1 0 2024-09-21T08:02:48.797 INFO:tasks.workunit.client.0.smithi107.stdout:4/618: rename dc/d13/d40/d5e/fb1 to dc/d13/d40/d46/fc0 0 2024-09-21T08:02:48.798 INFO:tasks.workunit.client.0.smithi107.stdout:4/619: dread - dc/d13/d83/d90/f96 zero size 2024-09-21T08:02:48.799 INFO:tasks.workunit.client.0.smithi107.stdout:0/568: link d1/d5/d25/d3d/d20/d29/f94 d1/d5/d25/d3d/d20/d85/da8/fbd 0 2024-09-21T08:02:48.801 INFO:tasks.workunit.client.0.smithi107.stdout:7/491: rename d7/d22/d3b/f47 to d7/d22/d37/d5a/fad 0 2024-09-21T08:02:48.801 INFO:tasks.workunit.client.0.smithi107.stdout:7/492: readlink d7/d10/d64/laa 0 2024-09-21T08:02:48.803 INFO:tasks.workunit.client.0.smithi107.stdout:4/620: mknod dc/d13/d83/d90/cc1 0 2024-09-21T08:02:48.806 INFO:tasks.workunit.client.0.smithi107.stdout:4/621: unlink dc/d13/d40/d5e/d6e/fba 0 2024-09-21T08:02:48.809 INFO:tasks.workunit.client.0.smithi107.stdout:9/749: dwrite d11/d27/d2f/f100 [0,4194304] 0 2024-09-21T08:02:48.809 INFO:tasks.workunit.client.0.smithi107.stdout:9/750: stat d11/d27/d2f/d4d/d5c/d61/db4/d10f 0 2024-09-21T08:02:48.809 INFO:tasks.workunit.client.0.smithi107.stdout:9/751: dread - d11/d24/d26/dd0/dec/f10e zero size 2024-09-21T08:02:48.810 INFO:tasks.workunit.client.0.smithi107.stdout:1/590: rename d0/d19/d59 to d0/d29/d4d/d84/dc5/da9/dc7 0 2024-09-21T08:02:48.810 INFO:tasks.workunit.client.0.smithi107.stdout:3/642: dwrite d8/d25/d42/dae/db1/fbb [0,4194304] 0 2024-09-21T08:02:48.812 INFO:tasks.workunit.client.0.smithi107.stdout:8/544: dwrite d5/f19 [0,4194304] 0 2024-09-21T08:02:48.812 INFO:tasks.workunit.client.0.smithi107.stdout:8/545: creat d5/d40/fba x:0 0 0 2024-09-21T08:02:48.813 INFO:tasks.workunit.client.0.smithi107.stdout:4/622: dread dc/f68 [0,4194304] 0 2024-09-21T08:02:48.813 INFO:tasks.workunit.client.0.smithi107.stdout:4/623: truncate dc/d13/d40/d80/fbb 419639 0 2024-09-21T08:02:48.813 INFO:tasks.workunit.client.0.smithi107.stdout:5/757: dwrite d7/de/da3/fe8 [0,4194304] 0 2024-09-21T08:02:48.816 INFO:tasks.workunit.client.0.smithi107.stdout:9/752: link d11/d27/d2f/d4d/d5c/f4b d11/d27/d98/d97/f111 0 2024-09-21T08:02:48.816 INFO:tasks.workunit.client.0.smithi107.stdout:9/753: truncate d11/fe2 388093 0 2024-09-21T08:02:48.819 INFO:tasks.workunit.client.0.smithi107.stdout:0/569: rename d1/d5/f48 to d1/d5/d25/fbe 0 2024-09-21T08:02:48.819 INFO:tasks.workunit.client.0.smithi107.stdout:0/570: read - d1/d23/f6d zero size 2024-09-21T08:02:48.822 INFO:tasks.workunit.client.0.smithi107.stdout:7/493: dwrite d7/d22/d37/d5a/f8c [0,4194304] 0 2024-09-21T08:02:48.822 INFO:tasks.workunit.client.0.smithi107.stdout:1/591: mkdir d0/d29/d4d/d84/dc5/da9/dc7/dc8 0 2024-09-21T08:02:48.823 INFO:tasks.workunit.client.0.smithi107.stdout:3/643: unlink d8/d44/l8f 0 2024-09-21T08:02:48.827 INFO:tasks.workunit.client.0.smithi107.stdout:8/546: mknod d5/d40/d8a/cbb 0 2024-09-21T08:02:48.828 INFO:tasks.workunit.client.0.smithi107.stdout:8/547: creat d5/d40/fbc x:0 0 0 2024-09-21T08:02:48.829 INFO:tasks.workunit.client.0.smithi107.stdout:4/624: link dc/d13/d40/d80/cb3 dc/d13/d40/d5e/da8/cc2 0 2024-09-21T08:02:48.833 INFO:tasks.workunit.client.0.smithi107.stdout:3/644: read d8/d2b/f3f [863794,44044] 0 2024-09-21T08:02:48.833 INFO:tasks.workunit.client.0.smithi107.stdout:9/754: dwrite d11/d27/d98/f54 [4194304,4194304] 0 2024-09-21T08:02:48.833 INFO:tasks.workunit.client.0.smithi107.stdout:9/755: write d11/f21 [1802645,75184] 0 2024-09-21T08:02:48.834 INFO:tasks.workunit.client.0.smithi107.stdout:5/758: unlink d7/de/d1d/d29/d68/de9/l102 0 2024-09-21T08:02:48.834 INFO:tasks.workunit.client.0.smithi107.stdout:9/756: write d11/d27/d2f/d38/daa/ffd [1469956,39708] 0 2024-09-21T08:02:48.836 INFO:tasks.workunit.client.0.smithi107.stdout:0/571: mknod d1/d5/d25/d3d/d20/d29/cbf 0 2024-09-21T08:02:48.838 INFO:tasks.workunit.client.0.smithi107.stdout:5/759: dread d7/de/d1d/d24/f4f [0,4194304] 0 2024-09-21T08:02:48.842 INFO:tasks.workunit.client.0.smithi107.stdout:7/494: link d7/d22/d37/d40/d4d/c93 d7/d22/d37/d40/cae 0 2024-09-21T08:02:48.842 INFO:tasks.workunit.client.0.smithi107.stdout:7/495: chown d7/d22/d3a/c8e 79978 1 2024-09-21T08:02:48.842 INFO:tasks.workunit.client.0.smithi107.stdout:3/645: dread d8/d21/f4c [0,4194304] 0 2024-09-21T08:02:48.843 INFO:tasks.workunit.client.0.smithi107.stdout:1/592: mknod d0/d29/d4d/cc9 0 2024-09-21T08:02:48.843 INFO:tasks.workunit.client.0.smithi107.stdout:3/646: dread d8/d25/d34/faf [0,4194304] 0 2024-09-21T08:02:48.846 INFO:tasks.workunit.client.0.smithi107.stdout:8/548: creat d5/d38/d56/da3/fbd x:0 0 0 2024-09-21T08:02:48.847 INFO:tasks.workunit.client.0.smithi107.stdout:4/625: dwrite dc/fe [4194304,4194304] 0 2024-09-21T08:02:48.852 INFO:tasks.workunit.client.0.smithi107.stdout:7/496: rename d7/d18/c1e to d7/d22/d37/caf 0 2024-09-21T08:02:48.853 INFO:tasks.workunit.client.0.smithi107.stdout:8/549: symlink d5/d38/lbe 0 2024-09-21T08:02:48.856 INFO:tasks.workunit.client.0.smithi107.stdout:4/626: link dc/laf dc/d13/d40/d5e/d77/d99/lc3 0 2024-09-21T08:02:48.857 INFO:tasks.workunit.client.0.smithi107.stdout:9/757: getdents d11/d27/d2a 0 2024-09-21T08:02:48.860 INFO:tasks.workunit.client.0.smithi107.stdout:3/647: dread d8/d2b/d45/f6a [0,4194304] 0 2024-09-21T08:02:48.861 INFO:tasks.workunit.client.0.smithi107.stdout:4/627: rename dc/d13/d40/c62 to dc/d13/d40/d5e/da8/cc4 0 2024-09-21T08:02:48.861 INFO:tasks.workunit.client.0.smithi107.stdout:4/628: chown dc/d4c/c9c 0 1 2024-09-21T08:02:48.861 INFO:tasks.workunit.client.0.smithi107.stdout:4/629: fdatasync dc/d13/d83/d90/f96 0 2024-09-21T08:02:48.863 INFO:tasks.workunit.client.0.smithi107.stdout:5/760: dwrite d7/de/d1d/dbc/f10c [0,4194304] 0 2024-09-21T08:02:48.865 INFO:tasks.workunit.client.0.smithi107.stdout:3/648: mknod d8/d14/d96/ce2 0 2024-09-21T08:02:48.865 INFO:tasks.workunit.client.0.smithi107.stdout:3/649: chown d8/d25/d42/dae 689 1 2024-09-21T08:02:48.865 INFO:tasks.workunit.client.0.smithi107.stdout:5/761: write d7/de/d1d/d24/fae [380382,23088] 0 2024-09-21T08:02:48.868 INFO:tasks.workunit.client.0.smithi107.stdout:7/497: rename d7/d22/d37/d4b/d4e to d7/d22/d37/d4b/db0 0 2024-09-21T08:02:48.873 INFO:tasks.workunit.client.0.smithi107.stdout:3/650: getdents d8/d38 0 2024-09-21T08:02:48.875 INFO:tasks.workunit.client.0.smithi107.stdout:3/651: write d8/d25/d42/f86 [89439,40243] 0 2024-09-21T08:02:48.875 INFO:tasks.workunit.client.0.smithi107.stdout:3/652: fdatasync d8/d44/f62 0 2024-09-21T08:02:48.875 INFO:tasks.workunit.client.0.smithi107.stdout:3/653: stat d8/d25/d34/faf 0 2024-09-21T08:02:48.875 INFO:tasks.workunit.client.0.smithi107.stdout:9/758: write d11/d24/d4a/f75 [1522257,50169] 0 2024-09-21T08:02:48.875 INFO:tasks.workunit.client.0.smithi107.stdout:5/762: unlink d7/de/d52/fb0 0 2024-09-21T08:02:48.876 INFO:tasks.workunit.client.0.smithi107.stdout:1/593: dwrite d0/d29/d4d/d84/dc5/f3d [0,4194304] 0 2024-09-21T08:02:48.878 INFO:tasks.workunit.client.0.smithi107.stdout:7/498: mkdir d7/d10/d64/db1 0 2024-09-21T08:02:48.880 INFO:tasks.workunit.client.0.smithi107.stdout:3/654: link d8/d2b/l53 d8/d87/le3 0 2024-09-21T08:02:48.882 INFO:tasks.workunit.client.0.smithi107.stdout:0/572: fsync d1/d5/d25/d3d/d20/d29/d55/d91/fbc 0 2024-09-21T08:02:48.882 INFO:tasks.workunit.client.0.smithi107.stdout:0/573: chown d1/d5/c66 9438572 1 2024-09-21T08:02:48.883 INFO:tasks.workunit.client.0.smithi107.stdout:9/759: stat d11/d24/d26/dd0/dec/c3d 0 2024-09-21T08:02:48.883 INFO:tasks.workunit.client.0.smithi107.stdout:9/760: creat d11/d27/d98/d97/f112 x:0 0 0 2024-09-21T08:02:48.885 INFO:tasks.workunit.client.0.smithi107.stdout:8/550: dwrite d5/f21 [0,4194304] 0 2024-09-21T08:02:48.886 INFO:tasks.workunit.client.0.smithi107.stdout:4/630: dwrite dc/d13/f58 [0,4194304] 0 2024-09-21T08:02:48.892 INFO:tasks.workunit.client.0.smithi107.stdout:1/594: dread d0/d29/d4d/d84/dc5/f3d [0,4194304] 0 2024-09-21T08:02:48.893 INFO:tasks.workunit.client.0.smithi107.stdout:1/595: truncate d0/d19/d2b/d4b/d61/d75/f7d 4987926 0 2024-09-21T08:02:48.898 INFO:tasks.workunit.client.0.smithi107.stdout:8/551: write d5/d38/d56/d52/f8f [2593623,37834] 0 2024-09-21T08:02:48.901 INFO:tasks.workunit.client.0.smithi107.stdout:1/596: dread d0/d19/f33 [0,4194304] 0 2024-09-21T08:02:48.903 INFO:tasks.workunit.client.0.smithi107.stdout:5/763: dwrite d7/de/d35/f42 [0,4194304] 0 2024-09-21T08:02:48.908 INFO:tasks.workunit.client.0.smithi107.stdout:7/499: stat d7/d22/d37/d40/l6c 0 2024-09-21T08:02:48.908 INFO:tasks.workunit.client.0.smithi107.stdout:3/655: write d8/d21/f48 [4326399,115114] 0 2024-09-21T08:02:48.910 INFO:tasks.workunit.client.0.smithi107.stdout:0/574: creat d1/d5/d25/d3d/d20/da0/fc0 x:0 0 0 2024-09-21T08:02:48.910 INFO:tasks.workunit.client.0.smithi107.stdout:0/575: chown d1/d6f/f89 13468 1 2024-09-21T08:02:48.916 INFO:tasks.workunit.client.0.smithi107.stdout:8/552: creat d5/d2e/d94/fbf x:0 0 0 2024-09-21T08:02:48.917 INFO:tasks.workunit.client.0.smithi107.stdout:9/761: dwrite d11/d24/fd9 [0,4194304] 0 2024-09-21T08:02:48.918 INFO:tasks.workunit.client.0.smithi107.stdout:9/762: chown d11/d27/d5b/laf 81 1 2024-09-21T08:02:48.918 INFO:tasks.workunit.client.0.smithi107.stdout:1/597: creat d0/d19/d2b/d86/dc2/fca x:0 0 0 2024-09-21T08:02:48.920 INFO:tasks.workunit.client.0.smithi107.stdout:5/764: mkdir d7/de/d1d/d29/d68/ddb/dde/df7/d10d 0 2024-09-21T08:02:48.920 INFO:tasks.workunit.client.0.smithi107.stdout:5/765: write d7/de/d2d/d5d/d60/fe1 [218457,74087] 0 2024-09-21T08:02:48.920 INFO:tasks.workunit.client.0.smithi107.stdout:5/766: dread - d7/de/d1d/d29/d64/f7f zero size 2024-09-21T08:02:48.920 INFO:tasks.workunit.client.0.smithi107.stdout:5/767: getdents d7/de/d1d/d29/d68/ddb/dde/dd8/d105 0 2024-09-21T08:02:48.920 INFO:tasks.workunit.client.0.smithi107.stdout:5/768: write d7/de/d1d/d29/d64/d87/fa5 [40477,65664] 0 2024-09-21T08:02:48.920 INFO:tasks.workunit.client.0.smithi107.stdout:7/500: mknod d7/d22/d37/d40/d4d/cb2 0 2024-09-21T08:02:48.921 INFO:tasks.workunit.client.0.smithi107.stdout:7/501: truncate d7/d22/d37/d4b/f5e 1000244 0 2024-09-21T08:02:48.921 INFO:tasks.workunit.client.0.smithi107.stdout:7/502: fdatasync d7/d22/d3a/f7a 0 2024-09-21T08:02:48.922 INFO:tasks.workunit.client.0.smithi107.stdout:3/656: creat d8/d2b/d91/fe4 x:0 0 0 2024-09-21T08:02:48.926 INFO:tasks.workunit.client.0.smithi107.stdout:9/763: rename d11/d24/d26/dd0/dec/l82 to d11/d24/l113 0 2024-09-21T08:02:48.927 INFO:tasks.workunit.client.0.smithi107.stdout:3/657: write d8/d21/f75 [79766,111980] 0 2024-09-21T08:02:48.931 INFO:tasks.workunit.client.0.smithi107.stdout:4/631: dwrite dc/d13/f3e [0,4194304] 0 2024-09-21T08:02:48.931 INFO:tasks.workunit.client.0.smithi107.stdout:1/598: dread d0/f71 [0,4194304] 0 2024-09-21T08:02:48.931 INFO:tasks.workunit.client.0.smithi107.stdout:1/599: write d0/d19/d2b/d4b/d44/d72/d36/d8e/fb0 [993666,1819] 0 2024-09-21T08:02:48.934 INFO:tasks.workunit.client.0.smithi107.stdout:3/658: mkdir d8/d2b/d91/de5 0 2024-09-21T08:02:48.937 INFO:tasks.workunit.client.0.smithi107.stdout:3/659: unlink d8/d2b/f3f 0 2024-09-21T08:02:48.939 INFO:tasks.workunit.client.0.smithi107.stdout:5/769: dread d7/de/d1d/dbc/f10c [0,4194304] 0 2024-09-21T08:02:48.940 INFO:tasks.workunit.client.0.smithi107.stdout:5/770: write d7/fec [23615,61735] 0 2024-09-21T08:02:48.943 INFO:tasks.workunit.client.0.smithi107.stdout:9/764: read d11/d24/d26/fb8 [2162539,128221] 0 2024-09-21T08:02:48.943 INFO:tasks.workunit.client.0.smithi107.stdout:9/765: stat d11/d24/d26/dd0/fdc 0 2024-09-21T08:02:48.947 INFO:tasks.workunit.client.0.smithi107.stdout:0/576: dwrite d1/d5/d25/d3d/d20/d29/f44 [0,4194304] 0 2024-09-21T08:02:48.947 INFO:tasks.workunit.client.0.smithi107.stdout:3/660: write d8/d38/fa4 [3095949,63131] 0 2024-09-21T08:02:48.947 INFO:tasks.workunit.client.0.smithi107.stdout:3/661: chown d8/d25/d34/fbc 5068 1 2024-09-21T08:02:48.948 INFO:tasks.workunit.client.0.smithi107.stdout:7/503: dwrite d7/d22/d3a/f7a [0,4194304] 0 2024-09-21T08:02:48.950 INFO:tasks.workunit.client.0.smithi107.stdout:3/662: mknod d8/d44/dad/ce6 0 2024-09-21T08:02:48.954 INFO:tasks.workunit.client.0.smithi107.stdout:5/771: dread d7/de/d1d/d29/d68/ddb/dde/fdd [0,4194304] 0 2024-09-21T08:02:48.955 INFO:tasks.workunit.client.0.smithi107.stdout:0/577: dread d1/d5/d25/d3d/d20/d29/d55/d7a/f8c [0,4194304] 0 2024-09-21T08:02:48.956 INFO:tasks.workunit.client.0.smithi107.stdout:5/772: mknod d7/de/d35/c10e 0 2024-09-21T08:02:48.962 INFO:tasks.workunit.client.0.smithi107.stdout:0/578: mkdir d1/d6f/dc1 0 2024-09-21T08:02:48.963 INFO:tasks.workunit.client.0.smithi107.stdout:3/663: fsync d8/d21/f48 0 2024-09-21T08:02:48.963 INFO:tasks.workunit.client.0.smithi107.stdout:3/664: creat d8/d2b/d91/fe7 x:0 0 0 2024-09-21T08:02:48.963 INFO:tasks.workunit.client.0.smithi107.stdout:3/665: chown d8/d2b/d45/dcc/f1f 15 1 2024-09-21T08:02:48.963 INFO:tasks.workunit.client.0.smithi107.stdout:3/666: dread - d8/d21/d7e/fd2 zero size 2024-09-21T08:02:48.963 INFO:tasks.workunit.client.0.smithi107.stdout:3/667: readlink d8/d2b/d52/d55/lc5 0 2024-09-21T08:02:48.963 INFO:tasks.workunit.client.0.smithi107.stdout:3/668: chown d8/d25/d3d/d72/d80/d5d/d67/cda 4146 1 2024-09-21T08:02:48.963 INFO:tasks.workunit.client.0.smithi107.stdout:1/600: dwrite d0/d19/d2b/d4b/d61/d75/f7d [4194304,4194304] 0 2024-09-21T08:02:48.963 INFO:tasks.workunit.client.0.smithi107.stdout:1/601: write d0/f71 [521570,108922] 0 2024-09-21T08:02:48.964 INFO:tasks.workunit.client.0.smithi107.stdout:4/632: dwrite dc/d13/f72 [0,4194304] 0 2024-09-21T08:02:48.967 INFO:tasks.workunit.client.0.smithi107.stdout:3/669: stat d8/d25/d3d/l40 0 2024-09-21T08:02:48.967 INFO:tasks.workunit.client.0.smithi107.stdout:3/670: chown d8/d25/d3d/l40 0 1 2024-09-21T08:02:48.967 INFO:tasks.workunit.client.0.smithi107.stdout:3/671: truncate d8/d21/f88 219149 0 2024-09-21T08:02:48.968 INFO:tasks.workunit.client.0.smithi107.stdout:7/504: read d7/d22/d37/d5a/f66 [3985381,41742] 0 2024-09-21T08:02:48.969 INFO:tasks.workunit.client.0.smithi107.stdout:1/602: mkdir d0/d19/d2b/d4b/d5b/dcb 0 2024-09-21T08:02:48.972 INFO:tasks.workunit.client.0.smithi107.stdout:8/553: rmdir d5/d38 39 2024-09-21T08:02:48.973 INFO:tasks.workunit.client.0.smithi107.stdout:0/579: write d1/d5/f7e [2979633,101957] 0 2024-09-21T08:02:48.976 INFO:tasks.workunit.client.0.smithi107.stdout:9/766: dwrite d11/d27/d2f/d4d/d5c/d61/f7e [0,4194304] 0 2024-09-21T08:02:48.980 INFO:tasks.workunit.client.0.smithi107.stdout:4/633: dread dc/d13/f58 [0,4194304] 0 2024-09-21T08:02:48.982 INFO:tasks.workunit.client.0.smithi107.stdout:7/505: dread d7/d18/f29 [0,4194304] 0 2024-09-21T08:02:48.982 INFO:tasks.workunit.client.0.smithi107.stdout:3/672: dread d8/d25/d42/f86 [0,4194304] 0 2024-09-21T08:02:48.982 INFO:tasks.workunit.client.0.smithi107.stdout:7/506: write d7/d10/d28/f9b [767824,99680] 0 2024-09-21T08:02:48.985 INFO:tasks.workunit.client.0.smithi107.stdout:5/773: dwrite d7/de/d1d/fb6 [0,4194304] 0 2024-09-21T08:02:48.990 INFO:tasks.workunit.client.0.smithi107.stdout:1/603: dread d0/d19/d2b/f8b [0,4194304] 0 2024-09-21T08:02:48.994 INFO:tasks.workunit.client.0.smithi107.stdout:8/554: creat d5/d2e/d7c/d9a/fc0 x:0 0 0 2024-09-21T08:02:48.998 INFO:tasks.workunit.client.0.smithi107.stdout:0/580: mkdir d1/d5/d25/d3d/d20/d29/d5c/dc2 0 2024-09-21T08:02:49.000 INFO:tasks.workunit.client.0.smithi107.stdout:9/767: mkdir d11/d27/d114 0 2024-09-21T08:02:49.002 INFO:tasks.workunit.client.0.smithi107.stdout:3/673: truncate d8/d25/d3d/d72/d80/d5d/f63 971758 0 2024-09-21T08:02:49.004 INFO:tasks.workunit.client.0.smithi107.stdout:0/581: dread d1/d23/d61/f73 [0,4194304] 0 2024-09-21T08:02:49.004 INFO:tasks.workunit.client.0.smithi107.stdout:4/634: dwrite dc/f50 [0,4194304] 0 2024-09-21T08:02:49.004 INFO:tasks.workunit.client.0.smithi107.stdout:0/582: write d1/d5/d25/f40 [1913049,105493] 0 2024-09-21T08:02:49.004 INFO:tasks.workunit.client.0.smithi107.stdout:0/583: dread - d1/d5/d25/d2d/d8e/fb0 zero size 2024-09-21T08:02:49.004 INFO:tasks.workunit.client.0.smithi107.stdout:0/584: truncate d1/d5/d25/d3d/d20/f7d 510152 0 2024-09-21T08:02:49.004 INFO:tasks.workunit.client.0.smithi107.stdout:0/585: chown d1/d5/d25/d2d/c45 9610 1 2024-09-21T08:02:49.004 INFO:tasks.workunit.client.0.smithi107.stdout:0/586: write d1/d23/f8b [279073,106398] 0 2024-09-21T08:02:49.005 INFO:tasks.workunit.client.0.smithi107.stdout:7/507: creat d7/d22/d37/d4b/db0/d4f/fb3 x:0 0 0 2024-09-21T08:02:49.011 INFO:tasks.workunit.client.0.smithi107.stdout:5/774: unlink d7/de/d1d/f10b 0 2024-09-21T08:02:49.011 INFO:tasks.workunit.client.0.smithi107.stdout:5/775: fdatasync d7/de/fc8 0 2024-09-21T08:02:49.013 INFO:tasks.workunit.client.0.smithi107.stdout:5/776: dread d7/de/d2d/d5d/fa1 [0,4194304] 0 2024-09-21T08:02:49.014 INFO:tasks.workunit.client.0.smithi107.stdout:1/604: rename d0/d19/d2b/d4b/d44/d55/d64/fa3 to d0/d29/da1/fcc 0 2024-09-21T08:02:49.016 INFO:tasks.workunit.client.0.smithi107.stdout:8/555: link d5/db9/l6b d5/db9/lc1 0 2024-09-21T08:02:49.016 INFO:tasks.workunit.client.0.smithi107.stdout:8/556: write d5/d38/d56/d54/fae [388242,126489] 0 2024-09-21T08:02:49.018 INFO:tasks.workunit.client.0.smithi107.stdout:7/508: dread d7/d10/f1d [0,4194304] 0 2024-09-21T08:02:49.022 INFO:tasks.workunit.client.0.smithi107.stdout:3/674: mknod d8/d25/d42/dae/db1/dd6/ce8 0 2024-09-21T08:02:49.022 INFO:tasks.workunit.client.0.smithi107.stdout:9/768: dread d11/d27/d98/f7c [0,4194304] 0 2024-09-21T08:02:49.022 INFO:tasks.workunit.client.0.smithi107.stdout:3/675: readlink d8/d14/l4e 0 2024-09-21T08:02:49.023 INFO:tasks.workunit.client.0.smithi107.stdout:1/605: dread d0/d29/d4d/d84/dc5/f41 [0,4194304] 0 2024-09-21T08:02:49.023 INFO:tasks.workunit.client.0.smithi107.stdout:1/606: chown d0/d29/d4d/d84/dc5/da9/dc7/f91 983 1 2024-09-21T08:02:49.023 INFO:tasks.workunit.client.0.smithi107.stdout:1/607: fsync d0/d29/d4d/d84/dc5/da9/dc7/f6f 0 2024-09-21T08:02:49.025 INFO:tasks.workunit.client.0.smithi107.stdout:0/587: truncate d1/d5/d25/d3d/d20/d29/d55/d7a/f95 2527007 0 2024-09-21T08:02:49.027 INFO:tasks.workunit.client.0.smithi107.stdout:5/777: mknod d7/de/d1d/d29/d68/ddb/dde/dd8/d105/c10f 0 2024-09-21T08:02:49.031 INFO:tasks.workunit.client.0.smithi107.stdout:8/557: symlink d5/d38/d56/d54/lc2 0 2024-09-21T08:02:49.031 INFO:tasks.workunit.client.0.smithi107.stdout:8/558: chown d5/d44/d47 37 1 2024-09-21T08:02:49.033 INFO:tasks.workunit.client.0.smithi107.stdout:9/769: truncate d11/d27/d5e/d76/fb7 2547476 0 2024-09-21T08:02:49.036 INFO:tasks.workunit.client.0.smithi107.stdout:1/608: unlink d0/d19/d2b/d4b/l13 0 2024-09-21T08:02:49.040 INFO:tasks.workunit.client.0.smithi107.stdout:0/588: creat d1/d5/d25/d3d/d20/fc3 x:0 0 0 2024-09-21T08:02:49.041 INFO:tasks.workunit.client.0.smithi107.stdout:0/589: write d1/d5/d25/f40 [1895049,56409] 0 2024-09-21T08:02:49.042 INFO:tasks.workunit.client.0.smithi107.stdout:5/778: symlink d7/l110 0 2024-09-21T08:02:49.042 INFO:tasks.workunit.client.0.smithi107.stdout:5/779: getdents d7/d70/de3 0 2024-09-21T08:02:49.050 INFO:tasks.workunit.client.0.smithi107.stdout:4/635: rename dc/d13/d83 to dc/d13/d40/d46/d48/d70/dc5 0 2024-09-21T08:02:49.055 INFO:tasks.workunit.client.0.smithi107.stdout:3/676: dwrite d8/d21/f4c [0,4194304] 0 2024-09-21T08:02:49.057 INFO:tasks.workunit.client.0.smithi107.stdout:8/559: link d5/d23/f35 d5/db9/fc3 0 2024-09-21T08:02:49.058 INFO:tasks.workunit.client.0.smithi107.stdout:1/609: dwrite d0/d29/d4d/d84/dc5/d5e/f69 [0,4194304] 0 2024-09-21T08:02:49.060 INFO:tasks.workunit.client.0.smithi107.stdout:3/677: dread d8/d2b/d45/dcc/f1f [0,4194304] 0 2024-09-21T08:02:49.063 INFO:tasks.workunit.client.0.smithi107.stdout:0/590: unlink d1/d5/d25/d3d/d20/d29/cbf 0 2024-09-21T08:02:49.063 INFO:tasks.workunit.client.0.smithi107.stdout:0/591: fsync d1/d5/d75/f81 0 2024-09-21T08:02:49.066 INFO:tasks.workunit.client.0.smithi107.stdout:5/780: rmdir d7/de/d1d/d29/d64 39 2024-09-21T08:02:49.067 INFO:tasks.workunit.client.0.smithi107.stdout:4/636: creat dc/d13/d40/d5e/d6e/fc6 x:0 0 0 2024-09-21T08:02:49.068 INFO:tasks.workunit.client.0.smithi107.stdout:4/637: fsync dc/d13/f5d 0 2024-09-21T08:02:49.070 INFO:tasks.workunit.client.0.smithi107.stdout:1/610: dread d0/d19/d2b/d4b/f1a [0,4194304] 0 2024-09-21T08:02:49.070 INFO:tasks.workunit.client.0.smithi107.stdout:9/770: rename d11/d27/d2f/d4d/d5c/d61/db4/c101 to d11/d27/d98/c115 0 2024-09-21T08:02:49.070 INFO:tasks.workunit.client.0.smithi107.stdout:9/771: creat d11/d27/d98/d97/f116 x:0 0 0 2024-09-21T08:02:49.070 INFO:tasks.workunit.client.0.smithi107.stdout:8/560: mknod d5/d38/d67/d7d/d91/cc4 0 2024-09-21T08:02:49.072 INFO:tasks.workunit.client.0.smithi107.stdout:3/678: truncate d8/d87/fa7 1632230 0 2024-09-21T08:02:49.072 INFO:tasks.workunit.client.0.smithi107.stdout:3/679: chown d8/d87/dc9 6754 1 2024-09-21T08:02:49.073 INFO:tasks.workunit.client.0.smithi107.stdout:0/592: mknod d1/d5/d25/d3d/d20/d29/d5c/cc4 0 2024-09-21T08:02:49.075 INFO:tasks.workunit.client.0.smithi107.stdout:6/713: sync 2024-09-21T08:02:49.075 INFO:tasks.workunit.client.0.smithi107.stdout:2/567: sync 2024-09-21T08:02:49.076 INFO:tasks.workunit.client.0.smithi107.stdout:4/638: symlink dc/d13/d5a/lc7 0 2024-09-21T08:02:49.078 INFO:tasks.workunit.client.0.smithi107.stdout:1/611: symlink d0/d19/d2b/d86/da4/lcd 0 2024-09-21T08:02:49.081 INFO:tasks.workunit.client.0.smithi107.stdout:9/772: mknod d11/d27/d2f/d38/dcc/de7/c117 0 2024-09-21T08:02:49.082 INFO:tasks.workunit.client.0.smithi107.stdout:9/773: chown d11/f20 677 1 2024-09-21T08:02:49.085 INFO:tasks.workunit.client.0.smithi107.stdout:8/561: creat d5/d2e/fc5 x:0 0 0 2024-09-21T08:02:49.085 INFO:tasks.workunit.client.0.smithi107.stdout:8/562: creat d5/d2e/fc6 x:0 0 0 2024-09-21T08:02:49.085 INFO:tasks.workunit.client.0.smithi107.stdout:8/563: write d5/fa [8719399,29110] 0 2024-09-21T08:02:49.085 INFO:tasks.workunit.client.0.smithi107.stdout:8/564: write d5/d38/f3e [5102260,24181] 0 2024-09-21T08:02:49.086 INFO:tasks.workunit.client.0.smithi107.stdout:8/565: fsync d5/d23/f57 0 2024-09-21T08:02:49.088 INFO:tasks.workunit.client.0.smithi107.stdout:3/680: mknod d8/d14/d96/db0/ce9 0 2024-09-21T08:02:49.088 INFO:tasks.workunit.client.0.smithi107.stdout:3/681: stat d8/dc6 0 2024-09-21T08:02:49.088 INFO:tasks.workunit.client.0.smithi107.stdout:3/682: read d8/d25/d42/f86 [99996,104967] 0 2024-09-21T08:02:49.088 INFO:tasks.workunit.client.0.smithi107.stdout:3/683: write d8/d44/dad/fde [649315,44356] 0 2024-09-21T08:02:49.090 INFO:tasks.workunit.client.0.smithi107.stdout:0/593: creat d1/d5/d25/d3d/d20/d29/fc5 x:0 0 0 2024-09-21T08:02:49.094 INFO:tasks.workunit.client.0.smithi107.stdout:6/714: link d2/d2e/c77 d2/d3/d7/d54/ced 0 2024-09-21T08:02:49.094 INFO:tasks.workunit.client.0.smithi107.stdout:6/715: creat d2/d3/d7/d54/dae/fee x:0 0 0 2024-09-21T08:02:49.094 INFO:tasks.workunit.client.0.smithi107.stdout:6/716: readlink d2/d3/d7/d23/l6d 0 2024-09-21T08:02:49.095 INFO:tasks.workunit.client.0.smithi107.stdout:3/684: dread d8/f13 [0,4194304] 0 2024-09-21T08:02:49.095 INFO:tasks.workunit.client.0.smithi107.stdout:5/781: dwrite d7/de/d2d/d5d/f9e [0,4194304] 0 2024-09-21T08:02:49.095 INFO:tasks.workunit.client.0.smithi107.stdout:3/685: creat d8/d25/fea x:0 0 0 2024-09-21T08:02:49.095 INFO:tasks.workunit.client.0.smithi107.stdout:4/639: mknod dc/d13/d40/d46/d48/d70/dc5/cc8 0 2024-09-21T08:02:49.096 INFO:tasks.workunit.client.0.smithi107.stdout:2/568: dwrite d1/d16/f32 [0,4194304] 0 2024-09-21T08:02:49.097 INFO:tasks.workunit.client.0.smithi107.stdout:1/612: mkdir d0/dce 0 2024-09-21T08:02:49.099 INFO:tasks.workunit.client.0.smithi107.stdout:8/566: write d5/fd [498770,53958] 0 2024-09-21T08:02:49.099 INFO:tasks.workunit.client.0.smithi107.stdout:8/567: fsync d5/d23/f25 0 2024-09-21T08:02:49.099 INFO:tasks.workunit.client.0.smithi107.stdout:8/568: fsync d5/d2e/d7c/d9a/fc0 0 2024-09-21T08:02:49.099 INFO:tasks.workunit.client.0.smithi107.stdout:9/774: creat d11/d27/d2f/d38/dcc/de7/f118 x:0 0 0 2024-09-21T08:02:49.100 INFO:tasks.workunit.client.0.smithi107.stdout:9/775: creat d11/d27/d98/f119 x:0 0 0 2024-09-21T08:02:49.100 INFO:tasks.workunit.client.0.smithi107.stdout:9/776: read d11/f18 [2596366,65554] 0 2024-09-21T08:02:49.105 INFO:tasks.workunit.client.0.smithi107.stdout:6/717: rename d2/d3/d7/d48/da3/d85/d9d/dcf/fd3 to d2/d2e/d97/fef 0 2024-09-21T08:02:49.105 INFO:tasks.workunit.client.0.smithi107.stdout:1/613: rename d0 to d0/d19/d2b/d4b/d44/d72/d36/dcf 22 2024-09-21T08:02:49.107 INFO:tasks.workunit.client.0.smithi107.stdout:3/686: mknod d8/d21/d7e/ceb 0 2024-09-21T08:02:49.107 INFO:tasks.workunit.client.0.smithi107.stdout:3/687: creat d8/fec x:0 0 0 2024-09-21T08:02:49.113 INFO:tasks.workunit.client.0.smithi107.stdout:6/718: dread d2/d3/d7/d23/d2b/f2f [4194304,4194304] 0 2024-09-21T08:02:49.113 INFO:tasks.workunit.client.0.smithi107.stdout:2/569: symlink d1/d2/d6d/d42/db0/lc2 0 2024-09-21T08:02:49.115 INFO:tasks.workunit.client.0.smithi107.stdout:8/569: mknod d5/d38/d67/cc7 0 2024-09-21T08:02:49.116 INFO:tasks.workunit.client.0.smithi107.stdout:8/570: write d5/d1d/f4d [8453648,99413] 0 2024-09-21T08:02:49.116 INFO:tasks.workunit.client.0.smithi107.stdout:8/571: write d5/d40/fbc [259406,78233] 0 2024-09-21T08:02:49.118 INFO:tasks.workunit.client.0.smithi107.stdout:9/777: symlink d11/d27/d2f/def/dfb/l11a 0 2024-09-21T08:02:49.119 INFO:tasks.workunit.client.0.smithi107.stdout:1/614: unlink d0/dc6/f52 0 2024-09-21T08:02:49.119 INFO:tasks.workunit.client.0.smithi107.stdout:1/615: dread - d0/d19/f87 zero size 2024-09-21T08:02:49.121 INFO:tasks.workunit.client.0.smithi107.stdout:3/688: symlink d8/d2b/led 0 2024-09-21T08:02:49.123 INFO:tasks.workunit.client.0.smithi107.stdout:2/570: dread d1/d2/d6d/d42/d76/fa7 [0,4194304] 0 2024-09-21T08:02:49.124 INFO:tasks.workunit.client.0.smithi107.stdout:9/778: symlink d11/d27/d2f/d4d/d5c/l11b 0 2024-09-21T08:02:49.125 INFO:tasks.workunit.client.0.smithi107.stdout:3/689: symlink d8/lee 0 2024-09-21T08:02:49.125 INFO:tasks.workunit.client.0.smithi107.stdout:3/690: chown d8/d44/dad 58375504 1 2024-09-21T08:02:49.127 INFO:tasks.workunit.client.0.smithi107.stdout:2/571: mknod d1/d16/d9c/dbb/cc3 0 2024-09-21T08:02:49.130 INFO:tasks.workunit.client.0.smithi107.stdout:3/691: mknod d8/d25/d3d/d72/d80/d5d/d67/cef 0 2024-09-21T08:02:49.131 INFO:tasks.workunit.client.0.smithi107.stdout:2/572: stat d1/d1e/c6a 0 2024-09-21T08:02:49.137 INFO:tasks.workunit.client.0.smithi107.stdout:4/640: rmdir dc/d13/d40/d46/d48 39 2024-09-21T08:02:49.139 INFO:tasks.workunit.client.0.smithi107.stdout:4/641: symlink dc/d13/d5a/d9b/lc9 0 2024-09-21T08:02:49.141 INFO:tasks.workunit.client.0.smithi107.stdout:4/642: symlink dc/d13/d40/d5e/d77/d99/lca 0 2024-09-21T08:02:49.141 INFO:tasks.workunit.client.0.smithi107.stdout:4/643: creat dc/fcb x:0 0 0 2024-09-21T08:02:49.144 INFO:tasks.workunit.client.0.smithi107.stdout:4/644: mkdir dc/d13/d40/dcc 0 2024-09-21T08:02:49.144 INFO:tasks.workunit.client.0.smithi107.stdout:4/645: write dc/d13/d5a/fae [6416627,42882] 0 2024-09-21T08:02:49.144 INFO:tasks.workunit.client.0.smithi107.stdout:2/573: dread d1/d2/d6d/f5b [4194304,4194304] 0 2024-09-21T08:02:49.144 INFO:tasks.workunit.client.0.smithi107.stdout:2/574: getdents d1/d2/d6d/d37/d49 0 2024-09-21T08:02:49.144 INFO:tasks.workunit.client.0.smithi107.stdout:2/575: write d1/d2/fa4 [1006726,84626] 0 2024-09-21T08:02:49.145 INFO:tasks.workunit.client.0.smithi107.stdout:4/646: unlink dc/d13/d40/d5e/d6e/fc6 0 2024-09-21T08:02:49.145 INFO:tasks.workunit.client.0.smithi107.stdout:4/647: chown dc/d13/d40/dcc 316808383 1 2024-09-21T08:02:49.146 INFO:tasks.workunit.client.0.smithi107.stdout:2/576: getdents d1/d2/d6d/d37 0 2024-09-21T08:02:49.148 INFO:tasks.workunit.client.0.smithi107.stdout:4/648: mknod dc/d13/d40/d46/d48/d70/dc5/d97/ccd 0 2024-09-21T08:02:49.148 INFO:tasks.workunit.client.0.smithi107.stdout:4/649: creat dc/d13/d40/d80/fce x:0 0 0 2024-09-21T08:02:49.152 INFO:tasks.workunit.client.0.smithi107.stdout:6/719: dwrite d2/d2e/fbd [0,4194304] 0 2024-09-21T08:02:49.152 INFO:tasks.workunit.client.0.smithi107.stdout:6/720: stat d2/d2e 0 2024-09-21T08:02:49.152 INFO:tasks.workunit.client.0.smithi107.stdout:6/721: fdatasync d2/d3/d7/d24/d41/fd7 0 2024-09-21T08:02:49.152 INFO:tasks.workunit.client.0.smithi107.stdout:1/616: dwrite d0/d19/d2b/d86/dc2/fca [0,4194304] 0 2024-09-21T08:02:49.152 INFO:tasks.workunit.client.0.smithi107.stdout:1/617: write d0/d29/f5c [2744778,13487] 0 2024-09-21T08:02:49.152 INFO:tasks.workunit.client.0.smithi107.stdout:9/779: dwrite d11/d27/d2a/f41 [0,4194304] 0 2024-09-21T08:02:49.155 INFO:tasks.workunit.client.0.smithi107.stdout:8/572: dwrite d5/d38/d67/d7d/d91/fa6 [4194304,4194304] 0 2024-09-21T08:02:49.159 INFO:tasks.workunit.client.0.smithi107.stdout:6/722: creat d2/d3/d7/d23/ff0 x:0 0 0 2024-09-21T08:02:49.159 INFO:tasks.workunit.client.0.smithi107.stdout:6/723: creat d2/d2e/ff1 x:0 0 0 2024-09-21T08:02:49.170 INFO:tasks.workunit.client.0.smithi107.stdout:3/692: getdents d8/d25/d3d/d72/d80/d5d/d67 0 2024-09-21T08:02:49.170 INFO:tasks.workunit.client.0.smithi107.stdout:3/693: fdatasync d8/f8a 0 2024-09-21T08:02:49.170 INFO:tasks.workunit.client.0.smithi107.stdout:3/694: write d8/d2b/d45/dcc/fc7 [232120,103561] 0 2024-09-21T08:02:49.170 INFO:tasks.workunit.client.0.smithi107.stdout:3/695: chown d8/d25/d42 1770515 1 2024-09-21T08:02:49.178 INFO:tasks.workunit.client.0.smithi107.stdout:2/577: dwrite d1/d2/d6d/d42/d76/fa7 [0,4194304] 0 2024-09-21T08:02:49.181 INFO:tasks.workunit.client.0.smithi107.stdout:3/696: creat d8/d2b/d52/d71/db3/dc2/ff0 x:0 0 0 2024-09-21T08:02:49.184 INFO:tasks.workunit.client.0.smithi107.stdout:2/578: creat d1/d2/d6d/d42/db0/fc4 x:0 0 0 2024-09-21T08:02:49.184 INFO:tasks.workunit.client.0.smithi107.stdout:2/579: truncate d1/d1e/f5c 2434389 0 2024-09-21T08:02:49.184 INFO:tasks.workunit.client.0.smithi107.stdout:2/580: stat d1/d1e/f79 0 2024-09-21T08:02:49.184 INFO:tasks.workunit.client.0.smithi107.stdout:2/581: write d1/d2/d6d/f86 [3778843,25498] 0 2024-09-21T08:02:49.185 INFO:tasks.workunit.client.0.smithi107.stdout:2/582: unlink d1/d2/d6d/d37/d49/f83 0 2024-09-21T08:02:49.186 INFO:tasks.workunit.client.0.smithi107.stdout:2/583: rmdir d1/d2/d6d/d37 39 2024-09-21T08:02:49.187 INFO:tasks.workunit.client.0.smithi107.stdout:2/584: rename d1/d16/f55 to d1/fc5 0 2024-09-21T08:02:49.187 INFO:tasks.workunit.client.0.smithi107.stdout:2/585: stat d1/d16/d9c/dbb/cc3 0 2024-09-21T08:02:49.189 INFO:tasks.workunit.client.0.smithi107.stdout:4/650: dwrite dc/fe [0,4194304] 0 2024-09-21T08:02:49.190 INFO:tasks.workunit.client.0.smithi107.stdout:8/573: dwrite d5/d38/d56/d52/f8f [0,4194304] 0 2024-09-21T08:02:49.190 INFO:tasks.workunit.client.0.smithi107.stdout:4/651: getdents dc/d13/d40/d46/d48/d70/dc5/d8a 0 2024-09-21T08:02:49.190 INFO:tasks.workunit.client.0.smithi107.stdout:4/652: chown dc/d13/d40/d46/d48/d70/dc5/d97/la7 5361 1 2024-09-21T08:02:49.192 INFO:tasks.workunit.client.0.smithi107.stdout:8/574: symlink d5/d44/db7/lc8 0 2024-09-21T08:02:49.192 INFO:tasks.workunit.client.0.smithi107.stdout:8/575: dread - d5/d2e/d7c/d9a/fc0 zero size 2024-09-21T08:02:49.192 INFO:tasks.workunit.client.0.smithi107.stdout:8/576: truncate d5/d44/d47/f4e 2322870 0 2024-09-21T08:02:49.192 INFO:tasks.workunit.client.0.smithi107.stdout:8/577: write d5/d2e/f39 [2919146,108904] 0 2024-09-21T08:02:49.193 INFO:tasks.workunit.client.0.smithi107.stdout:4/653: mkdir dc/d64/d6b/dcf 0 2024-09-21T08:02:49.193 INFO:tasks.workunit.client.0.smithi107.stdout:4/654: chown dc/d60/d8c/cad 7 1 2024-09-21T08:02:49.193 INFO:tasks.workunit.client.0.smithi107.stdout:6/724: dwrite d2/d2e/fbd [0,4194304] 0 2024-09-21T08:02:49.194 INFO:tasks.workunit.client.0.smithi107.stdout:6/725: write d2/d3/d7/d24/d41/fbf [1046362,87366] 0 2024-09-21T08:02:49.197 INFO:tasks.workunit.client.0.smithi107.stdout:6/726: symlink d2/d3/d7/d24/d41/d50/lf2 0 2024-09-21T08:02:49.200 INFO:tasks.workunit.client.0.smithi107.stdout:3/697: dread d8/d25/d42/dae/db1/fbb [0,4194304] 0 2024-09-21T08:02:49.202 INFO:tasks.workunit.client.0.smithi107.stdout:4/655: dread dc/d13/f2a [0,4194304] 0 2024-09-21T08:02:49.203 INFO:tasks.workunit.client.0.smithi107.stdout:4/656: creat dc/fd0 x:0 0 0 2024-09-21T08:02:49.205 INFO:tasks.workunit.client.0.smithi107.stdout:3/698: unlink d8/d14/d96/db0/ce9 0 2024-09-21T08:02:49.205 INFO:tasks.workunit.client.0.smithi107.stdout:3/699: write d8/d44/fc3 [415043,47936] 0 2024-09-21T08:02:49.205 INFO:tasks.workunit.client.0.smithi107.stdout:6/727: rmdir d2/d3/d7/d2a 39 2024-09-21T08:02:49.205 INFO:tasks.workunit.client.0.smithi107.stdout:6/728: readlink d2/d3/le2 0 2024-09-21T08:02:49.207 INFO:tasks.workunit.client.0.smithi107.stdout:2/586: dwrite d1/d16/f61 [0,4194304] 0 2024-09-21T08:02:49.210 INFO:tasks.workunit.client.0.smithi107.stdout:6/729: dread d2/d3/d7/d3f/f60 [0,4194304] 0 2024-09-21T08:02:49.211 INFO:tasks.workunit.client.0.smithi107.stdout:2/587: creat d1/d16/d35/fc6 x:0 0 0 2024-09-21T08:02:49.212 INFO:tasks.workunit.client.0.smithi107.stdout:2/588: read d1/d2/d6d/f6c [52422,3798] 0 2024-09-21T08:02:49.212 INFO:tasks.workunit.client.0.smithi107.stdout:2/589: write d1/d16/f60 [307382,119370] 0 2024-09-21T08:02:49.214 INFO:tasks.workunit.client.0.smithi107.stdout:6/730: mknod d2/d3/d7/d79/cf3 0 2024-09-21T08:02:49.214 INFO:tasks.workunit.client.0.smithi107.stdout:6/731: fdatasync d2/d3/d7/d23/f6a 0 2024-09-21T08:02:49.215 INFO:tasks.workunit.client.0.smithi107.stdout:4/657: dread dc/d13/d40/f52 [0,4194304] 0 2024-09-21T08:02:49.217 INFO:tasks.workunit.client.0.smithi107.stdout:6/732: mkdir d2/df4 0 2024-09-21T08:02:49.217 INFO:tasks.workunit.client.0.smithi107.stdout:6/733: write d2/d3/d7/f42 [4756141,47154] 0 2024-09-21T08:02:49.217 INFO:tasks.workunit.client.0.smithi107.stdout:2/590: dread d1/d1e/f5c [0,4194304] 0 2024-09-21T08:02:49.219 INFO:tasks.workunit.client.0.smithi107.stdout:4/658: creat dc/d13/d40/d5e/da8/fd1 x:0 0 0 2024-09-21T08:02:49.223 INFO:tasks.workunit.client.0.smithi107.stdout:6/734: stat d2/d3/d7/l16 0 2024-09-21T08:02:49.230 INFO:tasks.workunit.client.0.smithi107.stdout:2/591: dread d1/d16/f60 [0,4194304] 0 2024-09-21T08:02:49.230 INFO:tasks.workunit.client.0.smithi107.stdout:2/592: chown d1/d1e/c6a 2 1 2024-09-21T08:02:49.232 INFO:tasks.workunit.client.0.smithi107.stdout:2/593: getdents d1/d2/d6d/d37/d49/d85 0 2024-09-21T08:02:49.232 INFO:tasks.workunit.client.0.smithi107.stdout:3/700: dwrite d8/f30 [0,4194304] 0 2024-09-21T08:02:49.233 INFO:tasks.workunit.client.0.smithi107.stdout:3/701: read d8/d2b/d45/dcc/f1e [891763,127715] 0 2024-09-21T08:02:49.233 INFO:tasks.workunit.client.0.smithi107.stdout:4/659: dwrite dc/d13/d40/d5e/da8/fd1 [0,4194304] 0 2024-09-21T08:02:49.234 INFO:tasks.workunit.client.0.smithi107.stdout:2/594: mknod d1/d2/d6d/d42/db0/db8/cc7 0 2024-09-21T08:02:49.239 INFO:tasks.workunit.client.0.smithi107.stdout:3/702: creat d8/d21/ff1 x:0 0 0 2024-09-21T08:02:49.244 INFO:tasks.workunit.client.0.smithi107.stdout:4/660: mknod dc/d4c/cd2 0 2024-09-21T08:02:49.246 INFO:tasks.workunit.client.0.smithi107.stdout:3/703: truncate d8/d25/d3d/f51 297854 0 2024-09-21T08:02:49.250 INFO:tasks.workunit.client.0.smithi107.stdout:3/704: mkdir d8/d2b/d91/df2 0 2024-09-21T08:02:49.261 INFO:tasks.workunit.client.0.smithi107.stdout:2/595: dwrite d1/d2/d6d/d37/d49/d7f/f99 [4194304,4194304] 0 2024-09-21T08:02:49.261 INFO:tasks.workunit.client.0.smithi107.stdout:4/661: dread dc/d13/f57 [0,4194304] 0 2024-09-21T08:02:49.263 INFO:tasks.workunit.client.0.smithi107.stdout:2/596: mkdir d1/dc8 0 2024-09-21T08:02:49.266 INFO:tasks.workunit.client.0.smithi107.stdout:4/662: rename dc/d13/d40/d80/fbb to dc/d64/d6b/dcf/fd3 0 2024-09-21T08:02:49.266 INFO:tasks.workunit.client.0.smithi107.stdout:4/663: stat dc/d13/d40/d5e/d98/dbe 0 2024-09-21T08:02:49.267 INFO:tasks.workunit.client.0.smithi107.stdout:2/597: creat d1/d2/d6d/d37/d82/fc9 x:0 0 0 2024-09-21T08:02:49.268 INFO:tasks.workunit.client.0.smithi107.stdout:2/598: write d1/d16/d35/f50 [553107,127873] 0 2024-09-21T08:02:49.268 INFO:tasks.workunit.client.0.smithi107.stdout:2/599: readlink d1/d2/d6d/l7e 0 2024-09-21T08:02:49.271 INFO:tasks.workunit.client.0.smithi107.stdout:4/664: getdents dc/d13/d40/d5e/d77/d99/daa 0 2024-09-21T08:02:49.275 INFO:tasks.workunit.client.0.smithi107.stdout:3/705: dwrite d8/d21/f75 [0,4194304] 0 2024-09-21T08:02:49.276 INFO:tasks.workunit.client.0.smithi107.stdout:4/665: creat dc/d13/d40/d46/d48/fd4 x:0 0 0 2024-09-21T08:02:49.276 INFO:tasks.workunit.client.0.smithi107.stdout:4/666: write dc/d13/d40/d46/fc0 [1002305,2089] 0 2024-09-21T08:02:49.277 INFO:tasks.workunit.client.0.smithi107.stdout:3/706: dread d8/d25/d3d/f51 [0,4194304] 0 2024-09-21T08:02:49.278 INFO:tasks.workunit.client.0.smithi107.stdout:3/707: dread - d8/d2b/d52/d71/db3/dc2/ff0 zero size 2024-09-21T08:02:49.280 INFO:tasks.workunit.client.0.smithi107.stdout:4/667: symlink dc/d60/d8c/ld5 0 2024-09-21T08:02:49.282 INFO:tasks.workunit.client.0.smithi107.stdout:3/708: link d8/d44/l93 d8/d2b/d91/lf3 0 2024-09-21T08:02:49.282 INFO:tasks.workunit.client.0.smithi107.stdout:3/709: readlink d8/d2b/l4d 0 2024-09-21T08:02:49.283 INFO:tasks.workunit.client.0.smithi107.stdout:4/668: rename dc/d13/f5d to dc/d13/d40/d5e/da8/fd6 0 2024-09-21T08:02:49.284 INFO:tasks.workunit.client.0.smithi107.stdout:3/710: symlink d8/d25/d34/dd0/lf4 0 2024-09-21T08:02:49.285 INFO:tasks.workunit.client.0.smithi107.stdout:3/711: mkdir d8/d2b/d45/dcc/df5 0 2024-09-21T08:02:49.285 INFO:tasks.workunit.client.0.smithi107.stdout:3/712: getdents d8/d25/d3d 0 2024-09-21T08:02:49.290 INFO:tasks.workunit.client.0.smithi107.stdout:2/600: dwrite d1/d2/fba [0,4194304] 0 2024-09-21T08:02:49.290 INFO:tasks.workunit.client.0.smithi107.stdout:2/601: write d1/d2/d6d/f71 [857433,56549] 0 2024-09-21T08:02:49.290 INFO:tasks.workunit.client.0.smithi107.stdout:2/602: chown d1/d2/d6d/d42 1 1 2024-09-21T08:02:49.290 INFO:tasks.workunit.client.0.smithi107.stdout:2/603: write d1/d2/d6d/d37/d49/d85/f97 [1023976,127729] 0 2024-09-21T08:02:49.292 INFO:tasks.workunit.client.0.smithi107.stdout:2/604: mknod d1/cca 0 2024-09-21T08:02:49.302 INFO:tasks.workunit.client.0.smithi107.stdout:2/605: write d1/d16/d35/f59 [2944385,8437] 0 2024-09-21T08:02:49.302 INFO:tasks.workunit.client.0.smithi107.stdout:2/606: write d1/d1e/f3e [2101913,45857] 0 2024-09-21T08:02:49.310 INFO:tasks.workunit.client.0.smithi107.stdout:2/607: write d1/f26 [211375,21358] 0 2024-09-21T08:02:49.311 INFO:tasks.workunit.client.0.smithi107.stdout:2/608: creat d1/d16/d35/fcb x:0 0 0 2024-09-21T08:02:49.311 INFO:tasks.workunit.client.0.smithi107.stdout:2/609: write d1/d6/f18 [3757997,3205] 0 2024-09-21T08:02:49.312 INFO:tasks.workunit.client.0.smithi107.stdout:2/610: link d1/c11 d1/d2/d6d/d9b/dad/ccc 0 2024-09-21T08:02:49.313 INFO:tasks.workunit.client.0.smithi107.stdout:4/669: dwrite dc/fd0 [0,4194304] 0 2024-09-21T08:02:49.314 INFO:tasks.workunit.client.0.smithi107.stdout:3/713: dwrite d8/d25/d34/fbc [0,4194304] 0 2024-09-21T08:02:49.314 INFO:tasks.workunit.client.0.smithi107.stdout:3/714: stat d8/d44/l9a 0 2024-09-21T08:02:49.316 INFO:tasks.workunit.client.0.smithi107.stdout:4/670: link dc/d60/d8c/ld5 dc/d13/d40/d5e/d98/ld7 0 2024-09-21T08:02:49.321 INFO:tasks.workunit.client.0.smithi107.stdout:2/611: read d1/d16/f17 [1612878,64005] 0 2024-09-21T08:02:49.323 INFO:tasks.workunit.client.0.smithi107.stdout:4/671: link dc/c33 dc/d13/d40/d46/d48/d70/dc5/d90/db2/db8/cd8 0 2024-09-21T08:02:49.323 INFO:tasks.workunit.client.0.smithi107.stdout:4/672: creat dc/fd9 x:0 0 0 2024-09-21T08:02:49.323 INFO:tasks.workunit.client.0.smithi107.stdout:4/673: write dc/fcb [1002074,90552] 0 2024-09-21T08:02:49.325 INFO:tasks.workunit.client.0.smithi107.stdout:3/715: getdents d8/d25/d3d/d72/d80/d5d 0 2024-09-21T08:02:49.325 INFO:tasks.workunit.client.0.smithi107.stdout:3/716: write d8/d2b/d52/d55/fc4 [985824,74463] 0 2024-09-21T08:02:49.326 INFO:tasks.workunit.client.0.smithi107.stdout:2/612: rmdir d1/d6/d9e/da3 0 2024-09-21T08:02:49.328 INFO:tasks.workunit.client.0.smithi107.stdout:4/674: mknod dc/d13/d40/dcc/cda 0 2024-09-21T08:02:49.330 INFO:tasks.workunit.client.0.smithi107.stdout:3/717: rename d8/d25/d3d/d72/d80/d5d/d67/cda to d8/d25/d34/cf6 0 2024-09-21T08:02:49.330 INFO:tasks.workunit.client.0.smithi107.stdout:3/718: write d8/f8a [4297924,66883] 0 2024-09-21T08:02:49.330 INFO:tasks.workunit.client.0.smithi107.stdout:3/719: dread - d8/d25/d3d/d72/d80/fd7 zero size 2024-09-21T08:02:49.330 INFO:tasks.workunit.client.0.smithi107.stdout:3/720: chown d8/d2b/d52/d71/db3/dc2 2 1 2024-09-21T08:02:49.335 INFO:tasks.workunit.client.0.smithi107.stdout:4/675: write dc/d4c/f8e [133572,649] 0 2024-09-21T08:02:49.337 INFO:tasks.workunit.client.0.smithi107.stdout:2/613: rmdir d1/d6/d9e 39 2024-09-21T08:02:49.356 INFO:tasks.workunit.client.0.smithi107.stdout:3/721: dwrite d8/d25/d3d/d72/d80/fd7 [0,4194304] 0 2024-09-21T08:02:49.359 INFO:tasks.workunit.client.0.smithi107.stdout:3/722: unlink d8/d14/l78 0 2024-09-21T08:02:49.360 INFO:tasks.workunit.client.0.smithi107.stdout:3/723: symlink d8/d2b/d52/lf7 0 2024-09-21T08:02:49.360 INFO:tasks.workunit.client.0.smithi107.stdout:3/724: dread - d8/d2b/d52/d71/db3/fb4 zero size 2024-09-21T08:02:49.361 INFO:tasks.workunit.client.0.smithi107.stdout:4/676: dwrite dc/d13/d40/d5e/d6e/f71 [0,4194304] 0 2024-09-21T08:02:49.361 INFO:tasks.workunit.client.0.smithi107.stdout:4/677: write dc/d13/d40/f43 [2668447,16190] 0 2024-09-21T08:02:49.361 INFO:tasks.workunit.client.0.smithi107.stdout:4/678: fsync dc/d13/d40/d46/f6c 0 2024-09-21T08:02:49.361 INFO:tasks.workunit.client.0.smithi107.stdout:4/679: write dc/d13/d40/d5e/da8/fd6 [2381710,14502] 0 2024-09-21T08:02:49.361 INFO:tasks.workunit.client.0.smithi107.stdout:2/614: dwrite d1/f31 [0,4194304] 0 2024-09-21T08:02:49.362 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:49 smithi129 ceph-mon[34472]: Reconfiguring node-exporter.smithi107 (dependencies changed)... 2024-09-21T08:02:49.362 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:49 smithi129 ceph-mon[34472]: Deploying daemon node-exporter.smithi107 on smithi107 2024-09-21T08:02:49.362 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:49 smithi129 ceph-mon[34472]: pgmap v16: 65 pgs: 65 active+clean; 2.8 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 235 MiB/s rd, 287 MiB/s wr, 393 op/s 2024-09-21T08:02:49.370 INFO:tasks.workunit.client.0.smithi107.stdout:2/615: dread d1/d2/d6d/f71 [0,4194304] 0 2024-09-21T08:02:49.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:49 smithi107 ceph-mon[27622]: Reconfiguring node-exporter.smithi107 (dependencies changed)... 2024-09-21T08:02:49.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:49 smithi107 ceph-mon[27622]: Deploying daemon node-exporter.smithi107 on smithi107 2024-09-21T08:02:49.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:49 smithi107 ceph-mon[27622]: pgmap v16: 65 pgs: 65 active+clean; 2.8 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 235 MiB/s rd, 287 MiB/s wr, 393 op/s 2024-09-21T08:02:49.759 INFO:tasks.workunit.client.0.smithi107.stdout:1/618: sync 2024-09-21T08:02:49.759 INFO:tasks.workunit.client.0.smithi107.stdout:5/782: sync 2024-09-21T08:02:49.760 INFO:tasks.workunit.client.0.smithi107.stdout:7/509: sync 2024-09-21T08:02:49.760 INFO:tasks.workunit.client.0.smithi107.stdout:0/594: sync 2024-09-21T08:02:49.760 INFO:tasks.workunit.client.0.smithi107.stdout:1/619: stat d0/d19/d2b/d4b/d61/d75 0 2024-09-21T08:02:49.760 INFO:tasks.workunit.client.0.smithi107.stdout:1/620: link d0/d19/l6e d0/d29/d4d/d84/dc5/d5e/ld0 0 2024-09-21T08:02:49.760 INFO:tasks.workunit.client.0.smithi107.stdout:1/621: read - d0/d19/fc4 zero size 2024-09-21T08:02:49.761 INFO:tasks.workunit.client.0.smithi107.stdout:0/595: creat d1/d5/d25/d3d/d20/d29/d55/d91/fc6 x:0 0 0 2024-09-21T08:02:49.762 INFO:tasks.workunit.client.0.smithi107.stdout:0/596: rename d1/d5/d25/d3d/d20/d29/l84 to d1/d5/d25/d3d/d20/lc7 0 2024-09-21T08:02:49.781 INFO:tasks.workunit.client.0.smithi107.stdout:1/622: dread d0/d19/f3b [4194304,4194304] 0 2024-09-21T08:02:49.782 INFO:tasks.workunit.client.0.smithi107.stdout:1/623: rmdir d0/d19/d2b/d4b/d61/d75/dc0 0 2024-09-21T08:02:49.791 INFO:tasks.workunit.client.0.smithi107.stdout:5/783: dwrite d7/de/d1d/d24/d3d/f44 [4194304,4194304] 0 2024-09-21T08:02:49.792 INFO:tasks.workunit.client.0.smithi107.stdout:7/510: dwrite d7/d10/f17 [0,4194304] 0 2024-09-21T08:02:49.792 INFO:tasks.workunit.client.0.smithi107.stdout:7/511: dread - d7/d22/d37/fa7 zero size 2024-09-21T08:02:49.793 INFO:tasks.workunit.client.0.smithi107.stdout:5/784: mkdir d7/de/d1d/d29/d68/ddb/dde/dba/d111 0 2024-09-21T08:02:49.793 INFO:tasks.workunit.client.0.smithi107.stdout:5/785: creat d7/de/d2d/d5d/d60/dc5/f112 x:0 0 0 2024-09-21T08:02:49.793 INFO:tasks.workunit.client.0.smithi107.stdout:5/786: dread - d7/de/d2d/d5d/d60/dc5/f112 zero size 2024-09-21T08:02:49.799 INFO:tasks.workunit.client.0.smithi107.stdout:1/624: read d0/d19/d2b/d4b/d44/d72/d36/f73 [78769,39156] 0 2024-09-21T08:02:49.800 INFO:tasks.workunit.client.0.smithi107.stdout:1/625: stat d0/d29/d4d/d84/dc5/da9/dc7/db5 0 2024-09-21T08:02:49.801 INFO:tasks.workunit.client.0.smithi107.stdout:1/626: truncate d0/d29/d4d/f60 3211290 0 2024-09-21T08:02:49.802 INFO:tasks.workunit.client.0.smithi107.stdout:1/627: creat d0/d29/d4d/d84/dc5/da9/dc7/db5/fd1 x:0 0 0 2024-09-21T08:02:49.804 INFO:tasks.workunit.client.0.smithi107.stdout:1/628: mkdir d0/d19/d2b/d4b/d61/d75/dd2 0 2024-09-21T08:02:49.805 INFO:tasks.workunit.client.0.smithi107.stdout:1/629: chown d0/d29/d4d/d84/dc5/d5e/ld0 113363530 1 2024-09-21T08:02:49.805 INFO:tasks.workunit.client.0.smithi107.stdout:1/630: dread - d0/d19/fc4 zero size 2024-09-21T08:02:49.805 INFO:tasks.workunit.client.0.smithi107.stdout:1/631: unlink d0/d29/da1/fcc 0 2024-09-21T08:02:49.806 INFO:tasks.workunit.client.0.smithi107.stdout:1/632: rmdir d0/d19/d2b/d4b/d44/d72/d36/daf 0 2024-09-21T08:02:49.815 INFO:tasks.workunit.client.0.smithi107.stdout:0/597: dwrite d1/d5/d25/d3d/d20/f7d [0,4194304] 0 2024-09-21T08:02:49.815 INFO:tasks.workunit.client.0.smithi107.stdout:0/598: write d1/d6f/d80/f88 [346884,72507] 0 2024-09-21T08:02:49.818 INFO:tasks.workunit.client.0.smithi107.stdout:0/599: creat d1/d6f/dc1/fc8 x:0 0 0 2024-09-21T08:02:49.818 INFO:tasks.workunit.client.0.smithi107.stdout:0/600: chown d1/d5/d25/d3d/lad 24102085 1 2024-09-21T08:02:49.820 INFO:tasks.workunit.client.0.smithi107.stdout:1/633: dread d0/f71 [0,4194304] 0 2024-09-21T08:02:49.820 INFO:tasks.workunit.client.0.smithi107.stdout:7/512: dwrite d7/d22/d3b/fa3 [0,4194304] 0 2024-09-21T08:02:49.821 INFO:tasks.workunit.client.0.smithi107.stdout:5/787: dwrite d7/de/d2d/fcd [0,4194304] 0 2024-09-21T08:02:49.821 INFO:tasks.workunit.client.0.smithi107.stdout:0/601: rename d1/d5/d25/d3d/d20/d29/f2e to d1/d5/d75/fc9 0 2024-09-21T08:02:49.821 INFO:tasks.workunit.client.0.smithi107.stdout:0/602: chown d1/d5/d25/d9e/fa4 76 1 2024-09-21T08:02:49.822 INFO:tasks.workunit.client.0.smithi107.stdout:1/634: creat d0/d19/d2b/d4b/d44/d72/d36/d8e/fd3 x:0 0 0 2024-09-21T08:02:49.827 INFO:tasks.workunit.client.0.smithi107.stdout:7/513: creat d7/d22/fb4 x:0 0 0 2024-09-21T08:02:49.827 INFO:tasks.workunit.client.0.smithi107.stdout:7/514: fsync d7/fa9 0 2024-09-21T08:02:49.827 INFO:tasks.workunit.client.0.smithi107.stdout:0/603: dread d1/d23/f2a [0,4194304] 0 2024-09-21T08:02:49.830 INFO:tasks.workunit.client.0.smithi107.stdout:0/604: dread d1/d6f/f89 [0,4194304] 0 2024-09-21T08:02:49.837 INFO:tasks.workunit.client.0.smithi107.stdout:1/635: fsync d0/d19/d2b/d4b/d44/d72/d36/d8e/fd3 0 2024-09-21T08:02:49.837 INFO:tasks.workunit.client.0.smithi107.stdout:1/636: creat d0/d29/d4d/d84/dc5/da9/dc7/db5/fd4 x:0 0 0 2024-09-21T08:02:49.837 INFO:tasks.workunit.client.0.smithi107.stdout:1/637: write d0/dc6/fb2 [401691,70181] 0 2024-09-21T08:02:49.837 INFO:tasks.workunit.client.0.smithi107.stdout:1/638: truncate d0/d19/d2b/d4b/d44/d72/f78 4579761 0 2024-09-21T08:02:49.837 INFO:tasks.workunit.client.0.smithi107.stdout:7/515: dread d7/d22/d3a/fa5 [0,4194304] 0 2024-09-21T08:02:49.844 INFO:tasks.workunit.client.0.smithi107.stdout:5/788: mkdir d7/de/d1d/d29/d68/ddb/dde/dba/d113 0 2024-09-21T08:02:49.848 INFO:tasks.workunit.client.0.smithi107.stdout:0/605: rename d1/d5/d25/d2d/d8e/fb0 to d1/d5/d25/d3d/d20/d29/d55/d91/d9a/fca 0 2024-09-21T08:02:49.848 INFO:tasks.workunit.client.0.smithi107.stdout:0/606: readlink d1/l70 0 2024-09-21T08:02:49.850 INFO:tasks.workunit.client.0.smithi107.stdout:9/780: sync 2024-09-21T08:02:49.851 INFO:tasks.workunit.client.0.smithi107.stdout:8/578: sync 2024-09-21T08:02:49.852 INFO:tasks.workunit.client.0.smithi107.stdout:1/639: dwrite d0/d29/d4d/d84/dc5/d5e/f99 [0,4194304] 0 2024-09-21T08:02:49.852 INFO:tasks.workunit.client.0.smithi107.stdout:1/640: write d0/d29/d4d/d84/dc5/d5e/f69 [4336316,92605] 0 2024-09-21T08:02:49.852 INFO:tasks.workunit.client.0.smithi107.stdout:7/516: creat d7/d22/d37/d5a/d83/d9e/fb5 x:0 0 0 2024-09-21T08:02:49.855 INFO:tasks.workunit.client.0.smithi107.stdout:5/789: creat d7/de/d1d/d29/d68/ddb/f114 x:0 0 0 2024-09-21T08:02:49.857 INFO:tasks.workunit.client.0.smithi107.stdout:0/607: rename d1/d5/d25/d3d/d20/d85/d8a/fb7 to d1/d5/d25/d3d/d20/d29/d55/fcb 0 2024-09-21T08:02:49.857 INFO:tasks.workunit.client.0.smithi107.stdout:3/725: sync 2024-09-21T08:02:49.857 INFO:tasks.workunit.client.0.smithi107.stdout:6/735: sync 2024-09-21T08:02:49.857 INFO:tasks.workunit.client.0.smithi107.stdout:4/680: sync 2024-09-21T08:02:49.857 INFO:tasks.workunit.client.0.smithi107.stdout:2/616: sync 2024-09-21T08:02:49.861 INFO:tasks.workunit.client.0.smithi107.stdout:9/781: truncate d11/d24/d26/dd0/dec/f91 3905300 0 2024-09-21T08:02:49.863 INFO:tasks.workunit.client.0.smithi107.stdout:8/579: truncate d5/d1d/f3a 2264712 0 2024-09-21T08:02:49.863 INFO:tasks.workunit.client.0.smithi107.stdout:8/580: write d5/d23/f9d [584663,44162] 0 2024-09-21T08:02:49.866 INFO:tasks.workunit.client.0.smithi107.stdout:1/641: mknod d0/d29/d4d/d84/dc3/cd5 0 2024-09-21T08:02:49.871 INFO:tasks.workunit.client.0.smithi107.stdout:5/790: rename d7/de/d2d/d5d/d60/laa to d7/de/d1d/d29/d68/ddb/dde/dd8/d105/l115 0 2024-09-21T08:02:49.874 INFO:tasks.workunit.client.0.smithi107.stdout:0/608: mkdir d1/d6f/dc1/dcc 0 2024-09-21T08:02:49.874 INFO:tasks.workunit.client.0.smithi107.stdout:0/609: chown d1/d5/d25/d3d/d20/lc7 4608 1 2024-09-21T08:02:49.876 INFO:tasks.workunit.client.0.smithi107.stdout:6/736: creat d2/d3/d7/d48/da3/d85/dd9/ff5 x:0 0 0 2024-09-21T08:02:49.876 INFO:tasks.workunit.client.0.smithi107.stdout:6/737: write d2/d3/f4 [7862742,54331] 0 2024-09-21T08:02:49.877 INFO:tasks.workunit.client.0.smithi107.stdout:9/782: write d11/f5f [599819,112231] 0 2024-09-21T08:02:49.877 INFO:tasks.workunit.client.0.smithi107.stdout:9/783: fsync d11/d24/d26/f2e 0 2024-09-21T08:02:49.877 INFO:tasks.workunit.client.0.smithi107.stdout:9/784: chown d11/d24/d26/f2e 33054 1 2024-09-21T08:02:49.877 INFO:tasks.workunit.client.0.smithi107.stdout:9/785: read - d11/d27/fe8 zero size 2024-09-21T08:02:49.879 INFO:tasks.workunit.client.0.smithi107.stdout:2/617: getdents d1/d2/d6d/d42/db0/db8 0 2024-09-21T08:02:49.880 INFO:tasks.workunit.client.0.smithi107.stdout:1/642: truncate d0/d29/d4d/f60 81894 0 2024-09-21T08:02:49.880 INFO:tasks.workunit.client.0.smithi107.stdout:8/581: dread d5/d23/f57 [0,4194304] 0 2024-09-21T08:02:49.882 INFO:tasks.workunit.client.0.smithi107.stdout:9/786: creat d11/d24/d6e/db9/f11c x:0 0 0 2024-09-21T08:02:49.882 INFO:tasks.workunit.client.0.smithi107.stdout:9/787: chown d11/d27/d2f/d38/dbf/dda 11331 1 2024-09-21T08:02:49.882 INFO:tasks.workunit.client.0.smithi107.stdout:2/618: mknod d1/d2/d6d/d9b/dad/ccd 0 2024-09-21T08:02:49.883 INFO:tasks.workunit.client.0.smithi107.stdout:1/643: truncate d0/d19/d2b/d4b/d44/d72/d36/d8e/fb0 632249 0 2024-09-21T08:02:49.885 INFO:tasks.workunit.client.0.smithi107.stdout:8/582: link d5/c83 d5/d38/d56/d52/d7a/cc9 0 2024-09-21T08:02:49.888 INFO:tasks.workunit.client.0.smithi107.stdout:2/619: mkdir d1/d6/d92/dce 0 2024-09-21T08:02:49.890 INFO:tasks.workunit.client.0.smithi107.stdout:8/583: write d5/db9/fc3 [5448882,90207] 0 2024-09-21T08:02:49.890 INFO:tasks.workunit.client.0.smithi107.stdout:1/644: symlink d0/d29/d4d/d84/dc5/da9/dc7/dc8/ld6 0 2024-09-21T08:02:49.890 INFO:tasks.workunit.client.0.smithi107.stdout:1/645: chown d0/d19/d2b/d4b/d61/d75/dd2 675720 1 2024-09-21T08:02:49.892 INFO:tasks.workunit.client.0.smithi107.stdout:8/584: mkdir d5/d44/db7/dca 0 2024-09-21T08:02:49.893 INFO:tasks.workunit.client.0.smithi107.stdout:8/585: mkdir d5/d40/d8a/dcb 0 2024-09-21T08:02:49.893 INFO:tasks.workunit.client.0.smithi107.stdout:8/586: readlink d5/d38/d56/d52/l95 0 2024-09-21T08:02:49.897 INFO:tasks.workunit.client.0.smithi107.stdout:9/788: write d11/d27/d2f/fce [3826998,41937] 0 2024-09-21T08:02:49.904 INFO:tasks.workunit.client.0.smithi107.stdout:2/620: dread d1/d16/f17 [0,4194304] 0 2024-09-21T08:02:49.905 INFO:tasks.workunit.client.0.smithi107.stdout:2/621: rmdir d1/d2/d6d/d42/db0 39 2024-09-21T08:02:49.905 INFO:tasks.workunit.client.0.smithi107.stdout:2/622: stat d1/d16 0 2024-09-21T08:02:49.907 INFO:tasks.workunit.client.0.smithi107.stdout:2/623: link d1/d2/cd d1/d2/d6d/d37/ccf 0 2024-09-21T08:02:49.908 INFO:tasks.workunit.client.0.smithi107.stdout:2/624: creat d1/d2/fd0 x:0 0 0 2024-09-21T08:02:49.908 INFO:tasks.workunit.client.0.smithi107.stdout:2/625: chown d1/d2/d6d/d42 1015783 1 2024-09-21T08:02:49.908 INFO:tasks.workunit.client.0.smithi107.stdout:2/626: write d1/d2/d6d/d37/f94 [943103,78832] 0 2024-09-21T08:02:49.911 INFO:tasks.workunit.client.0.smithi107.stdout:9/789: dread d11/d24/d35/f4e [0,4194304] 0 2024-09-21T08:02:49.911 INFO:tasks.workunit.client.0.smithi107.stdout:9/790: readlink d11/d27/l8d 0 2024-09-21T08:02:49.911 INFO:tasks.workunit.client.0.smithi107.stdout:5/791: dwrite d7/de/d2d/d5d/d60/dc5/fe0 [0,4194304] 0 2024-09-21T08:02:49.913 INFO:tasks.workunit.client.0.smithi107.stdout:3/726: dwrite d8/d25/d3d/d72/d80/fd7 [0,4194304] 0 2024-09-21T08:02:49.913 INFO:tasks.workunit.client.0.smithi107.stdout:3/727: dread - d8/d2b/d52/d71/db3/dc2/ff0 zero size 2024-09-21T08:02:49.914 INFO:tasks.workunit.client.0.smithi107.stdout:5/792: rmdir d7/de/d1d/d29/d68/ddb/dde/df7/d10d 0 2024-09-21T08:02:49.915 INFO:tasks.workunit.client.0.smithi107.stdout:6/738: dwrite d2/d2e/d97/f88 [0,4194304] 0 2024-09-21T08:02:49.915 INFO:tasks.workunit.client.0.smithi107.stdout:6/739: write d2/d3/d7/d24/d41/fa0 [471264,66134] 0 2024-09-21T08:02:49.915 INFO:tasks.workunit.client.0.smithi107.stdout:6/740: chown d2/d3/d7/d48/da3/d85/dd9 4 1 2024-09-21T08:02:49.915 INFO:tasks.workunit.client.0.smithi107.stdout:6/741: chown d2/d3/d7/d24/d41/l61 31 1 2024-09-21T08:02:49.915 INFO:tasks.workunit.client.0.smithi107.stdout:6/742: chown d2/d3/d67 173377696 1 2024-09-21T08:02:49.915 INFO:tasks.workunit.client.0.smithi107.stdout:1/646: dwrite d0/d19/d39/f96 [0,4194304] 0 2024-09-21T08:02:49.916 INFO:tasks.workunit.client.0.smithi107.stdout:2/627: dread d1/d1e/f79 [0,4194304] 0 2024-09-21T08:02:49.917 INFO:tasks.workunit.client.0.smithi107.stdout:4/681: dwrite dc/d13/f18 [0,4194304] 0 2024-09-21T08:02:49.917 INFO:tasks.workunit.client.0.smithi107.stdout:9/791: dread d11/d27/d2f/d38/daa/ffd [0,4194304] 0 2024-09-21T08:02:49.918 INFO:tasks.workunit.client.0.smithi107.stdout:3/728: creat d8/d25/d42/dae/db1/ff8 x:0 0 0 2024-09-21T08:02:49.918 INFO:tasks.workunit.client.0.smithi107.stdout:3/729: dread - d8/d2b/d45/fc1 zero size 2024-09-21T08:02:49.918 INFO:tasks.workunit.client.0.smithi107.stdout:3/730: write d8/d2b/d52/fb6 [341064,55136] 0 2024-09-21T08:02:49.918 INFO:tasks.workunit.client.0.smithi107.stdout:0/610: rmdir d1/d6f/dc1 39 2024-09-21T08:02:49.919 INFO:tasks.workunit.client.0.smithi107.stdout:5/793: symlink d7/de/d1d/d29/d68/ddb/dde/l116 0 2024-09-21T08:02:49.919 INFO:tasks.workunit.client.0.smithi107.stdout:5/794: chown d7/de/d1d/fb6 207 1 2024-09-21T08:02:49.921 INFO:tasks.workunit.client.0.smithi107.stdout:5/795: dread d7/de/d1d/d24/fae [0,4194304] 0 2024-09-21T08:02:49.925 INFO:tasks.workunit.client.0.smithi107.stdout:6/743: creat d2/d2e/d97/ff6 x:0 0 0 2024-09-21T08:02:49.925 INFO:tasks.workunit.client.0.smithi107.stdout:6/744: fsync d2/d3/d7/d23/d2b/fbc 0 2024-09-21T08:02:49.929 INFO:tasks.workunit.client.0.smithi107.stdout:2/628: creat d1/d2/d6d/d37/d49/d7f/fd1 x:0 0 0 2024-09-21T08:02:49.930 INFO:tasks.workunit.client.0.smithi107.stdout:1/647: mkdir d0/d19/d2b/d4b/d44/d72/d36/d8e/dd7 0 2024-09-21T08:02:49.931 INFO:tasks.workunit.client.0.smithi107.stdout:2/629: dread d1/d2/d6d/f5f [0,4194304] 0 2024-09-21T08:02:49.932 INFO:tasks.workunit.client.0.smithi107.stdout:2/630: readlink d1/l8e 0 2024-09-21T08:02:49.933 INFO:tasks.workunit.client.0.smithi107.stdout:9/792: unlink d11/l95 0 2024-09-21T08:02:49.936 INFO:tasks.workunit.client.0.smithi107.stdout:4/682: rename dc/f3f to dc/d13/d5a/d9b/dbc/fdb 0 2024-09-21T08:02:49.936 INFO:tasks.workunit.client.0.smithi107.stdout:4/683: truncate f8 2303132 0 2024-09-21T08:02:49.937 INFO:tasks.workunit.client.0.smithi107.stdout:3/731: link d8/d25/d34/cd5 d8/d87/dc9/cf9 0 2024-09-21T08:02:49.937 INFO:tasks.workunit.client.0.smithi107.stdout:3/732: truncate d8/d25/fea 959878 0 2024-09-21T08:02:49.937 INFO:tasks.workunit.client.0.smithi107.stdout:3/733: fdatasync d8/fec 0 2024-09-21T08:02:49.940 INFO:tasks.workunit.client.0.smithi107.stdout:0/611: symlink d1/d5/d25/d3d/d20/lcd 0 2024-09-21T08:02:49.941 INFO:tasks.workunit.client.0.smithi107.stdout:5/796: creat d7/de/d1d/d29/d68/ddb/dde/dd8/d105/f117 x:0 0 0 2024-09-21T08:02:49.946 INFO:tasks.workunit.client.0.smithi107.stdout:9/793: creat d11/d27/d2f/d38/daa/f11d x:0 0 0 2024-09-21T08:02:49.946 INFO:tasks.workunit.client.0.smithi107.stdout:9/794: chown d11/d24/d26/cf5 55 1 2024-09-21T08:02:49.949 INFO:tasks.workunit.client.0.smithi107.stdout:1/648: dwrite d0/d19/d2b/d4b/d44/d72/f1d [8388608,4194304] 0 2024-09-21T08:02:49.949 INFO:tasks.workunit.client.0.smithi107.stdout:6/745: rename d2/d3/d7/d24/f59 to d2/d2e/ff7 0 2024-09-21T08:02:49.951 INFO:tasks.workunit.client.0.smithi107.stdout:4/684: link dc/d13/d40/d5e/l81 dc/d13/d40/d46/d48/d70/dc5/ldc 0 2024-09-21T08:02:49.952 INFO:tasks.workunit.client.0.smithi107.stdout:0/612: dread d1/d5/d25/d3d/d20/f51 [0,4194304] 0 2024-09-21T08:02:49.954 INFO:tasks.workunit.client.0.smithi107.stdout:3/734: symlink d8/d2b/d91/de5/lfa 0 2024-09-21T08:02:49.955 INFO:tasks.workunit.client.0.smithi107.stdout:5/797: creat d7/de/d1d/d29/d64/d100/f118 x:0 0 0 2024-09-21T08:02:49.957 INFO:tasks.workunit.client.0.smithi107.stdout:2/631: getdents d1/d16/d35 0 2024-09-21T08:02:49.957 INFO:tasks.workunit.client.0.smithi107.stdout:2/632: chown d1/d2/d6d/d42/d76/cb1 854783 1 2024-09-21T08:02:49.957 INFO:tasks.workunit.client.0.smithi107.stdout:2/633: stat d1/c87 0 2024-09-21T08:02:49.958 INFO:tasks.workunit.client.0.smithi107.stdout:9/795: mkdir d11/d27/d2f/d4d/d5c/d61/d11e 0 2024-09-21T08:02:49.963 INFO:tasks.workunit.client.0.smithi107.stdout:1/649: unlink d0/d19/l7a 0 2024-09-21T08:02:49.964 INFO:tasks.workunit.client.0.smithi107.stdout:4/685: write dc/d64/f79 [3297237,18278] 0 2024-09-21T08:02:49.970 INFO:tasks.workunit.client.0.smithi107.stdout:2/634: write d1/d2/fba [3226206,10683] 0 2024-09-21T08:02:49.971 INFO:tasks.workunit.client.0.smithi107.stdout:9/796: dread d11/d27/d2f/d4d/d5c/fa2 [0,4194304] 0 2024-09-21T08:02:49.974 INFO:tasks.workunit.client.0.smithi107.stdout:6/746: symlink d2/d3/d7/d48/da3/d85/lf8 0 2024-09-21T08:02:49.977 INFO:tasks.workunit.client.0.smithi107.stdout:0/613: getdents d1/d5/d25/d3d/d20/d85 0 2024-09-21T08:02:49.977 INFO:tasks.workunit.client.0.smithi107.stdout:4/686: write dc/fe [5898751,111558] 0 2024-09-21T08:02:49.977 INFO:tasks.workunit.client.0.smithi107.stdout:4/687: write dc/d13/d40/d46/d48/d70/f94 [4619402,121239] 0 2024-09-21T08:02:49.979 INFO:tasks.workunit.client.0.smithi107.stdout:3/735: rename d8/d38/f97 to d8/d25/d3d/ffb 0 2024-09-21T08:02:49.979 INFO:tasks.workunit.client.0.smithi107.stdout:3/736: chown d8/d2b/d91/lf3 1963639 1 2024-09-21T08:02:49.979 INFO:tasks.workunit.client.0.smithi107.stdout:3/737: chown d8/d2b/d91/fe7 376 1 2024-09-21T08:02:49.979 INFO:tasks.workunit.client.0.smithi107.stdout:1/650: dwrite d0/d19/fc4 [0,4194304] 0 2024-09-21T08:02:49.979 INFO:tasks.workunit.client.0.smithi107.stdout:1/651: fdatasync d0/d19/d2b/d4b/f4c 0 2024-09-21T08:02:49.986 INFO:tasks.workunit.client.0.smithi107.stdout:5/798: mknod d7/de/d2d/d5d/d60/dc5/c119 0 2024-09-21T08:02:49.986 INFO:tasks.workunit.client.0.smithi107.stdout:5/799: creat d7/d70/f11a x:0 0 0 2024-09-21T08:02:49.989 INFO:tasks.workunit.client.0.smithi107.stdout:2/635: rmdir d1/d16/d9c 39 2024-09-21T08:02:49.993 INFO:tasks.workunit.client.0.smithi107.stdout:1/652: symlink d0/d19/d2b/d86/da4/ld8 0 2024-09-21T08:02:49.994 INFO:tasks.workunit.client.0.smithi107.stdout:2/636: truncate d1/f26 3995397 0 2024-09-21T08:02:49.994 INFO:tasks.workunit.client.0.smithi107.stdout:2/637: chown d1/d2/d6d/d42/c64 19 1 2024-09-21T08:02:49.996 INFO:tasks.workunit.client.0.smithi107.stdout:0/614: rename d1/d5/c65 to d1/d5/d25/d3d/d20/d29/d5c/cce 0 2024-09-21T08:02:49.996 INFO:tasks.workunit.client.0.smithi107.stdout:1/653: mkdir d0/d19/d2b/d86/dd9 0 2024-09-21T08:02:49.997 INFO:tasks.workunit.client.0.smithi107.stdout:4/688: rename dc/d13/d5a/fae to dc/d13/d40/d5e/da8/fdd 0 2024-09-21T08:02:49.998 INFO:tasks.workunit.client.0.smithi107.stdout:1/654: creat d0/d29/d4d/d84/dc5/da9/fda x:0 0 0 2024-09-21T08:02:49.998 INFO:tasks.workunit.client.0.smithi107.stdout:1/655: chown d0/d19/d2b/cb7 258 1 2024-09-21T08:02:49.999 INFO:tasks.workunit.client.0.smithi107.stdout:5/800: rename d7/d74 to d7/de/d1d/d29/d68/ddb/d11b 0 2024-09-21T08:02:49.999 INFO:tasks.workunit.client.0.smithi107.stdout:5/801: fdatasync d7/de/d52/ffb 0 2024-09-21T08:02:50.000 INFO:tasks.workunit.client.0.smithi107.stdout:4/689: creat dc/d13/d40/fde x:0 0 0 2024-09-21T08:02:50.000 INFO:tasks.workunit.client.0.smithi107.stdout:4/690: truncate dc/d13/d40/d80/fce 316746 0 2024-09-21T08:02:50.001 INFO:tasks.workunit.client.0.smithi107.stdout:1/656: rmdir d0/d29/d4d/d84/dc5/da9/dc7 39 2024-09-21T08:02:50.002 INFO:tasks.workunit.client.0.smithi107.stdout:3/738: dwrite d8/d21/f36 [0,4194304] 0 2024-09-21T08:02:50.002 INFO:tasks.workunit.client.0.smithi107.stdout:3/739: fdatasync d8/d2b/d52/d71/fc8 0 2024-09-21T08:02:50.002 INFO:tasks.workunit.client.0.smithi107.stdout:3/740: fdatasync d8/d2b/d52/d71/fc8 0 2024-09-21T08:02:50.002 INFO:tasks.workunit.client.0.smithi107.stdout:2/638: rename d1/d16/d35/fcb to d1/d2/d6d/d37/fd2 0 2024-09-21T08:02:50.004 INFO:tasks.workunit.client.0.smithi107.stdout:6/747: dwrite d2/d2e/d97/f6f [4194304,4194304] 0 2024-09-21T08:02:50.006 INFO:tasks.workunit.client.0.smithi107.stdout:9/797: dwrite d11/d27/d98/f6c [0,4194304] 0 2024-09-21T08:02:50.006 INFO:tasks.workunit.client.0.smithi107.stdout:9/798: write d11/d27/d5e/df1/d105/fc8 [675234,52633] 0 2024-09-21T08:02:50.006 INFO:tasks.workunit.client.0.smithi107.stdout:9/799: read d11/d27/d2f/d4d/d5c/d61/f64 [508741,40719] 0 2024-09-21T08:02:50.006 INFO:tasks.workunit.client.0.smithi107.stdout:5/802: mknod d7/de/da3/c11c 0 2024-09-21T08:02:50.007 INFO:tasks.workunit.client.0.smithi107.stdout:1/657: getdents d0/d29/d4d/d84/dc3 0 2024-09-21T08:02:50.007 INFO:tasks.workunit.client.0.smithi107.stdout:1/658: chown d0/d29/d4d/d84 23306 1 2024-09-21T08:02:50.011 INFO:tasks.workunit.client.0.smithi107.stdout:0/615: write d1/d5/d25/d3d/d20/d29/d55/d7a/f83 [3885963,3352] 0 2024-09-21T08:02:50.011 INFO:tasks.workunit.client.0.smithi107.stdout:0/616: write d1/d5/d25/d3d/d20/d29/d55/d7a/f83 [2626267,108920] 0 2024-09-21T08:02:50.012 INFO:tasks.workunit.client.0.smithi107.stdout:1/659: dread d0/d19/f33 [0,4194304] 0 2024-09-21T08:02:50.019 INFO:tasks.workunit.client.0.smithi107.stdout:3/741: write d8/f1b [2427538,71792] 0 2024-09-21T08:02:50.019 INFO:tasks.workunit.client.0.smithi107.stdout:3/742: write d8/d2b/d45/dbf/fd1 [937875,2495] 0 2024-09-21T08:02:50.023 INFO:tasks.workunit.client.0.smithi107.stdout:5/803: rename d7/de/d52/d6b/lb3 to d7/de/d1d/d29/d68/ddb/dde/dd8/dff/l11d 0 2024-09-21T08:02:50.025 INFO:tasks.workunit.client.0.smithi107.stdout:1/660: dread d0/d19/fc4 [0,4194304] 0 2024-09-21T08:02:50.025 INFO:tasks.workunit.client.0.smithi107.stdout:1/661: truncate d0/d29/d4d/f60 475188 0 2024-09-21T08:02:50.026 INFO:tasks.workunit.client.0.smithi107.stdout:0/617: link d1/d5/d25/d3d/d20/c74 d1/d5/d25/d3d/d20/d29/d55/d91/ccf 0 2024-09-21T08:02:50.031 INFO:tasks.workunit.client.0.smithi107.stdout:1/662: dread d0/d19/d2b/d4b/f63 [0,4194304] 0 2024-09-21T08:02:50.031 INFO:tasks.workunit.client.0.smithi107.stdout:1/663: getdents d0/dce 0 2024-09-21T08:02:50.032 INFO:tasks.workunit.client.0.smithi107.stdout:4/691: dwrite dc/f31 [0,4194304] 0 2024-09-21T08:02:50.032 INFO:tasks.workunit.client.0.smithi107.stdout:9/800: dwrite d11/d27/d5e/d76/f8c [0,4194304] 0 2024-09-21T08:02:50.033 INFO:tasks.workunit.client.0.smithi107.stdout:2/639: dwrite d1/d16/f60 [0,4194304] 0 2024-09-21T08:02:50.041 INFO:tasks.workunit.client.0.smithi107.stdout:6/748: rmdir d2 39 2024-09-21T08:02:50.044 INFO:tasks.workunit.client.0.smithi107.stdout:0/618: mkdir d1/d5/d25/d3d/d20/d29/dd0 0 2024-09-21T08:02:50.044 INFO:tasks.workunit.client.0.smithi107.stdout:0/619: write d1/d5/fbb [755919,69588] 0 2024-09-21T08:02:50.051 INFO:tasks.workunit.client.0.smithi107.stdout:5/804: dread d7/de/d1d/d29/d64/d87/fbe [0,4194304] 0 2024-09-21T08:02:50.051 INFO:tasks.workunit.client.0.smithi107.stdout:6/749: symlink d2/d3/d7/d3f/lf9 0 2024-09-21T08:02:50.054 INFO:tasks.workunit.client.0.smithi107.stdout:0/620: truncate d1/d5/d75/f7c 2992412 0 2024-09-21T08:02:50.055 INFO:tasks.workunit.client.0.smithi107.stdout:0/621: write d1/d23/f6d [68322,92873] 0 2024-09-21T08:02:50.055 INFO:tasks.workunit.client.0.smithi107.stdout:1/664: getdents d0/d19/d2b/d4b/d61/d75 0 2024-09-21T08:02:50.057 INFO:tasks.workunit.client.0.smithi107.stdout:6/750: mknod d2/d3/d7/d48/da3/d85/d9d/dcf/dd8/cfa 0 2024-09-21T08:02:50.057 INFO:tasks.workunit.client.0.smithi107.stdout:6/751: chown d2/d3/d7/d48/da3 1835 1 2024-09-21T08:02:50.058 INFO:tasks.workunit.client.0.smithi107.stdout:1/665: creat d0/d29/d4d/d84/fdb x:0 0 0 2024-09-21T08:02:50.058 INFO:tasks.workunit.client.0.smithi107.stdout:1/666: write d0/d19/d2b/d4b/f63 [1223404,14837] 0 2024-09-21T08:02:50.060 INFO:tasks.workunit.client.0.smithi107.stdout:6/752: link d2/d3/d67/f56 d2/d2e/db2/ffb 0 2024-09-21T08:02:50.061 INFO:tasks.workunit.client.0.smithi107.stdout:5/805: write d7/de/f30 [2393068,12184] 0 2024-09-21T08:02:50.061 INFO:tasks.workunit.client.0.smithi107.stdout:5/806: write d7/de/d1d/d24/fae [202299,90924] 0 2024-09-21T08:02:50.061 INFO:tasks.workunit.client.0.smithi107.stdout:1/667: creat d0/d19/d2b/d4b/d44/d55/fdc x:0 0 0 2024-09-21T08:02:50.062 INFO:tasks.workunit.client.0.smithi107.stdout:1/668: fdatasync d0/d29/d4d/d84/dc5/da9/dc7/db5/fd4 0 2024-09-21T08:02:50.062 INFO:tasks.workunit.client.0.smithi107.stdout:1/669: fsync d0/d29/d4d/d84/dc5/da9/dc7/f91 0 2024-09-21T08:02:50.062 INFO:tasks.workunit.client.0.smithi107.stdout:6/753: symlink d2/d3/d7/d48/da3/d85/d9d/dcf/lfc 0 2024-09-21T08:02:50.064 INFO:tasks.workunit.client.0.smithi107.stdout:6/754: symlink d2/d3/d7/d23/d2b/lfd 0 2024-09-21T08:02:50.065 INFO:tasks.workunit.client.0.smithi107.stdout:5/807: getdents d7/de/d1d/d29/d68/ddb 0 2024-09-21T08:02:50.065 INFO:tasks.workunit.client.0.smithi107.stdout:5/808: fsync d7/de/d1d/dbc/f10c 0 2024-09-21T08:02:50.065 INFO:tasks.workunit.client.0.smithi107.stdout:5/809: getdents d7/de/d1d/d29/dfc 0 2024-09-21T08:02:50.066 INFO:tasks.workunit.client.0.smithi107.stdout:1/670: dread d0/d19/fc4 [0,4194304] 0 2024-09-21T08:02:50.066 INFO:tasks.workunit.client.0.smithi107.stdout:1/671: dread - d0/d29/d4d/d84/fdb zero size 2024-09-21T08:02:50.067 INFO:tasks.workunit.client.0.smithi107.stdout:6/755: getdents d2/d3/d7/d48/da3 0 2024-09-21T08:02:50.068 INFO:tasks.workunit.client.0.smithi107.stdout:2/640: dwrite d1/d16/f6b [0,4194304] 0 2024-09-21T08:02:50.068 INFO:tasks.workunit.client.0.smithi107.stdout:5/810: fdatasync d7/de/f30 0 2024-09-21T08:02:50.068 INFO:tasks.workunit.client.0.smithi107.stdout:5/811: dread - d7/de/d2d/d5d/d60/dc5/fe7 zero size 2024-09-21T08:02:50.069 INFO:tasks.workunit.client.0.smithi107.stdout:1/672: rename d0/d29/d4d/d84/dc5/da9/dc7/dc8 to d0/d19/ddd 0 2024-09-21T08:02:50.069 INFO:tasks.workunit.client.0.smithi107.stdout:4/692: dwrite dc/f31 [4194304,4194304] 0 2024-09-21T08:02:50.072 INFO:tasks.workunit.client.0.smithi107.stdout:5/812: symlink d7/de/d1d/d29/d68/de9/l11e 0 2024-09-21T08:02:50.075 INFO:tasks.workunit.client.0.smithi107.stdout:1/673: rename d0/d19/d2b/d4b/d61/d75/dd2 to d0/d19/d2b/d4b/d44/d72/dde 0 2024-09-21T08:02:50.076 INFO:tasks.workunit.client.0.smithi107.stdout:4/693: getdents dc/d13/d5a/d9b 0 2024-09-21T08:02:50.078 INFO:tasks.workunit.client.0.smithi107.stdout:2/641: dread d1/d16/f6b [0,4194304] 0 2024-09-21T08:02:50.081 INFO:tasks.workunit.client.0.smithi107.stdout:1/674: dread d0/dc6/fb2 [0,4194304] 0 2024-09-21T08:02:50.083 INFO:tasks.workunit.client.0.smithi107.stdout:6/756: dwrite d2/d3/d7/d2a/fcb [0,4194304] 0 2024-09-21T08:02:50.083 INFO:tasks.workunit.client.0.smithi107.stdout:6/757: getdents d2/df4 0 2024-09-21T08:02:50.085 INFO:tasks.workunit.client.0.smithi107.stdout:4/694: rename dc/fcb to dc/d13/d40/d5e/d98/dbf/fdf 0 2024-09-21T08:02:50.085 INFO:tasks.workunit.client.0.smithi107.stdout:5/813: getdents d7/de/d1d/d29/d64/d100 0 2024-09-21T08:02:50.087 INFO:tasks.workunit.client.0.smithi107.stdout:2/642: creat d1/d2/d6d/d37/d49/d85/fd3 x:0 0 0 2024-09-21T08:02:50.088 INFO:tasks.workunit.client.0.smithi107.stdout:1/675: link d0/d29/d4d/cc9 d0/cdf 0 2024-09-21T08:02:50.088 INFO:tasks.workunit.client.0.smithi107.stdout:1/676: write d0/d19/d2b/d4b/d44/d72/fb9 [2296005,17480] 0 2024-09-21T08:02:50.088 INFO:tasks.workunit.client.0.smithi107.stdout:1/677: fsync d0/d19/fa2 0 2024-09-21T08:02:50.088 INFO:tasks.workunit.client.0.smithi107.stdout:1/678: write d0/d19/f33 [329896,39660] 0 2024-09-21T08:02:50.089 INFO:tasks.workunit.client.0.smithi107.stdout:0/622: truncate d1/d5/d25/d3d/d20/d29/d55/d7a/f83 2726739 0 2024-09-21T08:02:50.089 INFO:tasks.workunit.client.0.smithi107.stdout:0/623: readlink d1/l52 0 2024-09-21T08:02:50.091 INFO:tasks.workunit.client.0.smithi107.stdout:3/743: truncate d8/d2b/d45/dbf/fd1 365483 0 2024-09-21T08:02:50.093 INFO:tasks.workunit.client.0.smithi107.stdout:6/758: dread d2/d3/d7/d3f/f5b [0,4194304] 0 2024-09-21T08:02:50.094 INFO:tasks.workunit.client.0.smithi107.stdout:5/814: mkdir d7/de/d1d/d29/d68/ddb/dde/d11f 0 2024-09-21T08:02:50.097 INFO:tasks.workunit.client.0.smithi107.stdout:2/643: dread d1/d16/f61 [0,4194304] 0 2024-09-21T08:02:50.101 INFO:tasks.workunit.client.0.smithi107.stdout:1/679: mknod d0/d19/d2b/d4b/d90/ce0 0 2024-09-21T08:02:50.103 INFO:tasks.workunit.client.0.smithi107.stdout:0/624: unlink d1/d5/d25/d3d/d20/d29/d5c/cce 0 2024-09-21T08:02:50.103 INFO:tasks.workunit.client.0.smithi107.stdout:0/625: stat d1/d5/d25 0 2024-09-21T08:02:50.103 INFO:tasks.workunit.client.0.smithi107.stdout:0/626: write d1/f1c [3348720,43908] 0 2024-09-21T08:02:50.106 INFO:tasks.workunit.client.0.smithi107.stdout:6/759: link d2/d2e/c77 d2/d3/d7/d54/dae/cfe 0 2024-09-21T08:02:50.109 INFO:tasks.workunit.client.0.smithi107.stdout:5/815: symlink d7/de/d1d/d29/d68/ddb/dde/df7/l120 0 2024-09-21T08:02:50.112 INFO:tasks.workunit.client.0.smithi107.stdout:0/627: dread d1/d5/d25/d3d/d20/d29/d55/d7a/f95 [0,4194304] 0 2024-09-21T08:02:50.114 INFO:tasks.workunit.client.0.smithi107.stdout:1/680: mknod d0/d19/d2b/d86/d95/ce1 0 2024-09-21T08:02:50.118 INFO:tasks.workunit.client.0.smithi107.stdout:5/816: rename d7/de/d1d/d29/d68/ddb/dde/df7/l120 to d7/de/d52/d8b/l121 0 2024-09-21T08:02:50.118 INFO:tasks.workunit.client.0.smithi107.stdout:5/817: stat d7/de/d1d/d24/ccb 0 2024-09-21T08:02:50.125 INFO:tasks.workunit.client.0.smithi107.stdout:0/628: write d1/d5/d25/f4e [1965628,476] 0 2024-09-21T08:02:50.127 INFO:tasks.workunit.client.0.smithi107.stdout:0/629: mkdir d1/d5/d25/d3d/d20/d29/d55/d91/d9a/dd1 0 2024-09-21T08:02:50.130 INFO:tasks.workunit.client.0.smithi107.stdout:2/644: dwrite d1/d2/d6d/d37/d49/d7f/f99 [4194304,4194304] 0 2024-09-21T08:02:50.130 INFO:tasks.workunit.client.0.smithi107.stdout:5/818: dread d7/f34 [0,4194304] 0 2024-09-21T08:02:50.130 INFO:tasks.workunit.client.0.smithi107.stdout:2/645: write d1/d16/f8b [108469,87992] 0 2024-09-21T08:02:50.130 INFO:tasks.workunit.client.0.smithi107.stdout:0/630: mknod d1/d5/d25/d3d/d20/d85/d8a/cd2 0 2024-09-21T08:02:50.132 INFO:tasks.workunit.client.0.smithi107.stdout:5/819: creat d7/de/d1d/d29/d68/ddb/dde/df7/f122 x:0 0 0 2024-09-21T08:02:50.133 INFO:tasks.workunit.client.0.smithi107.stdout:0/631: mknod d1/cd3 0 2024-09-21T08:02:50.136 INFO:tasks.workunit.client.0.smithi107.stdout:5/820: creat d7/de/d2d/d5d/f123 x:0 0 0 2024-09-21T08:02:50.136 INFO:tasks.workunit.client.0.smithi107.stdout:5/821: dread - d7/de/d52/ffb zero size 2024-09-21T08:02:50.136 INFO:tasks.workunit.client.0.smithi107.stdout:5/822: chown d7/de/d1d/d29/d68/de9 7 1 2024-09-21T08:02:50.136 INFO:tasks.workunit.client.0.smithi107.stdout:1/681: dwrite d0/f3 [0,4194304] 0 2024-09-21T08:02:50.136 INFO:tasks.workunit.client.0.smithi107.stdout:1/682: fdatasync d0/d19/d39/fb8 0 2024-09-21T08:02:50.137 INFO:tasks.workunit.client.0.smithi107.stdout:0/632: link d1/d23/f3a d1/d5/d25/d3d/d20/d85/d8a/fd4 0 2024-09-21T08:02:50.140 INFO:tasks.workunit.client.0.smithi107.stdout:5/823: unlink d7/de/d1d/d29/d68/ddb/d11b/c9f 0 2024-09-21T08:02:50.140 INFO:tasks.workunit.client.0.smithi107.stdout:1/683: mkdir d0/de2 0 2024-09-21T08:02:50.143 INFO:tasks.workunit.client.0.smithi107.stdout:0/633: symlink d1/d5/d25/d9e/ld5 0 2024-09-21T08:02:50.143 INFO:tasks.workunit.client.0.smithi107.stdout:2/646: dwrite d1/d2/d6d/d37/f94 [0,4194304] 0 2024-09-21T08:02:50.150 INFO:tasks.workunit.client.0.smithi107.stdout:2/647: symlink d1/d6/d92/dce/ld4 0 2024-09-21T08:02:50.151 INFO:tasks.workunit.client.0.smithi107.stdout:5/824: rmdir d7/de/d2d/d5d/d60/dc5 39 2024-09-21T08:02:50.167 INFO:tasks.workunit.client.0.smithi107.stdout:2/648: dread d1/d2/d6d/d42/d76/fa7 [0,4194304] 0 2024-09-21T08:02:50.168 INFO:tasks.workunit.client.0.smithi107.stdout:2/649: mkdir d1/d2/d6d/d37/d82/dd5 0 2024-09-21T08:02:50.169 INFO:tasks.workunit.client.0.smithi107.stdout:1/684: dwrite d0/d29/d4d/d84/fdb [0,4194304] 0 2024-09-21T08:02:50.169 INFO:tasks.workunit.client.0.smithi107.stdout:5/825: dread d7/de/f99 [0,4194304] 0 2024-09-21T08:02:50.179 INFO:tasks.workunit.client.0.smithi107.stdout:2/650: dread d1/d2/d6d/d37/f94 [0,4194304] 0 2024-09-21T08:02:50.179 INFO:tasks.workunit.client.0.smithi107.stdout:5/826: read d7/de/d1d/fbb [2284888,23458] 0 2024-09-21T08:02:50.179 INFO:tasks.workunit.client.0.smithi107.stdout:5/827: creat d7/de/d52/d8b/f124 x:0 0 0 2024-09-21T08:02:50.179 INFO:tasks.workunit.client.0.smithi107.stdout:0/634: dwrite d1/d5/f67 [0,4194304] 0 2024-09-21T08:02:50.181 INFO:tasks.workunit.client.0.smithi107.stdout:5/828: rmdir d7/de/d1d/d29/d64/d100 39 2024-09-21T08:02:50.182 INFO:tasks.workunit.client.0.smithi107.stdout:0/635: dread d1/d5/d25/d3d/f1f [0,4194304] 0 2024-09-21T08:02:50.187 INFO:tasks.workunit.client.0.smithi107.stdout:2/651: dread d1/d2/f34 [0,4194304] 0 2024-09-21T08:02:50.189 INFO:tasks.workunit.client.0.smithi107.stdout:2/652: rename d1/d2/d6d/d37/c5a to d1/d2/d6d/d42/cd6 0 2024-09-21T08:02:50.190 INFO:tasks.workunit.client.0.smithi107.stdout:2/653: rmdir d1/d2/d6d/d37/d82/daa 0 2024-09-21T08:02:50.194 INFO:tasks.workunit.client.0.smithi107.stdout:1/685: dwrite d0/d19/f3b [0,4194304] 0 2024-09-21T08:02:50.194 INFO:tasks.workunit.client.0.smithi107.stdout:1/686: write d0/d19/d2b/d4b/d61/fbb [293860,50501] 0 2024-09-21T08:02:50.194 INFO:tasks.workunit.client.0.smithi107.stdout:1/687: chown d0/d29/d4d/d84/dc5/da9/dc7/f91 15 1 2024-09-21T08:02:50.200 INFO:tasks.workunit.client.0.smithi107.stdout:1/688: dread d0/d29/d4d/d84/dc5/da9/dc7/f91 [0,4194304] 0 2024-09-21T08:02:50.201 INFO:tasks.workunit.client.0.smithi107.stdout:0/636: dwrite d1/d5/d25/d3d/f1d [0,4194304] 0 2024-09-21T08:02:50.201 INFO:tasks.workunit.client.0.smithi107.stdout:0/637: chown d1/d5/d25/d3d/d20/d29 243635 1 2024-09-21T08:02:50.202 INFO:tasks.workunit.client.0.smithi107.stdout:1/689: mknod d0/d19/d2b/d4b/d5b/ce3 0 2024-09-21T08:02:50.203 INFO:tasks.workunit.client.0.smithi107.stdout:1/690: chown d0/d19/d2b/d4b/d44/d55/d64/lad 480420 1 2024-09-21T08:02:50.205 INFO:tasks.workunit.client.0.smithi107.stdout:1/691: creat d0/d19/d2b/d86/dd9/fe4 x:0 0 0 2024-09-21T08:02:50.211 INFO:tasks.workunit.client.0.smithi107.stdout:2/654: dwrite d1/d2/d6d/d37/d49/d7f/fa8 [0,4194304] 0 2024-09-21T08:02:50.211 INFO:tasks.workunit.client.0.smithi107.stdout:0/638: dread d1/d5/d25/f4d [0,4194304] 0 2024-09-21T08:02:50.216 INFO:tasks.workunit.client.0.smithi107.stdout:1/692: dread d0/dc6/f30 [0,4194304] 0 2024-09-21T08:02:50.220 INFO:tasks.workunit.client.0.smithi107.stdout:0/639: creat d1/d5/d25/d3d/d20/d85/da8/fd6 x:0 0 0 2024-09-21T08:02:50.220 INFO:tasks.workunit.client.0.smithi107.stdout:0/640: read d1/d5/d25/f4e [2963989,35256] 0 2024-09-21T08:02:50.221 INFO:tasks.workunit.client.0.smithi107.stdout:1/693: symlink d0/d29/d4d/d84/dc5/le5 0 2024-09-21T08:02:50.224 INFO:tasks.workunit.client.0.smithi107.stdout:0/641: link d1/d5/d25/fb9 d1/d6f/dc1/dcc/fd7 0 2024-09-21T08:02:50.228 INFO:tasks.workunit.client.0.smithi107.stdout:2/655: dwrite d1/d16/d35/fc6 [0,4194304] 0 2024-09-21T08:02:50.230 INFO:tasks.workunit.client.0.smithi107.stdout:2/656: unlink d1/d16/c46 0 2024-09-21T08:02:50.235 INFO:tasks.workunit.client.0.smithi107.stdout:1/694: read d0/d19/d2b/d86/dc2/fca [2745976,119400] 0 2024-09-21T08:02:50.238 INFO:tasks.workunit.client.0.smithi107.stdout:2/657: dread d1/d6/f18 [0,4194304] 0 2024-09-21T08:02:50.243 INFO:tasks.workunit.client.0.smithi107.stdout:2/658: dread d1/d2/d6d/f71 [0,4194304] 0 2024-09-21T08:02:50.243 INFO:tasks.workunit.client.0.smithi107.stdout:2/659: chown d1/d6/d92/fac 1242336 1 2024-09-21T08:02:50.243 INFO:tasks.workunit.client.0.smithi107.stdout:0/642: dwrite d1/d5/d25/d3d/d20/d85/d8a/f9b [0,4194304] 0 2024-09-21T08:02:50.245 INFO:tasks.workunit.client.0.smithi107.stdout:2/660: link d1/d2/d6d/d9b/dad/ccc d1/dc8/cd7 0 2024-09-21T08:02:50.245 INFO:tasks.workunit.client.0.smithi107.stdout:2/661: creat d1/d2/d6d/d37/d49/d7f/fd8 x:0 0 0 2024-09-21T08:02:50.245 INFO:tasks.workunit.client.0.smithi107.stdout:2/662: fdatasync d1/d2/d6d/d37/d49/f77 0 2024-09-21T08:02:50.245 INFO:tasks.workunit.client.0.smithi107.stdout:2/663: dread - d1/d2/d6d/d37/fd2 zero size 2024-09-21T08:02:50.249 INFO:tasks.workunit.client.0.smithi107.stdout:0/643: creat d1/d6f/fd8 x:0 0 0 2024-09-21T08:02:50.250 INFO:tasks.workunit.client.0.smithi107.stdout:0/644: stat d1/d5/f5d 0 2024-09-21T08:02:50.250 INFO:tasks.workunit.client.0.smithi107.stdout:1/695: write d0/d19/d39/fb8 [5762928,11249] 0 2024-09-21T08:02:50.255 INFO:tasks.workunit.client.0.smithi107.stdout:2/664: write d1/d2/d6d/d37/d49/d7f/f99 [6013773,106583] 0 2024-09-21T08:02:50.266 INFO:tasks.workunit.client.0.smithi107.stdout:2/665: creat d1/dc8/fd9 x:0 0 0 2024-09-21T08:02:50.268 INFO:tasks.workunit.client.0.smithi107.stdout:2/666: mknod d1/d2/d6d/d37/cda 0 2024-09-21T08:02:50.269 INFO:tasks.workunit.client.0.smithi107.stdout:2/667: creat d1/d2/d6d/d37/d49/fdb x:0 0 0 2024-09-21T08:02:50.269 INFO:tasks.workunit.client.0.smithi107.stdout:2/668: creat d1/d2/d6d/d37/fdc x:0 0 0 2024-09-21T08:02:50.289 INFO:tasks.workunit.client.0.smithi107.stdout:0/645: dwrite d1/d23/f6d [0,4194304] 0 2024-09-21T08:02:50.291 INFO:tasks.workunit.client.0.smithi107.stdout:0/646: creat d1/d5/d25/d3d/d20/d85/dab/fd9 x:0 0 0 2024-09-21T08:02:50.292 INFO:tasks.workunit.client.0.smithi107.stdout:0/647: fdatasync d1/d5/d25/d3d/d20/d29/d55/fac 0 2024-09-21T08:02:50.292 INFO:tasks.workunit.client.0.smithi107.stdout:0/648: write d1/d5/fbb [1830824,14699] 0 2024-09-21T08:02:50.292 INFO:tasks.workunit.client.0.smithi107.stdout:2/669: dwrite d1/d2/fba [0,4194304] 0 2024-09-21T08:02:50.293 INFO:tasks.workunit.client.0.smithi107.stdout:0/649: link d1/d5/d25/d3d/d20/d29/f94 d1/d5/d25/d3d/d20/d85/da8/fda 0 2024-09-21T08:02:50.293 INFO:tasks.workunit.client.0.smithi107.stdout:0/650: fdatasync d1/d6f/f89 0 2024-09-21T08:02:50.294 INFO:tasks.workunit.client.0.smithi107.stdout:2/670: getdents d1/d16/d9c/dbb 0 2024-09-21T08:02:50.294 INFO:tasks.workunit.client.0.smithi107.stdout:7/517: sync 2024-09-21T08:02:50.294 INFO:tasks.workunit.client.0.smithi107.stdout:7/518: truncate d7/d22/d3d/fa2 476091 0 2024-09-21T08:02:50.305 INFO:tasks.workunit.client.0.smithi107.stdout:7/519: write d7/d10/f17 [2066950,1210] 0 2024-09-21T08:02:50.318 INFO:tasks.workunit.client.0.smithi107.stdout:7/520: dread d7/d22/f24 [0,4194304] 0 2024-09-21T08:02:50.330 INFO:tasks.workunit.client.0.smithi107.stdout:0/651: dwrite d1/d5/d25/d3d/d20/d29/f94 [0,4194304] 0 2024-09-21T08:02:50.330 INFO:tasks.workunit.client.0.smithi107.stdout:0/652: truncate d1/d6f/d80/f88 1352631 0 2024-09-21T08:02:50.331 INFO:tasks.workunit.client.0.smithi107.stdout:2/671: dwrite d1/d2/d6d/f52 [0,4194304] 0 2024-09-21T08:02:50.332 INFO:tasks.workunit.client.0.smithi107.stdout:0/653: creat d1/d5/d25/d3d/d20/d29/d55/d7a/fdb x:0 0 0 2024-09-21T08:02:50.339 INFO:tasks.workunit.client.0.smithi107.stdout:2/672: truncate d1/d2/f15 3092063 0 2024-09-21T08:02:50.340 INFO:tasks.workunit.client.0.smithi107.stdout:7/521: dwrite d7/d22/d3a/fa5 [0,4194304] 0 2024-09-21T08:02:50.341 INFO:tasks.workunit.client.0.smithi107.stdout:2/673: link d1/d6/f2d d1/d16/fdd 0 2024-09-21T08:02:50.344 INFO:tasks.workunit.client.0.smithi107.stdout:2/674: mkdir d1/d2/d6d/d37/d49/dde 0 2024-09-21T08:02:50.344 INFO:tasks.workunit.client.0.smithi107.stdout:2/675: readlink d1/d2/lb9 0 2024-09-21T08:02:50.347 INFO:tasks.workunit.client.0.smithi107.stdout:2/676: creat d1/d2/d6d/d9b/dad/fdf x:0 0 0 2024-09-21T08:02:50.347 INFO:tasks.workunit.client.0.smithi107.stdout:2/677: chown d1/d2/f34 15969 1 2024-09-21T08:02:50.347 INFO:tasks.workunit.client.0.smithi107.stdout:2/678: write d1/d6/d92/f9f [3541841,35670] 0 2024-09-21T08:02:50.348 INFO:tasks.workunit.client.0.smithi107.stdout:0/654: dwrite d1/d5/d25/d3d/d20/d29/d55/d7a/f82 [0,4194304] 0 2024-09-21T08:02:50.348 INFO:tasks.workunit.client.0.smithi107.stdout:2/679: symlink d1/d6/le0 0 2024-09-21T08:02:50.348 INFO:tasks.workunit.client.0.smithi107.stdout:2/680: write d1/d16/fa5 [737239,18879] 0 2024-09-21T08:02:50.353 INFO:tasks.workunit.client.0.smithi107.stdout:2/681: mknod d1/d1e/ce1 0 2024-09-21T08:02:50.353 INFO:tasks.workunit.client.0.smithi107.stdout:2/682: write d1/d16/f17 [522355,129954] 0 2024-09-21T08:02:50.357 INFO:tasks.workunit.client.0.smithi107.stdout:0/655: write d1/d5/d25/d3d/d20/f51 [3047721,62940] 0 2024-09-21T08:02:50.357 INFO:tasks.workunit.client.0.smithi107.stdout:0/656: creat d1/d5/d25/d3d/d20/d29/d55/fdc x:0 0 0 2024-09-21T08:02:50.358 INFO:tasks.workunit.client.0.smithi107.stdout:0/657: stat d1/d6f/dc1/dcc 0 2024-09-21T08:02:50.367 INFO:tasks.workunit.client.0.smithi107.stdout:2/683: dread d1/d2/d6d/d37/d49/d7f/fa8 [0,4194304] 0 2024-09-21T08:02:50.367 INFO:tasks.workunit.client.0.smithi107.stdout:2/684: readlink d1/d2/d6d/d42/d76/l7c 0 2024-09-21T08:02:50.369 INFO:tasks.workunit.client.0.smithi107.stdout:2/685: creat d1/d1e/fe2 x:0 0 0 2024-09-21T08:02:50.369 INFO:tasks.workunit.client.0.smithi107.stdout:2/686: rmdir d1/d2/d6d/d42/db0 39 2024-09-21T08:02:50.371 INFO:tasks.workunit.client.0.smithi107.stdout:2/687: creat d1/d16/d9c/fe3 x:0 0 0 2024-09-21T08:02:50.371 INFO:tasks.workunit.client.0.smithi107.stdout:2/688: write d1/d2/fba [4430817,90529] 0 2024-09-21T08:02:50.372 INFO:tasks.workunit.client.0.smithi107.stdout:2/689: link d1/d16/d35/c44 d1/d6/d9e/ce4 0 2024-09-21T08:02:50.372 INFO:tasks.workunit.client.0.smithi107.stdout:2/690: stat d1/d1e/fe2 0 2024-09-21T08:02:50.375 INFO:tasks.workunit.client.0.smithi107.stdout:0/658: dwrite d1/d5/d25/d3d/d20/f7d [0,4194304] 0 2024-09-21T08:02:50.376 INFO:tasks.workunit.client.0.smithi107.stdout:0/659: symlink d1/d5/d25/d3d/d20/ldd 0 2024-09-21T08:02:50.376 INFO:tasks.workunit.client.0.smithi107.stdout:0/660: write d1/d23/f2a [3678780,18653] 0 2024-09-21T08:02:50.377 INFO:tasks.workunit.client.0.smithi107.stdout:2/691: dread d1/d16/fa5 [0,4194304] 0 2024-09-21T08:02:50.377 INFO:tasks.workunit.client.0.smithi107.stdout:2/692: chown d1/d6/d92 71453 1 2024-09-21T08:02:50.378 INFO:tasks.workunit.client.0.smithi107.stdout:0/661: unlink d1/d6f/d80/cb1 0 2024-09-21T08:02:50.379 INFO:tasks.workunit.client.0.smithi107.stdout:0/662: creat d1/d5/d25/d3d/da1/fde x:0 0 0 2024-09-21T08:02:50.380 INFO:tasks.workunit.client.0.smithi107.stdout:2/693: read d1/d1e/f79 [26523,52169] 0 2024-09-21T08:02:50.380 INFO:tasks.workunit.client.0.smithi107.stdout:2/694: creat d1/d1e/fe5 x:0 0 0 2024-09-21T08:02:50.381 INFO:tasks.workunit.client.0.smithi107.stdout:0/663: mknod d1/d5/d25/cdf 0 2024-09-21T08:02:50.381 INFO:tasks.workunit.client.0.smithi107.stdout:0/664: write d1/d5/d75/f81 [556865,103522] 0 2024-09-21T08:02:50.381 INFO:tasks.workunit.client.0.smithi107.stdout:0/665: dread - d1/d5/d25/d2d/f8f zero size 2024-09-21T08:02:50.389 INFO:tasks.workunit.client.0.smithi107.stdout:2/695: read d1/d16/d35/f58 [2267647,34787] 0 2024-09-21T08:02:50.406 INFO:tasks.workunit.client.0.smithi107.stdout:0/666: dwrite d1/d5/d25/f9f [4194304,4194304] 0 2024-09-21T08:02:50.407 INFO:tasks.workunit.client.0.smithi107.stdout:2/696: dwrite d1/d16/d35/f58 [4194304,4194304] 0 2024-09-21T08:02:50.484 INFO:tasks.workunit.client.0.smithi107.stdout:0/667: symlink d1/d5/d25/d3d/da1/le0 0 2024-09-21T08:02:50.484 INFO:tasks.workunit.client.0.smithi107.stdout:0/668: stat d1/d5/d25/f77 0 2024-09-21T08:02:50.493 INFO:tasks.workunit.client.0.smithi107.stdout:0/669: write d1/d5/d25/d3d/f1d [1615706,37770] 0 2024-09-21T08:02:50.493 INFO:tasks.workunit.client.0.smithi107.stdout:0/670: write d1/d5/f7e [4024362,54571] 0 2024-09-21T08:02:50.505 INFO:tasks.workunit.client.0.smithi107.stdout:2/697: rmdir d1/d2/d6d/d37 39 2024-09-21T08:02:50.505 INFO:tasks.workunit.client.0.smithi107.stdout:2/698: readlink d1/d2/d6d/d37/l8a 0 2024-09-21T08:02:50.508 INFO:tasks.workunit.client.0.smithi107.stdout:0/671: unlink d1/d5/d75/fc9 0 2024-09-21T08:02:50.509 INFO:tasks.workunit.client.0.smithi107.stdout:2/699: mknod d1/d2/d6d/d42/ce6 0 2024-09-21T08:02:50.510 INFO:tasks.workunit.client.0.smithi107.stdout:2/700: creat d1/d6/d92/fe7 x:0 0 0 2024-09-21T08:02:50.510 INFO:tasks.workunit.client.0.smithi107.stdout:2/701: fdatasync d1/dc8/fd9 0 2024-09-21T08:02:50.510 INFO:tasks.workunit.client.0.smithi107.stdout:2/702: fsync d1/d2/d6d/d37/d49/d7f/f99 0 2024-09-21T08:02:50.510 INFO:tasks.workunit.client.0.smithi107.stdout:2/703: fdatasync d1/d16/fdd 0 2024-09-21T08:02:50.510 INFO:tasks.workunit.client.0.smithi107.stdout:2/704: write d1/d2/fd0 [93316,103637] 0 2024-09-21T08:02:50.516 INFO:tasks.workunit.client.0.smithi107.stdout:0/672: read d1/d5/d25/d3d/d20/d85/d8a/fd4 [712159,119265] 0 2024-09-21T08:02:50.517 INFO:tasks.workunit.client.0.smithi107.stdout:0/673: mkdir d1/d5/d25/d3d/d20/d85/de1 0 2024-09-21T08:02:50.518 INFO:tasks.workunit.client.0.smithi107.stdout:2/705: dread d1/d16/f17 [0,4194304] 0 2024-09-21T08:02:50.518 INFO:tasks.workunit.client.0.smithi107.stdout:2/706: creat d1/d2/d6d/d9b/fe8 x:0 0 0 2024-09-21T08:02:50.518 INFO:tasks.workunit.client.0.smithi107.stdout:2/707: truncate d1/d2/d6d/d37/d49/d7f/fa8 4458121 0 2024-09-21T08:02:50.519 INFO:tasks.workunit.client.0.smithi107.stdout:2/708: creat d1/d6/fe9 x:0 0 0 2024-09-21T08:02:50.519 INFO:tasks.workunit.client.0.smithi107.stdout:2/709: write d1/d2/d6d/d42/db0/fc4 [1025318,53661] 0 2024-09-21T08:02:50.519 INFO:tasks.workunit.client.0.smithi107.stdout:2/710: chown d1/d2/d6d/d37/d82/la2 52603 1 2024-09-21T08:02:50.519 INFO:tasks.workunit.client.0.smithi107.stdout:2/711: write d1/d6/f2e [658547,51743] 0 2024-09-21T08:02:50.519 INFO:tasks.workunit.client.0.smithi107.stdout:2/712: creat d1/d2/fea x:0 0 0 2024-09-21T08:02:50.522 INFO:tasks.workunit.client.0.smithi107.stdout:2/713: unlink d1/d16/c6e 0 2024-09-21T08:02:50.524 INFO:tasks.workunit.client.0.smithi107.stdout:2/714: unlink d1/d2/d6d/d37/d49/d7f/f99 0 2024-09-21T08:02:50.524 INFO:tasks.workunit.client.0.smithi107.stdout:2/715: write d1/d2/d6d/f52 [4258263,77107] 0 2024-09-21T08:02:50.525 INFO:tasks.workunit.client.0.smithi107.stdout:2/716: creat d1/d16/feb x:0 0 0 2024-09-21T08:02:50.529 INFO:tasks.workunit.client.0.smithi107.stdout:2/717: creat d1/d2/d6d/d37/fec x:0 0 0 2024-09-21T08:02:50.529 INFO:tasks.workunit.client.0.smithi107.stdout:2/718: unlink d1/d6/c12 0 2024-09-21T08:02:50.529 INFO:tasks.workunit.client.0.smithi107.stdout:2/719: creat d1/d2/d6d/d37/d49/d85/fed x:0 0 0 2024-09-21T08:02:50.531 INFO:tasks.workunit.client.0.smithi107.stdout:2/720: rename d1/d16/c78 to d1/d2/d6d/d9b/cee 0 2024-09-21T08:02:50.531 INFO:tasks.workunit.client.0.smithi107.stdout:2/721: rename d1/d16/d35 to d1/d16/d35/def 22 2024-09-21T08:02:50.532 INFO:tasks.workunit.client.0.smithi107.stdout:2/722: mkdir d1/d2/d6d/d37/df0 0 2024-09-21T08:02:50.532 INFO:tasks.workunit.client.0.smithi107.stdout:2/723: rename d1/d2/d6d/d37/d49 to d1/d2/d6d/d37/d49/df1 22 2024-09-21T08:02:50.534 INFO:tasks.workunit.client.0.smithi107.stdout:2/724: unlink d1/d2/d6d/d9b/lb3 0 2024-09-21T08:02:50.534 INFO:tasks.workunit.client.0.smithi107.stdout:2/725: dread - d1/d2/d6d/d9b/dad/fdf zero size 2024-09-21T08:02:50.535 INFO:tasks.workunit.client.0.smithi107.stdout:0/674: dwrite d1/d5/d25/d3d/d20/f53 [0,4194304] 0 2024-09-21T08:02:50.535 INFO:tasks.workunit.client.0.smithi107.stdout:0/675: chown d1/d6f/dc1/dcc/fd7 10499 1 2024-09-21T08:02:50.535 INFO:tasks.workunit.client.0.smithi107.stdout:2/726: unlink d1/d16/c40 0 2024-09-21T08:02:50.536 INFO:tasks.workunit.client.0.smithi107.stdout:0/676: truncate d1/d5/d25/d3d/d20/f51 3850851 0 2024-09-21T08:02:50.537 INFO:tasks.workunit.client.0.smithi107.stdout:2/727: mkdir d1/d6/d92/df2 0 2024-09-21T08:02:50.549 INFO:tasks.workunit.client.0.smithi107.stdout:0/677: dwrite d1/d5/d25/d3d/f1f [0,4194304] 0 2024-09-21T08:02:50.550 INFO:tasks.workunit.client.0.smithi107.stdout:2/728: write d1/d16/d35/f58 [6214397,130474] 0 2024-09-21T08:02:50.550 INFO:tasks.workunit.client.0.smithi107.stdout:2/729: fsync d1/d16/d9c/fe3 0 2024-09-21T08:02:50.551 INFO:tasks.workunit.client.0.smithi107.stdout:2/730: symlink d1/d2/d6d/d37/d49/lf3 0 2024-09-21T08:02:50.551 INFO:tasks.workunit.client.0.smithi107.stdout:2/731: truncate d1/d2/fa4 2080873 0 2024-09-21T08:02:50.551 INFO:tasks.workunit.client.0.smithi107.stdout:2/732: fdatasync d1/d2/fba 0 2024-09-21T08:02:50.552 INFO:tasks.workunit.client.0.smithi107.stdout:2/733: creat d1/dc8/ff4 x:0 0 0 2024-09-21T08:02:50.552 INFO:tasks.workunit.client.0.smithi107.stdout:2/734: write d1/d1e/fe2 [98448,59437] 0 2024-09-21T08:02:50.552 INFO:tasks.workunit.client.0.smithi107.stdout:2/735: mknod d1/d16/cf5 0 2024-09-21T08:02:50.553 INFO:tasks.workunit.client.0.smithi107.stdout:2/736: creat d1/d2/d6d/d37/df0/ff6 x:0 0 0 2024-09-21T08:02:50.554 INFO:tasks.workunit.client.0.smithi107.stdout:2/737: readlink d1/d6/lb6 0 2024-09-21T08:02:50.554 INFO:tasks.workunit.client.0.smithi107.stdout:2/738: mkdir d1/d2/d6d/d42/db0/df7 0 2024-09-21T08:02:50.559 INFO:tasks.workunit.client.0.smithi107.stdout:0/678: dread d1/d5/d25/d3d/d20/f53 [0,4194304] 0 2024-09-21T08:02:50.562 INFO:tasks.workunit.client.0.smithi107.stdout:2/739: write d1/d2/d6d/f5b [2677637,13066] 0 2024-09-21T08:02:50.567 INFO:tasks.workunit.client.0.smithi107.stdout:2/740: dread d1/d2/d6d/d37/f4a [0,4194304] 0 2024-09-21T08:02:50.570 INFO:tasks.workunit.client.0.smithi107.stdout:2/741: dread d1/d2/fa4 [0,4194304] 0 2024-09-21T08:02:50.571 INFO:tasks.workunit.client.0.smithi107.stdout:0/679: write d1/d5/d25/f9f [877876,53110] 0 2024-09-21T08:02:50.575 INFO:tasks.workunit.client.0.smithi107.stdout:0/680: link d1/d6f/f89 d1/d5/d25/d3d/d20/d29/d55/d91/fe2 0 2024-09-21T08:02:50.578 INFO:tasks.workunit.client.0.smithi107.stdout:0/681: symlink d1/d5/d25/d3d/d20/d29/dd0/le3 0 2024-09-21T08:02:50.582 INFO:tasks.workunit.client.0.smithi107.stdout:2/742: dread d1/d2/d6d/f5b [0,4194304] 0 2024-09-21T08:02:50.583 INFO:tasks.workunit.client.0.smithi107.stdout:0/682: creat d1/d5/fe4 x:0 0 0 2024-09-21T08:02:50.583 INFO:tasks.workunit.client.0.smithi107.stdout:0/683: creat d1/d5/d25/d3d/d20/fe5 x:0 0 0 2024-09-21T08:02:50.584 INFO:tasks.workunit.client.0.smithi107.stdout:2/743: rmdir d1/d2/d6d/d42/d76 39 2024-09-21T08:02:50.633 INFO:tasks.workunit.client.0.smithi107.stdout:0/684: dwrite d1/d5/d25/d3d/d20/fc3 [0,4194304] 0 2024-09-21T08:02:50.633 INFO:tasks.workunit.client.0.smithi107.stdout:0/685: dread - d1/d23/f9c zero size 2024-09-21T08:02:50.633 INFO:tasks.workunit.client.0.smithi107.stdout:0/686: creat d1/d5/d25/d3d/d20/da0/fe6 x:0 0 0 2024-09-21T08:02:50.637 INFO:tasks.workunit.client.0.smithi107.stdout:0/687: rename d1/d5/d25/d3d/d20/d29/d55/d91/d9a/fca to d1/d5/d25/d9e/fe7 0 2024-09-21T08:02:50.639 INFO:tasks.workunit.client.0.smithi107.stdout:2/744: dwrite d1/d2/d6d/d37/fdc [0,4194304] 0 2024-09-21T08:02:50.639 INFO:tasks.workunit.client.0.smithi107.stdout:2/745: chown d1/d16/d35 2704 1 2024-09-21T08:02:50.639 INFO:tasks.workunit.client.0.smithi107.stdout:2/746: chown d1/d16/f17 14 1 2024-09-21T08:02:50.641 INFO:tasks.workunit.client.0.smithi107.stdout:2/747: mkdir d1/d2/d6d/d37/d49/d85/df8 0 2024-09-21T08:02:50.652 INFO:tasks.workunit.client.0.smithi107.stdout:2/748: dread d1/d2/d6d/d37/d49/f77 [0,4194304] 0 2024-09-21T08:02:50.653 INFO:tasks.workunit.client.0.smithi107.stdout:0/688: dwrite d1/d6f/d80/f88 [0,4194304] 0 2024-09-21T08:02:50.653 INFO:tasks.workunit.client.0.smithi107.stdout:0/689: chown d1/d5/d25/d3d/d20/d85/d8a/f9b 25250 1 2024-09-21T08:02:50.656 INFO:tasks.workunit.client.0.smithi107.stdout:0/690: rmdir d1/d5/d25/d3d/d20/d29/d55/d91 39 2024-09-21T08:02:50.658 INFO:tasks.workunit.client.0.smithi107.stdout:0/691: rename d1/d5/d25/d3d/d20/d85/da8/fbd to d1/d5/d25/d3d/d20/d85/fe8 0 2024-09-21T08:02:50.661 INFO:tasks.workunit.client.0.smithi107.stdout:0/692: symlink d1/d5/le9 0 2024-09-21T08:02:50.662 INFO:tasks.workunit.client.0.smithi107.stdout:0/693: truncate d1/d5/d25/d3d/d20/d85/fe8 691566 0 2024-09-21T08:02:50.662 INFO:tasks.workunit.client.0.smithi107.stdout:2/749: write d1/d16/f6b [3634849,47673] 0 2024-09-21T08:02:50.670 INFO:tasks.workunit.client.0.smithi107.stdout:0/694: dread d1/d5/d25/f9f [0,4194304] 0 2024-09-21T08:02:50.670 INFO:tasks.workunit.client.0.smithi107.stdout:0/695: chown d1/d5/d25/d3d/d20/c74 26803 1 2024-09-21T08:02:50.673 INFO:tasks.workunit.client.0.smithi107.stdout:2/750: write d1/d16/f60 [1508261,92694] 0 2024-09-21T08:02:50.673 INFO:tasks.workunit.client.0.smithi107.stdout:0/696: rmdir d1/d6f 39 2024-09-21T08:02:50.673 INFO:tasks.workunit.client.0.smithi107.stdout:0/697: read d1/d5/d25/d3d/d20/d85/d8a/fd4 [1801923,106104] 0 2024-09-21T08:02:50.674 INFO:tasks.workunit.client.0.smithi107.stdout:0/698: chown d1/c28 54504 1 2024-09-21T08:02:50.674 INFO:tasks.workunit.client.0.smithi107.stdout:2/751: write d1/d16/fa5 [367293,105362] 0 2024-09-21T08:02:50.676 INFO:tasks.workunit.client.0.smithi107.stdout:2/752: symlink d1/d2/d6d/d9b/lf9 0 2024-09-21T08:02:50.676 INFO:tasks.workunit.client.0.smithi107.stdout:2/753: dread - d1/d2/d6d/d37/fd2 zero size 2024-09-21T08:02:50.677 INFO:tasks.workunit.client.0.smithi107.stdout:2/754: mkdir d1/d2/d6d/dfa 0 2024-09-21T08:02:50.678 INFO:tasks.workunit.client.0.smithi107.stdout:0/699: dread d1/d5/f7e [0,4194304] 0 2024-09-21T08:02:50.680 INFO:tasks.workunit.client.0.smithi107.stdout:0/700: creat d1/d23/fea x:0 0 0 2024-09-21T08:02:50.682 INFO:tasks.workunit.client.0.smithi107.stdout:0/701: getdents d1/d5/d25/d3d/d20/d29/d55 0 2024-09-21T08:02:50.683 INFO:tasks.workunit.client.0.smithi107.stdout:0/702: truncate d1/d23/d61/f73 493406 0 2024-09-21T08:02:50.699 INFO:tasks.workunit.client.0.smithi107.stdout:0/703: dwrite d1/d5/d25/f40 [0,4194304] 0 2024-09-21T08:02:50.705 INFO:tasks.workunit.client.0.smithi107.stdout:0/704: truncate d1/d5/d25/d3d/d20/d85/d8a/f9b 2299904 0 2024-09-21T08:02:50.721 INFO:tasks.workunit.client.0.smithi107.stdout:8/587: sync 2024-09-21T08:02:50.721 INFO:tasks.workunit.client.0.smithi107.stdout:9/801: sync 2024-09-21T08:02:50.722 INFO:tasks.workunit.client.0.smithi107.stdout:8/588: read d5/d1d/f24 [225505,87583] 0 2024-09-21T08:02:50.722 INFO:tasks.workunit.client.0.smithi107.stdout:0/705: dwrite d1/d23/f3f [0,4194304] 0 2024-09-21T08:02:50.722 INFO:tasks.workunit.client.0.smithi107.stdout:0/706: chown d1/d5/d25/d3d/da1/fde 25272679 1 2024-09-21T08:02:50.723 INFO:tasks.workunit.client.0.smithi107.stdout:9/802: truncate d11/f37 2649055 0 2024-09-21T08:02:50.723 INFO:tasks.workunit.client.0.smithi107.stdout:9/803: write d11/d27/d98/f47 [2483079,8680] 0 2024-09-21T08:02:50.723 INFO:tasks.workunit.client.0.smithi107.stdout:9/804: fdatasync d11/d27/d2f/d4d/d5c/f4b 0 2024-09-21T08:02:50.725 INFO:tasks.workunit.client.0.smithi107.stdout:8/589: mkdir d5/d2e/d7c/d9a/d9e/dcc 0 2024-09-21T08:02:50.725 INFO:tasks.workunit.client.0.smithi107.stdout:8/590: dread - d5/db9/fb6 zero size 2024-09-21T08:02:50.726 INFO:tasks.workunit.client.0.smithi107.stdout:9/805: symlink d11/d24/l11f 0 2024-09-21T08:02:50.727 INFO:tasks.workunit.client.0.smithi107.stdout:8/591: symlink d5/d2e/d89/lcd 0 2024-09-21T08:02:50.730 INFO:tasks.workunit.client.0.smithi107.stdout:9/806: rename d11/d27/d2f/d38/dbf/fd4 to d11/d27/d2f/d38/daa/f120 0 2024-09-21T08:02:50.730 INFO:tasks.workunit.client.0.smithi107.stdout:9/807: truncate d11/d27/d2a/f42 2035692 0 2024-09-21T08:02:50.730 INFO:tasks.workunit.client.0.smithi107.stdout:9/808: write d11/d27/fe8 [754980,26722] 0 2024-09-21T08:02:50.732 INFO:tasks.workunit.client.0.smithi107.stdout:8/592: mkdir d5/d38/d56/d54/dce 0 2024-09-21T08:02:50.733 INFO:tasks.workunit.client.0.smithi107.stdout:0/707: read d1/d6f/d80/f88 [932756,127456] 0 2024-09-21T08:02:50.733 INFO:tasks.workunit.client.0.smithi107.stdout:0/708: fsync d1/f1c 0 2024-09-21T08:02:50.733 INFO:tasks.workunit.client.0.smithi107.stdout:0/709: dread - d1/d5/d25/d3d/d20/f6c zero size 2024-09-21T08:02:50.733 INFO:tasks.workunit.client.0.smithi107.stdout:0/710: write d1/d5/fbb [2684952,8765] 0 2024-09-21T08:02:50.736 INFO:tasks.workunit.client.0.smithi107.stdout:8/593: creat d5/d2e/d7c/d9a/d98/fcf x:0 0 0 2024-09-21T08:02:50.738 INFO:tasks.workunit.client.0.smithi107.stdout:0/711: rename d1/d5/d25/d9e/fe7 to d1/d5/feb 0 2024-09-21T08:02:50.739 INFO:tasks.workunit.client.0.smithi107.stdout:8/594: creat d5/d40/d8a/dcb/fd0 x:0 0 0 2024-09-21T08:02:50.742 INFO:tasks.workunit.client.0.smithi107.stdout:0/712: mkdir d1/d5/d25/d2d/dec 0 2024-09-21T08:02:50.744 INFO:tasks.workunit.client.0.smithi107.stdout:0/713: rename d1/l70 to d1/d5/d25/d3d/d20/da0/led 0 2024-09-21T08:02:50.745 INFO:tasks.workunit.client.0.smithi107.stdout:0/714: chown d1/d23/f6d 251 1 2024-09-21T08:02:50.752 INFO:tasks.workunit.client.0.smithi107.stdout:8/595: read d5/d23/f25 [3143128,3629] 0 2024-09-21T08:02:50.752 INFO:tasks.workunit.client.0.smithi107.stdout:9/809: dwrite d11/d24/d26/dd0/dec/f81 [0,4194304] 0 2024-09-21T08:02:50.754 INFO:tasks.workunit.client.0.smithi107.stdout:0/715: dread d1/d5/d25/d3d/d20/d85/d8a/f9b [0,4194304] 0 2024-09-21T08:02:50.754 INFO:tasks.workunit.client.0.smithi107.stdout:0/716: fdatasync d1/d5/d25/d3d/d20/f6c 0 2024-09-21T08:02:50.755 INFO:tasks.workunit.client.0.smithi107.stdout:8/596: write d5/d23/f3b [900145,120518] 0 2024-09-21T08:02:50.759 INFO:tasks.workunit.client.0.smithi107.stdout:8/597: creat d5/d2e/d7c/d9a/d9e/fd1 x:0 0 0 2024-09-21T08:02:50.762 INFO:tasks.workunit.client.0.smithi107.stdout:8/598: unlink d5/d44/db7/lc8 0 2024-09-21T08:02:50.763 INFO:tasks.workunit.client.0.smithi107.stdout:8/599: link d5/c17 d5/d44/cd2 0 2024-09-21T08:02:50.763 INFO:tasks.workunit.client.0.smithi107.stdout:8/600: dread - d5/d1d/fb1 zero size 2024-09-21T08:02:50.767 INFO:tasks.workunit.client.0.smithi107.stdout:8/601: write d5/d2e/f39 [245730,36032] 0 2024-09-21T08:02:50.780 INFO:tasks.workunit.client.0.smithi107.stdout:0/717: dwrite d1/d5/f67 [0,4194304] 0 2024-09-21T08:02:50.781 INFO:tasks.workunit.client.0.smithi107.stdout:0/718: mkdir d1/d5/d25/d3d/d20/d85/dab/dee 0 2024-09-21T08:02:50.784 INFO:tasks.workunit.client.0.smithi107.stdout:0/719: dread d1/d23/f8b [0,4194304] 0 2024-09-21T08:02:50.785 INFO:tasks.workunit.client.0.smithi107.stdout:0/720: truncate d1/d5/d75/f7c 3340872 0 2024-09-21T08:02:50.791 INFO:tasks.workunit.client.0.smithi107.stdout:0/721: dread d1/f1c [0,4194304] 0 2024-09-21T08:02:50.796 INFO:tasks.workunit.client.0.smithi107.stdout:0/722: symlink d1/d5/d25/d3d/lef 0 2024-09-21T08:02:50.835 INFO:tasks.workunit.client.0.smithi107.stdout:0/723: symlink d1/d6f/d80/lf0 0 2024-09-21T08:02:50.840 INFO:tasks.workunit.client.0.smithi107.stdout:0/724: mknod d1/d5/cf1 0 2024-09-21T08:02:50.840 INFO:tasks.workunit.client.0.smithi107.stdout:0/725: chown d1/d5/d25/d2d/d8e 40827342 1 2024-09-21T08:02:50.845 INFO:tasks.workunit.client.0.smithi107.stdout:0/726: link d1/d5/d25/d3d/d20/d29/d55/d7a/f7f d1/d5/d25/d3d/d20/d85/de1/ff2 0 2024-09-21T08:02:50.851 INFO:tasks.workunit.client.0.smithi107.stdout:0/727: rename d1/d5/d25/d9e/fb2 to d1/d5/d75/ff3 0 2024-09-21T08:02:50.869 INFO:tasks.workunit.client.0.smithi107.stdout:0/728: dwrite d1/d5/d25/d3d/fb5 [0,4194304] 0 2024-09-21T08:02:50.874 INFO:tasks.workunit.client.0.smithi107.stdout:0/729: creat d1/d5/d75/ff4 x:0 0 0 2024-09-21T08:02:50.886 INFO:tasks.workunit.client.0.smithi107.stdout:0/730: write d1/d5/d25/fbe [1847718,68792] 0 2024-09-21T08:02:50.886 INFO:tasks.workunit.client.0.smithi107.stdout:0/731: fdatasync d1/d5/d25/d3d/d20/d29/d55/fac 0 2024-09-21T08:02:50.886 INFO:tasks.workunit.client.0.smithi107.stdout:0/732: dread - d1/d5/d75/ff3 zero size 2024-09-21T08:02:50.886 INFO:tasks.workunit.client.0.smithi107.stdout:0/733: chown d1/d5/d75/ff3 27528643 1 2024-09-21T08:02:50.893 INFO:tasks.workunit.client.0.smithi107.stdout:4/695: sync 2024-09-21T08:02:50.893 INFO:tasks.workunit.client.0.smithi107.stdout:4/696: chown dc/d13/d5a/d9b/lc9 1 1 2024-09-21T08:02:50.896 INFO:tasks.workunit.client.0.smithi107.stdout:4/697: dread dc/f68 [0,4194304] 0 2024-09-21T08:02:50.896 INFO:tasks.workunit.client.0.smithi107.stdout:4/698: write dc/d13/d40/d5e/d77/d99/daa/fb4 [760006,130889] 0 2024-09-21T08:02:50.897 INFO:tasks.workunit.client.0.smithi107.stdout:0/734: dread d1/fe [0,4194304] 0 2024-09-21T08:02:50.899 INFO:tasks.workunit.client.0.smithi107.stdout:4/699: rename dc/l22 to dc/d13/d40/d46/d48/d70/dc5/d90/le0 0 2024-09-21T08:02:50.909 INFO:tasks.workunit.client.0.smithi107.stdout:4/700: unlink dc/d13/f58 0 2024-09-21T08:02:50.912 INFO:tasks.workunit.client.0.smithi107.stdout:0/735: rmdir d1/d5/d75 39 2024-09-21T08:02:50.915 INFO:tasks.workunit.client.0.smithi107.stdout:4/701: unlink dc/d64/cac 0 2024-09-21T08:02:50.915 INFO:tasks.workunit.client.0.smithi107.stdout:4/702: readlink dc/d13/d40/d46/d48/d70/dc5/ldc 0 2024-09-21T08:02:50.917 INFO:tasks.workunit.client.0.smithi107.stdout:4/703: getdents dc/d13/d40/d5e/d77/d99 0 2024-09-21T08:02:50.917 INFO:tasks.workunit.client.0.smithi107.stdout:4/704: chown dc/d60/d8c/ld5 2 1 2024-09-21T08:02:50.927 INFO:tasks.workunit.client.0.smithi107.stdout:0/736: dread d1/d5/d25/d3d/d20/d29/d5c/f5e [0,4194304] 0 2024-09-21T08:02:50.929 INFO:tasks.workunit.client.0.smithi107.stdout:0/737: symlink d1/d5/d25/d3d/d20/d29/d5c/lf5 0 2024-09-21T08:02:50.929 INFO:tasks.workunit.client.0.smithi107.stdout:0/738: write d1/fe [2268431,93237] 0 2024-09-21T08:02:50.929 INFO:tasks.workunit.client.0.smithi107.stdout:0/739: dread - d1/d5/d25/fb9 zero size 2024-09-21T08:02:50.929 INFO:tasks.workunit.client.0.smithi107.stdout:0/740: chown d1/d5/d25/d3d/d20/d85 105 1 2024-09-21T08:02:50.929 INFO:tasks.workunit.client.0.smithi107.stdout:0/741: chown d1/d6f/f89 431521129 1 2024-09-21T08:02:50.929 INFO:tasks.workunit.client.0.smithi107.stdout:0/742: write d1/d6f/dc1/fc8 [768418,76807] 0 2024-09-21T08:02:50.929 INFO:tasks.workunit.client.0.smithi107.stdout:0/743: dread - d1/d5/d25/d3d/d20/d29/d55/fdc zero size 2024-09-21T08:02:50.937 INFO:tasks.workunit.client.0.smithi107.stdout:4/705: dwrite dc/d13/d40/d80/fce [0,4194304] 0 2024-09-21T08:02:50.938 INFO:tasks.workunit.client.0.smithi107.stdout:0/744: rmdir d1/d5/d25/d3d/d20 39 2024-09-21T08:02:50.940 INFO:tasks.workunit.client.0.smithi107.stdout:0/745: rename d1/d5/d25/d3d/d20/da0/fe6 to d1/d5/d25/d3d/da1/ff6 0 2024-09-21T08:02:50.941 INFO:tasks.workunit.client.0.smithi107.stdout:0/746: mkdir d1/d6f/dc1/dcc/df7 0 2024-09-21T08:02:50.942 INFO:tasks.workunit.client.0.smithi107.stdout:0/747: symlink d1/d5/d25/d2d/d8e/lf8 0 2024-09-21T08:02:50.945 INFO:tasks.workunit.client.0.smithi107.stdout:0/748: rename d1/d5/d25/d3d/d20/d85/dab to d1/d5/d25/d3d/d20/d85/de1/df9 0 2024-09-21T08:02:50.945 INFO:tasks.workunit.client.0.smithi107.stdout:0/749: chown d1/d5/d25/d3d/d20/l42 105941 1 2024-09-21T08:02:50.945 INFO:tasks.workunit.client.0.smithi107.stdout:0/750: readlink d1/d5/d25/d3d/lef 0 2024-09-21T08:02:50.946 INFO:tasks.workunit.client.0.smithi107.stdout:4/706: dread dc/d64/f79 [0,4194304] 0 2024-09-21T08:02:50.947 INFO:tasks.workunit.client.0.smithi107.stdout:0/751: symlink d1/d6f/dc1/dcc/df7/lfa 0 2024-09-21T08:02:50.956 INFO:tasks.workunit.client.0.smithi107.stdout:0/752: write d1/f4c [3225555,125351] 0 2024-09-21T08:02:50.958 INFO:tasks.workunit.client.0.smithi107.stdout:0/753: mkdir d1/d5/d25/d3d/d20/d29/d55/d91/d9a/dd1/dfb 0 2024-09-21T08:02:50.958 INFO:tasks.workunit.client.0.smithi107.stdout:0/754: write d1/d5/d25/d3d/d20/d85/d8a/fd4 [4539376,7073] 0 2024-09-21T08:02:50.960 INFO:tasks.workunit.client.0.smithi107.stdout:3/744: sync 2024-09-21T08:02:50.961 INFO:tasks.workunit.client.0.smithi107.stdout:4/707: dwrite dc/d64/d6b/dcf/fd3 [0,4194304] 0 2024-09-21T08:02:50.961 INFO:tasks.workunit.client.0.smithi107.stdout:4/708: chown dc/f2c 7622129 1 2024-09-21T08:02:50.962 INFO:tasks.workunit.client.0.smithi107.stdout:3/745: creat d8/d2b/ffc x:0 0 0 2024-09-21T08:02:50.962 INFO:tasks.workunit.client.0.smithi107.stdout:3/746: write d8/d25/d34/faf [982938,69411] 0 2024-09-21T08:02:50.966 INFO:tasks.workunit.client.0.smithi107.stdout:4/709: write dc/d13/d40/d5e/f92 [264402,119490] 0 2024-09-21T08:02:50.966 INFO:tasks.workunit.client.0.smithi107.stdout:4/710: chown dc/d13/d40/d46/f6c 2391 1 2024-09-21T08:02:50.966 INFO:tasks.workunit.client.0.smithi107.stdout:3/747: mkdir d8/d2b/d52/d71/dd8/dfd 0 2024-09-21T08:02:50.969 INFO:tasks.workunit.client.0.smithi107.stdout:4/711: rename dc/d13/d40/d46/d48/d70/dc5/cc8 to dc/d13/d40/d80/ce1 0 2024-09-21T08:02:50.969 INFO:tasks.workunit.client.0.smithi107.stdout:4/712: write dc/d13/d40/d46/d48/d70/dc5/d90/f96 [293319,114622] 0 2024-09-21T08:02:50.971 INFO:tasks.workunit.client.0.smithi107.stdout:3/748: rmdir d8/dcf 0 2024-09-21T08:02:50.971 INFO:tasks.workunit.client.0.smithi107.stdout:3/749: stat d8/d2b/d52/d55/lc5 0 2024-09-21T08:02:50.971 INFO:tasks.workunit.client.0.smithi107.stdout:3/750: chown d8/d2b/d52/d55/ca8 26960083 1 2024-09-21T08:02:50.974 INFO:tasks.workunit.client.0.smithi107.stdout:3/751: mkdir d8/dfe 0 2024-09-21T08:02:50.975 INFO:tasks.workunit.client.0.smithi107.stdout:0/755: dwrite d1/d5/d25/d3d/d20/f6c [0,4194304] 0 2024-09-21T08:02:50.976 INFO:tasks.workunit.client.0.smithi107.stdout:3/752: creat d8/d14/d96/db0/fff x:0 0 0 2024-09-21T08:02:50.976 INFO:tasks.workunit.client.0.smithi107.stdout:3/753: truncate d8/d21/d7e/fd2 671875 0 2024-09-21T08:02:50.984 INFO:tasks.workunit.client.0.smithi107.stdout:4/713: dwrite dc/d13/f72 [0,4194304] 0 2024-09-21T08:02:50.986 INFO:tasks.workunit.client.0.smithi107.stdout:0/756: mknod d1/d5/d25/cfc 0 2024-09-21T08:02:50.986 INFO:tasks.workunit.client.0.smithi107.stdout:0/757: creat d1/d5/d25/d3d/ffd x:0 0 0 2024-09-21T08:02:50.991 INFO:tasks.workunit.client.0.smithi107.stdout:4/714: mknod dc/d13/d40/d46/d48/d70/dc5/d90/db2/db8/ce2 0 2024-09-21T08:02:50.996 INFO:tasks.workunit.client.0.smithi107.stdout:4/715: getdents dc/d13/d40/d5e/d77 0 2024-09-21T08:02:50.997 INFO:tasks.workunit.client.0.smithi107.stdout:4/716: mknod dc/d13/d40/d5e/ce3 0 2024-09-21T08:02:51.004 INFO:tasks.workunit.client.0.smithi107.stdout:1/696: sync 2024-09-21T08:02:51.005 INFO:tasks.workunit.client.0.smithi107.stdout:2/755: sync 2024-09-21T08:02:51.005 INFO:tasks.workunit.client.0.smithi107.stdout:7/522: sync 2024-09-21T08:02:51.005 INFO:tasks.workunit.client.0.smithi107.stdout:6/760: sync 2024-09-21T08:02:51.005 INFO:tasks.workunit.client.0.smithi107.stdout:7/523: chown d7/c25 0 1 2024-09-21T08:02:51.005 INFO:tasks.workunit.client.0.smithi107.stdout:2/756: fsync d1/d2/d6d/d37/d49/d85/fed 0 2024-09-21T08:02:51.005 INFO:tasks.workunit.client.0.smithi107.stdout:6/761: fdatasync d2/d3/d7/d2a/f8b 0 2024-09-21T08:02:51.005 INFO:tasks.workunit.client.0.smithi107.stdout:6/762: write d2/d3/d7/d23/d2b/d84/fc5 [2540848,39281] 0 2024-09-21T08:02:51.005 INFO:tasks.workunit.client.0.smithi107.stdout:8/602: sync 2024-09-21T08:02:51.005 INFO:tasks.workunit.client.0.smithi107.stdout:5/829: sync 2024-09-21T08:02:51.006 INFO:tasks.workunit.client.0.smithi107.stdout:0/758: dwrite d1/d23/f8b [0,4194304] 0 2024-09-21T08:02:51.007 INFO:tasks.workunit.client.0.smithi107.stdout:7/524: creat d7/d22/d3b/fb6 x:0 0 0 2024-09-21T08:02:51.007 INFO:tasks.workunit.client.0.smithi107.stdout:7/525: readlink d7/d22/d3a/l54 0 2024-09-21T08:02:51.008 INFO:tasks.workunit.client.0.smithi107.stdout:2/757: truncate d1/d2/d6d/d42/db0/fc4 41474 0 2024-09-21T08:02:51.008 INFO:tasks.workunit.client.0.smithi107.stdout:9/810: sync 2024-09-21T08:02:51.012 INFO:tasks.workunit.client.0.smithi107.stdout:6/763: creat d2/d3/d7/d48/da3/d85/d9d/dcf/fff x:0 0 0 2024-09-21T08:02:51.012 INFO:tasks.workunit.client.0.smithi107.stdout:6/764: truncate d2/d3/d7/d24/d41/fbf 2141695 0 2024-09-21T08:02:51.012 INFO:tasks.workunit.client.0.smithi107.stdout:4/717: dread dc/d13/d40/d80/fce [0,4194304] 0 2024-09-21T08:02:51.013 INFO:tasks.workunit.client.0.smithi107.stdout:8/603: mknod d5/d2e/d7c/d9a/d9e/cd3 0 2024-09-21T08:02:51.013 INFO:tasks.workunit.client.0.smithi107.stdout:8/604: truncate d5/d38/fb3 786378 0 2024-09-21T08:02:51.016 INFO:tasks.workunit.client.0.smithi107.stdout:0/759: symlink d1/d5/d25/d3d/d20/d29/d5c/dc2/lfe 0 2024-09-21T08:02:51.017 INFO:tasks.workunit.client.0.smithi107.stdout:0/760: fdatasync d1/d5/d25/f77 0 2024-09-21T08:02:51.023 INFO:tasks.workunit.client.0.smithi107.stdout:7/526: dread d7/d22/d37/d4b/db0/f96 [4194304,4194304] 0 2024-09-21T08:02:51.023 INFO:tasks.workunit.client.0.smithi107.stdout:7/527: write d7/d38/f41 [2389364,112134] 0 2024-09-21T08:02:51.023 INFO:tasks.workunit.client.0.smithi107.stdout:7/528: chown d7/d22/l32 2107126825 1 2024-09-21T08:02:51.023 INFO:tasks.workunit.client.0.smithi107.stdout:2/758: rename d1/d2/fea to d1/d2/d6d/dfa/ffb 0 2024-09-21T08:02:51.025 INFO:tasks.workunit.client.0.smithi107.stdout:9/811: mknod d11/d27/d5e/df1/c121 0 2024-09-21T08:02:51.025 INFO:tasks.workunit.client.0.smithi107.stdout:9/812: chown d11/d27/d98/d97/lfa 266780749 1 2024-09-21T08:02:51.025 INFO:tasks.workunit.client.0.smithi107.stdout:9/813: chown d11/d24/d35/c9c 86 1 2024-09-21T08:02:51.026 INFO:tasks.workunit.client.0.smithi107.stdout:6/765: dread d2/d3/d7/f8 [4194304,4194304] 0 2024-09-21T08:02:51.026 INFO:tasks.workunit.client.0.smithi107.stdout:8/605: truncate d5/d23/f3b 1113310 0 2024-09-21T08:02:51.027 INFO:tasks.workunit.client.0.smithi107.stdout:6/766: write d2/d3/d7/d48/da3/d85/fa5 [74496,22792] 0 2024-09-21T08:02:51.027 INFO:tasks.workunit.client.0.smithi107.stdout:6/767: fdatasync d2/d3/d7/d48/da3/d85/d9d/dcf/fff 0 2024-09-21T08:02:51.028 INFO:tasks.workunit.client.0.smithi107.stdout:7/529: symlink d7/d22/d37/d5a/d83/d9e/lb7 0 2024-09-21T08:02:51.029 INFO:tasks.workunit.client.0.smithi107.stdout:2/759: link d1/d2/d6d/d9b/cee d1/d2/d6d/d37/cfc 0 2024-09-21T08:02:51.029 INFO:tasks.workunit.client.0.smithi107.stdout:2/760: fdatasync d1/d6/d92/fac 0 2024-09-21T08:02:51.030 INFO:tasks.workunit.client.0.smithi107.stdout:2/761: truncate d1/d2/f7a 824938 0 2024-09-21T08:02:51.031 INFO:tasks.workunit.client.0.smithi107.stdout:2/762: dread d1/d2/f9 [0,4194304] 0 2024-09-21T08:02:51.031 INFO:tasks.workunit.client.0.smithi107.stdout:2/763: fdatasync d1/d2/d6d/d37/d49/fdb 0 2024-09-21T08:02:51.031 INFO:tasks.workunit.client.0.smithi107.stdout:2/764: read d1/d6/f18 [168759,72227] 0 2024-09-21T08:02:51.031 INFO:tasks.workunit.client.0.smithi107.stdout:2/765: chown d1/d2/d6d/d37/d49/d7f 719039 1 2024-09-21T08:02:51.031 INFO:tasks.workunit.client.0.smithi107.stdout:2/766: write d1/d2/f9 [1018352,26538] 0 2024-09-21T08:02:51.032 INFO:tasks.workunit.client.0.smithi107.stdout:5/830: dwrite d7/d70/fd0 [0,4194304] 0 2024-09-21T08:02:51.032 INFO:tasks.workunit.client.0.smithi107.stdout:9/814: rmdir d11/d27/d5b 39 2024-09-21T08:02:51.034 INFO:tasks.workunit.client.0.smithi107.stdout:8/606: unlink d5/d2e/cad 0 2024-09-21T08:02:51.034 INFO:tasks.workunit.client.0.smithi107.stdout:8/607: dread - d5/d2e/d94/fbf zero size 2024-09-21T08:02:51.034 INFO:tasks.workunit.client.0.smithi107.stdout:8/608: creat d5/d40/fd4 x:0 0 0 2024-09-21T08:02:51.034 INFO:tasks.workunit.client.0.smithi107.stdout:8/609: read - d5/d40/d8a/dcb/fd0 zero size 2024-09-21T08:02:51.035 INFO:tasks.workunit.client.0.smithi107.stdout:1/697: dwrite d0/d29/d4d/d84/dc5/da9/dc7/db5/fd4 [0,4194304] 0 2024-09-21T08:02:51.035 INFO:tasks.workunit.client.0.smithi107.stdout:6/768: unlink d2/d3/d7/d48/da3/d85/d9d/dcf/lfc 0 2024-09-21T08:02:51.035 INFO:tasks.workunit.client.0.smithi107.stdout:6/769: fdatasync d2/d3/d7/f8 0 2024-09-21T08:02:51.036 INFO:tasks.workunit.client.0.smithi107.stdout:2/767: truncate d1/d2/d6d/f86 1209351 0 2024-09-21T08:02:51.039 INFO:tasks.workunit.client.0.smithi107.stdout:5/831: mkdir d7/de/d1d/d29/dfc/d125 0 2024-09-21T08:02:51.039 INFO:tasks.workunit.client.0.smithi107.stdout:5/832: readlink d7/de/d1d/la2 0 2024-09-21T08:02:51.040 INFO:tasks.workunit.client.0.smithi107.stdout:8/610: mkdir d5/d1d/d90/dd5 0 2024-09-21T08:02:51.043 INFO:tasks.workunit.client.0.smithi107.stdout:1/698: link d0/d19/d2b/d4b/c70 d0/d29/d4d/d84/dc5/da9/dc7/ce6 0 2024-09-21T08:02:51.044 INFO:tasks.workunit.client.0.smithi107.stdout:9/815: dread d11/f3e [0,4194304] 0 2024-09-21T08:02:51.044 INFO:tasks.workunit.client.0.smithi107.stdout:9/816: chown d11/d27/d2a/f63 91146308 1 2024-09-21T08:02:51.044 INFO:tasks.workunit.client.0.smithi107.stdout:6/770: creat d2/d3/d7/d48/da3/d85/d9b/f100 x:0 0 0 2024-09-21T08:02:51.045 INFO:tasks.workunit.client.0.smithi107.stdout:9/817: write d11/d27/d2f/d4d/d5c/d61/f7e [4561701,1700] 0 2024-09-21T08:02:51.045 INFO:tasks.workunit.client.0.smithi107.stdout:9/818: read - d11/d24/d26/f106 zero size 2024-09-21T08:02:51.045 INFO:tasks.workunit.client.0.smithi107.stdout:6/771: truncate d2/d3/d7/d48/da3/d85/dd9/ff5 297507 0 2024-09-21T08:02:51.045 INFO:tasks.workunit.client.0.smithi107.stdout:5/833: mkdir d7/de/d1d/d29/dfc/d125/d126 0 2024-09-21T08:02:51.046 INFO:tasks.workunit.client.0.smithi107.stdout:8/611: truncate d5/d1d/f24 192604 0 2024-09-21T08:02:51.047 INFO:tasks.workunit.client.0.smithi107.stdout:1/699: symlink d0/d19/d2b/d4b/d44/d72/dde/le7 0 2024-09-21T08:02:51.048 INFO:tasks.workunit.client.0.smithi107.stdout:6/772: link d2/d3/d7/d54/d5c/laa d2/d3/d7/d54/l101 0 2024-09-21T08:02:51.048 INFO:tasks.workunit.client.0.smithi107.stdout:6/773: read - d2/d3/d7/d54/d5c/fc8 zero size 2024-09-21T08:02:51.049 INFO:tasks.workunit.client.0.smithi107.stdout:2/768: dread d1/d2/d6d/d37/f4a [0,4194304] 0 2024-09-21T08:02:51.049 INFO:tasks.workunit.client.0.smithi107.stdout:2/769: chown d1/d2/fd0 1338 1 2024-09-21T08:02:51.049 INFO:tasks.workunit.client.0.smithi107.stdout:2/770: creat d1/dc8/ffd x:0 0 0 2024-09-21T08:02:51.050 INFO:tasks.workunit.client.0.smithi107.stdout:5/834: link d7/de/d2d/d5d/c107 d7/de/da3/c127 0 2024-09-21T08:02:51.050 INFO:tasks.workunit.client.0.smithi107.stdout:5/835: stat d7/d70/c101 0 2024-09-21T08:02:51.052 INFO:tasks.workunit.client.0.smithi107.stdout:8/612: link d5/d2e/f4a d5/d1d/d90/dd5/fd6 0 2024-09-21T08:02:51.055 INFO:tasks.workunit.client.0.smithi107.stdout:2/771: creat d1/d2/d6d/d42/db0/df7/ffe x:0 0 0 2024-09-21T08:02:51.055 INFO:tasks.workunit.client.0.smithi107.stdout:2/772: truncate d1/d6/d92/fac 410287 0 2024-09-21T08:02:51.055 INFO:tasks.workunit.client.0.smithi107.stdout:2/773: write d1/d1e/f5c [3023055,27884] 0 2024-09-21T08:02:51.056 INFO:tasks.workunit.client.0.smithi107.stdout:2/774: chown d1/d1e/f79 25 1 2024-09-21T08:02:51.056 INFO:tasks.workunit.client.0.smithi107.stdout:8/613: truncate d5/fa 3429801 0 2024-09-21T08:02:51.056 INFO:tasks.workunit.client.0.smithi107.stdout:8/614: chown d5/d38/d56/d54/fae 148391679 1 2024-09-21T08:02:51.056 INFO:tasks.workunit.client.0.smithi107.stdout:8/615: write d5/d38/d56/f65 [440042,15468] 0 2024-09-21T08:02:51.057 INFO:tasks.workunit.client.0.smithi107.stdout:2/775: mkdir d1/d2/d6d/d37/d82/dff 0 2024-09-21T08:02:51.058 INFO:tasks.workunit.client.0.smithi107.stdout:1/700: write d0/d19/d2b/d4b/d44/d72/f78 [3063325,35711] 0 2024-09-21T08:02:51.058 INFO:tasks.workunit.client.0.smithi107.stdout:1/701: chown d0/d19/d2b/d4b/d61/d75/c88 1873396 1 2024-09-21T08:02:51.058 INFO:tasks.workunit.client.0.smithi107.stdout:8/616: mkdir d5/d44/d5d/d9c/dd7 0 2024-09-21T08:02:51.060 INFO:tasks.workunit.client.0.smithi107.stdout:2/776: unlink d1/d2/fd0 0 2024-09-21T08:02:51.061 INFO:tasks.workunit.client.0.smithi107.stdout:8/617: symlink d5/d38/d67/ld8 0 2024-09-21T08:02:51.061 INFO:tasks.workunit.client.0.smithi107.stdout:4/718: dwrite dc/d13/d40/d5e/da8/fd6 [0,4194304] 0 2024-09-21T08:02:51.063 INFO:tasks.workunit.client.0.smithi107.stdout:2/777: creat d1/d2/d6d/dfa/f100 x:0 0 0 2024-09-21T08:02:51.063 INFO:tasks.workunit.client.0.smithi107.stdout:2/778: chown d1/d6/fe9 589417 1 2024-09-21T08:02:51.064 INFO:tasks.workunit.client.0.smithi107.stdout:8/618: mknod d5/d2e/d7c/d9a/d9e/dcc/cd9 0 2024-09-21T08:02:51.065 INFO:tasks.workunit.client.0.smithi107.stdout:4/719: truncate dc/d13/d40/d5e/f92 1770968 0 2024-09-21T08:02:51.065 INFO:tasks.workunit.client.0.smithi107.stdout:4/720: creat dc/fe4 x:0 0 0 2024-09-21T08:02:51.065 INFO:tasks.workunit.client.0.smithi107.stdout:4/721: chown dc/d13/d40/d5e/d77/d99/lc3 12039 1 2024-09-21T08:02:51.066 INFO:tasks.workunit.client.0.smithi107.stdout:9/819: read d11/d27/d98/d97/f111 [2945793,14953] 0 2024-09-21T08:02:51.068 INFO:tasks.workunit.client.0.smithi107.stdout:9/820: creat d11/d27/d2f/d4d/d5c/d61/db4/dbb/f122 x:0 0 0 2024-09-21T08:02:51.069 INFO:tasks.workunit.client.0.smithi107.stdout:9/821: creat d11/d27/d2f/def/dfb/f123 x:0 0 0 2024-09-21T08:02:51.073 INFO:tasks.workunit.client.0.smithi107.stdout:9/822: dread d11/d27/d2a/f42 [0,4194304] 0 2024-09-21T08:02:51.074 INFO:tasks.workunit.client.0.smithi107.stdout:9/823: symlink d11/d24/l124 0 2024-09-21T08:02:51.075 INFO:tasks.workunit.client.0.smithi107.stdout:9/824: creat d11/d27/d2f/d4d/d5c/d61/db4/d10f/f125 x:0 0 0 2024-09-21T08:02:51.079 INFO:tasks.workunit.client.0.smithi107.stdout:0/761: dwrite d1/d5/d25/d3d/d20/d85/da8/fda [0,4194304] 0 2024-09-21T08:02:51.085 INFO:tasks.workunit.client.0.smithi107.stdout:8/619: dread d5/d23/f35 [0,4194304] 0 2024-09-21T08:02:51.085 INFO:tasks.workunit.client.0.smithi107.stdout:9/825: write d11/d24/d4a/fd6 [1591316,69149] 0 2024-09-21T08:02:51.089 INFO:tasks.workunit.client.0.smithi107.stdout:9/826: mknod d11/d27/d2f/c126 0 2024-09-21T08:02:51.089 INFO:tasks.workunit.client.0.smithi107.stdout:4/722: read dc/d13/d40/d46/f82 [308154,31168] 0 2024-09-21T08:02:51.089 INFO:tasks.workunit.client.0.smithi107.stdout:4/723: stat dc/d13/d40/d46/d48/d70/dc5/d90/c6d 0 2024-09-21T08:02:51.089 INFO:tasks.workunit.client.0.smithi107.stdout:9/827: truncate d11/f20 4153090 0 2024-09-21T08:02:51.089 INFO:tasks.workunit.client.0.smithi107.stdout:9/828: read - d11/d27/d2a/d7f/fbc zero size 2024-09-21T08:02:51.092 INFO:tasks.workunit.client.0.smithi107.stdout:9/829: mknod d11/d27/d2f/d4d/d5c/d61/dca/c127 0 2024-09-21T08:02:51.097 INFO:tasks.workunit.client.0.smithi107.stdout:7/530: dwrite d7/d10/f1d [0,4194304] 0 2024-09-21T08:02:51.097 INFO:tasks.workunit.client.0.smithi107.stdout:7/531: write d7/d22/d37/d5a/fad [4758386,122227] 0 2024-09-21T08:02:51.097 INFO:tasks.workunit.client.0.smithi107.stdout:6/774: dwrite d2/d3/d7/d48/da3/d85/d9d/dcf/fff [0,4194304] 0 2024-09-21T08:02:51.101 INFO:tasks.workunit.client.0.smithi107.stdout:5/836: dwrite d7/de/d1d/d24/d3d/fd2 [0,4194304] 0 2024-09-21T08:02:51.101 INFO:tasks.workunit.client.0.smithi107.stdout:7/532: symlink d7/d22/d37/d5a/lb8 0 2024-09-21T08:02:51.101 INFO:tasks.workunit.client.0.smithi107.stdout:7/533: chown d7/d22/d37/d4b/db0/f62 4 1 2024-09-21T08:02:51.102 INFO:tasks.workunit.client.0.smithi107.stdout:6/775: symlink d2/d3/l102 0 2024-09-21T08:02:51.102 INFO:tasks.workunit.client.0.smithi107.stdout:6/776: dread - d2/d3/d7/d23/d2b/d84/fbb zero size 2024-09-21T08:02:51.103 INFO:tasks.workunit.client.0.smithi107.stdout:8/620: dread d5/d38/d67/d7d/d91/fa6 [4194304,4194304] 0 2024-09-21T08:02:51.103 INFO:tasks.workunit.client.0.smithi107.stdout:9/830: dread d11/d27/d98/f47 [0,4194304] 0 2024-09-21T08:02:51.103 INFO:tasks.workunit.client.0.smithi107.stdout:9/831: chown d11/d24/d35/c9c 189276 1 2024-09-21T08:02:51.104 INFO:tasks.workunit.client.0.smithi107.stdout:0/762: dwrite d1/d23/f3a [0,4194304] 0 2024-09-21T08:02:51.105 INFO:tasks.workunit.client.0.smithi107.stdout:1/702: dwrite d0/d19/d2b/d4b/fd [0,4194304] 0 2024-09-21T08:02:51.106 INFO:tasks.workunit.client.0.smithi107.stdout:4/724: dread dc/d13/d40/f45 [0,4194304] 0 2024-09-21T08:02:51.107 INFO:tasks.workunit.client.0.smithi107.stdout:6/777: dread d2/d3/d7/d3f/f60 [0,4194304] 0 2024-09-21T08:02:51.108 INFO:tasks.workunit.client.0.smithi107.stdout:1/703: write d0/d19/f58 [4740361,118012] 0 2024-09-21T08:02:51.109 INFO:tasks.workunit.client.0.smithi107.stdout:9/832: symlink d11/d27/d2f/d4d/d5c/d61/db4/l128 0 2024-09-21T08:02:51.109 INFO:tasks.workunit.client.0.smithi107.stdout:9/833: creat d11/d24/d35/f129 x:0 0 0 2024-09-21T08:02:51.109 INFO:tasks.workunit.client.0.smithi107.stdout:9/834: dread - d11/d24/d26/f106 zero size 2024-09-21T08:02:51.111 INFO:tasks.workunit.client.0.smithi107.stdout:0/763: symlink d1/d5/d25/d3d/d20/d29/d55/d91/d9a/lff 0 2024-09-21T08:02:51.111 INFO:tasks.workunit.client.0.smithi107.stdout:5/837: dread d7/de/d1d/d29/d64/f90 [0,4194304] 0 2024-09-21T08:02:51.114 INFO:tasks.workunit.client.0.smithi107.stdout:4/725: rmdir dc/d13/d40/d5e 39 2024-09-21T08:02:51.115 INFO:tasks.workunit.client.0.smithi107.stdout:6/778: symlink d2/d2e/d97/l103 0 2024-09-21T08:02:51.116 INFO:tasks.workunit.client.0.smithi107.stdout:2/779: getdents d1/d2/d6d/d37/d82 0 2024-09-21T08:02:51.119 INFO:tasks.workunit.client.0.smithi107.stdout:7/534: rmdir d7/d22/d37/d4b/db0/d4f 39 2024-09-21T08:02:51.124 INFO:tasks.workunit.client.0.smithi107.stdout:9/835: rmdir d11/d27/d2f/d4d/d5c/d61/d11e 0 2024-09-21T08:02:51.124 INFO:tasks.workunit.client.0.smithi107.stdout:9/836: read - d11/d27/d2f/f103 zero size 2024-09-21T08:02:51.124 INFO:tasks.workunit.client.0.smithi107.stdout:9/837: chown d11/d27/d2f/def/dfb 210 1 2024-09-21T08:02:51.124 INFO:tasks.workunit.client.0.smithi107.stdout:9/838: fsync d11/d24/fd1 0 2024-09-21T08:02:51.130 INFO:tasks.workunit.client.0.smithi107.stdout:6/779: creat d2/d2e/f104 x:0 0 0 2024-09-21T08:02:51.130 INFO:tasks.workunit.client.0.smithi107.stdout:6/780: write d2/d3/d7/d23/ff0 [781448,46500] 0 2024-09-21T08:02:51.131 INFO:tasks.workunit.client.0.smithi107.stdout:5/838: dwrite d7/de/d1d/d29/d64/d100/f118 [0,4194304] 0 2024-09-21T08:02:51.131 INFO:tasks.workunit.client.0.smithi107.stdout:5/839: fsync d7/d70/fd0 0 2024-09-21T08:02:51.131 INFO:tasks.workunit.client.0.smithi107.stdout:2/780: truncate d1/d2/fa4 1495269 0 2024-09-21T08:02:51.131 INFO:tasks.workunit.client.0.smithi107.stdout:2/781: write d1/d2/d6d/d37/d49/d7f/fd8 [561329,1229] 0 2024-09-21T08:02:51.135 INFO:tasks.workunit.client.0.smithi107.stdout:7/535: dread d7/d22/d3a/d49/f74 [0,4194304] 0 2024-09-21T08:02:51.143 INFO:tasks.workunit.client.0.smithi107.stdout:5/840: creat d7/de/d1d/d29/d68/ddb/dde/dba/f128 x:0 0 0 2024-09-21T08:02:51.144 INFO:tasks.workunit.client.0.smithi107.stdout:9/839: symlink d11/d24/d26/dd0/dec/l12a 0 2024-09-21T08:02:51.148 INFO:tasks.workunit.client.0.smithi107.stdout:6/781: dread d2/d3/d7/d79/fb5 [0,4194304] 0 2024-09-21T08:02:51.150 INFO:tasks.workunit.client.0.smithi107.stdout:6/782: rmdir d2/d3/d7/d54/dae 39 2024-09-21T08:02:51.150 INFO:tasks.workunit.client.0.smithi107.stdout:6/783: dread - d2/d3/d7/d48/da3/d85/d9d/fd1 zero size 2024-09-21T08:02:51.160 INFO:tasks.workunit.client.0.smithi107.stdout:5/841: write d7/de/d1d/d29/d68/ddb/dde/fdd [2119719,40455] 0 2024-09-21T08:02:51.161 INFO:tasks.workunit.client.0.smithi107.stdout:2/782: dwrite d1/d16/f32 [0,4194304] 0 2024-09-21T08:02:51.163 INFO:tasks.workunit.client.0.smithi107.stdout:2/783: rename d1/d2/d6d/d9b/fe8 to d1/d2/d6d/d42/db0/df7/f101 0 2024-09-21T08:02:51.163 INFO:tasks.workunit.client.0.smithi107.stdout:2/784: readlink d1/d2/d6d/d37/d49/l81 0 2024-09-21T08:02:51.171 INFO:tasks.workunit.client.0.smithi107.stdout:2/785: dread d1/d16/d35/fc6 [0,4194304] 0 2024-09-21T08:02:51.171 INFO:tasks.workunit.client.0.smithi107.stdout:2/786: chown d1/d2/d6d/d37/d49/d7f/fd1 255464164 1 2024-09-21T08:02:51.171 INFO:tasks.workunit.client.0.smithi107.stdout:2/787: stat d1/d2/d6d/d9b/dad/fdf 0 2024-09-21T08:02:51.171 INFO:tasks.workunit.client.0.smithi107.stdout:2/788: symlink d1/d6/l102 0 2024-09-21T08:02:51.173 INFO:tasks.workunit.client.0.smithi107.stdout:2/789: creat d1/d6/d92/df2/f103 x:0 0 0 2024-09-21T08:02:51.173 INFO:tasks.workunit.client.0.smithi107.stdout:2/790: read - d1/d2/d6d/d37/d49/d7f/fd1 zero size 2024-09-21T08:02:51.173 INFO:tasks.workunit.client.0.smithi107.stdout:2/791: write d1/d2/d6d/d37/f4a [4180620,16852] 0 2024-09-21T08:02:51.174 INFO:tasks.workunit.client.0.smithi107.stdout:2/792: mknod d1/d2/d6d/d9b/dad/c104 0 2024-09-21T08:02:51.174 INFO:tasks.workunit.client.0.smithi107.stdout:9/840: dwrite d11/d24/fd1 [0,4194304] 0 2024-09-21T08:02:51.184 INFO:tasks.workunit.client.0.smithi107.stdout:9/841: write d11/d27/d2f/f3b [367936,68291] 0 2024-09-21T08:02:51.191 INFO:tasks.workunit.client.0.smithi107.stdout:5/842: dwrite d7/de/d2d/d5d/d60/dc5/f112 [0,4194304] 0 2024-09-21T08:02:51.194 INFO:tasks.workunit.client.0.smithi107.stdout:5/843: creat d7/de/d1d/d29/d68/ddb/dde/dba/d111/f129 x:0 0 0 2024-09-21T08:02:51.195 INFO:tasks.workunit.client.0.smithi107.stdout:5/844: link d7/de/d1d/d29/d68/ddb/dde/l6c d7/de/d1d/d29/d68/ddb/dde/dd8/dff/l12a 0 2024-09-21T08:02:51.197 INFO:tasks.workunit.client.0.smithi107.stdout:5/845: mkdir d7/de/d1d/d29/d68/ddb/dde/dcc/d12b 0 2024-09-21T08:02:51.197 INFO:tasks.workunit.client.0.smithi107.stdout:5/846: readlink d7/lf1 0 2024-09-21T08:02:51.197 INFO:tasks.workunit.client.0.smithi107.stdout:5/847: write d7/de/d52/d8b/f124 [314466,60421] 0 2024-09-21T08:02:51.198 INFO:tasks.workunit.client.0.smithi107.stdout:2/793: dwrite d1/d2/d6d/d37/f3a [0,4194304] 0 2024-09-21T08:02:51.199 INFO:tasks.workunit.client.0.smithi107.stdout:2/794: creat d1/dc8/f105 x:0 0 0 2024-09-21T08:02:51.200 INFO:tasks.workunit.client.0.smithi107.stdout:7/536: dwrite d7/d10/d28/f35 [0,4194304] 0 2024-09-21T08:02:51.200 INFO:tasks.workunit.client.0.smithi107.stdout:9/842: dread d11/d27/d2a/f33 [0,4194304] 0 2024-09-21T08:02:51.200 INFO:tasks.workunit.client.0.smithi107.stdout:9/843: truncate d11/d27/d2f/d4d/d5c/d61/db4/dbb/f122 238318 0 2024-09-21T08:02:51.201 INFO:tasks.workunit.client.0.smithi107.stdout:7/537: creat d7/d22/d37/d5a/d83/d9e/fb9 x:0 0 0 2024-09-21T08:02:51.201 INFO:tasks.workunit.client.0.smithi107.stdout:7/538: write d7/d22/d3d/f42 [3450393,5786] 0 2024-09-21T08:02:51.201 INFO:tasks.workunit.client.0.smithi107.stdout:7/539: chown d7 26909 1 2024-09-21T08:02:51.206 INFO:tasks.workunit.client.0.smithi107.stdout:2/795: rename d1/d16/d35/c44 to d1/dc8/c106 0 2024-09-21T08:02:51.206 INFO:tasks.workunit.client.0.smithi107.stdout:2/796: read d1/d16/f60 [2180912,102296] 0 2024-09-21T08:02:51.208 INFO:tasks.workunit.client.0.smithi107.stdout:2/797: fsync d1/f26 0 2024-09-21T08:02:51.216 INFO:tasks.workunit.client.0.smithi107.stdout:5/848: dwrite d7/de/d2d/fd4 [0,4194304] 0 2024-09-21T08:02:51.221 INFO:tasks.workunit.client.0.smithi107.stdout:2/798: link d1/d2/d6d/d37/cfc d1/d2/d6d/d37/df0/c107 0 2024-09-21T08:02:51.222 INFO:tasks.workunit.client.0.smithi107.stdout:7/540: unlink d7/d38/l5d 0 2024-09-21T08:02:51.228 INFO:tasks.workunit.client.0.smithi107.stdout:5/849: truncate d7/f6d 3586265 0 2024-09-21T08:02:51.229 INFO:tasks.workunit.client.0.smithi107.stdout:7/541: mkdir d7/d10/d28/dba 0 2024-09-21T08:02:51.231 INFO:tasks.workunit.client.0.smithi107.stdout:5/850: mknod d7/de/d1d/d29/dfc/d125/d126/c12c 0 2024-09-21T08:02:51.232 INFO:tasks.workunit.client.0.smithi107.stdout:2/799: read d1/f31 [2499005,528] 0 2024-09-21T08:02:51.232 INFO:tasks.workunit.client.0.smithi107.stdout:2/800: write d1/d2/d6d/dfa/ffb [167015,18029] 0 2024-09-21T08:02:51.234 INFO:tasks.workunit.client.0.smithi107.stdout:5/851: rename d7/d70/c101 to d7/de/d1d/d29/d68/de9/c12d 0 2024-09-21T08:02:51.234 INFO:tasks.workunit.client.0.smithi107.stdout:5/852: creat d7/de/d1d/dbc/f12e x:0 0 0 2024-09-21T08:02:51.234 INFO:tasks.workunit.client.0.smithi107.stdout:2/801: creat d1/d2/d6d/f108 x:0 0 0 2024-09-21T08:02:51.236 INFO:tasks.workunit.client.0.smithi107.stdout:5/853: truncate d7/de/d2d/d5d/d60/dc5/fe0 2343225 0 2024-09-21T08:02:51.237 INFO:tasks.workunit.client.0.smithi107.stdout:2/802: symlink d1/d2/d6d/d37/d82/dff/l109 0 2024-09-21T08:02:51.238 INFO:tasks.workunit.client.0.smithi107.stdout:7/542: dread d7/d22/d3a/d49/f6f [0,4194304] 0 2024-09-21T08:02:51.238 INFO:tasks.workunit.client.0.smithi107.stdout:7/543: truncate d7/fa9 666932 0 2024-09-21T08:02:51.239 INFO:tasks.workunit.client.0.smithi107.stdout:5/854: rename d7/de/d52/d8b/cbd to d7/de/d2d/d5d/d60/c12f 0 2024-09-21T08:02:51.239 INFO:tasks.workunit.client.0.smithi107.stdout:5/855: fsync d7/de/d1d/d29/d68/ddb/dde/dd8/d105/f117 0 2024-09-21T08:02:51.240 INFO:tasks.workunit.client.0.smithi107.stdout:7/544: symlink d7/d22/d37/d40/d4d/lbb 0 2024-09-21T08:02:51.240 INFO:tasks.workunit.client.0.smithi107.stdout:7/545: readlink d7/d22/d37/d40/l6c 0 2024-09-21T08:02:51.241 INFO:tasks.workunit.client.0.smithi107.stdout:5/856: truncate d7/de/d2d/d5d/f9e 7220504 0 2024-09-21T08:02:51.245 INFO:tasks.workunit.client.0.smithi107.stdout:7/546: rename d7/d10/d28/f2f to d7/d10/d28/d69/da0/fbc 0 2024-09-21T08:02:51.247 INFO:tasks.workunit.client.0.smithi107.stdout:7/547: rmdir d7/d22/d3b 39 2024-09-21T08:02:51.250 INFO:tasks.workunit.client.0.smithi107.stdout:7/548: mknod d7/d38/cbd 0 2024-09-21T08:02:51.251 INFO:tasks.workunit.client.0.smithi107.stdout:7/549: mkdir d7/d22/d3a/d49/dbe 0 2024-09-21T08:02:51.253 INFO:tasks.workunit.client.0.smithi107.stdout:7/550: mknod d7/d10/d28/dba/cbf 0 2024-09-21T08:02:51.259 INFO:tasks.workunit.client.0.smithi107.stdout:2/803: dwrite d1/d2/d6d/f5b [4194304,4194304] 0 2024-09-21T08:02:51.377 INFO:tasks.workunit.client.0.smithi107.stdout:5/857: dwrite d7/de/d1d/d29/d64/d87/fa5 [0,4194304] 0 2024-09-21T08:02:51.377 INFO:tasks.workunit.client.0.smithi107.stdout:5/858: creat d7/de/d1d/d29/d68/ddb/dde/dba/f130 x:0 0 0 2024-09-21T08:02:51.377 INFO:tasks.workunit.client.0.smithi107.stdout:5/859: rmdir d7/de/d1d/d29/d68/ddb/dde/dba/d113 0 2024-09-21T08:02:51.377 INFO:tasks.workunit.client.0.smithi107.stdout:5/860: chown d7/de/d2d/d5d/d60/c69 0 1 2024-09-21T08:02:51.377 INFO:tasks.workunit.client.0.smithi107.stdout:5/861: mknod d7/de/d1d/d29/d68/de9/c131 0 2024-09-21T08:02:51.377 INFO:tasks.workunit.client.0.smithi107.stdout:2/804: dwrite d1/d16/d35/f59 [0,4194304] 0 2024-09-21T08:02:51.377 INFO:tasks.workunit.client.0.smithi107.stdout:7/551: dwrite d7/d38/f7d [0,4194304] 0 2024-09-21T08:02:51.377 INFO:tasks.workunit.client.0.smithi107.stdout:2/805: stat d1/d2/d6d/d37/d49/d7f/l8f 0 2024-09-21T08:02:51.378 INFO:tasks.workunit.client.0.smithi107.stdout:2/806: stat d1/d2/d6d/d37/d49/d85 0 2024-09-21T08:02:51.378 INFO:tasks.workunit.client.0.smithi107.stdout:7/552: write d7/d22/d37/d4b/f9d [418520,82274] 0 2024-09-21T08:02:51.378 INFO:tasks.workunit.client.0.smithi107.stdout:2/807: write d1/d2/d6d/d37/d49/d85/f97 [2081067,91808] 0 2024-09-21T08:02:51.378 INFO:tasks.workunit.client.0.smithi107.stdout:5/862: write d7/de/d2d/d5d/f9e [430870,98778] 0 2024-09-21T08:02:51.378 INFO:tasks.workunit.client.0.smithi107.stdout:5/863: rmdir d7/de/d52 39 2024-09-21T08:02:51.378 INFO:tasks.workunit.client.0.smithi107.stdout:5/864: write d7/de/d1d/d29/d64/f89 [5497723,22903] 0 2024-09-21T08:02:51.378 INFO:tasks.workunit.client.0.smithi107.stdout:7/553: dread d7/d38/f7d [0,4194304] 0 2024-09-21T08:02:51.378 INFO:tasks.workunit.client.0.smithi107.stdout:7/554: fsync d7/d22/d3d/fa2 0 2024-09-21T08:02:51.378 INFO:tasks.workunit.client.0.smithi107.stdout:7/555: stat d7/d22/d37/d5a/f8c 0 2024-09-21T08:02:51.378 INFO:tasks.workunit.client.0.smithi107.stdout:7/556: dwrite d7/f3f [0,4194304] 0 2024-09-21T08:02:51.379 INFO:tasks.workunit.client.0.smithi107.stdout:7/557: dread d7/d18/f29 [4194304,4194304] 0 2024-09-21T08:02:51.379 INFO:tasks.workunit.client.0.smithi107.stdout:7/558: write d7/d10/d28/d69/da0/fbc [4427819,61481] 0 2024-09-21T08:02:51.379 INFO:tasks.workunit.client.0.smithi107.stdout:7/559: creat d7/d22/d37/d4b/db0/d4f/fc0 x:0 0 0 2024-09-21T08:02:51.379 INFO:tasks.workunit.client.0.smithi107.stdout:5/865: dwrite d7/de/d1d/d29/fc6 [0,4194304] 0 2024-09-21T08:02:51.379 INFO:tasks.workunit.client.0.smithi107.stdout:7/560: dread d7/d22/d3d/f50 [0,4194304] 0 2024-09-21T08:02:51.379 INFO:tasks.workunit.client.0.smithi107.stdout:7/561: write d7/d22/d3b/fa3 [4390121,45849] 0 2024-09-21T08:02:51.379 INFO:tasks.workunit.client.0.smithi107.stdout:5/866: dread d7/de/d35/f8a [0,4194304] 0 2024-09-21T08:02:51.379 INFO:tasks.workunit.client.0.smithi107.stdout:5/867: chown d7/de/d35/c7d 22 1 2024-09-21T08:02:51.379 INFO:tasks.workunit.client.0.smithi107.stdout:5/868: rename d7/de/d1d/d29/d68/ddb/dde/dd8/dff/l11d to d7/de/d1d/d29/d68/ddb/dde/dd8/dff/l132 0 2024-09-21T08:02:51.379 INFO:tasks.workunit.client.0.smithi107.stdout:5/869: write d7/de/d1d/d29/d64/f90 [1069015,29285] 0 2024-09-21T08:02:51.380 INFO:tasks.workunit.client.0.smithi107.stdout:5/870: symlink d7/de/d1d/d29/d68/ddb/d11b/l133 0 2024-09-21T08:02:51.380 INFO:tasks.workunit.client.0.smithi107.stdout:5/871: chown d7/d70/ff2 285355 1 2024-09-21T08:02:51.380 INFO:tasks.workunit.client.0.smithi107.stdout:5/872: dread d7/fec [0,4194304] 0 2024-09-21T08:02:51.380 INFO:tasks.workunit.client.0.smithi107.stdout:5/873: chown d7/de/d1d/d29/d64/d87/fa5 69 1 2024-09-21T08:02:51.380 INFO:tasks.workunit.client.0.smithi107.stdout:5/874: mknod d7/de/d1d/d24/d3d/c134 0 2024-09-21T08:02:51.380 INFO:tasks.workunit.client.0.smithi107.stdout:5/875: write d7/de/d2d/d5d/d60/dc5/ffd [70341,17076] 0 2024-09-21T08:02:51.380 INFO:tasks.workunit.client.0.smithi107.stdout:5/876: creat d7/f135 x:0 0 0 2024-09-21T08:02:51.380 INFO:tasks.workunit.client.0.smithi107.stdout:5/877: readlink d7/de/d1d/d29/d68/l6a 0 2024-09-21T08:02:51.380 INFO:tasks.workunit.client.0.smithi107.stdout:5/878: symlink d7/de/d1d/d29/d68/ddb/dde/dd8/d105/l136 0 2024-09-21T08:02:51.380 INFO:tasks.workunit.client.0.smithi107.stdout:5/879: chown d7/de/d2d/d5d/d60/f81 38565131 1 2024-09-21T08:02:51.380 INFO:tasks.workunit.client.0.smithi107.stdout:5/880: truncate d7/fec 536261 0 2024-09-21T08:02:51.381 INFO:tasks.workunit.client.0.smithi107.stdout:5/881: creat d7/de/da3/f137 x:0 0 0 2024-09-21T08:02:51.381 INFO:tasks.workunit.client.0.smithi107.stdout:5/882: mknod d7/d70/de3/c138 0 2024-09-21T08:02:51.381 INFO:tasks.workunit.client.0.smithi107.stdout:5/883: mkdir d7/de/d2d/d139 0 2024-09-21T08:02:51.381 INFO:tasks.workunit.client.0.smithi107.stdout:5/884: unlink d7/de/d35/c10e 0 2024-09-21T08:02:51.381 INFO:tasks.workunit.client.0.smithi107.stdout:5/885: mknod d7/d70/de3/c13a 0 2024-09-21T08:02:51.381 INFO:tasks.workunit.client.0.smithi107.stdout:5/886: write d7/de/d52/d8b/f103 [4106671,64956] 0 2024-09-21T08:02:51.381 INFO:tasks.workunit.client.0.smithi107.stdout:5/887: chown d7/de/d1d/d29/d64/d87/fbe 77912989 1 2024-09-21T08:02:51.381 INFO:tasks.workunit.client.0.smithi107.stdout:5/888: fdatasync d7/de/d1d/d24/d3d/dfa/f109 0 2024-09-21T08:02:51.381 INFO:tasks.workunit.client.0.smithi107.stdout:5/889: write d7/de/d1d/fb6 [4399507,43795] 0 2024-09-21T08:02:51.381 INFO:tasks.workunit.client.0.smithi107.stdout:5/890: rename d7/de/da3/c127 to d7/de/d1d/d29/d64/c13b 0 2024-09-21T08:02:51.381 INFO:tasks.workunit.client.0.smithi107.stdout:5/891: write d7/de/d52/d8b/f50 [4111710,127705] 0 2024-09-21T08:02:51.382 INFO:tasks.workunit.client.0.smithi107.stdout:5/892: readlink d7/lee 0 2024-09-21T08:02:51.382 INFO:tasks.workunit.client.0.smithi107.stdout:5/893: mkdir d7/de/d1d/d29/d68/ddb/dde/dc0/d13c 0 2024-09-21T08:02:51.382 INFO:tasks.workunit.client.0.smithi107.stdout:5/894: fdatasync d7/de/d1d/ff4 0 2024-09-21T08:02:51.382 INFO:tasks.workunit.client.0.smithi107.stdout:5/895: rename d7/de/d35/la4 to d7/de/d1d/d29/d68/ddb/dde/l13d 0 2024-09-21T08:02:51.382 INFO:tasks.workunit.client.0.smithi107.stdout:5/896: dwrite d7/d70/f11a [0,4194304] 0 2024-09-21T08:02:51.383 INFO:tasks.workunit.client.0.smithi107.stdout:5/897: mkdir d7/de/d13e 0 2024-09-21T08:02:51.395 INFO:tasks.workunit.client.0.smithi107.stdout:5/898: dwrite d7/de/fc8 [0,4194304] 0 2024-09-21T08:02:51.398 INFO:tasks.workunit.client.0.smithi107.stdout:5/899: creat d7/de/d2d/d5d/d60/dc5/f13f x:0 0 0 2024-09-21T08:02:51.400 INFO:tasks.workunit.client.0.smithi107.stdout:5/900: mknod d7/de/d1d/d29/d68/ddb/dde/dc0/d13c/c140 0 2024-09-21T08:02:51.400 INFO:tasks.workunit.client.0.smithi107.stdout:5/901: truncate d7/de/d1d/d24/f8c 3141764 0 2024-09-21T08:02:51.422 INFO:tasks.workunit.client.0.smithi107.stdout:5/902: dwrite d7/de/d1d/fb6 [0,4194304] 0 2024-09-21T08:02:51.427 INFO:tasks.workunit.client.0.smithi107.stdout:5/903: symlink d7/de/d1d/d29/d68/ddb/dde/dd8/dd9/l141 0 2024-09-21T08:02:51.430 INFO:tasks.workunit.client.0.smithi107.stdout:5/904: getdents d7/de/d1d/d29/d68/ddb/dde/dc0/d13c 0 2024-09-21T08:02:51.431 INFO:tasks.workunit.client.0.smithi107.stdout:5/905: dread - d7/de/d1d/d24/d3d/dfa/f109 zero size 2024-09-21T08:02:51.431 INFO:tasks.workunit.client.0.smithi107.stdout:5/906: creat d7/de/d1d/d24/d3d/dfa/f142 x:0 0 0 2024-09-21T08:02:51.431 INFO:tasks.workunit.client.0.smithi107.stdout:5/907: read d7/de/f30 [289864,78948] 0 2024-09-21T08:02:51.451 INFO:tasks.workunit.client.0.smithi107.stdout:5/908: dwrite d7/de/d2d/d5d/fa1 [0,4194304] 0 2024-09-21T08:02:51.455 INFO:tasks.workunit.client.0.smithi107.stdout:5/909: creat d7/de/d1d/d29/dfc/d125/d126/f143 x:0 0 0 2024-09-21T08:02:51.456 INFO:tasks.workunit.client.0.smithi107.stdout:5/910: unlink d7/de/d1d/dbc/f10c 0 2024-09-21T08:02:51.466 INFO:tasks.workunit.client.0.smithi107.stdout:5/911: read d7/de/da3/fe8 [1402127,62494] 0 2024-09-21T08:02:51.467 INFO:tasks.workunit.client.0.smithi107.stdout:5/912: getdents d7/de/da3 0 2024-09-21T08:02:51.468 INFO:tasks.workunit.client.0.smithi107.stdout:5/913: rename d7/de/d1d/d29/fc6 to d7/de/d13e/f144 0 2024-09-21T08:02:51.473 INFO:tasks.workunit.client.0.smithi107.stdout:5/914: rename d7/de/d2d to d7/de/d1d/d29/d145 0 2024-09-21T08:02:51.473 INFO:tasks.workunit.client.0.smithi107.stdout:5/915: readlink d7/de/l22 0 2024-09-21T08:02:51.473 INFO:tasks.workunit.client.0.smithi107.stdout:5/916: creat d7/de/f146 x:0 0 0 2024-09-21T08:02:51.475 INFO:tasks.workunit.client.0.smithi107.stdout:5/917: mkdir d7/de/d1d/d29/d68/ddb/dde/d147 0 2024-09-21T08:02:51.475 INFO:tasks.workunit.client.0.smithi107.stdout:5/918: chown d7/de/d1d/d29/d145/d5d/d60/dc5 63 1 2024-09-21T08:02:51.476 INFO:tasks.workunit.client.0.smithi107.stdout:5/919: rename d7/de/d52/d6b/d106 to d7/de/d1d/d29/d68/ddb/dde/d11f/d148 0 2024-09-21T08:02:51.486 INFO:tasks.workunit.client.0.smithi107.stdout:5/920: write d7/de/d1d/d29/d68/ddb/dde/f94 [526373,110850] 0 2024-09-21T08:02:51.486 INFO:tasks.workunit.client.0.smithi107.stdout:5/921: fsync d7/de/d1d/d29/d64/f7f 0 2024-09-21T08:02:51.487 INFO:tasks.workunit.client.0.smithi107.stdout:5/922: rmdir d7/de/d1d/d29/d68/ddb/dde/dc0/d13c 39 2024-09-21T08:02:51.506 INFO:tasks.workunit.client.0.smithi107.stdout:5/923: dwrite d7/d70/fe6 [0,4194304] 0 2024-09-21T08:02:51.506 INFO:tasks.workunit.client.0.smithi107.stdout:5/924: fdatasync d7/de/d52/d8b/f124 0 2024-09-21T08:02:51.510 INFO:tasks.workunit.client.0.smithi107.stdout:5/925: symlink d7/de/d1d/d29/l149 0 2024-09-21T08:02:51.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:51 smithi129 ceph-mon[34472]: pgmap v17: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 254 MiB/s rd, 304 MiB/s wr, 422 op/s 2024-09-21T08:02:51.522 INFO:tasks.workunit.client.0.smithi107.stdout:3/754: sync 2024-09-21T08:02:51.522 INFO:tasks.workunit.client.0.smithi107.stdout:3/755: chown d8/d14/c5e 2427 1 2024-09-21T08:02:51.525 INFO:tasks.workunit.client.0.smithi107.stdout:3/756: dread d8/d14/f58 [0,4194304] 0 2024-09-21T08:02:51.526 INFO:tasks.workunit.client.0.smithi107.stdout:3/757: symlink d8/d2b/d52/d55/l100 0 2024-09-21T08:02:51.526 INFO:tasks.workunit.client.0.smithi107.stdout:3/758: truncate d8/d44/dad/fde 1476252 0 2024-09-21T08:02:51.528 INFO:tasks.workunit.client.0.smithi107.stdout:5/926: dwrite d7/de/d1d/ff4 [0,4194304] 0 2024-09-21T08:02:51.528 INFO:tasks.workunit.client.0.smithi107.stdout:5/927: write d7/de/d1d/d24/fae [1350988,71743] 0 2024-09-21T08:02:51.528 INFO:tasks.workunit.client.0.smithi107.stdout:5/928: chown d7/de/d1d/d29/d68/ddb/dde/dc0/d13c 50883 1 2024-09-21T08:02:51.535 INFO:tasks.workunit.client.0.smithi107.stdout:3/759: dread d8/fa6 [0,4194304] 0 2024-09-21T08:02:51.539 INFO:tasks.workunit.client.0.smithi107.stdout:5/929: rmdir d7/de/d1d/d29/d68/ddb/dde/dba/d111 39 2024-09-21T08:02:51.539 INFO:tasks.workunit.client.0.smithi107.stdout:5/930: fsync d7/de/d1d/d29/d68/ddb/dde/dba/f130 0 2024-09-21T08:02:51.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:51 smithi107 ceph-mon[27622]: pgmap v17: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 254 MiB/s rd, 304 MiB/s wr, 422 op/s 2024-09-21T08:02:51.555 INFO:tasks.workunit.client.0.smithi107.stdout:5/931: dwrite d7/de/d35/f8a [0,4194304] 0 2024-09-21T08:02:51.555 INFO:tasks.workunit.client.0.smithi107.stdout:5/932: dread - d7/de/d1d/d29/d68/ddb/f114 zero size 2024-09-21T08:02:51.556 INFO:tasks.workunit.client.0.smithi107.stdout:5/933: symlink d7/de/d1d/d29/d68/ddb/dde/l14a 0 2024-09-21T08:02:51.557 INFO:tasks.workunit.client.0.smithi107.stdout:5/934: mknod d7/de/d1d/d29/d68/ddb/dde/dd8/dd9/c14b 0 2024-09-21T08:02:51.560 INFO:tasks.workunit.client.0.smithi107.stdout:5/935: unlink d7/f135 0 2024-09-21T08:02:51.562 INFO:tasks.workunit.client.0.smithi107.stdout:5/936: creat d7/de/d13e/f14c x:0 0 0 2024-09-21T08:02:51.564 INFO:tasks.workunit.client.0.smithi107.stdout:5/937: mkdir d7/de/d1d/d29/d68/ddb/d14d 0 2024-09-21T08:02:51.566 INFO:tasks.workunit.client.0.smithi107.stdout:5/938: mkdir d7/de/d1d/d29/d68/ddb/d11b/d14e 0 2024-09-21T08:02:51.566 INFO:tasks.workunit.client.0.smithi107.stdout:5/939: fdatasync d7/de/d1d/d29/d68/ddb/dde/df7/f122 0 2024-09-21T08:02:51.567 INFO:tasks.workunit.client.0.smithi107.stdout:5/940: mknod d7/de/d1d/d29/d68/ddb/d11b/c14f 0 2024-09-21T08:02:51.569 INFO:tasks.workunit.client.0.smithi107.stdout:5/941: truncate d7/de/da3/fe8 223347 0 2024-09-21T08:02:51.569 INFO:tasks.workunit.client.0.smithi107.stdout:5/942: chown d7/de/d1d/dbc/f12e 5827 1 2024-09-21T08:02:51.569 INFO:tasks.workunit.client.0.smithi107.stdout:5/943: stat d7/d70/feb 0 2024-09-21T08:02:51.569 INFO:tasks.workunit.client.0.smithi107.stdout:5/944: chown d7/de/d1d/d29/d64/c13b 581576 1 2024-09-21T08:02:51.578 INFO:tasks.workunit.client.0.smithi107.stdout:5/945: write d7/d70/f11a [708579,15980] 0 2024-09-21T08:02:51.580 INFO:tasks.workunit.client.0.smithi107.stdout:5/946: creat d7/de/d1d/d29/d145/d5d/f150 x:0 0 0 2024-09-21T08:02:51.581 INFO:tasks.workunit.client.0.smithi107.stdout:5/947: getdents d7/de/d52/d6b 0 2024-09-21T08:02:51.581 INFO:tasks.workunit.client.0.smithi107.stdout:5/948: chown d7/d70/de3 168564 1 2024-09-21T08:02:51.583 INFO:tasks.workunit.client.0.smithi107.stdout:5/949: rename d7/d70/f11a to d7/de/d1d/d29/d68/ddb/dde/dc0/f151 0 2024-09-21T08:02:51.584 INFO:tasks.workunit.client.0.smithi107.stdout:5/950: mkdir d7/de/d1d/d29/d68/d152 0 2024-09-21T08:02:51.586 INFO:tasks.workunit.client.0.smithi107.stdout:5/951: creat d7/de/d1d/d29/d68/ddb/d11b/d14e/f153 x:0 0 0 2024-09-21T08:02:51.586 INFO:tasks.workunit.client.0.smithi107.stdout:5/952: truncate d7/de/d1d/d29/d145/d5d/d60/fb8 339253 0 2024-09-21T08:02:51.588 INFO:tasks.workunit.client.0.smithi107.stdout:5/953: mkdir d7/de/d1d/d29/d68/ddb/dde/d11f/d148/d154 0 2024-09-21T08:02:51.588 INFO:tasks.workunit.client.0.smithi107.stdout:5/954: stat d7/de/d1d/d29/d145/fcd 0 2024-09-21T08:02:51.588 INFO:tasks.workunit.client.0.smithi107.stdout:5/955: write d7/d70/fe6 [4206551,85782] 0 2024-09-21T08:02:51.589 INFO:tasks.workunit.client.0.smithi107.stdout:5/956: rename d7/de/d1d/d29/d145/d5d/d60/dc5/c119 to d7/de/d1d/d29/d68/ddb/dde/d11f/d148/d154/c155 0 2024-09-21T08:02:51.590 INFO:tasks.workunit.client.0.smithi107.stdout:5/957: mkdir d7/d70/de3/d156 0 2024-09-21T08:02:51.608 INFO:tasks.workunit.client.0.smithi107.stdout:5/958: dwrite d7/de/d1d/d29/d68/ddb/dde/dd8/d105/f117 [0,4194304] 0 2024-09-21T08:02:51.608 INFO:tasks.workunit.client.0.smithi107.stdout:5/959: write d7/de/d1d/d29/d145/d5d/f123 [794667,5923] 0 2024-09-21T08:02:51.613 INFO:tasks.workunit.client.0.smithi107.stdout:5/960: mkdir d7/de/d52/d157 0 2024-09-21T08:02:51.621 INFO:tasks.workunit.client.0.smithi107.stdout:5/961: symlink d7/de/d1d/d24/l158 0 2024-09-21T08:02:51.621 INFO:tasks.workunit.client.0.smithi107.stdout:5/962: write d7/de/f30 [2423832,4429] 0 2024-09-21T08:02:51.621 INFO:tasks.workunit.client.0.smithi107.stdout:5/963: fdatasync d7/de/f1b 0 2024-09-21T08:02:51.624 INFO:tasks.workunit.client.0.smithi107.stdout:5/964: mknod d7/de/d1d/d29/d68/ddb/dde/dc0/d13c/c159 0 2024-09-21T08:02:51.631 INFO:tasks.workunit.client.0.smithi107.stdout:8/621: sync 2024-09-21T08:02:51.633 INFO:tasks.workunit.client.0.smithi107.stdout:8/622: rmdir d5/d2e/d7c/d9a/d9e/dcc 39 2024-09-21T08:02:51.635 INFO:tasks.workunit.client.0.smithi107.stdout:8/623: write d5/d2e/d7c/d9a/f6a [595011,46766] 0 2024-09-21T08:02:51.649 INFO:tasks.workunit.client.0.smithi107.stdout:5/965: dwrite d7/de/d35/f42 [0,4194304] 0 2024-09-21T08:02:51.650 INFO:tasks.workunit.client.0.smithi107.stdout:5/966: rename d7/de/d1d/d29/d68/ddb/dde/dc0/d13c/c140 to d7/d70/de3/d156/c15a 0 2024-09-21T08:02:51.651 INFO:tasks.workunit.client.0.smithi107.stdout:5/967: write d7/de/d1d/d24/d3d/dfa/f142 [217300,95567] 0 2024-09-21T08:02:51.655 INFO:tasks.workunit.client.0.smithi107.stdout:8/624: dwrite d5/d40/fba [0,4194304] 0 2024-09-21T08:02:51.670 INFO:tasks.workunit.client.0.smithi107.stdout:5/968: write d7/de/d1d/d24/f8c [2609230,53785] 0 2024-09-21T08:02:51.685 INFO:tasks.workunit.client.0.smithi107.stdout:5/969: dread d7/de/d1d/d24/d3d/f5a [0,4194304] 0 2024-09-21T08:02:51.686 INFO:tasks.workunit.client.0.smithi107.stdout:5/970: rename d7/de/d1d/d29/d145/d5d/f123 to d7/de/d1d/d29/d68/de9/f15b 0 2024-09-21T08:02:51.687 INFO:tasks.workunit.client.0.smithi107.stdout:8/625: dwrite d5/d2e/f51 [0,4194304] 0 2024-09-21T08:02:51.687 INFO:tasks.workunit.client.0.smithi107.stdout:5/971: creat d7/de/d1d/d29/d68/ddb/dde/f15c x:0 0 0 2024-09-21T08:02:51.691 INFO:tasks.workunit.client.0.smithi107.stdout:8/626: creat d5/d44/db7/fda x:0 0 0 2024-09-21T08:02:51.691 INFO:tasks.workunit.client.0.smithi107.stdout:5/972: mknod d7/de/d1d/d29/d68/ddb/dde/d11f/c15d 0 2024-09-21T08:02:51.694 INFO:tasks.workunit.client.0.smithi107.stdout:8/627: symlink d5/d38/ldb 0 2024-09-21T08:02:51.695 INFO:tasks.workunit.client.0.smithi107.stdout:5/973: creat d7/de/d1d/d29/d145/d5d/d60/dc5/f15e x:0 0 0 2024-09-21T08:02:51.700 INFO:tasks.workunit.client.0.smithi107.stdout:8/628: mkdir d5/d2e/ddc 0 2024-09-21T08:02:51.700 INFO:tasks.workunit.client.0.smithi107.stdout:8/629: dread - d5/d2e/d7c/d9a/d98/fcf zero size 2024-09-21T08:02:51.700 INFO:tasks.workunit.client.0.smithi107.stdout:8/630: truncate d5/d38/d56/da3/fbd 1022313 0 2024-09-21T08:02:51.708 INFO:tasks.workunit.client.0.smithi107.stdout:8/631: write d5/f5c [652672,36939] 0 2024-09-21T08:02:51.709 INFO:tasks.workunit.client.0.smithi107.stdout:8/632: fsync d5/d38/d56/d54/fae 0 2024-09-21T08:02:51.710 INFO:tasks.workunit.client.0.smithi107.stdout:8/633: creat d5/d2e/ddc/fdd x:0 0 0 2024-09-21T08:02:51.711 INFO:tasks.workunit.client.0.smithi107.stdout:8/634: write d5/d38/f3e [4702074,60978] 0 2024-09-21T08:02:51.716 INFO:tasks.workunit.client.0.smithi107.stdout:8/635: write d5/f14 [1315317,55831] 0 2024-09-21T08:02:51.719 INFO:tasks.workunit.client.0.smithi107.stdout:8/636: truncate d5/d38/d56/d52/f8f 3693507 0 2024-09-21T08:02:51.722 INFO:tasks.workunit.client.0.smithi107.stdout:8/637: link d5/d40/f43 d5/d2e/fde 0 2024-09-21T08:02:51.722 INFO:tasks.workunit.client.0.smithi107.stdout:8/638: chown d5/d1d/f3a 163371997 1 2024-09-21T08:02:51.731 INFO:tasks.workunit.client.0.smithi107.stdout:8/639: truncate d5/d23/f57 3686231 0 2024-09-21T08:02:51.733 INFO:tasks.workunit.client.0.smithi107.stdout:8/640: dread d5/d40/fbc [0,4194304] 0 2024-09-21T08:02:51.736 INFO:tasks.workunit.client.0.smithi107.stdout:8/641: unlink d5/f21 0 2024-09-21T08:02:51.753 INFO:tasks.workunit.client.0.smithi107.stdout:8/642: dwrite d5/f72 [0,4194304] 0 2024-09-21T08:02:51.756 INFO:tasks.workunit.client.0.smithi107.stdout:8/643: creat d5/d38/d56/d52/fdf x:0 0 0 2024-09-21T08:02:51.756 INFO:tasks.workunit.client.0.smithi107.stdout:8/644: stat d5/d23/ca5 0 2024-09-21T08:02:51.756 INFO:tasks.workunit.client.0.smithi107.stdout:8/645: write d5/d1d/f5b [1783420,60505] 0 2024-09-21T08:02:51.757 INFO:tasks.workunit.client.0.smithi107.stdout:8/646: mkdir d5/d44/de0 0 2024-09-21T08:02:51.757 INFO:tasks.workunit.client.0.smithi107.stdout:8/647: readlink d5/d38/d67/ld8 0 2024-09-21T08:02:51.764 INFO:tasks.workunit.client.0.smithi107.stdout:8/648: dread d5/d2e/f39 [0,4194304] 0 2024-09-21T08:02:51.768 INFO:tasks.workunit.client.0.smithi107.stdout:8/649: creat d5/d38/d56/d54/dce/fe1 x:0 0 0 2024-09-21T08:02:51.768 INFO:tasks.workunit.client.0.smithi107.stdout:8/650: dread - d5/d1d/f6f zero size 2024-09-21T08:02:51.791 INFO:tasks.workunit.client.0.smithi107.stdout:8/651: dwrite d5/d2e/f4b [0,4194304] 0 2024-09-21T08:02:51.824 INFO:tasks.workunit.client.0.smithi107.stdout:8/652: dwrite d5/d2e/d7c/d9a/fc0 [0,4194304] 0 2024-09-21T08:02:51.831 INFO:tasks.workunit.client.0.smithi107.stdout:8/653: rmdir d5/d1d/d90 39 2024-09-21T08:02:51.836 INFO:tasks.workunit.client.0.smithi107.stdout:8/654: creat d5/d44/d5d/d9c/fe2 x:0 0 0 2024-09-21T08:02:51.836 INFO:tasks.workunit.client.0.smithi107.stdout:8/655: write d5/d2e/d7c/d9a/d9e/fd1 [744787,13005] 0 2024-09-21T08:02:51.837 INFO:tasks.workunit.client.0.smithi107.stdout:8/656: chown d5/d2e/d89 10 1 2024-09-21T08:02:51.860 INFO:tasks.workunit.client.0.smithi107.stdout:8/657: dwrite d5/d23/f2f [0,4194304] 0 2024-09-21T08:02:51.861 INFO:tasks.workunit.client.0.smithi107.stdout:1/704: sync 2024-09-21T08:02:51.861 INFO:tasks.workunit.client.0.smithi107.stdout:8/658: symlink d5/d1d/le3 0 2024-09-21T08:02:51.864 INFO:tasks.workunit.client.0.smithi107.stdout:1/705: creat d0/d19/d2b/d4b/d5b/fe8 x:0 0 0 2024-09-21T08:02:51.865 INFO:tasks.workunit.client.0.smithi107.stdout:8/659: creat d5/d38/fe4 x:0 0 0 2024-09-21T08:02:51.865 INFO:tasks.workunit.client.0.smithi107.stdout:8/660: chown d5/d2e/fc6 373781 1 2024-09-21T08:02:51.865 INFO:tasks.workunit.client.0.smithi107.stdout:8/661: readlink d5/d2e/l31 0 2024-09-21T08:02:51.865 INFO:tasks.workunit.client.0.smithi107.stdout:8/662: write d5/d2e/fc5 [925489,19218] 0 2024-09-21T08:02:51.866 INFO:tasks.workunit.client.0.smithi107.stdout:1/706: symlink d0/d19/d2b/d4b/d44/d72/d36/d8e/dd7/le9 0 2024-09-21T08:02:51.868 INFO:tasks.workunit.client.0.smithi107.stdout:8/663: link d5/c17 d5/d2e/d7c/d9a/d9e/dcc/ce5 0 2024-09-21T08:02:51.868 INFO:tasks.workunit.client.0.smithi107.stdout:8/664: write d5/d1d/fb1 [224824,709] 0 2024-09-21T08:02:51.869 INFO:tasks.workunit.client.0.smithi107.stdout:1/707: stat d0/d19/d2b/d4b/l34 0 2024-09-21T08:02:51.870 INFO:tasks.workunit.client.0.smithi107.stdout:8/665: getdents d5/d44/d47 0 2024-09-21T08:02:51.870 INFO:tasks.workunit.client.0.smithi107.stdout:8/666: write d5/fd [4989997,126959] 0 2024-09-21T08:02:51.871 INFO:tasks.workunit.client.0.smithi107.stdout:1/708: creat d0/d19/d2b/d4b/d5b/dcb/fea x:0 0 0 2024-09-21T08:02:51.871 INFO:tasks.workunit.client.0.smithi107.stdout:1/709: creat d0/d29/d4d/d84/feb x:0 0 0 2024-09-21T08:02:51.873 INFO:tasks.workunit.client.0.smithi107.stdout:8/667: mknod d5/d2e/d94/ce6 0 2024-09-21T08:02:51.876 INFO:tasks.workunit.client.0.smithi107.stdout:1/710: mknod d0/d80/cec 0 2024-09-21T08:02:51.876 INFO:tasks.workunit.client.0.smithi107.stdout:1/711: truncate d0/dc6/f30 4288626 0 2024-09-21T08:02:51.877 INFO:tasks.workunit.client.0.smithi107.stdout:8/668: mkdir d5/d38/d56/da3/de7 0 2024-09-21T08:02:51.879 INFO:tasks.workunit.client.0.smithi107.stdout:1/712: mkdir d0/d19/d2b/d4b/d5b/dcb/ded 0 2024-09-21T08:02:51.880 INFO:tasks.workunit.client.0.smithi107.stdout:8/669: rmdir d5/db9 39 2024-09-21T08:02:51.883 INFO:tasks.workunit.client.0.smithi107.stdout:1/713: creat d0/d19/d2b/d4b/d44/fee x:0 0 0 2024-09-21T08:02:51.906 INFO:tasks.workunit.client.0.smithi107.stdout:1/714: dwrite d0/d19/f87 [0,4194304] 0 2024-09-21T08:02:51.907 INFO:tasks.workunit.client.0.smithi107.stdout:8/670: dwrite d5/d1d/f4d [4194304,4194304] 0 2024-09-21T08:02:51.907 INFO:tasks.workunit.client.0.smithi107.stdout:8/671: readlink d5/d44/d47/l49 0 2024-09-21T08:02:51.908 INFO:tasks.workunit.client.0.smithi107.stdout:1/715: creat d0/d29/d31/fef x:0 0 0 2024-09-21T08:02:51.909 INFO:tasks.workunit.client.0.smithi107.stdout:8/672: creat d5/d44/db7/dca/fe8 x:0 0 0 2024-09-21T08:02:51.909 INFO:tasks.workunit.client.0.smithi107.stdout:8/673: creat d5/d44/db7/dca/fe9 x:0 0 0 2024-09-21T08:02:51.909 INFO:tasks.workunit.client.0.smithi107.stdout:1/716: mkdir d0/d19/d2b/d4b/d44/d72/dde/df0 0 2024-09-21T08:02:51.911 INFO:tasks.workunit.client.0.smithi107.stdout:8/674: symlink d5/d38/d67/lea 0 2024-09-21T08:02:51.913 INFO:tasks.workunit.client.0.smithi107.stdout:1/717: symlink d0/d29/d4d/lf1 0 2024-09-21T08:02:51.914 INFO:tasks.workunit.client.0.smithi107.stdout:8/675: dread d5/d23/f9d [0,4194304] 0 2024-09-21T08:02:51.914 INFO:tasks.workunit.client.0.smithi107.stdout:8/676: creat d5/d2e/d94/feb x:0 0 0 2024-09-21T08:02:51.915 INFO:tasks.workunit.client.0.smithi107.stdout:8/677: creat d5/d44/db7/fec x:0 0 0 2024-09-21T08:02:51.917 INFO:tasks.workunit.client.0.smithi107.stdout:8/678: mkdir d5/d40/d8a/ded 0 2024-09-21T08:02:51.918 INFO:tasks.workunit.client.0.smithi107.stdout:1/718: dread d0/d29/d31/f42 [4194304,4194304] 0 2024-09-21T08:02:51.918 INFO:tasks.workunit.client.0.smithi107.stdout:8/679: mkdir d5/d40/d8a/dcb/dee 0 2024-09-21T08:02:51.919 INFO:tasks.workunit.client.0.smithi107.stdout:8/680: mkdir d5/d38/d56/da3/def 0 2024-09-21T08:02:51.920 INFO:tasks.workunit.client.0.smithi107.stdout:8/681: mkdir d5/d23/df0 0 2024-09-21T08:02:51.921 INFO:tasks.workunit.client.0.smithi107.stdout:8/682: chown d5/d38/d56/d52/d7a/la7 26750682 1 2024-09-21T08:02:51.921 INFO:tasks.workunit.client.0.smithi107.stdout:8/683: chown d5/d40/fbc 15 1 2024-09-21T08:02:51.921 INFO:tasks.workunit.client.0.smithi107.stdout:8/684: write d5/d38/d56/da3/fbd [414160,55532] 0 2024-09-21T08:02:51.922 INFO:tasks.workunit.client.0.smithi107.stdout:8/685: truncate d5/d1d/d90/dd5/fd6 179554 0 2024-09-21T08:02:51.922 INFO:tasks.workunit.client.0.smithi107.stdout:8/686: readlink d5/d38/lbe 0 2024-09-21T08:02:51.924 INFO:tasks.workunit.client.0.smithi107.stdout:8/687: rename d5/d23/d69 to d5/d2e/d7c/d9a/df1 0 2024-09-21T08:02:51.942 INFO:tasks.workunit.client.0.smithi107.stdout:8/688: dwrite d5/fa [0,4194304] 0 2024-09-21T08:02:51.945 INFO:tasks.workunit.client.0.smithi107.stdout:8/689: rmdir d5/d2e/ddc 39 2024-09-21T08:02:51.945 INFO:tasks.workunit.client.0.smithi107.stdout:8/690: truncate d5/d1d/f24 263222 0 2024-09-21T08:02:51.948 INFO:tasks.workunit.client.0.smithi107.stdout:8/691: dread d5/d2e/fc5 [0,4194304] 0 2024-09-21T08:02:51.970 INFO:tasks.workunit.client.0.smithi107.stdout:8/692: dwrite d5/d40/fba [0,4194304] 0 2024-09-21T08:02:51.989 INFO:tasks.workunit.client.0.smithi107.stdout:8/693: dwrite d5/d38/d67/d7d/d91/fa6 [4194304,4194304] 0 2024-09-21T08:02:51.990 INFO:tasks.workunit.client.0.smithi107.stdout:8/694: rename d5/d23/c76 to d5/d38/d56/d52/d7a/cf2 0 2024-09-21T08:02:51.992 INFO:tasks.workunit.client.0.smithi107.stdout:8/695: rename d5/d44/db7/dca/fe8 to d5/d2e/d7c/d9a/d9e/dcc/ff3 0 2024-09-21T08:02:52.001 INFO:tasks.workunit.client.0.smithi107.stdout:8/696: write d5/d1d/f4d [4327991,91492] 0 2024-09-21T08:02:52.001 INFO:tasks.workunit.client.0.smithi107.stdout:8/697: fdatasync d5/d2e/f4a 0 2024-09-21T08:02:52.010 INFO:tasks.workunit.client.0.smithi107.stdout:8/698: write d5/d2e/f77 [684920,94116] 0 2024-09-21T08:02:52.010 INFO:tasks.workunit.client.0.smithi107.stdout:8/699: fsync d5/d2e/d89/f92 0 2024-09-21T08:02:52.010 INFO:tasks.workunit.client.0.smithi107.stdout:8/700: dread - d5/d44/d5d/d9c/fe2 zero size 2024-09-21T08:02:52.016 INFO:tasks.workunit.client.0.smithi107.stdout:8/701: getdents d5/d2e/d94 0 2024-09-21T08:02:52.021 INFO:tasks.workunit.client.0.smithi107.stdout:8/702: dread d5/d1d/f3a [0,4194304] 0 2024-09-21T08:02:52.023 INFO:tasks.workunit.client.0.smithi107.stdout:8/703: unlink d5/db9/fb6 0 2024-09-21T08:02:52.059 INFO:tasks.workunit.client.0.smithi107.stdout:2/808: sync 2024-09-21T08:02:52.059 INFO:tasks.workunit.client.0.smithi107.stdout:3/760: sync 2024-09-21T08:02:52.059 INFO:tasks.workunit.client.0.smithi107.stdout:6/784: sync 2024-09-21T08:02:52.059 INFO:tasks.workunit.client.0.smithi107.stdout:5/974: sync 2024-09-21T08:02:52.059 INFO:tasks.workunit.client.0.smithi107.stdout:3/761: fdatasync d8/d44/dad/fde 0 2024-09-21T08:02:52.059 INFO:tasks.workunit.client.0.smithi107.stdout:3/762: readlink d8/d44/l93 0 2024-09-21T08:02:52.059 INFO:tasks.workunit.client.0.smithi107.stdout:3/763: stat d8/d2b/d45/dcc 0 2024-09-21T08:02:52.059 INFO:tasks.workunit.client.0.smithi107.stdout:7/562: sync 2024-09-21T08:02:52.059 INFO:tasks.workunit.client.0.smithi107.stdout:4/726: sync 2024-09-21T08:02:52.059 INFO:tasks.workunit.client.0.smithi107.stdout:4/727: dread - dc/d13/d40/fde zero size 2024-09-21T08:02:52.059 INFO:tasks.workunit.client.0.smithi107.stdout:4/728: write dc/d13/d40/f45 [4614861,32168] 0 2024-09-21T08:02:52.059 INFO:tasks.workunit.client.0.smithi107.stdout:4/729: dread - dc/fd9 zero size 2024-09-21T08:02:52.060 INFO:tasks.workunit.client.0.smithi107.stdout:9/844: sync 2024-09-21T08:02:52.060 INFO:tasks.workunit.client.0.smithi107.stdout:0/764: sync 2024-09-21T08:02:52.065 INFO:tasks.workunit.client.0.smithi107.stdout:4/730: dread dc/d13/d40/d5e/d77/d99/daa/fb4 [0,4194304] 0 2024-09-21T08:02:52.066 INFO:tasks.workunit.client.0.smithi107.stdout:9/845: link d11/d27/d2a/c31 d11/d24/d35/c12b 0 2024-09-21T08:02:52.068 INFO:tasks.workunit.client.0.smithi107.stdout:3/764: unlink d8/d21/l23 0 2024-09-21T08:02:52.068 INFO:tasks.workunit.client.0.smithi107.stdout:3/765: chown d8/d14/c5e 61149696 1 2024-09-21T08:02:52.069 INFO:tasks.workunit.client.0.smithi107.stdout:7/563: mkdir d7/d38/dc1 0 2024-09-21T08:02:52.069 INFO:tasks.workunit.client.0.smithi107.stdout:7/564: stat d7/d22/d37/d40/d4d/lbb 0 2024-09-21T08:02:52.070 INFO:tasks.workunit.client.0.smithi107.stdout:9/846: chown d11/d27/d2f/l79 32 1 2024-09-21T08:02:52.071 INFO:tasks.workunit.client.0.smithi107.stdout:9/847: write d11/d27/d5e/d76/f9e [383051,101839] 0 2024-09-21T08:02:52.071 INFO:tasks.workunit.client.0.smithi107.stdout:9/848: creat d11/d24/d26/f12c x:0 0 0 2024-09-21T08:02:52.071 INFO:tasks.workunit.client.0.smithi107.stdout:0/765: write d1/d5/d25/d3d/fb5 [1451139,128492] 0 2024-09-21T08:02:52.072 INFO:tasks.workunit.client.0.smithi107.stdout:3/766: creat d8/d14/f101 x:0 0 0 2024-09-21T08:02:52.073 INFO:tasks.workunit.client.0.smithi107.stdout:7/565: mknod d7/d38/dc1/cc2 0 2024-09-21T08:02:52.075 INFO:tasks.workunit.client.0.smithi107.stdout:2/809: dread d1/d2/d6d/f5b [0,4194304] 0 2024-09-21T08:02:52.075 INFO:tasks.workunit.client.0.smithi107.stdout:2/810: write d1/d16/f8b [978142,96513] 0 2024-09-21T08:02:52.076 INFO:tasks.workunit.client.0.smithi107.stdout:9/849: creat d11/d27/d2f/d4d/d5c/f12d x:0 0 0 2024-09-21T08:02:52.076 INFO:tasks.workunit.client.0.smithi107.stdout:9/850: truncate d11/d27/d98/fcb 1356949 0 2024-09-21T08:02:52.076 INFO:tasks.workunit.client.0.smithi107.stdout:9/851: dread - d11/d27/d2f/d4d/d5c/f12d zero size 2024-09-21T08:02:52.078 INFO:tasks.workunit.client.0.smithi107.stdout:3/767: creat d8/d25/d3d/d72/d80/f102 x:0 0 0 2024-09-21T08:02:52.079 INFO:tasks.workunit.client.0.smithi107.stdout:4/731: write dc/f1b [6802655,102885] 0 2024-09-21T08:02:52.079 INFO:tasks.workunit.client.0.smithi107.stdout:7/566: truncate d7/d22/d3b/fa3 3181560 0 2024-09-21T08:02:52.080 INFO:tasks.workunit.client.0.smithi107.stdout:2/811: symlink d1/d6/d9e/l10a 0 2024-09-21T08:02:52.080 INFO:tasks.workunit.client.0.smithi107.stdout:2/812: fsync d1/f26 0 2024-09-21T08:02:52.080 INFO:tasks.workunit.client.0.smithi107.stdout:2/813: write d1/d2/d6d/d37/d49/d85/fd3 [440493,100626] 0 2024-09-21T08:02:52.081 INFO:tasks.workunit.client.0.smithi107.stdout:9/852: mkdir d11/d24/d4a/d9f/d12e 0 2024-09-21T08:02:52.082 INFO:tasks.workunit.client.0.smithi107.stdout:0/766: getdents d1 0 2024-09-21T08:02:52.083 INFO:tasks.workunit.client.0.smithi107.stdout:0/767: readlink d1/d5/d25/d3d/d20/da0/led 0 2024-09-21T08:02:52.083 INFO:tasks.workunit.client.0.smithi107.stdout:0/768: creat d1/d5/d25/d3d/f100 x:0 0 0 2024-09-21T08:02:52.083 INFO:tasks.workunit.client.0.smithi107.stdout:0/769: fdatasync d1/d6f/dc1/fc8 0 2024-09-21T08:02:52.085 INFO:tasks.workunit.client.0.smithi107.stdout:6/785: dwrite d2/d3/d7/d54/d5c/fa8 [0,4194304] 0 2024-09-21T08:02:52.085 INFO:tasks.workunit.client.0.smithi107.stdout:6/786: readlink d2/d3/d7/d54/l101 0 2024-09-21T08:02:52.085 INFO:tasks.workunit.client.0.smithi107.stdout:6/787: write d2/d2e/d97/f49 [868057,37895] 0 2024-09-21T08:02:52.085 INFO:tasks.workunit.client.0.smithi107.stdout:6/788: dread - d2/d2e/ff1 zero size 2024-09-21T08:02:52.085 INFO:tasks.workunit.client.0.smithi107.stdout:6/789: write d2/d3/d7/d2a/fcb [4366734,42506] 0 2024-09-21T08:02:52.085 INFO:tasks.workunit.client.0.smithi107.stdout:3/768: unlink d8/d25/d3d/d72/d80/fd7 0 2024-09-21T08:02:52.088 INFO:tasks.workunit.client.0.smithi107.stdout:7/567: write d7/d10/f90 [14476,54139] 0 2024-09-21T08:02:52.088 INFO:tasks.workunit.client.0.smithi107.stdout:7/568: write d7/d18/fa6 [989615,81585] 0 2024-09-21T08:02:52.088 INFO:tasks.workunit.client.0.smithi107.stdout:7/569: truncate d7/d22/d37/d4b/db0/d4f/fc0 735171 0 2024-09-21T08:02:52.088 INFO:tasks.workunit.client.0.smithi107.stdout:7/570: chown d7/d22/d37/d4b/f7e 3 1 2024-09-21T08:02:52.088 INFO:tasks.workunit.client.0.smithi107.stdout:5/975: dwrite d7/d70/ff2 [4194304,4194304] 0 2024-09-21T08:02:52.088 INFO:tasks.workunit.client.0.smithi107.stdout:5/976: chown d7/de/d1d/d29/d68/ddb/dde/dd8/dff/l132 0 1 2024-09-21T08:02:52.089 INFO:tasks.workunit.client.0.smithi107.stdout:4/732: creat dc/d13/d40/d5e/d77/fe5 x:0 0 0 2024-09-21T08:02:52.091 INFO:tasks.workunit.client.0.smithi107.stdout:2/814: creat d1/d2/d6d/d37/d49/d7f/f10b x:0 0 0 2024-09-21T08:02:52.092 INFO:tasks.workunit.client.0.smithi107.stdout:2/815: fdatasync d1/d2/d6d/d37/d49/d7f/fd1 0 2024-09-21T08:02:52.097 INFO:tasks.workunit.client.0.smithi107.stdout:9/853: creat d11/d27/d2f/d38/dbf/f12f x:0 0 0 2024-09-21T08:02:52.097 INFO:tasks.workunit.client.0.smithi107.stdout:9/854: chown d11/d24/c93 500 1 2024-09-21T08:02:52.097 INFO:tasks.workunit.client.0.smithi107.stdout:9/855: chown d11 14 1 2024-09-21T08:02:52.098 INFO:tasks.workunit.client.0.smithi107.stdout:0/770: symlink d1/d5/d25/d2d/d8e/l101 0 2024-09-21T08:02:52.099 INFO:tasks.workunit.client.0.smithi107.stdout:0/771: creat d1/d5/d25/d3d/da1/f102 x:0 0 0 2024-09-21T08:02:52.104 INFO:tasks.workunit.client.0.smithi107.stdout:6/790: symlink d2/d3/d7/d23/d2b/l105 0 2024-09-21T08:02:52.106 INFO:tasks.workunit.client.0.smithi107.stdout:3/769: link d8/d2b/d91/de5/lfa d8/d2b/d52/d55/l103 0 2024-09-21T08:02:52.110 INFO:tasks.workunit.client.0.smithi107.stdout:2/816: dwrite d1/d1e/f5c [0,4194304] 0 2024-09-21T08:02:52.110 INFO:tasks.workunit.client.0.smithi107.stdout:2/817: chown d1/d16/f60 198625546 1 2024-09-21T08:02:52.110 INFO:tasks.workunit.client.0.smithi107.stdout:2/818: write d1/d6/d92/fac [421972,39045] 0 2024-09-21T08:02:52.111 INFO:tasks.workunit.client.0.smithi107.stdout:7/571: truncate d7/f13 2469653 0 2024-09-21T08:02:52.111 INFO:tasks.workunit.client.0.smithi107.stdout:7/572: chown d7/d10/d28/f35 1038255442 1 2024-09-21T08:02:52.113 INFO:tasks.workunit.client.0.smithi107.stdout:4/733: rename dc/f2c to dc/d13/d40/d46/d48/d70/fe6 0 2024-09-21T08:02:52.121 INFO:tasks.workunit.client.0.smithi107.stdout:4/734: dread dc/d13/d40/f43 [0,4194304] 0 2024-09-21T08:02:52.134 INFO:tasks.workunit.client.0.smithi107.stdout:0/772: mkdir d1/d5/d25/d9e/d103 0 2024-09-21T08:02:52.136 INFO:tasks.workunit.client.0.smithi107.stdout:3/770: truncate d8/d44/f62 216549 0 2024-09-21T08:02:52.136 INFO:tasks.workunit.client.0.smithi107.stdout:4/735: dwrite dc/d13/d40/d46/d48/d70/dc5/d8a/fa2 [0,4194304] 0 2024-09-21T08:02:52.137 INFO:tasks.workunit.client.0.smithi107.stdout:2/819: mkdir d1/d16/d35/d10c 0 2024-09-21T08:02:52.140 INFO:tasks.workunit.client.0.smithi107.stdout:6/791: rename d2/d2e/d97/c39 to d2/d3/d7/d24/c106 0 2024-09-21T08:02:52.140 INFO:tasks.workunit.client.0.smithi107.stdout:6/792: chown d2/d3/d7/d54/cea 155925 1 2024-09-21T08:02:52.143 INFO:tasks.workunit.client.0.smithi107.stdout:2/820: link d1/d2/d6d/d42/db0/fc4 d1/f10d 0 2024-09-21T08:02:52.145 INFO:tasks.workunit.client.0.smithi107.stdout:2/821: creat d1/d6/d92/df2/f10e x:0 0 0 2024-09-21T08:02:52.147 INFO:tasks.workunit.client.0.smithi107.stdout:3/771: dread d8/d21/d7e/f83 [0,4194304] 0 2024-09-21T08:02:52.147 INFO:tasks.workunit.client.0.smithi107.stdout:7/573: mkdir d7/dc3 0 2024-09-21T08:02:52.147 INFO:tasks.workunit.client.0.smithi107.stdout:7/574: truncate d7/d22/fb4 533569 0 2024-09-21T08:02:52.148 INFO:tasks.workunit.client.0.smithi107.stdout:6/793: symlink d2/d3/d7/d23/de9/l107 0 2024-09-21T08:02:52.148 INFO:tasks.workunit.client.0.smithi107.stdout:6/794: write d2/d3/d7/d23/d2b/d84/fc5 [265471,3557] 0 2024-09-21T08:02:52.148 INFO:tasks.workunit.client.0.smithi107.stdout:6/795: dread - d2/d3/f8a zero size 2024-09-21T08:02:52.151 INFO:tasks.workunit.client.0.smithi107.stdout:2/822: mkdir d1/d2/d6d/d37/d49/dde/d10f 0 2024-09-21T08:02:52.151 INFO:tasks.workunit.client.0.smithi107.stdout:2/823: creat d1/d1e/f110 x:0 0 0 2024-09-21T08:02:52.153 INFO:tasks.workunit.client.0.smithi107.stdout:3/772: stat d8/d2b/c9e 0 2024-09-21T08:02:52.153 INFO:tasks.workunit.client.0.smithi107.stdout:3/773: fdatasync d8/d14/f101 0 2024-09-21T08:02:52.156 INFO:tasks.workunit.client.0.smithi107.stdout:7/575: mknod d7/d22/cc4 0 2024-09-21T08:02:52.157 INFO:tasks.workunit.client.0.smithi107.stdout:4/736: read dc/fe [1407476,10085] 0 2024-09-21T08:02:52.157 INFO:tasks.workunit.client.0.smithi107.stdout:0/773: dwrite d1/d5/d25/d3d/d20/d85/de1/ff2 [8388608,4194304] 0 2024-09-21T08:02:52.158 INFO:tasks.workunit.client.0.smithi107.stdout:6/796: mkdir d2/d3/d7/d54/dae/d108 0 2024-09-21T08:02:52.162 INFO:tasks.workunit.client.0.smithi107.stdout:6/797: dread d2/d3/d7/d23/ff0 [0,4194304] 0 2024-09-21T08:02:52.162 INFO:tasks.workunit.client.0.smithi107.stdout:7/576: rename d7/d22/d3a/c7b to d7/d10/d64/cc5 0 2024-09-21T08:02:52.162 INFO:tasks.workunit.client.0.smithi107.stdout:7/577: chown d7/d10/d64/c99 173197 1 2024-09-21T08:02:52.163 INFO:tasks.workunit.client.0.smithi107.stdout:3/774: write d8/d25/d3d/ffb [2659610,34114] 0 2024-09-21T08:02:52.164 INFO:tasks.workunit.client.0.smithi107.stdout:4/737: dread dc/d13/d40/f43 [0,4194304] 0 2024-09-21T08:02:52.166 INFO:tasks.workunit.client.0.smithi107.stdout:6/798: mkdir d2/d3/d7/d48/d65/d109 0 2024-09-21T08:02:52.166 INFO:tasks.workunit.client.0.smithi107.stdout:4/738: dread dc/d13/d40/d5e/d77/d99/daa/fb4 [0,4194304] 0 2024-09-21T08:02:52.168 INFO:tasks.workunit.client.0.smithi107.stdout:7/578: rename d7/fa9 to d7/d10/d28/d69/da0/fc6 0 2024-09-21T08:02:52.169 INFO:tasks.workunit.client.0.smithi107.stdout:0/774: write d1/d5/f67 [2880473,90109] 0 2024-09-21T08:02:52.169 INFO:tasks.workunit.client.0.smithi107.stdout:2/824: dwrite d1/d2/f15 [0,4194304] 0 2024-09-21T08:02:52.170 INFO:tasks.workunit.client.0.smithi107.stdout:3/775: symlink d8/d2b/d52/d71/db3/dc2/l104 0 2024-09-21T08:02:52.172 INFO:tasks.workunit.client.0.smithi107.stdout:4/739: getdents dc/d13/d40/d46/d48 0 2024-09-21T08:02:52.174 INFO:tasks.workunit.client.0.smithi107.stdout:0/775: symlink d1/d5/d25/d3d/d20/da0/l104 0 2024-09-21T08:02:52.179 INFO:tasks.workunit.client.0.smithi107.stdout:7/579: write f4 [2390512,49531] 0 2024-09-21T08:02:52.180 INFO:tasks.workunit.client.0.smithi107.stdout:2/825: write d1/d16/fdd [3117733,117298] 0 2024-09-21T08:02:52.180 INFO:tasks.workunit.client.0.smithi107.stdout:3/776: creat d8/d87/dc9/f105 x:0 0 0 2024-09-21T08:02:52.181 INFO:tasks.workunit.client.0.smithi107.stdout:6/799: dwrite d2/d3/d7/d48/da3/d85/d9d/fd1 [0,4194304] 0 2024-09-21T08:02:52.182 INFO:tasks.workunit.client.0.smithi107.stdout:4/740: rename dc/d13/d40/d46/d48/d70/dc5/d90/db2 to dc/d13/d40/d46/de7 0 2024-09-21T08:02:52.187 INFO:tasks.workunit.client.0.smithi107.stdout:3/777: creat d8/d25/d42/dae/db1/dd6/f106 x:0 0 0 2024-09-21T08:02:52.193 INFO:tasks.workunit.client.0.smithi107.stdout:6/800: creat d2/d3/d67/f10a x:0 0 0 2024-09-21T08:02:52.194 INFO:tasks.workunit.client.0.smithi107.stdout:4/741: mkdir dc/de8 0 2024-09-21T08:02:52.195 INFO:tasks.workunit.client.0.smithi107.stdout:3/778: creat d8/d25/d42/dae/f107 x:0 0 0 2024-09-21T08:02:52.195 INFO:tasks.workunit.client.0.smithi107.stdout:3/779: truncate d8/d2b/d45/dbf/fd1 521895 0 2024-09-21T08:02:52.198 INFO:tasks.workunit.client.0.smithi107.stdout:7/580: dwrite d7/d22/d37/d5a/f66 [4194304,4194304] 0 2024-09-21T08:02:52.198 INFO:tasks.workunit.client.0.smithi107.stdout:0/776: dwrite d1/d5/d25/d3d/da1/ff6 [0,4194304] 0 2024-09-21T08:02:52.207 INFO:tasks.workunit.client.0.smithi107.stdout:3/780: dread d8/d25/d3d/ffb [0,4194304] 0 2024-09-21T08:02:52.207 INFO:tasks.workunit.client.0.smithi107.stdout:6/801: getdents d2/d3/d7/d24/d41/d50 0 2024-09-21T08:02:52.209 INFO:tasks.workunit.client.0.smithi107.stdout:4/742: symlink dc/d13/d40/d5e/d98/dbe/le9 0 2024-09-21T08:02:52.219 INFO:tasks.workunit.client.0.smithi107.stdout:4/743: truncate dc/d13/d40/d5e/da8/fd1 1400203 0 2024-09-21T08:02:52.220 INFO:tasks.workunit.client.0.smithi107.stdout:7/581: symlink d7/lc7 0 2024-09-21T08:02:52.221 INFO:tasks.workunit.client.0.smithi107.stdout:4/744: getdents dc/d13/d40/d46/d48/d70/dc5 0 2024-09-21T08:02:52.222 INFO:tasks.workunit.client.0.smithi107.stdout:4/745: mkdir dc/d13/d5a/dea 0 2024-09-21T08:02:52.223 INFO:tasks.workunit.client.0.smithi107.stdout:3/781: read d8/d25/d3d/f90 [686126,36035] 0 2024-09-21T08:02:52.223 INFO:tasks.workunit.client.0.smithi107.stdout:3/782: stat d8/d38/f94 0 2024-09-21T08:02:52.223 INFO:tasks.workunit.client.0.smithi107.stdout:3/783: creat d8/d25/d42/dae/db1/dd6/f108 x:0 0 0 2024-09-21T08:02:52.225 INFO:tasks.workunit.client.0.smithi107.stdout:4/746: creat dc/d64/feb x:0 0 0 2024-09-21T08:02:52.225 INFO:tasks.workunit.client.0.smithi107.stdout:4/747: stat dc/d13/c53 0 2024-09-21T08:02:52.225 INFO:tasks.workunit.client.0.smithi107.stdout:4/748: chown dc/fa1 1 1 2024-09-21T08:02:52.225 INFO:tasks.workunit.client.0.smithi107.stdout:4/749: truncate dc/d13/d40/f4b 28972 0 2024-09-21T08:02:52.227 INFO:tasks.workunit.client.0.smithi107.stdout:3/784: symlink d8/d2b/d45/dcc/daa/l109 0 2024-09-21T08:02:52.233 INFO:tasks.workunit.client.0.smithi107.stdout:6/802: dwrite d2/d2e/d97/fef [0,4194304] 0 2024-09-21T08:02:52.239 INFO:tasks.workunit.client.0.smithi107.stdout:4/750: dread dc/f31 [4194304,4194304] 0 2024-09-21T08:02:52.239 INFO:tasks.workunit.client.0.smithi107.stdout:4/751: write dc/d13/d40/d46/d48/d70/dc5/d90/f96 [894204,86571] 0 2024-09-21T08:02:52.255 INFO:tasks.workunit.client.0.smithi107.stdout:7/582: dwrite f4 [0,4194304] 0 2024-09-21T08:02:52.255 INFO:tasks.workunit.client.0.smithi107.stdout:7/583: getdents d7/dc3 0 2024-09-21T08:02:52.256 INFO:tasks.workunit.client.0.smithi107.stdout:7/584: creat d7/d22/d3a/fc8 x:0 0 0 2024-09-21T08:02:52.257 INFO:tasks.workunit.client.0.smithi107.stdout:7/585: stat d7/d22/d37/d4b/db0/l70 0 2024-09-21T08:02:52.257 INFO:tasks.workunit.client.0.smithi107.stdout:7/586: truncate d7/d22/d3d/d8a/f8d 459238 0 2024-09-21T08:02:52.265 INFO:tasks.workunit.client.0.smithi107.stdout:3/785: dwrite d8/d25/d34/dd0/fd9 [0,4194304] 0 2024-09-21T08:02:52.266 INFO:tasks.workunit.client.0.smithi107.stdout:4/752: dwrite dc/d13/d40/fde [0,4194304] 0 2024-09-21T08:02:52.266 INFO:tasks.workunit.client.0.smithi107.stdout:6/803: dwrite d2/d3/d7/d23/d2b/f90 [0,4194304] 0 2024-09-21T08:02:52.271 INFO:tasks.workunit.client.0.smithi107.stdout:7/587: write d7/d10/d28/f35 [1273040,117636] 0 2024-09-21T08:02:52.273 INFO:tasks.workunit.client.0.smithi107.stdout:4/753: rename dc/d13/d5a/lc7 to dc/d13/d40/lec 0 2024-09-21T08:02:52.278 INFO:tasks.workunit.client.0.smithi107.stdout:3/786: rmdir d8/d44 39 2024-09-21T08:02:52.278 INFO:tasks.workunit.client.0.smithi107.stdout:3/787: chown d8/d25/d34/ca2 251 1 2024-09-21T08:02:52.281 INFO:tasks.workunit.client.0.smithi107.stdout:7/588: mkdir d7/d10/d64/db1/dc9 0 2024-09-21T08:02:52.282 INFO:tasks.workunit.client.0.smithi107.stdout:4/754: truncate dc/d13/f3e 3034102 0 2024-09-21T08:02:52.283 INFO:tasks.workunit.client.0.smithi107.stdout:3/788: unlink d8/d2b/ffc 0 2024-09-21T08:02:52.285 INFO:tasks.workunit.client.0.smithi107.stdout:6/804: dwrite d2/d3/d67/f4e [0,4194304] 0 2024-09-21T08:02:52.286 INFO:tasks.workunit.client.0.smithi107.stdout:7/589: rename d7/ce to d7/d10/d28/cca 0 2024-09-21T08:02:52.289 INFO:tasks.workunit.client.0.smithi107.stdout:6/805: truncate d2/d2e/fbd 414147 0 2024-09-21T08:02:52.289 INFO:tasks.workunit.client.0.smithi107.stdout:6/806: read d2/d3/d7/d48/da3/d85/fa5 [159400,89713] 0 2024-09-21T08:02:52.289 INFO:tasks.workunit.client.0.smithi107.stdout:6/807: write d2/d3/d7/d24/d41/fd7 [574869,77893] 0 2024-09-21T08:02:52.290 INFO:tasks.workunit.client.0.smithi107.stdout:1/719: sync 2024-09-21T08:02:52.291 INFO:tasks.workunit.client.0.smithi107.stdout:1/720: write d0/d19/d2b/d4b/f63 [961449,80226] 0 2024-09-21T08:02:52.292 INFO:tasks.workunit.client.0.smithi107.stdout:7/590: link d7/d22/d3a/f7a d7/d22/d3a/fcb 0 2024-09-21T08:02:52.295 INFO:tasks.workunit.client.0.smithi107.stdout:4/755: write dc/f31 [7058537,124392] 0 2024-09-21T08:02:52.295 INFO:tasks.workunit.client.0.smithi107.stdout:4/756: stat dc/d13/l37 0 2024-09-21T08:02:52.295 INFO:tasks.workunit.client.0.smithi107.stdout:7/591: dread d7/d22/d3d/d8a/f8d [0,4194304] 0 2024-09-21T08:02:52.296 INFO:tasks.workunit.client.0.smithi107.stdout:1/721: rmdir d0/d19/d2b/d4b/d44/d72/d36 39 2024-09-21T08:02:52.297 INFO:tasks.workunit.client.0.smithi107.stdout:1/722: write d0/d19/d2b/f8b [4952978,84854] 0 2024-09-21T08:02:52.297 INFO:tasks.workunit.client.0.smithi107.stdout:1/723: creat d0/d19/d2b/d4b/d44/d55/d64/ff2 x:0 0 0 2024-09-21T08:02:52.303 INFO:tasks.workunit.client.0.smithi107.stdout:4/757: getdents dc/d13/d40/d46/d48/d70/dc5/d97 0 2024-09-21T08:02:52.305 INFO:tasks.workunit.client.0.smithi107.stdout:7/592: rename d7/d22/d37/d5a/fa4 to d7/d10/d64/fcc 0 2024-09-21T08:02:52.308 INFO:tasks.workunit.client.0.smithi107.stdout:4/758: link dc/d13/d40/d46/d48/d70/dc5/d90/c67 dc/d13/d40/d5e/da8/ced 0 2024-09-21T08:02:52.309 INFO:tasks.workunit.client.0.smithi107.stdout:6/808: dwrite d2/d3/d7/d54/d5c/fab [0,4194304] 0 2024-09-21T08:02:52.310 INFO:tasks.workunit.client.0.smithi107.stdout:7/593: creat d7/d10/fcd x:0 0 0 2024-09-21T08:02:52.310 INFO:tasks.workunit.client.0.smithi107.stdout:4/759: creat dc/d13/d40/d46/d48/d70/dc5/d8a/fee x:0 0 0 2024-09-21T08:02:52.311 INFO:tasks.workunit.client.0.smithi107.stdout:4/760: write dc/f1b [1551027,95478] 0 2024-09-21T08:02:52.313 INFO:tasks.workunit.client.0.smithi107.stdout:6/809: mkdir d2/d3/d7/d48/da3/d85/d9d/d10b 0 2024-09-21T08:02:52.314 INFO:tasks.workunit.client.0.smithi107.stdout:1/724: dwrite d0/d29/d31/f42 [0,4194304] 0 2024-09-21T08:02:52.314 INFO:tasks.workunit.client.0.smithi107.stdout:1/725: dread - d0/d19/d2b/d4b/d44/d55/d64/ff2 zero size 2024-09-21T08:02:52.314 INFO:tasks.workunit.client.0.smithi107.stdout:7/594: mknod d7/d22/d37/d5a/d83/d9e/cce 0 2024-09-21T08:02:52.317 INFO:tasks.workunit.client.0.smithi107.stdout:4/761: mkdir dc/d13/d40/d46/d48/d70/def 0 2024-09-21T08:02:52.317 INFO:tasks.workunit.client.0.smithi107.stdout:1/726: dread d0/d19/f33 [0,4194304] 0 2024-09-21T08:02:52.317 INFO:tasks.workunit.client.0.smithi107.stdout:1/727: write d0/d19/d2b/d4b/d44/d55/fdc [256784,51919] 0 2024-09-21T08:02:52.319 INFO:tasks.workunit.client.0.smithi107.stdout:6/810: creat d2/d2e/d97/f10c x:0 0 0 2024-09-21T08:02:52.321 INFO:tasks.workunit.client.0.smithi107.stdout:4/762: mknod dc/d13/d5a/d9b/cf0 0 2024-09-21T08:02:52.321 INFO:tasks.workunit.client.0.smithi107.stdout:4/763: fdatasync dc/d13/d40/f42 0 2024-09-21T08:02:52.323 INFO:tasks.workunit.client.0.smithi107.stdout:1/728: symlink d0/d19/d2b/d4b/d44/d9a/lf3 0 2024-09-21T08:02:52.326 INFO:tasks.workunit.client.0.smithi107.stdout:6/811: truncate d2/d3/d7/d2a/f51 3290780 0 2024-09-21T08:02:52.328 INFO:tasks.workunit.client.0.smithi107.stdout:4/764: mknod dc/d13/d40/d46/cf1 0 2024-09-21T08:02:52.331 INFO:tasks.workunit.client.0.smithi107.stdout:1/729: unlink d0/d29/d4d/d84/dc5/da9/dc7/f91 0 2024-09-21T08:02:52.333 INFO:tasks.workunit.client.0.smithi107.stdout:4/765: symlink dc/d13/d40/d46/d48/d70/dc5/d8a/lf2 0 2024-09-21T08:02:52.333 INFO:tasks.workunit.client.0.smithi107.stdout:4/766: chown dc/d13/d40/d5e/d77 2470337 1 2024-09-21T08:02:52.333 INFO:tasks.workunit.client.0.smithi107.stdout:4/767: creat dc/d64/ff3 x:0 0 0 2024-09-21T08:02:52.333 INFO:tasks.workunit.client.0.smithi107.stdout:1/730: mknod d0/d19/d2b/d4b/d61/d75/cf4 0 2024-09-21T08:02:52.334 INFO:tasks.workunit.client.0.smithi107.stdout:1/731: dread - d0/d29/d31/fef zero size 2024-09-21T08:02:52.335 INFO:tasks.workunit.client.0.smithi107.stdout:4/768: rename dc/d13/f18 to dc/d13/d40/d46/de7/db8/ff4 0 2024-09-21T08:02:52.335 INFO:tasks.workunit.client.0.smithi107.stdout:4/769: fsync dc/d13/d40/f43 0 2024-09-21T08:02:52.335 INFO:tasks.workunit.client.0.smithi107.stdout:7/595: dwrite d7/d22/d37/d5a/fad [0,4194304] 0 2024-09-21T08:02:52.337 INFO:tasks.workunit.client.0.smithi107.stdout:4/770: rename dc/d13/d40/d5e/d98/ld7 to dc/d13/d40/d80/lf5 0 2024-09-21T08:02:52.355 INFO:tasks.workunit.client.0.smithi107.stdout:1/732: dread d0/d29/f5c [0,4194304] 0 2024-09-21T08:02:52.369 INFO:tasks.workunit.client.0.smithi107.stdout:7/596: dwrite d7/d22/d37/fa7 [0,4194304] 0 2024-09-21T08:02:52.369 INFO:tasks.workunit.client.0.smithi107.stdout:4/771: dwrite dc/fa1 [4194304,4194304] 0 2024-09-21T08:02:52.369 INFO:tasks.workunit.client.0.smithi107.stdout:4/772: write dc/d13/d40/d5e/da8/fd1 [2042567,4548] 0 2024-09-21T08:02:52.375 INFO:tasks.workunit.client.0.smithi107.stdout:7/597: rename d7/d38/f41 to d7/d22/d37/fcf 0 2024-09-21T08:02:52.375 INFO:tasks.workunit.client.0.smithi107.stdout:7/598: chown d7/d22/d37/d40/d4d/lbb 7179 1 2024-09-21T08:02:52.375 INFO:tasks.workunit.client.0.smithi107.stdout:7/599: chown d7/d22/d37/d5a/c6b 5 1 2024-09-21T08:02:52.376 INFO:tasks.workunit.client.0.smithi107.stdout:4/773: creat dc/d13/d5a/d9b/ff6 x:0 0 0 2024-09-21T08:02:52.377 INFO:tasks.workunit.client.0.smithi107.stdout:4/774: stat dc/d13/l24 0 2024-09-21T08:02:52.381 INFO:tasks.workunit.client.0.smithi107.stdout:7/600: dread d7/d18/f36 [0,4194304] 0 2024-09-21T08:02:52.385 INFO:tasks.workunit.client.0.smithi107.stdout:4/775: write dc/d13/d40/d46/d48/d70/f94 [3564055,100765] 0 2024-09-21T08:02:52.387 INFO:tasks.workunit.client.0.smithi107.stdout:4/776: rmdir dc/d13/d40/d5e/d98/dbe 39 2024-09-21T08:02:52.387 INFO:tasks.workunit.client.0.smithi107.stdout:4/777: chown dc/d13/d40/d46/d48/d70/dc5/d8a/fa2 1111080 1 2024-09-21T08:02:52.388 INFO:tasks.workunit.client.0.smithi107.stdout:4/778: mkdir dc/d13/d40/d46/d48/d70/dc5/d97/df7 0 2024-09-21T08:02:52.389 INFO:tasks.workunit.client.0.smithi107.stdout:4/779: chown dc/d13/d5a/d9b/lc9 409398404 1 2024-09-21T08:02:52.393 INFO:tasks.workunit.client.0.smithi107.stdout:4/780: dread dc/f29 [0,4194304] 0 2024-09-21T08:02:52.393 INFO:tasks.workunit.client.0.smithi107.stdout:4/781: getdents dc/d13/d40/d46/d48/d70/dc5/d97/df7 0 2024-09-21T08:02:52.393 INFO:tasks.workunit.client.0.smithi107.stdout:4/782: read dc/f3a [845982,90974] 0 2024-09-21T08:02:52.397 INFO:tasks.workunit.client.0.smithi107.stdout:7/601: dwrite d7/d22/d37/d4b/f4c [0,4194304] 0 2024-09-21T08:02:52.400 INFO:tasks.workunit.client.0.smithi107.stdout:7/602: mknod d7/dc3/cd0 0 2024-09-21T08:02:52.400 INFO:tasks.workunit.client.0.smithi107.stdout:7/603: write d7/d22/f76 [118499,90825] 0 2024-09-21T08:02:52.403 INFO:tasks.workunit.client.0.smithi107.stdout:7/604: truncate d7/d22/d3a/fcb 1143252 0 2024-09-21T08:02:52.405 INFO:tasks.workunit.client.0.smithi107.stdout:7/605: rmdir d7/d10/d64/db1/dc9 0 2024-09-21T08:02:52.405 INFO:tasks.workunit.client.0.smithi107.stdout:7/606: dread - d7/d22/d37/d5a/d83/d9e/fb9 zero size 2024-09-21T08:02:52.408 INFO:tasks.workunit.client.0.smithi107.stdout:7/607: creat d7/d10/d64/fd1 x:0 0 0 2024-09-21T08:02:52.410 INFO:tasks.workunit.client.0.smithi107.stdout:7/608: mknod d7/d22/d3b/cd2 0 2024-09-21T08:02:52.413 INFO:tasks.workunit.client.0.smithi107.stdout:7/609: creat d7/d22/d3a/d49/dbe/fd3 x:0 0 0 2024-09-21T08:02:52.415 INFO:tasks.workunit.client.0.smithi107.stdout:7/610: mkdir d7/d22/d3d/d8a/dd4 0 2024-09-21T08:02:52.418 INFO:tasks.workunit.client.0.smithi107.stdout:7/611: getdents d7/d22/d37/d40 0 2024-09-21T08:02:52.418 INFO:tasks.workunit.client.0.smithi107.stdout:7/612: fdatasync d7/d22/d3a/fc8 0 2024-09-21T08:02:52.421 INFO:tasks.workunit.client.0.smithi107.stdout:7/613: symlink d7/d22/d37/ld5 0 2024-09-21T08:02:52.421 INFO:tasks.workunit.client.0.smithi107.stdout:7/614: chown d7/d22/d3a/l79 443305826 1 2024-09-21T08:02:52.426 INFO:tasks.workunit.client.0.smithi107.stdout:7/615: rmdir d7/d10 39 2024-09-21T08:02:52.428 INFO:tasks.workunit.client.0.smithi107.stdout:7/616: symlink d7/dc3/ld6 0 2024-09-21T08:02:52.428 INFO:tasks.workunit.client.0.smithi107.stdout:7/617: write d7/d22/d37/d40/d4d/f6a [1198010,31224] 0 2024-09-21T08:02:52.428 INFO:tasks.workunit.client.0.smithi107.stdout:7/618: dread d7/d22/d37/d4b/db0/d4f/fc0 [0,4194304] 0 2024-09-21T08:02:52.428 INFO:tasks.workunit.client.0.smithi107.stdout:7/619: creat d7/d22/d3a/d49/dbe/fd7 x:0 0 0 2024-09-21T08:02:52.431 INFO:tasks.workunit.client.0.smithi107.stdout:7/620: dread d7/d18/fa6 [0,4194304] 0 2024-09-21T08:02:52.436 INFO:tasks.workunit.client.0.smithi107.stdout:7/621: rename d7/d22/d3d/c98 to d7/cd8 0 2024-09-21T08:02:52.437 INFO:tasks.workunit.client.0.smithi107.stdout:7/622: dread - d7/d10/d28/d69/f91 zero size 2024-09-21T08:02:52.438 INFO:tasks.workunit.client.0.smithi107.stdout:7/623: rename d7/d22/d37/d40/cae to d7/d22/d37/cd9 0 2024-09-21T08:02:52.441 INFO:tasks.workunit.client.0.smithi107.stdout:7/624: fsync d7/d22/f76 0 2024-09-21T08:02:52.441 INFO:tasks.workunit.client.0.smithi107.stdout:7/625: write d7/d22/d3a/d49/dbe/fd7 [586042,100252] 0 2024-09-21T08:02:52.442 INFO:tasks.workunit.client.0.smithi107.stdout:7/626: mkdir d7/d22/d37/d40/d4d/dda 0 2024-09-21T08:02:52.444 INFO:tasks.workunit.client.0.smithi107.stdout:7/627: rename d7/d22/d37/l9f to d7/d22/d3a/d49/ldb 0 2024-09-21T08:02:52.473 INFO:tasks.workunit.client.0.smithi107.stdout:8/704: sync 2024-09-21T08:02:52.481 INFO:tasks.workunit.client.0.smithi107.stdout:8/705: write d5/d40/fba [2398506,109916] 0 2024-09-21T08:02:52.506 INFO:tasks.workunit.client.0.smithi107.stdout:8/706: symlink d5/d2e/dab/lf4 0 2024-09-21T08:02:52.507 INFO:tasks.workunit.client.0.smithi107.stdout:8/707: dread - d5/d38/fe4 zero size 2024-09-21T08:02:52.507 INFO:tasks.workunit.client.0.smithi107.stdout:8/708: creat d5/d2e/d94/ff5 x:0 0 0 2024-09-21T08:02:52.507 INFO:tasks.workunit.client.0.smithi107.stdout:8/709: creat d5/d44/db7/ff6 x:0 0 0 2024-09-21T08:02:52.509 INFO:tasks.workunit.client.0.smithi107.stdout:8/710: creat d5/d38/d56/ff7 x:0 0 0 2024-09-21T08:02:52.510 INFO:tasks.workunit.client.0.smithi107.stdout:8/711: unlink d5/d38/ldb 0 2024-09-21T08:02:52.511 INFO:tasks.workunit.client.0.smithi107.stdout:8/712: readlink d5/d38/d56/d52/d7a/l85 0 2024-09-21T08:02:52.511 INFO:tasks.workunit.client.0.smithi107.stdout:8/713: rmdir d5/d2e/ddc 39 2024-09-21T08:02:52.513 INFO:tasks.workunit.client.0.smithi107.stdout:8/714: dread d5/d40/f8d [0,4194304] 0 2024-09-21T08:02:52.513 INFO:tasks.workunit.client.0.smithi107.stdout:8/715: truncate d5/d2e/d7c/d9a/d9e/fd1 1245387 0 2024-09-21T08:02:52.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:52 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:02:52.521 INFO:tasks.workunit.client.0.smithi107.stdout:8/716: dread d5/db9/fc3 [0,4194304] 0 2024-09-21T08:02:52.539 INFO:tasks.workunit.client.0.smithi107.stdout:8/717: dwrite d5/d2e/d94/ff5 [0,4194304] 0 2024-09-21T08:02:52.540 INFO:tasks.workunit.client.0.smithi107.stdout:8/718: readlink d5/d40/l93 0 2024-09-21T08:02:52.540 INFO:tasks.workunit.client.0.smithi107.stdout:8/719: write d5/d2e/fde [498554,53593] 0 2024-09-21T08:02:52.546 INFO:tasks.workunit.client.0.smithi107.stdout:8/720: dread d5/d38/d56/d52/f8f [0,4194304] 0 2024-09-21T08:02:52.547 INFO:tasks.workunit.client.0.smithi107.stdout:8/721: write d5/d38/f3f [588384,101338] 0 2024-09-21T08:02:52.547 INFO:tasks.workunit.client.0.smithi107.stdout:8/722: mkdir d5/d44/d5d/d9c/dd7/df8 0 2024-09-21T08:02:52.548 INFO:tasks.workunit.client.0.smithi107.stdout:8/723: write d5/d2e/d7c/d9a/f70 [224149,105704] 0 2024-09-21T08:02:52.550 INFO:tasks.workunit.client.0.smithi107.stdout:8/724: symlink d5/d44/d5d/d9c/dd7/lf9 0 2024-09-21T08:02:52.550 INFO:tasks.workunit.client.0.smithi107.stdout:8/725: chown d5/d23/l41 94 1 2024-09-21T08:02:52.550 INFO:tasks.workunit.client.0.smithi107.stdout:8/726: chown d5/d44/d47 23100866 1 2024-09-21T08:02:52.550 INFO:tasks.workunit.client.0.smithi107.stdout:8/727: stat d5/d2e/d7c/d9a 0 2024-09-21T08:02:52.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:52 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:02:52.557 INFO:tasks.workunit.client.0.smithi107.stdout:8/728: write d5/d23/f57 [2242797,22122] 0 2024-09-21T08:02:52.574 INFO:tasks.workunit.client.0.smithi107.stdout:8/729: dwrite d5/d38/f3e [0,4194304] 0 2024-09-21T08:02:52.574 INFO:tasks.workunit.client.0.smithi107.stdout:8/730: write d5/d38/fb3 [1780372,53412] 0 2024-09-21T08:02:52.574 INFO:tasks.workunit.client.0.smithi107.stdout:8/731: rmdir d5/d2e/ddc 39 2024-09-21T08:02:52.574 INFO:tasks.workunit.client.0.smithi107.stdout:8/732: getdents d5/d44/d47 0 2024-09-21T08:02:52.575 INFO:tasks.workunit.client.0.smithi107.stdout:8/733: truncate d5/d1d/f4d 7046080 0 2024-09-21T08:02:52.576 INFO:tasks.workunit.client.0.smithi107.stdout:8/734: stat d5/d44/cd2 0 2024-09-21T08:02:52.583 INFO:tasks.workunit.client.0.smithi107.stdout:8/735: dread d5/f1b [0,4194304] 0 2024-09-21T08:02:52.585 INFO:tasks.workunit.client.0.smithi107.stdout:8/736: creat d5/d38/d56/da3/de7/ffa x:0 0 0 2024-09-21T08:02:52.586 INFO:tasks.workunit.client.0.smithi107.stdout:8/737: truncate d5/d2e/d94/ff5 4687507 0 2024-09-21T08:02:52.591 INFO:tasks.workunit.client.0.smithi107.stdout:8/738: dread d5/f1b [0,4194304] 0 2024-09-21T08:02:52.591 INFO:tasks.workunit.client.0.smithi107.stdout:8/739: stat d5/d44/db7/ff6 0 2024-09-21T08:02:52.592 INFO:tasks.workunit.client.0.smithi107.stdout:8/740: mkdir d5/d40/d8a/dcb/dfb 0 2024-09-21T08:02:52.592 INFO:tasks.workunit.client.0.smithi107.stdout:8/741: truncate d5/d2e/fde 1408823 0 2024-09-21T08:02:52.592 INFO:tasks.workunit.client.0.smithi107.stdout:8/742: truncate d5/d38/d56/f65 134229 0 2024-09-21T08:02:52.594 INFO:tasks.workunit.client.0.smithi107.stdout:8/743: link d5/d44/l82 d5/d38/d56/d52/lfc 0 2024-09-21T08:02:52.596 INFO:tasks.workunit.client.0.smithi107.stdout:8/744: rmdir d5/d2e/d7c 39 2024-09-21T08:02:52.599 INFO:tasks.workunit.client.0.smithi107.stdout:8/745: rename d5/d38/d56/da3/def to d5/d38/d56/d54/dfd 0 2024-09-21T08:02:52.601 INFO:tasks.workunit.client.0.smithi107.stdout:8/746: mkdir d5/d38/d56/d54/dce/dfe 0 2024-09-21T08:02:52.603 INFO:tasks.workunit.client.0.smithi107.stdout:8/747: mkdir d5/d40/d8a/dcb/dff 0 2024-09-21T08:02:52.688 INFO:tasks.workunit.client.0.smithi107.stdout:8/748: rename d5/d2e/d7c/d9a/d9e/dcc/ff3 to d5/d44/d5d/f100 0 2024-09-21T08:02:52.697 INFO:tasks.workunit.client.0.smithi107.stdout:8/749: write d5/d2e/f4b [658297,6359] 0 2024-09-21T08:02:52.700 INFO:tasks.workunit.client.0.smithi107.stdout:8/750: rename d5/d23/f32 to d5/d1d/f101 0 2024-09-21T08:02:52.708 INFO:tasks.workunit.client.0.smithi107.stdout:8/751: dread d5/d2e/f77 [0,4194304] 0 2024-09-21T08:02:52.722 INFO:tasks.workunit.client.0.smithi107.stdout:8/752: dwrite d5/d1d/f24 [0,4194304] 0 2024-09-21T08:02:52.722 INFO:tasks.workunit.client.0.smithi107.stdout:8/753: creat d5/d1d/f102 x:0 0 0 2024-09-21T08:02:52.740 INFO:tasks.workunit.client.0.smithi107.stdout:8/754: dwrite d5/d40/fd4 [0,4194304] 0 2024-09-21T08:02:52.741 INFO:tasks.workunit.client.0.smithi107.stdout:8/755: readlink d5/db9/l6b 0 2024-09-21T08:02:52.741 INFO:tasks.workunit.client.0.smithi107.stdout:8/756: fsync d5/d2e/f4a 0 2024-09-21T08:02:52.757 INFO:tasks.workunit.client.0.smithi107.stdout:5/977: sync 2024-09-21T08:02:52.757 INFO:tasks.workunit.client.0.smithi107.stdout:9/856: sync 2024-09-21T08:02:52.759 INFO:tasks.workunit.client.0.smithi107.stdout:9/857: creat d11/d27/d2f/d4d/f130 x:0 0 0 2024-09-21T08:02:52.761 INFO:tasks.workunit.client.0.smithi107.stdout:5/978: mknod d7/de/d1d/d29/d145/d5d/d60/c15f 0 2024-09-21T08:02:52.761 INFO:tasks.workunit.client.0.smithi107.stdout:5/979: write d7/de/d1d/d24/f8c [1345499,14813] 0 2024-09-21T08:02:52.762 INFO:tasks.workunit.client.0.smithi107.stdout:8/757: dwrite d5/d44/d5d/f100 [0,4194304] 0 2024-09-21T08:02:52.763 INFO:tasks.workunit.client.0.smithi107.stdout:5/980: link d7/de/d1d/d29/f3c d7/de/d52/d157/f160 0 2024-09-21T08:02:52.763 INFO:tasks.workunit.client.0.smithi107.stdout:5/981: fsync d7/de/d1d/d24/f6e 0 2024-09-21T08:02:52.768 INFO:tasks.workunit.client.0.smithi107.stdout:9/858: dread d11/d27/d2a/f87 [0,4194304] 0 2024-09-21T08:02:52.771 INFO:tasks.workunit.client.0.smithi107.stdout:8/758: unlink d5/d38/fb3 0 2024-09-21T08:02:52.774 INFO:tasks.workunit.client.0.smithi107.stdout:5/982: symlink d7/de/d1d/d29/d68/ddb/dde/dc0/d13c/l161 0 2024-09-21T08:02:52.775 INFO:tasks.workunit.client.0.smithi107.stdout:5/983: creat d7/de/d1d/d29/d68/ddb/d11b/f162 x:0 0 0 2024-09-21T08:02:52.786 INFO:tasks.workunit.client.0.smithi107.stdout:8/759: read d5/d1d/f24 [1488420,46770] 0 2024-09-21T08:02:52.788 INFO:tasks.workunit.client.0.smithi107.stdout:8/760: mkdir d5/d38/d67/d7d/d103 0 2024-09-21T08:02:52.788 INFO:tasks.workunit.client.0.smithi107.stdout:8/761: creat d5/d1d/f104 x:0 0 0 2024-09-21T08:02:52.788 INFO:tasks.workunit.client.0.smithi107.stdout:8/762: chown d5/d40/d8a/dcb/dff 108250 1 2024-09-21T08:02:52.789 INFO:tasks.workunit.client.0.smithi107.stdout:9/859: dwrite d11/d24/fd9 [0,4194304] 0 2024-09-21T08:02:52.789 INFO:tasks.workunit.client.0.smithi107.stdout:5/984: dread d7/de/d52/d6b/f92 [0,4194304] 0 2024-09-21T08:02:52.789 INFO:tasks.workunit.client.0.smithi107.stdout:9/860: truncate d11/d24/d26/dd0/dec/f10e 812507 0 2024-09-21T08:02:52.789 INFO:tasks.workunit.client.0.smithi107.stdout:9/861: creat d11/d24/d26/dd0/f131 x:0 0 0 2024-09-21T08:02:52.791 INFO:tasks.workunit.client.0.smithi107.stdout:8/763: creat d5/d2e/d89/f105 x:0 0 0 2024-09-21T08:02:52.791 INFO:tasks.workunit.client.0.smithi107.stdout:8/764: readlink d5/d40/l93 0 2024-09-21T08:02:52.791 INFO:tasks.workunit.client.0.smithi107.stdout:8/765: write d5/d1d/f6f [141832,64938] 0 2024-09-21T08:02:52.794 INFO:tasks.workunit.client.0.smithi107.stdout:5/985: symlink d7/de/d1d/d29/d68/l163 0 2024-09-21T08:02:52.794 INFO:tasks.workunit.client.0.smithi107.stdout:5/986: truncate d7/de/d1d/d24/f4f 1613259 0 2024-09-21T08:02:52.798 INFO:tasks.workunit.client.0.smithi107.stdout:8/766: symlink d5/d2e/d7c/d9a/d98/l106 0 2024-09-21T08:02:52.798 INFO:tasks.workunit.client.0.smithi107.stdout:8/767: truncate d5/d44/db7/fda 246777 0 2024-09-21T08:02:52.800 INFO:tasks.workunit.client.0.smithi107.stdout:5/987: link d7/de/d35/ce2 d7/de/d1d/d29/d68/ddb/dde/d11f/d148/d154/c164 0 2024-09-21T08:02:52.801 INFO:tasks.workunit.client.0.smithi107.stdout:9/862: getdents d11/d27/d2f/d38/daa 0 2024-09-21T08:02:52.808 INFO:tasks.workunit.client.0.smithi107.stdout:8/768: mknod d5/d23/c107 0 2024-09-21T08:02:52.809 INFO:tasks.workunit.client.0.smithi107.stdout:5/988: creat d7/de/d35/f165 x:0 0 0 2024-09-21T08:02:52.811 INFO:tasks.workunit.client.0.smithi107.stdout:5/989: truncate d7/d70/ff2 3528942 0 2024-09-21T08:02:52.813 INFO:tasks.workunit.client.0.smithi107.stdout:9/863: dread d11/d27/d5e/d76/f8c [0,4194304] 0 2024-09-21T08:02:52.813 INFO:tasks.workunit.client.0.smithi107.stdout:9/864: stat d11/d27/d2f/d4d/d5c/c78 0 2024-09-21T08:02:52.815 INFO:tasks.workunit.client.0.smithi107.stdout:5/990: mknod d7/de/d13e/c166 0 2024-09-21T08:02:52.818 INFO:tasks.workunit.client.0.smithi107.stdout:5/991: link d7/de/d1d/d29/d68/ddb/dde/l77 d7/de/d1d/d29/d68/ddb/d14d/l167 0 2024-09-21T08:02:52.833 INFO:tasks.workunit.client.0.smithi107.stdout:5/992: dread d7/de/d1d/d29/d64/d87/fa5 [0,4194304] 0 2024-09-21T08:02:52.837 INFO:tasks.workunit.client.0.smithi107.stdout:5/993: creat d7/de/d1d/d29/d145/d139/f168 x:0 0 0 2024-09-21T08:02:52.838 INFO:tasks.workunit.client.0.smithi107.stdout:8/769: dwrite d5/f6 [0,4194304] 0 2024-09-21T08:02:52.838 INFO:tasks.workunit.client.0.smithi107.stdout:8/770: truncate d5/d38/d56/da3/de7/ffa 896848 0 2024-09-21T08:02:52.838 INFO:tasks.workunit.client.0.smithi107.stdout:8/771: write d5/d38/d56/ff7 [1026354,46645] 0 2024-09-21T08:02:52.838 INFO:tasks.workunit.client.0.smithi107.stdout:0/777: sync 2024-09-21T08:02:52.838 INFO:tasks.workunit.client.0.smithi107.stdout:0/778: creat d1/d5/d25/d3d/f105 x:0 0 0 2024-09-21T08:02:52.839 INFO:tasks.workunit.client.0.smithi107.stdout:2/826: sync 2024-09-21T08:02:52.840 INFO:tasks.workunit.client.0.smithi107.stdout:8/772: mknod d5/d44/d5d/d9c/c108 0 2024-09-21T08:02:52.841 INFO:tasks.workunit.client.0.smithi107.stdout:5/994: dread d7/de/d1d/d29/d64/f89 [4194304,4194304] 0 2024-09-21T08:02:52.846 INFO:tasks.workunit.client.0.smithi107.stdout:0/779: creat d1/d5/d25/d3d/d20/d85/da8/f106 x:0 0 0 2024-09-21T08:02:52.848 INFO:tasks.workunit.client.0.smithi107.stdout:8/773: symlink d5/d38/d56/d52/l109 0 2024-09-21T08:02:52.848 INFO:tasks.workunit.client.0.smithi107.stdout:8/774: truncate f0 4336202 0 2024-09-21T08:02:52.851 INFO:tasks.workunit.client.0.smithi107.stdout:3/789: sync 2024-09-21T08:02:52.851 INFO:tasks.workunit.client.0.smithi107.stdout:0/780: truncate d1/d5/d25/f4e 3047070 0 2024-09-21T08:02:52.852 INFO:tasks.workunit.client.0.smithi107.stdout:0/781: write d1/d5/d25/d3d/d20/d29/fc5 [311224,7473] 0 2024-09-21T08:02:52.852 INFO:tasks.workunit.client.0.smithi107.stdout:0/782: stat d1/d6f/d80 0 2024-09-21T08:02:52.852 INFO:tasks.workunit.client.0.smithi107.stdout:0/783: chown d1/d5/d25/f40 42187924 1 2024-09-21T08:02:52.852 INFO:tasks.workunit.client.0.smithi107.stdout:6/812: sync 2024-09-21T08:02:52.852 INFO:tasks.workunit.client.0.smithi107.stdout:1/733: sync 2024-09-21T08:02:52.852 INFO:tasks.workunit.client.0.smithi107.stdout:1/734: dread - d0/d80/fa8 zero size 2024-09-21T08:02:52.852 INFO:tasks.workunit.client.0.smithi107.stdout:1/735: chown d0/d19/d2b/d4b/f1a 11881503 1 2024-09-21T08:02:52.852 INFO:tasks.workunit.client.0.smithi107.stdout:7/628: sync 2024-09-21T08:02:52.852 INFO:tasks.workunit.client.0.smithi107.stdout:7/629: truncate d7/d22/d3a/d49/dbe/fd3 931586 0 2024-09-21T08:02:52.852 INFO:tasks.workunit.client.0.smithi107.stdout:7/630: fsync d7/d22/d3a/f67 0 2024-09-21T08:02:52.852 INFO:tasks.workunit.client.0.smithi107.stdout:4/783: sync 2024-09-21T08:02:52.856 INFO:tasks.workunit.client.0.smithi107.stdout:5/995: dread d7/de/d35/f8a [0,4194304] 0 2024-09-21T08:02:52.857 INFO:tasks.workunit.client.0.smithi107.stdout:3/790: rename d8/d2b/d52/d71/c77 to d8/d2b/d91/de5/c10a 0 2024-09-21T08:02:52.857 INFO:tasks.workunit.client.0.smithi107.stdout:3/791: chown d8/d25/d34/cf6 368538988 1 2024-09-21T08:02:52.861 INFO:tasks.workunit.client.0.smithi107.stdout:0/784: creat d1/d5/d25/d3d/d20/d29/d5c/f107 x:0 0 0 2024-09-21T08:02:52.861 INFO:tasks.workunit.client.0.smithi107.stdout:0/785: fsync d1/d5/d25/d3d/d20/d29/d55/d7a/f82 0 2024-09-21T08:02:52.861 INFO:tasks.workunit.client.0.smithi107.stdout:0/786: chown d1/d5/d25/d2d/c45 510 1 2024-09-21T08:02:52.862 INFO:tasks.workunit.client.0.smithi107.stdout:6/813: rmdir d2/d3/d7/d48/d86 39 2024-09-21T08:02:52.865 INFO:tasks.workunit.client.0.smithi107.stdout:1/736: rename d0/d29/d4d/d84/dc5/da9/dc7/ce6 to d0/d29/d4d/d84/dc5/da9/dc7/cf5 0 2024-09-21T08:02:52.868 INFO:tasks.workunit.client.0.smithi107.stdout:2/827: dwrite d1/d2/d6d/d42/db0/df7/ffe [0,4194304] 0 2024-09-21T08:02:52.868 INFO:tasks.workunit.client.0.smithi107.stdout:2/828: write d1/d16/f41 [1411582,21239] 0 2024-09-21T08:02:52.868 INFO:tasks.workunit.client.0.smithi107.stdout:7/631: unlink d7/d22/d37/d40/l6c 0 2024-09-21T08:02:52.868 INFO:tasks.workunit.client.0.smithi107.stdout:7/632: truncate d7/d22/d3d/f7c 588679 0 2024-09-21T08:02:52.869 INFO:tasks.workunit.client.0.smithi107.stdout:4/784: link dc/d13/d40/f4b dc/d13/d5a/d9b/dbc/ff8 0 2024-09-21T08:02:52.873 INFO:tasks.workunit.client.0.smithi107.stdout:8/775: rmdir d5/d44/db7 39 2024-09-21T08:02:52.874 INFO:tasks.workunit.client.0.smithi107.stdout:0/787: dread d1/d5/d25/d3d/d20/d29/d5c/f5e [0,4194304] 0 2024-09-21T08:02:52.875 INFO:tasks.workunit.client.0.smithi107.stdout:5/996: rename d7/de/d1d/d29/d145/d5d/d60/dc5/fe7 to d7/de/d1d/dbc/f169 0 2024-09-21T08:02:52.875 INFO:tasks.workunit.client.0.smithi107.stdout:5/997: truncate d7/de/d1d/d29/d68/ddb/dde/df7/f122 918372 0 2024-09-21T08:02:52.877 INFO:tasks.workunit.client.0.smithi107.stdout:1/737: write d0/d19/d2b/d4b/fd [972709,8116] 0 2024-09-21T08:02:52.877 INFO:tasks.workunit.client.0.smithi107.stdout:1/738: truncate d0/d19/d2b/d4b/d44/d72/d36/d8e/fd3 6486 0 2024-09-21T08:02:52.879 INFO:tasks.workunit.client.0.smithi107.stdout:3/792: mkdir d8/d25/d3d/d72/d80/d5d/d6e/d10b 0 2024-09-21T08:02:52.879 INFO:tasks.workunit.client.0.smithi107.stdout:3/793: read - d8/d25/d42/dae/db1/dd6/f106 zero size 2024-09-21T08:02:52.882 INFO:tasks.workunit.client.0.smithi107.stdout:4/785: dread dc/d13/d40/d5e/d77/fa9 [0,4194304] 0 2024-09-21T08:02:52.882 INFO:tasks.workunit.client.0.smithi107.stdout:6/814: creat d2/d3/d7/d48/da3/d85/dd9/f10d x:0 0 0 2024-09-21T08:02:52.889 INFO:tasks.workunit.client.0.smithi107.stdout:2/829: mkdir d1/d2/d6d/d37/d49/d7f/d111 0 2024-09-21T08:02:52.891 INFO:tasks.workunit.client.0.smithi107.stdout:7/633: mknod d7/d10/d64/db1/cdc 0 2024-09-21T08:02:52.892 INFO:tasks.workunit.client.0.smithi107.stdout:5/998: dread d7/de/f30 [0,4194304] 0 2024-09-21T08:02:52.894 INFO:tasks.workunit.client.0.smithi107.stdout:0/788: creat d1/d5/d25/d3d/d20/d29/d55/d91/d9a/dd1/f108 x:0 0 0 2024-09-21T08:02:52.894 INFO:tasks.workunit.client.0.smithi107.stdout:0/789: chown d1/d5/d25/d2d/c45 123274326 1 2024-09-21T08:02:52.898 INFO:tasks.workunit.client.0.smithi107.stdout:6/815: read d2/d3/d7/fb7 [3542099,1020] 0 2024-09-21T08:02:52.898 INFO:tasks.workunit.client.0.smithi107.stdout:6/816: chown d2/d3/d7/d23/d2b/d84 31998 1 2024-09-21T08:02:52.898 INFO:tasks.workunit.client.0.smithi107.stdout:6/817: chown d2/d3/d7/d48/da3/d85/d9b/db6 19 1 2024-09-21T08:02:52.900 INFO:tasks.workunit.client.0.smithi107.stdout:2/830: getdents d1/d2/d6d/d42/d76 0 2024-09-21T08:02:52.902 INFO:tasks.workunit.client.0.smithi107.stdout:7/634: creat d7/d10/d28/fdd x:0 0 0 2024-09-21T08:02:52.903 INFO:tasks.workunit.client.0.smithi107.stdout:8/776: getdents d5/d2e/d7c/d9a/d98 0 2024-09-21T08:02:52.903 INFO:tasks.workunit.client.0.smithi107.stdout:8/777: creat d5/d38/d56/f10a x:0 0 0 2024-09-21T08:02:52.904 INFO:tasks.workunit.client.0.smithi107.stdout:4/786: getdents dc/d13/d40 0 2024-09-21T08:02:52.905 INFO:tasks.workunit.client.0.smithi107.stdout:2/831: symlink d1/d2/d6d/d37/d49/d7f/d111/l112 0 2024-09-21T08:02:52.907 INFO:tasks.workunit.client.0.smithi107.stdout:8/778: rename d5/l1c to d5/d38/d56/d54/l10b 0 2024-09-21T08:02:52.908 INFO:tasks.workunit.client.0.smithi107.stdout:8/779: write d5/d40/d8a/dcb/fd0 [211890,63884] 0 2024-09-21T08:02:52.908 INFO:tasks.workunit.client.0.smithi107.stdout:8/780: fdatasync d5/d23/f57 0 2024-09-21T08:02:52.908 INFO:tasks.workunit.client.0.smithi107.stdout:4/787: mknod dc/d13/d40/d46/d48/d70/dc5/cf9 0 2024-09-21T08:02:52.908 INFO:tasks.workunit.client.0.smithi107.stdout:4/788: chown dc/d13/d40/d46/d48/f9d 43099 1 2024-09-21T08:02:52.908 INFO:tasks.workunit.client.0.smithi107.stdout:4/789: dread - dc/d13/d40/d46/d48/fd4 zero size 2024-09-21T08:02:52.909 INFO:tasks.workunit.client.0.smithi107.stdout:3/794: dwrite d8/d25/d42/fb7 [4194304,4194304] 0 2024-09-21T08:02:52.909 INFO:tasks.workunit.client.0.smithi107.stdout:6/818: mkdir d2/d3/d7/d10e 0 2024-09-21T08:02:52.910 INFO:tasks.workunit.client.0.smithi107.stdout:1/739: dwrite d0/d19/d2b/d4b/d44/d72/f78 [0,4194304] 0 2024-09-21T08:02:52.910 INFO:tasks.workunit.client.0.smithi107.stdout:2/832: mknod d1/dc8/c113 0 2024-09-21T08:02:52.910 INFO:tasks.workunit.client.0.smithi107.stdout:7/635: rmdir d7/d22/d3a/d49/dbe 39 2024-09-21T08:02:52.911 INFO:tasks.workunit.client.0.smithi107.stdout:0/790: dwrite d1/d5/d25/fa6 [12582912,4194304] 0 2024-09-21T08:02:52.915 INFO:tasks.workunit.client.0.smithi107.stdout:4/790: creat dc/d64/d6b/dcf/ffa x:0 0 0 2024-09-21T08:02:52.915 INFO:tasks.workunit.client.0.smithi107.stdout:3/795: dread d8/d25/d34/faf [0,4194304] 0 2024-09-21T08:02:52.915 INFO:tasks.workunit.client.0.smithi107.stdout:3/796: write d8/d2b/d52/f68 [1001150,61368] 0 2024-09-21T08:02:52.916 INFO:tasks.workunit.client.0.smithi107.stdout:3/797: fsync d8/d2b/d45/dcc/f1e 0 2024-09-21T08:02:52.916 INFO:tasks.workunit.client.0.smithi107.stdout:1/740: rmdir d0/d29/d4d/d84/dc5/d5e 39 2024-09-21T08:02:52.916 INFO:tasks.workunit.client.0.smithi107.stdout:2/833: truncate d1/d6/d92/f9f 3334199 0 2024-09-21T08:02:52.917 INFO:tasks.workunit.client.0.smithi107.stdout:2/834: readlink d1/d1e/la0 0 2024-09-21T08:02:52.917 INFO:tasks.workunit.client.0.smithi107.stdout:5/999: dread d7/de/d35/f43 [0,4194304] 0 2024-09-21T08:02:52.920 INFO:tasks.workunit.client.0.smithi107.stdout:7/636: rename d7/d22/d3d/ca8 to d7/d10/d28/d69/da0/cde 0 2024-09-21T08:02:52.921 INFO:tasks.workunit.client.0.smithi107.stdout:7/637: write d7/d22/d3d/f51 [570935,1703] 0 2024-09-21T08:02:52.928 INFO:tasks.workunit.client.0.smithi107.stdout:4/791: write dc/d13/d40/d5e/da8/fd6 [2589392,5179] 0 2024-09-21T08:02:52.929 INFO:tasks.workunit.client.0.smithi107.stdout:0/791: dread d1/d5/d25/f40 [0,4194304] 0 2024-09-21T08:02:52.929 INFO:tasks.workunit.client.0.smithi107.stdout:0/792: truncate d1/d23/f6d 4914714 0 2024-09-21T08:02:52.929 INFO:tasks.workunit.client.0.smithi107.stdout:0/793: chown d1/d6f/f89 450 1 2024-09-21T08:02:52.930 INFO:tasks.workunit.client.0.smithi107.stdout:7/638: dread d7/d22/d37/d4b/db0/f96 [0,4194304] 0 2024-09-21T08:02:52.932 INFO:tasks.workunit.client.0.smithi107.stdout:4/792: mknod dc/d13/d40/d80/cfb 0 2024-09-21T08:02:52.932 INFO:tasks.workunit.client.0.smithi107.stdout:4/793: write dc/d13/d40/d46/f82 [2845659,14398] 0 2024-09-21T08:02:52.933 INFO:tasks.workunit.client.0.smithi107.stdout:0/794: rmdir d1/d6f 39 2024-09-21T08:02:52.933 INFO:tasks.workunit.client.0.smithi107.stdout:0/795: readlink d1/d5/d25/d3d/d20/d29/d55/d91/d9a/lff 0 2024-09-21T08:02:52.935 INFO:tasks.workunit.client.0.smithi107.stdout:3/798: rename d8/d14/d96/db0 to d8/d2b/d10c 0 2024-09-21T08:02:52.938 INFO:tasks.workunit.client.0.smithi107.stdout:4/794: unlink dc/d13/d40/d46/d48/d70/dc5/d90/f96 0 2024-09-21T08:02:52.939 INFO:tasks.workunit.client.0.smithi107.stdout:0/796: symlink d1/d5/d25/l109 0 2024-09-21T08:02:52.940 INFO:tasks.workunit.client.0.smithi107.stdout:7/639: write d7/d18/f29 [1632575,120995] 0 2024-09-21T08:02:52.941 INFO:tasks.workunit.client.0.smithi107.stdout:4/795: symlink dc/d13/d5a/d9b/dbc/lfc 0 2024-09-21T08:02:52.941 INFO:tasks.workunit.client.0.smithi107.stdout:4/796: readlink dc/d13/d40/d46/d48/d70/dc5/l91 0 2024-09-21T08:02:52.941 INFO:tasks.workunit.client.0.smithi107.stdout:8/781: dwrite d5/d38/d56/f65 [0,4194304] 0 2024-09-21T08:02:52.941 INFO:tasks.workunit.client.0.smithi107.stdout:6/819: dwrite d2/d2e/ff1 [0,4194304] 0 2024-09-21T08:02:52.944 INFO:tasks.workunit.client.0.smithi107.stdout:0/797: unlink d1/d5/d25/d3d/d20/d85/da8/fd6 0 2024-09-21T08:02:52.944 INFO:tasks.workunit.client.0.smithi107.stdout:0/798: fsync d1/fe 0 2024-09-21T08:02:52.949 INFO:tasks.workunit.client.0.smithi107.stdout:4/797: unlink dc/fa1 0 2024-09-21T08:02:52.949 INFO:tasks.workunit.client.0.smithi107.stdout:4/798: creat dc/d13/d40/d5e/d77/ffd x:0 0 0 2024-09-21T08:02:52.955 INFO:tasks.workunit.client.0.smithi107.stdout:3/799: dwrite d8/d21/f48 [0,4194304] 0 2024-09-21T08:02:52.955 INFO:tasks.workunit.client.0.smithi107.stdout:3/800: read - d8/d25/fcd zero size 2024-09-21T08:02:52.955 INFO:tasks.workunit.client.0.smithi107.stdout:3/801: readlink d8/d38/l39 0 2024-09-21T08:02:52.956 INFO:tasks.workunit.client.0.smithi107.stdout:8/782: truncate d5/d38/d56/d54/f80 919446 0 2024-09-21T08:02:52.958 INFO:tasks.workunit.client.0.smithi107.stdout:3/802: dread d8/d44/f64 [0,4194304] 0 2024-09-21T08:02:52.958 INFO:tasks.workunit.client.0.smithi107.stdout:3/803: write d8/d38/fd3 [145738,114401] 0 2024-09-21T08:02:52.958 INFO:tasks.workunit.client.0.smithi107.stdout:3/804: chown d8/l10 0 1 2024-09-21T08:02:52.959 INFO:tasks.workunit.client.0.smithi107.stdout:3/805: creat d8/d2b/d45/f10d x:0 0 0 2024-09-21T08:02:52.959 INFO:tasks.workunit.client.0.smithi107.stdout:3/806: dread d8/d21/d7e/fd2 [0,4194304] 0 2024-09-21T08:02:52.960 INFO:tasks.workunit.client.0.smithi107.stdout:1/741: truncate d0/d29/d4d/d84/dc5/f3d 163969 0 2024-09-21T08:02:52.962 INFO:tasks.workunit.client.0.smithi107.stdout:6/820: link d2/d2e/f4c d2/d3/d7/d79/f10f 0 2024-09-21T08:02:52.965 INFO:tasks.workunit.client.0.smithi107.stdout:0/799: mkdir d1/d5/d25/d2d/d8e/d10a 0 2024-09-21T08:02:52.965 INFO:tasks.workunit.client.0.smithi107.stdout:7/640: mknod d7/d38/cdf 0 2024-09-21T08:02:52.966 INFO:tasks.workunit.client.0.smithi107.stdout:7/641: write d7/d22/d3d/f50 [1947206,61668] 0 2024-09-21T08:02:52.966 INFO:tasks.workunit.client.0.smithi107.stdout:7/642: write f4 [5102321,67205] 0 2024-09-21T08:02:52.968 INFO:tasks.workunit.client.0.smithi107.stdout:4/799: mknod dc/d13/d40/d5e/cfe 0 2024-09-21T08:02:52.971 INFO:tasks.workunit.client.0.smithi107.stdout:8/783: creat d5/d2e/ddc/f10c x:0 0 0 2024-09-21T08:02:52.974 INFO:tasks.workunit.client.0.smithi107.stdout:8/784: dread d5/d40/f8d [0,4194304] 0 2024-09-21T08:02:52.974 INFO:tasks.workunit.client.0.smithi107.stdout:8/785: write d5/d23/f57 [556358,85884] 0 2024-09-21T08:02:52.977 INFO:tasks.workunit.client.0.smithi107.stdout:1/742: rename d0/d19/d2b/d86/dd9/fe4 to d0/d19/ddd/ff6 0 2024-09-21T08:02:52.986 INFO:tasks.workunit.client.0.smithi107.stdout:7/643: dwrite d7/d18/f19 [8388608,4194304] 0 2024-09-21T08:02:52.990 INFO:tasks.workunit.client.0.smithi107.stdout:4/800: truncate dc/d60/fab 1744281 0 2024-09-21T08:02:52.991 INFO:tasks.workunit.client.0.smithi107.stdout:4/801: fdatasync dc/d13/d40/d5e/da8/fdd 0 2024-09-21T08:02:52.992 INFO:tasks.workunit.client.0.smithi107.stdout:8/786: symlink d5/d38/d56/d54/dce/l10d 0 2024-09-21T08:02:52.992 INFO:tasks.workunit.client.0.smithi107.stdout:8/787: getdents d5/d40/d8a/dcb/dee 0 2024-09-21T08:02:52.995 INFO:tasks.workunit.client.0.smithi107.stdout:0/800: rename d1/d23/d61 to d1/d6f/dc1/dcc/df7/d10b 0 2024-09-21T08:02:53.001 INFO:tasks.workunit.client.0.smithi107.stdout:7/644: link d7/d18/f29 d7/d22/d3a/fe0 0 2024-09-21T08:02:53.006 INFO:tasks.workunit.client.0.smithi107.stdout:1/743: dwrite d0/d29/d4d/d84/dc5/d5e/f99 [0,4194304] 0 2024-09-21T08:02:53.006 INFO:tasks.workunit.client.0.smithi107.stdout:4/802: dread dc/f1b [0,4194304] 0 2024-09-21T08:02:53.006 INFO:tasks.workunit.client.0.smithi107.stdout:6/821: unlink d2/d3/d7/l92 0 2024-09-21T08:02:53.006 INFO:tasks.workunit.client.0.smithi107.stdout:6/822: write d2/d3/d7/d23/d2b/fdf [989805,116850] 0 2024-09-21T08:02:53.009 INFO:tasks.workunit.client.0.smithi107.stdout:8/788: getdents d5/d44 0 2024-09-21T08:02:53.009 INFO:tasks.workunit.client.0.smithi107.stdout:8/789: write d5/d2e/d89/f105 [634248,29197] 0 2024-09-21T08:02:53.009 INFO:tasks.workunit.client.0.smithi107.stdout:8/790: creat d5/d44/d5d/d9c/f10e x:0 0 0 2024-09-21T08:02:53.018 INFO:tasks.workunit.client.0.smithi107.stdout:4/803: read dc/d13/d40/d46/d48/d70/dc5/d8a/fa2 [2479497,47129] 0 2024-09-21T08:02:53.023 INFO:tasks.workunit.client.0.smithi107.stdout:0/801: dwrite d1/d5/d25/d3d/d20/d85/d8a/fd4 [0,4194304] 0 2024-09-21T08:02:53.024 INFO:tasks.workunit.client.0.smithi107.stdout:7/645: dwrite d7/d22/d37/d4b/f7e [0,4194304] 0 2024-09-21T08:02:53.026 INFO:tasks.workunit.client.0.smithi107.stdout:4/804: read dc/d13/d40/d46/f55 [2731615,41443] 0 2024-09-21T08:02:53.033 INFO:tasks.workunit.client.0.smithi107.stdout:1/744: rename d0/d29/d4d/lf1 to d0/d19/d2b/d4b/d44/d72/d36/d8e/lf7 0 2024-09-21T08:02:53.034 INFO:tasks.workunit.client.0.smithi107.stdout:0/802: write d1/d5/d25/d3d/d20/f6c [3630893,109314] 0 2024-09-21T08:02:53.034 INFO:tasks.workunit.client.0.smithi107.stdout:0/803: stat d1/d5/d75 0 2024-09-21T08:02:53.034 INFO:tasks.workunit.client.0.smithi107.stdout:0/804: truncate d1/d6f/fd8 97784 0 2024-09-21T08:02:53.036 INFO:tasks.workunit.client.0.smithi107.stdout:7/646: truncate d7/d22/d37/d4b/db0/f96 12894 0 2024-09-21T08:02:53.036 INFO:tasks.workunit.client.0.smithi107.stdout:7/647: dread - d7/d10/d64/fcc zero size 2024-09-21T08:02:53.039 INFO:tasks.workunit.client.0.smithi107.stdout:4/805: mknod dc/d13/d40/d46/cff 0 2024-09-21T08:02:53.039 INFO:tasks.workunit.client.0.smithi107.stdout:4/806: chown dc/d13/d40/d5e/cfe 57 1 2024-09-21T08:02:53.042 INFO:tasks.workunit.client.0.smithi107.stdout:0/805: link d1/d5/d25/d3d/d20/d29/l72 d1/d6f/d80/l10c 0 2024-09-21T08:02:53.042 INFO:tasks.workunit.client.0.smithi107.stdout:0/806: dread - d1/d5/d25/d3d/d20/d29/d5c/f107 zero size 2024-09-21T08:02:53.042 INFO:tasks.workunit.client.0.smithi107.stdout:0/807: write d1/d5/d25/d3d/d20/d29/d55/f93 [57424,110993] 0 2024-09-21T08:02:53.046 INFO:tasks.workunit.client.0.smithi107.stdout:7/648: write d7/d18/f29 [7339367,46578] 0 2024-09-21T08:02:53.049 INFO:tasks.workunit.client.0.smithi107.stdout:1/745: dwrite d0/d19/f93 [0,4194304] 0 2024-09-21T08:02:53.049 INFO:tasks.workunit.client.0.smithi107.stdout:1/746: truncate d0/d19/d2b/d4b/d44/d72/f78 342621 0 2024-09-21T08:02:53.051 INFO:tasks.workunit.client.0.smithi107.stdout:0/808: write d1/d5/d25/f40 [3113804,31147] 0 2024-09-21T08:02:53.053 INFO:tasks.workunit.client.0.smithi107.stdout:0/809: truncate d1/d23/f6d 792719 0 2024-09-21T08:02:53.053 INFO:tasks.workunit.client.0.smithi107.stdout:0/810: chown d1/d5/d25/fa6 45 1 2024-09-21T08:02:53.054 INFO:tasks.workunit.client.0.smithi107.stdout:0/811: mkdir d1/d5/d25/d9e/d10d 0 2024-09-21T08:02:53.074 INFO:tasks.workunit.client.0.smithi107.stdout:7/649: dwrite d7/d22/fb4 [0,4194304] 0 2024-09-21T08:02:53.079 INFO:tasks.workunit.client.0.smithi107.stdout:7/650: getdents d7 0 2024-09-21T08:02:53.079 INFO:tasks.workunit.client.0.smithi107.stdout:1/747: dwrite d0/d19/f3b [4194304,4194304] 0 2024-09-21T08:02:53.079 INFO:tasks.workunit.client.0.smithi107.stdout:0/812: dwrite d1/d5/d25/d3d/f105 [0,4194304] 0 2024-09-21T08:02:53.080 INFO:tasks.workunit.client.0.smithi107.stdout:7/651: rmdir d7/d22/d3a/d49/d56 39 2024-09-21T08:02:53.087 INFO:tasks.workunit.client.0.smithi107.stdout:1/748: dread d0/d19/f87 [0,4194304] 0 2024-09-21T08:02:53.087 INFO:tasks.workunit.client.0.smithi107.stdout:7/652: symlink d7/d10/d64/le1 0 2024-09-21T08:02:53.090 INFO:tasks.workunit.client.0.smithi107.stdout:7/653: dread d7/d22/d3d/d8a/f8d [0,4194304] 0 2024-09-21T08:02:53.092 INFO:tasks.workunit.client.0.smithi107.stdout:1/749: rename d0/f2 to d0/d29/d4d/d84/ff8 0 2024-09-21T08:02:53.092 INFO:tasks.workunit.client.0.smithi107.stdout:0/813: write d1/d5/d25/d3d/d20/d29/d55/d91/fbc [5004209,126423] 0 2024-09-21T08:02:53.092 INFO:tasks.workunit.client.0.smithi107.stdout:0/814: chown d1/d5/d25/d2d/c45 97090753 1 2024-09-21T08:02:53.094 INFO:tasks.workunit.client.0.smithi107.stdout:7/654: mkdir d7/d22/d37/d5a/d83/d9e/de2 0 2024-09-21T08:02:53.095 INFO:tasks.workunit.client.0.smithi107.stdout:1/750: mknod d0/d19/d2b/d4b/d5b/dcb/ded/cf9 0 2024-09-21T08:02:53.099 INFO:tasks.workunit.client.0.smithi107.stdout:0/815: creat d1/d6f/d80/f10e x:0 0 0 2024-09-21T08:02:53.101 INFO:tasks.workunit.client.0.smithi107.stdout:1/751: rename d0/d29/d31/l48 to d0/d29/d4d/d84/dc5/da9/dc7/lfa 0 2024-09-21T08:02:53.101 INFO:tasks.workunit.client.0.smithi107.stdout:1/752: fdatasync d0/d19/d2b/d4b/fd 0 2024-09-21T08:02:53.101 INFO:tasks.workunit.client.0.smithi107.stdout:1/753: chown d0/d29/f3f 91903 1 2024-09-21T08:02:53.101 INFO:tasks.workunit.client.0.smithi107.stdout:1/754: dread - d0/d80/fa8 zero size 2024-09-21T08:02:53.104 INFO:tasks.workunit.client.0.smithi107.stdout:0/816: rename d1/d5/d25/d3d/d20/d29/d55/f8d to d1/d5/d25/d9e/f10f 0 2024-09-21T08:02:53.105 INFO:tasks.workunit.client.0.smithi107.stdout:1/755: link d0/d19/d39/l43 d0/d19/d2b/d4b/d5b/lfb 0 2024-09-21T08:02:53.109 INFO:tasks.workunit.client.0.smithi107.stdout:1/756: rmdir d0/d19/d2b/d4b/d44 39 2024-09-21T08:02:53.113 INFO:tasks.workunit.client.0.smithi107.stdout:0/817: dread d1/d5/d25/d9e/fa4 [0,4194304] 0 2024-09-21T08:02:53.119 INFO:tasks.workunit.client.0.smithi107.stdout:1/757: dread d0/d19/d2b/d4b/d44/d72/d36/f73 [0,4194304] 0 2024-09-21T08:02:53.139 INFO:tasks.workunit.client.0.smithi107.stdout:0/818: dwrite d1/d5/d25/d9e/fa4 [0,4194304] 0 2024-09-21T08:02:53.139 INFO:tasks.workunit.client.0.smithi107.stdout:1/758: dwrite d0/d29/f5c [4194304,4194304] 0 2024-09-21T08:02:53.141 INFO:tasks.workunit.client.0.smithi107.stdout:0/819: rename d1/d6f/dc1/dcc/df7/d10b/f73 to d1/d5/d25/d3d/d20/f110 0 2024-09-21T08:02:53.146 INFO:tasks.workunit.client.0.smithi107.stdout:1/759: rmdir d0/d29/d31 39 2024-09-21T08:02:53.146 INFO:tasks.workunit.client.0.smithi107.stdout:1/760: write d0/d19/d2b/d4b/d61/fbb [1163607,102673] 0 2024-09-21T08:02:53.147 INFO:tasks.workunit.client.0.smithi107.stdout:1/761: dread d0/d29/d4d/d84/dc5/d5e/f69 [4194304,4194304] 0 2024-09-21T08:02:53.149 INFO:tasks.workunit.client.0.smithi107.stdout:0/820: dread d1/d5/d25/d3d/f105 [0,4194304] 0 2024-09-21T08:02:53.157 INFO:tasks.workunit.client.0.smithi107.stdout:1/762: dread d0/d29/d4d/d84/dc5/d5e/f69 [0,4194304] 0 2024-09-21T08:02:53.157 INFO:tasks.workunit.client.0.smithi107.stdout:1/763: truncate d0/d19/d2b/d4b/d44/d55/d64/ff2 153560 0 2024-09-21T08:02:53.157 INFO:tasks.workunit.client.0.smithi107.stdout:1/764: chown d0/dc6/l85 7 1 2024-09-21T08:02:53.158 INFO:tasks.workunit.client.0.smithi107.stdout:1/765: creat d0/d19/d2b/d4b/d44/d55/d64/ffc x:0 0 0 2024-09-21T08:02:53.178 INFO:tasks.workunit.client.0.smithi107.stdout:1/766: dwrite d0/d29/d4d/d84/dc5/f3d [0,4194304] 0 2024-09-21T08:02:53.193 INFO:tasks.workunit.client.0.smithi107.stdout:1/767: dwrite d0/d19/d2b/d4b/f1a [0,4194304] 0 2024-09-21T08:02:53.201 INFO:tasks.workunit.client.0.smithi107.stdout:1/768: mkdir d0/d19/d2b/dfd 0 2024-09-21T08:02:53.209 INFO:tasks.workunit.client.0.smithi107.stdout:1/769: write d0/d19/f3b [3717314,94576] 0 2024-09-21T08:02:53.211 INFO:tasks.workunit.client.0.smithi107.stdout:1/770: rename d0/d19/d2b/d4b/d44/d72/dde to d0/d19/d2b/dfd/dfe 0 2024-09-21T08:02:53.211 INFO:tasks.workunit.client.0.smithi107.stdout:1/771: stat d0/d19/l27 0 2024-09-21T08:02:53.211 INFO:tasks.workunit.client.0.smithi107.stdout:1/772: fsync d0/d29/f3f 0 2024-09-21T08:02:53.225 INFO:tasks.workunit.client.0.smithi107.stdout:1/773: dwrite d0/d29/d4d/d84/dc5/f26 [0,4194304] 0 2024-09-21T08:02:53.226 INFO:tasks.workunit.client.0.smithi107.stdout:1/774: getdents d0/d19/d2b/d4b/d44 0 2024-09-21T08:02:53.243 INFO:tasks.workunit.client.0.smithi107.stdout:1/775: dwrite d0/d19/d2b/d4b/d61/d75/f7d [4194304,4194304] 0 2024-09-21T08:02:53.244 INFO:tasks.workunit.client.0.smithi107.stdout:1/776: mknod d0/d80/cff 0 2024-09-21T08:02:53.245 INFO:tasks.workunit.client.0.smithi107.stdout:1/777: creat d0/dc6/f100 x:0 0 0 2024-09-21T08:02:53.246 INFO:tasks.workunit.client.0.smithi107.stdout:9/865: sync 2024-09-21T08:02:53.246 INFO:tasks.workunit.client.0.smithi107.stdout:9/866: chown d11/d24/d6e/ffe 70 1 2024-09-21T08:02:53.256 INFO:tasks.workunit.client.0.smithi107.stdout:1/778: write d0/d29/d4d/d84/dc5/da9/dc7/f6f [3228616,127018] 0 2024-09-21T08:02:53.266 INFO:tasks.workunit.client.0.smithi107.stdout:1/779: write d0/d19/d39/f96 [2295663,26240] 0 2024-09-21T08:02:53.266 INFO:tasks.workunit.client.0.smithi107.stdout:9/867: dwrite d11/d24/d6e/f94 [0,4194304] 0 2024-09-21T08:02:53.269 INFO:tasks.workunit.client.0.smithi107.stdout:9/868: dread d11/f18 [4194304,4194304] 0 2024-09-21T08:02:53.269 INFO:tasks.workunit.client.0.smithi107.stdout:9/869: chown d11/d27/d2f/d4d/d5c/d61/db4/d10f 32501 1 2024-09-21T08:02:53.272 INFO:tasks.workunit.client.0.smithi107.stdout:9/870: dread d11/d27/d98/d97/fc9 [0,4194304] 0 2024-09-21T08:02:53.272 INFO:tasks.workunit.client.0.smithi107.stdout:9/871: creat d11/d24/d26/f132 x:0 0 0 2024-09-21T08:02:53.272 INFO:tasks.workunit.client.0.smithi107.stdout:9/872: chown d11/d27/d2f/d38/l51 1 1 2024-09-21T08:02:53.276 INFO:tasks.workunit.client.0.smithi107.stdout:9/873: rename d11/d27/d5e/le1 to d11/d27/d2f/def/l133 0 2024-09-21T08:02:53.276 INFO:tasks.workunit.client.0.smithi107.stdout:9/874: stat d11/d24/d35/f6f 0 2024-09-21T08:02:53.276 INFO:tasks.workunit.client.0.smithi107.stdout:9/875: fsync d11/d27/d98/fcb 0 2024-09-21T08:02:53.277 INFO:tasks.workunit.client.0.smithi107.stdout:9/876: stat d11/d27/lac 0 2024-09-21T08:02:53.278 INFO:tasks.workunit.client.0.smithi107.stdout:9/877: chown d11/d27/d5b/fc2 0 1 2024-09-21T08:02:53.278 INFO:tasks.workunit.client.0.smithi107.stdout:9/878: write d11/d27/d5e/d76/fb7 [2805581,21611] 0 2024-09-21T08:02:53.282 INFO:tasks.workunit.client.0.smithi107.stdout:1/780: dwrite d0/d19/d2b/d4b/d44/d72/fb9 [0,4194304] 0 2024-09-21T08:02:53.283 INFO:tasks.workunit.client.0.smithi107.stdout:1/781: symlink d0/d19/d2b/d4b/d5b/dcb/ded/l101 0 2024-09-21T08:02:53.283 INFO:tasks.workunit.client.0.smithi107.stdout:1/782: creat d0/d19/d39/f102 x:0 0 0 2024-09-21T08:02:53.289 INFO:tasks.workunit.client.0.smithi107.stdout:9/879: write d11/d27/d2f/d38/fa6 [697498,89298] 0 2024-09-21T08:02:53.292 INFO:tasks.workunit.client.0.smithi107.stdout:9/880: mknod d11/d27/d2f/d4d/d5c/d61/db4/dbb/c134 0 2024-09-21T08:02:53.298 INFO:tasks.workunit.client.0.smithi107.stdout:1/783: dwrite d0/d19/fc4 [0,4194304] 0 2024-09-21T08:02:53.298 INFO:tasks.workunit.client.0.smithi107.stdout:1/784: chown d0/d29/d4d/d84/dc5/da9/dc7 850 1 2024-09-21T08:02:53.298 INFO:tasks.workunit.client.0.smithi107.stdout:1/785: readlink d0/d19/d2b/l68 0 2024-09-21T08:02:53.299 INFO:tasks.workunit.client.0.smithi107.stdout:1/786: creat d0/d29/f103 x:0 0 0 2024-09-21T08:02:53.299 INFO:tasks.workunit.client.0.smithi107.stdout:1/787: creat d0/d29/f104 x:0 0 0 2024-09-21T08:02:53.299 INFO:tasks.workunit.client.0.smithi107.stdout:1/788: chown d0/d19/f33 0 1 2024-09-21T08:02:53.299 INFO:tasks.workunit.client.0.smithi107.stdout:1/789: fsync d0/d19/fc4 0 2024-09-21T08:02:53.309 INFO:tasks.workunit.client.0.smithi107.stdout:9/881: dwrite d11/d24/d4a/f70 [0,4194304] 0 2024-09-21T08:02:53.316 INFO:tasks.workunit.client.0.smithi107.stdout:9/882: dread d11/d27/d2f/d38/daa/ffd [0,4194304] 0 2024-09-21T08:02:53.317 INFO:tasks.workunit.client.0.smithi107.stdout:9/883: symlink d11/d24/d26/l135 0 2024-09-21T08:02:53.321 INFO:tasks.workunit.client.0.smithi107.stdout:9/884: link d11/f21 d11/d27/d2f/f136 0 2024-09-21T08:02:53.328 INFO:tasks.workunit.client.0.smithi107.stdout:9/885: write d11/d27/d2f/d4d/f59 [3043330,30119] 0 2024-09-21T08:02:53.329 INFO:tasks.workunit.client.0.smithi107.stdout:9/886: mknod d11/d27/d2f/d4d/d5c/d61/db4/c137 0 2024-09-21T08:02:53.339 INFO:tasks.workunit.client.0.smithi107.stdout:9/887: dread d11/d27/d98/f6c [0,4194304] 0 2024-09-21T08:02:53.339 INFO:tasks.workunit.client.0.smithi107.stdout:9/888: fdatasync d11/d27/d2f/d4d/d5c/d61/db4/dbb/ff2 0 2024-09-21T08:02:53.339 INFO:tasks.workunit.client.0.smithi107.stdout:9/889: write d11/d27/d2a/d7f/fbc [561996,36947] 0 2024-09-21T08:02:53.339 INFO:tasks.workunit.client.0.smithi107.stdout:9/890: write d11/f5f [147614,50644] 0 2024-09-21T08:02:53.340 INFO:tasks.workunit.client.0.smithi107.stdout:9/891: rename d11/d27/d5e/df1/c121 to d11/d27/d2f/d38/daa/c138 0 2024-09-21T08:02:53.341 INFO:tasks.workunit.client.0.smithi107.stdout:9/892: symlink d11/d27/d2f/d4d/d92/l139 0 2024-09-21T08:02:53.357 INFO:tasks.workunit.client.0.smithi107.stdout:9/893: dwrite d11/d24/d35/fa8 [0,4194304] 0 2024-09-21T08:02:53.360 INFO:tasks.workunit.client.0.smithi107.stdout:9/894: rmdir d11/d27/d2f/d4d/d5c/d61/db4/dbb 39 2024-09-21T08:02:53.361 INFO:tasks.workunit.client.0.smithi107.stdout:9/895: symlink d11/d27/d2f/d4d/d5c/d61/db4/dbb/l13a 0 2024-09-21T08:02:53.370 INFO:tasks.workunit.client.0.smithi107.stdout:9/896: write d11/d27/d2f/d4d/d5c/d61/f7e [1936795,129499] 0 2024-09-21T08:02:53.371 INFO:tasks.workunit.client.0.smithi107.stdout:9/897: creat d11/d24/d26/dbe/f13b x:0 0 0 2024-09-21T08:02:53.372 INFO:tasks.workunit.client.0.smithi107.stdout:9/898: symlink d11/d27/d2f/d38/dcc/l13c 0 2024-09-21T08:02:53.389 INFO:tasks.workunit.client.0.smithi107.stdout:9/899: dwrite d11/d24/d26/f2e [0,4194304] 0 2024-09-21T08:02:53.391 INFO:tasks.workunit.client.0.smithi107.stdout:9/900: mkdir d11/d27/d2f/def/dfb/d13d 0 2024-09-21T08:02:53.392 INFO:tasks.workunit.client.0.smithi107.stdout:9/901: symlink d11/d24/d26/dd0/dec/d10d/l13e 0 2024-09-21T08:02:53.401 INFO:tasks.workunit.client.0.smithi107.stdout:9/902: dread d11/d24/d4a/f70 [0,4194304] 0 2024-09-21T08:02:53.402 INFO:tasks.workunit.client.0.smithi107.stdout:9/903: write d11/d24/d26/dd0/f131 [573931,24329] 0 2024-09-21T08:02:53.403 INFO:tasks.workunit.client.0.smithi107.stdout:9/904: mkdir d11/d24/d26/dbe/de3/d13f 0 2024-09-21T08:02:53.403 INFO:tasks.workunit.client.0.smithi107.stdout:9/905: creat d11/d27/d2f/def/f140 x:0 0 0 2024-09-21T08:02:53.403 INFO:tasks.workunit.client.0.smithi107.stdout:9/906: fdatasync d11/d27/d2f/f7d 0 2024-09-21T08:02:53.405 INFO:tasks.workunit.client.0.smithi107.stdout:9/907: truncate d11/f37 2244122 0 2024-09-21T08:02:53.407 INFO:tasks.workunit.client.0.smithi107.stdout:9/908: getdents d11/d27/d2f/d4d/d5c/d61 0 2024-09-21T08:02:53.408 INFO:tasks.workunit.client.0.smithi107.stdout:9/909: creat d11/d24/d26/df0/f141 x:0 0 0 2024-09-21T08:02:53.410 INFO:tasks.workunit.client.0.smithi107.stdout:9/910: truncate d11/f18 267619 0 2024-09-21T08:02:53.410 INFO:tasks.workunit.client.0.smithi107.stdout:9/911: stat d11/d27/d2f/d4d/d5c/d61/f64 0 2024-09-21T08:02:53.410 INFO:tasks.workunit.client.0.smithi107.stdout:9/912: truncate d11/d27/d5e/d76/f6a 5122481 0 2024-09-21T08:02:53.411 INFO:tasks.workunit.client.0.smithi107.stdout:9/913: truncate d11/d27/d2f/d4d/d5c/d61/fab 1103026 0 2024-09-21T08:02:53.411 INFO:tasks.workunit.client.0.smithi107.stdout:9/914: chown d11/d24/d6e/db9/cdb 12695 1 2024-09-21T08:02:53.431 INFO:tasks.workunit.client.0.smithi107.stdout:9/915: dwrite d11/d27/d5e/d76/fe0 [0,4194304] 0 2024-09-21T08:02:53.435 INFO:tasks.workunit.client.0.smithi107.stdout:9/916: symlink d11/d24/d6e/db9/ded/l142 0 2024-09-21T08:02:53.453 INFO:tasks.workunit.client.0.smithi107.stdout:9/917: dwrite d11/d24/d6e/f94 [0,4194304] 0 2024-09-21T08:02:53.454 INFO:tasks.workunit.client.0.smithi107.stdout:9/918: fsync d11/d27/d5e/df1/d105/fc8 0 2024-09-21T08:02:53.464 INFO:tasks.workunit.client.0.smithi107.stdout:9/919: rename d11/d27/d2f to d11/d27/d5e/d76/d143 0 2024-09-21T08:02:53.465 INFO:tasks.workunit.client.0.smithi107.stdout:9/920: unlink d11/d27/d5e/d76/d143/d38/daa/f11d 0 2024-09-21T08:02:53.467 INFO:tasks.workunit.client.0.smithi107.stdout:9/921: read d11/d27/d5e/d76/d143/d4d/d5c/d61/db4/dbb/ff2 [782754,85176] 0 2024-09-21T08:02:53.476 INFO:tasks.workunit.client.0.smithi107.stdout:9/922: dread d11/d24/d26/dd0/dec/f91 [0,4194304] 0 2024-09-21T08:02:53.476 INFO:tasks.workunit.client.0.smithi107.stdout:9/923: chown d11/c23 324225626 1 2024-09-21T08:02:53.476 INFO:tasks.workunit.client.0.smithi107.stdout:9/924: chown d11/d27/d5e/d76/d143/d4d/d5c/d61/dca/c127 420522 1 2024-09-21T08:02:53.477 INFO:tasks.workunit.client.0.smithi107.stdout:9/925: mknod d11/d27/d5e/d76/d143/d38/dcc/c144 0 2024-09-21T08:02:53.479 INFO:tasks.workunit.client.0.smithi107.stdout:9/926: mkdir d11/d27/d5e/d145 0 2024-09-21T08:02:53.479 INFO:tasks.workunit.client.0.smithi107.stdout:9/927: chown d11/d27/d5e/d76/d143/def/dfb/l11a 92532932 1 2024-09-21T08:02:53.479 INFO:tasks.workunit.client.0.smithi107.stdout:9/928: write d11/d27/d98/d97/f112 [755602,70452] 0 2024-09-21T08:02:53.481 INFO:tasks.workunit.client.0.smithi107.stdout:9/929: creat d11/d27/d5e/d76/d143/def/dfb/d13d/f146 x:0 0 0 2024-09-21T08:02:53.485 INFO:tasks.workunit.client.0.smithi107.stdout:9/930: mkdir d11/d147 0 2024-09-21T08:02:53.487 INFO:tasks.workunit.client.0.smithi107.stdout:9/931: creat d11/d24/d4a/f148 x:0 0 0 2024-09-21T08:02:53.504 INFO:tasks.workunit.client.0.smithi107.stdout:9/932: dwrite d11/d24/d35/f129 [0,4194304] 0 2024-09-21T08:02:53.510 INFO:tasks.workunit.client.0.smithi107.stdout:9/933: mknod d11/d27/d98/c149 0 2024-09-21T08:02:53.510 INFO:tasks.workunit.client.0.smithi107.stdout:9/934: write d11/f21 [5513617,100083] 0 2024-09-21T08:02:53.511 INFO:tasks.workunit.client.0.smithi107.stdout:9/935: fsync d11/d24/d4a/f75 0 2024-09-21T08:02:53.511 INFO:tasks.workunit.client.0.smithi107.stdout:9/936: write d11/d27/d5e/d76/d143/d38/dbf/dda/fe9 [1177337,404] 0 2024-09-21T08:02:53.511 INFO:tasks.workunit.client.0.smithi107.stdout:9/937: dread - d11/d27/d5e/d76/d143/def/dfb/d13d/f146 zero size 2024-09-21T08:02:53.513 INFO:tasks.workunit.client.0.smithi107.stdout:9/938: mkdir d11/d27/d5b/d14a 0 2024-09-21T08:02:53.514 INFO:tasks.workunit.client.0.smithi107.stdout:9/939: mknod d11/d24/d35/c14b 0 2024-09-21T08:02:53.515 INFO:tasks.workunit.client.0.smithi107.stdout:9/940: creat d11/d27/d5e/d76/d143/d38/dcc/f14c x:0 0 0 2024-09-21T08:02:53.516 INFO:tasks.workunit.client.0.smithi107.stdout:9/941: write d11/d27/d5e/d76/d143/d4d/d5c/d61/db4/dbb/ff2 [544994,17243] 0 2024-09-21T08:02:53.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:53 smithi129 ceph-mon[34472]: pgmap v18: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 177 MiB/s rd, 207 MiB/s wr, 346 op/s 2024-09-21T08:02:53.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:53 smithi107 ceph-mon[27622]: pgmap v18: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 177 MiB/s rd, 207 MiB/s wr, 346 op/s 2024-09-21T08:02:53.582 INFO:tasks.workunit.client.0.smithi107.stdout:9/942: mkdir d11/d24/d26/dbe/de3/d13f/d14d 0 2024-09-21T08:02:53.590 INFO:tasks.workunit.client.0.smithi107.stdout:9/943: dread d11/d27/d5e/d76/d143/fce [0,4194304] 0 2024-09-21T08:02:53.600 INFO:tasks.workunit.client.0.smithi107.stdout:9/944: dread d11/d27/d5e/d76/d143/d4d/d5c/fa2 [0,4194304] 0 2024-09-21T08:02:53.600 INFO:tasks.workunit.client.0.smithi107.stdout:9/945: dread - d11/d27/d5e/d76/d143/def/dfb/d13d/f146 zero size 2024-09-21T08:02:53.600 INFO:tasks.workunit.client.0.smithi107.stdout:9/946: truncate d11/d27/d5e/d76/d143/d4d/d5c/d61/fcd 476001 0 2024-09-21T08:02:53.616 INFO:tasks.workunit.client.0.smithi107.stdout:9/947: dwrite d11/d24/d6e/ffe [0,4194304] 0 2024-09-21T08:02:53.616 INFO:tasks.workunit.client.0.smithi107.stdout:9/948: fdatasync d11/d27/d5e/d76/d143/d4d/d5c/fa2 0 2024-09-21T08:02:53.657 INFO:tasks.workunit.client.0.smithi107.stdout:9/949: creat d11/d27/d5e/d76/d143/d38/dbf/dda/f14e x:0 0 0 2024-09-21T08:02:53.677 INFO:tasks.workunit.client.0.smithi107.stdout:9/950: dwrite d11/d27/d5e/d76/d143/d38/dcc/f14c [0,4194304] 0 2024-09-21T08:02:53.678 INFO:tasks.workunit.client.0.smithi107.stdout:2/835: sync 2024-09-21T08:02:53.681 INFO:tasks.workunit.client.0.smithi107.stdout:9/951: creat d11/d27/d5e/d76/d143/d38/dbf/f14f x:0 0 0 2024-09-21T08:02:53.682 INFO:tasks.workunit.client.0.smithi107.stdout:2/836: rmdir d1/d6/d9e 39 2024-09-21T08:02:53.684 INFO:tasks.workunit.client.0.smithi107.stdout:9/952: creat d11/d27/d5e/d76/d143/d4d/d5c/d61/f150 x:0 0 0 2024-09-21T08:02:53.688 INFO:tasks.workunit.client.0.smithi107.stdout:9/953: symlink d11/d24/d26/dbe/de3/d13f/l151 0 2024-09-21T08:02:53.688 INFO:tasks.workunit.client.0.smithi107.stdout:9/954: readlink d11/d27/d5e/d76/d143/d38/l51 0 2024-09-21T08:02:53.688 INFO:tasks.workunit.client.0.smithi107.stdout:9/955: readlink d11/d24/d6e/db9/l104 0 2024-09-21T08:02:53.703 INFO:tasks.workunit.client.0.smithi107.stdout:2/837: dwrite d1/dc8/f105 [0,4194304] 0 2024-09-21T08:02:53.703 INFO:tasks.workunit.client.0.smithi107.stdout:2/838: chown d1/d2/d6d/d37/d49/d85/fed 0 1 2024-09-21T08:02:53.703 INFO:tasks.workunit.client.0.smithi107.stdout:9/956: dwrite d11/d27/d5e/d76/d143/d38/daa/f120 [0,4194304] 0 2024-09-21T08:02:53.704 INFO:tasks.workunit.client.0.smithi107.stdout:2/839: dread d1/d6/f51 [0,4194304] 0 2024-09-21T08:02:53.704 INFO:tasks.workunit.client.0.smithi107.stdout:2/840: dread - d1/d1e/f110 zero size 2024-09-21T08:02:53.704 INFO:tasks.workunit.client.0.smithi107.stdout:2/841: dread - d1/d6/d92/df2/f103 zero size 2024-09-21T08:02:53.704 INFO:tasks.workunit.client.0.smithi107.stdout:2/842: fdatasync d1/d2/d6d/d37/f4a 0 2024-09-21T08:02:53.704 INFO:tasks.workunit.client.0.smithi107.stdout:2/843: fsync d1/d2/d6d/f5f 0 2024-09-21T08:02:53.708 INFO:tasks.workunit.client.0.smithi107.stdout:9/957: unlink d11/l96 0 2024-09-21T08:02:53.708 INFO:tasks.workunit.client.0.smithi107.stdout:9/958: chown d11/d27/d2a/f33 25442070 1 2024-09-21T08:02:53.708 INFO:tasks.workunit.client.0.smithi107.stdout:9/959: write d11/d24/d26/df0/f141 [634077,91573] 0 2024-09-21T08:02:53.711 INFO:tasks.workunit.client.0.smithi107.stdout:9/960: mknod d11/d27/d5e/d76/d143/d4d/d5c/d61/db4/d10f/c152 0 2024-09-21T08:02:53.712 INFO:tasks.workunit.client.0.smithi107.stdout:2/844: mknod d1/d2/d6d/d42/c114 0 2024-09-21T08:02:53.718 INFO:tasks.workunit.client.0.smithi107.stdout:3/807: sync 2024-09-21T08:02:53.718 INFO:tasks.workunit.client.0.smithi107.stdout:3/808: truncate d8/d14/f54 2794274 0 2024-09-21T08:02:53.720 INFO:tasks.workunit.client.0.smithi107.stdout:3/809: unlink d8/d25/d34/c9d 0 2024-09-21T08:02:53.721 INFO:tasks.workunit.client.0.smithi107.stdout:3/810: unlink d8/d2b/d52/d55/ca8 0 2024-09-21T08:02:53.727 INFO:tasks.workunit.client.0.smithi107.stdout:9/961: write d11/f37 [2695101,107174] 0 2024-09-21T08:02:53.728 INFO:tasks.workunit.client.0.smithi107.stdout:2/845: dwrite d1/d16/f60 [0,4194304] 0 2024-09-21T08:02:53.728 INFO:tasks.workunit.client.0.smithi107.stdout:2/846: creat d1/d2/d6d/d37/d49/d85/f115 x:0 0 0 2024-09-21T08:02:53.733 INFO:tasks.workunit.client.0.smithi107.stdout:2/847: rmdir d1/d16/d35 39 2024-09-21T08:02:53.733 INFO:tasks.workunit.client.0.smithi107.stdout:2/848: chown d1/d2/l29 175 1 2024-09-21T08:02:53.739 INFO:tasks.workunit.client.0.smithi107.stdout:3/811: dwrite d8/f13 [0,4194304] 0 2024-09-21T08:02:53.739 INFO:tasks.workunit.client.0.smithi107.stdout:3/812: truncate d8/d21/f88 666384 0 2024-09-21T08:02:53.739 INFO:tasks.workunit.client.0.smithi107.stdout:3/813: write d8/d25/d42/dae/db1/dd6/f106 [641307,24439] 0 2024-09-21T08:02:53.749 INFO:tasks.workunit.client.0.smithi107.stdout:3/814: rename d8/d38/la3 to d8/d2b/d52/d71/dd8/dfd/l10e 0 2024-09-21T08:02:53.753 INFO:tasks.workunit.client.0.smithi107.stdout:3/815: rename d8/d25/d3d/f90 to d8/d21/f10f 0 2024-09-21T08:02:53.754 INFO:tasks.workunit.client.0.smithi107.stdout:2/849: dwrite d1/d2/d6d/d37/d49/d7f/f10b [0,4194304] 0 2024-09-21T08:02:53.754 INFO:tasks.workunit.client.0.smithi107.stdout:9/962: dwrite d11/d27/d98/f54 [0,4194304] 0 2024-09-21T08:02:53.759 INFO:tasks.workunit.client.0.smithi107.stdout:2/850: mknod d1/d2/d6d/d37/d82/dff/c116 0 2024-09-21T08:02:53.759 INFO:tasks.workunit.client.0.smithi107.stdout:3/816: creat d8/d2b/d91/de5/f110 x:0 0 0 2024-09-21T08:02:53.762 INFO:tasks.workunit.client.0.smithi107.stdout:9/963: read d11/d24/d6e/f94 [2833635,107728] 0 2024-09-21T08:02:53.772 INFO:tasks.workunit.client.0.smithi107.stdout:9/964: dread d11/d24/d26/dd0/dec/f81 [0,4194304] 0 2024-09-21T08:02:53.772 INFO:tasks.workunit.client.0.smithi107.stdout:9/965: fsync d11/d27/d2a/f33 0 2024-09-21T08:02:53.772 INFO:tasks.workunit.client.0.smithi107.stdout:9/966: chown d11/d24/d35/f129 2 1 2024-09-21T08:02:53.773 INFO:tasks.workunit.client.0.smithi107.stdout:9/967: fsync d11/d27/d5b/fc2 0 2024-09-21T08:02:53.773 INFO:tasks.workunit.client.0.smithi107.stdout:2/851: creat d1/d6/d92/dce/f117 x:0 0 0 2024-09-21T08:02:53.773 INFO:tasks.workunit.client.0.smithi107.stdout:3/817: mkdir d8/d2b/d45/d111 0 2024-09-21T08:02:53.773 INFO:tasks.workunit.client.0.smithi107.stdout:3/818: creat d8/d87/f112 x:0 0 0 2024-09-21T08:02:53.773 INFO:tasks.workunit.client.0.smithi107.stdout:3/819: write d8/d2b/d91/fe7 [552705,125251] 0 2024-09-21T08:02:53.774 INFO:tasks.workunit.client.0.smithi107.stdout:2/852: readlink d1/d16/d9c/lbc 0 2024-09-21T08:02:53.774 INFO:tasks.workunit.client.0.smithi107.stdout:2/853: creat d1/d2/d6d/f118 x:0 0 0 2024-09-21T08:02:53.776 INFO:tasks.workunit.client.0.smithi107.stdout:3/820: rmdir d8/dc6 0 2024-09-21T08:02:53.776 INFO:tasks.workunit.client.0.smithi107.stdout:3/821: write d8/d21/f10f [1151952,129717] 0 2024-09-21T08:02:53.777 INFO:tasks.workunit.client.0.smithi107.stdout:3/822: chown d8/d2b/d45/dcc/daa/l109 40457 1 2024-09-21T08:02:53.778 INFO:tasks.workunit.client.0.smithi107.stdout:2/854: mknod d1/c119 0 2024-09-21T08:02:53.778 INFO:tasks.workunit.client.0.smithi107.stdout:2/855: stat d1/f10d 0 2024-09-21T08:02:53.781 INFO:tasks.workunit.client.0.smithi107.stdout:3/823: truncate d8/f1b 1404576 0 2024-09-21T08:02:53.781 INFO:tasks.workunit.client.0.smithi107.stdout:3/824: chown d8/d2b/d52/d55/l100 17443 1 2024-09-21T08:02:53.781 INFO:tasks.workunit.client.0.smithi107.stdout:3/825: truncate d8/d25/d42/dae/db1/dd6/f108 638232 0 2024-09-21T08:02:53.785 INFO:tasks.workunit.client.0.smithi107.stdout:2/856: dread d1/d2/d6d/d42/db0/df7/ffe [0,4194304] 0 2024-09-21T08:02:53.786 INFO:tasks.workunit.client.0.smithi107.stdout:2/857: fdatasync d1/d2/f9 0 2024-09-21T08:02:53.786 INFO:tasks.workunit.client.0.smithi107.stdout:3/826: getdents d8/d2b/d91 0 2024-09-21T08:02:53.788 INFO:tasks.workunit.client.0.smithi107.stdout:2/858: truncate d1/d2/fba 3970982 0 2024-09-21T08:02:53.789 INFO:tasks.workunit.client.0.smithi107.stdout:9/968: dwrite d11/d27/d5e/d76/d143/d4d/d5c/d61/db4/d10f/f125 [0,4194304] 0 2024-09-21T08:02:53.789 INFO:tasks.workunit.client.0.smithi107.stdout:9/969: stat d11/d27/d98/d97/f112 0 2024-09-21T08:02:53.789 INFO:tasks.workunit.client.0.smithi107.stdout:9/970: chown d11/d27/d5e/d76/d143/d4d/d5c/d61/db4/dbb/c134 54007 1 2024-09-21T08:02:53.790 INFO:tasks.workunit.client.0.smithi107.stdout:2/859: dread d1/d1e/fe2 [0,4194304] 0 2024-09-21T08:02:53.796 INFO:tasks.workunit.client.0.smithi107.stdout:2/860: creat d1/d2/d6d/d37/d49/f11a x:0 0 0 2024-09-21T08:02:53.797 INFO:tasks.workunit.client.0.smithi107.stdout:2/861: link d1/d2/d6d/d37/d82/fc9 d1/d6/d9e/f11b 0 2024-09-21T08:02:53.799 INFO:tasks.workunit.client.0.smithi107.stdout:2/862: mknod d1/d2/d6d/d37/d82/c11c 0 2024-09-21T08:02:53.799 INFO:tasks.workunit.client.0.smithi107.stdout:2/863: dread - d1/d6/d92/df2/f10e zero size 2024-09-21T08:02:53.799 INFO:tasks.workunit.client.0.smithi107.stdout:2/864: chown d1/d2/d6d/d37/d49/d7f/fd8 18 1 2024-09-21T08:02:53.799 INFO:tasks.workunit.client.0.smithi107.stdout:2/865: fsync d1/d2/d6d/d37/d49/f77 0 2024-09-21T08:02:53.801 INFO:tasks.workunit.client.0.smithi107.stdout:2/866: mkdir d1/d2/d6d/d11d 0 2024-09-21T08:02:53.801 INFO:tasks.workunit.client.0.smithi107.stdout:2/867: readlink d1/d6/d9e/l10a 0 2024-09-21T08:02:53.801 INFO:tasks.workunit.client.0.smithi107.stdout:2/868: write d1/d16/fa5 [1730625,92517] 0 2024-09-21T08:02:53.802 INFO:tasks.workunit.client.0.smithi107.stdout:2/869: symlink d1/d16/d9c/dbb/l11e 0 2024-09-21T08:02:53.802 INFO:tasks.workunit.client.0.smithi107.stdout:2/870: creat d1/d2/d6d/d37/d49/d85/f11f x:0 0 0 2024-09-21T08:02:53.802 INFO:tasks.workunit.client.0.smithi107.stdout:2/871: dread - d1/d2/d6d/d37/d82/f93 zero size 2024-09-21T08:02:53.803 INFO:tasks.workunit.client.0.smithi107.stdout:3/827: dwrite d8/d2b/d91/fe7 [0,4194304] 0 2024-09-21T08:02:53.803 INFO:tasks.workunit.client.0.smithi107.stdout:3/828: truncate d8/d25/d3d/d72/d80/f102 153042 0 2024-09-21T08:02:53.804 INFO:tasks.workunit.client.0.smithi107.stdout:2/872: mknod d1/d2/c120 0 2024-09-21T08:02:53.810 INFO:tasks.workunit.client.0.smithi107.stdout:4/807: sync 2024-09-21T08:02:53.811 INFO:tasks.workunit.client.0.smithi107.stdout:6/823: sync 2024-09-21T08:02:53.811 INFO:tasks.workunit.client.0.smithi107.stdout:8/791: sync 2024-09-21T08:02:53.811 INFO:tasks.workunit.client.0.smithi107.stdout:3/829: mkdir d8/d2b/d91/df2/d113 0 2024-09-21T08:02:53.811 INFO:tasks.workunit.client.0.smithi107.stdout:4/808: creat dc/d13/d40/d5e/d6e/f100 x:0 0 0 2024-09-21T08:02:53.813 INFO:tasks.workunit.client.0.smithi107.stdout:9/971: dwrite d11/f37 [0,4194304] 0 2024-09-21T08:02:53.815 INFO:tasks.workunit.client.0.smithi107.stdout:4/809: truncate dc/d13/d40/d46/f55 443829 0 2024-09-21T08:02:53.816 INFO:tasks.workunit.client.0.smithi107.stdout:2/873: dread d1/dc8/f105 [0,4194304] 0 2024-09-21T08:02:53.817 INFO:tasks.workunit.client.0.smithi107.stdout:2/874: read d1/d1e/fb7 [543252,61426] 0 2024-09-21T08:02:53.817 INFO:tasks.workunit.client.0.smithi107.stdout:9/972: creat d11/d27/d2a/d7f/f153 x:0 0 0 2024-09-21T08:02:53.818 INFO:tasks.workunit.client.0.smithi107.stdout:4/810: mknod dc/d13/d40/d46/d48/d70/dc5/c101 0 2024-09-21T08:02:53.819 INFO:tasks.workunit.client.0.smithi107.stdout:8/792: rmdir d5/d40/d8a/dcb/dee 0 2024-09-21T08:02:53.819 INFO:tasks.workunit.client.0.smithi107.stdout:8/793: chown d5/d40/c42 912 1 2024-09-21T08:02:53.822 INFO:tasks.workunit.client.0.smithi107.stdout:2/875: mkdir d1/d2/d6d/d42/db0/df7/d121 0 2024-09-21T08:02:53.823 INFO:tasks.workunit.client.0.smithi107.stdout:3/830: dread d8/d21/f4c [0,4194304] 0 2024-09-21T08:02:53.824 INFO:tasks.workunit.client.0.smithi107.stdout:9/973: mkdir d11/d27/d5e/d76/d143/d38/d154 0 2024-09-21T08:02:53.824 INFO:tasks.workunit.client.0.smithi107.stdout:9/974: write d11/d27/d5e/d76/d143/d4d/d5c/d61/f150 [1027572,55999] 0 2024-09-21T08:02:53.824 INFO:tasks.workunit.client.0.smithi107.stdout:2/876: dread d1/f10d [0,4194304] 0 2024-09-21T08:02:53.824 INFO:tasks.workunit.client.0.smithi107.stdout:2/877: dread - d1/d2/d6d/d37/d49/d85/f115 zero size 2024-09-21T08:02:53.825 INFO:tasks.workunit.client.0.smithi107.stdout:6/824: dread d2/d3/d7/d54/d5c/fab [0,4194304] 0 2024-09-21T08:02:53.825 INFO:tasks.workunit.client.0.smithi107.stdout:6/825: chown d2/d3/d7/d48/da3/d85/d9b/f100 1 1 2024-09-21T08:02:53.826 INFO:tasks.workunit.client.0.smithi107.stdout:4/811: creat dc/d13/d40/d46/d48/f102 x:0 0 0 2024-09-21T08:02:53.826 INFO:tasks.workunit.client.0.smithi107.stdout:4/812: creat dc/f103 x:0 0 0 2024-09-21T08:02:53.826 INFO:tasks.workunit.client.0.smithi107.stdout:4/813: fdatasync dc/d60/fab 0 2024-09-21T08:02:53.827 INFO:tasks.workunit.client.0.smithi107.stdout:4/814: readlink dc/d13/d40/d5e/l81 0 2024-09-21T08:02:53.827 INFO:tasks.workunit.client.0.smithi107.stdout:9/975: unlink d11/d27/fa5 0 2024-09-21T08:02:53.829 INFO:tasks.workunit.client.0.smithi107.stdout:2/878: mkdir d1/d16/d35/d10c/d122 0 2024-09-21T08:02:53.829 INFO:tasks.workunit.client.0.smithi107.stdout:3/831: dread d8/d2b/d45/dcc/f5c [0,4194304] 0 2024-09-21T08:02:53.832 INFO:tasks.workunit.client.0.smithi107.stdout:4/815: creat dc/d13/d40/d5e/d98/dbe/f104 x:0 0 0 2024-09-21T08:02:53.834 INFO:tasks.workunit.client.0.smithi107.stdout:9/976: mkdir d11/d27/d2a/d155 0 2024-09-21T08:02:53.834 INFO:tasks.workunit.client.0.smithi107.stdout:9/977: creat d11/d24/d26/f156 x:0 0 0 2024-09-21T08:02:53.835 INFO:tasks.workunit.client.0.smithi107.stdout:2/879: rmdir d1/d16/d9c/dbb 39 2024-09-21T08:02:53.839 INFO:tasks.workunit.client.0.smithi107.stdout:6/826: dwrite d2/d3/d7/d23/ff0 [0,4194304] 0 2024-09-21T08:02:53.839 INFO:tasks.workunit.client.0.smithi107.stdout:3/832: rename d8/d25/d42/dae/db1/fbb to d8/d2b/d52/d71/db3/dc2/f114 0 2024-09-21T08:02:53.840 INFO:tasks.workunit.client.0.smithi107.stdout:3/833: fsync d8/d2b/d45/dcc/fc7 0 2024-09-21T08:02:53.842 INFO:tasks.workunit.client.0.smithi107.stdout:4/816: symlink dc/d13/d40/dcc/l105 0 2024-09-21T08:02:53.844 INFO:tasks.workunit.client.0.smithi107.stdout:2/880: mknod d1/d2/d6d/d11d/c123 0 2024-09-21T08:02:53.850 INFO:tasks.workunit.client.0.smithi107.stdout:6/827: truncate d2/d2e/d97/f49 81990 0 2024-09-21T08:02:53.853 INFO:tasks.workunit.client.0.smithi107.stdout:4/817: mkdir dc/d13/d40/d5e/d98/dbe/d106 0 2024-09-21T08:02:53.855 INFO:tasks.workunit.client.0.smithi107.stdout:2/881: truncate d1/d16/f6b 3841615 0 2024-09-21T08:02:53.858 INFO:tasks.workunit.client.0.smithi107.stdout:4/818: symlink dc/d60/l107 0 2024-09-21T08:02:53.861 INFO:tasks.workunit.client.0.smithi107.stdout:4/819: rename dc/d13/d40/d5e/d77/fa0 to dc/d13/d40/d46/de7/f108 0 2024-09-21T08:02:53.862 INFO:tasks.workunit.client.0.smithi107.stdout:4/820: dread - dc/d13/d40/d46/d48/f9d zero size 2024-09-21T08:02:53.862 INFO:tasks.workunit.client.0.smithi107.stdout:6/828: dread d2/d3/d7/d48/da3/d85/d9d/dcf/fff [0,4194304] 0 2024-09-21T08:02:53.865 INFO:tasks.workunit.client.0.smithi107.stdout:3/834: dwrite d8/d44/f62 [0,4194304] 0 2024-09-21T08:02:53.866 INFO:tasks.workunit.client.0.smithi107.stdout:6/829: rmdir d2/d3/d7/d24/d41/d50 39 2024-09-21T08:02:53.866 INFO:tasks.workunit.client.0.smithi107.stdout:6/830: chown d2/d3/d7/d48/da3/d85/d9d/dcf 1878099 1 2024-09-21T08:02:53.867 INFO:tasks.workunit.client.0.smithi107.stdout:6/831: mkdir d2/d2e/db2/d110 0 2024-09-21T08:02:53.867 INFO:tasks.workunit.client.0.smithi107.stdout:6/832: truncate d2/d3/d7/d3f/f60 1827192 0 2024-09-21T08:02:53.867 INFO:tasks.workunit.client.0.smithi107.stdout:6/833: creat d2/d2e/db2/d110/f111 x:0 0 0 2024-09-21T08:02:53.868 INFO:tasks.workunit.client.0.smithi107.stdout:6/834: write d2/d3/d7/d54/d5c/f8c [676741,128291] 0 2024-09-21T08:02:53.869 INFO:tasks.workunit.client.0.smithi107.stdout:6/835: unlink d2/d2e/d97/l103 0 2024-09-21T08:02:53.870 INFO:tasks.workunit.client.0.smithi107.stdout:6/836: creat d2/d3/d7/d48/da3/d85/d9d/f112 x:0 0 0 2024-09-21T08:02:53.871 INFO:tasks.workunit.client.0.smithi107.stdout:6/837: unlink d2/d3/d7/d79/fb5 0 2024-09-21T08:02:53.872 INFO:tasks.workunit.client.0.smithi107.stdout:6/838: creat d2/df4/f113 x:0 0 0 2024-09-21T08:02:53.872 INFO:tasks.workunit.client.0.smithi107.stdout:6/839: chown d2/d3/d7/d48/da3/d85/d9d/dcf/dd8/cfa 1 1 2024-09-21T08:02:53.873 INFO:tasks.workunit.client.0.smithi107.stdout:1/790: sync 2024-09-21T08:02:53.873 INFO:tasks.workunit.client.0.smithi107.stdout:1/791: read - d0/d29/d4d/d84/dc5/da9/fda zero size 2024-09-21T08:02:53.873 INFO:tasks.workunit.client.0.smithi107.stdout:1/792: symlink d0/d29/d4d/d84/dc5/da9/dc7/l105 0 2024-09-21T08:02:53.874 INFO:tasks.workunit.client.0.smithi107.stdout:7/655: sync 2024-09-21T08:02:53.874 INFO:tasks.workunit.client.0.smithi107.stdout:0/821: sync 2024-09-21T08:02:53.874 INFO:tasks.workunit.client.0.smithi107.stdout:0/822: fdatasync d1/d5/d25/d3d/d20/d29/d55/d91/fbc 0 2024-09-21T08:02:53.874 INFO:tasks.workunit.client.0.smithi107.stdout:7/656: mknod d7/d22/d3d/ce3 0 2024-09-21T08:02:53.875 INFO:tasks.workunit.client.0.smithi107.stdout:0/823: mknod d1/d5/d25/d3d/d20/d29/d5c/c111 0 2024-09-21T08:02:53.876 INFO:tasks.workunit.client.0.smithi107.stdout:2/882: dwrite d1/d16/f17 [0,4194304] 0 2024-09-21T08:02:53.878 INFO:tasks.workunit.client.0.smithi107.stdout:0/824: mknod d1/d5/d25/d3d/d20/d29/d55/d91/d9a/c112 0 2024-09-21T08:02:53.878 INFO:tasks.workunit.client.0.smithi107.stdout:0/825: chown d1/d6f/d80/la2 281044366 1 2024-09-21T08:02:53.878 INFO:tasks.workunit.client.0.smithi107.stdout:7/657: rmdir d7/d38 39 2024-09-21T08:02:53.879 INFO:tasks.workunit.client.0.smithi107.stdout:7/658: fdatasync d7/d22/d37/d4b/db0/f81 0 2024-09-21T08:02:53.880 INFO:tasks.workunit.client.0.smithi107.stdout:7/659: truncate d7/d22/d37/d5a/f66 2742547 0 2024-09-21T08:02:53.881 INFO:tasks.workunit.client.0.smithi107.stdout:6/840: write d2/d3/d7/d48/da3/d85/d9d/dcf/fff [743843,4790] 0 2024-09-21T08:02:53.881 INFO:tasks.workunit.client.0.smithi107.stdout:7/660: creat d7/d22/d3a/d49/fe4 x:0 0 0 2024-09-21T08:02:53.884 INFO:tasks.workunit.client.0.smithi107.stdout:4/821: rename dc/d13/d40/d46/f55 to dc/d13/d40/d5e/d77/d99/daa/f109 0 2024-09-21T08:02:53.884 INFO:tasks.workunit.client.0.smithi107.stdout:4/822: truncate dc/d60/d8c/fa6 492373 0 2024-09-21T08:02:53.885 INFO:tasks.workunit.client.0.smithi107.stdout:2/883: dread d1/f33 [0,4194304] 0 2024-09-21T08:02:53.885 INFO:tasks.workunit.client.0.smithi107.stdout:2/884: write d1/f3 [4566474,2672] 0 2024-09-21T08:02:53.886 INFO:tasks.workunit.client.0.smithi107.stdout:1/793: rename d0/d29/d4d/d84/dc5/cbc to d0/d19/d2b/d86/dc2/c106 0 2024-09-21T08:02:53.886 INFO:tasks.workunit.client.0.smithi107.stdout:1/794: chown d0/d19/d2b/d4b/d61/fbb 2991 1 2024-09-21T08:02:53.888 INFO:tasks.workunit.client.0.smithi107.stdout:7/661: rename d7/d22/d3d/f6e to d7/d38/fe5 0 2024-09-21T08:02:53.888 INFO:tasks.workunit.client.0.smithi107.stdout:7/662: truncate d7/d10/d28/fdd 189087 0 2024-09-21T08:02:53.897 INFO:tasks.workunit.client.0.smithi107.stdout:1/795: read d0/d29/d4d/d84/dc5/f41 [3094891,101002] 0 2024-09-21T08:02:53.897 INFO:tasks.workunit.client.0.smithi107.stdout:4/823: dread dc/d64/f79 [0,4194304] 0 2024-09-21T08:02:53.898 INFO:tasks.workunit.client.0.smithi107.stdout:1/796: dread d0/d19/d2b/d4b/d44/d72/d36/d8e/fd3 [0,4194304] 0 2024-09-21T08:02:53.898 INFO:tasks.workunit.client.0.smithi107.stdout:1/797: write d0/d29/f3f [1258991,36181] 0 2024-09-21T08:02:53.899 INFO:tasks.workunit.client.0.smithi107.stdout:4/824: mknod dc/d13/d40/d5e/d98/dbe/d106/c10a 0 2024-09-21T08:02:53.900 INFO:tasks.workunit.client.0.smithi107.stdout:2/885: write d1/d1e/f5c [449330,124641] 0 2024-09-21T08:02:53.900 INFO:tasks.workunit.client.0.smithi107.stdout:2/886: chown d1/d6/d92/dce/f117 221252612 1 2024-09-21T08:02:53.901 INFO:tasks.workunit.client.0.smithi107.stdout:1/798: creat d0/d19/d2b/d4b/d44/d9a/db6/f107 x:0 0 0 2024-09-21T08:02:53.904 INFO:tasks.workunit.client.0.smithi107.stdout:4/825: truncate dc/d13/f57 3370771 0 2024-09-21T08:02:53.904 INFO:tasks.workunit.client.0.smithi107.stdout:4/826: stat dc/d13/d40/d46/d48/d70/dc5/d90 0 2024-09-21T08:02:53.907 INFO:tasks.workunit.client.0.smithi107.stdout:2/887: symlink d1/d16/d35/l124 0 2024-09-21T08:02:53.908 INFO:tasks.workunit.client.0.smithi107.stdout:1/799: link d0/d19/l21 d0/d29/d4d/d84/dc3/l108 0 2024-09-21T08:02:53.911 INFO:tasks.workunit.client.0.smithi107.stdout:4/827: creat dc/d13/d40/d46/de7/db8/f10b x:0 0 0 2024-09-21T08:02:53.912 INFO:tasks.workunit.client.0.smithi107.stdout:4/828: write dc/fe4 [167077,31107] 0 2024-09-21T08:02:53.912 INFO:tasks.workunit.client.0.smithi107.stdout:4/829: fsync dc/d13/f72 0 2024-09-21T08:02:53.912 INFO:tasks.workunit.client.0.smithi107.stdout:4/830: fsync dc/d64/feb 0 2024-09-21T08:02:53.912 INFO:tasks.workunit.client.0.smithi107.stdout:4/831: chown dc/d13/d40/dcc/l105 57967494 1 2024-09-21T08:02:53.913 INFO:tasks.workunit.client.0.smithi107.stdout:1/800: getdents d0/d19/d2b/d86/d95 0 2024-09-21T08:02:53.920 INFO:tasks.workunit.client.0.smithi107.stdout:1/801: rename d0/d19/d2b/d4b/d44/d55/d64/lab to d0/d29/d4d/d84/dc3/l109 0 2024-09-21T08:02:53.923 INFO:tasks.workunit.client.0.smithi107.stdout:4/832: rmdir dc/d64 39 2024-09-21T08:02:53.926 INFO:tasks.workunit.client.0.smithi107.stdout:2/888: dwrite d1/d2/d6d/d42/db0/fc4 [0,4194304] 0 2024-09-21T08:02:53.928 INFO:tasks.workunit.client.0.smithi107.stdout:1/802: mknod d0/d19/d2b/d86/da4/c10a 0 2024-09-21T08:02:53.929 INFO:tasks.workunit.client.0.smithi107.stdout:4/833: rmdir dc/d13/d5a/dea 0 2024-09-21T08:02:53.937 INFO:tasks.workunit.client.0.smithi107.stdout:2/889: mkdir d1/d2/d125 0 2024-09-21T08:02:53.937 INFO:tasks.workunit.client.0.smithi107.stdout:2/890: dread - d1/d6/d92/df2/f103 zero size 2024-09-21T08:02:53.940 INFO:tasks.workunit.client.0.smithi107.stdout:1/803: mkdir d0/d29/d4d/d84/dc3/d10b 0 2024-09-21T08:02:53.940 INFO:tasks.workunit.client.0.smithi107.stdout:1/804: write d0/dc6/f100 [395668,48508] 0 2024-09-21T08:02:53.941 INFO:tasks.workunit.client.0.smithi107.stdout:4/834: mkdir dc/d13/d40/d46/d48/d10c 0 2024-09-21T08:02:53.941 INFO:tasks.workunit.client.0.smithi107.stdout:4/835: read dc/d13/d40/f43 [2056311,68768] 0 2024-09-21T08:02:53.941 INFO:tasks.workunit.client.0.smithi107.stdout:4/836: fdatasync dc/d13/d40/f43 0 2024-09-21T08:02:53.941 INFO:tasks.workunit.client.0.smithi107.stdout:4/837: dread - dc/fd9 zero size 2024-09-21T08:02:53.943 INFO:tasks.workunit.client.0.smithi107.stdout:2/891: rename d1/d2/l29 to d1/d16/d35/l126 0 2024-09-21T08:02:53.944 INFO:tasks.workunit.client.0.smithi107.stdout:2/892: fdatasync d1/d6/f2e 0 2024-09-21T08:02:53.944 INFO:tasks.workunit.client.0.smithi107.stdout:2/893: chown d1/d2/d6d/d37/d49/d85 4 1 2024-09-21T08:02:53.944 INFO:tasks.workunit.client.0.smithi107.stdout:2/894: chown d1/d2/d6d/d42/f48 9031 1 2024-09-21T08:02:53.946 INFO:tasks.workunit.client.0.smithi107.stdout:4/838: creat dc/d13/d40/d46/d48/d70/def/f10d x:0 0 0 2024-09-21T08:02:53.948 INFO:tasks.workunit.client.0.smithi107.stdout:4/839: symlink dc/d13/l10e 0 2024-09-21T08:02:53.953 INFO:tasks.workunit.client.0.smithi107.stdout:4/840: symlink dc/d13/d40/d46/d48/l10f 0 2024-09-21T08:02:53.965 INFO:tasks.workunit.client.0.smithi107.stdout:4/841: write dc/d13/d5a/f78 [1371950,66574] 0 2024-09-21T08:02:53.965 INFO:tasks.workunit.client.0.smithi107.stdout:4/842: dread - dc/d13/d40/d5e/fa5 zero size 2024-09-21T08:02:53.969 INFO:tasks.workunit.client.0.smithi107.stdout:2/895: dread d1/f3 [0,4194304] 0 2024-09-21T08:02:53.971 INFO:tasks.workunit.client.0.smithi107.stdout:1/805: dwrite d0/d29/d4d/d84/dc5/da9/dc7/db5/fd4 [4194304,4194304] 0 2024-09-21T08:02:53.971 INFO:tasks.workunit.client.0.smithi107.stdout:7/663: unlink d7/d38/fe5 0 2024-09-21T08:02:53.974 INFO:tasks.workunit.client.0.smithi107.stdout:2/896: link d1/d2/d6d/d37/d49/d85/fd3 d1/d2/d125/f127 0 2024-09-21T08:02:53.977 INFO:tasks.workunit.client.0.smithi107.stdout:1/806: truncate d0/d19/f33 982802 0 2024-09-21T08:02:53.983 INFO:tasks.workunit.client.0.smithi107.stdout:7/664: creat d7/d22/d3b/fe6 x:0 0 0 2024-09-21T08:02:54.003 INFO:tasks.workunit.client.0.smithi107.stdout:4/843: dwrite dc/d13/f2a [0,4194304] 0 2024-09-21T08:02:54.009 INFO:tasks.workunit.client.0.smithi107.stdout:7/665: dwrite d7/d10/d28/fdd [0,4194304] 0 2024-09-21T08:02:54.009 INFO:tasks.workunit.client.0.smithi107.stdout:1/807: dwrite d0/d29/d4d/d84/feb [0,4194304] 0 2024-09-21T08:02:54.009 INFO:tasks.workunit.client.0.smithi107.stdout:2/897: dwrite d1/d2/d6d/d37/d49/d7f/f10b [0,4194304] 0 2024-09-21T08:02:54.016 INFO:tasks.workunit.client.0.smithi107.stdout:1/808: rename d0/d19/d2b/d4b/fd to d0/d29/da1/f10c 0 2024-09-21T08:02:54.023 INFO:tasks.workunit.client.0.smithi107.stdout:2/898: dread d1/fc5 [0,4194304] 0 2024-09-21T08:02:54.028 INFO:tasks.workunit.client.0.smithi107.stdout:4/844: dwrite dc/d13/d40/f45 [0,4194304] 0 2024-09-21T08:02:54.031 INFO:tasks.workunit.client.0.smithi107.stdout:2/899: rmdir d1/d6/d92 39 2024-09-21T08:02:54.038 INFO:tasks.workunit.client.0.smithi107.stdout:7/666: dwrite d7/d22/d3b/fb6 [0,4194304] 0 2024-09-21T08:02:54.038 INFO:tasks.workunit.client.0.smithi107.stdout:7/667: read d7/d10/f55 [348470,103098] 0 2024-09-21T08:02:54.041 INFO:tasks.workunit.client.0.smithi107.stdout:2/900: symlink d1/d16/l128 0 2024-09-21T08:02:54.044 INFO:tasks.workunit.client.0.smithi107.stdout:7/668: mknod d7/d10/d28/ce7 0 2024-09-21T08:02:54.045 INFO:tasks.workunit.client.0.smithi107.stdout:7/669: fsync d7/d22/d37/d4b/f9d 0 2024-09-21T08:02:54.045 INFO:tasks.workunit.client.0.smithi107.stdout:7/670: chown d7/d22/d3a/d49/f6f 1084980 1 2024-09-21T08:02:54.046 INFO:tasks.workunit.client.0.smithi107.stdout:2/901: mknod d1/d2/d6d/d42/db0/c129 0 2024-09-21T08:02:54.050 INFO:tasks.workunit.client.0.smithi107.stdout:4/845: dwrite dc/d64/feb [0,4194304] 0 2024-09-21T08:02:54.057 INFO:tasks.workunit.client.0.smithi107.stdout:2/902: write d1/d2/d6d/d42/d76/fa7 [439652,49566] 0 2024-09-21T08:02:54.058 INFO:tasks.workunit.client.0.smithi107.stdout:4/846: dread dc/d13/d40/d5e/d77/d99/daa/fb4 [0,4194304] 0 2024-09-21T08:02:54.059 INFO:tasks.workunit.client.0.smithi107.stdout:4/847: mkdir dc/d13/d5a/d110 0 2024-09-21T08:02:54.060 INFO:tasks.workunit.client.0.smithi107.stdout:4/848: symlink dc/d13/d40/d46/d48/l111 0 2024-09-21T08:02:54.060 INFO:tasks.workunit.client.0.smithi107.stdout:4/849: stat dc/d13/d40/d5e/d77/fb7 0 2024-09-21T08:02:54.073 INFO:tasks.workunit.client.0.smithi107.stdout:7/671: dwrite d7/d22/d37/d4b/db0/d4f/fb3 [0,4194304] 0 2024-09-21T08:02:54.073 INFO:tasks.workunit.client.0.smithi107.stdout:4/850: dwrite dc/d13/d40/d46/d48/f9d [0,4194304] 0 2024-09-21T08:02:54.077 INFO:tasks.workunit.client.0.smithi107.stdout:7/672: rename d7/d22/d3d/f51 to d7/d22/d3d/d8a/fe8 0 2024-09-21T08:02:54.077 INFO:tasks.workunit.client.0.smithi107.stdout:7/673: write d7/d22/fb4 [4802608,56957] 0 2024-09-21T08:02:54.083 INFO:tasks.workunit.client.0.smithi107.stdout:4/851: dread dc/d13/f57 [0,4194304] 0 2024-09-21T08:02:54.083 INFO:tasks.workunit.client.0.smithi107.stdout:4/852: chown dc/d13/d40/d46/d48/d70/fe6 52675 1 2024-09-21T08:02:54.085 INFO:tasks.workunit.client.0.smithi107.stdout:4/853: link dc/d13/d40/d5e/d6e/f100 dc/d13/d40/d5e/d6e/f112 0 2024-09-21T08:02:54.085 INFO:tasks.workunit.client.0.smithi107.stdout:4/854: write dc/d13/d40/f42 [1203710,88343] 0 2024-09-21T08:02:54.085 INFO:tasks.workunit.client.0.smithi107.stdout:4/855: truncate dc/d13/d40/d46/d48/d70/dc5/d8a/fee 387356 0 2024-09-21T08:02:54.085 INFO:tasks.workunit.client.0.smithi107.stdout:4/856: dread - dc/d13/d40/d5e/d98/dbe/f104 zero size 2024-09-21T08:02:54.085 INFO:tasks.workunit.client.0.smithi107.stdout:4/857: creat dc/d13/d40/d46/d48/d70/dc5/d8a/f113 x:0 0 0 2024-09-21T08:02:54.085 INFO:tasks.workunit.client.0.smithi107.stdout:4/858: write dc/d13/d40/d5e/d77/fe5 [82789,107367] 0 2024-09-21T08:02:54.088 INFO:tasks.workunit.client.0.smithi107.stdout:4/859: mkdir dc/d13/d40/d46/d48/d70/dc5/d90/d114 0 2024-09-21T08:02:54.095 INFO:tasks.workunit.client.0.smithi107.stdout:4/860: dread fa [0,4194304] 0 2024-09-21T08:02:54.097 INFO:tasks.workunit.client.0.smithi107.stdout:4/861: creat dc/de8/f115 x:0 0 0 2024-09-21T08:02:54.098 INFO:tasks.workunit.client.0.smithi107.stdout:4/862: stat dc/c33 0 2024-09-21T08:02:54.098 INFO:tasks.workunit.client.0.smithi107.stdout:4/863: chown dc/d13/d40/d46/c74 904178 1 2024-09-21T08:02:54.106 INFO:tasks.workunit.client.0.smithi107.stdout:7/674: dwrite d7/d22/d3d/f7c [0,4194304] 0 2024-09-21T08:02:54.109 INFO:tasks.workunit.client.0.smithi107.stdout:7/675: mknod d7/d10/d28/ce9 0 2024-09-21T08:02:54.115 INFO:tasks.workunit.client.0.smithi107.stdout:4/864: dwrite dc/d13/d40/f45 [0,4194304] 0 2024-09-21T08:02:54.121 INFO:tasks.workunit.client.0.smithi107.stdout:4/865: dread dc/d13/d40/d46/fc0 [0,4194304] 0 2024-09-21T08:02:54.125 INFO:tasks.workunit.client.0.smithi107.stdout:7/676: dwrite d7/d22/d37/d4b/db0/f81 [0,4194304] 0 2024-09-21T08:02:54.129 INFO:tasks.workunit.client.0.smithi107.stdout:4/866: mkdir dc/d13/d40/d116 0 2024-09-21T08:02:54.129 INFO:tasks.workunit.client.0.smithi107.stdout:4/867: stat dc/d13/d40/d46/d48/f102 0 2024-09-21T08:02:54.129 INFO:tasks.workunit.client.0.smithi107.stdout:4/868: chown dc/d60/d8c/c7a 191582 1 2024-09-21T08:02:54.135 INFO:tasks.workunit.client.0.smithi107.stdout:7/677: creat d7/d22/d37/d40/d4d/dda/fea x:0 0 0 2024-09-21T08:02:54.137 INFO:tasks.workunit.client.0.smithi107.stdout:4/869: creat dc/d13/d40/d46/d48/d70/f117 x:0 0 0 2024-09-21T08:02:54.137 INFO:tasks.workunit.client.0.smithi107.stdout:7/678: rmdir d7/dc3 39 2024-09-21T08:02:54.139 INFO:tasks.workunit.client.0.smithi107.stdout:4/870: creat dc/d64/d6b/dcf/f118 x:0 0 0 2024-09-21T08:02:54.141 INFO:tasks.workunit.client.0.smithi107.stdout:4/871: creat dc/d60/f119 x:0 0 0 2024-09-21T08:02:54.163 INFO:tasks.workunit.client.0.smithi107.stdout:4/872: dwrite dc/fd9 [0,4194304] 0 2024-09-21T08:02:54.163 INFO:tasks.workunit.client.0.smithi107.stdout:4/873: fdatasync dc/d13/d40/d46/f82 0 2024-09-21T08:02:54.164 INFO:tasks.workunit.client.0.smithi107.stdout:4/874: symlink dc/d13/d40/d116/l11a 0 2024-09-21T08:02:54.164 INFO:tasks.workunit.client.0.smithi107.stdout:4/875: readlink dc/d13/d40/d46/d48/l111 0 2024-09-21T08:02:54.168 INFO:tasks.workunit.client.0.smithi107.stdout:4/876: getdents dc/d13/d40/d116 0 2024-09-21T08:02:54.168 INFO:tasks.workunit.client.0.smithi107.stdout:4/877: readlink dc/d13/d5a/d9b/dbc/lbd 0 2024-09-21T08:02:54.168 INFO:tasks.workunit.client.0.smithi107.stdout:4/878: chown dc/fd0 34 1 2024-09-21T08:02:54.170 INFO:tasks.workunit.client.0.smithi107.stdout:4/879: getdents dc/d13/d40/d46/d48/d70/def 0 2024-09-21T08:02:54.173 INFO:tasks.workunit.client.0.smithi107.stdout:4/880: rename dc/d13/d40/d46/d48/d70/dc5/d8a/fee to dc/d13/d40/d46/d48/d10c/f11b 0 2024-09-21T08:02:54.174 INFO:tasks.workunit.client.0.smithi107.stdout:4/881: mkdir dc/d13/d40/d5e/d77/d99/d11c 0 2024-09-21T08:02:54.189 INFO:tasks.workunit.client.0.smithi107.stdout:4/882: dwrite dc/d64/d6b/dcf/ffa [0,4194304] 0 2024-09-21T08:02:54.195 INFO:tasks.workunit.client.0.smithi107.stdout:4/883: unlink dc/d13/d40/d46/d48/l85 0 2024-09-21T08:02:54.195 INFO:tasks.workunit.client.0.smithi107.stdout:4/884: creat dc/d64/d6b/dcf/f11d x:0 0 0 2024-09-21T08:02:54.202 INFO:tasks.workunit.client.0.smithi107.stdout:4/885: dread dc/d13/d40/f43 [0,4194304] 0 2024-09-21T08:02:54.203 INFO:tasks.workunit.client.0.smithi107.stdout:4/886: fsync dc/d13/d40/f4a 0 2024-09-21T08:02:54.205 INFO:tasks.workunit.client.0.smithi107.stdout:4/887: mknod dc/d13/d40/d46/d48/d70/def/c11e 0 2024-09-21T08:02:54.213 INFO:tasks.workunit.client.0.smithi107.stdout:4/888: dread dc/d13/d40/d80/f93 [0,4194304] 0 2024-09-21T08:02:54.222 INFO:tasks.workunit.client.0.smithi107.stdout:4/889: dread dc/d13/d40/d80/fce [0,4194304] 0 2024-09-21T08:02:54.223 INFO:tasks.workunit.client.0.smithi107.stdout:4/890: truncate dc/d13/f72 3674764 0 2024-09-21T08:02:54.388 INFO:tasks.workunit.client.0.smithi107.stdout:8/794: sync 2024-09-21T08:02:54.390 INFO:tasks.workunit.client.0.smithi107.stdout:8/795: mkdir d5/d38/d67/d7d/d10f 0 2024-09-21T08:02:54.390 INFO:tasks.workunit.client.0.smithi107.stdout:8/796: truncate d5/d1d/fb1 666396 0 2024-09-21T08:02:54.391 INFO:tasks.workunit.client.0.smithi107.stdout:8/797: unlink d5/d1d/f102 0 2024-09-21T08:02:54.399 INFO:tasks.workunit.client.0.smithi107.stdout:8/798: write d5/d1d/f1e [4090378,22661] 0 2024-09-21T08:02:54.402 INFO:tasks.workunit.client.0.smithi107.stdout:8/799: symlink d5/d38/d56/d52/d7a/l110 0 2024-09-21T08:02:54.404 INFO:tasks.workunit.client.0.smithi107.stdout:8/800: mkdir d5/d2e/dab/d111 0 2024-09-21T08:02:54.405 INFO:tasks.workunit.client.0.smithi107.stdout:8/801: symlink d5/d23/l112 0 2024-09-21T08:02:54.425 INFO:tasks.workunit.client.0.smithi107.stdout:8/802: dwrite d5/d40/fba [4194304,4194304] 0 2024-09-21T08:02:54.425 INFO:tasks.workunit.client.0.smithi107.stdout:8/803: dread - d5/d40/f9b zero size 2024-09-21T08:02:54.425 INFO:tasks.workunit.client.0.smithi107.stdout:8/804: chown d5/d2e/d94/fbf 89 1 2024-09-21T08:02:54.426 INFO:tasks.workunit.client.0.smithi107.stdout:8/805: mkdir d5/d38/d67/d7d/d91/d113 0 2024-09-21T08:02:54.433 INFO:tasks.workunit.client.0.smithi107.stdout:8/806: dread d5/f72 [0,4194304] 0 2024-09-21T08:02:54.448 INFO:tasks.workunit.client.0.smithi107.stdout:8/807: dwrite d5/d2e/d89/f105 [0,4194304] 0 2024-09-21T08:02:54.450 INFO:tasks.workunit.client.0.smithi107.stdout:8/808: creat d5/d44/d47/f114 x:0 0 0 2024-09-21T08:02:54.453 INFO:tasks.workunit.client.0.smithi107.stdout:8/809: dread d5/d40/f8d [0,4194304] 0 2024-09-21T08:02:54.453 INFO:tasks.workunit.client.0.smithi107.stdout:8/810: write d5/d38/f3f [653374,123820] 0 2024-09-21T08:02:54.456 INFO:tasks.workunit.client.0.smithi107.stdout:8/811: rename d5/d44/de0 to d5/d115 0 2024-09-21T08:02:54.456 INFO:tasks.workunit.client.0.smithi107.stdout:8/812: stat d5/d2e/d7c/d9a/d98/fcf 0 2024-09-21T08:02:54.456 INFO:tasks.workunit.client.0.smithi107.stdout:8/813: stat d5/d38/d56/da3 0 2024-09-21T08:02:54.456 INFO:tasks.workunit.client.0.smithi107.stdout:8/814: dread - d5/d44/d47/f114 zero size 2024-09-21T08:02:54.457 INFO:tasks.workunit.client.0.smithi107.stdout:8/815: write d5/d38/d56/da3/fbd [1574697,17352] 0 2024-09-21T08:02:54.457 INFO:tasks.workunit.client.0.smithi107.stdout:8/816: chown d5/d2e/d7c/d9a/f53 5384 1 2024-09-21T08:02:54.457 INFO:tasks.workunit.client.0.smithi107.stdout:8/817: mkdir d5/d40/d8a/ded/d116 0 2024-09-21T08:02:54.457 INFO:tasks.workunit.client.0.smithi107.stdout:8/818: chown d5/d2e/d7c/d9a/fc0 306002 1 2024-09-21T08:02:54.458 INFO:tasks.workunit.client.0.smithi107.stdout:8/819: mkdir d5/d44/d117 0 2024-09-21T08:02:54.458 INFO:tasks.workunit.client.0.smithi107.stdout:8/820: truncate d5/d44/d47/f114 317950 0 2024-09-21T08:02:54.459 INFO:tasks.workunit.client.0.smithi107.stdout:8/821: rename d5/d40/c42 to d5/d38/c118 0 2024-09-21T08:02:54.459 INFO:tasks.workunit.client.0.smithi107.stdout:8/822: chown d5/d115 260441 1 2024-09-21T08:02:54.460 INFO:tasks.workunit.client.0.smithi107.stdout:8/823: rmdir d5/d44/d117 0 2024-09-21T08:02:54.462 INFO:tasks.workunit.client.0.smithi107.stdout:8/824: truncate d5/d2e/d94/ff5 1218581 0 2024-09-21T08:02:54.478 INFO:tasks.workunit.client.0.smithi107.stdout:8/825: dwrite d5/db9/fc3 [4194304,4194304] 0 2024-09-21T08:02:54.480 INFO:tasks.workunit.client.0.smithi107.stdout:8/826: rename d5/f19 to d5/d38/d56/f119 0 2024-09-21T08:02:54.481 INFO:tasks.workunit.client.0.smithi107.stdout:8/827: rename d5/d38/lbe to d5/d38/d56/d54/dce/dfe/l11a 0 2024-09-21T08:02:54.483 INFO:tasks.workunit.client.0.smithi107.stdout:8/828: mknod d5/d38/d56/d54/dce/dfe/c11b 0 2024-09-21T08:02:54.483 INFO:tasks.workunit.client.0.smithi107.stdout:8/829: stat d5/d38/d56/f119 0 2024-09-21T08:02:54.484 INFO:tasks.workunit.client.0.smithi107.stdout:8/830: link d5/d23/l41 d5/d44/db7/l11c 0 2024-09-21T08:02:54.485 INFO:tasks.workunit.client.0.smithi107.stdout:8/831: truncate d5/d44/d47/f4e 1548822 0 2024-09-21T08:02:54.485 INFO:tasks.workunit.client.0.smithi107.stdout:8/832: fsync d5/d2e/d94/feb 0 2024-09-21T08:02:54.485 INFO:tasks.workunit.client.0.smithi107.stdout:8/833: chown d5/d2e/d7c/d9a/d9e/dcc/cd9 92839751 1 2024-09-21T08:02:54.485 INFO:tasks.workunit.client.0.smithi107.stdout:8/834: getdents d5/d38/d67/d7d/d10f 0 2024-09-21T08:02:54.486 INFO:tasks.workunit.client.0.smithi107.stdout:8/835: truncate d5/d40/f43 1681058 0 2024-09-21T08:02:54.486 INFO:tasks.workunit.client.0.smithi107.stdout:8/836: stat d5/d2e/d7c/d9a/f70 0 2024-09-21T08:02:54.487 INFO:tasks.workunit.client.0.smithi107.stdout:8/837: mkdir d5/d2e/d7c/d9a/d98/d11d 0 2024-09-21T08:02:54.488 INFO:tasks.workunit.client.0.smithi107.stdout:8/838: mkdir d5/d2e/d94/d11e 0 2024-09-21T08:02:54.488 INFO:tasks.workunit.client.0.smithi107.stdout:8/839: creat d5/d44/d5d/f11f x:0 0 0 2024-09-21T08:02:54.490 INFO:tasks.workunit.client.0.smithi107.stdout:8/840: link d5/db9/l6b d5/d40/d8a/dcb/dff/l120 0 2024-09-21T08:02:54.511 INFO:tasks.workunit.client.0.smithi107.stdout:8/841: dwrite d5/d1d/f6f [0,4194304] 0 2024-09-21T08:02:54.515 INFO:tasks.workunit.client.0.smithi107.stdout:8/842: unlink d5/d2e/f4a 0 2024-09-21T08:02:54.515 INFO:tasks.workunit.client.0.smithi107.stdout:8/843: write d5/d38/d56/d52/fdf [275388,1952] 0 2024-09-21T08:02:54.515 INFO:tasks.workunit.client.0.smithi107.stdout:8/844: write d5/f14 [2611169,38428] 0 2024-09-21T08:02:54.515 INFO:tasks.workunit.client.0.smithi107.stdout:8/845: truncate d5/f8e 625213 0 2024-09-21T08:02:54.516 INFO:tasks.workunit.client.0.smithi107.stdout:8/846: mkdir d5/d44/d47/d121 0 2024-09-21T08:02:54.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:54 smithi129 ceph-mon[34472]: pgmap v19: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 255 MiB/s rd, 296 MiB/s wr, 497 op/s 2024-09-21T08:02:54.523 INFO:tasks.workunit.client.0.smithi107.stdout:8/847: link d5/d2e/d7c/d9a/d9e/la8 d5/d2e/d7c/d9a/d9e/dcc/l122 0 2024-09-21T08:02:54.543 INFO:tasks.workunit.client.0.smithi107.stdout:8/848: dwrite d5/d40/f9b [0,4194304] 0 2024-09-21T08:02:54.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:54 smithi107 ceph-mon[27622]: pgmap v19: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 255 MiB/s rd, 296 MiB/s wr, 497 op/s 2024-09-21T08:02:54.587 INFO:tasks.workunit.client.0.smithi107.stdout:8/849: mkdir d5/d2e/dab/d111/d123 0 2024-09-21T08:02:54.587 INFO:tasks.workunit.client.0.smithi107.stdout:8/850: fsync d5/d38/d56/da3/fbd 0 2024-09-21T08:02:54.587 INFO:tasks.workunit.client.0.smithi107.stdout:8/851: write d5/d2e/fc5 [1313732,20565] 0 2024-09-21T08:02:54.649 INFO:tasks.workunit.client.0.smithi107.stdout:9/978: sync 2024-09-21T08:02:54.649 INFO:tasks.workunit.client.0.smithi107.stdout:0/826: sync 2024-09-21T08:02:54.649 INFO:tasks.workunit.client.0.smithi107.stdout:1/809: sync 2024-09-21T08:02:54.649 INFO:tasks.workunit.client.0.smithi107.stdout:4/891: sync 2024-09-21T08:02:54.649 INFO:tasks.workunit.client.0.smithi107.stdout:6/841: sync 2024-09-21T08:02:54.649 INFO:tasks.workunit.client.0.smithi107.stdout:3/835: sync 2024-09-21T08:02:54.649 INFO:tasks.workunit.client.0.smithi107.stdout:1/810: dread - d0/d29/f103 zero size 2024-09-21T08:02:54.650 INFO:tasks.workunit.client.0.smithi107.stdout:4/892: write dc/d13/d40/f43 [4746266,25196] 0 2024-09-21T08:02:54.650 INFO:tasks.workunit.client.0.smithi107.stdout:4/893: chown dc/d13/d40/d5e/d6e/l9e 37602 1 2024-09-21T08:02:54.658 INFO:tasks.workunit.client.0.smithi107.stdout:8/852: mkdir d5/d38/d56/d54/dce/dfe/d124 0 2024-09-21T08:02:54.660 INFO:tasks.workunit.client.0.smithi107.stdout:9/979: mknod d11/d27/d5e/df1/c157 0 2024-09-21T08:02:54.660 INFO:tasks.workunit.client.0.smithi107.stdout:9/980: dread - d11/d27/d5e/d76/d143/d4d/f130 zero size 2024-09-21T08:02:54.662 INFO:tasks.workunit.client.0.smithi107.stdout:4/894: rename dc/d13/d40/d5e/d6e/f100 to dc/d60/d8c/f11f 0 2024-09-21T08:02:54.664 INFO:tasks.workunit.client.0.smithi107.stdout:4/895: dread dc/d13/d40/d46/d48/d70/fe6 [0,4194304] 0 2024-09-21T08:02:54.670 INFO:tasks.workunit.client.0.smithi107.stdout:3/836: dwrite d8/d2b/d91/fe7 [4194304,4194304] 0 2024-09-21T08:02:54.670 INFO:tasks.workunit.client.0.smithi107.stdout:3/837: dread - d8/d2b/d45/f10d zero size 2024-09-21T08:02:54.714 INFO:tasks.workunit.client.0.smithi107.stdout:3/838: link d8/d25/d3d/d72/cc0 d8/d25/d34/ddc/c115 0 2024-09-21T08:02:54.714 INFO:tasks.workunit.client.0.smithi107.stdout:3/839: write d8/d38/fa4 [4863071,20421] 0 2024-09-21T08:02:54.716 INFO:tasks.workunit.client.0.smithi107.stdout:6/842: dwrite d2/d3/d7/d23/ff0 [0,4194304] 0 2024-09-21T08:02:54.716 INFO:tasks.workunit.client.0.smithi107.stdout:6/843: fsync d2/d3/d7/d48/da3/d85/d9d/f112 0 2024-09-21T08:02:54.716 INFO:tasks.workunit.client.0.smithi107.stdout:6/844: write d2/d2e/d97/f10c [968060,45412] 0 2024-09-21T08:02:54.717 INFO:tasks.workunit.client.0.smithi107.stdout:8/853: dread d5/d38/d56/d52/fdf [0,4194304] 0 2024-09-21T08:02:54.720 INFO:tasks.workunit.client.0.smithi107.stdout:3/840: rename d8/d21/d7e/fd2 to d8/d2b/d10c/f116 0 2024-09-21T08:02:54.720 INFO:tasks.workunit.client.0.smithi107.stdout:3/841: fsync d8/d21/ff1 0 2024-09-21T08:02:54.725 INFO:tasks.workunit.client.0.smithi107.stdout:6/845: write d2/d3/d7/d2a/f51 [618336,90319] 0 2024-09-21T08:02:54.728 INFO:tasks.workunit.client.0.smithi107.stdout:8/854: dread d5/d38/d56/f65 [0,4194304] 0 2024-09-21T08:02:54.728 INFO:tasks.workunit.client.0.smithi107.stdout:8/855: write d5/f20 [1586660,59565] 0 2024-09-21T08:02:54.728 INFO:tasks.workunit.client.0.smithi107.stdout:8/856: mkdir d5/d2e/ddc/d125 0 2024-09-21T08:02:54.735 INFO:tasks.workunit.client.0.smithi107.stdout:3/842: symlink d8/d2b/d45/l117 0 2024-09-21T08:02:54.736 INFO:tasks.workunit.client.0.smithi107.stdout:3/843: dread d8/d25/d42/dae/db1/dd6/f108 [0,4194304] 0 2024-09-21T08:02:54.736 INFO:tasks.workunit.client.0.smithi107.stdout:3/844: truncate d8/d2b/d45/dbf/fd1 1341775 0 2024-09-21T08:02:54.737 INFO:tasks.workunit.client.0.smithi107.stdout:0/827: unlink d1/d5/d25/d2d/f7b 0 2024-09-21T08:02:54.740 INFO:tasks.workunit.client.0.smithi107.stdout:8/857: dread d5/d44/d5d/f100 [0,4194304] 0 2024-09-21T08:02:54.743 INFO:tasks.workunit.client.0.smithi107.stdout:9/981: link d11/d27/c80 d11/c158 0 2024-09-21T08:02:54.745 INFO:tasks.workunit.client.0.smithi107.stdout:9/982: truncate d11/d27/d5e/d76/d143/f3b 755814 0 2024-09-21T08:02:54.745 INFO:tasks.workunit.client.0.smithi107.stdout:0/828: write d1/d5/d25/f9f [8288566,103782] 0 2024-09-21T08:02:54.745 INFO:tasks.workunit.client.0.smithi107.stdout:0/829: write d1/d23/fea [852826,92682] 0 2024-09-21T08:02:54.746 INFO:tasks.workunit.client.0.smithi107.stdout:9/983: unlink d11/d27/d5e/d76/d143/d4d/d5c/cde 0 2024-09-21T08:02:54.746 INFO:tasks.workunit.client.0.smithi107.stdout:9/984: read d11/f21 [2309034,36822] 0 2024-09-21T08:02:54.747 INFO:tasks.workunit.client.0.smithi107.stdout:9/985: chown d11/d24/d26/dd0/dec/d10d 2639994 1 2024-09-21T08:02:54.748 INFO:tasks.workunit.client.0.smithi107.stdout:6/846: dwrite d2/d2e/fbd [0,4194304] 0 2024-09-21T08:02:54.748 INFO:tasks.workunit.client.0.smithi107.stdout:6/847: stat d2/d3/d7/d48/da3/d85/dd9/ce8 0 2024-09-21T08:02:54.756 INFO:tasks.workunit.client.0.smithi107.stdout:0/830: creat d1/d6f/dc1/f113 x:0 0 0 2024-09-21T08:02:54.757 INFO:tasks.workunit.client.0.smithi107.stdout:3/845: write d8/d2b/d91/fe7 [7353966,17565] 0 2024-09-21T08:02:54.758 INFO:tasks.workunit.client.0.smithi107.stdout:9/986: rename d11/d24/d26/df0/f141 to d11/d27/d5e/d76/d143/d4d/f159 0 2024-09-21T08:02:54.759 INFO:tasks.workunit.client.0.smithi107.stdout:6/848: mkdir d2/d3/d67/d114 0 2024-09-21T08:02:54.760 INFO:tasks.workunit.client.0.smithi107.stdout:0/831: creat d1/d5/d25/d3d/d20/da0/f114 x:0 0 0 2024-09-21T08:02:54.762 INFO:tasks.workunit.client.0.smithi107.stdout:3/846: link d8/d25/d42/c9b d8/d2b/d52/d71/c118 0 2024-09-21T08:02:54.762 INFO:tasks.workunit.client.0.smithi107.stdout:3/847: fsync d8/d44/f62 0 2024-09-21T08:02:54.762 INFO:tasks.workunit.client.0.smithi107.stdout:3/848: fdatasync d8/d21/f75 0 2024-09-21T08:02:54.763 INFO:tasks.workunit.client.0.smithi107.stdout:9/987: creat d11/d24/d26/dbe/de3/f15a x:0 0 0 2024-09-21T08:02:54.764 INFO:tasks.workunit.client.0.smithi107.stdout:6/849: creat d2/d3/d7/d48/da3/f115 x:0 0 0 2024-09-21T08:02:54.765 INFO:tasks.workunit.client.0.smithi107.stdout:0/832: rename d1/d5/d25/d3d/ffd to d1/d5/d25/d3d/f115 0 2024-09-21T08:02:54.766 INFO:tasks.workunit.client.0.smithi107.stdout:0/833: chown d1/d23/l30 0 1 2024-09-21T08:02:54.768 INFO:tasks.workunit.client.0.smithi107.stdout:3/849: symlink d8/d21/d7e/l119 0 2024-09-21T08:02:54.769 INFO:tasks.workunit.client.0.smithi107.stdout:9/988: mknod d11/d27/d5e/d76/d143/d38/daa/c15b 0 2024-09-21T08:02:54.770 INFO:tasks.workunit.client.0.smithi107.stdout:8/858: dwrite d5/d2e/d7c/d9a/fc0 [0,4194304] 0 2024-09-21T08:02:54.773 INFO:tasks.workunit.client.0.smithi107.stdout:3/850: creat d8/d25/d3d/d72/f11a x:0 0 0 2024-09-21T08:02:54.775 INFO:tasks.workunit.client.0.smithi107.stdout:9/989: rename d11/d27/d5e/d76/d143/d4d/d5c/d61/cae to d11/d24/d26/df0/c15c 0 2024-09-21T08:02:54.778 INFO:tasks.workunit.client.0.smithi107.stdout:0/834: dread d1/fe [0,4194304] 0 2024-09-21T08:02:54.779 INFO:tasks.workunit.client.0.smithi107.stdout:8/859: rename d5/d23/f2f to d5/d2e/d7c/d9a/d9e/dcc/f126 0 2024-09-21T08:02:54.779 INFO:tasks.workunit.client.0.smithi107.stdout:8/860: write d5/d44/db7/fda [532084,85156] 0 2024-09-21T08:02:54.780 INFO:tasks.workunit.client.0.smithi107.stdout:9/990: creat d11/d27/d2a/f15d x:0 0 0 2024-09-21T08:02:54.780 INFO:tasks.workunit.client.0.smithi107.stdout:9/991: truncate d11/d27/d5e/d76/d143/d4d/d5c/d61/f150 1428490 0 2024-09-21T08:02:54.783 INFO:tasks.workunit.client.0.smithi107.stdout:0/835: creat d1/d5/d25/d2d/d8e/f116 x:0 0 0 2024-09-21T08:02:54.783 INFO:tasks.workunit.client.0.smithi107.stdout:0/836: write d1/d5/d25/d3d/d20/da0/fc0 [684751,15771] 0 2024-09-21T08:02:54.784 INFO:tasks.workunit.client.0.smithi107.stdout:8/861: rename d5/d38/d56/d52/f8f to d5/d38/d67/d7d/d91/d113/f127 0 2024-09-21T08:02:54.786 INFO:tasks.workunit.client.0.smithi107.stdout:9/992: creat d11/d27/d5e/d76/d143/d38/dbf/f15e x:0 0 0 2024-09-21T08:02:54.786 INFO:tasks.workunit.client.0.smithi107.stdout:9/993: chown d11/d27/d5e 460050 1 2024-09-21T08:02:54.792 INFO:tasks.workunit.client.0.smithi107.stdout:1/811: creat d0/d19/f10d x:0 0 0 2024-09-21T08:02:54.792 INFO:tasks.workunit.client.0.smithi107.stdout:7/679: sync 2024-09-21T08:02:54.793 INFO:tasks.workunit.client.0.smithi107.stdout:7/680: chown d7/d22/d3a/f7a 22531 1 2024-09-21T08:02:54.793 INFO:tasks.workunit.client.0.smithi107.stdout:0/837: rename d1/d5/d25/d3d/d20/d29/d55/d7a/f8c to d1/d5/d25/d9e/f117 0 2024-09-21T08:02:54.796 INFO:tasks.workunit.client.0.smithi107.stdout:9/994: link d11/d27/d5e/lc7 d11/d27/d5e/d76/d143/d4d/d5c/d61/db4/l15f 0 2024-09-21T08:02:54.796 INFO:tasks.workunit.client.0.smithi107.stdout:9/995: dread - d11/d27/d2a/f15d zero size 2024-09-21T08:02:54.796 INFO:tasks.workunit.client.0.smithi107.stdout:9/996: write d11/d27/d5e/d76/d143/d38/daa/ffd [2454337,77700] 0 2024-09-21T08:02:54.799 INFO:tasks.workunit.client.0.smithi107.stdout:7/681: mkdir d7/d22/d3d/d8a/dd4/deb 0 2024-09-21T08:02:54.801 INFO:tasks.workunit.client.0.smithi107.stdout:9/997: mkdir d11/d27/d5e/d160 0 2024-09-21T08:02:54.801 INFO:tasks.workunit.client.0.smithi107.stdout:2/903: sync 2024-09-21T08:02:54.804 INFO:tasks.workunit.client.0.smithi107.stdout:9/998: truncate d11/f21 646478 0 2024-09-21T08:02:54.807 INFO:tasks.workunit.client.0.smithi107.stdout:2/904: creat d1/d2/d6d/d37/d82/dff/f12a x:0 0 0 2024-09-21T08:02:54.807 INFO:tasks.workunit.client.0.smithi107.stdout:2/905: stat d1/d6/d92/dce/ld4 0 2024-09-21T08:02:54.807 INFO:tasks.workunit.client.0.smithi107.stdout:1/812: read d0/d19/d2b/f8b [594783,106548] 0 2024-09-21T08:02:54.807 INFO:tasks.workunit.client.0.smithi107.stdout:6/850: dwrite d2/d3/d7/d48/f68 [0,4194304] 0 2024-09-21T08:02:54.809 INFO:tasks.workunit.client.0.smithi107.stdout:9/999: link d11/d27/d5e/d76/d143/d38/dcc/de7/c117 d11/d27/d5e/d76/d143/d4d/d5c/d61/db4/dbb/c161 0 2024-09-21T08:02:54.810 INFO:tasks.workunit.client.0.smithi107.stdout:2/906: dread d1/d2/fa4 [0,4194304] 0 2024-09-21T08:02:54.810 INFO:tasks.workunit.client.0.smithi107.stdout:2/907: write d1/d16/d35/f58 [8259211,10936] 0 2024-09-21T08:02:54.810 INFO:tasks.workunit.client.0.smithi107.stdout:1/813: symlink d0/d19/d2b/d4b/d61/d75/l10e 0 2024-09-21T08:02:54.812 INFO:tasks.workunit.client.0.smithi107.stdout:6/851: creat d2/d3/d67/d114/f116 x:0 0 0 2024-09-21T08:02:54.813 INFO:tasks.workunit.client.0.smithi107.stdout:1/814: creat d0/d19/d2b/d4b/d44/f10f x:0 0 0 2024-09-21T08:02:54.814 INFO:tasks.workunit.client.0.smithi107.stdout:1/815: chown d0/d19/d2b/d4b/d44/d72/d36/l9e 3099 1 2024-09-21T08:02:54.815 INFO:tasks.workunit.client.0.smithi107.stdout:6/852: mkdir d2/d3/d7/d48/da3/d85/d9d/d10b/d117 0 2024-09-21T08:02:54.816 INFO:tasks.workunit.client.0.smithi107.stdout:1/816: symlink d0/d19/d2b/d4b/d44/l110 0 2024-09-21T08:02:54.816 INFO:tasks.workunit.client.0.smithi107.stdout:1/817: chown d0/d29/d4d/d84 4472083 1 2024-09-21T08:02:54.816 INFO:tasks.workunit.client.0.smithi107.stdout:1/818: read - d0/d19/d2b/d4b/d44/d55/d64/f9c zero size 2024-09-21T08:02:54.821 INFO:tasks.workunit.client.0.smithi107.stdout:3/851: dwrite d8/d25/d3d/d72/d80/f102 [0,4194304] 0 2024-09-21T08:02:54.821 INFO:tasks.workunit.client.0.smithi107.stdout:8/862: dwrite d5/d23/f57 [0,4194304] 0 2024-09-21T08:02:54.821 INFO:tasks.workunit.client.0.smithi107.stdout:8/863: stat d5/d38/d56/d54/dce/dfe/c11b 0 2024-09-21T08:02:54.826 INFO:tasks.workunit.client.0.smithi107.stdout:7/682: dwrite d7/d10/d64/fd1 [0,4194304] 0 2024-09-21T08:02:54.826 INFO:tasks.workunit.client.0.smithi107.stdout:2/908: write d1/d2/d6d/d37/f65 [3287189,34620] 0 2024-09-21T08:02:54.826 INFO:tasks.workunit.client.0.smithi107.stdout:7/683: chown d7/d22/d37/d5a/d83 165549566 1 2024-09-21T08:02:54.826 INFO:tasks.workunit.client.0.smithi107.stdout:2/909: write d1/d2/d6d/d37/d49/d7f/fd1 [19272,732] 0 2024-09-21T08:02:54.826 INFO:tasks.workunit.client.0.smithi107.stdout:0/838: dwrite d1/d6f/d80/f86 [0,4194304] 0 2024-09-21T08:02:54.828 INFO:tasks.workunit.client.0.smithi107.stdout:6/853: dread d2/d3/d7/d2a/f51 [0,4194304] 0 2024-09-21T08:02:54.828 INFO:tasks.workunit.client.0.smithi107.stdout:6/854: fdatasync d2/d3/d7/d2a/fcb 0 2024-09-21T08:02:54.828 INFO:tasks.workunit.client.0.smithi107.stdout:8/864: mkdir d5/db9/d128 0 2024-09-21T08:02:54.834 INFO:tasks.workunit.client.0.smithi107.stdout:3/852: dread d8/f13 [0,4194304] 0 2024-09-21T08:02:54.836 INFO:tasks.workunit.client.0.smithi107.stdout:7/684: link d7/d22/d37/d5a/f66 d7/d22/d37/d5a/fec 0 2024-09-21T08:02:54.836 INFO:tasks.workunit.client.0.smithi107.stdout:7/685: stat d7/d18/f29 0 2024-09-21T08:02:54.836 INFO:tasks.workunit.client.0.smithi107.stdout:7/686: creat d7/d22/d37/d5a/d83/d9e/fed x:0 0 0 2024-09-21T08:02:54.837 INFO:tasks.workunit.client.0.smithi107.stdout:2/910: creat d1/d6/d92/dce/f12b x:0 0 0 2024-09-21T08:02:54.839 INFO:tasks.workunit.client.0.smithi107.stdout:0/839: rename d1/d6f/dc1/dcc/df7/d10b/cba to d1/d5/d25/d3d/d20/c118 0 2024-09-21T08:02:54.840 INFO:tasks.workunit.client.0.smithi107.stdout:8/865: mknod d5/d2e/d94/daf/c129 0 2024-09-21T08:02:54.842 INFO:tasks.workunit.client.0.smithi107.stdout:3/853: mknod d8/d25/d34/dd0/c11b 0 2024-09-21T08:02:54.846 INFO:tasks.workunit.client.0.smithi107.stdout:7/687: link d7/dc3/ld6 d7/d22/d37/d5a/d83/d9e/lee 0 2024-09-21T08:02:54.846 INFO:tasks.workunit.client.0.smithi107.stdout:7/688: readlink d7/d22/d37/d5a/d83/d9e/lb7 0 2024-09-21T08:02:54.846 INFO:tasks.workunit.client.0.smithi107.stdout:7/689: dread - d7/d22/d37/d5a/d83/d9e/fb9 zero size 2024-09-21T08:02:54.847 INFO:tasks.workunit.client.0.smithi107.stdout:6/855: rename d2/d3/d7/d48/da3/d85/d9d/dcf/cdb to d2/d3/d7/d48/da3/d85/dd9/de4/c118 0 2024-09-21T08:02:54.848 INFO:tasks.workunit.client.0.smithi107.stdout:2/911: write d1/d16/f61 [3335996,45746] 0 2024-09-21T08:02:54.849 INFO:tasks.workunit.client.0.smithi107.stdout:8/866: mknod d5/d38/d56/da3/de7/c12a 0 2024-09-21T08:02:54.849 INFO:tasks.workunit.client.0.smithi107.stdout:8/867: fdatasync d5/d23/f25 0 2024-09-21T08:02:54.849 INFO:tasks.workunit.client.0.smithi107.stdout:8/868: getdents d5/d2e/ddc/d125 0 2024-09-21T08:02:54.852 INFO:tasks.workunit.client.0.smithi107.stdout:3/854: mknod d8/d25/c11c 0 2024-09-21T08:02:54.852 INFO:tasks.workunit.client.0.smithi107.stdout:2/912: dread d1/d1e/f79 [0,4194304] 0 2024-09-21T08:02:54.852 INFO:tasks.workunit.client.0.smithi107.stdout:2/913: readlink d1/d2/d6d/d9b/lf9 0 2024-09-21T08:02:54.852 INFO:tasks.workunit.client.0.smithi107.stdout:2/914: readlink d1/d2/d6d/d42/l88 0 2024-09-21T08:02:54.854 INFO:tasks.workunit.client.0.smithi107.stdout:7/690: dread d7/d10/d28/fdd [0,4194304] 0 2024-09-21T08:02:54.856 INFO:tasks.workunit.client.0.smithi107.stdout:0/840: rename d1/d5/d25/d3d/da1/ff6 to d1/d5/d25/d3d/d20/da0/f119 0 2024-09-21T08:02:54.856 INFO:tasks.workunit.client.0.smithi107.stdout:6/856: dread d2/d3/d7/d79/f10f [0,4194304] 0 2024-09-21T08:02:54.856 INFO:tasks.workunit.client.0.smithi107.stdout:0/841: write d1/d5/d25/d3d/d20/d29/d55/d7a/f7f [689371,46097] 0 2024-09-21T08:02:54.859 INFO:tasks.workunit.client.0.smithi107.stdout:8/869: mknod d5/d44/d5d/d9c/c12b 0 2024-09-21T08:02:54.859 INFO:tasks.workunit.client.0.smithi107.stdout:8/870: truncate d5/d40/d8a/dcb/fd0 748166 0 2024-09-21T08:02:54.860 INFO:tasks.workunit.client.0.smithi107.stdout:3/855: mkdir d8/d25/d3d/d72/d11d 0 2024-09-21T08:02:54.864 INFO:tasks.workunit.client.0.smithi107.stdout:7/691: unlink d7/f3f 0 2024-09-21T08:02:54.864 INFO:tasks.workunit.client.0.smithi107.stdout:6/857: dread d2/d3/d7/d3f/fd0 [0,4194304] 0 2024-09-21T08:02:54.864 INFO:tasks.workunit.client.0.smithi107.stdout:6/858: write d2/d3/d7/d54/dae/fd5 [260440,122210] 0 2024-09-21T08:02:54.867 INFO:tasks.workunit.client.0.smithi107.stdout:0/842: write d1/d23/f3f [1598147,94477] 0 2024-09-21T08:02:54.868 INFO:tasks.workunit.client.0.smithi107.stdout:8/871: mknod d5/d44/d47/c12c 0 2024-09-21T08:02:54.871 INFO:tasks.workunit.client.0.smithi107.stdout:3/856: truncate d8/d2b/f3b 4389426 0 2024-09-21T08:02:54.873 INFO:tasks.workunit.client.0.smithi107.stdout:2/915: link d1/d16/d9c/c9d d1/d6/d92/dce/c12c 0 2024-09-21T08:02:54.873 INFO:tasks.workunit.client.0.smithi107.stdout:2/916: chown d1/d1e/fe5 506 1 2024-09-21T08:02:54.875 INFO:tasks.workunit.client.0.smithi107.stdout:0/843: symlink d1/d5/d25/d3d/d20/da0/l11a 0 2024-09-21T08:02:54.877 INFO:tasks.workunit.client.0.smithi107.stdout:8/872: unlink d5/d38/d67/d7d/d91/cc4 0 2024-09-21T08:02:54.877 INFO:tasks.workunit.client.0.smithi107.stdout:8/873: getdents d5/d40/d8a/ded/d116 0 2024-09-21T08:02:54.877 INFO:tasks.workunit.client.0.smithi107.stdout:8/874: fdatasync d5/d38/d56/da3/fbd 0 2024-09-21T08:02:54.881 INFO:tasks.workunit.client.0.smithi107.stdout:3/857: mknod d8/d44/c11e 0 2024-09-21T08:02:54.884 INFO:tasks.workunit.client.0.smithi107.stdout:2/917: rename d1/d2/d6d/f71 to d1/d2/f12d 0 2024-09-21T08:02:54.884 INFO:tasks.workunit.client.0.smithi107.stdout:0/844: mkdir d1/d5/d25/d9e/d11b 0 2024-09-21T08:02:54.888 INFO:tasks.workunit.client.0.smithi107.stdout:3/858: symlink d8/d2b/d45/dcc/l11f 0 2024-09-21T08:02:54.889 INFO:tasks.workunit.client.0.smithi107.stdout:3/859: chown d8/d25/d3d/d72/d80/f7f 18 1 2024-09-21T08:02:54.889 INFO:tasks.workunit.client.0.smithi107.stdout:3/860: dread - d8/d25/d42/dae/db1/ff8 zero size 2024-09-21T08:02:54.889 INFO:tasks.workunit.client.0.smithi107.stdout:3/861: chown d8/d2b/d45/cb8 2864642 1 2024-09-21T08:02:54.891 INFO:tasks.workunit.client.0.smithi107.stdout:3/862: dread d8/d44/fc3 [0,4194304] 0 2024-09-21T08:02:54.893 INFO:tasks.workunit.client.0.smithi107.stdout:6/859: dwrite d2/d3/d7/f11 [0,4194304] 0 2024-09-21T08:02:54.893 INFO:tasks.workunit.client.0.smithi107.stdout:6/860: creat d2/d2e/db2/d110/f119 x:0 0 0 2024-09-21T08:02:54.893 INFO:tasks.workunit.client.0.smithi107.stdout:2/918: rename d1/d6/c43 to d1/d2/d6d/c12e 0 2024-09-21T08:02:54.893 INFO:tasks.workunit.client.0.smithi107.stdout:2/919: write d1/d2/d6d/d42/db0/df7/f101 [494373,65781] 0 2024-09-21T08:02:54.893 INFO:tasks.workunit.client.0.smithi107.stdout:7/692: dwrite d7/d22/d3a/fcb [0,4194304] 0 2024-09-21T08:02:54.895 INFO:tasks.workunit.client.0.smithi107.stdout:0/845: getdents d1/d5/d25/d3d/d20/d85 0 2024-09-21T08:02:54.897 INFO:tasks.workunit.client.0.smithi107.stdout:7/693: read d7/d22/d37/fcf [710580,128614] 0 2024-09-21T08:02:54.897 INFO:tasks.workunit.client.0.smithi107.stdout:7/694: truncate d7/d22/d37/d40/d4d/dda/fea 130686 0 2024-09-21T08:02:54.898 INFO:tasks.workunit.client.0.smithi107.stdout:3/863: mkdir d8/d21/d7e/d120 0 2024-09-21T08:02:54.902 INFO:tasks.workunit.client.0.smithi107.stdout:3/864: dread d8/d25/d3d/f92 [0,4194304] 0 2024-09-21T08:02:54.903 INFO:tasks.workunit.client.0.smithi107.stdout:6/861: mknod d2/d3/d67/d114/c11a 0 2024-09-21T08:02:54.904 INFO:tasks.workunit.client.0.smithi107.stdout:2/920: symlink d1/d6/d92/l12f 0 2024-09-21T08:02:54.904 INFO:tasks.workunit.client.0.smithi107.stdout:2/921: write d1/d2/d6d/d37/d82/fc9 [902836,67151] 0 2024-09-21T08:02:54.906 INFO:tasks.workunit.client.0.smithi107.stdout:0/846: mkdir d1/d5/d25/d3d/d20/d29/d5c/d11c 0 2024-09-21T08:02:54.906 INFO:tasks.workunit.client.0.smithi107.stdout:0/847: write d1/d5/d25/f9f [2869661,88774] 0 2024-09-21T08:02:54.907 INFO:tasks.workunit.client.0.smithi107.stdout:3/865: rmdir d8/d25/d34 39 2024-09-21T08:02:54.908 INFO:tasks.workunit.client.0.smithi107.stdout:6/862: link d2/d3/d7/d48/da3/d85/d9d/f112 d2/d3/d7/d24/d41/f11b 0 2024-09-21T08:02:54.910 INFO:tasks.workunit.client.0.smithi107.stdout:2/922: mknod d1/d2/d6d/d42/d76/c130 0 2024-09-21T08:02:54.910 INFO:tasks.workunit.client.0.smithi107.stdout:7/695: getdents d7/d22/d37/d4b/db0/d4f 0 2024-09-21T08:02:54.911 INFO:tasks.workunit.client.0.smithi107.stdout:3/866: mknod d8/d2b/d45/d111/c121 0 2024-09-21T08:02:54.912 INFO:tasks.workunit.client.0.smithi107.stdout:6/863: symlink d2/d3/d7/d48/da3/d85/d9d/d10b/l11c 0 2024-09-21T08:02:54.913 INFO:tasks.workunit.client.0.smithi107.stdout:1/819: rmdir d0/d19/d2b/d4b/d44 39 2024-09-21T08:02:54.914 INFO:tasks.workunit.client.0.smithi107.stdout:0/848: dread d1/d5/d25/d3d/f1d [0,4194304] 0 2024-09-21T08:02:54.914 INFO:tasks.workunit.client.0.smithi107.stdout:0/849: chown d1/d5/d25/d3d/d20/d29/d55/d91/fbc 1109079 1 2024-09-21T08:02:54.916 INFO:tasks.workunit.client.0.smithi107.stdout:3/867: truncate d8/d25/d34/faf 232621 0 2024-09-21T08:02:54.920 INFO:tasks.workunit.client.0.smithi107.stdout:7/696: link d7/d22/d3a/d49/f6f d7/d38/fef 0 2024-09-21T08:02:54.920 INFO:tasks.workunit.client.0.smithi107.stdout:7/697: chown d7/d10/d28/d69/da0/la1 1224 1 2024-09-21T08:02:54.923 INFO:tasks.workunit.client.0.smithi107.stdout:7/698: mknod d7/d22/d3d/cf0 0 2024-09-21T08:02:54.925 INFO:tasks.workunit.client.0.smithi107.stdout:1/820: write d0/d29/d4d/d84/dc5/d5e/f99 [1144292,62922] 0 2024-09-21T08:02:54.925 INFO:tasks.workunit.client.0.smithi107.stdout:1/821: write d0/d19/f58 [547971,60639] 0 2024-09-21T08:02:54.926 INFO:tasks.workunit.client.0.smithi107.stdout:6/864: dread d2/d3/d7/d48/da3/fb3 [4194304,4194304] 0 2024-09-21T08:02:54.928 INFO:tasks.workunit.client.0.smithi107.stdout:2/923: dwrite d1/d16/d35/fc6 [0,4194304] 0 2024-09-21T08:02:54.929 INFO:tasks.workunit.client.0.smithi107.stdout:7/699: dread d7/d18/fa6 [0,4194304] 0 2024-09-21T08:02:54.929 INFO:tasks.workunit.client.0.smithi107.stdout:1/822: creat d0/f111 x:0 0 0 2024-09-21T08:02:54.930 INFO:tasks.workunit.client.0.smithi107.stdout:6/865: mkdir d2/d3/d7/d23/d2b/d84/d11d 0 2024-09-21T08:02:54.930 INFO:tasks.workunit.client.0.smithi107.stdout:6/866: stat d2/d3/d7/d48/da3/d85/lf8 0 2024-09-21T08:02:54.944 INFO:tasks.workunit.client.0.smithi107.stdout:1/823: read d0/d19/d2b/d4b/d44/d72/f78 [684724,34872] 0 2024-09-21T08:02:54.944 INFO:tasks.workunit.client.0.smithi107.stdout:0/850: dwrite d1/d6f/d80/f86 [0,4194304] 0 2024-09-21T08:02:54.944 INFO:tasks.workunit.client.0.smithi107.stdout:0/851: write d1/d5/d25/d3d/d20/d29/d55/d7a/f83 [1907722,110497] 0 2024-09-21T08:02:54.945 INFO:tasks.workunit.client.0.smithi107.stdout:1/824: write d0/d29/d4d/d84/dc5/d5e/f69 [5216707,104787] 0 2024-09-21T08:02:54.945 INFO:tasks.workunit.client.0.smithi107.stdout:0/852: truncate d1/d5/d25/d3d/d20/da0/fc0 1666237 0 2024-09-21T08:02:54.945 INFO:tasks.workunit.client.0.smithi107.stdout:0/853: chown d1/d5/d25/d3d/d20/d29/l34 32150 1 2024-09-21T08:02:54.946 INFO:tasks.workunit.client.0.smithi107.stdout:1/825: creat d0/d19/d2b/d86/f112 x:0 0 0 2024-09-21T08:02:54.946 INFO:tasks.workunit.client.0.smithi107.stdout:1/826: fsync d0/d29/d4d/d84/fdb 0 2024-09-21T08:02:54.947 INFO:tasks.workunit.client.0.smithi107.stdout:0/854: creat d1/d5/d25/d9e/d10d/f11d x:0 0 0 2024-09-21T08:02:54.949 INFO:tasks.workunit.client.0.smithi107.stdout:0/855: getdents d1/d6f/dc1/dcc/df7/d10b 0 2024-09-21T08:02:54.950 INFO:tasks.workunit.client.0.smithi107.stdout:0/856: creat d1/d5/d25/d2d/f11e x:0 0 0 2024-09-21T08:02:54.953 INFO:tasks.workunit.client.0.smithi107.stdout:3/868: dwrite d8/d21/f10f [0,4194304] 0 2024-09-21T08:02:54.962 INFO:tasks.workunit.client.0.smithi107.stdout:0/857: read d1/d5/d25/d3d/d20/d29/f44 [2443144,36201] 0 2024-09-21T08:02:54.963 INFO:tasks.workunit.client.0.smithi107.stdout:0/858: mkdir d1/d5/d25/d3d/d20/d85/de1/d11f 0 2024-09-21T08:02:54.963 INFO:tasks.workunit.client.0.smithi107.stdout:0/859: chown d1/d23/fea 30234756 1 2024-09-21T08:02:54.963 INFO:tasks.workunit.client.0.smithi107.stdout:0/860: fdatasync d1/d5/d25/fb9 0 2024-09-21T08:02:54.964 INFO:tasks.workunit.client.0.smithi107.stdout:0/861: symlink d1/d5/d25/d3d/d20/d29/d5c/l120 0 2024-09-21T08:02:54.965 INFO:tasks.workunit.client.0.smithi107.stdout:0/862: readlink d1/l31 0 2024-09-21T08:02:54.965 INFO:tasks.workunit.client.0.smithi107.stdout:2/924: rename d1/d6/d92/dce to d1/d2/d6d/d37/d82/dd5/d131 0 2024-09-21T08:02:54.966 INFO:tasks.workunit.client.0.smithi107.stdout:0/863: creat d1/d5/d25/d9e/d103/f121 x:0 0 0 2024-09-21T08:02:54.966 INFO:tasks.workunit.client.0.smithi107.stdout:3/869: dread d8/d38/f94 [0,4194304] 0 2024-09-21T08:02:54.967 INFO:tasks.workunit.client.0.smithi107.stdout:3/870: write d8/d2b/d91/de5/f110 [560310,34045] 0 2024-09-21T08:02:54.968 INFO:tasks.workunit.client.0.smithi107.stdout:0/864: getdents d1/d5/d25/d3d/d20/d29/d55/d91/d9a 0 2024-09-21T08:02:54.968 INFO:tasks.workunit.client.0.smithi107.stdout:0/865: truncate d1/d5/d25/d3d/f115 93332 0 2024-09-21T08:02:54.968 INFO:tasks.workunit.client.0.smithi107.stdout:0/866: dread - d1/d5/d25/d3d/d20/d85/de1/df9/fd9 zero size 2024-09-21T08:02:54.970 INFO:tasks.workunit.client.0.smithi107.stdout:0/867: mkdir d1/d5/d25/d3d/d20/d29/d55/d91/d9a/d122 0 2024-09-21T08:02:54.971 INFO:tasks.workunit.client.0.smithi107.stdout:0/868: truncate d1/d5/f67 166554 0 2024-09-21T08:02:54.975 INFO:tasks.workunit.client.0.smithi107.stdout:6/867: dwrite d2/d3/f8a [0,4194304] 0 2024-09-21T08:02:54.980 INFO:tasks.workunit.client.0.smithi107.stdout:1/827: dwrite d0/d29/d31/fef [0,4194304] 0 2024-09-21T08:02:54.980 INFO:tasks.workunit.client.0.smithi107.stdout:6/868: link d2/d3/d7/d23/d2b/d87/l98 d2/d3/d7/d48/da3/d85/d9d/d10b/d117/l11e 0 2024-09-21T08:02:54.983 INFO:tasks.workunit.client.0.smithi107.stdout:2/925: write d1/d16/f60 [3469151,44239] 0 2024-09-21T08:02:54.984 INFO:tasks.workunit.client.0.smithi107.stdout:7/700: dwrite d7/d22/d3d/d8a/f8d [0,4194304] 0 2024-09-21T08:02:54.988 INFO:tasks.workunit.client.0.smithi107.stdout:1/828: mknod d0/d19/d2b/c113 0 2024-09-21T08:02:54.990 INFO:tasks.workunit.client.0.smithi107.stdout:2/926: mkdir d1/d6/d92/df2/d132 0 2024-09-21T08:02:54.990 INFO:tasks.workunit.client.0.smithi107.stdout:2/927: chown d1/d2/d6d/d9b/dad 3430 1 2024-09-21T08:02:54.991 INFO:tasks.workunit.client.0.smithi107.stdout:2/928: fsync d1/d2/d6d/f108 0 2024-09-21T08:02:54.993 INFO:tasks.workunit.client.0.smithi107.stdout:1/829: creat d0/d19/d2b/f114 x:0 0 0 2024-09-21T08:02:54.993 INFO:tasks.workunit.client.0.smithi107.stdout:1/830: write d0/d29/d31/f42 [424189,55139] 0 2024-09-21T08:02:54.993 INFO:tasks.workunit.client.0.smithi107.stdout:1/831: truncate d0/d29/d31/f77 7084658 0 2024-09-21T08:02:54.994 INFO:tasks.workunit.client.0.smithi107.stdout:2/929: link d1/d16/d35/f59 d1/d2/d6d/d37/d49/d7f/d111/f133 0 2024-09-21T08:02:54.996 INFO:tasks.workunit.client.0.smithi107.stdout:1/832: mkdir d0/d29/d4d/d84/dc5/d5e/d115 0 2024-09-21T08:02:54.996 INFO:tasks.workunit.client.0.smithi107.stdout:1/833: truncate d0/d19/d2b/d4b/d5b/fe8 706972 0 2024-09-21T08:02:54.997 INFO:tasks.workunit.client.0.smithi107.stdout:2/930: getdents d1/d6/d9e 0 2024-09-21T08:02:54.998 INFO:tasks.workunit.client.0.smithi107.stdout:3/871: dwrite d8/d14/f101 [0,4194304] 0 2024-09-21T08:02:54.998 INFO:tasks.workunit.client.0.smithi107.stdout:3/872: chown d8 68 1 2024-09-21T08:02:54.998 INFO:tasks.workunit.client.0.smithi107.stdout:3/873: write d8/d44/fc3 [1289165,88111] 0 2024-09-21T08:02:55.003 INFO:tasks.workunit.client.0.smithi107.stdout:3/874: creat d8/f122 x:0 0 0 2024-09-21T08:02:55.004 INFO:tasks.workunit.client.0.smithi107.stdout:2/931: rmdir d1/d2/d6d/d42/db0/df7 39 2024-09-21T08:02:55.005 INFO:tasks.workunit.client.0.smithi107.stdout:1/834: dread d0/d29/d4d/d84/dc5/f3d [0,4194304] 0 2024-09-21T08:02:55.005 INFO:tasks.workunit.client.0.smithi107.stdout:1/835: chown d0/d29/d4d/d84/dc5/f41 431 1 2024-09-21T08:02:55.006 INFO:tasks.workunit.client.0.smithi107.stdout:1/836: creat d0/d19/f116 x:0 0 0 2024-09-21T08:02:55.010 INFO:tasks.workunit.client.0.smithi107.stdout:1/837: link d0/f3 d0/d19/d2b/d4b/f117 0 2024-09-21T08:02:55.011 INFO:tasks.workunit.client.0.smithi107.stdout:1/838: mknod d0/d19/d2b/d4b/d90/c118 0 2024-09-21T08:02:55.014 INFO:tasks.workunit.client.0.smithi107.stdout:1/839: symlink d0/d19/d2b/d4b/d5b/dcb/l119 0 2024-09-21T08:02:55.016 INFO:tasks.workunit.client.0.smithi107.stdout:2/932: write d1/d2/fba [1844471,123425] 0 2024-09-21T08:02:55.017 INFO:tasks.workunit.client.0.smithi107.stdout:8/875: dwrite d5/f8e [0,4194304] 0 2024-09-21T08:02:55.017 INFO:tasks.workunit.client.0.smithi107.stdout:6/869: dwrite d2/d3/f4 [0,4194304] 0 2024-09-21T08:02:55.019 INFO:tasks.workunit.client.0.smithi107.stdout:8/876: read d5/d38/d56/d54/fae [271131,109651] 0 2024-09-21T08:02:55.019 INFO:tasks.workunit.client.0.smithi107.stdout:8/877: fsync d5/d44/db7/ff6 0 2024-09-21T08:02:55.019 INFO:tasks.workunit.client.0.smithi107.stdout:2/933: creat d1/d16/d35/d10c/f134 x:0 0 0 2024-09-21T08:02:55.024 INFO:tasks.workunit.client.0.smithi107.stdout:6/870: symlink d2/d3/d7/d48/da3/d85/d9d/d10b/l11f 0 2024-09-21T08:02:55.026 INFO:tasks.workunit.client.0.smithi107.stdout:8/878: link d5/d44/d5d/d9c/f10e d5/d40/d8a/dcb/dff/f12d 0 2024-09-21T08:02:55.026 INFO:tasks.workunit.client.0.smithi107.stdout:8/879: write d5/d2e/d94/fbf [973653,120695] 0 2024-09-21T08:02:55.028 INFO:tasks.workunit.client.0.smithi107.stdout:8/880: creat d5/d2e/d7c/f12e x:0 0 0 2024-09-21T08:02:55.028 INFO:tasks.workunit.client.0.smithi107.stdout:8/881: chown d5/d40/d8a/dcb/fd0 2426537 1 2024-09-21T08:02:55.028 INFO:tasks.workunit.client.0.smithi107.stdout:8/882: chown d5/d38/d67/d7d/c8c 702034 1 2024-09-21T08:02:55.031 INFO:tasks.workunit.client.0.smithi107.stdout:3/875: dwrite d8/d25/d3d/d72/d80/d5d/f63 [0,4194304] 0 2024-09-21T08:02:55.031 INFO:tasks.workunit.client.0.smithi107.stdout:7/701: dwrite d7/d10/d28/d69/f91 [0,4194304] 0 2024-09-21T08:02:55.035 INFO:tasks.workunit.client.0.smithi107.stdout:1/840: write d0/d19/d2b/d4b/d61/d75/f7d [4787747,28260] 0 2024-09-21T08:02:55.038 INFO:tasks.workunit.client.0.smithi107.stdout:2/934: dread d1/d2/d6d/d37/d49/f77 [0,4194304] 0 2024-09-21T08:02:55.040 INFO:tasks.workunit.client.0.smithi107.stdout:7/702: dread d7/d22/d37/d40/d4d/f6a [0,4194304] 0 2024-09-21T08:02:55.040 INFO:tasks.workunit.client.0.smithi107.stdout:1/841: creat d0/d19/d2b/d4b/d44/d72/f11a x:0 0 0 2024-09-21T08:02:55.043 INFO:tasks.workunit.client.0.smithi107.stdout:6/871: write d2/d2e/ff1 [2482528,7881] 0 2024-09-21T08:02:55.043 INFO:tasks.workunit.client.0.smithi107.stdout:8/883: write d5/d38/d56/da3/fbd [1149956,66022] 0 2024-09-21T08:02:55.043 INFO:tasks.workunit.client.0.smithi107.stdout:6/872: chown d2/d3/d7/d54/dae/fee 1 1 2024-09-21T08:02:55.045 INFO:tasks.workunit.client.0.smithi107.stdout:2/935: symlink d1/d2/d6d/d42/db0/db8/l135 0 2024-09-21T08:02:55.049 INFO:tasks.workunit.client.0.smithi107.stdout:1/842: creat d0/d19/d2b/d86/d95/f11b x:0 0 0 2024-09-21T08:02:55.052 INFO:tasks.workunit.client.0.smithi107.stdout:8/884: truncate d5/d38/d67/d7d/d91/fa6 4119602 0 2024-09-21T08:02:55.052 INFO:tasks.workunit.client.0.smithi107.stdout:8/885: stat d5/c29 0 2024-09-21T08:02:55.052 INFO:tasks.workunit.client.0.smithi107.stdout:8/886: write d5/d2e/d89/f105 [4991487,129211] 0 2024-09-21T08:02:55.055 INFO:tasks.workunit.client.0.smithi107.stdout:6/873: write d2/d3/d7/f8 [6817294,26472] 0 2024-09-21T08:02:55.060 INFO:tasks.workunit.client.0.smithi107.stdout:3/876: dwrite d8/d2b/d52/d71/db3/dc2/f114 [0,4194304] 0 2024-09-21T08:02:55.061 INFO:tasks.workunit.client.0.smithi107.stdout:8/887: symlink d5/d38/d56/d54/dfd/l12f 0 2024-09-21T08:02:55.066 INFO:tasks.workunit.client.0.smithi107.stdout:1/843: read d0/d29/d31/fef [2307404,118860] 0 2024-09-21T08:02:55.073 INFO:tasks.workunit.client.0.smithi107.stdout:6/874: unlink d2/d3/d7/d54/leb 0 2024-09-21T08:02:55.073 INFO:tasks.workunit.client.0.smithi107.stdout:6/875: chown d2 74 1 2024-09-21T08:02:55.073 INFO:tasks.workunit.client.0.smithi107.stdout:6/876: dread - d2/d3/d67/fbe zero size 2024-09-21T08:02:55.075 INFO:tasks.workunit.client.0.smithi107.stdout:7/703: rename d7/d22/d37/d40/d4d/dda to d7/d22/d3a/d49/df1 0 2024-09-21T08:02:55.077 INFO:tasks.workunit.client.0.smithi107.stdout:3/877: symlink d8/dfe/l123 0 2024-09-21T08:02:55.077 INFO:tasks.workunit.client.0.smithi107.stdout:3/878: write d8/d2b/d45/f10d [476133,101398] 0 2024-09-21T08:02:55.077 INFO:tasks.workunit.client.0.smithi107.stdout:3/879: chown d8/d2b/d91/lf3 0 1 2024-09-21T08:02:55.077 INFO:tasks.workunit.client.0.smithi107.stdout:3/880: stat d8/d2b/d52/f68 0 2024-09-21T08:02:55.082 INFO:tasks.workunit.client.0.smithi107.stdout:0/869: getdents d1/d5/d25/d2d 0 2024-09-21T08:02:55.083 INFO:tasks.workunit.client.0.smithi107.stdout:1/844: unlink d0/d19/d2b/d4b/d44/d72/c32 0 2024-09-21T08:02:55.085 INFO:tasks.workunit.client.0.smithi107.stdout:6/877: creat d2/d3/d7/d48/da3/d85/d9b/f120 x:0 0 0 2024-09-21T08:02:55.086 INFO:tasks.workunit.client.0.smithi107.stdout:8/888: truncate d5/d38/d56/d54/f80 710337 0 2024-09-21T08:02:55.088 INFO:tasks.workunit.client.0.smithi107.stdout:0/870: creat d1/d5/d25/d3d/d20/d29/d55/d91/d9a/f123 x:0 0 0 2024-09-21T08:02:55.090 INFO:tasks.workunit.client.0.smithi107.stdout:1/845: mkdir d0/dce/d11c 0 2024-09-21T08:02:55.095 INFO:tasks.workunit.client.0.smithi107.stdout:8/889: link d5/d38/d56/d52/d7a/cf2 d5/d38/d56/d54/dce/dfe/d124/c130 0 2024-09-21T08:02:55.098 INFO:tasks.workunit.client.0.smithi107.stdout:8/890: creat d5/d2e/d94/daf/f131 x:0 0 0 2024-09-21T08:02:55.098 INFO:tasks.workunit.client.0.smithi107.stdout:6/878: dread d2/d3/d7/f15 [0,4194304] 0 2024-09-21T08:02:55.100 INFO:tasks.workunit.client.0.smithi107.stdout:6/879: getdents d2/d3/d7/d48/da3/d85/d9d 0 2024-09-21T08:02:55.100 INFO:tasks.workunit.client.0.smithi107.stdout:6/880: creat d2/d2e/d97/f121 x:0 0 0 2024-09-21T08:02:55.111 INFO:tasks.workunit.client.0.smithi107.stdout:1/846: write d0/d19/d39/fb8 [4409968,95590] 0 2024-09-21T08:02:55.114 INFO:tasks.workunit.client.0.smithi107.stdout:2/936: rmdir d1/d2/d6d 39 2024-09-21T08:02:55.115 INFO:tasks.workunit.client.0.smithi107.stdout:6/881: write d2/d3/d67/f4e [3418022,16764] 0 2024-09-21T08:02:55.115 INFO:tasks.workunit.client.0.smithi107.stdout:6/882: creat d2/d2e/d97/f122 x:0 0 0 2024-09-21T08:02:55.116 INFO:tasks.workunit.client.0.smithi107.stdout:2/937: creat d1/d2/d6d/d9b/f136 x:0 0 0 2024-09-21T08:02:55.116 INFO:tasks.workunit.client.0.smithi107.stdout:2/938: write d1/d6/fe9 [146566,65080] 0 2024-09-21T08:02:55.116 INFO:tasks.workunit.client.0.smithi107.stdout:2/939: write d1/d2/d6d/d42/db0/df7/f101 [1559366,33898] 0 2024-09-21T08:02:55.116 INFO:tasks.workunit.client.0.smithi107.stdout:2/940: write d1/d6/f2d [797947,50201] 0 2024-09-21T08:02:55.119 INFO:tasks.workunit.client.0.smithi107.stdout:7/704: dwrite d7/d10/f55 [0,4194304] 0 2024-09-21T08:02:55.119 INFO:tasks.workunit.client.0.smithi107.stdout:6/883: link d2/d3/fe0 d2/d3/d7/d48/d65/d109/f123 0 2024-09-21T08:02:55.119 INFO:tasks.workunit.client.0.smithi107.stdout:6/884: chown d2/d3/d7/d54/l101 208 1 2024-09-21T08:02:55.121 INFO:tasks.workunit.client.0.smithi107.stdout:3/881: dwrite d8/d2b/d45/fc1 [0,4194304] 0 2024-09-21T08:02:55.121 INFO:tasks.workunit.client.0.smithi107.stdout:3/882: chown d8/d2b/d91/lf3 0 1 2024-09-21T08:02:55.121 INFO:tasks.workunit.client.0.smithi107.stdout:3/883: chown d8/d2b/f3b 585 1 2024-09-21T08:02:55.122 INFO:tasks.workunit.client.0.smithi107.stdout:2/941: mknod d1/d2/d6d/d42/db0/c137 0 2024-09-21T08:02:55.122 INFO:tasks.workunit.client.0.smithi107.stdout:2/942: fdatasync d1/fc5 0 2024-09-21T08:02:55.127 INFO:tasks.workunit.client.0.smithi107.stdout:7/705: creat d7/d22/d3a/d49/dbe/ff2 x:0 0 0 2024-09-21T08:02:55.127 INFO:tasks.workunit.client.0.smithi107.stdout:7/706: stat d7/c44 0 2024-09-21T08:02:55.128 INFO:tasks.workunit.client.0.smithi107.stdout:6/885: symlink d2/d3/d7/d54/l124 0 2024-09-21T08:02:55.131 INFO:tasks.workunit.client.0.smithi107.stdout:3/884: creat d8/d25/d3d/d72/d11d/f124 x:0 0 0 2024-09-21T08:02:55.133 INFO:tasks.workunit.client.0.smithi107.stdout:3/885: creat d8/d2b/d91/df2/d113/f125 x:0 0 0 2024-09-21T08:02:55.135 INFO:tasks.workunit.client.0.smithi107.stdout:3/886: creat d8/d2b/d91/f126 x:0 0 0 2024-09-21T08:02:55.135 INFO:tasks.workunit.client.0.smithi107.stdout:3/887: chown d8/l2c 99137 1 2024-09-21T08:02:55.135 INFO:tasks.workunit.client.0.smithi107.stdout:3/888: read - d8/f122 zero size 2024-09-21T08:02:55.143 INFO:tasks.workunit.client.0.smithi107.stdout:2/943: dwrite d1/d2/d6d/d42/d76/fa7 [4194304,4194304] 0 2024-09-21T08:02:55.143 INFO:tasks.workunit.client.0.smithi107.stdout:2/944: truncate d1/d6/d92/fe7 845205 0 2024-09-21T08:02:55.145 INFO:tasks.workunit.client.0.smithi107.stdout:2/945: creat d1/d2/d6d/d37/d82/f138 x:0 0 0 2024-09-21T08:02:55.145 INFO:tasks.workunit.client.0.smithi107.stdout:2/946: chown d1/d6/c47 47585 1 2024-09-21T08:02:55.147 INFO:tasks.workunit.client.0.smithi107.stdout:3/889: read d8/d21/f36 [168578,63494] 0 2024-09-21T08:02:55.150 INFO:tasks.workunit.client.0.smithi107.stdout:2/947: dread d1/f33 [0,4194304] 0 2024-09-21T08:02:55.151 INFO:tasks.workunit.client.0.smithi107.stdout:2/948: read d1/d1e/fe2 [48063,71213] 0 2024-09-21T08:02:55.152 INFO:tasks.workunit.client.0.smithi107.stdout:2/949: rename d1/d6/d92/df2/d132 to d1/d16/d35/d10c/d122/d139 0 2024-09-21T08:02:55.153 INFO:tasks.workunit.client.0.smithi107.stdout:2/950: symlink d1/d2/d6d/d9b/l13a 0 2024-09-21T08:02:55.153 INFO:tasks.workunit.client.0.smithi107.stdout:2/951: truncate d1/d16/f17 2856149 0 2024-09-21T08:02:55.154 INFO:tasks.workunit.client.0.smithi107.stdout:2/952: readlink d1/d2/d6d/d37/d82/dff/l109 0 2024-09-21T08:02:55.155 INFO:tasks.workunit.client.0.smithi107.stdout:2/953: rename d1/d2/d6d/d37/d82/f138 to d1/d2/d6d/d37/d82/dd5/f13b 0 2024-09-21T08:02:55.155 INFO:tasks.workunit.client.0.smithi107.stdout:2/954: truncate d1/d1e/fe2 160604 0 2024-09-21T08:02:55.155 INFO:tasks.workunit.client.0.smithi107.stdout:2/955: creat d1/d2/d6d/d37/d82/dff/f13c x:0 0 0 2024-09-21T08:02:55.156 INFO:tasks.workunit.client.0.smithi107.stdout:2/956: rename d1/d2/d6d/d42/db0/fc4 to d1/d2/d6d/d37/d49/dde/f13d 0 2024-09-21T08:02:55.157 INFO:tasks.workunit.client.0.smithi107.stdout:2/957: symlink d1/d16/d35/l13e 0 2024-09-21T08:02:55.157 INFO:tasks.workunit.client.0.smithi107.stdout:2/958: read d1/d2/f34 [2575268,5102] 0 2024-09-21T08:02:55.158 INFO:tasks.workunit.client.0.smithi107.stdout:2/959: mkdir d1/d2/d6d/d37/d49/d85/d13f 0 2024-09-21T08:02:55.158 INFO:tasks.workunit.client.0.smithi107.stdout:2/960: write d1/d2/f12d [1576992,106162] 0 2024-09-21T08:02:55.158 INFO:tasks.workunit.client.0.smithi107.stdout:2/961: write d1/d2/d6d/d37/d49/f11a [1003301,34016] 0 2024-09-21T08:02:55.159 INFO:tasks.workunit.client.0.smithi107.stdout:2/962: creat d1/d2/d6d/d37/d49/d7f/d111/f140 x:0 0 0 2024-09-21T08:02:55.188 INFO:tasks.workunit.client.0.smithi107.stdout:6/886: dread d2/d2e/db2/ffb [0,4194304] 0 2024-09-21T08:02:55.189 INFO:tasks.workunit.client.0.smithi107.stdout:6/887: chown d2/d3/d7/d24/c45 3506190 1 2024-09-21T08:02:55.189 INFO:tasks.workunit.client.0.smithi107.stdout:6/888: fsync d2/fd 0 2024-09-21T08:02:55.206 INFO:tasks.workunit.client.0.smithi107.stdout:6/889: dwrite d2/d3/d7/d48/da3/d85/d9d/f112 [0,4194304] 0 2024-09-21T08:02:55.208 INFO:tasks.workunit.client.0.smithi107.stdout:6/890: dread d2/d2e/d97/f10c [0,4194304] 0 2024-09-21T08:02:55.209 INFO:tasks.workunit.client.0.smithi107.stdout:6/891: mkdir d2/d3/d7/d79/d125 0 2024-09-21T08:02:55.212 INFO:tasks.workunit.client.0.smithi107.stdout:6/892: rmdir d2/d3/d7 39 2024-09-21T08:02:55.212 INFO:tasks.workunit.client.0.smithi107.stdout:6/893: readlink d2/d3/d7/d48/da3/d85/d9d/d10b/l11c 0 2024-09-21T08:02:55.215 INFO:tasks.workunit.client.0.smithi107.stdout:6/894: creat d2/d3/d7/d54/d5c/f126 x:0 0 0 2024-09-21T08:02:55.216 INFO:tasks.workunit.client.0.smithi107.stdout:6/895: dread - d2/d2e/db2/d110/f111 zero size 2024-09-21T08:02:55.228 INFO:tasks.workunit.client.0.smithi107.stdout:1/847: dwrite d0/d19/f33 [0,4194304] 0 2024-09-21T08:02:55.234 INFO:tasks.workunit.client.0.smithi107.stdout:2/963: dwrite d1/d6/d92/df2/f10e [0,4194304] 0 2024-09-21T08:02:55.234 INFO:tasks.workunit.client.0.smithi107.stdout:2/964: write d1/d2/d6d/d9b/dad/fdf [267377,88165] 0 2024-09-21T08:02:55.234 INFO:tasks.workunit.client.0.smithi107.stdout:2/965: fsync d1/d16/f6b 0 2024-09-21T08:02:55.236 INFO:tasks.workunit.client.0.smithi107.stdout:8/891: truncate d5/d38/d56/d54/f80 405897 0 2024-09-21T08:02:55.239 INFO:tasks.workunit.client.0.smithi107.stdout:2/966: dread d1/d2/d6d/f5f [0,4194304] 0 2024-09-21T08:02:55.241 INFO:tasks.workunit.client.0.smithi107.stdout:6/896: dwrite d2/d3/d7/d3f/fb9 [0,4194304] 0 2024-09-21T08:02:55.243 INFO:tasks.workunit.client.0.smithi107.stdout:1/848: fsync d0/d19/d2b/d86/d95/f11b 0 2024-09-21T08:02:55.251 INFO:tasks.workunit.client.0.smithi107.stdout:8/892: dwrite d5/d38/d67/d7d/d91/d113/f127 [0,4194304] 0 2024-09-21T08:02:55.260 INFO:tasks.workunit.client.0.smithi107.stdout:2/967: unlink d1/d2/d6d/d42/d76/c130 0 2024-09-21T08:02:55.260 INFO:tasks.workunit.client.0.smithi107.stdout:2/968: stat d1/d6/d9e/f11b 0 2024-09-21T08:02:55.260 INFO:tasks.workunit.client.0.smithi107.stdout:2/969: write d1/d16/f61 [2705138,7479] 0 2024-09-21T08:02:55.265 INFO:tasks.workunit.client.0.smithi107.stdout:6/897: mknod d2/d3/d7/d48/da3/d85/d9d/d10b/c127 0 2024-09-21T08:02:55.267 INFO:tasks.workunit.client.0.smithi107.stdout:1/849: symlink d0/d19/d2b/d4b/d61/l11d 0 2024-09-21T08:02:55.269 INFO:tasks.workunit.client.0.smithi107.stdout:8/893: mkdir d5/d40/d8a/dcb/d132 0 2024-09-21T08:02:55.270 INFO:tasks.workunit.client.0.smithi107.stdout:2/970: rmdir d1/d6 39 2024-09-21T08:02:55.271 INFO:tasks.workunit.client.0.smithi107.stdout:6/898: creat d2/d3/d7/d48/d65/d109/f128 x:0 0 0 2024-09-21T08:02:55.275 INFO:tasks.workunit.client.0.smithi107.stdout:8/894: mknod d5/d23/df0/c133 0 2024-09-21T08:02:55.277 INFO:tasks.workunit.client.0.smithi107.stdout:1/850: mkdir d0/dc6/d11e 0 2024-09-21T08:02:55.277 INFO:tasks.workunit.client.0.smithi107.stdout:1/851: truncate d0/d19/d2b/d4b/d5b/dcb/fea 954754 0 2024-09-21T08:02:55.277 INFO:tasks.workunit.client.0.smithi107.stdout:1/852: fdatasync d0/d19/d2b/d4b/d61/d75/f7d 0 2024-09-21T08:02:55.278 INFO:tasks.workunit.client.0.smithi107.stdout:2/971: dread d1/d2/d6d/d37/d49/d7f/f10b [0,4194304] 0 2024-09-21T08:02:55.280 INFO:tasks.workunit.client.0.smithi107.stdout:8/895: mkdir d5/d38/d56/d54/dfd/d134 0 2024-09-21T08:02:55.331 INFO:tasks.workunit.client.0.smithi107.stdout:8/896: symlink d5/d38/d67/l135 0 2024-09-21T08:02:55.332 INFO:tasks.workunit.client.0.smithi107.stdout:1/853: mknod d0/d29/da1/c11f 0 2024-09-21T08:02:55.333 INFO:tasks.workunit.client.0.smithi107.stdout:2/972: symlink d1/d2/d6d/d42/l141 0 2024-09-21T08:02:55.335 INFO:tasks.workunit.client.0.smithi107.stdout:2/973: link d1/d2/d6d/d37/d49/d85/fd3 d1/d2/d6d/d37/d49/dde/d10f/f142 0 2024-09-21T08:02:55.335 INFO:tasks.workunit.client.0.smithi107.stdout:1/854: mkdir d0/d120 0 2024-09-21T08:02:55.338 INFO:tasks.workunit.client.0.smithi107.stdout:8/897: dread d5/f12 [0,4194304] 0 2024-09-21T08:02:55.339 INFO:tasks.workunit.client.0.smithi107.stdout:8/898: mknod d5/d23/df0/c136 0 2024-09-21T08:02:55.342 INFO:tasks.workunit.client.0.smithi107.stdout:8/899: creat d5/d38/d67/d7d/d10f/f137 x:0 0 0 2024-09-21T08:02:55.344 INFO:tasks.workunit.client.0.smithi107.stdout:8/900: mknod d5/d2e/d7c/c138 0 2024-09-21T08:02:55.345 INFO:tasks.workunit.client.0.smithi107.stdout:1/855: dread d0/d19/d2b/d4b/f117 [0,4194304] 0 2024-09-21T08:02:55.347 INFO:tasks.workunit.client.0.smithi107.stdout:8/901: unlink d5/d44/db7/l11c 0 2024-09-21T08:02:55.347 INFO:tasks.workunit.client.0.smithi107.stdout:1/856: dread d0/d19/d2b/d4b/d61/fbb [0,4194304] 0 2024-09-21T08:02:55.348 INFO:tasks.workunit.client.0.smithi107.stdout:8/902: mknod d5/d44/d5d/c139 0 2024-09-21T08:02:55.349 INFO:tasks.workunit.client.0.smithi107.stdout:1/857: mknod d0/d19/ddd/c121 0 2024-09-21T08:02:55.350 INFO:tasks.workunit.client.0.smithi107.stdout:1/858: truncate d0/dc6/f30 760712 0 2024-09-21T08:02:55.351 INFO:tasks.workunit.client.0.smithi107.stdout:1/859: write d0/d29/f3f [1075734,11463] 0 2024-09-21T08:02:55.351 INFO:tasks.workunit.client.0.smithi107.stdout:2/974: dwrite d1/d2/d6d/d42/db0/df7/ffe [0,4194304] 0 2024-09-21T08:02:55.352 INFO:tasks.workunit.client.0.smithi107.stdout:2/975: mknod d1/d2/d6d/d42/db0/db8/c143 0 2024-09-21T08:02:55.353 INFO:tasks.workunit.client.0.smithi107.stdout:8/903: dread d5/d2e/d7c/d9a/f70 [0,4194304] 0 2024-09-21T08:02:55.353 INFO:tasks.workunit.client.0.smithi107.stdout:8/904: fdatasync f0 0 2024-09-21T08:02:55.358 INFO:tasks.workunit.client.0.smithi107.stdout:8/905: rename d5/d40/f43 to d5/d44/d5d/d9c/dd7/f13a 0 2024-09-21T08:02:55.360 INFO:tasks.workunit.client.0.smithi107.stdout:8/906: mknod d5/d23/df0/c13b 0 2024-09-21T08:02:55.362 INFO:tasks.workunit.client.0.smithi107.stdout:8/907: rename d5/d38/d56/d54/dce/dfe to d5/d44/db7/dca/d13c 0 2024-09-21T08:02:55.362 INFO:tasks.workunit.client.0.smithi107.stdout:8/908: creat d5/d38/d56/f13d x:0 0 0 2024-09-21T08:02:55.367 INFO:tasks.workunit.client.0.smithi107.stdout:8/909: dread d5/d44/db7/fda [0,4194304] 0 2024-09-21T08:02:55.369 INFO:tasks.workunit.client.0.smithi107.stdout:8/910: symlink d5/d40/d8a/dcb/l13e 0 2024-09-21T08:02:55.372 INFO:tasks.workunit.client.0.smithi107.stdout:2/976: dwrite d1/d16/feb [0,4194304] 0 2024-09-21T08:02:55.372 INFO:tasks.workunit.client.0.smithi107.stdout:2/977: fdatasync d1/dc8/f105 0 2024-09-21T08:02:55.372 INFO:tasks.workunit.client.0.smithi107.stdout:1/860: dwrite d0/d29/d4d/d84/dc5/da9/dc7/f6f [0,4194304] 0 2024-09-21T08:02:55.372 INFO:tasks.workunit.client.0.smithi107.stdout:1/861: fsync d0/d19/d2b/d4b/d44/f10f 0 2024-09-21T08:02:55.379 INFO:tasks.workunit.client.0.smithi107.stdout:1/862: unlink d0/d19/d2b/d4b/d61/d75/f7d 0 2024-09-21T08:02:55.394 INFO:tasks.workunit.client.0.smithi107.stdout:2/978: dwrite d1/d2/d6d/d37/d82/dff/f13c [0,4194304] 0 2024-09-21T08:02:55.394 INFO:tasks.workunit.client.0.smithi107.stdout:8/911: dwrite d5/f72 [0,4194304] 0 2024-09-21T08:02:55.400 INFO:tasks.workunit.client.0.smithi107.stdout:2/979: rename d1/d16/feb to d1/d2/d6d/d9b/dad/f144 0 2024-09-21T08:02:55.402 INFO:tasks.workunit.client.0.smithi107.stdout:8/912: dread d5/f72 [0,4194304] 0 2024-09-21T08:02:55.410 INFO:tasks.workunit.client.0.smithi107.stdout:2/980: rmdir d1/d16/d35/d10c/d122/d139 0 2024-09-21T08:02:55.414 INFO:tasks.workunit.client.0.smithi107.stdout:2/981: symlink d1/l145 0 2024-09-21T08:02:55.417 INFO:tasks.workunit.client.0.smithi107.stdout:8/913: truncate d5/d44/d47/f4e 2191338 0 2024-09-21T08:02:55.419 INFO:tasks.workunit.client.0.smithi107.stdout:2/982: rename d1/d2/d6d/d42/db0/df7/f101 to d1/d2/d6d/d42/db0/df7/d121/f146 0 2024-09-21T08:02:55.422 INFO:tasks.workunit.client.0.smithi107.stdout:8/914: mkdir d5/d23/df0/d13f 0 2024-09-21T08:02:55.426 INFO:tasks.workunit.client.0.smithi107.stdout:2/983: mkdir d1/d2/d6d/d42/db0/df7/d121/d147 0 2024-09-21T08:02:55.428 INFO:tasks.workunit.client.0.smithi107.stdout:2/984: mknod d1/d1e/c148 0 2024-09-21T08:02:55.428 INFO:tasks.workunit.client.0.smithi107.stdout:2/985: stat d1/d2/d6d/d42/db0/c129 0 2024-09-21T08:02:55.429 INFO:tasks.workunit.client.0.smithi107.stdout:2/986: symlink d1/l149 0 2024-09-21T08:02:55.546 INFO:tasks.workunit.client.0.smithi107.stdout:4/896: sync 2024-09-21T08:02:55.548 INFO:tasks.workunit.client.0.smithi107.stdout:4/897: creat dc/d13/d5a/d110/f120 x:0 0 0 2024-09-21T08:02:55.565 INFO:tasks.workunit.client.0.smithi107.stdout:4/898: dwrite dc/d13/d40/f4b [0,4194304] 0 2024-09-21T08:02:55.565 INFO:tasks.workunit.client.0.smithi107.stdout:4/899: chown dc/d13/d40/d5e/d98 11134490 1 2024-09-21T08:02:55.565 INFO:tasks.workunit.client.0.smithi107.stdout:4/900: creat dc/d13/d40/d80/f121 x:0 0 0 2024-09-21T08:02:55.565 INFO:tasks.workunit.client.0.smithi107.stdout:4/901: fdatasync dc/d13/d40/d46/d48/d70/dc5/d8a/f113 0 2024-09-21T08:02:55.566 INFO:tasks.workunit.client.0.smithi107.stdout:4/902: write dc/d13/d40/d5e/d98/dbf/fdf [856774,53917] 0 2024-09-21T08:02:55.569 INFO:tasks.workunit.client.0.smithi107.stdout:4/903: symlink dc/d13/l122 0 2024-09-21T08:02:55.571 INFO:tasks.workunit.client.0.smithi107.stdout:4/904: symlink dc/d13/d5a/d9b/l123 0 2024-09-21T08:02:55.574 INFO:tasks.workunit.client.0.smithi107.stdout:4/905: creat dc/d13/d40/d5e/d98/f124 x:0 0 0 2024-09-21T08:02:55.585 INFO:tasks.workunit.client.0.smithi107.stdout:4/906: dread dc/d64/d6b/dcf/ffa [0,4194304] 0 2024-09-21T08:02:55.585 INFO:tasks.workunit.client.0.smithi107.stdout:4/907: read - dc/d13/d40/d5e/fa5 zero size 2024-09-21T08:02:55.586 INFO:tasks.workunit.client.0.smithi107.stdout:4/908: mknod dc/d64/d6b/dcf/c125 0 2024-09-21T08:02:55.586 INFO:tasks.workunit.client.0.smithi107.stdout:4/909: dread - dc/d13/d40/d5e/d6e/fb6 zero size 2024-09-21T08:02:55.601 INFO:tasks.workunit.client.0.smithi107.stdout:4/910: dwrite dc/d13/f2a [0,4194304] 0 2024-09-21T08:02:55.603 INFO:tasks.workunit.client.0.smithi107.stdout:4/911: mkdir dc/d126 0 2024-09-21T08:02:55.603 INFO:tasks.workunit.client.0.smithi107.stdout:4/912: chown dc/d13/d5a/d9b/dbc 1988023 1 2024-09-21T08:02:55.603 INFO:tasks.workunit.client.0.smithi107.stdout:4/913: truncate dc/d64/d6b/dcf/f11d 695858 0 2024-09-21T08:02:55.611 INFO:tasks.workunit.client.0.smithi107.stdout:4/914: dread dc/d13/d5a/d9b/dbc/ff8 [0,4194304] 0 2024-09-21T08:02:55.617 INFO:tasks.workunit.client.0.smithi107.stdout:4/915: write dc/d13/f3e [929832,10712] 0 2024-09-21T08:02:55.635 INFO:tasks.workunit.client.0.smithi107.stdout:4/916: dwrite dc/fd9 [0,4194304] 0 2024-09-21T08:02:55.635 INFO:tasks.workunit.client.0.smithi107.stdout:4/917: fsync dc/d13/d40/d46/d48/f9d 0 2024-09-21T08:02:55.635 INFO:tasks.workunit.client.0.smithi107.stdout:4/918: fsync dc/d13/d40/d46/d48/d70/f117 0 2024-09-21T08:02:55.655 INFO:tasks.workunit.client.0.smithi107.stdout:4/919: dwrite dc/d13/d40/f52 [0,4194304] 0 2024-09-21T08:02:55.656 INFO:tasks.workunit.client.0.smithi107.stdout:4/920: fdatasync dc/d13/d40/d80/f121 0 2024-09-21T08:02:55.662 INFO:tasks.workunit.client.0.smithi107.stdout:4/921: write dc/d13/f72 [704667,129779] 0 2024-09-21T08:02:55.662 INFO:tasks.workunit.client.0.smithi107.stdout:4/922: readlink dc/d13/l37 0 2024-09-21T08:02:55.665 INFO:tasks.workunit.client.0.smithi107.stdout:4/923: rename dc/d13/d40/d80/cb3 to dc/d13/d5a/d110/c127 0 2024-09-21T08:02:55.665 INFO:tasks.workunit.client.0.smithi107.stdout:4/924: read - dc/d60/f119 zero size 2024-09-21T08:02:55.667 INFO:tasks.workunit.client.0.smithi107.stdout:4/925: rename dc/d13/l122 to dc/d126/l128 0 2024-09-21T08:02:55.667 INFO:tasks.workunit.client.0.smithi107.stdout:4/926: chown dc/d13/d40/d46/d48/d70/dc5/ldc 86497435 1 2024-09-21T08:02:55.668 INFO:tasks.workunit.client.0.smithi107.stdout:4/927: mkdir dc/d13/d40/d5e/d98/dbe/d129 0 2024-09-21T08:02:55.677 INFO:tasks.workunit.client.0.smithi107.stdout:4/928: dread dc/d13/d40/f52 [0,4194304] 0 2024-09-21T08:02:55.679 INFO:tasks.workunit.client.0.smithi107.stdout:4/929: mkdir dc/d13/d40/d5e/d77/d12a 0 2024-09-21T08:02:55.683 INFO:tasks.workunit.client.0.smithi107.stdout:4/930: creat dc/f12b x:0 0 0 2024-09-21T08:02:55.683 INFO:tasks.workunit.client.0.smithi107.stdout:4/931: stat dc/d13/d40/dcc/l105 0 2024-09-21T08:02:55.687 INFO:tasks.workunit.client.0.smithi107.stdout:4/932: truncate dc/d13/f57 1874292 0 2024-09-21T08:02:55.689 INFO:tasks.workunit.client.0.smithi107.stdout:4/933: symlink dc/d13/d40/d46/d48/d10c/l12c 0 2024-09-21T08:02:55.689 INFO:tasks.workunit.client.0.smithi107.stdout:4/934: fdatasync dc/d13/d40/d80/f121 0 2024-09-21T08:02:55.690 INFO:tasks.workunit.client.0.smithi107.stdout:4/935: mknod dc/d13/d40/d5e/d6e/c12d 0 2024-09-21T08:02:55.690 INFO:tasks.workunit.client.0.smithi107.stdout:4/936: truncate dc/d13/d5a/d110/f120 660592 0 2024-09-21T08:02:55.703 INFO:tasks.workunit.client.0.smithi107.stdout:4/937: dread dc/d64/f79 [0,4194304] 0 2024-09-21T08:02:55.703 INFO:tasks.workunit.client.0.smithi107.stdout:4/938: truncate dc/d13/d40/d46/f82 3770643 0 2024-09-21T08:02:55.705 INFO:tasks.workunit.client.0.smithi107.stdout:4/939: write dc/d60/f8b [4862617,81852] 0 2024-09-21T08:02:55.705 INFO:tasks.workunit.client.0.smithi107.stdout:4/940: read dc/d13/d40/d5e/d77/d99/daa/f109 [412393,125741] 0 2024-09-21T08:02:55.705 INFO:tasks.workunit.client.0.smithi107.stdout:4/941: getdents dc/d13/d40/d5e/d77/d99/d11c 0 2024-09-21T08:02:55.705 INFO:tasks.workunit.client.0.smithi107.stdout:4/942: fdatasync dc/d13/d40/d5e/d77/fa9 0 2024-09-21T08:02:55.718 INFO:tasks.workunit.client.0.smithi107.stdout:4/943: dwrite dc/d13/d40/d80/f121 [0,4194304] 0 2024-09-21T08:02:55.722 INFO:tasks.workunit.client.0.smithi107.stdout:4/944: mknod dc/d64/d6b/c12e 0 2024-09-21T08:02:55.722 INFO:tasks.workunit.client.0.smithi107.stdout:4/945: fsync dc/fe4 0 2024-09-21T08:02:55.724 INFO:tasks.workunit.client.0.smithi107.stdout:4/946: unlink dc/d13/d40/d5e/ce3 0 2024-09-21T08:02:55.732 INFO:tasks.workunit.client.0.smithi107.stdout:4/947: dread dc/f1e [0,4194304] 0 2024-09-21T08:02:55.734 INFO:tasks.workunit.client.0.smithi107.stdout:4/948: getdents dc/d13/d40/dcc 0 2024-09-21T08:02:55.734 INFO:tasks.workunit.client.0.smithi107.stdout:4/949: write dc/d13/d40/d46/d48/d10c/f11b [1087067,67151] 0 2024-09-21T08:02:55.792 INFO:tasks.workunit.client.0.smithi107.stdout:0/871: sync 2024-09-21T08:02:55.792 INFO:tasks.workunit.client.0.smithi107.stdout:0/872: stat d1/d5/d25/d3d/d20/d29/d55/fac 0 2024-09-21T08:02:55.817 INFO:tasks.workunit.client.0.smithi107.stdout:0/873: dwrite d1/d5/d25/d3d/d20/d29/f94 [0,4194304] 0 2024-09-21T08:02:55.817 INFO:tasks.workunit.client.0.smithi107.stdout:0/874: chown d1/d5/d25/d3d/d20/da0/led 125 1 2024-09-21T08:02:55.819 INFO:tasks.workunit.client.0.smithi107.stdout:0/875: rmdir d1/d5/d25/d2d 39 2024-09-21T08:02:55.844 INFO:tasks.workunit.client.0.smithi107.stdout:0/876: truncate d1/d5/d25/d3d/d20/d85/fe8 2730825 0 2024-09-21T08:02:55.873 INFO:tasks.workunit.client.0.smithi107.stdout:0/877: dwrite d1/d5/d25/fbe [0,4194304] 0 2024-09-21T08:02:55.877 INFO:tasks.workunit.client.0.smithi107.stdout:0/878: mkdir d1/d5/d25/d3d/d124 0 2024-09-21T08:02:55.880 INFO:tasks.workunit.client.0.smithi107.stdout:0/879: creat d1/d5/d25/d3d/d20/d29/d5c/d11c/f125 x:0 0 0 2024-09-21T08:02:55.880 INFO:tasks.workunit.client.0.smithi107.stdout:0/880: fdatasync d1/d5/d25/d3d/d20/d29/d5c/d11c/f125 0 2024-09-21T08:02:55.880 INFO:tasks.workunit.client.0.smithi107.stdout:0/881: dread - d1/d5/d25/d3d/d20/d85/da8/f106 zero size 2024-09-21T08:02:55.881 INFO:tasks.workunit.client.0.smithi107.stdout:0/882: truncate d1/d5/d25/d3d/d20/f7d 4541235 0 2024-09-21T08:02:55.882 INFO:tasks.workunit.client.0.smithi107.stdout:0/883: creat d1/d5/d25/d3d/f126 x:0 0 0 2024-09-21T08:02:55.885 INFO:tasks.workunit.client.0.smithi107.stdout:0/884: mkdir d1/d5/d25/d3d/d20/d85/d8a/d127 0 2024-09-21T08:02:55.890 INFO:tasks.workunit.client.0.smithi107.stdout:0/885: rename d1/d5/d25/d3d/d20/fc3 to d1/d5/d25/d3d/d20/d29/d55/d91/d9a/dd1/f128 0 2024-09-21T08:02:55.893 INFO:tasks.workunit.client.0.smithi107.stdout:0/886: rmdir d1/d5/d25/d3d/d20/d85 39 2024-09-21T08:02:55.895 INFO:tasks.workunit.client.0.smithi107.stdout:0/887: rename d1/d5/d25/d2d/dec to d1/d5/d25/d3d/d20/d29/d5c/dc2/d129 0 2024-09-21T08:02:55.897 INFO:tasks.workunit.client.0.smithi107.stdout:0/888: creat d1/d5/d25/d3d/d20/d85/de1/df9/f12a x:0 0 0 2024-09-21T08:02:55.898 INFO:tasks.workunit.client.0.smithi107.stdout:0/889: creat d1/d5/d25/d9e/d11b/f12b x:0 0 0 2024-09-21T08:02:55.900 INFO:tasks.workunit.client.0.smithi107.stdout:0/890: creat d1/d5/f12c x:0 0 0 2024-09-21T08:02:55.900 INFO:tasks.workunit.client.0.smithi107.stdout:0/891: fsync d1/d5/d75/ff4 0 2024-09-21T08:02:55.941 INFO:tasks.workunit.client.0.smithi107.stdout:7/707: sync 2024-09-21T08:02:55.942 INFO:tasks.workunit.client.0.smithi107.stdout:7/708: truncate d7/d22/d37/fcf 1089612 0 2024-09-21T08:02:55.943 INFO:tasks.workunit.client.0.smithi107.stdout:7/709: stat d7/d22/d37/d5a/l73 0 2024-09-21T08:02:56.037 INFO:tasks.workunit.client.0.smithi107.stdout:6/899: sync 2024-09-21T08:02:56.037 INFO:tasks.workunit.client.0.smithi107.stdout:3/890: sync 2024-09-21T08:02:56.037 INFO:tasks.workunit.client.0.smithi107.stdout:8/915: sync 2024-09-21T08:02:56.037 INFO:tasks.workunit.client.0.smithi107.stdout:3/891: chown d8/d25/d3d/d72/d80/d5d/d6e/cab 4219 1 2024-09-21T08:02:56.038 INFO:tasks.workunit.client.0.smithi107.stdout:6/900: unlink d2/d3/d7/d24/d41/ce3 0 2024-09-21T08:02:56.039 INFO:tasks.workunit.client.0.smithi107.stdout:8/916: rename d5/d44/d5d/d9c/dd7/f13a to d5/d115/f140 0 2024-09-21T08:02:56.040 INFO:tasks.workunit.client.0.smithi107.stdout:3/892: mkdir d8/d87/d127 0 2024-09-21T08:02:56.041 INFO:tasks.workunit.client.0.smithi107.stdout:8/917: symlink d5/d2e/dab/l141 0 2024-09-21T08:02:56.043 INFO:tasks.workunit.client.0.smithi107.stdout:6/901: rename d2/d3/d7/d54/d5c/fa8 to d2/d3/d7/d54/dae/f129 0 2024-09-21T08:02:56.044 INFO:tasks.workunit.client.0.smithi107.stdout:3/893: rmdir d8/d25/d42/dae 39 2024-09-21T08:02:56.046 INFO:tasks.workunit.client.0.smithi107.stdout:8/918: symlink d5/d40/d8a/ded/d116/l142 0 2024-09-21T08:02:56.046 INFO:tasks.workunit.client.0.smithi107.stdout:8/919: dread - d5/d44/d5d/d9c/fe2 zero size 2024-09-21T08:02:56.046 INFO:tasks.workunit.client.0.smithi107.stdout:6/902: truncate d2/d3/d7/d54/d5c/fab 2037575 0 2024-09-21T08:02:56.047 INFO:tasks.workunit.client.0.smithi107.stdout:6/903: read d2/d3/d7/d48/f68 [4504508,46793] 0 2024-09-21T08:02:56.050 INFO:tasks.workunit.client.0.smithi107.stdout:3/894: rename d8/d38/lb5 to d8/d25/l128 0 2024-09-21T08:02:56.050 INFO:tasks.workunit.client.0.smithi107.stdout:3/895: stat d8/d38 0 2024-09-21T08:02:56.050 INFO:tasks.workunit.client.0.smithi107.stdout:3/896: chown d8/d25/d3d/f51 4320 1 2024-09-21T08:02:56.050 INFO:tasks.workunit.client.0.smithi107.stdout:3/897: dread - d8/d25/d42/dae/db1/ff8 zero size 2024-09-21T08:02:56.050 INFO:tasks.workunit.client.0.smithi107.stdout:3/898: chown d8/d2b/d52/fb6 131517 1 2024-09-21T08:02:56.050 INFO:tasks.workunit.client.0.smithi107.stdout:3/899: chown d8/d44/c74 1088606 1 2024-09-21T08:02:56.051 INFO:tasks.workunit.client.0.smithi107.stdout:8/920: dread d5/d2e/d7c/d9a/d98/fb4 [0,4194304] 0 2024-09-21T08:02:56.051 INFO:tasks.workunit.client.0.smithi107.stdout:3/900: unlink d8/d2b/f3b 0 2024-09-21T08:02:56.051 INFO:tasks.workunit.client.0.smithi107.stdout:3/901: write d8/d2b/d10c/fff [357558,129602] 0 2024-09-21T08:02:56.054 INFO:tasks.workunit.client.0.smithi107.stdout:8/921: mkdir d5/d2e/d94/d143 0 2024-09-21T08:02:56.054 INFO:tasks.workunit.client.0.smithi107.stdout:8/922: chown d5/d2e/d89/lcd 4652999 1 2024-09-21T08:02:56.054 INFO:tasks.workunit.client.0.smithi107.stdout:8/923: fsync d5/d2e/ddc/fdd 0 2024-09-21T08:02:56.056 INFO:tasks.workunit.client.0.smithi107.stdout:3/902: link d8/f122 d8/d25/d34/f129 0 2024-09-21T08:02:56.057 INFO:tasks.workunit.client.0.smithi107.stdout:6/904: write d2/d3/d7/d23/d2b/f2f [4044440,48987] 0 2024-09-21T08:02:56.057 INFO:tasks.workunit.client.0.smithi107.stdout:6/905: rename d2/d3/d7/d24 to d2/d3/d7/d24/d41/d12a 22 2024-09-21T08:02:56.059 INFO:tasks.workunit.client.0.smithi107.stdout:3/903: creat d8/d44/dad/f12a x:0 0 0 2024-09-21T08:02:56.063 INFO:tasks.workunit.client.0.smithi107.stdout:3/904: unlink d8/d25/d3d/d72/cc0 0 2024-09-21T08:02:56.065 INFO:tasks.workunit.client.0.smithi107.stdout:3/905: write d8/d2b/d52/d71/db3/fb9 [357994,403] 0 2024-09-21T08:02:56.065 INFO:tasks.workunit.client.0.smithi107.stdout:3/906: creat d8/d25/d3d/d72/f12b x:0 0 0 2024-09-21T08:02:56.067 INFO:tasks.workunit.client.0.smithi107.stdout:8/924: dread d5/d23/f9d [0,4194304] 0 2024-09-21T08:02:56.067 INFO:tasks.workunit.client.0.smithi107.stdout:6/906: dread d2/d3/d7/d24/d41/d50/f91 [0,4194304] 0 2024-09-21T08:02:56.070 INFO:tasks.workunit.client.0.smithi107.stdout:3/907: truncate d8/f8a 514944 0 2024-09-21T08:02:56.073 INFO:tasks.workunit.client.0.smithi107.stdout:6/907: creat d2/d3/d7/d48/da3/d85/d9d/d10b/d117/f12b x:0 0 0 2024-09-21T08:02:56.073 INFO:tasks.workunit.client.0.smithi107.stdout:6/908: creat d2/d2e/f12c x:0 0 0 2024-09-21T08:02:56.073 INFO:tasks.workunit.client.0.smithi107.stdout:6/909: fdatasync d2/d3/d7/d48/da3/d85/dd9/f10d 0 2024-09-21T08:02:56.073 INFO:tasks.workunit.client.0.smithi107.stdout:6/910: readlink d2/d3/d7/d54/lc0 0 2024-09-21T08:02:56.086 INFO:tasks.workunit.client.0.smithi107.stdout:3/908: write d8/d14/f54 [3689008,69443] 0 2024-09-21T08:02:56.086 INFO:tasks.workunit.client.0.smithi107.stdout:3/909: stat d8/d2b/d45/dcc/l11f 0 2024-09-21T08:02:56.086 INFO:tasks.workunit.client.0.smithi107.stdout:3/910: write d8/d2b/d52/d71/fc8 [900235,122253] 0 2024-09-21T08:02:56.086 INFO:tasks.workunit.client.0.smithi107.stdout:3/911: getdents d8/d25/d3d/d72/d80/d5d 0 2024-09-21T08:02:56.087 INFO:tasks.workunit.client.0.smithi107.stdout:6/911: getdents d2/d3/d7/d54 0 2024-09-21T08:02:56.089 INFO:tasks.workunit.client.0.smithi107.stdout:8/925: dwrite d5/d40/fba [4194304,4194304] 0 2024-09-21T08:02:56.090 INFO:tasks.workunit.client.0.smithi107.stdout:3/912: creat d8/d25/d34/ddc/f12c x:0 0 0 2024-09-21T08:02:56.090 INFO:tasks.workunit.client.0.smithi107.stdout:3/913: fsync d8/d21/f4c 0 2024-09-21T08:02:56.093 INFO:tasks.workunit.client.0.smithi107.stdout:8/926: creat d5/d44/d5d/d9c/dd7/f144 x:0 0 0 2024-09-21T08:02:56.097 INFO:tasks.workunit.client.0.smithi107.stdout:8/927: unlink d5/l10 0 2024-09-21T08:02:56.097 INFO:tasks.workunit.client.0.smithi107.stdout:8/928: fsync d5/d2e/d94/fbf 0 2024-09-21T08:02:56.097 INFO:tasks.workunit.client.0.smithi107.stdout:8/929: truncate d5/d44/d47/f114 791774 0 2024-09-21T08:02:56.100 INFO:tasks.workunit.client.0.smithi107.stdout:8/930: unlink d5/d1d/f4d 0 2024-09-21T08:02:56.101 INFO:tasks.workunit.client.0.smithi107.stdout:8/931: readlink d5/d38/d56/d54/l10b 0 2024-09-21T08:02:56.101 INFO:tasks.workunit.client.0.smithi107.stdout:3/914: dread d8/d25/d42/f86 [0,4194304] 0 2024-09-21T08:02:56.102 INFO:tasks.workunit.client.0.smithi107.stdout:6/912: dwrite d2/fcd [0,4194304] 0 2024-09-21T08:02:56.104 INFO:tasks.workunit.client.0.smithi107.stdout:3/915: dread d8/d2b/d45/dcc/fc7 [0,4194304] 0 2024-09-21T08:02:56.104 INFO:tasks.workunit.client.0.smithi107.stdout:6/913: dread d2/d3/d7/d48/d65/d109/f123 [0,4194304] 0 2024-09-21T08:02:56.104 INFO:tasks.workunit.client.0.smithi107.stdout:6/914: truncate d2/d3/d7/d23/d2b/d84/fc5 4042780 0 2024-09-21T08:02:56.104 INFO:tasks.workunit.client.0.smithi107.stdout:8/932: dread d5/d2e/d7c/d9a/f6a [0,4194304] 0 2024-09-21T08:02:56.105 INFO:tasks.workunit.client.0.smithi107.stdout:8/933: write d5/d2e/d7c/d9a/d98/fb4 [2848628,85597] 0 2024-09-21T08:02:56.105 INFO:tasks.workunit.client.0.smithi107.stdout:8/934: truncate d5/d44/d5d/f11f 391043 0 2024-09-21T08:02:56.107 INFO:tasks.workunit.client.0.smithi107.stdout:8/935: dread d5/d38/d56/d54/fae [0,4194304] 0 2024-09-21T08:02:56.108 INFO:tasks.workunit.client.0.smithi107.stdout:3/916: link d8/lee d8/d2b/d52/d71/db3/dc2/l12d 0 2024-09-21T08:02:56.113 INFO:tasks.workunit.client.0.smithi107.stdout:6/915: mkdir d2/d3/d7/d12d 0 2024-09-21T08:02:56.118 INFO:tasks.workunit.client.0.smithi107.stdout:6/916: mkdir d2/d3/d7/d54/dae/d108/d12e 0 2024-09-21T08:02:56.126 INFO:tasks.workunit.client.0.smithi107.stdout:8/936: dwrite d5/f5c [0,4194304] 0 2024-09-21T08:02:56.134 INFO:tasks.workunit.client.0.smithi107.stdout:8/937: dread d5/f72 [0,4194304] 0 2024-09-21T08:02:56.135 INFO:tasks.workunit.client.0.smithi107.stdout:8/938: mkdir d5/d38/d56/d52/d145 0 2024-09-21T08:02:56.136 INFO:tasks.workunit.client.0.smithi107.stdout:8/939: stat d5/db9/lc1 0 2024-09-21T08:02:56.136 INFO:tasks.workunit.client.0.smithi107.stdout:8/940: write d5/d38/d56/d54/fae [900102,36981] 0 2024-09-21T08:02:56.140 INFO:tasks.workunit.client.0.smithi107.stdout:3/917: dwrite d8/d25/d3d/d72/d80/f102 [4194304,4194304] 0 2024-09-21T08:02:56.140 INFO:tasks.workunit.client.0.smithi107.stdout:6/917: dwrite d2/d2e/d97/fef [0,4194304] 0 2024-09-21T08:02:56.140 INFO:tasks.workunit.client.0.smithi107.stdout:6/918: stat d2/d3/d7/d23/d2b/c4d 0 2024-09-21T08:02:56.142 INFO:tasks.workunit.client.0.smithi107.stdout:3/918: getdents d8/d2b/d52/d71/dd8 0 2024-09-21T08:02:56.144 INFO:tasks.workunit.client.0.smithi107.stdout:6/919: unlink d2/d3/d7/d54/dae/cfe 0 2024-09-21T08:02:56.161 INFO:tasks.workunit.client.0.smithi107.stdout:8/941: dwrite d5/d2e/f51 [0,4194304] 0 2024-09-21T08:02:56.164 INFO:tasks.workunit.client.0.smithi107.stdout:3/919: dwrite d8/d25/d3d/d72/d11d/f124 [0,4194304] 0 2024-09-21T08:02:56.166 INFO:tasks.workunit.client.0.smithi107.stdout:8/942: mkdir d5/d44/d47/d121/d146 0 2024-09-21T08:02:56.169 INFO:tasks.workunit.client.0.smithi107.stdout:3/920: truncate d8/d21/f10f 3668713 0 2024-09-21T08:02:56.170 INFO:tasks.workunit.client.0.smithi107.stdout:8/943: mknod d5/d2e/ddc/c147 0 2024-09-21T08:02:56.172 INFO:tasks.workunit.client.0.smithi107.stdout:3/921: creat d8/d25/f12e x:0 0 0 2024-09-21T08:02:56.175 INFO:tasks.workunit.client.0.smithi107.stdout:3/922: dread d8/d44/dad/fde [0,4194304] 0 2024-09-21T08:02:56.175 INFO:tasks.workunit.client.0.smithi107.stdout:8/944: rmdir d5/d40/d8a 39 2024-09-21T08:02:56.175 INFO:tasks.workunit.client.0.smithi107.stdout:8/945: chown d5/d44/l82 0 1 2024-09-21T08:02:56.179 INFO:tasks.workunit.client.0.smithi107.stdout:8/946: mknod d5/d40/d8a/c148 0 2024-09-21T08:02:56.180 INFO:tasks.workunit.client.0.smithi107.stdout:8/947: fdatasync d5/f72 0 2024-09-21T08:02:56.180 INFO:tasks.workunit.client.0.smithi107.stdout:8/948: stat d5/d38/d56/d54/dce 0 2024-09-21T08:02:56.181 INFO:tasks.workunit.client.0.smithi107.stdout:3/923: getdents d8/d25/d3d/d72/d80 0 2024-09-21T08:02:56.181 INFO:tasks.workunit.client.0.smithi107.stdout:3/924: readlink d8/d25/d34/l7a 0 2024-09-21T08:02:56.184 INFO:tasks.workunit.client.0.smithi107.stdout:3/925: mknod d8/d25/d3d/d72/d80/d5d/d6e/d10b/c12f 0 2024-09-21T08:02:56.202 INFO:tasks.workunit.client.0.smithi107.stdout:8/949: dwrite d5/d2e/fde [0,4194304] 0 2024-09-21T08:02:56.202 INFO:tasks.workunit.client.0.smithi107.stdout:8/950: fsync d5/d44/d5d/f68 0 2024-09-21T08:02:56.204 INFO:tasks.workunit.client.0.smithi107.stdout:8/951: mknod d5/d44/d5d/c149 0 2024-09-21T08:02:56.206 INFO:tasks.workunit.client.0.smithi107.stdout:3/926: dwrite d8/f30 [0,4194304] 0 2024-09-21T08:02:56.215 INFO:tasks.workunit.client.0.smithi107.stdout:8/952: truncate d5/d40/fba 3432619 0 2024-09-21T08:02:56.216 INFO:tasks.workunit.client.0.smithi107.stdout:8/953: symlink d5/d44/l14a 0 2024-09-21T08:02:56.217 INFO:tasks.workunit.client.0.smithi107.stdout:8/954: chown d5/d44/d5d/f68 848057417 1 2024-09-21T08:02:56.217 INFO:tasks.workunit.client.0.smithi107.stdout:8/955: write d5/d1d/f5b [2602292,82952] 0 2024-09-21T08:02:56.217 INFO:tasks.workunit.client.0.smithi107.stdout:8/956: write d5/f5c [5865774,78268] 0 2024-09-21T08:02:56.218 INFO:tasks.workunit.client.0.smithi107.stdout:8/957: mkdir d5/d40/d8a/dcb/dfb/d14b 0 2024-09-21T08:02:56.221 INFO:tasks.workunit.client.0.smithi107.stdout:8/958: rmdir d5/d38/d67/d7d/d10f 39 2024-09-21T08:02:56.225 INFO:tasks.workunit.client.0.smithi107.stdout:8/959: truncate d5/d38/d56/d54/f80 1199233 0 2024-09-21T08:02:56.249 INFO:tasks.workunit.client.0.smithi107.stdout:3/927: dwrite d8/d44/dad/f12a [0,4194304] 0 2024-09-21T08:02:56.249 INFO:tasks.workunit.client.0.smithi107.stdout:3/928: read d8/d2b/d45/dcc/f1e [3140680,114970] 0 2024-09-21T08:02:56.260 INFO:tasks.workunit.client.0.smithi107.stdout:2/987: sync 2024-09-21T08:02:56.260 INFO:tasks.workunit.client.0.smithi107.stdout:1/863: sync 2024-09-21T08:02:56.260 INFO:tasks.workunit.client.0.smithi107.stdout:4/950: sync 2024-09-21T08:02:56.260 INFO:tasks.workunit.client.0.smithi107.stdout:4/951: fdatasync dc/d13/d40/d80/f121 0 2024-09-21T08:02:56.267 INFO:tasks.workunit.client.0.smithi107.stdout:3/929: mknod d8/d2b/d91/df2/c130 0 2024-09-21T08:02:56.268 INFO:tasks.workunit.client.0.smithi107.stdout:3/930: write d8/d2b/d45/f10d [163192,42353] 0 2024-09-21T08:02:56.271 INFO:tasks.workunit.client.0.smithi107.stdout:2/988: creat d1/d16/d35/f14a x:0 0 0 2024-09-21T08:02:56.272 INFO:tasks.workunit.client.0.smithi107.stdout:2/989: write d1/d2/d6d/d37/f65 [3638252,50616] 0 2024-09-21T08:02:56.272 INFO:tasks.workunit.client.0.smithi107.stdout:4/952: symlink dc/d64/l12f 0 2024-09-21T08:02:56.274 INFO:tasks.workunit.client.0.smithi107.stdout:3/931: link d8/f8a d8/d14/d96/f131 0 2024-09-21T08:02:56.274 INFO:tasks.workunit.client.0.smithi107.stdout:3/932: readlink d8/d44/l9a 0 2024-09-21T08:02:56.274 INFO:tasks.workunit.client.0.smithi107.stdout:3/933: write d8/d2b/d52/d55/fe0 [449380,82745] 0 2024-09-21T08:02:56.275 INFO:tasks.workunit.client.0.smithi107.stdout:1/864: symlink d0/l122 0 2024-09-21T08:02:56.275 INFO:tasks.workunit.client.0.smithi107.stdout:1/865: dread - d0/d19/d2b/d4b/d44/d55/d64/f9c zero size 2024-09-21T08:02:56.277 INFO:tasks.workunit.client.0.smithi107.stdout:2/990: mkdir d1/d2/d6d/d37/d49/d7f/d111/d14b 0 2024-09-21T08:02:56.277 INFO:tasks.workunit.client.0.smithi107.stdout:2/991: truncate d1/d16/f8b 1859075 0 2024-09-21T08:02:56.277 INFO:tasks.workunit.client.0.smithi107.stdout:4/953: creat dc/d64/f130 x:0 0 0 2024-09-21T08:02:56.278 INFO:tasks.workunit.client.0.smithi107.stdout:4/954: chown dc/d4c/cd2 42 1 2024-09-21T08:02:56.281 INFO:tasks.workunit.client.0.smithi107.stdout:3/934: rename d8/d2b/d52/d71/f84 to d8/d2b/d45/dcc/df5/f132 0 2024-09-21T08:02:56.282 INFO:tasks.workunit.client.0.smithi107.stdout:1/866: mknod d0/d19/d2b/dfd/c123 0 2024-09-21T08:02:56.282 INFO:tasks.workunit.client.0.smithi107.stdout:1/867: read - d0/d19/d39/f102 zero size 2024-09-21T08:02:56.290 INFO:tasks.workunit.client.0.smithi107.stdout:1/868: dread d0/d19/d2b/d4b/f1a [0,4194304] 0 2024-09-21T08:02:56.290 INFO:tasks.workunit.client.0.smithi107.stdout:1/869: write d0/d19/d2b/d86/dc2/fca [429191,34344] 0 2024-09-21T08:02:56.291 INFO:tasks.workunit.client.0.smithi107.stdout:1/870: stat d0/f3c 0 2024-09-21T08:02:56.293 INFO:tasks.workunit.client.0.smithi107.stdout:1/871: symlink d0/d19/d2b/d4b/d44/d72/d36/d8e/dd7/l124 0 2024-09-21T08:02:56.293 INFO:tasks.workunit.client.0.smithi107.stdout:1/872: chown d0/d19/d2b/d4b/d61/d75/cf4 15 1 2024-09-21T08:02:56.295 INFO:tasks.workunit.client.0.smithi107.stdout:1/873: dread d0/dc6/fb2 [0,4194304] 0 2024-09-21T08:02:56.302 INFO:tasks.workunit.client.0.smithi107.stdout:3/935: write d8/d21/f88 [93168,18724] 0 2024-09-21T08:02:56.303 INFO:tasks.workunit.client.0.smithi107.stdout:1/874: dread d0/d19/d2b/d4b/d44/d72/f78 [0,4194304] 0 2024-09-21T08:02:56.303 INFO:tasks.workunit.client.0.smithi107.stdout:3/936: rename d8/d2b/d45/dbf/fd1 to d8/d25/d42/f133 0 2024-09-21T08:02:56.304 INFO:tasks.workunit.client.0.smithi107.stdout:1/875: mknod d0/dc6/c125 0 2024-09-21T08:02:56.306 INFO:tasks.workunit.client.0.smithi107.stdout:3/937: mkdir d8/d2b/d52/d55/d134 0 2024-09-21T08:02:56.306 INFO:tasks.workunit.client.0.smithi107.stdout:3/938: write d8/d2b/d52/d71/db3/fb9 [158101,56430] 0 2024-09-21T08:02:56.308 INFO:tasks.workunit.client.0.smithi107.stdout:3/939: unlink d8/d21/f88 0 2024-09-21T08:02:56.308 INFO:tasks.workunit.client.0.smithi107.stdout:3/940: chown d8/d25/d3d/ffb 4 1 2024-09-21T08:02:56.308 INFO:tasks.workunit.client.0.smithi107.stdout:3/941: fdatasync d8/d25/f12e 0 2024-09-21T08:02:56.309 INFO:tasks.workunit.client.0.smithi107.stdout:3/942: mknod d8/d25/d34/c135 0 2024-09-21T08:02:56.311 INFO:tasks.workunit.client.0.smithi107.stdout:3/943: creat d8/d38/f136 x:0 0 0 2024-09-21T08:02:56.311 INFO:tasks.workunit.client.0.smithi107.stdout:2/992: dwrite d1/d2/d6d/d37/d49/dde/f13d [4194304,4194304] 0 2024-09-21T08:02:56.311 INFO:tasks.workunit.client.0.smithi107.stdout:4/955: dwrite dc/d13/d40/d5e/d98/dbf/fdf [0,4194304] 0 2024-09-21T08:02:56.311 INFO:tasks.workunit.client.0.smithi107.stdout:3/944: rmdir d8/d2b/d45/dcc/daa 39 2024-09-21T08:02:56.311 INFO:tasks.workunit.client.0.smithi107.stdout:3/945: dread - d8/d2b/d91/df2/d113/f125 zero size 2024-09-21T08:02:56.317 INFO:tasks.workunit.client.0.smithi107.stdout:4/956: symlink dc/d13/l131 0 2024-09-21T08:02:56.319 INFO:tasks.workunit.client.0.smithi107.stdout:1/876: dwrite d0/d19/d2b/d4b/d44/f10f [0,4194304] 0 2024-09-21T08:02:56.322 INFO:tasks.workunit.client.0.smithi107.stdout:3/946: getdents d8/d44 0 2024-09-21T08:02:56.325 INFO:tasks.workunit.client.0.smithi107.stdout:3/947: write d8/d87/fa7 [1392725,100365] 0 2024-09-21T08:02:56.332 INFO:tasks.workunit.client.0.smithi107.stdout:1/877: mknod d0/d19/d2b/d4b/d44/d55/c126 0 2024-09-21T08:02:56.333 INFO:tasks.workunit.client.0.smithi107.stdout:4/957: dwrite f8 [0,4194304] 0 2024-09-21T08:02:56.333 INFO:tasks.workunit.client.0.smithi107.stdout:3/948: creat d8/d25/d3d/d72/d80/d5d/f137 x:0 0 0 2024-09-21T08:02:56.334 INFO:tasks.workunit.client.0.smithi107.stdout:3/949: chown d8/d2b/d45/dcc/c2e 344146191 1 2024-09-21T08:02:56.336 INFO:tasks.workunit.client.0.smithi107.stdout:4/958: truncate dc/f1b 3450978 0 2024-09-21T08:02:56.337 INFO:tasks.workunit.client.0.smithi107.stdout:3/950: symlink d8/d2b/d52/d71/dd8/l138 0 2024-09-21T08:02:56.339 INFO:tasks.workunit.client.0.smithi107.stdout:1/878: link d0/d80/cbf d0/d19/d2b/d4b/d61/d75/c127 0 2024-09-21T08:02:56.340 INFO:tasks.workunit.client.0.smithi107.stdout:2/993: truncate d1/f10d 7466484 0 2024-09-21T08:02:56.341 INFO:tasks.workunit.client.0.smithi107.stdout:2/994: stat d1/d2/d6d/d37/d49/lf3 0 2024-09-21T08:02:56.341 INFO:tasks.workunit.client.0.smithi107.stdout:2/995: dread - d1/d2/d6d/f118 zero size 2024-09-21T08:02:56.341 INFO:tasks.workunit.client.0.smithi107.stdout:1/879: dread d0/d29/d4d/f60 [0,4194304] 0 2024-09-21T08:02:56.341 INFO:tasks.workunit.client.0.smithi107.stdout:4/959: getdents dc/d4c 0 2024-09-21T08:02:56.341 INFO:tasks.workunit.client.0.smithi107.stdout:1/880: write d0/d19/d2b/d4b/d44/d72/f11a [221668,30535] 0 2024-09-21T08:02:56.342 INFO:tasks.workunit.client.0.smithi107.stdout:3/951: link d8/d38/c43 d8/d87/dc9/c139 0 2024-09-21T08:02:56.345 INFO:tasks.workunit.client.0.smithi107.stdout:1/881: symlink d0/d19/l128 0 2024-09-21T08:02:56.346 INFO:tasks.workunit.client.0.smithi107.stdout:3/952: truncate d8/d25/fea 537836 0 2024-09-21T08:02:56.346 INFO:tasks.workunit.client.0.smithi107.stdout:3/953: write d8/d25/f12e [615582,126877] 0 2024-09-21T08:02:56.346 INFO:tasks.workunit.client.0.smithi107.stdout:3/954: write d8/d2b/d45/dcc/fc7 [1293211,4925] 0 2024-09-21T08:02:56.348 INFO:tasks.workunit.client.0.smithi107.stdout:2/996: dread d1/f10 [0,4194304] 0 2024-09-21T08:02:56.348 INFO:tasks.workunit.client.0.smithi107.stdout:2/997: readlink d1/d16/l128 0 2024-09-21T08:02:56.348 INFO:tasks.workunit.client.0.smithi107.stdout:2/998: chown d1/d6/d92/df2/f10e 1953 1 2024-09-21T08:02:56.348 INFO:tasks.workunit.client.0.smithi107.stdout:4/960: dread dc/d13/d40/f4b [0,4194304] 0 2024-09-21T08:02:56.349 INFO:tasks.workunit.client.0.smithi107.stdout:3/955: mkdir d8/d2b/d45/d111/d13a 0 2024-09-21T08:02:56.349 INFO:tasks.workunit.client.0.smithi107.stdout:3/956: chown d8/d2b/d52/d55/l100 2750 1 2024-09-21T08:02:56.352 INFO:tasks.workunit.client.0.smithi107.stdout:2/999: link d1/d2/d6d/d37/d49/d7f/f10b d1/d2/d6d/d11d/f14c 0 2024-09-21T08:02:56.353 INFO:tasks.workunit.client.0.smithi107.stdout:1/882: dread d0/d19/d2b/d4b/d44/f10f [0,4194304] 0 2024-09-21T08:02:56.355 INFO:tasks.workunit.client.0.smithi107.stdout:3/957: rename d8/d25/d34/ddc/f12c to d8/d2b/d45/d111/d13a/f13b 0 2024-09-21T08:02:56.356 INFO:tasks.workunit.client.0.smithi107.stdout:4/961: dread dc/d13/d40/f52 [4194304,4194304] 0 2024-09-21T08:02:56.359 INFO:tasks.workunit.client.0.smithi107.stdout:1/883: mkdir d0/d29/d4d/d84/d129 0 2024-09-21T08:02:56.361 INFO:tasks.workunit.client.0.smithi107.stdout:1/884: truncate d0/d29/d4d/d84/dc5/da9/dc7/db5/fd4 4519830 0 2024-09-21T08:02:56.361 INFO:tasks.workunit.client.0.smithi107.stdout:1/885: chown d0/d19/d2b/d86/dd9 1809802996 1 2024-09-21T08:02:56.361 INFO:tasks.workunit.client.0.smithi107.stdout:1/886: stat d0/d19/d2b/dfd/dfe/df0 0 2024-09-21T08:02:56.363 INFO:tasks.workunit.client.0.smithi107.stdout:1/887: creat d0/d19/d2b/d4b/d44/d72/d36/d8e/f12a x:0 0 0 2024-09-21T08:02:56.365 INFO:tasks.workunit.client.0.smithi107.stdout:1/888: unlink d0/d19/d2b/d86/d95/cb4 0 2024-09-21T08:02:56.366 INFO:tasks.workunit.client.0.smithi107.stdout:3/958: write d8/d2b/d45/f6a [939778,81349] 0 2024-09-21T08:02:56.371 INFO:tasks.workunit.client.0.smithi107.stdout:3/959: dread d8/d2b/d45/f10d [0,4194304] 0 2024-09-21T08:02:56.372 INFO:tasks.workunit.client.0.smithi107.stdout:3/960: write d8/d25/d42/dae/db1/ff8 [198966,119323] 0 2024-09-21T08:02:56.373 INFO:tasks.workunit.client.0.smithi107.stdout:1/889: symlink d0/dce/d11c/l12b 0 2024-09-21T08:02:56.375 INFO:tasks.workunit.client.0.smithi107.stdout:1/890: write d0/d19/f58 [3330961,12606] 0 2024-09-21T08:02:56.376 INFO:tasks.workunit.client.0.smithi107.stdout:1/891: unlink d0/f3c 0 2024-09-21T08:02:56.378 INFO:tasks.workunit.client.0.smithi107.stdout:4/962: dwrite dc/d13/d40/d46/d48/d70/f94 [0,4194304] 0 2024-09-21T08:02:56.378 INFO:tasks.workunit.client.0.smithi107.stdout:4/963: fsync f8 0 2024-09-21T08:02:56.382 INFO:tasks.workunit.client.0.smithi107.stdout:1/892: creat d0/d19/d2b/d4b/d44/d55/f12c x:0 0 0 2024-09-21T08:02:56.385 INFO:tasks.workunit.client.0.smithi107.stdout:3/961: dwrite d8/d25/d3d/f92 [0,4194304] 0 2024-09-21T08:02:56.390 INFO:tasks.workunit.client.0.smithi107.stdout:1/893: rename d0/d29/d31/f42 to d0/d19/d2b/d4b/f12d 0 2024-09-21T08:02:56.395 INFO:tasks.workunit.client.0.smithi107.stdout:1/894: creat d0/dc6/d11e/f12e x:0 0 0 2024-09-21T08:02:56.397 INFO:tasks.workunit.client.0.smithi107.stdout:1/895: chown d0/lbe 15897 1 2024-09-21T08:02:56.397 INFO:tasks.workunit.client.0.smithi107.stdout:1/896: fdatasync d0/d19/f87 0 2024-09-21T08:02:56.398 INFO:tasks.workunit.client.0.smithi107.stdout:4/964: dwrite dc/fd9 [0,4194304] 0 2024-09-21T08:02:56.398 INFO:tasks.workunit.client.0.smithi107.stdout:1/897: dread d0/dc6/fb2 [0,4194304] 0 2024-09-21T08:02:56.401 INFO:tasks.workunit.client.0.smithi107.stdout:4/965: creat dc/d13/d40/d5e/d77/f132 x:0 0 0 2024-09-21T08:02:56.402 INFO:tasks.workunit.client.0.smithi107.stdout:1/898: symlink d0/d19/d2b/d4b/d90/l12f 0 2024-09-21T08:02:56.402 INFO:tasks.workunit.client.0.smithi107.stdout:4/966: write dc/d13/d40/f42 [11610,56878] 0 2024-09-21T08:02:56.403 INFO:tasks.workunit.client.0.smithi107.stdout:3/962: dwrite d8/d2b/d52/d71/db3/fb9 [0,4194304] 0 2024-09-21T08:02:56.404 INFO:tasks.workunit.client.0.smithi107.stdout:1/899: mkdir d0/d19/d130 0 2024-09-21T08:02:56.405 INFO:tasks.workunit.client.0.smithi107.stdout:1/900: chown d0/d19/d2b/f114 67660214 1 2024-09-21T08:02:56.405 INFO:tasks.workunit.client.0.smithi107.stdout:4/967: truncate fa 2121681 0 2024-09-21T08:02:56.406 INFO:tasks.workunit.client.0.smithi107.stdout:4/968: chown dc/d13/d40/d116 187602 1 2024-09-21T08:02:56.406 INFO:tasks.workunit.client.0.smithi107.stdout:4/969: write dc/de8/f115 [307099,59244] 0 2024-09-21T08:02:56.419 INFO:tasks.workunit.client.0.smithi107.stdout:4/970: link dc/d4c/l4e dc/d13/d40/d5e/da8/l133 0 2024-09-21T08:02:56.420 INFO:tasks.workunit.client.0.smithi107.stdout:3/963: dwrite d8/d25/fcd [0,4194304] 0 2024-09-21T08:02:56.421 INFO:tasks.workunit.client.0.smithi107.stdout:4/971: symlink dc/d13/l134 0 2024-09-21T08:02:56.426 INFO:tasks.workunit.client.0.smithi107.stdout:1/901: write d0/dc6/f30 [1355136,91204] 0 2024-09-21T08:02:56.430 INFO:tasks.workunit.client.0.smithi107.stdout:3/964: symlink d8/d2b/d52/d71/dd8/dfd/l13c 0 2024-09-21T08:02:56.431 INFO:tasks.workunit.client.0.smithi107.stdout:3/965: dread - d8/d2b/d91/f126 zero size 2024-09-21T08:02:56.431 INFO:tasks.workunit.client.0.smithi107.stdout:3/966: write d8/d2b/d91/f126 [339602,97202] 0 2024-09-21T08:02:56.431 INFO:tasks.workunit.client.0.smithi107.stdout:7/710: sync 2024-09-21T08:02:56.431 INFO:tasks.workunit.client.0.smithi107.stdout:8/960: sync 2024-09-21T08:02:56.431 INFO:tasks.workunit.client.0.smithi107.stdout:6/920: sync 2024-09-21T08:02:56.431 INFO:tasks.workunit.client.0.smithi107.stdout:0/892: sync 2024-09-21T08:02:56.431 INFO:tasks.workunit.client.0.smithi107.stdout:0/893: chown d1/d5/d25/d3d/da1/le0 246373 1 2024-09-21T08:02:56.431 INFO:tasks.workunit.client.0.smithi107.stdout:6/921: truncate d2/d3/d7/d23/d2b/d84/fb8 634425 0 2024-09-21T08:02:56.431 INFO:tasks.workunit.client.0.smithi107.stdout:6/922: write d2/d2e/d97/ff6 [373022,127936] 0 2024-09-21T08:02:56.431 INFO:tasks.workunit.client.0.smithi107.stdout:4/972: symlink dc/d60/d8c/l135 0 2024-09-21T08:02:56.434 INFO:tasks.workunit.client.0.smithi107.stdout:0/894: truncate d1/d23/f6d 41184 0 2024-09-21T08:02:56.434 INFO:tasks.workunit.client.0.smithi107.stdout:0/895: write d1/d5/d25/d3d/d20/d29/d5c/d11c/f125 [1046487,48023] 0 2024-09-21T08:02:56.435 INFO:tasks.workunit.client.0.smithi107.stdout:8/961: mkdir d5/d38/d56/d52/d145/d14c 0 2024-09-21T08:02:56.436 INFO:tasks.workunit.client.0.smithi107.stdout:6/923: mkdir d2/d3/d7/d12d/d12f 0 2024-09-21T08:02:56.436 INFO:tasks.workunit.client.0.smithi107.stdout:6/924: chown d2/d3/d7/l33 406557 1 2024-09-21T08:02:56.436 INFO:tasks.workunit.client.0.smithi107.stdout:6/925: write d2/d3/d7/fb7 [4730667,96556] 0 2024-09-21T08:02:56.437 INFO:tasks.workunit.client.0.smithi107.stdout:4/973: creat dc/d64/d6b/f136 x:0 0 0 2024-09-21T08:02:56.438 INFO:tasks.workunit.client.0.smithi107.stdout:6/926: write d2/d3/d7/d23/f94 [147940,109353] 0 2024-09-21T08:02:56.442 INFO:tasks.workunit.client.0.smithi107.stdout:8/962: dread d5/d2e/d94/fbf [0,4194304] 0 2024-09-21T08:02:56.443 INFO:tasks.workunit.client.0.smithi107.stdout:7/711: rmdir d7 39 2024-09-21T08:02:56.445 INFO:tasks.workunit.client.0.smithi107.stdout:4/974: link dc/d13/d40/lec dc/d13/d40/d5e/d98/dbf/l137 0 2024-09-21T08:02:56.445 INFO:tasks.workunit.client.0.smithi107.stdout:4/975: write dc/d13/f57 [1609340,27746] 0 2024-09-21T08:02:56.447 INFO:tasks.workunit.client.0.smithi107.stdout:0/896: dread d1/d5/d25/f77 [0,4194304] 0 2024-09-21T08:02:56.447 INFO:tasks.workunit.client.0.smithi107.stdout:0/897: chown d1/d5/l68 94479 1 2024-09-21T08:02:56.447 INFO:tasks.workunit.client.0.smithi107.stdout:8/963: unlink d5/d2e/d7c/d9a/df1/la1 0 2024-09-21T08:02:56.448 INFO:tasks.workunit.client.0.smithi107.stdout:8/964: fsync d5/d2e/fc6 0 2024-09-21T08:02:56.448 INFO:tasks.workunit.client.0.smithi107.stdout:8/965: getdents d5/d2e/dab/d111/d123 0 2024-09-21T08:02:56.448 INFO:tasks.workunit.client.0.smithi107.stdout:8/966: stat d5/d1d/d90/dd5 0 2024-09-21T08:02:56.448 INFO:tasks.workunit.client.0.smithi107.stdout:6/927: write d2/d3/d7/d48/da3/d85/d9d/fd1 [2472817,85230] 0 2024-09-21T08:02:56.449 INFO:tasks.workunit.client.0.smithi107.stdout:7/712: truncate d7/d22/d3d/d8a/fe8 710993 0 2024-09-21T08:02:56.449 INFO:tasks.workunit.client.0.smithi107.stdout:7/713: truncate d7/d22/d3b/fe6 283464 0 2024-09-21T08:02:56.450 INFO:tasks.workunit.client.0.smithi107.stdout:0/898: rename d1/d5/d25/d3d/d20/d29/fc5 to d1/d5/d25/d3d/d20/d85/d8a/f12d 0 2024-09-21T08:02:56.452 INFO:tasks.workunit.client.0.smithi107.stdout:7/714: mkdir d7/d22/d3d/d8a/dd4/df3 0 2024-09-21T08:02:56.453 INFO:tasks.workunit.client.0.smithi107.stdout:6/928: dread d2/d3/d7/d2a/f8b [0,4194304] 0 2024-09-21T08:02:56.453 INFO:tasks.workunit.client.0.smithi107.stdout:6/929: creat d2/d3/d7/d54/d5c/f130 x:0 0 0 2024-09-21T08:02:56.454 INFO:tasks.workunit.client.0.smithi107.stdout:1/902: dwrite d0/d29/f103 [0,4194304] 0 2024-09-21T08:02:56.454 INFO:tasks.workunit.client.0.smithi107.stdout:1/903: chown d0/d19/f3b 6786402 1 2024-09-21T08:02:56.456 INFO:tasks.workunit.client.0.smithi107.stdout:6/930: creat d2/d3/d7/d23/d2b/f131 x:0 0 0 2024-09-21T08:02:56.456 INFO:tasks.workunit.client.0.smithi107.stdout:6/931: chown d2/d3/d7/d48/da3/d85/d9d/dcf/dd8/cfa 232 1 2024-09-21T08:02:56.456 INFO:tasks.workunit.client.0.smithi107.stdout:6/932: chown d2/d3/d7/d54/lc0 1405 1 2024-09-21T08:02:56.456 INFO:tasks.workunit.client.0.smithi107.stdout:6/933: write d2/d3/d7/d54/dae/fee [917789,116315] 0 2024-09-21T08:02:56.456 INFO:tasks.workunit.client.0.smithi107.stdout:6/934: write d2/d2e/db2/d110/f119 [126262,114971] 0 2024-09-21T08:02:56.456 INFO:tasks.workunit.client.0.smithi107.stdout:6/935: read - d2/d3/d7/d23/d2b/f131 zero size 2024-09-21T08:02:56.456 INFO:tasks.workunit.client.0.smithi107.stdout:7/715: mknod d7/d38/cf4 0 2024-09-21T08:02:56.456 INFO:tasks.workunit.client.0.smithi107.stdout:7/716: fsync d7/d22/d3a/d49/df1/fea 0 2024-09-21T08:02:56.459 INFO:tasks.workunit.client.0.smithi107.stdout:1/904: rename d0/d29/d4d/f60 to d0/d19/d2b/d4b/d44/d72/d36/d8e/f131 0 2024-09-21T08:02:56.459 INFO:tasks.workunit.client.0.smithi107.stdout:1/905: readlink d0/d19/l128 0 2024-09-21T08:02:56.461 INFO:tasks.workunit.client.0.smithi107.stdout:6/936: link d2/d3/d7/d24/c93 d2/d2e/c132 0 2024-09-21T08:02:56.461 INFO:tasks.workunit.client.0.smithi107.stdout:7/717: stat d7/dc3/ld6 0 2024-09-21T08:02:56.462 INFO:tasks.workunit.client.0.smithi107.stdout:4/976: dread dc/d13/d40/d5e/d98/dbf/fdf [0,4194304] 0 2024-09-21T08:02:56.463 INFO:tasks.workunit.client.0.smithi107.stdout:3/967: dwrite d8/d44/dad/f12a [0,4194304] 0 2024-09-21T08:02:56.463 INFO:tasks.workunit.client.0.smithi107.stdout:8/967: dread d5/d2e/f51 [0,4194304] 0 2024-09-21T08:02:56.463 INFO:tasks.workunit.client.0.smithi107.stdout:3/968: stat d8/d38/fd3 0 2024-09-21T08:02:56.469 INFO:tasks.workunit.client.0.smithi107.stdout:8/968: write d5/d2e/f51 [3864202,35287] 0 2024-09-21T08:02:56.470 INFO:tasks.workunit.client.0.smithi107.stdout:6/937: mknod d2/d3/d7/d48/da3/d85/d9d/dcf/dd8/c133 0 2024-09-21T08:02:56.470 INFO:tasks.workunit.client.0.smithi107.stdout:6/938: chown d2/d2e/d97/c83 25254 1 2024-09-21T08:02:56.471 INFO:tasks.workunit.client.0.smithi107.stdout:7/718: mknod d7/d22/d3a/d49/df1/cf5 0 2024-09-21T08:02:56.474 INFO:tasks.workunit.client.0.smithi107.stdout:1/906: read d0/d29/d4d/d84/dc5/d5e/f69 [479270,27973] 0 2024-09-21T08:02:56.475 INFO:tasks.workunit.client.0.smithi107.stdout:4/977: symlink dc/d4c/l138 0 2024-09-21T08:02:56.484 INFO:tasks.workunit.client.0.smithi107.stdout:8/969: mknod d5/d38/d56/da3/c14d 0 2024-09-21T08:02:56.485 INFO:tasks.workunit.client.0.smithi107.stdout:1/907: mkdir d0/d19/d2b/d4b/d5b/dcb/ded/d132 0 2024-09-21T08:02:56.486 INFO:tasks.workunit.client.0.smithi107.stdout:4/978: rename dc/d13/d40/d5e/da8/fd6 to dc/d13/d40/d46/d48/d70/dc5/d90/f139 0 2024-09-21T08:02:56.487 INFO:tasks.workunit.client.0.smithi107.stdout:8/970: fsync d5/d44/d47/f4e 0 2024-09-21T08:02:56.487 INFO:tasks.workunit.client.0.smithi107.stdout:8/971: dread - d5/d2e/ddc/fdd zero size 2024-09-21T08:02:56.488 INFO:tasks.workunit.client.0.smithi107.stdout:1/908: symlink d0/d29/d4d/d84/dc5/d5e/d115/l133 0 2024-09-21T08:02:56.489 INFO:tasks.workunit.client.0.smithi107.stdout:8/972: symlink d5/d40/d8a/dcb/d132/l14e 0 2024-09-21T08:02:56.490 INFO:tasks.workunit.client.0.smithi107.stdout:8/973: link d5/d38/d56/d52/d7a/l110 d5/d2e/ddc/d125/l14f 0 2024-09-21T08:02:56.499 INFO:tasks.workunit.client.0.smithi107.stdout:8/974: write d5/f12 [272350,13795] 0 2024-09-21T08:02:56.499 INFO:tasks.workunit.client.0.smithi107.stdout:8/975: dread - d5/d2e/fc6 zero size 2024-09-21T08:02:56.499 INFO:tasks.workunit.client.0.smithi107.stdout:7/719: dwrite d7/d22/d3d/d8a/f8d [4194304,4194304] 0 2024-09-21T08:02:56.499 INFO:tasks.workunit.client.0.smithi107.stdout:7/720: write d7/d22/d3a/fe0 [7844087,66226] 0 2024-09-21T08:02:56.500 INFO:tasks.workunit.client.0.smithi107.stdout:6/939: dwrite d2/d3/d7/d23/ff0 [0,4194304] 0 2024-09-21T08:02:56.500 INFO:tasks.workunit.client.0.smithi107.stdout:3/969: dwrite d8/d25/d3d/f51 [0,4194304] 0 2024-09-21T08:02:56.500 INFO:tasks.workunit.client.0.smithi107.stdout:4/979: write dc/d64/d6b/dcf/fd3 [2754060,60003] 0 2024-09-21T08:02:56.500 INFO:tasks.workunit.client.0.smithi107.stdout:6/940: fsync d2/d3/d7/d54/d5c/fc8 0 2024-09-21T08:02:56.502 INFO:tasks.workunit.client.0.smithi107.stdout:1/909: write d0/d19/d2b/d4b/f1a [1903792,44042] 0 2024-09-21T08:02:56.503 INFO:tasks.workunit.client.0.smithi107.stdout:7/721: creat d7/d18/ff6 x:0 0 0 2024-09-21T08:02:56.505 INFO:tasks.workunit.client.0.smithi107.stdout:7/722: dread d7/d22/d3a/d49/df1/fea [0,4194304] 0 2024-09-21T08:02:56.505 INFO:tasks.workunit.client.0.smithi107.stdout:4/980: rmdir dc/d60 39 2024-09-21T08:02:56.505 INFO:tasks.workunit.client.0.smithi107.stdout:4/981: read dc/d13/d40/d5e/d77/fe5 [189060,103738] 0 2024-09-21T08:02:56.506 INFO:tasks.workunit.client.0.smithi107.stdout:4/982: read dc/de8/f115 [15997,83392] 0 2024-09-21T08:02:56.506 INFO:tasks.workunit.client.0.smithi107.stdout:4/983: dread - dc/d13/d40/d46/d48/d70/def/f10d zero size 2024-09-21T08:02:56.506 INFO:tasks.workunit.client.0.smithi107.stdout:1/910: mkdir d0/dc6/d134 0 2024-09-21T08:02:56.507 INFO:tasks.workunit.client.0.smithi107.stdout:7/723: creat d7/d22/d37/d5a/ff7 x:0 0 0 2024-09-21T08:02:56.508 INFO:tasks.workunit.client.0.smithi107.stdout:7/724: chown d7/d22/d3d/cf0 857848 1 2024-09-21T08:02:56.509 INFO:tasks.workunit.client.0.smithi107.stdout:4/984: creat dc/d13/d40/d5e/d77/d99/f13a x:0 0 0 2024-09-21T08:02:56.511 INFO:tasks.workunit.client.0.smithi107.stdout:4/985: link dc/f12b dc/d60/d8c/f13b 0 2024-09-21T08:02:56.511 INFO:tasks.workunit.client.0.smithi107.stdout:4/986: stat dc/d13/d40/d5e/fa5 0 2024-09-21T08:02:56.511 INFO:tasks.workunit.client.0.smithi107.stdout:3/970: dread d8/d21/f75 [0,4194304] 0 2024-09-21T08:02:56.513 INFO:tasks.workunit.client.0.smithi107.stdout:4/987: link dc/d13/d40/d46/d48/l10f dc/d13/d40/d5e/d77/d99/daa/l13c 0 2024-09-21T08:02:56.517 INFO:tasks.workunit.client.0.smithi107.stdout:6/941: dread d2/d3/d7/d23/d2b/d84/fc5 [0,4194304] 0 2024-09-21T08:02:56.518 INFO:tasks.workunit.client.0.smithi107.stdout:1/911: write d0/d29/d4d/d84/dc5/f41 [6216704,26769] 0 2024-09-21T08:02:56.520 INFO:tasks.workunit.client.0.smithi107.stdout:6/942: mknod d2/d3/d7/d3f/c134 0 2024-09-21T08:02:56.520 INFO:tasks.workunit.client.0.smithi107.stdout:6/943: chown d2/d3/d67/f56 2301 1 2024-09-21T08:02:56.521 INFO:tasks.workunit.client.0.smithi107.stdout:1/912: creat d0/dce/f135 x:0 0 0 2024-09-21T08:02:56.522 INFO:tasks.workunit.client.0.smithi107.stdout:7/725: write d7/d22/fb4 [4052193,6840] 0 2024-09-21T08:02:56.522 INFO:tasks.workunit.client.0.smithi107.stdout:8/976: dwrite d5/d38/d56/f10a [0,4194304] 0 2024-09-21T08:02:56.525 INFO:tasks.workunit.client.0.smithi107.stdout:1/913: mknod d0/d19/d2b/d4b/d5b/dcb/ded/c136 0 2024-09-21T08:02:56.525 INFO:tasks.workunit.client.0.smithi107.stdout:6/944: dread d2/d3/d7/f1b [0,4194304] 0 2024-09-21T08:02:56.525 INFO:tasks.workunit.client.0.smithi107.stdout:1/914: write d0/d19/d2b/d4b/d44/d55/d64/ff2 [133233,63709] 0 2024-09-21T08:02:56.529 INFO:tasks.workunit.client.0.smithi107.stdout:7/726: rmdir d7/d22/d37/d40/d4d 39 2024-09-21T08:02:56.531 INFO:tasks.workunit.client.0.smithi107.stdout:8/977: unlink d5/d44/d5d/d9c/c108 0 2024-09-21T08:02:56.532 INFO:tasks.workunit.client.0.smithi107.stdout:6/945: creat d2/d3/d7/d23/f135 x:0 0 0 2024-09-21T08:02:56.534 INFO:tasks.workunit.client.0.smithi107.stdout:8/978: rename d5/d2e/dab/cb2 to d5/d38/d56/d54/dfd/c150 0 2024-09-21T08:02:56.534 INFO:tasks.workunit.client.0.smithi107.stdout:8/979: chown d5/d1d/f26 3 1 2024-09-21T08:02:56.534 INFO:tasks.workunit.client.0.smithi107.stdout:6/946: link d2/d3/d7/d48/f72 d2/d3/d7/d48/da3/d85/d9d/d10b/f136 0 2024-09-21T08:02:56.535 INFO:tasks.workunit.client.0.smithi107.stdout:8/980: symlink d5/d38/d56/d54/dfd/d134/l151 0 2024-09-21T08:02:56.535 INFO:tasks.workunit.client.0.smithi107.stdout:8/981: chown d5/d115/f140 98015459 1 2024-09-21T08:02:56.535 INFO:tasks.workunit.client.0.smithi107.stdout:8/982: chown d5/d1d/f3a 1 1 2024-09-21T08:02:56.537 INFO:tasks.workunit.client.0.smithi107.stdout:6/947: rename d2/d3/d7/d23/d2b/d84/d11d to d2/d3/d7/d48/da3/d85/d9d/d10b/d137 0 2024-09-21T08:02:56.537 INFO:tasks.workunit.client.0.smithi107.stdout:4/988: dwrite dc/d13/d40/d80/fce [4194304,4194304] 0 2024-09-21T08:02:56.538 INFO:tasks.workunit.client.0.smithi107.stdout:6/948: symlink d2/d3/d7/d54/dae/d108/l138 0 2024-09-21T08:02:56.540 INFO:tasks.workunit.client.0.smithi107.stdout:4/989: link dc/d64/d6b/dcf/ffa dc/d13/d5a/d9b/dbc/f13d 0 2024-09-21T08:02:56.541 INFO:tasks.workunit.client.0.smithi107.stdout:7/727: dread d7/d22/d3b/fa3 [0,4194304] 0 2024-09-21T08:02:56.541 INFO:tasks.workunit.client.0.smithi107.stdout:3/971: dwrite d8/d25/d3d/f92 [0,4194304] 0 2024-09-21T08:02:56.542 INFO:tasks.workunit.client.0.smithi107.stdout:6/949: dread d2/d3/d7/d24/d41/fd7 [0,4194304] 0 2024-09-21T08:02:56.544 INFO:tasks.workunit.client.0.smithi107.stdout:7/728: symlink d7/d22/d3d/d8a/dd4/lf8 0 2024-09-21T08:02:56.546 INFO:tasks.workunit.client.0.smithi107.stdout:3/972: symlink d8/d25/d42/dae/db1/dd6/l13d 0 2024-09-21T08:02:56.546 INFO:tasks.workunit.client.0.smithi107.stdout:3/973: fdatasync d8/d2b/d45/f6a 0 2024-09-21T08:02:56.551 INFO:tasks.workunit.client.0.smithi107.stdout:7/729: symlink d7/d22/d37/d4b/lf9 0 2024-09-21T08:02:56.552 INFO:tasks.workunit.client.0.smithi107.stdout:3/974: truncate d8/f1b 567540 0 2024-09-21T08:02:56.553 INFO:tasks.workunit.client.0.smithi107.stdout:4/990: dread dc/d13/d40/d46/d48/d70/dc5/d90/f139 [0,4194304] 0 2024-09-21T08:02:56.553 INFO:tasks.workunit.client.0.smithi107.stdout:4/991: chown dc/d13/d40/d5e/d77/d99/lca 167 1 2024-09-21T08:02:56.553 INFO:tasks.workunit.client.0.smithi107.stdout:8/983: dwrite d5/d44/d5d/d9c/f10e [0,4194304] 0 2024-09-21T08:02:56.554 INFO:tasks.workunit.client.0.smithi107.stdout:6/950: getdents d2/d3/d7/d24/d41 0 2024-09-21T08:02:56.559 INFO:tasks.workunit.client.0.smithi107.stdout:4/992: getdents dc/d13/d40/d46/de7 0 2024-09-21T08:02:56.559 INFO:tasks.workunit.client.0.smithi107.stdout:4/993: read - dc/f12b zero size 2024-09-21T08:02:56.559 INFO:tasks.workunit.client.0.smithi107.stdout:7/730: read d7/d38/f60 [3798274,129690] 0 2024-09-21T08:02:56.565 INFO:tasks.workunit.client.0.smithi107.stdout:6/951: rmdir d2/d3/d7/d48/da3/dda 0 2024-09-21T08:02:56.566 INFO:tasks.workunit.client.0.smithi107.stdout:7/731: creat d7/d22/d3d/d8a/dd4/deb/ffa x:0 0 0 2024-09-21T08:02:56.572 INFO:tasks.workunit.client.0.smithi107.stdout:7/732: rename d7/d10/c30 to d7/d22/d3a/d49/cfb 0 2024-09-21T08:02:56.575 INFO:tasks.workunit.client.0.smithi107.stdout:4/994: read dc/d13/d5a/d9b/dbc/f13d [4120282,123091] 0 2024-09-21T08:02:56.576 INFO:tasks.workunit.client.0.smithi107.stdout:4/995: chown dc/d13/d40/d5e/d77/d99/d11c 13 1 2024-09-21T08:02:56.577 INFO:tasks.workunit.client.0.smithi107.stdout:4/996: creat dc/d13/d40/d46/d48/d70/dc5/f13e x:0 0 0 2024-09-21T08:02:56.577 INFO:tasks.workunit.client.0.smithi107.stdout:4/997: creat dc/d13/d5a/d110/f13f x:0 0 0 2024-09-21T08:02:56.588 INFO:tasks.workunit.client.0.smithi107.stdout:8/984: dwrite d5/d40/fbc [0,4194304] 0 2024-09-21T08:02:56.589 INFO:tasks.workunit.client.0.smithi107.stdout:3/975: dwrite d8/d2b/d52/f68 [0,4194304] 0 2024-09-21T08:02:56.589 INFO:tasks.workunit.client.0.smithi107.stdout:3/976: chown d8/d2b/d52/fb6 0 1 2024-09-21T08:02:56.589 INFO:tasks.workunit.client.0.smithi107.stdout:8/985: creat d5/d38/d56/d54/dce/f152 x:0 0 0 2024-09-21T08:02:56.589 INFO:tasks.workunit.client.0.smithi107.stdout:8/986: write d5/d38/d56/da3/fbd [458668,30266] 0 2024-09-21T08:02:56.589 INFO:tasks.workunit.client.0.smithi107.stdout:8/987: write d5/d1d/f24 [4381963,75786] 0 2024-09-21T08:02:56.591 INFO:tasks.workunit.client.0.smithi107.stdout:6/952: dwrite d2/d3/d7/d24/d41/d50/f91 [4194304,4194304] 0 2024-09-21T08:02:56.595 INFO:tasks.workunit.client.0.smithi107.stdout:3/977: symlink d8/d38/l13e 0 2024-09-21T08:02:56.595 INFO:tasks.workunit.client.0.smithi107.stdout:3/978: chown d8/d44/l93 94040705 1 2024-09-21T08:02:56.596 INFO:tasks.workunit.client.0.smithi107.stdout:3/979: dread d8/d2b/d52/d55/fe0 [0,4194304] 0 2024-09-21T08:02:56.597 INFO:tasks.workunit.client.0.smithi107.stdout:8/988: write d5/d23/f3b [1503513,4989] 0 2024-09-21T08:02:56.600 INFO:tasks.workunit.client.0.smithi107.stdout:3/980: dread d8/d2b/d91/f126 [0,4194304] 0 2024-09-21T08:02:56.600 INFO:tasks.workunit.client.0.smithi107.stdout:3/981: fdatasync d8/d25/d3d/d72/d80/d5d/f63 0 2024-09-21T08:02:56.600 INFO:tasks.workunit.client.0.smithi107.stdout:3/982: readlink d8/d25/l128 0 2024-09-21T08:02:56.600 INFO:tasks.workunit.client.0.smithi107.stdout:3/983: stat d8/d25/d34/ca2 0 2024-09-21T08:02:56.600 INFO:tasks.workunit.client.0.smithi107.stdout:6/953: read d2/d3/d7/d48/da3/fb3 [5182116,32689] 0 2024-09-21T08:02:56.600 INFO:tasks.workunit.client.0.smithi107.stdout:6/954: readlink d2/d3/lc 0 2024-09-21T08:02:56.601 INFO:tasks.workunit.client.0.smithi107.stdout:3/984: rename d8/d38/l13e to d8/d25/d42/dae/db1/dd6/l13f 0 2024-09-21T08:02:56.602 INFO:tasks.workunit.client.0.smithi107.stdout:4/998: dwrite dc/d60/f119 [0,4194304] 0 2024-09-21T08:02:56.602 INFO:tasks.workunit.client.0.smithi107.stdout:4/999: chown dc/fe4 1074855 1 2024-09-21T08:02:56.604 INFO:tasks.workunit.client.0.smithi107.stdout:6/955: creat d2/d3/d7/d54/dae/f139 x:0 0 0 2024-09-21T08:02:56.606 INFO:tasks.workunit.client.0.smithi107.stdout:3/985: dread d8/d2b/d52/d55/fc4 [0,4194304] 0 2024-09-21T08:02:56.606 INFO:tasks.workunit.client.0.smithi107.stdout:3/986: truncate d8/d25/d3d/f51 4512853 0 2024-09-21T08:02:56.606 INFO:tasks.workunit.client.0.smithi107.stdout:3/987: dread - d8/d2b/d52/d71/db3/fb4 zero size 2024-09-21T08:02:56.608 INFO:tasks.workunit.client.0.smithi107.stdout:8/989: dread d5/fd [0,4194304] 0 2024-09-21T08:02:56.608 INFO:tasks.workunit.client.0.smithi107.stdout:8/990: stat d5/lc 0 2024-09-21T08:02:56.609 INFO:tasks.workunit.client.0.smithi107.stdout:6/956: symlink d2/d2e/l13a 0 2024-09-21T08:02:56.609 INFO:tasks.workunit.client.0.smithi107.stdout:6/957: fsync d2/d3/d7/d54/d5c/f8c 0 2024-09-21T08:02:56.611 INFO:tasks.workunit.client.0.smithi107.stdout:3/988: link d8/d25/d42/dae/f107 d8/d44/f140 0 2024-09-21T08:02:56.619 INFO:tasks.workunit.client.0.smithi107.stdout:6/958: write d2/d3/d7/f9c [2528007,8430] 0 2024-09-21T08:02:56.625 INFO:tasks.workunit.client.0.smithi107.stdout:3/989: dwrite d8/f122 [0,4194304] 0 2024-09-21T08:02:56.626 INFO:tasks.workunit.client.0.smithi107.stdout:3/990: dread d8/d25/d34/faf [0,4194304] 0 2024-09-21T08:02:56.630 INFO:tasks.workunit.client.0.smithi107.stdout:6/959: creat d2/d3/d7/d79/d125/f13b x:0 0 0 2024-09-21T08:02:56.631 INFO:tasks.workunit.client.0.smithi107.stdout:6/960: creat d2/d3/d67/d114/f13c x:0 0 0 2024-09-21T08:02:56.638 INFO:tasks.workunit.client.0.smithi107.stdout:6/961: read d2/d3/f8a [3114654,97044] 0 2024-09-21T08:02:56.646 INFO:tasks.workunit.client.0.smithi107.stdout:3/991: rename d8/d2b to d8/d21/d7e/d141 0 2024-09-21T08:02:56.646 INFO:tasks.workunit.client.0.smithi107.stdout:6/962: write d2/d2e/d97/fef [991026,103357] 0 2024-09-21T08:02:56.649 INFO:tasks.workunit.client.0.smithi107.stdout:6/963: getdents d2/d3/d7/d23/d2b 0 2024-09-21T08:02:56.653 INFO:tasks.workunit.client.0.smithi107.stdout:6/964: mknod d2/d3/d7/d48/da3/d85/dd9/de4/c13d 0 2024-09-21T08:02:56.662 INFO:tasks.workunit.client.0.smithi107.stdout:3/992: dwrite d8/d21/f10f [0,4194304] 0 2024-09-21T08:02:56.664 INFO:tasks.workunit.client.0.smithi107.stdout:3/993: rmdir d8/d25/d3d/d72/d80/d5d/d67 39 2024-09-21T08:02:56.664 INFO:tasks.workunit.client.0.smithi107.stdout:3/994: chown d8/d44/f140 2 1 2024-09-21T08:02:56.665 INFO:tasks.workunit.client.0.smithi107.stdout:3/995: symlink d8/d38/l142 0 2024-09-21T08:02:56.665 INFO:tasks.workunit.client.0.smithi107.stdout:3/996: read d8/d21/d7e/d141/d91/f126 [416253,101349] 0 2024-09-21T08:02:56.666 INFO:tasks.workunit.client.0.smithi107.stdout:6/965: dread d2/d3/d7/d3f/fd0 [0,4194304] 0 2024-09-21T08:02:56.667 INFO:tasks.workunit.client.0.smithi107.stdout:3/997: rename d8/d44/f62 to d8/d25/d42/f143 0 2024-09-21T08:02:56.669 INFO:tasks.workunit.client.0.smithi107.stdout:3/998: creat d8/d25/d34/ddc/f144 x:0 0 0 2024-09-21T08:02:56.670 INFO:tasks.workunit.client.0.smithi107.stdout:3/999: rename d8/d25/d3d/d72/d80/d5d/f137 to d8/d25/d3d/d72/d80/d5d/d6e/f145 0 2024-09-21T08:02:56.683 INFO:tasks.workunit.client.0.smithi107.stdout:6/966: dwrite d2/d3/d7/f1f [0,4194304] 0 2024-09-21T08:02:56.683 INFO:tasks.workunit.client.0.smithi107.stdout:6/967: readlink d2/d3/d7/d23/l3d 0 2024-09-21T08:02:56.684 INFO:tasks.workunit.client.0.smithi107.stdout:6/968: mkdir d2/d3/d7/d48/da3/d13e 0 2024-09-21T08:02:56.699 INFO:tasks.workunit.client.0.smithi107.stdout:6/969: dwrite d2/d3/f4 [0,4194304] 0 2024-09-21T08:02:56.708 INFO:tasks.workunit.client.0.smithi107.stdout:6/970: dread d2/d3/d7/d3f/fd0 [0,4194304] 0 2024-09-21T08:02:56.708 INFO:tasks.workunit.client.0.smithi107.stdout:6/971: getdents d2/d3/d7/d10e 0 2024-09-21T08:02:56.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:56 smithi129 ceph-mon[34472]: pgmap v20: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 139 MiB/s rd, 163 MiB/s wr, 301 op/s 2024-09-21T08:02:56.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:56 smithi107 ceph-mon[27622]: pgmap v20: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 139 MiB/s rd, 163 MiB/s wr, 301 op/s 2024-09-21T08:02:56.884 INFO:tasks.workunit.client.0.smithi107.stdout:0/899: sync 2024-09-21T08:02:56.887 INFO:tasks.workunit.client.0.smithi107.stdout:0/900: link d1/d6f/d80/la2 d1/d5/d25/d3d/d20/l12e 0 2024-09-21T08:02:56.890 INFO:tasks.workunit.client.0.smithi107.stdout:0/901: stat d1/d6f/d80/l10c 0 2024-09-21T08:02:56.890 INFO:tasks.workunit.client.0.smithi107.stdout:0/902: readlink d1/d5/d25/d9e/la5 0 2024-09-21T08:02:57.215 INFO:tasks.workunit.client.0.smithi107.stdout:1/915: sync 2024-09-21T08:02:57.216 INFO:tasks.workunit.client.0.smithi107.stdout:7/733: sync 2024-09-21T08:02:57.216 INFO:tasks.workunit.client.0.smithi107.stdout:8/991: sync 2024-09-21T08:02:57.216 INFO:tasks.workunit.client.0.smithi107.stdout:7/734: fsync d7/d10/d28/fdd 0 2024-09-21T08:02:57.216 INFO:tasks.workunit.client.0.smithi107.stdout:8/992: dread - d5/d2e/ddc/fdd zero size 2024-09-21T08:02:57.216 INFO:tasks.workunit.client.0.smithi107.stdout:7/735: truncate d7/d22/d37/d4b/db0/f62 1155318 0 2024-09-21T08:02:57.216 INFO:tasks.workunit.client.0.smithi107.stdout:7/736: write d7/d22/d3a/f7a [4970007,60380] 0 2024-09-21T08:02:57.216 INFO:tasks.workunit.client.0.smithi107.stdout:7/737: write d7/d22/f2d [334339,125540] 0 2024-09-21T08:02:57.216 INFO:tasks.workunit.client.0.smithi107.stdout:7/738: chown d7/c77 6 1 2024-09-21T08:02:57.216 INFO:tasks.workunit.client.0.smithi107.stdout:7/739: chown d7/d10/d64/fd1 8679 1 2024-09-21T08:02:57.216 INFO:tasks.workunit.client.0.smithi107.stdout:7/740: write d7/d22/d3a/fe0 [7329663,42902] 0 2024-09-21T08:02:57.219 INFO:tasks.workunit.client.0.smithi107.stdout:8/993: rmdir d5/d38/d67/d7d/d103 0 2024-09-21T08:02:57.219 INFO:tasks.workunit.client.0.smithi107.stdout:7/741: link d7/d22/d3a/f7a d7/d22/d37/d5a/d83/d9e/de2/ffc 0 2024-09-21T08:02:57.220 INFO:tasks.workunit.client.0.smithi107.stdout:8/994: creat d5/d40/f153 x:0 0 0 2024-09-21T08:02:57.230 INFO:tasks.workunit.client.0.smithi107.stdout:8/995: dread d5/d2e/f39 [0,4194304] 0 2024-09-21T08:02:57.230 INFO:tasks.workunit.client.0.smithi107.stdout:8/996: truncate d5/d44/db7/ff6 732366 0 2024-09-21T08:02:57.230 INFO:tasks.workunit.client.0.smithi107.stdout:8/997: getdents d5/d2e/d94/d143 0 2024-09-21T08:02:57.232 INFO:tasks.workunit.client.0.smithi107.stdout:7/742: write d7/d10/f1d [2554819,4079] 0 2024-09-21T08:02:57.232 INFO:tasks.workunit.client.0.smithi107.stdout:8/998: symlink d5/d38/d56/d52/d145/l154 0 2024-09-21T08:02:57.233 INFO:tasks.workunit.client.0.smithi107.stdout:1/916: dwrite d0/d19/d2b/d4b/d44/d72/d36/f73 [0,4194304] 0 2024-09-21T08:02:57.239 INFO:tasks.workunit.client.0.smithi107.stdout:1/917: rename d0/f3 to d0/d29/d4d/d84/dc5/da9/f137 0 2024-09-21T08:02:57.241 INFO:tasks.workunit.client.0.smithi107.stdout:7/743: truncate d7/d10/f1d 157763 0 2024-09-21T08:02:57.241 INFO:tasks.workunit.client.0.smithi107.stdout:7/744: write d7/d22/d37/d4b/db0/d4f/fc0 [1121968,2052] 0 2024-09-21T08:02:57.243 INFO:tasks.workunit.client.0.smithi107.stdout:7/745: unlink d7/d22/d3d/d8a/fe8 0 2024-09-21T08:02:57.243 INFO:tasks.workunit.client.0.smithi107.stdout:7/746: truncate d7/d18/fa6 2113296 0 2024-09-21T08:02:57.244 INFO:tasks.workunit.client.0.smithi107.stdout:8/999: dread d5/d2e/d89/f92 [0,4194304] 0 2024-09-21T08:02:57.252 INFO:tasks.workunit.client.0.smithi107.stdout:7/747: write d7/d10/d28/d69/da0/fbc [3195215,112271] 0 2024-09-21T08:02:57.252 INFO:tasks.workunit.client.0.smithi107.stdout:7/748: truncate d7/d22/d3a/d49/f6f 4747852 0 2024-09-21T08:02:57.252 INFO:tasks.workunit.client.0.smithi107.stdout:7/749: write d7/d22/d3a/f67 [333549,75748] 0 2024-09-21T08:02:57.253 INFO:tasks.workunit.client.0.smithi107.stdout:7/750: dread d7/d22/d3a/d49/dbe/fd3 [0,4194304] 0 2024-09-21T08:02:57.254 INFO:tasks.workunit.client.0.smithi107.stdout:7/751: getdents d7/d10/d64 0 2024-09-21T08:02:57.254 INFO:tasks.workunit.client.0.smithi107.stdout:7/752: write d7/d10/f90 [1921852,4987] 0 2024-09-21T08:02:57.254 INFO:tasks.workunit.client.0.smithi107.stdout:7/753: dread d7/d22/d3a/d49/dbe/fd3 [0,4194304] 0 2024-09-21T08:02:57.258 INFO:tasks.workunit.client.0.smithi107.stdout:7/754: fsync d7/d22/d37/d4b/db0/d4f/fc0 0 2024-09-21T08:02:57.258 INFO:tasks.workunit.client.0.smithi107.stdout:7/755: readlink d7/dc3/ld6 0 2024-09-21T08:02:57.258 INFO:tasks.workunit.client.0.smithi107.stdout:1/918: dwrite d0/d29/f103 [0,4194304] 0 2024-09-21T08:02:57.260 INFO:tasks.workunit.client.0.smithi107.stdout:7/756: mknod d7/d10/d64/cfd 0 2024-09-21T08:02:57.261 INFO:tasks.workunit.client.0.smithi107.stdout:1/919: mknod d0/d29/d4d/d84/d129/c138 0 2024-09-21T08:02:57.299 INFO:tasks.workunit.client.0.smithi107.stdout:1/920: dwrite d0/d19/d2b/d4b/d44/d72/d36/d8e/f12a [0,4194304] 0 2024-09-21T08:02:57.299 INFO:tasks.workunit.client.0.smithi107.stdout:7/757: dwrite d7/d22/f24 [4194304,4194304] 0 2024-09-21T08:02:57.307 INFO:tasks.workunit.client.0.smithi107.stdout:7/758: dread d7/d38/f7d [0,4194304] 0 2024-09-21T08:02:57.311 INFO:tasks.workunit.client.0.smithi107.stdout:1/921: unlink d0/d19/d2b/l2d 0 2024-09-21T08:02:57.311 INFO:tasks.workunit.client.0.smithi107.stdout:1/922: chown d0/d19/d2b/d4b/f117 2396 1 2024-09-21T08:02:57.315 INFO:tasks.workunit.client.0.smithi107.stdout:7/759: dread d7/d22/d37/d4b/db0/d4f/fb3 [0,4194304] 0 2024-09-21T08:02:57.315 INFO:tasks.workunit.client.0.smithi107.stdout:7/760: chown d7/d18/f19 19030340 1 2024-09-21T08:02:57.319 INFO:tasks.workunit.client.0.smithi107.stdout:1/923: symlink d0/l139 0 2024-09-21T08:02:57.321 INFO:tasks.workunit.client.0.smithi107.stdout:1/924: mknod d0/d80/c13a 0 2024-09-21T08:02:57.322 INFO:tasks.workunit.client.0.smithi107.stdout:7/761: write d7/d10/d28/fdd [2029916,66988] 0 2024-09-21T08:02:57.322 INFO:tasks.workunit.client.0.smithi107.stdout:1/925: creat d0/d19/d2b/d4b/d44/d55/d64/f13b x:0 0 0 2024-09-21T08:02:57.326 INFO:tasks.workunit.client.0.smithi107.stdout:7/762: rmdir d7/d22/d37/d5a 39 2024-09-21T08:02:57.326 INFO:tasks.workunit.client.0.smithi107.stdout:7/763: fsync d7/d18/fa6 0 2024-09-21T08:02:57.345 INFO:tasks.workunit.client.0.smithi107.stdout:0/903: sync 2024-09-21T08:02:57.345 INFO:tasks.workunit.client.0.smithi107.stdout:6/972: sync 2024-09-21T08:02:57.345 INFO:tasks.workunit.client.0.smithi107.stdout:0/904: stat d1/d5/d25/d3d/d20/d29/l34 0 2024-09-21T08:02:57.346 INFO:tasks.workunit.client.0.smithi107.stdout:7/764: mknod d7/d22/d3a/d49/d56/cfe 0 2024-09-21T08:02:57.349 INFO:tasks.workunit.client.0.smithi107.stdout:7/765: mkdir d7/d22/d3d/d8a/dd4/df3/dff 0 2024-09-21T08:02:57.369 INFO:tasks.workunit.client.0.smithi107.stdout:0/905: dwrite d1/d5/d25/d3d/f115 [0,4194304] 0 2024-09-21T08:02:57.369 INFO:tasks.workunit.client.0.smithi107.stdout:7/766: dwrite d7/d22/d37/d4b/db0/f96 [0,4194304] 0 2024-09-21T08:02:57.373 INFO:tasks.workunit.client.0.smithi107.stdout:7/767: creat d7/d10/f100 x:0 0 0 2024-09-21T08:02:57.373 INFO:tasks.workunit.client.0.smithi107.stdout:7/768: write d7/d22/d37/d5a/f5b [92465,82271] 0 2024-09-21T08:02:57.375 INFO:tasks.workunit.client.0.smithi107.stdout:7/769: unlink d7/d22/d3b/fb6 0 2024-09-21T08:02:57.376 INFO:tasks.workunit.client.0.smithi107.stdout:7/770: symlink d7/d22/d37/d5a/d83/d9e/l101 0 2024-09-21T08:02:57.842 INFO:tasks.workunit.client.0.smithi107.stdout:1/926: sync 2024-09-21T08:02:57.842 INFO:tasks.workunit.client.0.smithi107.stdout:7/771: sync 2024-09-21T08:02:57.842 INFO:tasks.workunit.client.0.smithi107.stdout:0/906: sync 2024-09-21T08:02:57.842 INFO:tasks.workunit.client.0.smithi107.stdout:6/973: sync 2024-09-21T08:02:57.842 INFO:tasks.workunit.client.0.smithi107.stdout:6/974: write d2/d3/d7/d48/da3/fd2 [362508,101430] 0 2024-09-21T08:02:57.842 INFO:tasks.workunit.client.0.smithi107.stdout:1/927: write d0/d19/d2b/d4b/d5b/dcb/fea [653660,105194] 0 2024-09-21T08:02:57.843 INFO:tasks.workunit.client.0.smithi107.stdout:7/772: rmdir d7/d22/d37/d5a/d83/d9e/de2 39 2024-09-21T08:02:57.843 INFO:tasks.workunit.client.0.smithi107.stdout:7/773: write d7/d22/d37/d4b/f4c [4514463,13695] 0 2024-09-21T08:02:57.846 INFO:tasks.workunit.client.0.smithi107.stdout:0/907: creat d1/d5/d75/f12f x:0 0 0 2024-09-21T08:02:57.847 INFO:tasks.workunit.client.0.smithi107.stdout:1/928: mkdir d0/d19/d13c 0 2024-09-21T08:02:57.847 INFO:tasks.workunit.client.0.smithi107.stdout:1/929: readlink d0/d19/l128 0 2024-09-21T08:02:57.850 INFO:tasks.workunit.client.0.smithi107.stdout:7/774: link d7/d22/d3a/d49/dbe/fd7 d7/d22/d3d/d8a/dd4/f102 0 2024-09-21T08:02:57.850 INFO:tasks.workunit.client.0.smithi107.stdout:1/930: mkdir d0/d29/d4d/d13d 0 2024-09-21T08:02:57.857 INFO:tasks.workunit.client.0.smithi107.stdout:6/975: dread d2/d3/d7/d24/d41/d50/f91 [0,4194304] 0 2024-09-21T08:02:57.857 INFO:tasks.workunit.client.0.smithi107.stdout:6/976: fsync d2/d2e/f4c 0 2024-09-21T08:02:57.864 INFO:tasks.workunit.client.0.smithi107.stdout:6/977: rmdir d2/d3/d7/d48/da3 39 2024-09-21T08:02:57.865 INFO:tasks.workunit.client.0.smithi107.stdout:1/931: dread d0/d29/d31/fef [0,4194304] 0 2024-09-21T08:02:57.865 INFO:tasks.workunit.client.0.smithi107.stdout:1/932: dread - d0/d19/d2b/d4b/d44/fee zero size 2024-09-21T08:02:57.868 INFO:tasks.workunit.client.0.smithi107.stdout:6/978: mknod d2/df4/c13f 0 2024-09-21T08:02:57.869 INFO:tasks.workunit.client.0.smithi107.stdout:0/908: dwrite d1/d5/d25/d3d/d20/fe5 [0,4194304] 0 2024-09-21T08:02:57.869 INFO:tasks.workunit.client.0.smithi107.stdout:7/775: write d7/d22/d3a/fcb [2175876,92561] 0 2024-09-21T08:02:57.880 INFO:tasks.workunit.client.0.smithi107.stdout:7/776: symlink d7/d22/d37/d5a/d83/l103 0 2024-09-21T08:02:57.880 INFO:tasks.workunit.client.0.smithi107.stdout:7/777: fdatasync d7/d22/d37/d5a/fec 0 2024-09-21T08:02:57.883 INFO:tasks.workunit.client.0.smithi107.stdout:1/933: rmdir d0/d19/d2b/d4b/d44/d72 39 2024-09-21T08:02:57.883 INFO:tasks.workunit.client.0.smithi107.stdout:7/778: dread d7/d22/d37/d4b/f9d [0,4194304] 0 2024-09-21T08:02:57.888 INFO:tasks.workunit.client.0.smithi107.stdout:1/934: creat d0/d19/d2b/dfd/dfe/f13e x:0 0 0 2024-09-21T08:02:57.889 INFO:tasks.workunit.client.0.smithi107.stdout:6/979: dwrite d2/d3/d7/d54/d5c/fab [0,4194304] 0 2024-09-21T08:02:57.893 INFO:tasks.workunit.client.0.smithi107.stdout:6/980: unlink d2/d3/d7/d54/dae/fd5 0 2024-09-21T08:02:57.893 INFO:tasks.workunit.client.0.smithi107.stdout:6/981: readlink d2/d3/d7/d48/da3/d85/d9b/ld6 0 2024-09-21T08:02:57.893 INFO:tasks.workunit.client.0.smithi107.stdout:6/982: creat d2/d3/d7/d54/d5c/f140 x:0 0 0 2024-09-21T08:02:57.904 INFO:tasks.workunit.client.0.smithi107.stdout:1/935: dread d0/d19/d2b/d4b/f12d [0,4194304] 0 2024-09-21T08:02:57.915 INFO:tasks.workunit.client.0.smithi107.stdout:1/936: read d0/d29/f5c [8123360,70077] 0 2024-09-21T08:02:57.919 INFO:tasks.workunit.client.0.smithi107.stdout:1/937: link d0/d19/d2b/d4b/d61/d75/l10e d0/d19/d2b/d4b/d61/d75/l13f 0 2024-09-21T08:02:57.921 INFO:tasks.workunit.client.0.smithi107.stdout:6/983: dwrite d2/d3/d7/d3f/f60 [0,4194304] 0 2024-09-21T08:02:57.924 INFO:tasks.workunit.client.0.smithi107.stdout:6/984: creat d2/d3/d7/d48/da3/d85/d9d/dcf/f141 x:0 0 0 2024-09-21T08:02:57.929 INFO:tasks.workunit.client.0.smithi107.stdout:1/938: write d0/d19/d2b/d4b/d44/d72/fb9 [2503144,113999] 0 2024-09-21T08:02:57.932 INFO:tasks.workunit.client.0.smithi107.stdout:1/939: rename d0/cdf to d0/d29/d31/c140 0 2024-09-21T08:02:57.934 INFO:tasks.workunit.client.0.smithi107.stdout:1/940: link d0/d29/d4d/cc9 d0/d29/d4d/d84/dc5/c141 0 2024-09-21T08:02:57.934 INFO:tasks.workunit.client.0.smithi107.stdout:1/941: creat d0/dc6/d11e/f142 x:0 0 0 2024-09-21T08:02:57.935 INFO:tasks.workunit.client.0.smithi107.stdout:6/985: dread d2/d3/d7/d24/f37 [0,4194304] 0 2024-09-21T08:02:57.936 INFO:tasks.workunit.client.0.smithi107.stdout:1/942: mkdir d0/d19/d2b/d86/da4/d143 0 2024-09-21T08:02:57.936 INFO:tasks.workunit.client.0.smithi107.stdout:1/943: read - d0/d19/d2b/d4b/d44/d55/d64/ffc zero size 2024-09-21T08:02:57.937 INFO:tasks.workunit.client.0.smithi107.stdout:1/944: dread - d0/d19/f10d zero size 2024-09-21T08:02:57.937 INFO:tasks.workunit.client.0.smithi107.stdout:1/945: write d0/d29/f37 [2276704,77987] 0 2024-09-21T08:02:57.938 INFO:tasks.workunit.client.0.smithi107.stdout:6/986: dread d2/d3/d7/d24/d41/fbf [0,4194304] 0 2024-09-21T08:02:57.940 INFO:tasks.workunit.client.0.smithi107.stdout:6/987: mknod d2/d3/d7/d79/c142 0 2024-09-21T08:02:57.941 INFO:tasks.workunit.client.0.smithi107.stdout:6/988: link d2/d3/d7/d48/da3/d85/d9d/d10b/c127 d2/d3/d7/d10e/c143 0 2024-09-21T08:02:57.942 INFO:tasks.workunit.client.0.smithi107.stdout:6/989: mknod d2/d3/d7/d48/da3/d85/d9d/d10b/c144 0 2024-09-21T08:02:57.943 INFO:tasks.workunit.client.0.smithi107.stdout:6/990: symlink d2/d3/d7/d24/d41/d50/l145 0 2024-09-21T08:02:57.945 INFO:tasks.workunit.client.0.smithi107.stdout:6/991: creat d2/d3/f146 x:0 0 0 2024-09-21T08:02:57.964 INFO:tasks.workunit.client.0.smithi107.stdout:1/946: dwrite d0/d29/f37 [0,4194304] 0 2024-09-21T08:02:57.964 INFO:tasks.workunit.client.0.smithi107.stdout:1/947: creat d0/d19/d2b/d86/dd9/f144 x:0 0 0 2024-09-21T08:02:57.965 INFO:tasks.workunit.client.0.smithi107.stdout:6/992: dwrite d2/d3/d7/d54/d5c/f140 [0,4194304] 0 2024-09-21T08:02:57.965 INFO:tasks.workunit.client.0.smithi107.stdout:6/993: write d2/d3/d7/d24/d41/fc1 [8608339,33176] 0 2024-09-21T08:02:57.965 INFO:tasks.workunit.client.0.smithi107.stdout:6/994: rename d2 to d2/d3/d7/d79/d147 22 2024-09-21T08:02:57.970 INFO:tasks.workunit.client.0.smithi107.stdout:6/995: creat d2/d3/d7/d12d/d12f/f148 x:0 0 0 2024-09-21T08:02:57.970 INFO:tasks.workunit.client.0.smithi107.stdout:6/996: readlink d2/d3/d7/l16 0 2024-09-21T08:02:57.978 INFO:tasks.workunit.client.0.smithi107.stdout:1/948: dwrite d0/d19/d39/f96 [4194304,4194304] 0 2024-09-21T08:02:57.978 INFO:tasks.workunit.client.0.smithi107.stdout:1/949: dread - d0/dce/f135 zero size 2024-09-21T08:02:57.982 INFO:tasks.workunit.client.0.smithi107.stdout:1/950: rmdir d0/d19/d2b/d86/dd9 39 2024-09-21T08:02:57.984 INFO:tasks.workunit.client.0.smithi107.stdout:1/951: getdents d0/d19/d2b/d4b/d44/d9a/db6 0 2024-09-21T08:02:57.986 INFO:tasks.workunit.client.0.smithi107.stdout:1/952: symlink d0/d29/d4d/d84/d129/l145 0 2024-09-21T08:02:57.988 INFO:tasks.workunit.client.0.smithi107.stdout:6/997: dwrite d2/d3/d7/d48/da3/d85/d9d/dcf/fff [0,4194304] 0 2024-09-21T08:02:57.988 INFO:tasks.workunit.client.0.smithi107.stdout:6/998: dread - d2/d3/d67/f10a zero size 2024-09-21T08:02:57.988 INFO:tasks.workunit.client.0.smithi107.stdout:6/999: chown d2/d3/d7/d54/dae 1897389 1 2024-09-21T08:02:57.991 INFO:tasks.workunit.client.0.smithi107.stdout:1/953: dread d0/dc6/fb2 [0,4194304] 0 2024-09-21T08:02:57.991 INFO:tasks.workunit.client.0.smithi107.stdout:1/954: fsync d0/d29/f104 0 2024-09-21T08:02:57.992 INFO:tasks.workunit.client.0.smithi107.stdout:1/955: creat d0/d19/d2b/d4b/d44/d72/f146 x:0 0 0 2024-09-21T08:02:57.995 INFO:tasks.workunit.client.0.smithi107.stdout:1/956: symlink d0/d19/d2b/dfd/dfe/l147 0 2024-09-21T08:02:57.997 INFO:tasks.workunit.client.0.smithi107.stdout:1/957: getdents d0/de2 0 2024-09-21T08:02:57.999 INFO:tasks.workunit.client.0.smithi107.stdout:1/958: rmdir d0/d19/d2b/d4b/d5b/dcb/ded 39 2024-09-21T08:02:58.002 INFO:tasks.workunit.client.0.smithi107.stdout:1/959: truncate d0/f71 5232890 0 2024-09-21T08:02:58.019 INFO:tasks.workunit.client.0.smithi107.stdout:1/960: dwrite d0/d19/ddd/ff6 [0,4194304] 0 2024-09-21T08:02:58.019 INFO:tasks.workunit.client.0.smithi107.stdout:1/961: dread - d0/d80/fa8 zero size 2024-09-21T08:02:58.019 INFO:tasks.workunit.client.0.smithi107.stdout:1/962: read d0/d19/d2b/d4b/d44/d72/fb9 [3604596,15912] 0 2024-09-21T08:02:58.024 INFO:tasks.workunit.client.0.smithi107.stdout:1/963: unlink d0/d19/d2b/d4b/d44/d72/d36/d8e/dd7/l124 0 2024-09-21T08:02:58.026 INFO:tasks.workunit.client.0.smithi107.stdout:1/964: mkdir d0/d19/d2b/d86/dc2/d148 0 2024-09-21T08:02:58.028 INFO:tasks.workunit.client.0.smithi107.stdout:1/965: creat d0/d120/f149 x:0 0 0 2024-09-21T08:02:58.047 INFO:tasks.workunit.client.0.smithi107.stdout:1/966: dwrite d0/d19/d39/fb8 [0,4194304] 0 2024-09-21T08:02:58.047 INFO:tasks.workunit.client.0.smithi107.stdout:1/967: creat d0/dc6/f14a x:0 0 0 2024-09-21T08:02:58.049 INFO:tasks.workunit.client.0.smithi107.stdout:1/968: dread d0/d19/d2b/d4b/d44/d55/d64/ff2 [0,4194304] 0 2024-09-21T08:02:58.049 INFO:tasks.workunit.client.0.smithi107.stdout:1/969: fsync d0/d19/d2b/d4b/d44/d55/f12c 0 2024-09-21T08:02:58.051 INFO:tasks.workunit.client.0.smithi107.stdout:1/970: creat d0/d29/d4d/d84/d129/f14b x:0 0 0 2024-09-21T08:02:58.053 INFO:tasks.workunit.client.0.smithi107.stdout:1/971: rename d0/d19/d2b/d4b/d5b/lfb to d0/d19/d2b/d4b/d5b/l14c 0 2024-09-21T08:02:58.053 INFO:tasks.workunit.client.0.smithi107.stdout:1/972: fsync d0/d19/d2b/f114 0 2024-09-21T08:02:58.053 INFO:tasks.workunit.client.0.smithi107.stdout:1/973: chown d0/d19/d13c 6995 1 2024-09-21T08:02:58.068 INFO:tasks.workunit.client.0.smithi107.stdout:1/974: dwrite d0/d19/d39/f102 [0,4194304] 0 2024-09-21T08:02:58.069 INFO:tasks.workunit.client.0.smithi107.stdout:1/975: fsync d0/dc6/f100 0 2024-09-21T08:02:58.069 INFO:tasks.workunit.client.0.smithi107.stdout:1/976: chown d0/d29/d4d/d84/dc5 64 1 2024-09-21T08:02:58.069 INFO:tasks.workunit.client.0.smithi107.stdout:1/977: creat d0/d80/f14d x:0 0 0 2024-09-21T08:02:58.075 INFO:tasks.workunit.client.0.smithi107.stdout:1/978: getdents d0/d29/da1 0 2024-09-21T08:02:58.081 INFO:tasks.workunit.client.0.smithi107.stdout:1/979: rmdir d0/d19/d2b/d4b/d44/d55/d64 39 2024-09-21T08:02:58.081 INFO:tasks.workunit.client.0.smithi107.stdout:1/980: dread - d0/d19/d2b/d4b/d44/fee zero size 2024-09-21T08:02:58.083 INFO:tasks.workunit.client.0.smithi107.stdout:1/981: creat d0/d19/d2b/d4b/d44/d55/d64/f14e x:0 0 0 2024-09-21T08:02:58.083 INFO:tasks.workunit.client.0.smithi107.stdout:1/982: creat d0/d19/f14f x:0 0 0 2024-09-21T08:02:58.093 INFO:tasks.workunit.client.0.smithi107.stdout:1/983: dread d0/d29/d4d/d84/fdb [0,4194304] 0 2024-09-21T08:02:58.093 INFO:tasks.workunit.client.0.smithi107.stdout:1/984: fdatasync d0/d19/f93 0 2024-09-21T08:02:58.093 INFO:tasks.workunit.client.0.smithi107.stdout:1/985: write d0/dc6/f14a [208969,51661] 0 2024-09-21T08:02:58.094 INFO:tasks.workunit.client.0.smithi107.stdout:1/986: creat d0/d29/d4d/d84/dc3/f150 x:0 0 0 2024-09-21T08:02:58.108 INFO:tasks.workunit.client.0.smithi107.stdout:1/987: dwrite d0/d19/d2b/d4b/d44/d72/f1d [0,4194304] 0 2024-09-21T08:02:58.109 INFO:tasks.workunit.client.0.smithi107.stdout:1/988: dread - d0/d80/fa8 zero size 2024-09-21T08:02:58.109 INFO:tasks.workunit.client.0.smithi107.stdout:1/989: dread - d0/d29/d4d/d84/dc5/da9/dc7/db5/fd1 zero size 2024-09-21T08:02:58.109 INFO:tasks.workunit.client.0.smithi107.stdout:1/990: fdatasync d0/d19/d39/fb8 0 2024-09-21T08:02:58.124 INFO:tasks.workunit.client.0.smithi107.stdout:1/991: dwrite d0/d19/f10d [0,4194304] 0 2024-09-21T08:02:58.125 INFO:tasks.workunit.client.0.smithi107.stdout:1/992: getdents d0/d19/d2b/d4b/d44/d9a/db6 0 2024-09-21T08:02:58.125 INFO:tasks.workunit.client.0.smithi107.stdout:1/993: dread - d0/d19/d2b/d86/d95/f11b zero size 2024-09-21T08:02:58.125 INFO:tasks.workunit.client.0.smithi107.stdout:1/994: write d0/dce/f135 [800253,53764] 0 2024-09-21T08:02:58.125 INFO:tasks.workunit.client.0.smithi107.stdout:1/995: dread - d0/d19/d2b/d86/dd9/f144 zero size 2024-09-21T08:02:58.125 INFO:tasks.workunit.client.0.smithi107.stdout:1/996: chown d0/l122 0 1 2024-09-21T08:02:58.125 INFO:tasks.workunit.client.0.smithi107.stdout:1/997: truncate d0/d19/d2b/d4b/d44/d9a/db6/f107 880816 0 2024-09-21T08:02:58.125 INFO:tasks.workunit.client.0.smithi107.stdout:1/998: creat d0/d29/d4d/d84/dc5/da9/dc7/db5/f151 x:0 0 0 2024-09-21T08:02:58.140 INFO:tasks.workunit.client.0.smithi107.stdout:1/999: dwrite d0/d19/d2b/d4b/d44/d72/fb9 [0,4194304] 0 2024-09-21T08:02:58.299 INFO:tasks.workunit.client.0.smithi107.stdout:7/779: sync 2024-09-21T08:02:58.300 INFO:tasks.workunit.client.0.smithi107.stdout:0/909: sync 2024-09-21T08:02:58.300 INFO:tasks.workunit.client.0.smithi107.stdout:7/780: write d7/d10/d64/fcc [858198,93270] 0 2024-09-21T08:02:58.300 INFO:tasks.workunit.client.0.smithi107.stdout:0/910: truncate d1/d5/d25/d3d/d20/d29/f94 1949252 0 2024-09-21T08:02:58.300 INFO:tasks.workunit.client.0.smithi107.stdout:0/911: chown d1/d5/d25/d3d/f33 911241011 1 2024-09-21T08:02:58.300 INFO:tasks.workunit.client.0.smithi107.stdout:7/781: rmdir d7/d22/d37/d4b/db0 39 2024-09-21T08:02:58.302 INFO:tasks.workunit.client.0.smithi107.stdout:0/912: creat d1/d5/d25/d3d/d20/d29/d55/d91/d9a/d122/f130 x:0 0 0 2024-09-21T08:02:58.302 INFO:tasks.workunit.client.0.smithi107.stdout:7/782: dread d7/d22/d37/d4b/db0/d4f/fc0 [0,4194304] 0 2024-09-21T08:02:58.305 INFO:tasks.workunit.client.0.smithi107.stdout:0/913: creat d1/f131 x:0 0 0 2024-09-21T08:02:58.307 INFO:tasks.workunit.client.0.smithi107.stdout:0/914: rename d1/d6f/d80/lf0 to d1/d5/d25/d3d/d20/d29/d55/d91/l132 0 2024-09-21T08:02:58.312 INFO:tasks.workunit.client.0.smithi107.stdout:7/783: dread d7/d22/d37/d4b/db0/f96 [0,4194304] 0 2024-09-21T08:02:58.312 INFO:tasks.workunit.client.0.smithi107.stdout:7/784: fsync d7/d10/d28/d69/f91 0 2024-09-21T08:02:58.312 INFO:tasks.workunit.client.0.smithi107.stdout:7/785: stat d7/d38/dc1/cc2 0 2024-09-21T08:02:58.315 INFO:tasks.workunit.client.0.smithi107.stdout:0/915: rename d1/d5/d25/d3d/d20/d85/fe8 to d1/d5/d25/d3d/d20/d85/de1/df9/f133 0 2024-09-21T08:02:58.319 INFO:tasks.workunit.client.0.smithi107.stdout:7/786: mknod d7/d10/d28/c104 0 2024-09-21T08:02:58.319 INFO:tasks.workunit.client.0.smithi107.stdout:7/787: fsync d7/d22/d37/d5a/f5b 0 2024-09-21T08:02:58.319 INFO:tasks.workunit.client.0.smithi107.stdout:7/788: chown d7/d22/d37/d5a/d83 53200 1 2024-09-21T08:02:58.322 INFO:tasks.workunit.client.0.smithi107.stdout:0/916: dread d1/d5/d25/d3d/d20/d29/d55/d7a/f83 [0,4194304] 0 2024-09-21T08:02:58.322 INFO:tasks.workunit.client.0.smithi107.stdout:0/917: readlink d1/d5/d25/d3d/d20/da0/l11a 0 2024-09-21T08:02:58.322 INFO:tasks.workunit.client.0.smithi107.stdout:7/789: creat d7/d10/d64/db1/f105 x:0 0 0 2024-09-21T08:02:58.330 INFO:tasks.workunit.client.0.smithi107.stdout:7/790: dread d7/d10/d28/f9b [0,4194304] 0 2024-09-21T08:02:58.351 INFO:tasks.workunit.client.0.smithi107.stdout:0/918: dwrite d1/d5/d25/fa6 [8388608,4194304] 0 2024-09-21T08:02:58.351 INFO:tasks.workunit.client.0.smithi107.stdout:0/919: chown d1/d5/d25/d3d/d20/d29/d5c/cc4 1911019370 1 2024-09-21T08:02:58.352 INFO:tasks.workunit.client.0.smithi107.stdout:7/791: dwrite d7/d22/d3d/fa2 [0,4194304] 0 2024-09-21T08:02:58.354 INFO:tasks.workunit.client.0.smithi107.stdout:0/920: rename d1/d5/d25/d9e/f117 to d1/d5/d25/f134 0 2024-09-21T08:02:58.359 INFO:tasks.workunit.client.0.smithi107.stdout:0/921: symlink d1/d5/d25/d3d/d20/d29/d5c/l135 0 2024-09-21T08:02:58.359 INFO:tasks.workunit.client.0.smithi107.stdout:0/922: dread - d1/d5/f12c zero size 2024-09-21T08:02:58.359 INFO:tasks.workunit.client.0.smithi107.stdout:0/923: chown d1/d5/d25/d3d/d20/d29/d55/d91/fc6 9342170 1 2024-09-21T08:02:58.361 INFO:tasks.workunit.client.0.smithi107.stdout:0/924: dread d1/d5/d25/f134 [0,4194304] 0 2024-09-21T08:02:58.361 INFO:tasks.workunit.client.0.smithi107.stdout:0/925: fdatasync d1/d5/d25/d3d/d20/da0/fc0 0 2024-09-21T08:02:58.361 INFO:tasks.workunit.client.0.smithi107.stdout:0/926: chown d1/d5/d25/d3d/d20/f7d 0 1 2024-09-21T08:02:58.368 INFO:tasks.workunit.client.0.smithi107.stdout:0/927: read d1/d5/d25/d3d/f105 [361177,66933] 0 2024-09-21T08:02:58.368 INFO:tasks.workunit.client.0.smithi107.stdout:0/928: readlink d1/d5/d25/d3d/lad 0 2024-09-21T08:02:58.369 INFO:tasks.workunit.client.0.smithi107.stdout:7/792: dwrite d7/d10/d28/d69/f91 [0,4194304] 0 2024-09-21T08:02:58.369 INFO:tasks.workunit.client.0.smithi107.stdout:7/793: write d7/d10/d28/d69/da0/fbc [207189,61237] 0 2024-09-21T08:02:58.371 INFO:tasks.workunit.client.0.smithi107.stdout:7/794: symlink d7/d22/d37/d40/d4d/l106 0 2024-09-21T08:02:58.372 INFO:tasks.workunit.client.0.smithi107.stdout:7/795: write d7/d22/f2d [312411,91237] 0 2024-09-21T08:02:58.396 INFO:tasks.workunit.client.0.smithi107.stdout:0/929: dwrite d1/d5/d25/d3d/d20/d29/d55/d91/d9a/dd1/f108 [0,4194304] 0 2024-09-21T08:02:58.396 INFO:tasks.workunit.client.0.smithi107.stdout:7/796: dwrite d7/f13 [4194304,4194304] 0 2024-09-21T08:02:58.396 INFO:tasks.workunit.client.0.smithi107.stdout:0/930: read d1/d6f/fd8 [4715,113497] 0 2024-09-21T08:02:58.396 INFO:tasks.workunit.client.0.smithi107.stdout:0/931: chown d1/d5/d25/d3d/d20/d29/d55/d91/l132 0 1 2024-09-21T08:02:58.396 INFO:tasks.workunit.client.0.smithi107.stdout:0/932: dread - d1/d5/d25/d2d/f8f zero size 2024-09-21T08:02:58.400 INFO:tasks.workunit.client.0.smithi107.stdout:7/797: rename d7/d38/cbd to d7/d10/d28/dba/c107 0 2024-09-21T08:02:58.401 INFO:tasks.workunit.client.0.smithi107.stdout:0/933: mkdir d1/d6f/dc1/d136 0 2024-09-21T08:02:58.401 INFO:tasks.workunit.client.0.smithi107.stdout:0/934: readlink d1/d5/d25/d3d/d20/da0/l11a 0 2024-09-21T08:02:58.401 INFO:tasks.workunit.client.0.smithi107.stdout:0/935: write d1/d5/f67 [1151305,21529] 0 2024-09-21T08:02:58.403 INFO:tasks.workunit.client.0.smithi107.stdout:7/798: rename d7/d22/d3d/d8a/dd4/df3/dff to d7/d22/d37/d5a/d83/d9e/de2/d108 0 2024-09-21T08:02:58.405 INFO:tasks.workunit.client.0.smithi107.stdout:0/936: rename d1/d6f/dc1/dcc/df7/d10b to d1/d5/d25/d3d/d20/d29/d5c/dc2/d137 0 2024-09-21T08:02:58.409 INFO:tasks.workunit.client.0.smithi107.stdout:7/799: mkdir d7/d22/d37/d5a/d83/d109 0 2024-09-21T08:02:58.413 INFO:tasks.workunit.client.0.smithi107.stdout:0/937: rename d1/d5/d25/d3d/f100 to d1/d5/d25/d3d/d20/d29/d55/d91/d9a/dd1/dfb/f138 0 2024-09-21T08:02:58.418 INFO:tasks.workunit.client.0.smithi107.stdout:0/938: rmdir d1/d5/d25/d3d/d20/d29 39 2024-09-21T08:02:58.420 INFO:tasks.workunit.client.0.smithi107.stdout:0/939: mknod d1/d5/d25/d3d/d20/d85/d8a/c139 0 2024-09-21T08:02:58.428 INFO:tasks.workunit.client.0.smithi107.stdout:7/800: dwrite d7/d22/d3d/f50 [0,4194304] 0 2024-09-21T08:02:58.430 INFO:tasks.workunit.client.0.smithi107.stdout:0/940: dread d1/d5/d25/d3d/d20/d85/da8/fda [0,4194304] 0 2024-09-21T08:02:58.430 INFO:tasks.workunit.client.0.smithi107.stdout:0/941: chown d1/d5/d25/d3d/f105 785 1 2024-09-21T08:02:58.430 INFO:tasks.workunit.client.0.smithi107.stdout:0/942: stat d1/d5/d25/d3d/d20/d85/de1/ff2 0 2024-09-21T08:02:58.430 INFO:tasks.workunit.client.0.smithi107.stdout:0/943: dread - d1/d5/d25/d2d/f8f zero size 2024-09-21T08:02:58.430 INFO:tasks.workunit.client.0.smithi107.stdout:0/944: readlink d1/d5/d25/d3d/d20/d29/d5c/l120 0 2024-09-21T08:02:58.440 INFO:tasks.workunit.client.0.smithi107.stdout:7/801: mknod d7/d10/d64/db1/c10a 0 2024-09-21T08:02:58.440 INFO:tasks.workunit.client.0.smithi107.stdout:7/802: stat d7/d38/cdf 0 2024-09-21T08:02:58.446 INFO:tasks.workunit.client.0.smithi107.stdout:0/945: dwrite d1/d5/d25/d3d/fb5 [0,4194304] 0 2024-09-21T08:02:58.448 INFO:tasks.workunit.client.0.smithi107.stdout:0/946: unlink d1/d5/d25/d3d/d20/d85/d8a/cd2 0 2024-09-21T08:02:58.448 INFO:tasks.workunit.client.0.smithi107.stdout:0/947: fsync d1/d5/d25/d3d/d20/d85/d8a/f12d 0 2024-09-21T08:02:58.449 INFO:tasks.workunit.client.0.smithi107.stdout:0/948: link d1/d23/f3a d1/d5/d25/d3d/da1/f13a 0 2024-09-21T08:02:58.449 INFO:tasks.workunit.client.0.smithi107.stdout:0/949: write d1/d5/d75/ff3 [294118,76880] 0 2024-09-21T08:02:58.450 INFO:tasks.workunit.client.0.smithi107.stdout:0/950: write d1/d5/d25/d3d/d20/d29/d55/fcb [917204,120835] 0 2024-09-21T08:02:58.450 INFO:tasks.workunit.client.0.smithi107.stdout:0/951: creat d1/d5/d25/d3d/da1/f13b x:0 0 0 2024-09-21T08:02:58.450 INFO:tasks.workunit.client.0.smithi107.stdout:0/952: dread - d1/d5/f12c zero size 2024-09-21T08:02:58.450 INFO:tasks.workunit.client.0.smithi107.stdout:7/803: dread d7/d22/d37/d5a/d83/d9e/de2/ffc [0,4194304] 0 2024-09-21T08:02:58.450 INFO:tasks.workunit.client.0.smithi107.stdout:0/953: chown d1/d5/d25/d3d/d20/d29/d55/d91/d9a/dd1/f108 4 1 2024-09-21T08:02:58.451 INFO:tasks.workunit.client.0.smithi107.stdout:0/954: creat d1/d5/d25/d3d/d20/d85/f13c x:0 0 0 2024-09-21T08:02:58.452 INFO:tasks.workunit.client.0.smithi107.stdout:7/804: unlink d7/d22/d3b/fe6 0 2024-09-21T08:02:58.452 INFO:tasks.workunit.client.0.smithi107.stdout:7/805: chown d7/d10/d64/c88 193134532 1 2024-09-21T08:02:58.452 INFO:tasks.workunit.client.0.smithi107.stdout:7/806: truncate d7/d22/d37/d5a/f5b 645327 0 2024-09-21T08:02:58.453 INFO:tasks.workunit.client.0.smithi107.stdout:7/807: truncate d7/d22/f2d 1202740 0 2024-09-21T08:02:58.453 INFO:tasks.workunit.client.0.smithi107.stdout:0/955: rename d1/d5/d25/d3d/d20/d29/d5c/cc4 to d1/d5/d25/d3d/d20/d29/d55/d7a/c13d 0 2024-09-21T08:02:58.454 INFO:tasks.workunit.client.0.smithi107.stdout:7/808: mkdir d7/d10/d28/dba/d10b 0 2024-09-21T08:02:58.464 INFO:tasks.workunit.client.0.smithi107.stdout:0/956: rmdir d1/d5/d25/d3d/da1 39 2024-09-21T08:02:58.479 INFO:tasks.workunit.client.0.smithi107.stdout:0/957: dwrite d1/d5/fbb [0,4194304] 0 2024-09-21T08:02:58.481 INFO:tasks.workunit.client.0.smithi107.stdout:0/958: mknod d1/d5/d25/d3d/d20/d85/da8/c13e 0 2024-09-21T08:02:58.481 INFO:tasks.workunit.client.0.smithi107.stdout:0/959: dread - d1/d5/fe4 zero size 2024-09-21T08:02:58.484 INFO:tasks.workunit.client.0.smithi107.stdout:0/960: getdents d1/d5/d25/d9e/d11b 0 2024-09-21T08:02:58.484 INFO:tasks.workunit.client.0.smithi107.stdout:0/961: chown d1/d5/feb 2088384716 1 2024-09-21T08:02:58.493 INFO:tasks.workunit.client.0.smithi107.stdout:0/962: dread d1/d5/d25/fbe [0,4194304] 0 2024-09-21T08:02:58.498 INFO:tasks.workunit.client.0.smithi107.stdout:0/963: dread d1/d5/d25/d3d/f105 [0,4194304] 0 2024-09-21T08:02:58.505 INFO:tasks.workunit.client.0.smithi107.stdout:0/964: rename d1/d5/d25/d3d/d20/f6c to d1/d5/f13f 0 2024-09-21T08:02:58.507 INFO:tasks.workunit.client.0.smithi107.stdout:0/965: dread d1/d5/d25/d3d/d20/d85/d8a/f12d [0,4194304] 0 2024-09-21T08:02:58.507 INFO:tasks.workunit.client.0.smithi107.stdout:0/966: write d1/d5/d25/f4d [4547061,41445] 0 2024-09-21T08:02:58.508 INFO:tasks.workunit.client.0.smithi107.stdout:0/967: truncate d1/d5/d25/fa6 11860293 0 2024-09-21T08:02:58.510 INFO:tasks.workunit.client.0.smithi107.stdout:0/968: rmdir d1/d5/d25/d3d/da1 39 2024-09-21T08:02:58.527 INFO:tasks.workunit.client.0.smithi107.stdout:0/969: dwrite d1/d5/d25/d3d/d20/d29/d55/fac [0,4194304] 0 2024-09-21T08:02:58.541 INFO:tasks.workunit.client.0.smithi107.stdout:0/970: dwrite d1/d5/d25/d3d/d20/d85/de1/df9/f12a [0,4194304] 0 2024-09-21T08:02:58.546 INFO:tasks.workunit.client.0.smithi107.stdout:0/971: unlink d1/d5/d25/d3d/d20/d29/d55/fdc 0 2024-09-21T08:02:58.549 INFO:tasks.workunit.client.0.smithi107.stdout:0/972: symlink d1/d5/d25/d3d/d20/d29/dd0/l140 0 2024-09-21T08:02:58.553 INFO:tasks.workunit.client.0.smithi107.stdout:0/973: rmdir d1/d23 39 2024-09-21T08:02:58.556 INFO:tasks.workunit.client.0.smithi107.stdout:0/974: mknod d1/d5/d25/d3d/d20/d85/da8/c141 0 2024-09-21T08:02:58.560 INFO:tasks.workunit.client.0.smithi107.stdout:0/975: symlink d1/d5/d25/l142 0 2024-09-21T08:02:58.652 INFO:tasks.workunit.client.0.smithi107.stdout:0/976: rename d1/d5/d25/d2d to d1/d5/d25/d3d/d20/d85/de1/df9/d143 0 2024-09-21T08:02:58.656 INFO:tasks.workunit.client.0.smithi107.stdout:0/977: link d1/d5/d25/f4d d1/d6f/dc1/d136/f144 0 2024-09-21T08:02:58.660 INFO:tasks.workunit.client.0.smithi107.stdout:0/978: rmdir d1/d6f/d80 39 2024-09-21T08:02:58.669 INFO:tasks.workunit.client.0.smithi107.stdout:0/979: write d1/d5/d25/d3d/d20/da0/f119 [1824355,109414] 0 2024-09-21T08:02:58.669 INFO:tasks.workunit.client.0.smithi107.stdout:0/980: chown d1/d5/d25/d3d/d20/d85/de1/df9/d143/d8e/f116 129 1 2024-09-21T08:02:58.671 INFO:tasks.workunit.client.0.smithi107.stdout:0/981: mknod d1/d6f/c145 0 2024-09-21T08:02:58.671 INFO:tasks.workunit.client.0.smithi107.stdout:0/982: dread - d1/d5/d75/ff4 zero size 2024-09-21T08:02:58.672 INFO:tasks.workunit.client.0.smithi107.stdout:0/983: fsync d1/f131 0 2024-09-21T08:02:58.672 INFO:tasks.workunit.client.0.smithi107.stdout:0/984: creat d1/d5/d25/d3d/d20/d85/f146 x:0 0 0 2024-09-21T08:02:58.692 INFO:tasks.workunit.client.0.smithi107.stdout:0/985: dwrite d1/d5/d25/d3d/d20/d29/d5c/d11c/f125 [0,4194304] 0 2024-09-21T08:02:58.692 INFO:tasks.workunit.client.0.smithi107.stdout:0/986: stat d1/d5/d75 0 2024-09-21T08:02:58.700 INFO:tasks.workunit.client.0.smithi107.stdout:0/987: write d1/d23/f8b [1216424,90231] 0 2024-09-21T08:02:58.715 INFO:tasks.workunit.client.0.smithi107.stdout:0/988: dwrite d1/d5/d25/d3d/f33 [0,4194304] 0 2024-09-21T08:02:58.715 INFO:tasks.workunit.client.0.smithi107.stdout:0/989: readlink d1/l52 0 2024-09-21T08:02:58.715 INFO:tasks.workunit.client.0.smithi107.stdout:0/990: write d1/d5/d25/d3d/d20/d29/d55/d7a/f95 [1603630,76383] 0 2024-09-21T08:02:58.715 INFO:tasks.workunit.client.0.smithi107.stdout:0/991: chown d1/d5/d25/d9e/cb8 232588863 1 2024-09-21T08:02:58.719 INFO:tasks.workunit.client.0.smithi107.stdout:0/992: link d1/d5/d25/d3d/d20/d29/d5c/lf5 d1/d5/d25/d3d/d124/l147 0 2024-09-21T08:02:58.722 INFO:tasks.workunit.client.0.smithi107.stdout:0/993: mkdir d1/d5/d25/d3d/d20/d29/d5c/d148 0 2024-09-21T08:02:58.722 INFO:tasks.workunit.client.0.smithi107.stdout:0/994: chown d1/d5/d25/d9e/d103 447909215 1 2024-09-21T08:02:58.731 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:58 smithi107 ceph-mon[27622]: pgmap v21: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 156 MiB/s rd, 178 MiB/s wr, 348 op/s 2024-09-21T08:02:58.731 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:58 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:58.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:58 smithi129 ceph-mon[34472]: pgmap v21: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 156 MiB/s rd, 178 MiB/s wr, 348 op/s 2024-09-21T08:02:58.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:58 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:58.960 INFO:tasks.workunit.client.0.smithi107.stdout:7/809: sync 2024-09-21T08:02:58.960 INFO:tasks.workunit.client.0.smithi107.stdout:0/995: sync 2024-09-21T08:02:58.961 INFO:tasks.workunit.client.0.smithi107.stdout:0/996: truncate d1/d5/d25/d3d/d20/d85/d8a/f9b 2066274 0 2024-09-21T08:02:58.964 INFO:tasks.workunit.client.0.smithi107.stdout:0/997: mknod d1/d5/d25/d3d/d20/d85/d8a/d127/c149 0 2024-09-21T08:02:58.964 INFO:tasks.workunit.client.0.smithi107.stdout:0/998: dread - d1/d23/f9c zero size 2024-09-21T08:02:58.967 INFO:tasks.workunit.client.0.smithi107.stdout:0/999: symlink d1/d5/d25/d3d/d20/d85/de1/df9/l14a 0 2024-09-21T08:02:58.972 INFO:tasks.workunit.client.0.smithi107.stdout:7/810: dread d7/d22/f24 [0,4194304] 0 2024-09-21T08:02:58.977 INFO:tasks.workunit.client.0.smithi107.stdout:7/811: creat d7/d22/f10c x:0 0 0 2024-09-21T08:02:58.977 INFO:tasks.workunit.client.0.smithi107.stdout:7/812: chown d7/d22/d37/d4b/db0/l70 851152507 1 2024-09-21T08:02:58.980 INFO:tasks.workunit.client.0.smithi107.stdout:7/813: creat d7/d10/d28/d69/f10d x:0 0 0 2024-09-21T08:02:58.982 INFO:tasks.workunit.client.0.smithi107.stdout:7/814: symlink d7/d22/d37/d5a/d83/d109/l10e 0 2024-09-21T08:02:58.986 INFO:tasks.workunit.client.0.smithi107.stdout:7/815: mknod d7/d22/d3a/c10f 0 2024-09-21T08:02:58.986 INFO:tasks.workunit.client.0.smithi107.stdout:7/816: write d7/d22/d37/d5a/fad [844925,103588] 0 2024-09-21T08:02:58.987 INFO:tasks.workunit.client.0.smithi107.stdout:7/817: fdatasync d7/d22/f76 0 2024-09-21T08:02:58.998 INFO:tasks.workunit.client.0.smithi107.stdout:7/818: write d7/d22/d37/d4b/db0/d4f/fb3 [367269,130375] 0 2024-09-21T08:02:59.001 INFO:tasks.workunit.client.0.smithi107.stdout:7/819: unlink d7/d10/f100 0 2024-09-21T08:02:59.001 INFO:tasks.workunit.client.0.smithi107.stdout:7/820: chown d7/c15 765805430 1 2024-09-21T08:02:59.003 INFO:tasks.workunit.client.0.smithi107.stdout:7/821: mknod d7/d22/d37/c110 0 2024-09-21T08:02:59.006 INFO:tasks.workunit.client.0.smithi107.stdout:7/822: mkdir d7/d22/d37/d5a/d83/d9e/de2/d108/d111 0 2024-09-21T08:02:59.006 INFO:tasks.workunit.client.0.smithi107.stdout:7/823: write d7/d22/d3a/fe0 [2357943,100527] 0 2024-09-21T08:02:59.010 INFO:tasks.workunit.client.0.smithi107.stdout:7/824: unlink d7/d22/d37/d5a/c6b 0 2024-09-21T08:02:59.010 INFO:tasks.workunit.client.0.smithi107.stdout:7/825: creat d7/d10/d64/db1/f112 x:0 0 0 2024-09-21T08:02:59.010 INFO:tasks.workunit.client.0.smithi107.stdout:7/826: read - d7/d10/fcd zero size 2024-09-21T08:02:59.015 INFO:tasks.workunit.client.0.smithi107.stdout:7/827: dread d7/d22/d37/d4b/db0/f62 [0,4194304] 0 2024-09-21T08:02:59.015 INFO:tasks.workunit.client.0.smithi107.stdout:7/828: readlink d7/d18/l2b 0 2024-09-21T08:02:59.019 INFO:tasks.workunit.client.0.smithi107.stdout:7/829: unlink d7/d10/f17 0 2024-09-21T08:02:59.019 INFO:tasks.workunit.client.0.smithi107.stdout:7/830: creat d7/d10/d64/db1/f113 x:0 0 0 2024-09-21T08:02:59.024 INFO:tasks.workunit.client.0.smithi107.stdout:7/831: link d7/d10/d28/d69/f91 d7/d22/d3a/d49/d56/f114 0 2024-09-21T08:02:59.027 INFO:tasks.workunit.client.0.smithi107.stdout:7/832: creat d7/d22/d37/d5a/d83/d109/f115 x:0 0 0 2024-09-21T08:02:59.040 INFO:tasks.workunit.client.0.smithi107.stdout:7/833: fsync d7/d22/d3a/d49/d56/f114 0 2024-09-21T08:02:59.049 INFO:tasks.workunit.client.0.smithi107.stdout:7/834: dread d7/d22/d37/fa7 [0,4194304] 0 2024-09-21T08:02:59.050 INFO:tasks.workunit.client.0.smithi107.stdout:7/835: creat d7/d22/d37/d5a/d83/d9e/de2/d108/d111/f116 x:0 0 0 2024-09-21T08:02:59.050 INFO:tasks.workunit.client.0.smithi107.stdout:7/836: chown d7/d18/c1b 5414 1 2024-09-21T08:02:59.050 INFO:tasks.workunit.client.0.smithi107.stdout:7/837: creat d7/d22/d3a/d49/df1/f117 x:0 0 0 2024-09-21T08:02:59.050 INFO:tasks.workunit.client.0.smithi107.stdout:7/838: fdatasync d7/d22/d3d/d8a/dd4/deb/ffa 0 2024-09-21T08:02:59.071 INFO:tasks.workunit.client.0.smithi107.stdout:7/839: dwrite d7/d22/d37/d5a/f8c [0,4194304] 0 2024-09-21T08:02:59.080 INFO:tasks.workunit.client.0.smithi107.stdout:7/840: write d7/d22/d3d/fa2 [3591607,105173] 0 2024-09-21T08:02:59.080 INFO:tasks.workunit.client.0.smithi107.stdout:7/841: fdatasync d7/d22/d37/d4b/f4c 0 2024-09-21T08:02:59.081 INFO:tasks.workunit.client.0.smithi107.stdout:7/842: creat d7/d22/d37/d4b/f118 x:0 0 0 2024-09-21T08:02:59.084 INFO:tasks.workunit.client.0.smithi107.stdout:7/843: rename d7/d22/d3d/d8a/dd4/lf8 to d7/d10/d28/d69/l119 0 2024-09-21T08:02:59.085 INFO:tasks.workunit.client.0.smithi107.stdout:7/844: mkdir d7/d11a 0 2024-09-21T08:02:59.088 INFO:tasks.workunit.client.0.smithi107.stdout:7/845: rename d7/d22/d37/d5a/c84 to d7/d18/c11b 0 2024-09-21T08:02:59.090 INFO:tasks.workunit.client.0.smithi107.stdout:7/846: rename d7/d18/l85 to d7/d22/d3d/d8a/dd4/df3/l11c 0 2024-09-21T08:02:59.091 INFO:tasks.workunit.client.0.smithi107.stdout:7/847: creat d7/d22/d3d/d8a/dd4/f11d x:0 0 0 2024-09-21T08:02:59.092 INFO:tasks.workunit.client.0.smithi107.stdout:7/848: write d7/d22/d3a/fe0 [3693837,86591] 0 2024-09-21T08:02:59.093 INFO:tasks.workunit.client.0.smithi107.stdout:7/849: rename d7/d10/c58 to d7/d22/d37/d4b/c11e 0 2024-09-21T08:02:59.093 INFO:tasks.workunit.client.0.smithi107.stdout:7/850: write d7/d10/d28/f35 [3037650,56539] 0 2024-09-21T08:02:59.094 INFO:tasks.workunit.client.0.smithi107.stdout:7/851: getdents d7/d22/d37/d5a/d83/d9e 0 2024-09-21T08:02:59.096 INFO:tasks.workunit.client.0.smithi107.stdout:7/852: creat d7/d22/d37/d5a/d83/d9e/f11f x:0 0 0 2024-09-21T08:02:59.098 INFO:tasks.workunit.client.0.smithi107.stdout:7/853: rename d7/d22/d3a/d49/d56/cfe to d7/d22/d3a/d49/c120 0 2024-09-21T08:02:59.099 INFO:tasks.workunit.client.0.smithi107.stdout:7/854: rmdir d7/d38/dc1 39 2024-09-21T08:02:59.106 INFO:tasks.workunit.client.0.smithi107.stdout:7/855: dread d7/d22/d37/d4b/f7e [0,4194304] 0 2024-09-21T08:02:59.109 INFO:tasks.workunit.client.0.smithi107.stdout:7/856: rename d7/dc3/cd0 to d7/d22/d3a/d49/df1/c121 0 2024-09-21T08:02:59.109 INFO:tasks.workunit.client.0.smithi107.stdout:7/857: fdatasync d7/d10/d28/d69/da0/fc6 0 2024-09-21T08:02:59.124 INFO:tasks.workunit.client.0.smithi107.stdout:7/858: dwrite d7/d10/d64/db1/f113 [0,4194304] 0 2024-09-21T08:02:59.127 INFO:tasks.workunit.client.0.smithi107.stdout:7/859: mkdir d7/d22/d37/d40/d122 0 2024-09-21T08:02:59.127 INFO:tasks.workunit.client.0.smithi107.stdout:7/860: readlink d7/d22/d3a/d49/ldb 0 2024-09-21T08:02:59.127 INFO:tasks.workunit.client.0.smithi107.stdout:7/861: fdatasync d7/d38/f7d 0 2024-09-21T08:02:59.205 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T08:02:59.205 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-21T08:02:59.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:59 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:59.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:59 smithi129 ceph-mon[34472]: Reconfiguring alertmanager.smithi107 (dependencies changed)... 2024-09-21T08:02:59.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:02:59 smithi129 ceph-mon[34472]: Deploying daemon alertmanager.smithi107 on smithi107 2024-09-21T08:02:59.800 INFO:tasks.workunit.client.0.smithi107.stdout:7/862: sync 2024-09-21T08:02:59.800 INFO:tasks.workunit.client.0.smithi107.stdout:7/863: fdatasync d7/d10/d28/d69/f10d 0 2024-09-21T08:02:59.801 INFO:tasks.workunit.client.0.smithi107.stdout:7/864: creat d7/dc3/f123 x:0 0 0 2024-09-21T08:02:59.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:59 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:02:59.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:59 smithi107 ceph-mon[27622]: Reconfiguring alertmanager.smithi107 (dependencies changed)... 2024-09-21T08:02:59.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:02:59 smithi107 ceph-mon[27622]: Deploying daemon alertmanager.smithi107 on smithi107 2024-09-21T08:02:59.824 INFO:tasks.workunit.client.0.smithi107.stdout:7/865: dwrite d7/d10/d28/d69/da0/fbc [0,4194304] 0 2024-09-21T08:02:59.825 INFO:tasks.workunit.client.0.smithi107.stdout:7/866: mknod d7/d22/d3b/c124 0 2024-09-21T08:02:59.827 INFO:tasks.workunit.client.0.smithi107.stdout:7/867: creat d7/d22/f125 x:0 0 0 2024-09-21T08:02:59.828 INFO:tasks.workunit.client.0.smithi107.stdout:7/868: getdents d7/d22/d3a/d49/d56 0 2024-09-21T08:02:59.834 INFO:tasks.workunit.client.0.smithi107.stdout:7/869: unlink d7/d22/d37/d5a/d83/d9e/fb9 0 2024-09-21T08:02:59.858 INFO:tasks.workunit.client.0.smithi107.stdout:7/870: dwrite d7/d22/d37/d4b/f9d [0,4194304] 0 2024-09-21T08:02:59.858 INFO:tasks.workunit.client.0.smithi107.stdout:7/871: stat d7/d22/d37/d4b/lf9 0 2024-09-21T08:02:59.861 INFO:tasks.workunit.client.0.smithi107.stdout:7/872: unlink d7/d38/c6d 0 2024-09-21T08:02:59.876 INFO:tasks.workunit.client.0.smithi107.stdout:7/873: dread d7/d22/d3d/f50 [0,4194304] 0 2024-09-21T08:02:59.877 INFO:tasks.workunit.client.0.smithi107.stdout:7/874: write d7/d22/f10c [112937,75723] 0 2024-09-21T08:02:59.881 INFO:tasks.workunit.client.0.smithi107.stdout:7/875: mkdir d7/d38/d126 0 2024-09-21T08:02:59.883 INFO:tasks.workunit.client.0.smithi107.stdout:7/876: symlink d7/d22/d3a/d49/d56/l127 0 2024-09-21T08:02:59.884 INFO:tasks.workunit.client.0.smithi107.stdout:7/877: mknod d7/d11a/c128 0 2024-09-21T08:02:59.907 INFO:tasks.workunit.client.0.smithi107.stdout:7/878: dwrite d7/d22/d37/d4b/db0/d4f/fc0 [0,4194304] 0 2024-09-21T08:03:00.215 INFO:tasks.workunit.client.0.smithi107.stdout:7/879: sync 2024-09-21T08:03:00.232 INFO:tasks.workunit.client.0.smithi107.stdout:7/880: dwrite d7/d22/d37/d5a/d83/d9e/de2/ffc [0,4194304] 0 2024-09-21T08:03:00.232 INFO:tasks.workunit.client.0.smithi107.stdout:7/881: chown d7/d22/d37/d5a/lb8 446542896 1 2024-09-21T08:03:00.233 INFO:tasks.workunit.client.0.smithi107.stdout:7/882: symlink d7/d22/d37/d5a/d83/d109/l129 0 2024-09-21T08:03:00.233 INFO:tasks.workunit.client.0.smithi107.stdout:7/883: stat d7/d22/d3d/d8a/dd4/f102 0 2024-09-21T08:03:00.233 INFO:tasks.workunit.client.0.smithi107.stdout:7/884: write d7/d22/d37/d5a/f66 [411391,80405] 0 2024-09-21T08:03:00.235 INFO:tasks.workunit.client.0.smithi107.stdout:7/885: creat d7/d22/d37/d4b/db0/d4f/f12a x:0 0 0 2024-09-21T08:03:00.235 INFO:tasks.workunit.client.0.smithi107.stdout:7/886: chown d7/d10/d28/d69/f91 4025725 1 2024-09-21T08:03:00.236 INFO:tasks.workunit.client.0.smithi107.stdout:7/887: rmdir d7 39 2024-09-21T08:03:00.245 INFO:tasks.workunit.client.0.smithi107.stdout:7/888: write d7/d22/d3d/d8a/f8d [8331034,52646] 0 2024-09-21T08:03:00.246 INFO:tasks.workunit.client.0.smithi107.stdout:7/889: fdatasync d7/d22/d37/d4b/db0/d4f/fb3 0 2024-09-21T08:03:00.247 INFO:tasks.workunit.client.0.smithi107.stdout:7/890: fdatasync d7/d22/d37/d5a/fec 0 2024-09-21T08:03:00.248 INFO:tasks.workunit.client.0.smithi107.stdout:7/891: rmdir d7/d22/d3a/d49/d56 39 2024-09-21T08:03:00.257 INFO:tasks.workunit.client.0.smithi107.stdout:7/892: dread d7/d22/d3a/d49/f74 [0,4194304] 0 2024-09-21T08:03:00.257 INFO:tasks.workunit.client.0.smithi107.stdout:7/893: stat d7/d10/d28/d69/l119 0 2024-09-21T08:03:00.258 INFO:tasks.workunit.client.0.smithi107.stdout:7/894: fdatasync d7/f13 0 2024-09-21T08:03:00.258 INFO:tasks.workunit.client.0.smithi107.stdout:7/895: fdatasync d7/d22/d3a/fc8 0 2024-09-21T08:03:00.259 INFO:tasks.workunit.client.0.smithi107.stdout:7/896: symlink d7/d10/l12b 0 2024-09-21T08:03:00.456 INFO:tasks.workunit.client.0.smithi107.stdout:7/897: sync 2024-09-21T08:03:00.456 INFO:tasks.workunit.client.0.smithi107.stdout:7/898: write d7/d10/d28/d69/da0/fbc [4531459,111130] 0 2024-09-21T08:03:00.476 INFO:tasks.workunit.client.0.smithi107.stdout:7/899: dwrite d7/d22/d3d/f50 [0,4194304] 0 2024-09-21T08:03:00.477 INFO:tasks.workunit.client.0.smithi107.stdout:7/900: creat d7/d22/d37/d40/d122/f12c x:0 0 0 2024-09-21T08:03:00.478 INFO:tasks.workunit.client.0.smithi107.stdout:7/901: truncate d7/d18/fa6 1970339 0 2024-09-21T08:03:00.478 INFO:tasks.workunit.client.0.smithi107.stdout:7/902: chown d7/d22/d37/d4b/f5e 51478368 1 2024-09-21T08:03:00.479 INFO:tasks.workunit.client.0.smithi107.stdout:7/903: symlink d7/d22/d3d/d8a/dd4/deb/l12d 0 2024-09-21T08:03:00.480 INFO:tasks.workunit.client.0.smithi107.stdout:7/904: fdatasync d7/d22/f2d 0 2024-09-21T08:03:00.481 INFO:tasks.workunit.client.0.smithi107.stdout:7/905: getdents d7/d22/d37/d4b 0 2024-09-21T08:03:00.481 INFO:tasks.workunit.client.0.smithi107.stdout:7/906: truncate d7/d22/d37/d4b/f5e 1740139 0 2024-09-21T08:03:00.483 INFO:tasks.workunit.client.0.smithi107.stdout:7/907: getdents d7/d22/d3d/d8a/dd4/df3 0 2024-09-21T08:03:00.483 INFO:tasks.workunit.client.0.smithi107.stdout:7/908: readlink d7/d22/d37/d5a/d83/d109/l10e 0 2024-09-21T08:03:00.484 INFO:tasks.workunit.client.0.smithi107.stdout:7/909: mkdir d7/d22/d3d/d12e 0 2024-09-21T08:03:00.487 INFO:tasks.workunit.client.0.smithi107.stdout:7/910: rename d7/d22/d3d/fa2 to d7/dc3/f12f 0 2024-09-21T08:03:00.487 INFO:tasks.workunit.client.0.smithi107.stdout:7/911: chown d7/d38/f7d 21 1 2024-09-21T08:03:00.488 INFO:tasks.workunit.client.0.smithi107.stdout:7/912: rename d7/d22/d3a/d49/df1/cf5 to d7/d22/d3a/d49/df1/c130 0 2024-09-21T08:03:00.490 INFO:tasks.workunit.client.0.smithi107.stdout:7/913: rmdir d7/d22/d37/d4b/db0 39 2024-09-21T08:03:00.491 INFO:tasks.workunit.client.0.smithi107.stdout:7/914: unlink d7/d18/c1b 0 2024-09-21T08:03:00.492 INFO:tasks.workunit.client.0.smithi107.stdout:7/915: truncate d7/d22/d37/fcf 1019603 0 2024-09-21T08:03:00.500 INFO:tasks.workunit.client.0.smithi107.stdout:7/916: rmdir d7/d22/d37/d5a/d83/d9e/de2/d108/d111 39 2024-09-21T08:03:00.500 INFO:tasks.workunit.client.0.smithi107.stdout:7/917: chown d7/d22/d37/d40/d4d/f6a 53654 1 2024-09-21T08:03:00.500 INFO:tasks.workunit.client.0.smithi107.stdout:7/918: truncate d7/d10/d64/db1/f112 89733 0 2024-09-21T08:03:00.502 INFO:tasks.workunit.client.0.smithi107.stdout:7/919: getdents d7/d22/d3a/d49/d56 0 2024-09-21T08:03:00.506 INFO:tasks.workunit.client.0.smithi107.stdout:7/920: creat d7/d22/d37/d5a/d83/d9e/de2/d108/f131 x:0 0 0 2024-09-21T08:03:00.509 INFO:tasks.workunit.client.0.smithi107.stdout:7/921: creat d7/d22/d37/d5a/d83/d9e/de2/d108/d111/f132 x:0 0 0 2024-09-21T08:03:00.512 INFO:tasks.workunit.client.0.smithi107.stdout:7/922: unlink d7/d22/d3a/d49/fe4 0 2024-09-21T08:03:00.512 INFO:tasks.workunit.client.0.smithi107.stdout:7/923: stat d7/d22 0 2024-09-21T08:03:00.513 INFO:tasks.workunit.client.0.smithi107.stdout:7/924: rename d7/d22/d37/d5a/d83/d109/f115 to d7/d22/d3d/d8a/dd4/deb/f133 0 2024-09-21T08:03:00.514 INFO:tasks.workunit.client.0.smithi107.stdout:7/925: creat d7/d22/d37/d4b/f134 x:0 0 0 2024-09-21T08:03:00.514 INFO:tasks.workunit.client.0.smithi107.stdout:7/926: getdents d7/d22/d3a/d49/d56 0 2024-09-21T08:03:00.518 INFO:tasks.workunit.client.0.smithi107.stdout:7/927: rmdir d7/d22/d3d/d8a/dd4/deb 39 2024-09-21T08:03:00.521 INFO:tasks.workunit.client.0.smithi107.stdout:7/928: rename d7/d22/d37/d4b/f5e to d7/d22/d37/d4b/f135 0 2024-09-21T08:03:00.523 INFO:tasks.workunit.client.0.smithi107.stdout:7/929: mknod d7/d10/d28/d69/c136 0 2024-09-21T08:03:00.525 INFO:tasks.workunit.client.0.smithi107.stdout:7/930: mkdir d7/d10/d64/d137 0 2024-09-21T08:03:00.525 INFO:tasks.workunit.client.0.smithi107.stdout:7/931: truncate d7/d22/d3d/d8a/dd4/f102 1528282 0 2024-09-21T08:03:00.530 INFO:tasks.workunit.client.0.smithi107.stdout:7/932: dread d7/d22/d37/d4b/f7e [0,4194304] 0 2024-09-21T08:03:00.545 INFO:tasks.workunit.client.0.smithi107.stdout:7/933: dwrite d7/d38/f7d [4194304,4194304] 0 2024-09-21T08:03:00.545 INFO:tasks.workunit.client.0.smithi107.stdout:7/934: read d7/d22/d37/d5a/fec [193461,81902] 0 2024-09-21T08:03:00.552 INFO:tasks.workunit.client.0.smithi107.stdout:7/935: truncate d7/d22/d3a/d49/dbe/fd7 1072454 0 2024-09-21T08:03:00.553 INFO:tasks.workunit.client.0.smithi107.stdout:7/936: creat d7/d22/d3b/f138 x:0 0 0 2024-09-21T08:03:00.557 INFO:tasks.workunit.client.0.smithi107.stdout:7/937: unlink d7/d22/d37/c110 0 2024-09-21T08:03:00.557 INFO:tasks.workunit.client.0.smithi107.stdout:7/938: rename d7/d22 to d7/d22/d37/d40/d122/d139 22 2024-09-21T08:03:00.577 INFO:tasks.workunit.client.0.smithi107.stdout:7/939: dwrite d7/d22/d37/d4b/f118 [0,4194304] 0 2024-09-21T08:03:00.580 INFO:tasks.workunit.client.0.smithi107.stdout:7/940: readlink d7/d22/d37/d5a/d83/d9e/l101 0 2024-09-21T08:03:00.580 INFO:tasks.workunit.client.0.smithi107.stdout:7/941: dread - d7/d22/d37/d4b/db0/d4f/f12a zero size 2024-09-21T08:03:00.598 INFO:tasks.workunit.client.0.smithi107.stdout:7/942: dwrite d7/d22/f76 [0,4194304] 0 2024-09-21T08:03:00.608 INFO:tasks.workunit.client.0.smithi107.stdout:7/943: write d7/d22/d3a/d49/f74 [1183283,115517] 0 2024-09-21T08:03:00.608 INFO:tasks.workunit.client.0.smithi107.stdout:7/944: fdatasync d7/d22/d37/d40/d4d/f6a 0 2024-09-21T08:03:00.609 INFO:tasks.workunit.client.0.smithi107.stdout:7/945: getdents d7/d38/dc1 0 2024-09-21T08:03:00.610 INFO:tasks.workunit.client.0.smithi107.stdout:7/946: stat d7/d10/d64/laa 0 2024-09-21T08:03:00.612 INFO:tasks.workunit.client.0.smithi107.stdout:7/947: unlink d7/d18/f19 0 2024-09-21T08:03:00.614 INFO:tasks.workunit.client.0.smithi107.stdout:7/948: rename d7/d22/d3d/d8a/dd4/f11d to d7/d22/d37/d5a/d83/f13a 0 2024-09-21T08:03:00.614 INFO:tasks.workunit.client.0.smithi107.stdout:7/949: write d7/d10/f90 [5471272,94929] 0 2024-09-21T08:03:00.614 INFO:tasks.workunit.client.0.smithi107.stdout:7/950: chown d7/d22/d37/d5a/d83/d9e/fb5 263 1 2024-09-21T08:03:00.615 INFO:tasks.workunit.client.0.smithi107.stdout:7/951: write d7/d22/d37/d4b/f135 [407034,82410] 0 2024-09-21T08:03:00.618 INFO:tasks.workunit.client.0.smithi107.stdout:7/952: dread d7/d10/d64/db1/f112 [0,4194304] 0 2024-09-21T08:03:00.618 INFO:tasks.workunit.client.0.smithi107.stdout:7/953: chown d7/d22/d37/d4b/f9d 13448541 1 2024-09-21T08:03:00.618 INFO:tasks.workunit.client.0.smithi107.stdout:7/954: chown d7/d10/d28/d69/da0/cde 268537 1 2024-09-21T08:03:00.619 INFO:tasks.workunit.client.0.smithi107.stdout:7/955: creat d7/f13b x:0 0 0 2024-09-21T08:03:00.619 INFO:tasks.workunit.client.0.smithi107.stdout:7/956: write d7/d22/d37/d5a/d83/d9e/f11f [511029,30031] 0 2024-09-21T08:03:00.619 INFO:tasks.workunit.client.0.smithi107.stdout:7/957: creat d7/d22/d3a/d49/d56/f13c x:0 0 0 2024-09-21T08:03:00.621 INFO:tasks.workunit.client.0.smithi107.stdout:7/958: dread d7/d22/d3a/f67 [0,4194304] 0 2024-09-21T08:03:00.622 INFO:tasks.workunit.client.0.smithi107.stdout:7/959: write d7/d22/d37/d4b/f7e [887494,38789] 0 2024-09-21T08:03:00.623 INFO:tasks.workunit.client.0.smithi107.stdout:7/960: mkdir d7/d22/d3d/d8a/d13d 0 2024-09-21T08:03:00.623 INFO:tasks.workunit.client.0.smithi107.stdout:7/961: write d7/d22/d37/d4b/db0/d4f/fb3 [1106647,17287] 0 2024-09-21T08:03:00.631 INFO:tasks.workunit.client.0.smithi107.stdout:7/962: read d7/d22/d37/d5a/d83/d9e/de2/ffc [4055799,126060] 0 2024-09-21T08:03:00.631 INFO:tasks.workunit.client.0.smithi107.stdout:7/963: write d7/d22/d37/d4b/db0/f81 [4338949,101774] 0 2024-09-21T08:03:00.639 INFO:tasks.workunit.client.0.smithi107.stdout:7/964: rename d7/d22/d37 to d7/d22/d3a/d49/d56/d13e 0 2024-09-21T08:03:00.640 INFO:tasks.workunit.client.0.smithi107.stdout:7/965: mknod d7/d38/dc1/c13f 0 2024-09-21T08:03:00.657 INFO:tasks.workunit.client.0.smithi107.stdout:7/966: dwrite d7/d22/d3a/fc8 [0,4194304] 0 2024-09-21T08:03:00.663 INFO:tasks.workunit.client.0.smithi107.stdout:7/967: truncate d7/d22/d3d/f50 2510398 0 2024-09-21T08:03:00.666 INFO:tasks.workunit.client.0.smithi107.stdout:7/968: truncate d7/d22/d3d/f7c 382264 0 2024-09-21T08:03:00.669 INFO:tasks.workunit.client.0.smithi107.stdout:7/969: dread d7/d22/d3a/d49/d56/d13e/d40/d4d/f6a [0,4194304] 0 2024-09-21T08:03:00.671 INFO:tasks.workunit.client.0.smithi107.stdout:7/970: link d7/d10/l27 d7/d22/d3a/d49/d56/l140 0 2024-09-21T08:03:00.675 INFO:tasks.workunit.client.0.smithi107.stdout:7/971: getdents d7/d10/d28/d69 0 2024-09-21T08:03:00.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:00 smithi129 ceph-mon[34472]: pgmap v22: 65 pgs: 65 active+clean; 2.6 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 175 MiB/s rd, 194 MiB/s wr, 409 op/s 2024-09-21T08:03:00.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:00 smithi107 ceph-mon[27622]: pgmap v22: 65 pgs: 65 active+clean; 2.6 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 175 MiB/s rd, 194 MiB/s wr, 409 op/s 2024-09-21T08:03:01.258 INFO:tasks.workunit.client.0.smithi107.stdout:7/972: sync 2024-09-21T08:03:01.258 INFO:tasks.workunit.client.0.smithi107.stdout:7/973: fsync d7/d22/d3d/f50 0 2024-09-21T08:03:01.282 INFO:tasks.workunit.client.0.smithi107.stdout:7/974: dwrite d7/d22/d3d/d8a/f8d [4194304,4194304] 0 2024-09-21T08:03:01.297 INFO:tasks.workunit.client.0.smithi107.stdout:7/975: dwrite d7/d22/d3a/d49/d56/d13e/d5a/d83/d9e/de2/d108/d111/f132 [0,4194304] 0 2024-09-21T08:03:01.297 INFO:tasks.workunit.client.0.smithi107.stdout:7/976: chown d7/d22/d3a/d49/f74 6325910 1 2024-09-21T08:03:01.297 INFO:tasks.workunit.client.0.smithi107.stdout:7/977: chown d7/d22/d3d/d8a 1270674 1 2024-09-21T08:03:01.301 INFO:tasks.workunit.client.0.smithi107.stdout:7/978: mkdir d7/d22/d3a/d49/d56/d13e/d4b/d141 0 2024-09-21T08:03:01.301 INFO:tasks.workunit.client.0.smithi107.stdout:7/979: stat d7/d22/d3d/f50 0 2024-09-21T08:03:01.301 INFO:tasks.workunit.client.0.smithi107.stdout:7/980: fsync d7/d22/d3d/d8a/dd4/f102 0 2024-09-21T08:03:01.302 INFO:tasks.workunit.client.0.smithi107.stdout:7/981: mkdir d7/d22/d3d/d8a/d142 0 2024-09-21T08:03:01.303 INFO:tasks.workunit.client.0.smithi107.stdout:7/982: creat d7/d22/d3a/f143 x:0 0 0 2024-09-21T08:03:01.306 INFO:tasks.workunit.client.0.smithi107.stdout:7/983: dread d7/d22/d3a/d49/d56/d13e/d4b/f135 [0,4194304] 0 2024-09-21T08:03:01.306 INFO:tasks.workunit.client.0.smithi107.stdout:7/984: fsync d7/d22/d3d/f42 0 2024-09-21T08:03:01.306 INFO:tasks.workunit.client.0.smithi107.stdout:7/985: fsync d7/f13 0 2024-09-21T08:03:01.306 INFO:tasks.workunit.client.0.smithi107.stdout:7/986: readlink d7/d10/d64/laa 0 2024-09-21T08:03:01.306 INFO:tasks.workunit.client.0.smithi107.stdout:7/987: chown d7/c16 24 1 2024-09-21T08:03:01.306 INFO:tasks.workunit.client.0.smithi107.stdout:7/988: write d7/d10/f1d [1848716,77702] 0 2024-09-21T08:03:01.307 INFO:tasks.workunit.client.0.smithi107.stdout:7/989: mknod d7/d22/d3d/d8a/d142/c144 0 2024-09-21T08:03:01.313 INFO:tasks.workunit.client.0.smithi107.stdout:7/990: write d7/d38/f7d [602560,94181] 0 2024-09-21T08:03:01.330 INFO:tasks.workunit.client.0.smithi107.stdout:7/991: dwrite d7/d10/d28/d69/da0/fc6 [0,4194304] 0 2024-09-21T08:03:01.349 INFO:tasks.workunit.client.0.smithi107.stdout:7/992: dwrite d7/f13 [0,4194304] 0 2024-09-21T08:03:01.349 INFO:tasks.workunit.client.0.smithi107.stdout:7/993: write d7/d10/d64/db1/f112 [759653,130423] 0 2024-09-21T08:03:01.349 INFO:tasks.workunit.client.0.smithi107.stdout:7/994: read d7/d18/f29 [7432957,46138] 0 2024-09-21T08:03:01.349 INFO:tasks.workunit.client.0.smithi107.stdout:7/995: chown d7/dc3/f123 49 1 2024-09-21T08:03:01.349 INFO:tasks.workunit.client.0.smithi107.stdout:7/996: symlink d7/d22/d3a/d49/d56/d13e/d40/l145 0 2024-09-21T08:03:01.350 INFO:tasks.workunit.client.0.smithi107.stdout:7/997: symlink d7/d22/d3a/d49/d56/d13e/d4b/db0/l146 0 2024-09-21T08:03:01.352 INFO:tasks.workunit.client.0.smithi107.stdout:7/998: truncate d7/d22/d3a/fe0 1491234 0 2024-09-21T08:03:01.366 INFO:tasks.workunit.client.0.smithi107.stdout:7/999: dwrite d7/d22/d3a/fc8 [4194304,4194304] 0 2024-09-21T08:03:01.370 INFO:tasks.workunit.client.0.smithi107.stderr:+ rm -rf -- ./tmp.VU57r2VfmB 2024-09-21T08:03:02.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:02 smithi129 ceph-mon[34472]: pgmap v23: 65 pgs: 65 active+clean; 2.6 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 132 MiB/s rd, 143 MiB/s wr, 285 op/s 2024-09-21T08:03:02.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:02 smithi107 ceph-mon[27622]: pgmap v23: 65 pgs: 65 active+clean; 2.6 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 132 MiB/s rd, 143 MiB/s wr, 285 op/s 2024-09-21T08:03:03.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.330+0000 7ff59baf8640 1 -- 172.21.15.107:0/3898821016 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5940ff6e0 msgr2=0x7ff594101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:03.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.330+0000 7ff59baf8640 1 --2- 172.21.15.107:0/3898821016 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5940ff6e0 0x7ff594101ac0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff5840048d0 tx=0x7ff584009da0 comp rx=0 tx=0).stop 2024-09-21T08:03:03.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.330+0000 7ff59baf8640 1 -- 172.21.15.107:0/3898821016 shutdown_connections 2024-09-21T08:03:03.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.330+0000 7ff59baf8640 1 --2- 172.21.15.107:0/3898821016 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5940ff6e0 0x7ff594101ac0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:03.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.330+0000 7ff59baf8640 1 --2- 172.21.15.107:0/3898821016 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff594065be0 0x7ff5940ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:03.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.330+0000 7ff59baf8640 1 -- 172.21.15.107:0/3898821016 >> 172.21.15.107:0/3898821016 conn(0x7ff5940f6c10 msgr2=0x7ff5940f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:03.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.330+0000 7ff59baf8640 1 -- 172.21.15.107:0/3898821016 shutdown_connections 2024-09-21T08:03:03.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.330+0000 7ff59baf8640 1 -- 172.21.15.107:0/3898821016 wait complete. 2024-09-21T08:03:03.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.331+0000 7ff59baf8640 1 Processor -- start 2024-09-21T08:03:03.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.331+0000 7ff59baf8640 1 -- start start 2024-09-21T08:03:03.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.331+0000 7ff59baf8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff594065be0 0x7ff59410d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:03.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.331+0000 7ff59baf8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5940ff6e0 0x7ff59410d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:03.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.331+0000 7ff59baf8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59410dbe0 con 0x7ff594065be0 2024-09-21T08:03:03.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.331+0000 7ff59baf8640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59410e400 con 0x7ff5940ff6e0 2024-09-21T08:03:03.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.331+0000 7ff599894640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff594065be0 0x7ff59410d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:03.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.331+0000 7ff599093640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5940ff6e0 0x7ff59410d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:03.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.331+0000 7ff599093640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5940ff6e0 0x7ff59410d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.107:49020/0 (socket says 172.21.15.107:49020) 2024-09-21T08:03:03.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.332+0000 7ff599894640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff594065be0 0x7ff59410d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58764/0 (socket says 172.21.15.107:58764) 2024-09-21T08:03:03.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.332+0000 7ff599093640 1 -- 172.21.15.107:0/1902158652 learned_addr learned my addr 172.21.15.107:0/1902158652 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:03:03.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.332+0000 7ff599894640 1 -- 172.21.15.107:0/1902158652 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5940ff6e0 msgr2=0x7ff59410d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:03.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.332+0000 7ff599894640 1 --2- 172.21.15.107:0/1902158652 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5940ff6e0 0x7ff59410d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:03.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.332+0000 7ff599894640 1 -- 172.21.15.107:0/1902158652 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff584005040 con 0x7ff594065be0 2024-09-21T08:03:03.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.332+0000 7ff599093640 1 --2- 172.21.15.107:0/1902158652 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5940ff6e0 0x7ff59410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:03:03.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.332+0000 7ff599894640 1 --2- 172.21.15.107:0/1902158652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff594065be0 0x7ff59410d050 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff594065940 tx=0x7ff59000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:03.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.332+0000 7ff58a7fc640 1 -- 172.21.15.107:0/1902158652 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff590007c30 con 0x7ff594065be0 2024-09-21T08:03:03.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.332+0000 7ff58a7fc640 1 -- 172.21.15.107:0/1902158652 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff59000f040 con 0x7ff594065be0 2024-09-21T08:03:03.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.332+0000 7ff58a7fc640 1 -- 172.21.15.107:0/1902158652 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff59000ca20 con 0x7ff594065be0 2024-09-21T08:03:03.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.333+0000 7ff59baf8640 1 -- 172.21.15.107:0/1902158652 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59410e690 con 0x7ff594065be0 2024-09-21T08:03:03.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.333+0000 7ff59baf8640 1 -- 172.21.15.107:0/1902158652 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59410ebe0 con 0x7ff594065be0 2024-09-21T08:03:03.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.334+0000 7ff59baf8640 1 -- 172.21.15.107:0/1902158652 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5940fa890 con 0x7ff594065be0 2024-09-21T08:03:03.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.334+0000 7ff58a7fc640 1 -- 172.21.15.107:0/1902158652 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7ff59000cc00 con 0x7ff594065be0 2024-09-21T08:03:03.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.335+0000 7ff58a7fc640 1 --2- 172.21.15.107:0/1902158652 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7ff58006e6e0 0x7ff580070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:03.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.335+0000 7ff58a7fc640 1 -- 172.21.15.107:0/1902158652 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ff59008e090 con 0x7ff594065be0 2024-09-21T08:03:03.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.335+0000 7ff599093640 1 --2- 172.21.15.107:0/1902158652 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7ff58006e6e0 0x7ff580070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:03.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.336+0000 7ff599093640 1 --2- 172.21.15.107:0/1902158652 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7ff58006e6e0 0x7ff580070b90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff58402ab40 tx=0x7ff584035040 comp rx=0 tx=0).ready entity=mgr.24311 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:03.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.343+0000 7ff58a7fc640 1 -- 172.21.15.107:0/1902158652 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7ff590057910 con 0x7ff594065be0 2024-09-21T08:03:03.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.601+0000 7ff59baf8640 1 -- 172.21.15.107:0/1902158652 --> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff59410f040 con 0x7ff58006e6e0 2024-09-21T08:03:03.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.604+0000 7ff58a7fc640 1 -- 172.21.15.107:0/1902158652 <== mgr.24311 v2:172.21.15.129:6828/1054385200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7ff59410f040 con 0x7ff58006e6e0 2024-09-21T08:03:03.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.607+0000 7ff59baf8640 1 -- 172.21.15.107:0/1902158652 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7ff58006e6e0 msgr2=0x7ff580070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:03.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.607+0000 7ff59baf8640 1 --2- 172.21.15.107:0/1902158652 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7ff58006e6e0 0x7ff580070b90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff58402ab40 tx=0x7ff584035040 comp rx=0 tx=0).stop 2024-09-21T08:03:03.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.607+0000 7ff59baf8640 1 -- 172.21.15.107:0/1902158652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff594065be0 msgr2=0x7ff59410d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:03.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.607+0000 7ff59baf8640 1 --2- 172.21.15.107:0/1902158652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff594065be0 0x7ff59410d050 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff594065940 tx=0x7ff59000b040 comp rx=0 tx=0).stop 2024-09-21T08:03:03.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.607+0000 7ff59baf8640 1 -- 172.21.15.107:0/1902158652 shutdown_connections 2024-09-21T08:03:03.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.607+0000 7ff59baf8640 1 --2- 172.21.15.107:0/1902158652 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7ff58006e6e0 0x7ff580070b90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:03.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.607+0000 7ff59baf8640 1 --2- 172.21.15.107:0/1902158652 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5940ff6e0 0x7ff59410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:03.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.607+0000 7ff59baf8640 1 --2- 172.21.15.107:0/1902158652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff594065be0 0x7ff59410d050 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:03.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.607+0000 7ff59baf8640 1 -- 172.21.15.107:0/1902158652 >> 172.21.15.107:0/1902158652 conn(0x7ff5940f6c10 msgr2=0x7ff5940f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:03.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.608+0000 7ff59baf8640 1 -- 172.21.15.107:0/1902158652 shutdown_connections 2024-09-21T08:03:03.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.608+0000 7ff59baf8640 1 -- 172.21.15.107:0/1902158652 wait complete. 2024-09-21T08:03:03.618 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:03:03.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.695+0000 7fb1e5142640 1 -- 172.21.15.107:0/237620280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1e00fabb0 msgr2=0x7fb1e00fafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:03.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.695+0000 7fb1e5142640 1 --2- 172.21.15.107:0/237620280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1e00fabb0 0x7fb1e00fafc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00048d0 tx=0x7fb1d0009da0 comp rx=0 tx=0).stop 2024-09-21T08:03:03.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.696+0000 7fb1e5142640 1 -- 172.21.15.107:0/237620280 shutdown_connections 2024-09-21T08:03:03.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.696+0000 7fb1e5142640 1 --2- 172.21.15.107:0/237620280 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb1e00fbe80 0x7fb1e00fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:03.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.696+0000 7fb1e5142640 1 --2- 172.21.15.107:0/237620280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1e00fabb0 0x7fb1e00fafc0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:03.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.696+0000 7fb1e5142640 1 -- 172.21.15.107:0/237620280 >> 172.21.15.107:0/237620280 conn(0x7fb1e00f6390 msgr2=0x7fb1e00f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:03.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.696+0000 7fb1e5142640 1 -- 172.21.15.107:0/237620280 shutdown_connections 2024-09-21T08:03:03.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.696+0000 7fb1e5142640 1 -- 172.21.15.107:0/237620280 wait complete. 2024-09-21T08:03:03.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.696+0000 7fb1e5142640 1 Processor -- start 2024-09-21T08:03:03.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.697+0000 7fb1e5142640 1 -- start start 2024-09-21T08:03:03.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.697+0000 7fb1e5142640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1e00fabb0 0x7fb1e010d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:03.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.697+0000 7fb1e5142640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb1e00fbe80 0x7fb1e010d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:03.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.697+0000 7fb1e5142640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e010dc20 con 0x7fb1e00fabb0 2024-09-21T08:03:03.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.697+0000 7fb1e5142640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e010e440 con 0x7fb1e00fbe80 2024-09-21T08:03:03.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.697+0000 7fb1ded9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1e00fabb0 0x7fb1e010d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:03.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.697+0000 7fb1ded9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1e00fabb0 0x7fb1e010d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58776/0 (socket says 172.21.15.107:58776) 2024-09-21T08:03:03.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.697+0000 7fb1ded9d640 1 -- 172.21.15.107:0/873177219 learned_addr learned my addr 172.21.15.107:0/873177219 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:03:03.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.697+0000 7fb1de59c640 1 --2- 172.21.15.107:0/873177219 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb1e00fbe80 0x7fb1e010d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:03.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.697+0000 7fb1ded9d640 1 -- 172.21.15.107:0/873177219 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb1e00fbe80 msgr2=0x7fb1e010d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:03.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.697+0000 7fb1ded9d640 1 --2- 172.21.15.107:0/873177219 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb1e00fbe80 0x7fb1e010d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:03.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.697+0000 7fb1ded9d640 1 -- 172.21.15.107:0/873177219 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d0005040 con 0x7fb1e00fabb0 2024-09-21T08:03:03.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.697+0000 7fb1ded9d640 1 --2- 172.21.15.107:0/873177219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1e00fabb0 0x7fb1e010d090 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00043d0 tx=0x7fb1d0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:03.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.698+0000 7fb1c77fe640 1 -- 172.21.15.107:0/873177219 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1d0038070 con 0x7fb1e00fabb0 2024-09-21T08:03:03.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.698+0000 7fb1e5142640 1 -- 172.21.15.107:0/873177219 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e010e670 con 0x7fb1e00fabb0 2024-09-21T08:03:03.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.698+0000 7fb1c77fe640 1 -- 172.21.15.107:0/873177219 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb1d002ae90 con 0x7fb1e00fabb0 2024-09-21T08:03:03.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.698+0000 7fb1c77fe640 1 -- 172.21.15.107:0/873177219 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1d003e670 con 0x7fb1e00fabb0 2024-09-21T08:03:03.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.698+0000 7fb1e5142640 1 -- 172.21.15.107:0/873177219 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e010ec10 con 0x7fb1e00fabb0 2024-09-21T08:03:03.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.699+0000 7fb1c57fa640 1 -- 172.21.15.107:0/873177219 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c0005210 con 0x7fb1e00fabb0 2024-09-21T08:03:03.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.700+0000 7fb1c77fe640 1 -- 172.21.15.107:0/873177219 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fb1d0030020 con 0x7fb1e00fabb0 2024-09-21T08:03:03.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.700+0000 7fb1c77fe640 1 --2- 172.21.15.107:0/873177219 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fb1c806e6e0 0x7fb1c8070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:03.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.700+0000 7fb1c77fe640 1 -- 172.21.15.107:0/873177219 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb1d00ae0e0 con 0x7fb1e00fabb0 2024-09-21T08:03:03.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.700+0000 7fb1de59c640 1 --2- 172.21.15.107:0/873177219 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fb1c806e6e0 0x7fb1c8070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:03.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.701+0000 7fb1de59c640 1 --2- 172.21.15.107:0/873177219 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fb1c806e6e0 0x7fb1c8070b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4007fd0 tx=0x7fb1d4009040 comp rx=0 tx=0).ready entity=mgr.24311 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:03.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.705+0000 7fb1c77fe640 1 -- 172.21.15.107:0/873177219 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fb1d0077a70 con 0x7fb1e00fabb0 2024-09-21T08:03:03.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.946+0000 7fb1c57fa640 1 -- 172.21.15.107:0/873177219 --> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1c0000bc0 con 0x7fb1c806e6e0 2024-09-21T08:03:03.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.948+0000 7fb1c77fe640 1 -- 172.21.15.107:0/873177219 <== mgr.24311 v2:172.21.15.129:6828/1054385200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fb1c0000bc0 con 0x7fb1c806e6e0 2024-09-21T08:03:03.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.951+0000 7fb1c57fa640 1 -- 172.21.15.107:0/873177219 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fb1c806e6e0 msgr2=0x7fb1c8070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:03.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.951+0000 7fb1c57fa640 1 --2- 172.21.15.107:0/873177219 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fb1c806e6e0 0x7fb1c8070b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4007fd0 tx=0x7fb1d4009040 comp rx=0 tx=0).stop 2024-09-21T08:03:03.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.951+0000 7fb1c57fa640 1 -- 172.21.15.107:0/873177219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1e00fabb0 msgr2=0x7fb1e010d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:03.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.951+0000 7fb1c57fa640 1 --2- 172.21.15.107:0/873177219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1e00fabb0 0x7fb1e010d090 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00043d0 tx=0x7fb1d0009da0 comp rx=0 tx=0).stop 2024-09-21T08:03:03.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.951+0000 7fb1c57fa640 1 -- 172.21.15.107:0/873177219 shutdown_connections 2024-09-21T08:03:03.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.951+0000 7fb1c57fa640 1 --2- 172.21.15.107:0/873177219 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fb1c806e6e0 0x7fb1c8070b90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:03.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.951+0000 7fb1c57fa640 1 --2- 172.21.15.107:0/873177219 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb1e00fbe80 0x7fb1e010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:03.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.951+0000 7fb1c57fa640 1 --2- 172.21.15.107:0/873177219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1e00fabb0 0x7fb1e010d090 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:03.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.951+0000 7fb1c57fa640 1 -- 172.21.15.107:0/873177219 >> 172.21.15.107:0/873177219 conn(0x7fb1e00f6390 msgr2=0x7fb1e00f7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:03.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.951+0000 7fb1c57fa640 1 -- 172.21.15.107:0/873177219 shutdown_connections 2024-09-21T08:03:03.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:03.951+0000 7fb1c57fa640 1 -- 172.21.15.107:0/873177219 wait complete. 2024-09-21T08:03:04.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.071+0000 7fe3fd399640 1 -- 172.21.15.107:0/1367355620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3f806e540 msgr2=0x7fe3f8108730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:04.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.071+0000 7fe3fd399640 1 --2- 172.21.15.107:0/1367355620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3f806e540 0x7fe3f8108730 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec0048d0 tx=0x7fe3ec009da0 comp rx=0 tx=0).stop 2024-09-21T08:03:04.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.072+0000 7fe3fd399640 1 -- 172.21.15.107:0/1367355620 shutdown_connections 2024-09-21T08:03:04.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.072+0000 7fe3fd399640 1 --2- 172.21.15.107:0/1367355620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3f806e540 0x7fe3f8108730 secure :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec0048d0 tx=0x7fe3ec009da0 comp rx=0 tx=0).stop 2024-09-21T08:03:04.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.072+0000 7fe3fd399640 1 --2- 172.21.15.107:0/1367355620 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe3f806dbf0 0x7fe3f806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:04.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.072+0000 7fe3fd399640 1 -- 172.21.15.107:0/1367355620 >> 172.21.15.107:0/1367355620 conn(0x7fe3f8069560 msgr2=0x7fe3f806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:04.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.072+0000 7fe3fd399640 1 -- 172.21.15.107:0/1367355620 shutdown_connections 2024-09-21T08:03:04.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.072+0000 7fe3fd399640 1 -- 172.21.15.107:0/1367355620 wait complete. 2024-09-21T08:03:04.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.073+0000 7fe3fd399640 1 Processor -- start 2024-09-21T08:03:04.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.073+0000 7fe3fd399640 1 -- start start 2024-09-21T08:03:04.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.073+0000 7fe3fd399640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe3f806dbf0 0x7fe3f811c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:04.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.073+0000 7fe3fd399640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3f811c570 0x7fe3f811d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:04.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.073+0000 7fe3fd399640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f811cac0 con 0x7fe3f811c570 2024-09-21T08:03:04.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.073+0000 7fe3fd399640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f811cc00 con 0x7fe3f806dbf0 2024-09-21T08:03:04.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.074+0000 7fe3f6ffd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe3f806dbf0 0x7fe3f811c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:04.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.074+0000 7fe3f6ffd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe3f806dbf0 0x7fe3f811c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.107:49078/0 (socket says 172.21.15.107:49078) 2024-09-21T08:03:04.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.074+0000 7fe3f6ffd640 1 -- 172.21.15.107:0/3159398542 learned_addr learned my addr 172.21.15.107:0/3159398542 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:03:04.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.075+0000 7fe3f6ffd640 1 -- 172.21.15.107:0/3159398542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3f811c570 msgr2=0x7fe3f811d3e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T08:03:04.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.075+0000 7fe3f6ffd640 1 --2- 172.21.15.107:0/3159398542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3f811c570 0x7fe3f811d3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:04.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.075+0000 7fe3f6ffd640 1 -- 172.21.15.107:0/3159398542 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ec005040 con 0x7fe3f806dbf0 2024-09-21T08:03:04.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.075+0000 7fe3f6ffd640 1 --2- 172.21.15.107:0/3159398542 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe3f806dbf0 0x7fe3f811c030 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000b790 tx=0x7fe3f00091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:04.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.076+0000 7fe3df7fe640 1 -- 172.21.15.107:0/3159398542 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3f000c700 con 0x7fe3f806dbf0 2024-09-21T08:03:04.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.076+0000 7fe3fd399640 1 -- 172.21.15.107:0/3159398542 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f811da90 con 0x7fe3f806dbf0 2024-09-21T08:03:04.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.076+0000 7fe3fd399640 1 -- 172.21.15.107:0/3159398542 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f811dfb0 con 0x7fe3f806dbf0 2024-09-21T08:03:04.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.076+0000 7fe3df7fe640 1 -- 172.21.15.107:0/3159398542 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe3f000cd00 con 0x7fe3f806dbf0 2024-09-21T08:03:04.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.076+0000 7fe3df7fe640 1 -- 172.21.15.107:0/3159398542 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3f0015e70 con 0x7fe3f806dbf0 2024-09-21T08:03:04.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.078+0000 7fe3fd399640 1 -- 172.21.15.107:0/3159398542 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e4005240 con 0x7fe3f806dbf0 2024-09-21T08:03:04.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.079+0000 7fe3df7fe640 1 -- 172.21.15.107:0/3159398542 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fe3f0012070 con 0x7fe3f806dbf0 2024-09-21T08:03:04.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.080+0000 7fe3df7fe640 1 --2- 172.21.15.107:0/3159398542 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fe3e006e800 0x7fe3e0070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:04.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.080+0000 7fe3df7fe640 1 -- 172.21.15.107:0/3159398542 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe3f008d700 con 0x7fe3f806dbf0 2024-09-21T08:03:04.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.080+0000 7fe3f67fc640 1 --2- 172.21.15.107:0/3159398542 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fe3e006e800 0x7fe3e0070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:04.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.081+0000 7fe3f67fc640 1 --2- 172.21.15.107:0/3159398542 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fe3e006e800 0x7fe3e0070cb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec000c00 tx=0x7fe3ec009da0 comp rx=0 tx=0).ready entity=mgr.24311 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:04.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.088+0000 7fe3df7fe640 1 -- 172.21.15.107:0/3159398542 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fe3f005abc0 con 0x7fe3f806dbf0 2024-09-21T08:03:04.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.319+0000 7fe3fd399640 1 -- 172.21.15.107:0/3159398542 --> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3e4000bf0 con 0x7fe3e006e800 2024-09-21T08:03:04.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.329+0000 7fe3df7fe640 1 -- 172.21.15.107:0/3159398542 <== mgr.24311 v2:172.21.15.129:6828/1054385200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe3e4000bf0 con 0x7fe3e006e800 2024-09-21T08:03:04.330 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:03:04.330 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (6m) 19s ago 8m 24.6M - 0.25.0 c8568f914cd2 2b63428d7be3 2024-09-21T08:03:04.330 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (8m) 19s ago 8m 6899k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 4557b307c7dd 2024-09-21T08:03:04.330 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (7m) 34s ago 7m 6895k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be e74e9385abdf 2024-09-21T08:03:04.330 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (6m) 19s ago 7m 88.2M - 9.4.7 954c08fa6188 8571a453fdc8 2024-09-21T08:03:04.331 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (2m) 19s ago 2m 194M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 3bc779f88228 2024-09-21T08:03:04.331 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (2m) 19s ago 2m 12.0M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be ea8f140aade7 2024-09-21T08:03:04.331 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (2m) 34s ago 2m 14.9M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 329346c3afec 2024-09-21T08:03:04.331 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (2m) 34s ago 2m 16.9M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be baf87f32bfbc 2024-09-21T08:03:04.331 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:9283,8765,8443 running (9m) 19s ago 9m 243M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be d8e1cda67b5b 2024-09-21T08:03:04.331 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283 running (63s) 34s ago 7m 479M - 19.1.1-367-g9e2ac70b cc9251b744a3 303933eb1c8b 2024-09-21T08:03:04.331 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (9m) 19s ago 9m 48.0M 2048M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7702e48722c8 2024-09-21T08:03:04.331 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (7m) 34s ago 7m 38.1M 2048M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be d9680c5a5b92 2024-09-21T08:03:04.331 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 starting - - - - 2024-09-21T08:03:04.331 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (7m) 34s ago 7m 16.2M - 1.5.0 0da6a335fe13 7285c04552f9 2024-09-21T08:03:04.331 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (6m) 19s ago 6m 125M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 6799bdf55207 2024-09-21T08:03:04.331 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (6m) 19s ago 6m 136M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 29d8ce3f3a52 2024-09-21T08:03:04.331 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (5m) 19s ago 5m 131M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be c9e1c4756c02 2024-09-21T08:03:04.331 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (5m) 34s ago 5m 143M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7d58f70b105c 2024-09-21T08:03:04.331 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (4m) 34s ago 4m 136M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 2f916ef76d22 2024-09-21T08:03:04.332 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (4m) 34s ago 4m 129M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 0f25d9454304 2024-09-21T08:03:04.332 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (6m) 19s ago 7m 67.2M - 2.43.0 a07b618ecd1d 36fd24c0b07b 2024-09-21T08:03:04.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.331+0000 7fe3fd399640 1 -- 172.21.15.107:0/3159398542 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fe3e006e800 msgr2=0x7fe3e0070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:04.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.331+0000 7fe3fd399640 1 --2- 172.21.15.107:0/3159398542 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fe3e006e800 0x7fe3e0070cb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec000c00 tx=0x7fe3ec009da0 comp rx=0 tx=0).stop 2024-09-21T08:03:04.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.331+0000 7fe3fd399640 1 -- 172.21.15.107:0/3159398542 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe3f806dbf0 msgr2=0x7fe3f811c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:04.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.331+0000 7fe3fd399640 1 --2- 172.21.15.107:0/3159398542 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe3f806dbf0 0x7fe3f811c030 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000b790 tx=0x7fe3f00091d0 comp rx=0 tx=0).stop 2024-09-21T08:03:04.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.331+0000 7fe3fd399640 1 -- 172.21.15.107:0/3159398542 shutdown_connections 2024-09-21T08:03:04.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.331+0000 7fe3fd399640 1 --2- 172.21.15.107:0/3159398542 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fe3e006e800 0x7fe3e0070cb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:04.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.331+0000 7fe3fd399640 1 --2- 172.21.15.107:0/3159398542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3f811c570 0x7fe3f811d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:04.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.331+0000 7fe3fd399640 1 --2- 172.21.15.107:0/3159398542 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe3f806dbf0 0x7fe3f811c030 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:04.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.331+0000 7fe3fd399640 1 -- 172.21.15.107:0/3159398542 >> 172.21.15.107:0/3159398542 conn(0x7fe3f8069560 msgr2=0x7fe3f8106930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:04.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.331+0000 7fe3fd399640 1 -- 172.21.15.107:0/3159398542 shutdown_connections 2024-09-21T08:03:04.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.331+0000 7fe3fd399640 1 -- 172.21.15.107:0/3159398542 wait complete. 2024-09-21T08:03:04.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.418+0000 7f48b6b41640 1 -- 172.21.15.107:0/3671196683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48b00fc540 msgr2=0x7f48b00fc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:04.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.418+0000 7f48b6b41640 1 --2- 172.21.15.107:0/3671196683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48b00fc540 0x7f48b00fc950 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f48a40048d0 tx=0x7f48a4009da0 comp rx=0 tx=0).stop 2024-09-21T08:03:04.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.418+0000 7f48b6b41640 1 -- 172.21.15.107:0/3671196683 shutdown_connections 2024-09-21T08:03:04.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.418+0000 7f48b6b41640 1 --2- 172.21.15.107:0/3671196683 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f48b00fd810 0x7f48b00fdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:04.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.418+0000 7f48b6b41640 1 --2- 172.21.15.107:0/3671196683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48b00fc540 0x7f48b00fc950 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:04.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.418+0000 7f48b6b41640 1 -- 172.21.15.107:0/3671196683 >> 172.21.15.107:0/3671196683 conn(0x7f48b00f7ce0 msgr2=0x7f48b00fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:04.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.418+0000 7f48b6b41640 1 -- 172.21.15.107:0/3671196683 shutdown_connections 2024-09-21T08:03:04.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.418+0000 7f48b6b41640 1 -- 172.21.15.107:0/3671196683 wait complete. 2024-09-21T08:03:04.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.419+0000 7f48b6b41640 1 Processor -- start 2024-09-21T08:03:04.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.419+0000 7f48b6b41640 1 -- start start 2024-09-21T08:03:04.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.419+0000 7f48b6b41640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48b00fc540 0x7f48b0071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:04.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.419+0000 7f48b6b41640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f48b00fd810 0x7f48b006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:04.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.419+0000 7f48b6b41640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b006fff0 con 0x7f48b00fc540 2024-09-21T08:03:04.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.419+0000 7f48b6b41640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0070130 con 0x7f48b00fd810 2024-09-21T08:03:04.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.419+0000 7f48b48dd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48b00fc540 0x7f48b0071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:04.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.419+0000 7f48b48dd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48b00fc540 0x7f48b0071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58800/0 (socket says 172.21.15.107:58800) 2024-09-21T08:03:04.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.419+0000 7f48b48dd640 1 -- 172.21.15.107:0/928332273 learned_addr learned my addr 172.21.15.107:0/928332273 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:03:04.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.419+0000 7f48affff640 1 --2- 172.21.15.107:0/928332273 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f48b00fd810 0x7f48b006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:04.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.420+0000 7f48affff640 1 -- 172.21.15.107:0/928332273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48b00fc540 msgr2=0x7f48b0071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:04.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.420+0000 7f48affff640 1 --2- 172.21.15.107:0/928332273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48b00fc540 0x7f48b0071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:04.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.420+0000 7f48affff640 1 -- 172.21.15.107:0/928332273 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a4005040 con 0x7f48b00fd810 2024-09-21T08:03:04.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.420+0000 7f48b48dd640 1 --2- 172.21.15.107:0/928332273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48b00fc540 0x7f48b0071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:03:04.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.420+0000 7f48affff640 1 --2- 172.21.15.107:0/928332273 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f48b00fd810 0x7f48b006fa60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f489c00eb40 tx=0x7f489c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:04.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.420+0000 7f48ad7fa640 1 -- 172.21.15.107:0/928332273 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f489c007c30 con 0x7f48b00fd810 2024-09-21T08:03:04.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.420+0000 7f48b6b41640 1 -- 172.21.15.107:0/928332273 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b00703b0 con 0x7f48b00fd810 2024-09-21T08:03:04.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.420+0000 7f48ad7fa640 1 -- 172.21.15.107:0/928332273 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f489c00f040 con 0x7f48b00fd810 2024-09-21T08:03:04.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.420+0000 7f48ad7fa640 1 -- 172.21.15.107:0/928332273 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f489c0094a0 con 0x7f48b00fd810 2024-09-21T08:03:04.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.420+0000 7f48b6b41640 1 -- 172.21.15.107:0/928332273 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b01150f0 con 0x7f48b00fd810 2024-09-21T08:03:04.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.421+0000 7f48b6b41640 1 -- 172.21.15.107:0/928332273 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b00fb9a0 con 0x7f48b00fd810 2024-09-21T08:03:04.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.422+0000 7f48ad7fa640 1 -- 172.21.15.107:0/928332273 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f489c009600 con 0x7f48b00fd810 2024-09-21T08:03:04.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.422+0000 7f48ad7fa640 1 --2- 172.21.15.107:0/928332273 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f48a006e6e0 0x7f48a0070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:04.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.422+0000 7f48ad7fa640 1 -- 172.21.15.107:0/928332273 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f489c08db30 con 0x7f48b00fd810 2024-09-21T08:03:04.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.422+0000 7f48b48dd640 1 --2- 172.21.15.107:0/928332273 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f48a006e6e0 0x7f48a0070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:04.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.423+0000 7f48b48dd640 1 --2- 172.21.15.107:0/928332273 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f48a006e6e0 0x7f48a0070b90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f48a4000c00 tx=0x7f48a4035040 comp rx=0 tx=0).ready entity=mgr.24311 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:04.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.427+0000 7f48ad7fa640 1 -- 172.21.15.107:0/928332273 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f489c057460 con 0x7f48b00fd810 2024-09-21T08:03:04.601 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:04 smithi107 ceph-mon[27622]: pgmap v24: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 142 MiB/s rd, 158 MiB/s wr, 417 op/s 2024-09-21T08:03:04.602 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:04 smithi107 ceph-mon[27622]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:03:04.602 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:04 smithi107 ceph-mon[27622]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:03:04.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.754+0000 7f48b6b41640 1 -- 172.21.15.107:0/928332273 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f48b004b720 con 0x7f48b00fd810 2024-09-21T08:03:04.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.755+0000 7f48ad7fa640 1 -- 172.21.15.107:0/928332273 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7f489c05ab20 con 0x7f48b00fd810 2024-09-21T08:03:04.757 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:03:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": { 2024-09-21T08:03:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 2 2024-09-21T08:03:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:03:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": { 2024-09-21T08:03:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 1, 2024-09-21T08:03:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 1 2024-09-21T08:03:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:03:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": { 2024-09-21T08:03:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 6 2024-09-21T08:03:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:03:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-21T08:03:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 4 2024-09-21T08:03:04.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:03:04.758 INFO:teuthology.orchestra.run.smithi107.stdout: "overall": { 2024-09-21T08:03:04.758 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 13, 2024-09-21T08:03:04.758 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 1 2024-09-21T08:03:04.758 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-21T08:03:04.758 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:03:04.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.758+0000 7f48b6b41640 1 -- 172.21.15.107:0/928332273 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f48a006e6e0 msgr2=0x7f48a0070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:04.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.758+0000 7f48b6b41640 1 --2- 172.21.15.107:0/928332273 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f48a006e6e0 0x7f48a0070b90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f48a4000c00 tx=0x7f48a4035040 comp rx=0 tx=0).stop 2024-09-21T08:03:04.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.758+0000 7f48b6b41640 1 -- 172.21.15.107:0/928332273 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f48b00fd810 msgr2=0x7f48b006fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:04.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.758+0000 7f48b6b41640 1 --2- 172.21.15.107:0/928332273 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f48b00fd810 0x7f48b006fa60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f489c00eb40 tx=0x7f489c00b040 comp rx=0 tx=0).stop 2024-09-21T08:03:04.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.758+0000 7f48b6b41640 1 -- 172.21.15.107:0/928332273 shutdown_connections 2024-09-21T08:03:04.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.758+0000 7f48b6b41640 1 --2- 172.21.15.107:0/928332273 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f48a006e6e0 0x7f48a0070b90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:04.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.758+0000 7f48b6b41640 1 --2- 172.21.15.107:0/928332273 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f48b00fd810 0x7f48b006fa60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:04.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.758+0000 7f48b6b41640 1 --2- 172.21.15.107:0/928332273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48b00fc540 0x7f48b0071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:04.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.758+0000 7f48b6b41640 1 -- 172.21.15.107:0/928332273 >> 172.21.15.107:0/928332273 conn(0x7f48b00f7ce0 msgr2=0x7f48b00f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:04.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.759+0000 7f48b6b41640 1 -- 172.21.15.107:0/928332273 shutdown_connections 2024-09-21T08:03:04.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.759+0000 7f48b6b41640 1 -- 172.21.15.107:0/928332273 wait complete. 2024-09-21T08:03:04.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:04 smithi129 ceph-mon[34472]: pgmap v24: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 142 MiB/s rd, 158 MiB/s wr, 417 op/s 2024-09-21T08:03:04.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:04 smithi129 ceph-mon[34472]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:03:04.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:04 smithi129 ceph-mon[34472]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:03:04.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.852+0000 7fe00f79b640 1 -- 172.21.15.107:0/386449406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0080fc520 msgr2=0x7fe0080fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:04.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.852+0000 7fe00f79b640 1 --2- 172.21.15.107:0/386449406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0080fc520 0x7fe0080fc930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe0040048d0 tx=0x7fe004009da0 comp rx=0 tx=0).stop 2024-09-21T08:03:04.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.852+0000 7fe00f79b640 1 -- 172.21.15.107:0/386449406 shutdown_connections 2024-09-21T08:03:04.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.852+0000 7fe00f79b640 1 --2- 172.21.15.107:0/386449406 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe0080fd7f0 0x7fe0080fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:04.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.852+0000 7fe00f79b640 1 --2- 172.21.15.107:0/386449406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0080fc520 0x7fe0080fc930 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:04.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.852+0000 7fe00f79b640 1 -- 172.21.15.107:0/386449406 >> 172.21.15.107:0/386449406 conn(0x7fe0080f7ce0 msgr2=0x7fe0080fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:04.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.853+0000 7fe00f79b640 1 -- 172.21.15.107:0/386449406 shutdown_connections 2024-09-21T08:03:04.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.853+0000 7fe00f79b640 1 -- 172.21.15.107:0/386449406 wait complete. 2024-09-21T08:03:04.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.853+0000 7fe00f79b640 1 Processor -- start 2024-09-21T08:03:04.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.853+0000 7fe00f79b640 1 -- start start 2024-09-21T08:03:04.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.854+0000 7fe00f79b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe0080fc520 0x7fe008071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:04.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.854+0000 7fe00f79b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0080fd7f0 0x7fe00806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:04.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.854+0000 7fe00f79b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00806fff0 con 0x7fe0080fd7f0 2024-09-21T08:03:04.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.854+0000 7fe00f79b640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe008070130 con 0x7fe0080fc520 2024-09-21T08:03:04.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.854+0000 7fe00d537640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe0080fc520 0x7fe008071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:04.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.854+0000 7fe00d537640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe0080fc520 0x7fe008071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.107:49112/0 (socket says 172.21.15.107:49112) 2024-09-21T08:03:04.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.854+0000 7fe00d537640 1 -- 172.21.15.107:0/2657705049 learned_addr learned my addr 172.21.15.107:0/2657705049 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:03:04.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.854+0000 7fe00cd36640 1 --2- 172.21.15.107:0/2657705049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0080fd7f0 0x7fe00806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:04.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.854+0000 7fe00d537640 1 -- 172.21.15.107:0/2657705049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0080fd7f0 msgr2=0x7fe00806fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:04.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.854+0000 7fe00d537640 1 --2- 172.21.15.107:0/2657705049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0080fd7f0 0x7fe00806fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:04.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.854+0000 7fe00d537640 1 -- 172.21.15.107:0/2657705049 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe004005040 con 0x7fe0080fc520 2024-09-21T08:03:04.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.854+0000 7fe00d537640 1 --2- 172.21.15.107:0/2657705049 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe0080fc520 0x7fe008071570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe0040043d0 tx=0x7fe004009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:04.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.855+0000 7fdffdffb640 1 -- 172.21.15.107:0/2657705049 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe004038070 con 0x7fe0080fc520 2024-09-21T08:03:04.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.855+0000 7fe00f79b640 1 -- 172.21.15.107:0/2657705049 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0080703b0 con 0x7fe0080fc520 2024-09-21T08:03:04.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.855+0000 7fdffdffb640 1 -- 172.21.15.107:0/2657705049 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe00402ae90 con 0x7fe0080fc520 2024-09-21T08:03:04.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.855+0000 7fdffdffb640 1 -- 172.21.15.107:0/2657705049 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe00403e670 con 0x7fe0080fc520 2024-09-21T08:03:04.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.855+0000 7fe00f79b640 1 -- 172.21.15.107:0/2657705049 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe008115100 con 0x7fe0080fc520 2024-09-21T08:03:04.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.857+0000 7fe00f79b640 1 -- 172.21.15.107:0/2657705049 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfec005240 con 0x7fe0080fc520 2024-09-21T08:03:04.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.857+0000 7fdffdffb640 1 -- 172.21.15.107:0/2657705049 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fe004030020 con 0x7fe0080fc520 2024-09-21T08:03:04.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.857+0000 7fdffdffb640 1 --2- 172.21.15.107:0/2657705049 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fdff406e6e0 0x7fdff4070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:04.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.857+0000 7fdffdffb640 1 -- 172.21.15.107:0/2657705049 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe0040adef0 con 0x7fe0080fc520 2024-09-21T08:03:04.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.857+0000 7fe00cd36640 1 --2- 172.21.15.107:0/2657705049 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fdff406e6e0 0x7fdff4070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:04.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.858+0000 7fe00cd36640 1 --2- 172.21.15.107:0/2657705049 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fdff406e6e0 0x7fdff4070b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdff8004ed0 tx=0x7fdff800b040 comp rx=0 tx=0).ready entity=mgr.24311 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:04.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:04.862+0000 7fdffdffb640 1 -- 172.21.15.107:0/2657705049 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fe00407b0b0 con 0x7fe0080fc520 2024-09-21T08:03:05.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:05.180+0000 7fe00f79b640 1 -- 172.21.15.107:0/2657705049 --> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfec000bf0 con 0x7fdff406e6e0 2024-09-21T08:03:05.184 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:03:05.184 INFO:teuthology.orchestra.run.smithi107.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5", 2024-09-21T08:03:05.184 INFO:teuthology.orchestra.run.smithi107.stdout: "in_progress": true, 2024-09-21T08:03:05.184 INFO:teuthology.orchestra.run.smithi107.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T08:03:05.184 INFO:teuthology.orchestra.run.smithi107.stdout: "services_complete": [], 2024-09-21T08:03:05.184 INFO:teuthology.orchestra.run.smithi107.stdout: "progress": "1/2 daemons upgraded", 2024-09-21T08:03:05.184 INFO:teuthology.orchestra.run.smithi107.stdout: "message": "", 2024-09-21T08:03:05.184 INFO:teuthology.orchestra.run.smithi107.stdout: "is_paused": false 2024-09-21T08:03:05.184 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:03:05.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:05.182+0000 7fdffdffb640 1 -- 172.21.15.107:0/2657705049 <== mgr.24311 v2:172.21.15.129:6828/1054385200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fdfec000bf0 con 0x7fdff406e6e0 2024-09-21T08:03:05.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:05.185+0000 7fe00f79b640 1 -- 172.21.15.107:0/2657705049 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fdff406e6e0 msgr2=0x7fdff4070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:05.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:05.185+0000 7fe00f79b640 1 --2- 172.21.15.107:0/2657705049 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fdff406e6e0 0x7fdff4070b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdff8004ed0 tx=0x7fdff800b040 comp rx=0 tx=0).stop 2024-09-21T08:03:05.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:05.186+0000 7fe00f79b640 1 -- 172.21.15.107:0/2657705049 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe0080fc520 msgr2=0x7fe008071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:05.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:05.186+0000 7fe00f79b640 1 --2- 172.21.15.107:0/2657705049 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe0080fc520 0x7fe008071570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe0040043d0 tx=0x7fe004009da0 comp rx=0 tx=0).stop 2024-09-21T08:03:05.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:05.186+0000 7fe00f79b640 1 -- 172.21.15.107:0/2657705049 shutdown_connections 2024-09-21T08:03:05.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:05.186+0000 7fe00f79b640 1 --2- 172.21.15.107:0/2657705049 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fdff406e6e0 0x7fdff4070b90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:05.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:05.186+0000 7fe00f79b640 1 --2- 172.21.15.107:0/2657705049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0080fd7f0 0x7fe00806fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:05.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:05.186+0000 7fe00f79b640 1 --2- 172.21.15.107:0/2657705049 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe0080fc520 0x7fe008071570 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:05.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:05.186+0000 7fe00f79b640 1 -- 172.21.15.107:0/2657705049 >> 172.21.15.107:0/2657705049 conn(0x7fe0080f7ce0 msgr2=0x7fe0080f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:05.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:05.187+0000 7fe00f79b640 1 -- 172.21.15.107:0/2657705049 shutdown_connections 2024-09-21T08:03:05.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:05.187+0000 7fe00f79b640 1 -- 172.21.15.107:0/2657705049 wait complete. 2024-09-21T08:03:05.714 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:05 smithi107 ceph-mon[27622]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:03:05.714 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:05 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/928332273' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:03:05.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:05 smithi129 ceph-mon[34472]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:03:05.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:05 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/928332273' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:03:06.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:06 smithi129 ceph-mon[34472]: from='client.24369 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:03:06.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:06 smithi129 ceph-mon[34472]: pgmap v25: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 65 MiB/s rd, 69 MiB/s wr, 266 op/s 2024-09-21T08:03:06.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:06 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:06.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:06 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:06.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:06 smithi107 ceph-mon[27622]: from='client.24369 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:03:06.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:06 smithi107 ceph-mon[27622]: pgmap v25: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 65 MiB/s rd, 69 MiB/s wr, 266 op/s 2024-09-21T08:03:06.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:06 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:06.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:06 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:07.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:07 smithi107 ceph-mon[27622]: Reconfiguring grafana.smithi107 (dependencies changed)... 2024-09-21T08:03:07.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:07 smithi107 ceph-mon[27622]: Reconfiguring daemon grafana.smithi107 on smithi107 2024-09-21T08:03:07.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:07 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:03:07.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:07 smithi129 ceph-mon[34472]: Reconfiguring grafana.smithi107 (dependencies changed)... 2024-09-21T08:03:07.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:07 smithi129 ceph-mon[34472]: Reconfiguring daemon grafana.smithi107 on smithi107 2024-09-21T08:03:07.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:07 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:03:08.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:08 smithi107 ceph-mon[27622]: pgmap v26: 65 pgs: 65 active+clean; 2.0 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 65 MiB/s rd, 69 MiB/s wr, 315 op/s 2024-09-21T08:03:08.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:08 smithi129 ceph-mon[34472]: pgmap v26: 65 pgs: 65 active+clean; 2.0 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 65 MiB/s rd, 69 MiB/s wr, 315 op/s 2024-09-21T08:03:10.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:10 smithi129 ceph-mon[34472]: pgmap v27: 65 pgs: 65 active+clean; 1.7 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 48 MiB/s rd, 54 MiB/s wr, 361 op/s 2024-09-21T08:03:10.786 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:10 smithi107 ceph-mon[27622]: pgmap v27: 65 pgs: 65 active+clean; 1.7 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 48 MiB/s rd, 54 MiB/s wr, 361 op/s 2024-09-21T08:03:12.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:12 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:12.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:12 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:12.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:12 smithi129 ceph-mon[34472]: Reconfiguring prometheus.smithi107 (dependencies changed)... 2024-09-21T08:03:12.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:12 smithi129 ceph-mon[34472]: pgmap v28: 65 pgs: 65 active+clean; 1.7 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 10 MiB/s rd, 15 MiB/s wr, 275 op/s 2024-09-21T08:03:12.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:12 smithi129 ceph-mon[34472]: Deploying daemon prometheus.smithi107 on smithi107 2024-09-21T08:03:12.533 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:12 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:12.533 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:12 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:12.533 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:12 smithi107 ceph-mon[27622]: Reconfiguring prometheus.smithi107 (dependencies changed)... 2024-09-21T08:03:12.533 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:12 smithi107 ceph-mon[27622]: pgmap v28: 65 pgs: 65 active+clean; 1.7 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 10 MiB/s rd, 15 MiB/s wr, 275 op/s 2024-09-21T08:03:12.533 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:12 smithi107 ceph-mon[27622]: Deploying daemon prometheus.smithi107 on smithi107 2024-09-21T08:03:14.742 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:14 smithi107 ceph-mon[27622]: pgmap v29: 65 pgs: 65 active+clean; 1.1 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 10 MiB/s rd, 16 MiB/s wr, 434 op/s 2024-09-21T08:03:14.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:14 smithi129 ceph-mon[34472]: pgmap v29: 65 pgs: 65 active+clean; 1.1 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 10 MiB/s rd, 16 MiB/s wr, 434 op/s 2024-09-21T08:03:16.715 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:16 smithi107 ceph-mon[27622]: pgmap v30: 65 pgs: 65 active+clean; 1.1 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 33 KiB/s rd, 1.5 MiB/s wr, 302 op/s 2024-09-21T08:03:16.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:16 smithi129 ceph-mon[34472]: pgmap v30: 65 pgs: 65 active+clean; 1.1 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 33 KiB/s rd, 1.5 MiB/s wr, 302 op/s 2024-09-21T08:03:18.557 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T08:03:18.557 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T08:03:18.715 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:18 smithi129 ceph-mon[34472]: pgmap v31: 65 pgs: 65 active+clean; 977 MiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 49 KiB/s rd, 1.7 MiB/s wr, 337 op/s 2024-09-21T08:03:18.715 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:18 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:18.715 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:18 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:18.715 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:18 smithi129 ceph-mon[34472]: Reconfiguring node-exporter.smithi129 (dependencies changed)... 2024-09-21T08:03:18.715 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:18 smithi129 ceph-mon[34472]: Deploying daemon node-exporter.smithi129 on smithi129 2024-09-21T08:03:19.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:18 smithi107 ceph-mon[27622]: pgmap v31: 65 pgs: 65 active+clean; 977 MiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 49 KiB/s rd, 1.7 MiB/s wr, 337 op/s 2024-09-21T08:03:19.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:18 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:19.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:18 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:19.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:18 smithi107 ceph-mon[27622]: Reconfiguring node-exporter.smithi129 (dependencies changed)... 2024-09-21T08:03:19.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:18 smithi107 ceph-mon[27622]: Deploying daemon node-exporter.smithi129 on smithi129 2024-09-21T08:03:20.901 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:20 smithi107 ceph-mon[27622]: pgmap v32: 65 pgs: 65 active+clean; 565 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 34 KiB/s rd, 1.9 MiB/s wr, 389 op/s 2024-09-21T08:03:20.902 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:20 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:20.902 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:20 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:20.902 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:20 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T08:03:20.902 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:20 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T08:03:20.902 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:20 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T08:03:20.902 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:20 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:03:21.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:20 smithi129 ceph-mon[34472]: pgmap v32: 65 pgs: 65 active+clean; 565 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 34 KiB/s rd, 1.9 MiB/s wr, 389 op/s 2024-09-21T08:03:21.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:20 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:21.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:20 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:21.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:20 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T08:03:21.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:20 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T08:03:21.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:20 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T08:03:21.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:20 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:03:22.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:21 smithi129 ceph-mon[34472]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T08:03:22.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:21 smithi129 ceph-mon[34472]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T08:03:22.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:21 smithi129 ceph-mon[34472]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T08:03:22.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:21 smithi129 ceph-mon[34472]: Upgrade: Need to upgrade myself (mgr.smithi129.wvlmvo) 2024-09-21T08:03:22.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:21 smithi129 ceph-mon[34472]: Upgrade: Need to upgrade myself (mgr.smithi129.wvlmvo) 2024-09-21T08:03:22.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:21 smithi107 ceph-mon[27622]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T08:03:22.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:21 smithi107 ceph-mon[27622]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T08:03:22.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:21 smithi107 ceph-mon[27622]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T08:03:22.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:21 smithi107 ceph-mon[27622]: Upgrade: Need to upgrade myself (mgr.smithi129.wvlmvo) 2024-09-21T08:03:22.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:21 smithi107 ceph-mon[27622]: Upgrade: Need to upgrade myself (mgr.smithi129.wvlmvo) 2024-09-21T08:03:22.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:22 smithi129 ceph-mon[34472]: pgmap v33: 65 pgs: 65 active+clean; 565 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 34 KiB/s rd, 1.6 MiB/s wr, 296 op/s 2024-09-21T08:03:22.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:22 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:03:22.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:22 smithi107 ceph-mon[27622]: pgmap v33: 65 pgs: 65 active+clean; 565 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 34 KiB/s rd, 1.6 MiB/s wr, 296 op/s 2024-09-21T08:03:22.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:22 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:03:24.951 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:24 smithi129 ceph-mon[34472]: pgmap v34: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 50 KiB/s rd, 2.7 MiB/s wr, 414 op/s 2024-09-21T08:03:25.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:24 smithi107 ceph-mon[27622]: pgmap v34: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 50 KiB/s rd, 2.7 MiB/s wr, 414 op/s 2024-09-21T08:03:26.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:26 smithi129 ceph-mon[34472]: pgmap v35: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 2.0 MiB/s wr, 254 op/s 2024-09-21T08:03:26.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:26 smithi129 ceph-mon[34472]: Upgrade: Updating mgr.smithi107.wzulxb 2024-09-21T08:03:26.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:26 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:26.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:26 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi107.wzulxb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T08:03:26.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:26 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi107.wzulxb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T08:03:26.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:26 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T08:03:26.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:26 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:03:26.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:26 smithi129 ceph-mon[34472]: Deploying daemon mgr.smithi107.wzulxb on smithi107 2024-09-21T08:03:26.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:26 smithi107 ceph-mon[27622]: pgmap v35: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 2.0 MiB/s wr, 254 op/s 2024-09-21T08:03:26.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:26 smithi107 ceph-mon[27622]: Upgrade: Updating mgr.smithi107.wzulxb 2024-09-21T08:03:26.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:26 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:26.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:26 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi107.wzulxb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T08:03:26.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:26 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi107.wzulxb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T08:03:26.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:26 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T08:03:26.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:26 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:03:26.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:26 smithi107 ceph-mon[27622]: Deploying daemon mgr.smithi107.wzulxb on smithi107 2024-09-21T08:03:28.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:28 smithi129 ceph-mon[34472]: pgmap v36: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.5 MiB/s wr, 298 op/s 2024-09-21T08:03:28.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:28 smithi107 ceph-mon[27622]: pgmap v36: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.5 MiB/s wr, 298 op/s 2024-09-21T08:03:30.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:30 smithi129 ceph-mon[34472]: pgmap v37: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 2.7 MiB/s wr, 343 op/s 2024-09-21T08:03:30.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:30 smithi107 ceph-mon[27622]: pgmap v37: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 2.7 MiB/s wr, 343 op/s 2024-09-21T08:03:32.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:32 smithi129 ceph-mon[34472]: pgmap v38: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 2.1 MiB/s wr, 242 op/s 2024-09-21T08:03:32.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:32 smithi107 ceph-mon[27622]: pgmap v38: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 2.1 MiB/s wr, 242 op/s 2024-09-21T08:03:34.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:34 smithi129 ceph-mon[34472]: pgmap v39: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 3.0 MiB/s wr, 394 op/s 2024-09-21T08:03:34.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:34 smithi107 ceph-mon[27622]: pgmap v39: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 3.0 MiB/s wr, 394 op/s 2024-09-21T08:03:35.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.285+0000 7f7e67b98640 1 -- 172.21.15.107:0/2121408244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e600fe4f0 msgr2=0x7f7e600fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:35.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.285+0000 7f7e67b98640 1 --2- 172.21.15.107:0/2121408244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e600fe4f0 0x7f7e600fa650 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7e500048d0 tx=0x7f7e50009da0 comp rx=0 tx=0).stop 2024-09-21T08:03:35.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.285+0000 7f7e67b98640 1 -- 172.21.15.107:0/2121408244 shutdown_connections 2024-09-21T08:03:35.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.285+0000 7f7e67b98640 1 --2- 172.21.15.107:0/2121408244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e600fe4f0 0x7f7e600fa650 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:35.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.285+0000 7f7e67b98640 1 --2- 172.21.15.107:0/2121408244 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7e600fdba0 0x7f7e600fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:35.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.285+0000 7f7e67b98640 1 -- 172.21.15.107:0/2121408244 >> 172.21.15.107:0/2121408244 conn(0x7f7e600f6380 msgr2=0x7f7e600f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:35.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.285+0000 7f7e67b98640 1 -- 172.21.15.107:0/2121408244 shutdown_connections 2024-09-21T08:03:35.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.285+0000 7f7e67b98640 1 -- 172.21.15.107:0/2121408244 wait complete. 2024-09-21T08:03:35.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.286+0000 7f7e67b98640 1 Processor -- start 2024-09-21T08:03:35.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.286+0000 7f7e67b98640 1 -- start start 2024-09-21T08:03:35.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.286+0000 7f7e67b98640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7e600fdba0 0x7f7e6010d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:35.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.286+0000 7f7e67b98640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e600fe4f0 0x7f7e6010d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:35.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.286+0000 7f7e67b98640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6010dc20 con 0x7f7e600fe4f0 2024-09-21T08:03:35.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.286+0000 7f7e67b98640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6010e440 con 0x7f7e600fdba0 2024-09-21T08:03:35.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.286+0000 7f7e65133640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e600fe4f0 0x7f7e6010d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:35.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.286+0000 7f7e65133640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e600fe4f0 0x7f7e6010d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53558/0 (socket says 172.21.15.107:53558) 2024-09-21T08:03:35.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.286+0000 7f7e65133640 1 -- 172.21.15.107:0/340948339 learned_addr learned my addr 172.21.15.107:0/340948339 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:03:35.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.286+0000 7f7e65934640 1 --2- 172.21.15.107:0/340948339 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7e600fdba0 0x7f7e6010d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:35.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.286+0000 7f7e65133640 1 -- 172.21.15.107:0/340948339 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7e600fdba0 msgr2=0x7f7e6010d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:35.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.286+0000 7f7e65133640 1 --2- 172.21.15.107:0/340948339 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7e600fdba0 0x7f7e6010d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:35.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.286+0000 7f7e65133640 1 -- 172.21.15.107:0/340948339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e50005040 con 0x7f7e600fe4f0 2024-09-21T08:03:35.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.286+0000 7f7e65934640 1 --2- 172.21.15.107:0/340948339 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7e600fdba0 0x7f7e6010d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:03:35.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.287+0000 7f7e65133640 1 --2- 172.21.15.107:0/340948339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e600fe4f0 0x7f7e6010d5d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7e500048a0 tx=0x7f7e50009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:35.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.287+0000 7f7e567fc640 1 -- 172.21.15.107:0/340948339 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e50038070 con 0x7f7e600fe4f0 2024-09-21T08:03:35.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.287+0000 7f7e567fc640 1 -- 172.21.15.107:0/340948339 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7e5002abd0 con 0x7f7e600fe4f0 2024-09-21T08:03:35.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.287+0000 7f7e67b98640 1 -- 172.21.15.107:0/340948339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6010e670 con 0x7f7e600fe4f0 2024-09-21T08:03:35.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.287+0000 7f7e67b98640 1 -- 172.21.15.107:0/340948339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6010ec10 con 0x7f7e600fe4f0 2024-09-21T08:03:35.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.287+0000 7f7e567fc640 1 -- 172.21.15.107:0/340948339 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e50033640 con 0x7f7e600fe4f0 2024-09-21T08:03:35.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.288+0000 7f7e67b98640 1 -- 172.21.15.107:0/340948339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e600fa040 con 0x7f7e600fe4f0 2024-09-21T08:03:35.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.289+0000 7f7e567fc640 1 -- 172.21.15.107:0/340948339 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f7e50030020 con 0x7f7e600fe4f0 2024-09-21T08:03:35.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.290+0000 7f7e567fc640 1 --2- 172.21.15.107:0/340948339 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f7e4c06e7b0 0x7f7e4c070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:35.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.290+0000 7f7e567fc640 1 -- 172.21.15.107:0/340948339 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f7e500ae040 con 0x7f7e600fe4f0 2024-09-21T08:03:35.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.290+0000 7f7e65934640 1 --2- 172.21.15.107:0/340948339 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f7e4c06e7b0 0x7f7e4c070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:35.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.291+0000 7f7e65934640 1 --2- 172.21.15.107:0/340948339 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f7e4c06e7b0 0x7f7e4c070c60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c004c60 tx=0x7f7e5c009040 comp rx=0 tx=0).ready entity=mgr.24311 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:35.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.297+0000 7f7e567fc640 1 -- 172.21.15.107:0/340948339 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f7e50077b10 con 0x7f7e600fe4f0 2024-09-21T08:03:35.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.538+0000 7f7e67b98640 1 -- 172.21.15.107:0/340948339 --> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e6010ef90 con 0x7f7e4c06e7b0 2024-09-21T08:03:35.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.539+0000 7f7e567fc640 1 -- 172.21.15.107:0/340948339 <== mgr.24311 v2:172.21.15.129:6828/1054385200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f7e6010ef90 con 0x7f7e4c06e7b0 2024-09-21T08:03:35.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.541+0000 7f7e67b98640 1 -- 172.21.15.107:0/340948339 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f7e4c06e7b0 msgr2=0x7f7e4c070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:35.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.541+0000 7f7e67b98640 1 --2- 172.21.15.107:0/340948339 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f7e4c06e7b0 0x7f7e4c070c60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c004c60 tx=0x7f7e5c009040 comp rx=0 tx=0).stop 2024-09-21T08:03:35.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.541+0000 7f7e67b98640 1 -- 172.21.15.107:0/340948339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e600fe4f0 msgr2=0x7f7e6010d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:35.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.541+0000 7f7e67b98640 1 --2- 172.21.15.107:0/340948339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e600fe4f0 0x7f7e6010d5d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7e500048a0 tx=0x7f7e50009da0 comp rx=0 tx=0).stop 2024-09-21T08:03:35.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.541+0000 7f7e67b98640 1 -- 172.21.15.107:0/340948339 shutdown_connections 2024-09-21T08:03:35.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.541+0000 7f7e67b98640 1 --2- 172.21.15.107:0/340948339 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f7e4c06e7b0 0x7f7e4c070c60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:35.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.541+0000 7f7e67b98640 1 --2- 172.21.15.107:0/340948339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e600fe4f0 0x7f7e6010d5d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:35.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.541+0000 7f7e67b98640 1 --2- 172.21.15.107:0/340948339 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7e600fdba0 0x7f7e6010d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:35.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.541+0000 7f7e67b98640 1 -- 172.21.15.107:0/340948339 >> 172.21.15.107:0/340948339 conn(0x7f7e600f6380 msgr2=0x7f7e600f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:35.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.542+0000 7f7e67b98640 1 -- 172.21.15.107:0/340948339 shutdown_connections 2024-09-21T08:03:35.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.542+0000 7f7e67b98640 1 -- 172.21.15.107:0/340948339 wait complete. 2024-09-21T08:03:35.554 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:03:35.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.643+0000 7f58604ea640 1 -- 172.21.15.107:0/785489524 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58580ff6e0 msgr2=0x7f5858101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:35.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.643+0000 7f58604ea640 1 --2- 172.21.15.107:0/785489524 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58580ff6e0 0x7f5858101ac0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f58480048d0 tx=0x7f5848009da0 comp rx=0 tx=0).stop 2024-09-21T08:03:35.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.643+0000 7f58604ea640 1 -- 172.21.15.107:0/785489524 shutdown_connections 2024-09-21T08:03:35.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.643+0000 7f58604ea640 1 --2- 172.21.15.107:0/785489524 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58580ff6e0 0x7f5858101ac0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:35.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.643+0000 7f58604ea640 1 --2- 172.21.15.107:0/785489524 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5858065be0 0x7f58580ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:35.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.643+0000 7f58604ea640 1 -- 172.21.15.107:0/785489524 >> 172.21.15.107:0/785489524 conn(0x7f58580f6c10 msgr2=0x7f58580f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:35.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.643+0000 7f58604ea640 1 -- 172.21.15.107:0/785489524 shutdown_connections 2024-09-21T08:03:35.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.643+0000 7f58604ea640 1 -- 172.21.15.107:0/785489524 wait complete. 2024-09-21T08:03:35.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.644+0000 7f58604ea640 1 Processor -- start 2024-09-21T08:03:35.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.644+0000 7f58604ea640 1 -- start start 2024-09-21T08:03:35.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.644+0000 7f58604ea640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5858065be0 0x7f585810d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:35.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.644+0000 7f58604ea640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58580ff6e0 0x7f585810d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:35.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.644+0000 7f58604ea640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585810dbe0 con 0x7f5858065be0 2024-09-21T08:03:35.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.644+0000 7f58604ea640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585810e400 con 0x7f58580ff6e0 2024-09-21T08:03:35.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.644+0000 7f585e286640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5858065be0 0x7f585810d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:35.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.644+0000 7f585e286640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5858065be0 0x7f585810d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53574/0 (socket says 172.21.15.107:53574) 2024-09-21T08:03:35.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.644+0000 7f585e286640 1 -- 172.21.15.107:0/3282994519 learned_addr learned my addr 172.21.15.107:0/3282994519 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:03:35.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.644+0000 7f585da85640 1 --2- 172.21.15.107:0/3282994519 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58580ff6e0 0x7f585810d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:35.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.644+0000 7f585e286640 1 -- 172.21.15.107:0/3282994519 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58580ff6e0 msgr2=0x7f585810d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:35.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.644+0000 7f585e286640 1 --2- 172.21.15.107:0/3282994519 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58580ff6e0 0x7f585810d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:35.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.644+0000 7f585e286640 1 -- 172.21.15.107:0/3282994519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5848005040 con 0x7f5858065be0 2024-09-21T08:03:35.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.644+0000 7f585da85640 1 --2- 172.21.15.107:0/3282994519 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58580ff6e0 0x7f585810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:03:35.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.645+0000 7f585e286640 1 --2- 172.21.15.107:0/3282994519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5858065be0 0x7f585810d050 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f585400eb70 tx=0x7f585400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:35.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.645+0000 7f584effd640 1 -- 172.21.15.107:0/3282994519 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5854007c30 con 0x7f5858065be0 2024-09-21T08:03:35.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.645+0000 7f584effd640 1 -- 172.21.15.107:0/3282994519 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f585400f040 con 0x7f5858065be0 2024-09-21T08:03:35.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.645+0000 7f58604ea640 1 -- 172.21.15.107:0/3282994519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585810e690 con 0x7f5858065be0 2024-09-21T08:03:35.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.645+0000 7f584effd640 1 -- 172.21.15.107:0/3282994519 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f585400cb20 con 0x7f5858065be0 2024-09-21T08:03:35.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.645+0000 7f58604ea640 1 -- 172.21.15.107:0/3282994519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585810ec30 con 0x7f5858065be0 2024-09-21T08:03:35.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.646+0000 7f58604ea640 1 -- 172.21.15.107:0/3282994519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58580fa890 con 0x7f5858065be0 2024-09-21T08:03:35.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.648+0000 7f584effd640 1 -- 172.21.15.107:0/3282994519 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f5854009110 con 0x7f5858065be0 2024-09-21T08:03:35.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.648+0000 7f584effd640 1 --2- 172.21.15.107:0/3282994519 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f584406e6e0 0x7f5844070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:35.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.648+0000 7f584effd640 1 -- 172.21.15.107:0/3282994519 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f585408e7d0 con 0x7f5858065be0 2024-09-21T08:03:35.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.649+0000 7f585da85640 1 --2- 172.21.15.107:0/3282994519 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f584406e6e0 0x7f5844070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:35.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.649+0000 7f585da85640 1 --2- 172.21.15.107:0/3282994519 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f584406e6e0 0x7f5844070b90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f585810ce00 tx=0x7f5848009da0 comp rx=0 tx=0).ready entity=mgr.24311 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:35.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.652+0000 7f584effd640 1 -- 172.21.15.107:0/3282994519 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f5854058190 con 0x7f5858065be0 2024-09-21T08:03:35.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.902+0000 7f58604ea640 1 -- 172.21.15.107:0/3282994519 --> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f585810f0f0 con 0x7f584406e6e0 2024-09-21T08:03:35.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.903+0000 7f584effd640 1 -- 172.21.15.107:0/3282994519 <== mgr.24311 v2:172.21.15.129:6828/1054385200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f585810f0f0 con 0x7f584406e6e0 2024-09-21T08:03:35.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.906+0000 7f58604ea640 1 -- 172.21.15.107:0/3282994519 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f584406e6e0 msgr2=0x7f5844070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:35.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.906+0000 7f58604ea640 1 --2- 172.21.15.107:0/3282994519 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f584406e6e0 0x7f5844070b90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f585810ce00 tx=0x7f5848009da0 comp rx=0 tx=0).stop 2024-09-21T08:03:35.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.906+0000 7f58604ea640 1 -- 172.21.15.107:0/3282994519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5858065be0 msgr2=0x7f585810d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:35.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.906+0000 7f58604ea640 1 --2- 172.21.15.107:0/3282994519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5858065be0 0x7f585810d050 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f585400eb70 tx=0x7f585400b040 comp rx=0 tx=0).stop 2024-09-21T08:03:35.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.906+0000 7f58604ea640 1 -- 172.21.15.107:0/3282994519 shutdown_connections 2024-09-21T08:03:35.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.906+0000 7f58604ea640 1 --2- 172.21.15.107:0/3282994519 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f584406e6e0 0x7f5844070b90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:35.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.906+0000 7f58604ea640 1 --2- 172.21.15.107:0/3282994519 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58580ff6e0 0x7f585810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:35.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.906+0000 7f58604ea640 1 --2- 172.21.15.107:0/3282994519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5858065be0 0x7f585810d050 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:35.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.906+0000 7f58604ea640 1 -- 172.21.15.107:0/3282994519 >> 172.21.15.107:0/3282994519 conn(0x7f58580f6c10 msgr2=0x7f58580f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:35.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.906+0000 7f58604ea640 1 -- 172.21.15.107:0/3282994519 shutdown_connections 2024-09-21T08:03:35.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:35.906+0000 7f58604ea640 1 -- 172.21.15.107:0/3282994519 wait complete. 2024-09-21T08:03:36.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.015+0000 7f26b68ee640 1 -- 172.21.15.107:0/357904063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26b00ff680 msgr2=0x7f26b0101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:36.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.015+0000 7f26b68ee640 1 --2- 172.21.15.107:0/357904063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26b00ff680 0x7f26b0101a60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f26a40048d0 tx=0x7f26a4009da0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.015+0000 7f26b68ee640 1 -- 172.21.15.107:0/357904063 shutdown_connections 2024-09-21T08:03:36.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.015+0000 7f26b68ee640 1 --2- 172.21.15.107:0/357904063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26b00ff680 0x7f26b0101a60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.015+0000 7f26b68ee640 1 --2- 172.21.15.107:0/357904063 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26b0065c40 0x7f26b00ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.015+0000 7f26b68ee640 1 -- 172.21.15.107:0/357904063 >> 172.21.15.107:0/357904063 conn(0x7f26b00f6c10 msgr2=0x7f26b00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:36.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.015+0000 7f26b68ee640 1 -- 172.21.15.107:0/357904063 shutdown_connections 2024-09-21T08:03:36.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.015+0000 7f26b68ee640 1 -- 172.21.15.107:0/357904063 wait complete. 2024-09-21T08:03:36.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.015+0000 7f26b68ee640 1 Processor -- start 2024-09-21T08:03:36.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.015+0000 7f26b68ee640 1 -- start start 2024-09-21T08:03:36.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.016+0000 7f26b68ee640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26b0065c40 0x7f26b010d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:36.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.016+0000 7f26b68ee640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26b00ff680 0x7f26b010d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:36.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.016+0000 7f26b68ee640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b010dc00 con 0x7f26b00ff680 2024-09-21T08:03:36.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.016+0000 7f26b68ee640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b010e420 con 0x7f26b0065c40 2024-09-21T08:03:36.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.016+0000 7f26af7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26b00ff680 0x7f26b010d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.016+0000 7f26af7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26b00ff680 0x7f26b010d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53584/0 (socket says 172.21.15.107:53584) 2024-09-21T08:03:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.016+0000 7f26af7fe640 1 -- 172.21.15.107:0/32550029 learned_addr learned my addr 172.21.15.107:0/32550029 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:03:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.016+0000 7f26affff640 1 --2- 172.21.15.107:0/32550029 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26b0065c40 0x7f26b010d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.016+0000 7f26af7fe640 1 -- 172.21.15.107:0/32550029 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26b0065c40 msgr2=0x7f26b010d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.016+0000 7f26af7fe640 1 --2- 172.21.15.107:0/32550029 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26b0065c40 0x7f26b010d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.016+0000 7f26af7fe640 1 -- 172.21.15.107:0/32550029 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a4005040 con 0x7f26b00ff680 2024-09-21T08:03:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.016+0000 7f26af7fe640 1 --2- 172.21.15.107:0/32550029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26b00ff680 0x7f26b010d5b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f26a40048a0 tx=0x7f26a4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.016+0000 7f26acff9640 1 -- 172.21.15.107:0/32550029 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26a4038070 con 0x7f26b00ff680 2024-09-21T08:03:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.017+0000 7f26acff9640 1 -- 172.21.15.107:0/32550029 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f26a4004290 con 0x7f26b00ff680 2024-09-21T08:03:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.017+0000 7f26b68ee640 1 -- 172.21.15.107:0/32550029 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b010e650 con 0x7f26b00ff680 2024-09-21T08:03:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.017+0000 7f26acff9640 1 -- 172.21.15.107:0/32550029 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26a4033660 con 0x7f26b00ff680 2024-09-21T08:03:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.017+0000 7f26b68ee640 1 -- 172.21.15.107:0/32550029 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b010ebf0 con 0x7f26b00ff680 2024-09-21T08:03:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.018+0000 7f26b68ee640 1 -- 172.21.15.107:0/32550029 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b00fa890 con 0x7f26b00ff680 2024-09-21T08:03:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.019+0000 7f26acff9640 1 -- 172.21.15.107:0/32550029 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f26a4030020 con 0x7f26b00ff680 2024-09-21T08:03:36.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.020+0000 7f26acff9640 1 --2- 172.21.15.107:0/32550029 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f269806e6e0 0x7f2698070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:36.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.020+0000 7f26acff9640 1 -- 172.21.15.107:0/32550029 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f26a40adf60 con 0x7f26b00ff680 2024-09-21T08:03:36.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.020+0000 7f26affff640 1 --2- 172.21.15.107:0/32550029 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f269806e6e0 0x7f2698070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:36.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.020+0000 7f26affff640 1 --2- 172.21.15.107:0/32550029 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f269806e6e0 0x7f2698070b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009af0 tx=0x7f26a000b040 comp rx=0 tx=0).ready entity=mgr.24311 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:36.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.028+0000 7f26acff9640 1 -- 172.21.15.107:0/32550029 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f26a40e26d0 con 0x7f26b00ff680 2024-09-21T08:03:36.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.263+0000 7f26b68ee640 1 -- 172.21.15.107:0/32550029 --> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f26b010ef70 con 0x7f269806e6e0 2024-09-21T08:03:36.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.271+0000 7f26acff9640 1 -- 172.21.15.107:0/32550029 <== mgr.24311 v2:172.21.15.129:6828/1054385200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f26b010ef70 con 0x7f269806e6e0 2024-09-21T08:03:36.273 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:03:36.273 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 starting - - - - 2024-09-21T08:03:36.273 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (8m) 51s ago 8m 6899k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 4557b307c7dd 2024-09-21T08:03:36.273 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (8m) 66s ago 8m 6895k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be e74e9385abdf 2024-09-21T08:03:36.273 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 starting - - - - 2024-09-21T08:03:36.273 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (3m) 51s ago 3m 194M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 3bc779f88228 2024-09-21T08:03:36.273 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (3m) 51s ago 3m 12.0M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be ea8f140aade7 2024-09-21T08:03:36.273 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (3m) 66s ago 3m 14.9M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 329346c3afec 2024-09-21T08:03:36.273 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (3m) 66s ago 3m 16.9M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be baf87f32bfbc 2024-09-21T08:03:36.273 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:9283,8765,8443 running (9m) 51s ago 9m 243M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be d8e1cda67b5b 2024-09-21T08:03:36.273 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283 running (95s) 66s ago 7m 479M - 19.1.1-367-g9e2ac70b cc9251b744a3 303933eb1c8b 2024-09-21T08:03:36.273 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (9m) 51s ago 10m 48.0M 2048M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7702e48722c8 2024-09-21T08:03:36.273 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (7m) 66s ago 7m 38.1M 2048M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be d9680c5a5b92 2024-09-21T08:03:36.274 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 starting - - - - 2024-09-21T08:03:36.274 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 starting - - - - 2024-09-21T08:03:36.274 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (7m) 51s ago 7m 125M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 6799bdf55207 2024-09-21T08:03:36.274 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (6m) 51s ago 6m 136M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 29d8ce3f3a52 2024-09-21T08:03:36.274 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (6m) 51s ago 6m 131M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be c9e1c4756c02 2024-09-21T08:03:36.274 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (5m) 66s ago 5m 143M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7d58f70b105c 2024-09-21T08:03:36.274 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (5m) 66s ago 5m 136M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 2f916ef76d22 2024-09-21T08:03:36.274 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (4m) 66s ago 4m 129M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 0f25d9454304 2024-09-21T08:03:36.274 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 starting - - - - 2024-09-21T08:03:36.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.273+0000 7f26b68ee640 1 -- 172.21.15.107:0/32550029 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f269806e6e0 msgr2=0x7f2698070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:36.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.273+0000 7f26b68ee640 1 --2- 172.21.15.107:0/32550029 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f269806e6e0 0x7f2698070b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009af0 tx=0x7f26a000b040 comp rx=0 tx=0).stop 2024-09-21T08:03:36.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.273+0000 7f26b68ee640 1 -- 172.21.15.107:0/32550029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26b00ff680 msgr2=0x7f26b010d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:36.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.273+0000 7f26b68ee640 1 --2- 172.21.15.107:0/32550029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26b00ff680 0x7f26b010d5b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f26a40048a0 tx=0x7f26a4009da0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.273+0000 7f26b68ee640 1 -- 172.21.15.107:0/32550029 shutdown_connections 2024-09-21T08:03:36.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.273+0000 7f26b68ee640 1 --2- 172.21.15.107:0/32550029 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f269806e6e0 0x7f2698070b90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.273+0000 7f26b68ee640 1 --2- 172.21.15.107:0/32550029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26b00ff680 0x7f26b010d5b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.273+0000 7f26b68ee640 1 --2- 172.21.15.107:0/32550029 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26b0065c40 0x7f26b010d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.273+0000 7f26b68ee640 1 -- 172.21.15.107:0/32550029 >> 172.21.15.107:0/32550029 conn(0x7f26b00f6c10 msgr2=0x7f26b00f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:36.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.273+0000 7f26b68ee640 1 -- 172.21.15.107:0/32550029 shutdown_connections 2024-09-21T08:03:36.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.273+0000 7f26b68ee640 1 -- 172.21.15.107:0/32550029 wait complete. 2024-09-21T08:03:36.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.362+0000 7fa3fc7d2640 1 -- 172.21.15.107:0/3288669055 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3f40fe760 msgr2=0x7fa3f40feb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:36.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.362+0000 7fa3fc7d2640 1 --2- 172.21.15.107:0/3288669055 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3f40fe760 0x7fa3f40feb70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00048d0 tx=0x7fa3f0009da0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.362+0000 7fa3fc7d2640 1 -- 172.21.15.107:0/3288669055 shutdown_connections 2024-09-21T08:03:36.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.362+0000 7fa3fc7d2640 1 --2- 172.21.15.107:0/3288669055 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa3f40ffa30 0x7fa3f40ffea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.362+0000 7fa3fc7d2640 1 --2- 172.21.15.107:0/3288669055 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3f40fe760 0x7fa3f40feb70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.362+0000 7fa3fc7d2640 1 -- 172.21.15.107:0/3288669055 >> 172.21.15.107:0/3288669055 conn(0x7fa3f40f9f20 msgr2=0x7fa3f40fc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:36.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.362+0000 7fa3fc7d2640 1 -- 172.21.15.107:0/3288669055 shutdown_connections 2024-09-21T08:03:36.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.362+0000 7fa3fc7d2640 1 -- 172.21.15.107:0/3288669055 wait complete. 2024-09-21T08:03:36.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.363+0000 7fa3fc7d2640 1 Processor -- start 2024-09-21T08:03:36.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.363+0000 7fa3fc7d2640 1 -- start start 2024-09-21T08:03:36.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.363+0000 7fa3fc7d2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa3f40fe760 0x7fa3f410f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:36.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.363+0000 7fa3fc7d2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3f40ffa30 0x7fa3f410f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:36.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.363+0000 7fa3fc7d2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f410fdb0 con 0x7fa3f40ffa30 2024-09-21T08:03:36.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.363+0000 7fa3fc7d2640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f41105d0 con 0x7fa3f40fe760 2024-09-21T08:03:36.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.363+0000 7fa3fa56e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa3f40fe760 0x7fa3f410f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:36.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.364+0000 7fa3fa56e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa3f40fe760 0x7fa3f410f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.107:52914/0 (socket says 172.21.15.107:52914) 2024-09-21T08:03:36.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.364+0000 7fa3fa56e640 1 -- 172.21.15.107:0/2829601641 learned_addr learned my addr 172.21.15.107:0/2829601641 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:03:36.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.364+0000 7fa3f9d6d640 1 --2- 172.21.15.107:0/2829601641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3f40ffa30 0x7fa3f410f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:36.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.364+0000 7fa3fa56e640 1 -- 172.21.15.107:0/2829601641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3f40ffa30 msgr2=0x7fa3f410f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:36.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.364+0000 7fa3fa56e640 1 --2- 172.21.15.107:0/2829601641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3f40ffa30 0x7fa3f410f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.364+0000 7fa3fa56e640 1 -- 172.21.15.107:0/2829601641 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f0005040 con 0x7fa3f40fe760 2024-09-21T08:03:36.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.364+0000 7fa3f9d6d640 1 --2- 172.21.15.107:0/2829601641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3f40ffa30 0x7fa3f410f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:03:36.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.364+0000 7fa3fa56e640 1 --2- 172.21.15.107:0/2829601641 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa3f40fe760 0x7fa3f410f220 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0003080 tx=0x7fa3f0009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:36.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.365+0000 7fa3eaffd640 1 -- 172.21.15.107:0/2829601641 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3f0038070 con 0x7fa3f40fe760 2024-09-21T08:03:36.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.365+0000 7fa3eaffd640 1 -- 172.21.15.107:0/2829601641 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa3f002abd0 con 0x7fa3f40fe760 2024-09-21T08:03:36.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.365+0000 7fa3eaffd640 1 -- 172.21.15.107:0/2829601641 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3f003e670 con 0x7fa3f40fe760 2024-09-21T08:03:36.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.365+0000 7fa3fc7d2640 1 -- 172.21.15.107:0/2829601641 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f4110800 con 0x7fa3f40fe760 2024-09-21T08:03:36.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.365+0000 7fa3fc7d2640 1 -- 172.21.15.107:0/2829601641 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f4110da0 con 0x7fa3f40fe760 2024-09-21T08:03:36.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.366+0000 7fa3fc7d2640 1 -- 172.21.15.107:0/2829601641 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f40fdbc0 con 0x7fa3f40fe760 2024-09-21T08:03:36.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.367+0000 7fa3eaffd640 1 -- 172.21.15.107:0/2829601641 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fa3f0030020 con 0x7fa3f40fe760 2024-09-21T08:03:36.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.367+0000 7fa3eaffd640 1 --2- 172.21.15.107:0/2829601641 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fa3e006e6e0 0x7fa3e0070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:36.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.367+0000 7fa3eaffd640 1 -- 172.21.15.107:0/2829601641 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa3f00ae190 con 0x7fa3f40fe760 2024-09-21T08:03:36.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.367+0000 7fa3f9d6d640 1 --2- 172.21.15.107:0/2829601641 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fa3e006e6e0 0x7fa3e0070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:36.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.368+0000 7fa3f9d6d640 1 --2- 172.21.15.107:0/2829601641 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fa3e006e6e0 0x7fa3e0070b90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa3f410efd0 tx=0x7fa3e4009040 comp rx=0 tx=0).ready entity=mgr.24311 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:36.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.372+0000 7fa3eaffd640 1 -- 172.21.15.107:0/2829601641 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fa3f0077bd0 con 0x7fa3f40fe760 2024-09-21T08:03:36.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:36 smithi107 ceph-mon[27622]: pgmap v40: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 1.8 MiB/s wr, 275 op/s 2024-09-21T08:03:36.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:36 smithi107 ceph-mon[27622]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:03:36.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:36 smithi107 ceph-mon[27622]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:03:36.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.754+0000 7fa3fc7d2640 1 -- 172.21.15.107:0/2829601641 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa3f4107160 con 0x7fa3f40fe760 2024-09-21T08:03:36.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.755+0000 7fa3eaffd640 1 -- 172.21.15.107:0/2829601641 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7fa3f007b290 con 0x7fa3f40fe760 2024-09-21T08:03:36.756 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:03:36.757 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": { 2024-09-21T08:03:36.757 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 2 2024-09-21T08:03:36.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:03:36.757 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": { 2024-09-21T08:03:36.757 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 1, 2024-09-21T08:03:36.757 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 1 2024-09-21T08:03:36.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:03:36.757 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": { 2024-09-21T08:03:36.757 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 6 2024-09-21T08:03:36.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:03:36.757 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-21T08:03:36.757 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 4 2024-09-21T08:03:36.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:03:36.758 INFO:teuthology.orchestra.run.smithi107.stdout: "overall": { 2024-09-21T08:03:36.758 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 13, 2024-09-21T08:03:36.758 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 1 2024-09-21T08:03:36.758 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-21T08:03:36.758 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:03:36.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.757+0000 7fa3fc7d2640 1 -- 172.21.15.107:0/2829601641 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fa3e006e6e0 msgr2=0x7fa3e0070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:36.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.757+0000 7fa3fc7d2640 1 --2- 172.21.15.107:0/2829601641 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fa3e006e6e0 0x7fa3e0070b90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa3f410efd0 tx=0x7fa3e4009040 comp rx=0 tx=0).stop 2024-09-21T08:03:36.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.757+0000 7fa3fc7d2640 1 -- 172.21.15.107:0/2829601641 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa3f40fe760 msgr2=0x7fa3f410f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:36.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.757+0000 7fa3fc7d2640 1 --2- 172.21.15.107:0/2829601641 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa3f40fe760 0x7fa3f410f220 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0003080 tx=0x7fa3f0009da0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.757+0000 7fa3fc7d2640 1 -- 172.21.15.107:0/2829601641 shutdown_connections 2024-09-21T08:03:36.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.757+0000 7fa3fc7d2640 1 --2- 172.21.15.107:0/2829601641 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7fa3e006e6e0 0x7fa3e0070b90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.757+0000 7fa3fc7d2640 1 --2- 172.21.15.107:0/2829601641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3f40ffa30 0x7fa3f410f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.757+0000 7fa3fc7d2640 1 --2- 172.21.15.107:0/2829601641 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa3f40fe760 0x7fa3f410f220 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.757+0000 7fa3fc7d2640 1 -- 172.21.15.107:0/2829601641 >> 172.21.15.107:0/2829601641 conn(0x7fa3f40f9f20 msgr2=0x7fa3f40fb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:36.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.757+0000 7fa3fc7d2640 1 -- 172.21.15.107:0/2829601641 shutdown_connections 2024-09-21T08:03:36.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.757+0000 7fa3fc7d2640 1 -- 172.21.15.107:0/2829601641 wait complete. 2024-09-21T08:03:36.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:36 smithi129 ceph-mon[34472]: pgmap v40: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 1.8 MiB/s wr, 275 op/s 2024-09-21T08:03:36.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:36 smithi129 ceph-mon[34472]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:03:36.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:36 smithi129 ceph-mon[34472]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:03:36.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.851+0000 7f21f0e6f640 1 -- 172.21.15.107:0/2120384496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21ec0fb430 msgr2=0x7f21ec0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:36.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.851+0000 7f21f0e6f640 1 --2- 172.21.15.107:0/2120384496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21ec0fb430 0x7f21ec0fb840 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0048d0 tx=0x7f21dc009da0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.851+0000 7f21f0e6f640 1 -- 172.21.15.107:0/2120384496 shutdown_connections 2024-09-21T08:03:36.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.851+0000 7f21f0e6f640 1 --2- 172.21.15.107:0/2120384496 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f21ec0fc700 0x7f21ec0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.851+0000 7f21f0e6f640 1 --2- 172.21.15.107:0/2120384496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21ec0fb430 0x7f21ec0fb840 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.851+0000 7f21f0e6f640 1 -- 172.21.15.107:0/2120384496 >> 172.21.15.107:0/2120384496 conn(0x7f21ec0f6c10 msgr2=0x7f21ec0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:36.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.851+0000 7f21f0e6f640 1 -- 172.21.15.107:0/2120384496 shutdown_connections 2024-09-21T08:03:36.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.851+0000 7f21f0e6f640 1 -- 172.21.15.107:0/2120384496 wait complete. 2024-09-21T08:03:36.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.852+0000 7f21f0e6f640 1 Processor -- start 2024-09-21T08:03:36.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.852+0000 7f21f0e6f640 1 -- start start 2024-09-21T08:03:36.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.852+0000 7f21f0e6f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21ec0fb430 0x7f21ec10fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:36.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.852+0000 7f21f0e6f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f21ec0fc700 0x7f21ec112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:36.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.852+0000 7f21f0e6f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec065c60 con 0x7f21ec0fb430 2024-09-21T08:03:36.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.852+0000 7f21f0e6f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec065dd0 con 0x7f21ec0fc700 2024-09-21T08:03:36.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.852+0000 7f21ea59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21ec0fb430 0x7f21ec10fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:36.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.852+0000 7f21ea59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21ec0fb430 0x7f21ec10fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53632/0 (socket says 172.21.15.107:53632) 2024-09-21T08:03:36.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.852+0000 7f21ea59c640 1 -- 172.21.15.107:0/2073985173 learned_addr learned my addr 172.21.15.107:0/2073985173 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:03:36.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.852+0000 7f21e9d9b640 1 --2- 172.21.15.107:0/2073985173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f21ec0fc700 0x7f21ec112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:36.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.853+0000 7f21ea59c640 1 -- 172.21.15.107:0/2073985173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f21ec0fc700 msgr2=0x7f21ec112310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:36.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.853+0000 7f21ea59c640 1 --2- 172.21.15.107:0/2073985173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f21ec0fc700 0x7f21ec112310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.853+0000 7f21ea59c640 1 -- 172.21.15.107:0/2073985173 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc005040 con 0x7f21ec0fb430 2024-09-21T08:03:36.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.853+0000 7f21ea59c640 1 --2- 172.21.15.107:0/2073985173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21ec0fb430 0x7f21ec10fdc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0048a0 tx=0x7f21dc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:36.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.853+0000 7f21daffd640 1 -- 172.21.15.107:0/2073985173 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21dc038070 con 0x7f21ec0fb430 2024-09-21T08:03:36.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.853+0000 7f21daffd640 1 -- 172.21.15.107:0/2073985173 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f21dc004290 con 0x7f21ec0fb430 2024-09-21T08:03:36.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.853+0000 7f21daffd640 1 -- 172.21.15.107:0/2073985173 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21dc033660 con 0x7f21ec0fb430 2024-09-21T08:03:36.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.853+0000 7f21f0e6f640 1 -- 172.21.15.107:0/2073985173 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ec112850 con 0x7f21ec0fb430 2024-09-21T08:03:36.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.853+0000 7f21f0e6f640 1 -- 172.21.15.107:0/2073985173 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ec112dc0 con 0x7f21ec0fb430 2024-09-21T08:03:36.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.854+0000 7f21f0e6f640 1 -- 172.21.15.107:0/2073985173 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ec0fa890 con 0x7f21ec0fb430 2024-09-21T08:03:36.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.856+0000 7f21daffd640 1 -- 172.21.15.107:0/2073985173 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f21dc030020 con 0x7f21ec0fb430 2024-09-21T08:03:36.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.856+0000 7f21daffd640 1 --2- 172.21.15.107:0/2073985173 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f21d406e6e0 0x7f21d4070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:36.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.856+0000 7f21daffd640 1 -- 172.21.15.107:0/2073985173 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f21dc0ade40 con 0x7f21ec0fb430 2024-09-21T08:03:36.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.856+0000 7f21e9d9b640 1 --2- 172.21.15.107:0/2073985173 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f21d406e6e0 0x7f21d4070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:36.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.857+0000 7f21e9d9b640 1 --2- 172.21.15.107:0/2073985173 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f21d406e6e0 0x7f21d4070b90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f21e0009af0 tx=0x7f21e000b040 comp rx=0 tx=0).ready entity=mgr.24311 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:36.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:36.864+0000 7f21daffd640 1 -- 172.21.15.107:0/2073985173 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f21dc0779c0 con 0x7f21ec0fb430 2024-09-21T08:03:37.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:37.125+0000 7f21f0e6f640 1 -- 172.21.15.107:0/2073985173 --> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f21ec100b60 con 0x7f21d406e6e0 2024-09-21T08:03:37.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:37.127+0000 7f21daffd640 1 -- 172.21.15.107:0/2073985173 <== mgr.24311 v2:172.21.15.129:6828/1054385200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f21ec100b60 con 0x7f21d406e6e0 2024-09-21T08:03:37.128 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:03:37.128 INFO:teuthology.orchestra.run.smithi107.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5", 2024-09-21T08:03:37.128 INFO:teuthology.orchestra.run.smithi107.stdout: "in_progress": true, 2024-09-21T08:03:37.128 INFO:teuthology.orchestra.run.smithi107.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T08:03:37.129 INFO:teuthology.orchestra.run.smithi107.stdout: "services_complete": [], 2024-09-21T08:03:37.129 INFO:teuthology.orchestra.run.smithi107.stdout: "progress": "1/2 daemons upgraded", 2024-09-21T08:03:37.129 INFO:teuthology.orchestra.run.smithi107.stdout: "message": "Currently upgrading mgr daemons", 2024-09-21T08:03:37.129 INFO:teuthology.orchestra.run.smithi107.stdout: "is_paused": false 2024-09-21T08:03:37.129 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:03:37.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:37.130+0000 7f21f0e6f640 1 -- 172.21.15.107:0/2073985173 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f21d406e6e0 msgr2=0x7f21d4070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:37.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:37.130+0000 7f21f0e6f640 1 --2- 172.21.15.107:0/2073985173 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f21d406e6e0 0x7f21d4070b90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f21e0009af0 tx=0x7f21e000b040 comp rx=0 tx=0).stop 2024-09-21T08:03:37.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:37.130+0000 7f21f0e6f640 1 -- 172.21.15.107:0/2073985173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21ec0fb430 msgr2=0x7f21ec10fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:37.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:37.130+0000 7f21f0e6f640 1 --2- 172.21.15.107:0/2073985173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21ec0fb430 0x7f21ec10fdc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0048a0 tx=0x7f21dc009da0 comp rx=0 tx=0).stop 2024-09-21T08:03:37.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:37.130+0000 7f21f0e6f640 1 -- 172.21.15.107:0/2073985173 shutdown_connections 2024-09-21T08:03:37.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:37.130+0000 7f21f0e6f640 1 --2- 172.21.15.107:0/2073985173 >> [v2:172.21.15.129:6828/1054385200,v1:172.21.15.129:6829/1054385200] conn(0x7f21d406e6e0 0x7f21d4070b90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:37.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:37.130+0000 7f21f0e6f640 1 --2- 172.21.15.107:0/2073985173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f21ec0fc700 0x7f21ec112310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:37.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:37.130+0000 7f21f0e6f640 1 --2- 172.21.15.107:0/2073985173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21ec0fb430 0x7f21ec10fdc0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:37.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:37.130+0000 7f21f0e6f640 1 -- 172.21.15.107:0/2073985173 >> 172.21.15.107:0/2073985173 conn(0x7f21ec0f6c10 msgr2=0x7f21ec0f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:37.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:37.130+0000 7f21f0e6f640 1 -- 172.21.15.107:0/2073985173 shutdown_connections 2024-09-21T08:03:37.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:03:37.130+0000 7f21f0e6f640 1 -- 172.21.15.107:0/2073985173 wait complete. 2024-09-21T08:03:37.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:37 smithi129 ceph-mon[34472]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:03:37.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:37 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/2829601641' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:03:37.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:37 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:03:37.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:37 smithi107 ceph-mon[27622]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:03:37.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:37 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/2829601641' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:03:37.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:37 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:03:38.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:38 smithi129 ceph-mon[34472]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:03:38.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:38 smithi129 ceph-mon[34472]: pgmap v41: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 2.5 MiB/s wr, 476 op/s 2024-09-21T08:03:38.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:38 smithi107 ceph-mon[27622]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:03:38.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:38 smithi107 ceph-mon[27622]: pgmap v41: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 2.5 MiB/s wr, 476 op/s 2024-09-21T08:03:40.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:40 smithi129 ceph-mon[34472]: pgmap v42: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 2.0 MiB/s wr, 812 op/s 2024-09-21T08:03:40.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:40 smithi107 ceph-mon[27622]: pgmap v42: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 2.0 MiB/s wr, 812 op/s 2024-09-21T08:03:42.689 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:42 smithi107 ceph-mon[27622]: pgmap v43: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.7 MiB/s wr, 732 op/s 2024-09-21T08:03:42.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:42 smithi129 ceph-mon[34472]: pgmap v43: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.7 MiB/s wr, 732 op/s 2024-09-21T08:03:44.412 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:44 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:44.412 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:44 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:44.412 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:44 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:03:44.412 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:44 smithi107 ceph-mon[27622]: pgmap v44: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 2.6 MiB/s wr, 1.23k op/s 2024-09-21T08:03:44.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:44 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:44.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:44 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:44.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:44 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:03:44.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:44 smithi129 ceph-mon[34472]: pgmap v44: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 2.6 MiB/s wr, 1.23k op/s 2024-09-21T08:03:46.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:46 smithi129 ceph-mon[34472]: pgmap v45: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.7 MiB/s wr, 1.07k op/s 2024-09-21T08:03:46.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:46 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:46.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:46 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:46.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:46 smithi107 ceph-mon[27622]: pgmap v45: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.7 MiB/s wr, 1.07k op/s 2024-09-21T08:03:46.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:46 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:46.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:46 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:03:48.660 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:48 smithi107 ceph-mon[27622]: pgmap v46: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 2.2 MiB/s wr, 1.17k op/s 2024-09-21T08:03:48.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:48 smithi129 ceph-mon[34472]: pgmap v46: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 2.2 MiB/s wr, 1.17k op/s 2024-09-21T08:03:50.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:50 smithi129 ceph-mon[34472]: pgmap v47: 65 pgs: 65 active+clean; 298 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.8 MiB/s wr, 1.13k op/s 2024-09-21T08:03:50.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:50 smithi129 ceph-mon[34472]: Standby manager daemon smithi107.wzulxb restarted 2024-09-21T08:03:50.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:50 smithi129 ceph-mon[34472]: Standby manager daemon smithi107.wzulxb started 2024-09-21T08:03:50.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:50 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.wzulxb/crt"}]: dispatch 2024-09-21T08:03:50.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:50 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T08:03:50.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:50 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.wzulxb/key"}]: dispatch 2024-09-21T08:03:50.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:50 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T08:03:50.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:50 smithi107 ceph-mon[27622]: pgmap v47: 65 pgs: 65 active+clean; 298 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.8 MiB/s wr, 1.13k op/s 2024-09-21T08:03:50.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:50 smithi107 ceph-mon[27622]: Standby manager daemon smithi107.wzulxb restarted 2024-09-21T08:03:50.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:50 smithi107 ceph-mon[27622]: Standby manager daemon smithi107.wzulxb started 2024-09-21T08:03:50.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:50 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.wzulxb/crt"}]: dispatch 2024-09-21T08:03:50.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:50 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T08:03:50.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:50 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.wzulxb/key"}]: dispatch 2024-09-21T08:03:50.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:50 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T08:03:51.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:51 smithi129 ceph-mon[34472]: mgrmap e26: smithi129.wvlmvo(active, since 89s), standbys: smithi107.wzulxb 2024-09-21T08:03:51.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:51 smithi107 ceph-mon[27622]: mgrmap e26: smithi129.wvlmvo(active, since 89s), standbys: smithi107.wzulxb 2024-09-21T08:03:52.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:52 smithi129 ceph-mon[34472]: pgmap v48: 65 pgs: 65 active+clean; 298 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.6 MiB/s wr, 753 op/s 2024-09-21T08:03:52.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:52 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:03:52.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:52 smithi107 ceph-mon[27622]: pgmap v48: 65 pgs: 65 active+clean; 298 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.6 MiB/s wr, 753 op/s 2024-09-21T08:03:52.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:52 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:03:54.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:54 smithi129 ceph-mon[34472]: pgmap v49: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.5 MiB/s wr, 916 op/s 2024-09-21T08:03:54.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:54 smithi129 ceph-mon[34472]: mgrmap e27: smithi129.wvlmvo(active, since 92s), standbys: smithi107.wzulxb 2024-09-21T08:03:54.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:54 smithi107 ceph-mon[27622]: pgmap v49: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.5 MiB/s wr, 916 op/s 2024-09-21T08:03:54.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:54 smithi107 ceph-mon[27622]: mgrmap e27: smithi129.wvlmvo(active, since 92s), standbys: smithi107.wzulxb 2024-09-21T08:03:56.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:56 smithi129 ceph-mon[34472]: pgmap v50: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.6 MiB/s wr, 421 op/s 2024-09-21T08:03:56.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:56 smithi107 ceph-mon[27622]: pgmap v50: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.6 MiB/s wr, 421 op/s 2024-09-21T08:03:58.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:58 smithi129 ceph-mon[34472]: pgmap v51: 65 pgs: 65 active+clean; 283 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.7 MiB/s wr, 493 op/s 2024-09-21T08:03:58.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:58 smithi107 ceph-mon[27622]: pgmap v51: 65 pgs: 65 active+clean; 283 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.7 MiB/s wr, 493 op/s 2024-09-21T08:04:00.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:59 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:04:00.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:59 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:04:00.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:59 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:04:00.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:03:59 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:04:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:59 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:04:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:59 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:04:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:59 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:04:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:03:59 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:04:00.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:00 smithi107 ceph-mon[27622]: pgmap v52: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.8 MiB/s wr, 578 op/s 2024-09-21T08:04:01.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:00 smithi129 ceph-mon[34472]: pgmap v52: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.8 MiB/s wr, 578 op/s 2024-09-21T08:04:02.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:02 smithi107 ceph-mon[27622]: pgmap v53: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.7 MiB/s wr, 408 op/s 2024-09-21T08:04:03.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:02 smithi129 ceph-mon[34472]: pgmap v53: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.7 MiB/s wr, 408 op/s 2024-09-21T08:04:04.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:04 smithi107 ceph-mon[27622]: pgmap v54: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 2.5 MiB/s wr, 898 op/s 2024-09-21T08:04:04.951 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:04 smithi129 ceph-mon[34472]: pgmap v54: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 2.5 MiB/s wr, 898 op/s 2024-09-21T08:04:06.328 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-21T08:04:06.329 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-21T08:04:06.629 DEBUG:teuthology.parallel:result is None 2024-09-21T08:04:06.891 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:06 smithi129 ceph-mon[34472]: pgmap v55: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 735 op/s 2024-09-21T08:04:06.935 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:06 smithi107 ceph-mon[27622]: pgmap v55: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 735 op/s 2024-09-21T08:04:07.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.253+0000 7fae5df00640 1 -- 172.21.15.107:0/3697167408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae580fe4c0 msgr2=0x7fae580fa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:07.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.253+0000 7fae5df00640 1 --2- 172.21.15.107:0/3697167408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae580fe4c0 0x7fae580fa620 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fae4c0048d0 tx=0x7fae4c009da0 comp rx=0 tx=0).stop 2024-09-21T08:04:07.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.253+0000 7fae5df00640 1 -- 172.21.15.107:0/3697167408 shutdown_connections 2024-09-21T08:04:07.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.253+0000 7fae5df00640 1 --2- 172.21.15.107:0/3697167408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae580fe4c0 0x7fae580fa620 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:07.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.253+0000 7fae5df00640 1 --2- 172.21.15.107:0/3697167408 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fae580fdb70 0x7fae580fdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:07.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.253+0000 7fae5df00640 1 -- 172.21.15.107:0/3697167408 >> 172.21.15.107:0/3697167408 conn(0x7fae580f6390 msgr2=0x7fae580f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:07.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.254+0000 7fae5df00640 1 -- 172.21.15.107:0/3697167408 shutdown_connections 2024-09-21T08:04:07.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.254+0000 7fae5df00640 1 -- 172.21.15.107:0/3697167408 wait complete. 2024-09-21T08:04:07.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.254+0000 7fae5df00640 1 Processor -- start 2024-09-21T08:04:07.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.254+0000 7fae5df00640 1 -- start start 2024-09-21T08:04:07.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.254+0000 7fae5df00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae580fdb70 0x7fae5810d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:07.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.254+0000 7fae5df00640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fae580fe4c0 0x7fae5810d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:07.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.254+0000 7fae5df00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5810dc30 con 0x7fae580fdb70 2024-09-21T08:04:07.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.254+0000 7fae5df00640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5810e450 con 0x7fae580fe4c0 2024-09-21T08:04:07.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.255+0000 7fae577fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae580fdb70 0x7fae5810d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:07.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.255+0000 7fae577fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae580fdb70 0x7fae5810d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41932/0 (socket says 172.21.15.107:41932) 2024-09-21T08:04:07.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.255+0000 7fae577fe640 1 -- 172.21.15.107:0/995470354 learned_addr learned my addr 172.21.15.107:0/995470354 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:04:07.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.255+0000 7fae56ffd640 1 --2- 172.21.15.107:0/995470354 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fae580fe4c0 0x7fae5810d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:07.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.255+0000 7fae577fe640 1 -- 172.21.15.107:0/995470354 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fae580fe4c0 msgr2=0x7fae5810d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:07.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.255+0000 7fae577fe640 1 --2- 172.21.15.107:0/995470354 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fae580fe4c0 0x7fae5810d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:07.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.255+0000 7fae577fe640 1 -- 172.21.15.107:0/995470354 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c005040 con 0x7fae580fdb70 2024-09-21T08:04:07.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.255+0000 7fae56ffd640 1 --2- 172.21.15.107:0/995470354 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fae580fe4c0 0x7fae5810d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:04:07.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.255+0000 7fae577fe640 1 --2- 172.21.15.107:0/995470354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae580fdb70 0x7fae5810d0a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fae4800eb70 tx=0x7fae4800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:07.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.256+0000 7fae3ffff640 1 -- 172.21.15.107:0/995470354 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae48007c30 con 0x7fae580fdb70 2024-09-21T08:04:07.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.256+0000 7fae5df00640 1 -- 172.21.15.107:0/995470354 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5810e680 con 0x7fae580fdb70 2024-09-21T08:04:07.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.256+0000 7fae5df00640 1 -- 172.21.15.107:0/995470354 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5810ec20 con 0x7fae580fdb70 2024-09-21T08:04:07.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.256+0000 7fae3ffff640 1 -- 172.21.15.107:0/995470354 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fae4800f040 con 0x7fae580fdb70 2024-09-21T08:04:07.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.256+0000 7fae3ffff640 1 -- 172.21.15.107:0/995470354 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae48009370 con 0x7fae580fdb70 2024-09-21T08:04:07.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.257+0000 7fae5df00640 1 -- 172.21.15.107:0/995470354 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae44005240 con 0x7fae580fdb70 2024-09-21T08:04:07.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.257+0000 7fae3ffff640 1 -- 172.21.15.107:0/995470354 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 28) v1 ==== 45992+0+0 (secure 0 0 0) 0x7fae4800c6a0 con 0x7fae580fdb70 2024-09-21T08:04:07.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.258+0000 7fae3ffff640 1 -- 172.21.15.107:0/995470354 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fae4804c3d0 con 0x7fae580fdb70 2024-09-21T08:04:07.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.265+0000 7fae3ffff640 1 -- 172.21.15.107:0/995470354 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fae48009850 con 0x7fae580fdb70 2024-09-21T08:04:07.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.906+0000 7fae3ffff640 1 -- 172.21.15.107:0/995470354 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 29) v1 ==== 46415+0+0 (secure 0 0 0) 0x7fae4800c950 con 0x7fae580fdb70 2024-09-21T08:04:07.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.907+0000 7fae3ffff640 1 --2- 172.21.15.107:0/995470354 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fae4003e030 0x7fae40040410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:07.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.907+0000 7fae3ffff640 1 -- 172.21.15.107:0/995470354 --> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae40040950 con 0x7fae4003e030 2024-09-21T08:04:07.909 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:04:07.909 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:04:07.909 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:04:07.910 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:04:07.910 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:04:07.910 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:04:07.910 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mgr fail", "who": "smithi129.wvlmvo"}]: dispatch 2024-09-21T08:04:07.910 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mgr fail", "who": "smithi129.wvlmvo"}]: dispatch 2024-09-21T08:04:07.910 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: Activating manager daemon smithi107.wzulxb 2024-09-21T08:04:07.910 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: osdmap e46: 6 total, 6 up, 6 in 2024-09-21T08:04:07.910 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd='[{"prefix": "mgr fail", "who": "smithi129.wvlmvo"}]': finished 2024-09-21T08:04:07.910 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: mgrmap e28: smithi107.wzulxb(active, starting, since 0.00567737s) 2024-09-21T08:04:07.910 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-21T08:04:07.910 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T08:04:07.910 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.grqzkt"}]: dispatch 2024-09-21T08:04:07.911 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.qusoyf"}]: dispatch 2024-09-21T08:04:07.911 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.fwmfcy"}]: dispatch 2024-09-21T08:04:07.911 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.belyba"}]: dispatch 2024-09-21T08:04:07.911 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr metadata", "who": "smithi107.wzulxb", "id": "smithi107.wzulxb"}]: dispatch 2024-09-21T08:04:07.911 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T08:04:07.911 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T08:04:07.911 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T08:04:07.911 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T08:04:07.911 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T08:04:07.911 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T08:04:07.911 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T08:04:07.911 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T08:04:07.912 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T08:04:07.912 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: Manager daemon smithi107.wzulxb is now available 2024-09-21T08:04:07.912 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:04:07.912 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:04:07.912 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.wzulxb/mirror_snapshot_schedule"}]: dispatch 2024-09-21T08:04:07.912 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.wzulxb/trash_purge_schedule"}]: dispatch 2024-09-21T08:04:07.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.916+0000 7fae56ffd640 1 --2- 172.21.15.107:0/995470354 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fae4003e030 0x7fae40040410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:07.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.917+0000 7fae56ffd640 1 --2- 172.21.15.107:0/995470354 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fae4003e030 0x7fae40040410 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fae5810ce50 tx=0x7fae4c035040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:07.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.920+0000 7fae3ffff640 1 -- 172.21.15.107:0/995470354 <== mgr.14644 v2:172.21.15.107:6800/695383021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fae40040950 con 0x7fae4003e030 2024-09-21T08:04:07.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.924+0000 7fae5df00640 1 -- 172.21.15.107:0/995470354 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fae4003e030 msgr2=0x7fae40040410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:07.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.924+0000 7fae5df00640 1 --2- 172.21.15.107:0/995470354 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fae4003e030 0x7fae40040410 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fae5810ce50 tx=0x7fae4c035040 comp rx=0 tx=0).stop 2024-09-21T08:04:07.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.924+0000 7fae5df00640 1 -- 172.21.15.107:0/995470354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae580fdb70 msgr2=0x7fae5810d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:07.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.924+0000 7fae5df00640 1 --2- 172.21.15.107:0/995470354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae580fdb70 0x7fae5810d0a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fae4800eb70 tx=0x7fae4800b040 comp rx=0 tx=0).stop 2024-09-21T08:04:07.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.924+0000 7fae5df00640 1 -- 172.21.15.107:0/995470354 shutdown_connections 2024-09-21T08:04:07.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.924+0000 7fae5df00640 1 --2- 172.21.15.107:0/995470354 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fae4003e030 0x7fae40040410 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:07.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.924+0000 7fae5df00640 1 --2- 172.21.15.107:0/995470354 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fae580fe4c0 0x7fae5810d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:07.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.924+0000 7fae5df00640 1 --2- 172.21.15.107:0/995470354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae580fdb70 0x7fae5810d0a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:07.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.924+0000 7fae5df00640 1 -- 172.21.15.107:0/995470354 >> 172.21.15.107:0/995470354 conn(0x7fae580f6390 msgr2=0x7fae580f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:07.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.924+0000 7fae5df00640 1 -- 172.21.15.107:0/995470354 shutdown_connections 2024-09-21T08:04:07.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:07.924+0000 7fae5df00640 1 -- 172.21.15.107:0/995470354 wait complete. 2024-09-21T08:04:07.935 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:04:08.029 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:04:08.030 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:04:08.030 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:04:08.030 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:04:08.030 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' 2024-09-21T08:04:08.030 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:04:08.030 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.24311 172.21.15.129:0/1755620297' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mgr fail", "who": "smithi129.wvlmvo"}]: dispatch 2024-09-21T08:04:08.030 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "mgr fail", "who": "smithi129.wvlmvo"}]: dispatch 2024-09-21T08:04:08.030 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: Activating manager daemon smithi107.wzulxb 2024-09-21T08:04:08.030 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: osdmap e46: 6 total, 6 up, 6 in 2024-09-21T08:04:08.030 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.24311 ' entity='mgr.smithi129.wvlmvo' cmd='[{"prefix": "mgr fail", "who": "smithi129.wvlmvo"}]': finished 2024-09-21T08:04:08.030 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: mgrmap e28: smithi107.wzulxb(active, starting, since 0.00567737s) 2024-09-21T08:04:08.031 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-21T08:04:08.031 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T08:04:08.031 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.grqzkt"}]: dispatch 2024-09-21T08:04:08.031 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.qusoyf"}]: dispatch 2024-09-21T08:04:08.031 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.fwmfcy"}]: dispatch 2024-09-21T08:04:08.031 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.belyba"}]: dispatch 2024-09-21T08:04:08.031 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr metadata", "who": "smithi107.wzulxb", "id": "smithi107.wzulxb"}]: dispatch 2024-09-21T08:04:08.031 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T08:04:08.031 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T08:04:08.031 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T08:04:08.031 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T08:04:08.031 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T08:04:08.032 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T08:04:08.032 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T08:04:08.032 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T08:04:08.032 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T08:04:08.032 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: Manager daemon smithi107.wzulxb is now available 2024-09-21T08:04:08.032 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:04:08.032 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:04:08.032 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.wzulxb/mirror_snapshot_schedule"}]: dispatch 2024-09-21T08:04:08.032 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.wzulxb/trash_purge_schedule"}]: dispatch 2024-09-21T08:04:08.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.052+0000 7f3bfc016640 1 -- 172.21.15.107:0/1935784540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bf406e540 msgr2=0x7f3bf4108730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:08.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.052+0000 7f3bfc016640 1 --2- 172.21.15.107:0/1935784540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bf406e540 0x7f3bf4108730 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0048d0 tx=0x7f3bec009da0 comp rx=0 tx=0).stop 2024-09-21T08:04:08.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.052+0000 7f3bfc016640 1 -- 172.21.15.107:0/1935784540 shutdown_connections 2024-09-21T08:04:08.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.052+0000 7f3bfc016640 1 --2- 172.21.15.107:0/1935784540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bf406e540 0x7f3bf4108730 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:08.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.052+0000 7f3bfc016640 1 --2- 172.21.15.107:0/1935784540 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3bf406dbf0 0x7f3bf406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:08.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.052+0000 7f3bfc016640 1 -- 172.21.15.107:0/1935784540 >> 172.21.15.107:0/1935784540 conn(0x7f3bf4069560 msgr2=0x7f3bf406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:08.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.054+0000 7f3bfc016640 1 -- 172.21.15.107:0/1935784540 shutdown_connections 2024-09-21T08:04:08.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.055+0000 7f3bfc016640 1 -- 172.21.15.107:0/1935784540 wait complete. 2024-09-21T08:04:08.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.055+0000 7f3bfc016640 1 Processor -- start 2024-09-21T08:04:08.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.060+0000 7f3bfc016640 1 -- start start 2024-09-21T08:04:08.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.060+0000 7f3bfc016640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3bf406dbf0 0x7f3bf411bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:08.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.060+0000 7f3bfc016640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bf406e540 0x7f3bf411c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:08.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.060+0000 7f3bfc016640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf411d280 con 0x7f3bf406e540 2024-09-21T08:04:08.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.060+0000 7f3bfc016640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf411d3f0 con 0x7f3bf406dbf0 2024-09-21T08:04:08.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.061+0000 7f3bf9db2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3bf406dbf0 0x7f3bf411bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:08.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.061+0000 7f3bf9db2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3bf406dbf0 0x7f3bf411bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.107:37210/0 (socket says 172.21.15.107:37210) 2024-09-21T08:04:08.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.061+0000 7f3bf9db2640 1 -- 172.21.15.107:0/1005859169 learned_addr learned my addr 172.21.15.107:0/1005859169 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:04:08.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.061+0000 7f3bf95b1640 1 --2- 172.21.15.107:0/1005859169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bf406e540 0x7f3bf411c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:08.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.061+0000 7f3bf9db2640 1 -- 172.21.15.107:0/1005859169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bf406e540 msgr2=0x7f3bf411c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:08.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.061+0000 7f3bf9db2640 1 --2- 172.21.15.107:0/1005859169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bf406e540 0x7f3bf411c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:08.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.061+0000 7f3bf9db2640 1 -- 172.21.15.107:0/1005859169 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec005040 con 0x7f3bf406dbf0 2024-09-21T08:04:08.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.061+0000 7f3bf9db2640 1 --2- 172.21.15.107:0/1005859169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3bf406dbf0 0x7f3bf411bed0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3be800b560 tx=0x7f3be80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:08.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.066+0000 7f3bf27fc640 1 -- 172.21.15.107:0/1005859169 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3be800f6f0 con 0x7f3bf406dbf0 2024-09-21T08:04:08.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.066+0000 7f3bf27fc640 1 -- 172.21.15.107:0/1005859169 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3be800fcf0 con 0x7f3bf406dbf0 2024-09-21T08:04:08.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.066+0000 7f3bfc016640 1 -- 172.21.15.107:0/1005859169 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf411d590 con 0x7f3bf406dbf0 2024-09-21T08:04:08.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.066+0000 7f3bfc016640 1 -- 172.21.15.107:0/1005859169 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf411da80 con 0x7f3bf406dbf0 2024-09-21T08:04:08.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.068+0000 7f3bfc016640 1 -- 172.21.15.107:0/1005859169 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf406d1b0 con 0x7f3bf406dbf0 2024-09-21T08:04:08.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.072+0000 7f3bf27fc640 1 -- 172.21.15.107:0/1005859169 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3be8011e70 con 0x7f3bf406dbf0 2024-09-21T08:04:08.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.072+0000 7f3bf27fc640 1 -- 172.21.15.107:0/1005859169 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 29) v1 ==== 46415+0+0 (secure 0 0 0) 0x7f3be801a420 con 0x7f3bf406dbf0 2024-09-21T08:04:08.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.072+0000 7f3bf27fc640 1 --2- 172.21.15.107:0/1005859169 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3bdc039140 0x7f3bdc03b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:08.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.072+0000 7f3bf27fc640 1 -- 172.21.15.107:0/1005859169 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f3be804dba0 con 0x7f3bf406dbf0 2024-09-21T08:04:08.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.072+0000 7f3bf95b1640 1 --2- 172.21.15.107:0/1005859169 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3bdc039140 0x7f3bdc03b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:08.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.074+0000 7f3bf95b1640 1 --2- 172.21.15.107:0/1005859169 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3bdc039140 0x7f3bdc03b5f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3bec003080 tx=0x7f3bec035040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:08.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.082+0000 7f3bf27fc640 1 -- 172.21.15.107:0/1005859169 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f3be800dd90 con 0x7f3bf406dbf0 2024-09-21T08:04:08.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.374+0000 7f3bfc016640 1 -- 172.21.15.107:0/1005859169 --> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bf411def0 con 0x7f3bdc039140 2024-09-21T08:04:08.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.375+0000 7f3bf27fc640 1 -- 172.21.15.107:0/1005859169 <== mgr.14644 v2:172.21.15.107:6800/695383021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f3bf411def0 con 0x7f3bdc039140 2024-09-21T08:04:08.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.378+0000 7f3bfc016640 1 -- 172.21.15.107:0/1005859169 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3bdc039140 msgr2=0x7f3bdc03b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:08.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.378+0000 7f3bfc016640 1 --2- 172.21.15.107:0/1005859169 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3bdc039140 0x7f3bdc03b5f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3bec003080 tx=0x7f3bec035040 comp rx=0 tx=0).stop 2024-09-21T08:04:08.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.378+0000 7f3bfc016640 1 -- 172.21.15.107:0/1005859169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3bf406dbf0 msgr2=0x7f3bf411bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:08.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.378+0000 7f3bfc016640 1 --2- 172.21.15.107:0/1005859169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3bf406dbf0 0x7f3bf411bed0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3be800b560 tx=0x7f3be80090f0 comp rx=0 tx=0).stop 2024-09-21T08:04:08.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.378+0000 7f3bfc016640 1 -- 172.21.15.107:0/1005859169 shutdown_connections 2024-09-21T08:04:08.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.378+0000 7f3bfc016640 1 --2- 172.21.15.107:0/1005859169 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3bdc039140 0x7f3bdc03b5f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:08.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.378+0000 7f3bfc016640 1 --2- 172.21.15.107:0/1005859169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bf406e540 0x7f3bf411c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:08.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.378+0000 7f3bfc016640 1 --2- 172.21.15.107:0/1005859169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3bf406dbf0 0x7f3bf411bed0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:08.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.378+0000 7f3bfc016640 1 -- 172.21.15.107:0/1005859169 >> 172.21.15.107:0/1005859169 conn(0x7f3bf4069560 msgr2=0x7f3bf4106810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:08.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.378+0000 7f3bfc016640 1 -- 172.21.15.107:0/1005859169 shutdown_connections 2024-09-21T08:04:08.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.378+0000 7f3bfc016640 1 -- 172.21.15.107:0/1005859169 wait complete. 2024-09-21T08:04:08.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.481+0000 7fcf1334f640 1 -- 172.21.15.107:0/3527006099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf0c0ff690 msgr2=0x7fcf0c101a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:08.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.481+0000 7fcf1334f640 1 --2- 172.21.15.107:0/3527006099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf0c0ff690 0x7fcf0c101a70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcefc0048d0 tx=0x7fcefc009da0 comp rx=0 tx=0).stop 2024-09-21T08:04:08.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.481+0000 7fcf1334f640 1 -- 172.21.15.107:0/3527006099 shutdown_connections 2024-09-21T08:04:08.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.481+0000 7fcf1334f640 1 --2- 172.21.15.107:0/3527006099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf0c0ff690 0x7fcf0c101a70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:08.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.481+0000 7fcf1334f640 1 --2- 172.21.15.107:0/3527006099 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcf0c065be0 0x7fcf0c0ff150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:08.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.481+0000 7fcf1334f640 1 -- 172.21.15.107:0/3527006099 >> 172.21.15.107:0/3527006099 conn(0x7fcf0c0f6b80 msgr2=0x7fcf0c0f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:08.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.482+0000 7fcf1334f640 1 -- 172.21.15.107:0/3527006099 shutdown_connections 2024-09-21T08:04:08.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.482+0000 7fcf1334f640 1 -- 172.21.15.107:0/3527006099 wait complete. 2024-09-21T08:04:08.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.482+0000 7fcf1334f640 1 Processor -- start 2024-09-21T08:04:08.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.482+0000 7fcf1334f640 1 -- start start 2024-09-21T08:04:08.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.482+0000 7fcf1334f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf0c065be0 0x7fcf0c10d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:08.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.482+0000 7fcf1334f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcf0c0ff690 0x7fcf0c10d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:08.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.482+0000 7fcf1334f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c10dbc0 con 0x7fcf0c065be0 2024-09-21T08:04:08.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.482+0000 7fcf1334f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c10e3e0 con 0x7fcf0c0ff690 2024-09-21T08:04:08.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.483+0000 7fcf110eb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf0c065be0 0x7fcf0c10d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:08.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.483+0000 7fcf110eb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf0c065be0 0x7fcf0c10d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42036/0 (socket says 172.21.15.107:42036) 2024-09-21T08:04:08.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.483+0000 7fcf110eb640 1 -- 172.21.15.107:0/3284587000 learned_addr learned my addr 172.21.15.107:0/3284587000 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:04:08.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.483+0000 7fcf108ea640 1 --2- 172.21.15.107:0/3284587000 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcf0c0ff690 0x7fcf0c10d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:08.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.483+0000 7fcf110eb640 1 -- 172.21.15.107:0/3284587000 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcf0c0ff690 msgr2=0x7fcf0c10d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:08.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.483+0000 7fcf110eb640 1 --2- 172.21.15.107:0/3284587000 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcf0c0ff690 0x7fcf0c10d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:08.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.483+0000 7fcf110eb640 1 -- 172.21.15.107:0/3284587000 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc005040 con 0x7fcf0c065be0 2024-09-21T08:04:08.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.483+0000 7fcf110eb640 1 --2- 172.21.15.107:0/3284587000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf0c065be0 0x7fcf0c10d030 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcf08002840 tx=0x7fcf08004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:08.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.483+0000 7fcf01ffb640 1 -- 172.21.15.107:0/3284587000 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf08007c30 con 0x7fcf0c065be0 2024-09-21T08:04:08.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.483+0000 7fcf01ffb640 1 -- 172.21.15.107:0/3284587000 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcf0800f040 con 0x7fcf0c065be0 2024-09-21T08:04:08.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.483+0000 7fcf1334f640 1 -- 172.21.15.107:0/3284587000 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0c10e670 con 0x7fcf0c065be0 2024-09-21T08:04:08.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.483+0000 7fcf01ffb640 1 -- 172.21.15.107:0/3284587000 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf08009510 con 0x7fcf0c065be0 2024-09-21T08:04:08.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.484+0000 7fcf1334f640 1 -- 172.21.15.107:0/3284587000 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0c10ec10 con 0x7fcf0c065be0 2024-09-21T08:04:08.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.485+0000 7fcf01ffb640 1 -- 172.21.15.107:0/3284587000 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 29) v1 ==== 46415+0+0 (secure 0 0 0) 0x7fcf08009670 con 0x7fcf0c065be0 2024-09-21T08:04:08.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.485+0000 7fcf01ffb640 1 --2- 172.21.15.107:0/3284587000 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fcef8039040 0x7fcef803b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:08.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.485+0000 7fcf01ffb640 1 -- 172.21.15.107:0/3284587000 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fcf0804cdf0 con 0x7fcf0c065be0 2024-09-21T08:04:08.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.485+0000 7fcf108ea640 1 --2- 172.21.15.107:0/3284587000 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fcef8039040 0x7fcef803b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:08.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.485+0000 7fcf1334f640 1 -- 172.21.15.107:0/3284587000 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf0c05ed70 con 0x7fcf0c065be0 2024-09-21T08:04:08.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.486+0000 7fcf108ea640 1 --2- 172.21.15.107:0/3284587000 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fcef8039040 0x7fcef803b4f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcefc003080 tx=0x7fcefc009da0 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:08.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.490+0000 7fcf01ffb640 1 -- 172.21.15.107:0/3284587000 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fcf080118e0 con 0x7fcf0c065be0 2024-09-21T08:04:08.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.740+0000 7fcf1334f640 1 -- 172.21.15.107:0/3284587000 --> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf0c10ef90 con 0x7fcef8039040 2024-09-21T08:04:08.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.749+0000 7fcf01ffb640 1 -- 172.21.15.107:0/3284587000 <== mgr.14644 v2:172.21.15.107:6800/695383021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fcf0c10ef90 con 0x7fcef8039040 2024-09-21T08:04:08.751 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:04:08.751 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (63s) 10s ago 9m 17.9M - 0.25.0 c8568f914cd2 2b499aa3b7de 2024-09-21T08:04:08.751 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (9m) 10s ago 9m 6899k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 4557b307c7dd 2024-09-21T08:04:08.751 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (8m) 22s ago 8m 6895k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be e74e9385abdf 2024-09-21T08:04:08.751 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (58s) 10s ago 9m 82.5M - 9.4.7 954c08fa6188 84ee0e853c1f 2024-09-21T08:04:08.751 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (3m) 10s ago 3m 257M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 3bc779f88228 2024-09-21T08:04:08.751 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (4m) 10s ago 4m 12.4M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be ea8f140aade7 2024-09-21T08:04:08.751 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (3m) 22s ago 3m 15.5M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 329346c3afec 2024-09-21T08:04:08.751 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (3m) 22s ago 3m 17.2M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be baf87f32bfbc 2024-09-21T08:04:08.752 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:8443,9283,8765 running (26s) 10s ago 10m 63.9M - 19.1.1-367-g9e2ac70b cc9251b744a3 49c237734f07 2024-09-21T08:04:08.754 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283 running (2m) 22s ago 8m 500M - 19.1.1-367-g9e2ac70b cc9251b744a3 303933eb1c8b 2024-09-21T08:04:08.754 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (10m) 10s ago 10m 45.3M 2048M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7702e48722c8 2024-09-21T08:04:08.754 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (8m) 22s ago 8m 42.4M 2048M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be d9680c5a5b92 2024-09-21T08:04:08.754 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 running (72s) 10s ago 9m 17.1M - 1.5.0 0da6a335fe13 6de7c307ba0f 2024-09-21T08:04:08.754 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (48s) 22s ago 8m 8522k - 1.5.0 0da6a335fe13 cb6d4577b24c 2024-09-21T08:04:08.754 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (7m) 10s ago 7m 213M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 6799bdf55207 2024-09-21T08:04:08.754 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (7m) 10s ago 7m 234M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 29d8ce3f3a52 2024-09-21T08:04:08.754 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (6m) 10s ago 6m 188M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be c9e1c4756c02 2024-09-21T08:04:08.754 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (6m) 22s ago 6m 257M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7d58f70b105c 2024-09-21T08:04:08.754 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (5m) 22s ago 5m 225M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 2f916ef76d22 2024-09-21T08:04:08.754 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (5m) 22s ago 5m 212M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 0f25d9454304 2024-09-21T08:04:08.754 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (51s) 10s ago 8m 49.7M - 2.43.0 a07b618ecd1d 6c8d6c7c2780 2024-09-21T08:04:08.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.751+0000 7fcf1334f640 1 -- 172.21.15.107:0/3284587000 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fcef8039040 msgr2=0x7fcef803b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:08.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.751+0000 7fcf1334f640 1 --2- 172.21.15.107:0/3284587000 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fcef8039040 0x7fcef803b4f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcefc003080 tx=0x7fcefc009da0 comp rx=0 tx=0).stop 2024-09-21T08:04:08.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.751+0000 7fcf1334f640 1 -- 172.21.15.107:0/3284587000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf0c065be0 msgr2=0x7fcf0c10d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:08.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.751+0000 7fcf1334f640 1 --2- 172.21.15.107:0/3284587000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf0c065be0 0x7fcf0c10d030 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcf08002840 tx=0x7fcf08004570 comp rx=0 tx=0).stop 2024-09-21T08:04:08.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.752+0000 7fcf1334f640 1 -- 172.21.15.107:0/3284587000 shutdown_connections 2024-09-21T08:04:08.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.752+0000 7fcf1334f640 1 --2- 172.21.15.107:0/3284587000 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fcef8039040 0x7fcef803b4f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:08.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.752+0000 7fcf1334f640 1 --2- 172.21.15.107:0/3284587000 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcf0c0ff690 0x7fcf0c10d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:08.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.752+0000 7fcf1334f640 1 --2- 172.21.15.107:0/3284587000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf0c065be0 0x7fcf0c10d030 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:08.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.752+0000 7fcf1334f640 1 -- 172.21.15.107:0/3284587000 >> 172.21.15.107:0/3284587000 conn(0x7fcf0c0f6b80 msgr2=0x7fcf0c0f6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:08.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.752+0000 7fcf1334f640 1 -- 172.21.15.107:0/3284587000 shutdown_connections 2024-09-21T08:04:08.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.752+0000 7fcf1334f640 1 -- 172.21.15.107:0/3284587000 wait complete. 2024-09-21T08:04:08.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.838+0000 7f75833ca640 1 -- 172.21.15.107:0/2560680237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f757c0fdb70 msgr2=0x7f757c0fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:08.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.838+0000 7f75833ca640 1 --2- 172.21.15.107:0/2560680237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f757c0fdb70 0x7f757c0fdf80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f75780048d0 tx=0x7f7578009da0 comp rx=0 tx=0).stop 2024-09-21T08:04:08.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.838+0000 7f75833ca640 1 -- 172.21.15.107:0/2560680237 shutdown_connections 2024-09-21T08:04:08.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.838+0000 7f75833ca640 1 --2- 172.21.15.107:0/2560680237 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f757c0fe4c0 0x7f757c0fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:08.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.838+0000 7f75833ca640 1 --2- 172.21.15.107:0/2560680237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f757c0fdb70 0x7f757c0fdf80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:08.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.838+0000 7f75833ca640 1 -- 172.21.15.107:0/2560680237 >> 172.21.15.107:0/2560680237 conn(0x7f757c0f6390 msgr2=0x7f757c0f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:08.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.838+0000 7f75833ca640 1 -- 172.21.15.107:0/2560680237 shutdown_connections 2024-09-21T08:04:08.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.838+0000 7f75833ca640 1 -- 172.21.15.107:0/2560680237 wait complete. 2024-09-21T08:04:08.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.838+0000 7f75833ca640 1 Processor -- start 2024-09-21T08:04:08.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.838+0000 7f75833ca640 1 -- start start 2024-09-21T08:04:08.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.839+0000 7f75833ca640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f757c0fdb70 0x7f757c10d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:08.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.839+0000 7f75833ca640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f757c0fe4c0 0x7f757c10d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:08.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.839+0000 7f75833ca640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c10dc00 con 0x7f757c0fe4c0 2024-09-21T08:04:08.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.839+0000 7f75833ca640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c10e420 con 0x7f757c0fdb70 2024-09-21T08:04:08.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.839+0000 7f7580965640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f757c0fe4c0 0x7f757c10d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:08.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.839+0000 7f7580965640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f757c0fe4c0 0x7f757c10d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42066/0 (socket says 172.21.15.107:42066) 2024-09-21T08:04:08.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.839+0000 7f7580965640 1 -- 172.21.15.107:0/536920473 learned_addr learned my addr 172.21.15.107:0/536920473 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:04:08.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.839+0000 7f7581166640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f757c0fdb70 0x7f757c10d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:08.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.839+0000 7f7580965640 1 -- 172.21.15.107:0/536920473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f757c0fdb70 msgr2=0x7f757c10d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:08.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.839+0000 7f7580965640 1 --2- 172.21.15.107:0/536920473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f757c0fdb70 0x7f757c10d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:08.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.839+0000 7f7580965640 1 -- 172.21.15.107:0/536920473 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7578005040 con 0x7f757c0fe4c0 2024-09-21T08:04:08.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.839+0000 7f7581166640 1 --2- 172.21.15.107:0/536920473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f757c0fdb70 0x7f757c10d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:04:08.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.840+0000 7f7580965640 1 --2- 172.21.15.107:0/536920473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f757c0fe4c0 0x7f757c10d5b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f756c002840 tx=0x7f756c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:08.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.840+0000 7f7571ffb640 1 -- 172.21.15.107:0/536920473 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f756c007c30 con 0x7f757c0fe4c0 2024-09-21T08:04:08.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.840+0000 7f7571ffb640 1 -- 172.21.15.107:0/536920473 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f756c00f040 con 0x7f757c0fe4c0 2024-09-21T08:04:08.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.840+0000 7f75833ca640 1 -- 172.21.15.107:0/536920473 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757c10e6b0 con 0x7f757c0fe4c0 2024-09-21T08:04:08.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.840+0000 7f7571ffb640 1 -- 172.21.15.107:0/536920473 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f756c009470 con 0x7f757c0fe4c0 2024-09-21T08:04:08.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.840+0000 7f75833ca640 1 -- 172.21.15.107:0/536920473 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757c10ec50 con 0x7f757c0fe4c0 2024-09-21T08:04:08.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.841+0000 7f7571ffb640 1 -- 172.21.15.107:0/536920473 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 29) v1 ==== 46415+0+0 (secure 0 0 0) 0x7f756c009690 con 0x7f757c0fe4c0 2024-09-21T08:04:08.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.841+0000 7f7571ffb640 1 --2- 172.21.15.107:0/536920473 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f7568039030 0x7f756803b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:08.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.841+0000 7f7571ffb640 1 -- 172.21.15.107:0/536920473 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f756c04c4a0 con 0x7f757c0fe4c0 2024-09-21T08:04:08.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.841+0000 7f7581166640 1 --2- 172.21.15.107:0/536920473 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f7568039030 0x7f756803b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:08.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.842+0000 7f75833ca640 1 -- 172.21.15.107:0/536920473 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757c0fa010 con 0x7f757c0fe4c0 2024-09-21T08:04:08.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.842+0000 7f7581166640 1 --2- 172.21.15.107:0/536920473 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f7568039030 0x7f756803b4e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7578000c00 tx=0x7f7578035040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:08.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:08.846+0000 7f7571ffb640 1 -- 172.21.15.107:0/536920473 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f756c051060 con 0x7f757c0fe4c0 2024-09-21T08:04:08.913 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:08 smithi107 ceph-mon[27622]: mgrmap e29: smithi107.wzulxb(active, since 1.01029s) 2024-09-21T08:04:08.914 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:08 smithi107 ceph-mon[27622]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:04:08.914 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:08 smithi107 ceph-mon[27622]: pgmap v3: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:09.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:08 smithi129 ceph-mon[34472]: mgrmap e29: smithi107.wzulxb(active, since 1.01029s) 2024-09-21T08:04:09.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:08 smithi129 ceph-mon[34472]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:04:09.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:08 smithi129 ceph-mon[34472]: pgmap v3: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:09.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.185+0000 7f75833ca640 1 -- 172.21.15.107:0/536920473 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f757c104f60 con 0x7f757c0fe4c0 2024-09-21T08:04:09.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.185+0000 7f7571ffb640 1 -- 172.21.15.107:0/536920473 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f756c0118e0 con 0x7f757c0fe4c0 2024-09-21T08:04:09.187 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:04:09.187 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": { 2024-09-21T08:04:09.187 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 2 2024-09-21T08:04:09.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:04:09.187 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": { 2024-09-21T08:04:09.187 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 1 2024-09-21T08:04:09.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:04:09.188 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": { 2024-09-21T08:04:09.188 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 6 2024-09-21T08:04:09.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:04:09.188 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-21T08:04:09.188 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 4 2024-09-21T08:04:09.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:04:09.188 INFO:teuthology.orchestra.run.smithi107.stdout: "overall": { 2024-09-21T08:04:09.188 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 12, 2024-09-21T08:04:09.188 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 1 2024-09-21T08:04:09.188 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-21T08:04:09.188 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:04:09.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.189+0000 7f75833ca640 1 -- 172.21.15.107:0/536920473 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f7568039030 msgr2=0x7f756803b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:09.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.189+0000 7f75833ca640 1 --2- 172.21.15.107:0/536920473 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f7568039030 0x7f756803b4e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7578000c00 tx=0x7f7578035040 comp rx=0 tx=0).stop 2024-09-21T08:04:09.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.189+0000 7f75833ca640 1 -- 172.21.15.107:0/536920473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f757c0fe4c0 msgr2=0x7f757c10d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:09.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.189+0000 7f75833ca640 1 --2- 172.21.15.107:0/536920473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f757c0fe4c0 0x7f757c10d5b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f756c002840 tx=0x7f756c004570 comp rx=0 tx=0).stop 2024-09-21T08:04:09.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.189+0000 7f75833ca640 1 -- 172.21.15.107:0/536920473 shutdown_connections 2024-09-21T08:04:09.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.189+0000 7f75833ca640 1 --2- 172.21.15.107:0/536920473 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f7568039030 0x7f756803b4e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:09.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.189+0000 7f75833ca640 1 --2- 172.21.15.107:0/536920473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f757c0fe4c0 0x7f757c10d5b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:09.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.189+0000 7f75833ca640 1 --2- 172.21.15.107:0/536920473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f757c0fdb70 0x7f757c10d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:09.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.189+0000 7f75833ca640 1 -- 172.21.15.107:0/536920473 >> 172.21.15.107:0/536920473 conn(0x7f757c0f6390 msgr2=0x7f757c0f7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:09.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.189+0000 7f75833ca640 1 -- 172.21.15.107:0/536920473 shutdown_connections 2024-09-21T08:04:09.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.189+0000 7f75833ca640 1 -- 172.21.15.107:0/536920473 wait complete. 2024-09-21T08:04:09.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.285+0000 7fecc6f76640 1 -- 172.21.15.107:0/3784084946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecc00ff740 msgr2=0x7fecc0101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:09.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.285+0000 7fecc6f76640 1 --2- 172.21.15.107:0/3784084946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecc00ff740 0x7fecc0101b20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fecac0048d0 tx=0x7fecac009da0 comp rx=0 tx=0).stop 2024-09-21T08:04:09.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.285+0000 7fecc6f76640 1 -- 172.21.15.107:0/3784084946 shutdown_connections 2024-09-21T08:04:09.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.285+0000 7fecc6f76640 1 --2- 172.21.15.107:0/3784084946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecc00ff740 0x7fecc0101b20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:09.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.285+0000 7fecc6f76640 1 --2- 172.21.15.107:0/3784084946 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fecc0065b80 0x7fecc00ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:09.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.285+0000 7fecc6f76640 1 -- 172.21.15.107:0/3784084946 >> 172.21.15.107:0/3784084946 conn(0x7fecc00f6c10 msgr2=0x7fecc00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:09.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.285+0000 7fecc6f76640 1 -- 172.21.15.107:0/3784084946 shutdown_connections 2024-09-21T08:04:09.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.285+0000 7fecc6f76640 1 -- 172.21.15.107:0/3784084946 wait complete. 2024-09-21T08:04:09.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.286+0000 7fecc6f76640 1 Processor -- start 2024-09-21T08:04:09.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.286+0000 7fecc6f76640 1 -- start start 2024-09-21T08:04:09.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.286+0000 7fecc6f76640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecc0065b80 0x7fecc010d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:09.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.286+0000 7fecc6f76640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fecc00ff740 0x7fecc010d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:09.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.286+0000 7fecc6f76640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc010e490 con 0x7fecc0065b80 2024-09-21T08:04:09.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.286+0000 7fecc6f76640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc010e600 con 0x7fecc00ff740 2024-09-21T08:04:09.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.286+0000 7fecc4d12640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecc0065b80 0x7fecc010d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:09.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.286+0000 7fecc4d12640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecc0065b80 0x7fecc010d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42082/0 (socket says 172.21.15.107:42082) 2024-09-21T08:04:09.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.286+0000 7fecc4d12640 1 -- 172.21.15.107:0/3321014003 learned_addr learned my addr 172.21.15.107:0/3321014003 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:04:09.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.286+0000 7fecbffff640 1 --2- 172.21.15.107:0/3321014003 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fecc00ff740 0x7fecc010d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:09.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.287+0000 7fecc4d12640 1 -- 172.21.15.107:0/3321014003 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fecc00ff740 msgr2=0x7fecc010d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:09.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.287+0000 7fecc4d12640 1 --2- 172.21.15.107:0/3321014003 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fecc00ff740 0x7fecc010d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:09.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.287+0000 7fecc4d12640 1 -- 172.21.15.107:0/3321014003 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecac005040 con 0x7fecc0065b80 2024-09-21T08:04:09.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.287+0000 7fecc4d12640 1 --2- 172.21.15.107:0/3321014003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecc0065b80 0x7fecc010d130 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fecb400b580 tx=0x7fecb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:09.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.287+0000 7fecbd7fa640 1 -- 172.21.15.107:0/3321014003 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecb400f6f0 con 0x7fecc0065b80 2024-09-21T08:04:09.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.287+0000 7fecc6f76640 1 -- 172.21.15.107:0/3321014003 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc010e880 con 0x7fecc0065b80 2024-09-21T08:04:09.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.287+0000 7fecbd7fa640 1 -- 172.21.15.107:0/3321014003 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fecb400fcf0 con 0x7fecc0065b80 2024-09-21T08:04:09.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.287+0000 7fecbd7fa640 1 -- 172.21.15.107:0/3321014003 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecb40103a0 con 0x7fecc0065b80 2024-09-21T08:04:09.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.287+0000 7fecc6f76640 1 -- 172.21.15.107:0/3321014003 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc010eda0 con 0x7fecc0065b80 2024-09-21T08:04:09.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.288+0000 7fecc6f76640 1 -- 172.21.15.107:0/3321014003 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc01057e0 con 0x7fecc0065b80 2024-09-21T08:04:09.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.288+0000 7fecbd7fa640 1 -- 172.21.15.107:0/3321014003 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 29) v1 ==== 46415+0+0 (secure 0 0 0) 0x7fecb4010500 con 0x7fecc0065b80 2024-09-21T08:04:09.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.289+0000 7fecbd7fa640 1 --2- 172.21.15.107:0/3321014003 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fecb0039030 0x7fecb003b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:09.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.289+0000 7fecbd7fa640 1 -- 172.21.15.107:0/3321014003 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fecb404ccc0 con 0x7fecc0065b80 2024-09-21T08:04:09.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.289+0000 7fecbffff640 1 --2- 172.21.15.107:0/3321014003 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fecb0039030 0x7fecb003b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:09.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.289+0000 7fecbffff640 1 --2- 172.21.15.107:0/3321014003 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fecb0039030 0x7fecb003b4e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fecc010cee0 tx=0x7fecac035040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:09.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.296+0000 7fecbd7fa640 1 -- 172.21.15.107:0/3321014003 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fecb400d470 con 0x7fecc0065b80 2024-09-21T08:04:09.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.544+0000 7fecc6f76640 1 -- 172.21.15.107:0/3321014003 --> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fecc010f0e0 con 0x7fecb0039030 2024-09-21T08:04:09.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.545+0000 7fecbd7fa640 1 -- 172.21.15.107:0/3321014003 <== mgr.14644 v2:172.21.15.107:6800/695383021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fecc010f0e0 con 0x7fecb0039030 2024-09-21T08:04:09.546 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:04:09.547 INFO:teuthology.orchestra.run.smithi107.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5", 2024-09-21T08:04:09.547 INFO:teuthology.orchestra.run.smithi107.stdout: "in_progress": true, 2024-09-21T08:04:09.547 INFO:teuthology.orchestra.run.smithi107.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T08:04:09.547 INFO:teuthology.orchestra.run.smithi107.stdout: "services_complete": [ 2024-09-21T08:04:09.547 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr" 2024-09-21T08:04:09.547 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-21T08:04:09.547 INFO:teuthology.orchestra.run.smithi107.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T08:04:09.547 INFO:teuthology.orchestra.run.smithi107.stdout: "message": "", 2024-09-21T08:04:09.547 INFO:teuthology.orchestra.run.smithi107.stdout: "is_paused": false 2024-09-21T08:04:09.547 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:04:09.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.547+0000 7fecc6f76640 1 -- 172.21.15.107:0/3321014003 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fecb0039030 msgr2=0x7fecb003b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:09.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.547+0000 7fecc6f76640 1 --2- 172.21.15.107:0/3321014003 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fecb0039030 0x7fecb003b4e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fecc010cee0 tx=0x7fecac035040 comp rx=0 tx=0).stop 2024-09-21T08:04:09.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.547+0000 7fecc6f76640 1 -- 172.21.15.107:0/3321014003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecc0065b80 msgr2=0x7fecc010d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:09.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.547+0000 7fecc6f76640 1 --2- 172.21.15.107:0/3321014003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecc0065b80 0x7fecc010d130 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fecb400b580 tx=0x7fecb40091a0 comp rx=0 tx=0).stop 2024-09-21T08:04:09.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.547+0000 7fecc6f76640 1 -- 172.21.15.107:0/3321014003 shutdown_connections 2024-09-21T08:04:09.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.547+0000 7fecc6f76640 1 --2- 172.21.15.107:0/3321014003 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fecb0039030 0x7fecb003b4e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:09.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.547+0000 7fecc6f76640 1 --2- 172.21.15.107:0/3321014003 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fecc00ff740 0x7fecc010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:09.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.547+0000 7fecc6f76640 1 --2- 172.21.15.107:0/3321014003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecc0065b80 0x7fecc010d130 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:09.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.547+0000 7fecc6f76640 1 -- 172.21.15.107:0/3321014003 >> 172.21.15.107:0/3321014003 conn(0x7fecc00f6c10 msgr2=0x7fecc00f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:09.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.548+0000 7fecc6f76640 1 -- 172.21.15.107:0/3321014003 shutdown_connections 2024-09-21T08:04:09.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:09.548+0000 7fecc6f76640 1 -- 172.21.15.107:0/3321014003 wait complete. 2024-09-21T08:04:10.057 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:09 smithi107 ceph-mon[27622]: [21/Sep/2024:08:04:08] ENGINE Bus STARTING 2024-09-21T08:04:10.057 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:09 smithi107 ceph-mon[27622]: [21/Sep/2024:08:04:08] ENGINE Serving on https://172.21.15.107:7150 2024-09-21T08:04:10.057 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:09 smithi107 ceph-mon[27622]: pgmap v4: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:10.057 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:09 smithi107 ceph-mon[27622]: [21/Sep/2024:08:04:08] ENGINE Error in HTTPServer.serve 2024-09-21T08:04:10.057 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Traceback (most recent call last): 2024-09-21T08:04:10.058 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T08:04:10.058 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._connections.run(self.expiration_interval) 2024-09-21T08:04:10.058 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T08:04:10.058 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._run(expiration_interval) 2024-09-21T08:04:10.058 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T08:04:10.058 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T08:04:10.058 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T08:04:10.058 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T08:04:10.058 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T08:04:10.058 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: s = self.context.wrap_socket( 2024-09-21T08:04:10.058 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T08:04:10.058 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: return self.sslsocket_class._create( 2024-09-21T08:04:10.058 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T08:04:10.059 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self.do_handshake() 2024-09-21T08:04:10.059 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T08:04:10.059 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._sslobj.do_handshake() 2024-09-21T08:04:10.059 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T08:04:10.059 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:09 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/536920473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:10.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:09 smithi129 ceph-mon[34472]: [21/Sep/2024:08:04:08] ENGINE Bus STARTING 2024-09-21T08:04:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:09 smithi129 ceph-mon[34472]: [21/Sep/2024:08:04:08] ENGINE Serving on https://172.21.15.107:7150 2024-09-21T08:04:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:09 smithi129 ceph-mon[34472]: pgmap v4: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:09 smithi129 ceph-mon[34472]: [21/Sep/2024:08:04:08] ENGINE Error in HTTPServer.serve 2024-09-21T08:04:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Traceback (most recent call last): 2024-09-21T08:04:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T08:04:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: self._connections.run(self.expiration_interval) 2024-09-21T08:04:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T08:04:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: self._run(expiration_interval) 2024-09-21T08:04:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T08:04:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T08:04:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T08:04:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T08:04:10.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T08:04:10.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: s = self.context.wrap_socket( 2024-09-21T08:04:10.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T08:04:10.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: return self.sslsocket_class._create( 2024-09-21T08:04:10.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T08:04:10.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: self.do_handshake() 2024-09-21T08:04:10.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T08:04:10.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: self._sslobj.do_handshake() 2024-09-21T08:04:10.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T08:04:10.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:09 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/536920473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:11.239 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:10 smithi129 ceph-mon[34472]: [21/Sep/2024:08:04:09] ENGINE Serving on http://172.21.15.107:8765 2024-09-21T08:04:11.239 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:10 smithi129 ceph-mon[34472]: [21/Sep/2024:08:04:09] ENGINE Bus STARTED 2024-09-21T08:04:11.239 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:10 smithi129 ceph-mon[34472]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:04:11.239 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:10 smithi129 ceph-mon[34472]: mgrmap e30: smithi107.wzulxb(active, since 3s) 2024-09-21T08:04:11.239 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:10 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:11.239 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:10 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:11.273 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:10 smithi107 ceph-mon[27622]: [21/Sep/2024:08:04:09] ENGINE Serving on http://172.21.15.107:8765 2024-09-21T08:04:11.273 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:10 smithi107 ceph-mon[27622]: [21/Sep/2024:08:04:09] ENGINE Bus STARTED 2024-09-21T08:04:11.273 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:10 smithi107 ceph-mon[27622]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:04:11.274 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:10 smithi107 ceph-mon[27622]: mgrmap e30: smithi107.wzulxb(active, since 3s) 2024-09-21T08:04:11.274 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:10 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:11.274 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:10 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:12.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:11 smithi129 ceph-mon[34472]: pgmap v5: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:12.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:11 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:12.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:11 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:12.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:11 smithi107 ceph-mon[27622]: pgmap v5: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:12.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:11 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:12.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:11 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:13.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:12 smithi129 ceph-mon[34472]: Standby manager daemon smithi129.wvlmvo started 2024-09-21T08:04:13.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:12 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.129:0/910377295' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi129.wvlmvo/crt"}]: dispatch 2024-09-21T08:04:13.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:12 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.129:0/910377295' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T08:04:13.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:12 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.129:0/910377295' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi129.wvlmvo/key"}]: dispatch 2024-09-21T08:04:13.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:12 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.129:0/910377295' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T08:04:13.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:12 smithi107 ceph-mon[27622]: Standby manager daemon smithi129.wvlmvo started 2024-09-21T08:04:13.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:12 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.129:0/910377295' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi129.wvlmvo/crt"}]: dispatch 2024-09-21T08:04:13.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:12 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.129:0/910377295' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T08:04:13.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:12 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.129:0/910377295' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi129.wvlmvo/key"}]: dispatch 2024-09-21T08:04:13.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:12 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.129:0/910377295' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T08:04:14.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:13 smithi129 ceph-mon[34472]: pgmap v6: 65 pgs: 65 active+clean; 246 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 423 KiB/s wr, 94 op/s 2024-09-21T08:04:14.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:13 smithi129 ceph-mon[34472]: mgrmap e31: smithi107.wzulxb(active, since 6s), standbys: smithi129.wvlmvo 2024-09-21T08:04:14.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:13 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr metadata", "who": "smithi129.wvlmvo", "id": "smithi129.wvlmvo"}]: dispatch 2024-09-21T08:04:14.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:13 smithi107 ceph-mon[27622]: pgmap v6: 65 pgs: 65 active+clean; 246 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 423 KiB/s wr, 94 op/s 2024-09-21T08:04:14.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:13 smithi107 ceph-mon[27622]: mgrmap e31: smithi107.wzulxb(active, since 6s), standbys: smithi129.wvlmvo 2024-09-21T08:04:14.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:13 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr metadata", "who": "smithi129.wvlmvo", "id": "smithi129.wvlmvo"}]: dispatch 2024-09-21T08:04:16.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:15 smithi129 ceph-mon[34472]: pgmap v7: 65 pgs: 65 active+clean; 227 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.1 MiB/s wr, 439 op/s 2024-09-21T08:04:16.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:15 smithi107 ceph-mon[27622]: pgmap v7: 65 pgs: 65 active+clean; 227 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.1 MiB/s wr, 439 op/s 2024-09-21T08:04:16.651 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-21T08:04:16.651 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T08:04:16.954 DEBUG:teuthology.parallel:result is None 2024-09-21T08:04:16.954 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T08:04:16.985 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T08:04:16.985 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-21T08:04:17.015 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-21T08:04:17.016 DEBUG:teuthology.parallel:result is None 2024-09-21T08:04:17.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:17 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:17.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:17 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:17.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:17 smithi129 ceph-mon[34472]: pgmap v8: 65 pgs: 65 active+clean; 227 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 886 KiB/s wr, 341 op/s 2024-09-21T08:04:17.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:17 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:17.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:17 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:17.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:17 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:17.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:17 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:17.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:17 smithi107 ceph-mon[27622]: pgmap v8: 65 pgs: 65 active+clean; 227 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 886 KiB/s wr, 341 op/s 2024-09-21T08:04:17.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:17 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:17.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:17 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:20.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:19 smithi129 ceph-mon[34472]: pgmap v9: 65 pgs: 65 active+clean; 215 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 1.3 MiB/s wr, 458 op/s 2024-09-21T08:04:20.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:19 smithi107 ceph-mon[27622]: pgmap v9: 65 pgs: 65 active+clean; 215 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 1.3 MiB/s wr, 458 op/s 2024-09-21T08:04:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:21 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:21 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:21 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:04:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:21 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:04:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:21 smithi129 ceph-mon[34472]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-21T08:04:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:21 smithi129 ceph-mon[34472]: Updating smithi129:/etc/ceph/ceph.conf 2024-09-21T08:04:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:21 smithi129 ceph-mon[34472]: pgmap v10: 65 pgs: 65 active+clean; 215 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.2 MiB/s wr, 419 op/s 2024-09-21T08:04:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:21 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:21 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:21 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:21 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:21 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:22.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:21 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:22.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:21 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:22.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:21 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:04:22.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:21 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:04:22.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:21 smithi107 ceph-mon[27622]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-21T08:04:22.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:21 smithi107 ceph-mon[27622]: Updating smithi129:/etc/ceph/ceph.conf 2024-09-21T08:04:22.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:21 smithi107 ceph-mon[27622]: pgmap v10: 65 pgs: 65 active+clean; 215 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.2 MiB/s wr, 419 op/s 2024-09-21T08:04:22.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:21 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:22.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:21 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:22.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:21 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:22.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:21 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:22.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:21 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:22.942 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:22 smithi107 ceph-mon[27622]: Updating smithi107:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T08:04:22.943 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:22 smithi107 ceph-mon[27622]: Updating smithi129:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T08:04:22.943 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:22 smithi107 ceph-mon[27622]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-09-21T08:04:22.943 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:22 smithi107 ceph-mon[27622]: Updating smithi129:/etc/ceph/ceph.client.admin.keyring 2024-09-21T08:04:22.943 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:22 smithi107 ceph-mon[27622]: Updating smithi129:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T08:04:22.943 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:22 smithi107 ceph-mon[27622]: Updating smithi107:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T08:04:22.943 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:22 smithi107 ceph-mon[27622]: Reconfiguring prometheus.smithi107 (dependencies changed)... 2024-09-21T08:04:22.943 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:22 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:04:23.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:22 smithi129 ceph-mon[34472]: Updating smithi107:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T08:04:23.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:22 smithi129 ceph-mon[34472]: Updating smithi129:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T08:04:23.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:22 smithi129 ceph-mon[34472]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-09-21T08:04:23.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:22 smithi129 ceph-mon[34472]: Updating smithi129:/etc/ceph/ceph.client.admin.keyring 2024-09-21T08:04:23.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:22 smithi129 ceph-mon[34472]: Updating smithi129:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T08:04:23.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:22 smithi129 ceph-mon[34472]: Updating smithi107:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T08:04:23.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:22 smithi129 ceph-mon[34472]: Reconfiguring prometheus.smithi107 (dependencies changed)... 2024-09-21T08:04:23.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:22 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:04:24.081 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:23 smithi107 ceph-mon[27622]: Reconfiguring daemon prometheus.smithi107 on smithi107 2024-09-21T08:04:24.081 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:23 smithi107 ceph-mon[27622]: pgmap v11: 65 pgs: 65 active+clean; 215 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.2 MiB/s wr, 420 op/s 2024-09-21T08:04:24.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:23 smithi129 ceph-mon[34472]: Reconfiguring daemon prometheus.smithi107 on smithi107 2024-09-21T08:04:24.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:23 smithi129 ceph-mon[34472]: pgmap v11: 65 pgs: 65 active+clean; 215 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.2 MiB/s wr, 420 op/s 2024-09-21T08:04:26.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:25 smithi129 ceph-mon[34472]: pgmap v12: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.0 MiB/s wr, 388 op/s 2024-09-21T08:04:26.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:25 smithi107 ceph-mon[27622]: pgmap v12: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.0 MiB/s wr, 388 op/s 2024-09-21T08:04:28.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:27 smithi129 ceph-mon[34472]: pgmap v13: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 14 KiB/s rd, 571 KiB/s wr, 172 op/s 2024-09-21T08:04:28.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:27 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:28.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:27 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:28.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:27 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T08:04:28.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:27 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:04:28.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:27 smithi107 ceph-mon[27622]: pgmap v13: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 14 KiB/s rd, 571 KiB/s wr, 172 op/s 2024-09-21T08:04:28.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:27 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:28.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:27 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:28.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:27 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T08:04:28.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:27 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:04:29.255 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:28 smithi129 ceph-mon[34472]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T08:04:29.256 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:28 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi129.wvlmvo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T08:04:29.256 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:28 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T08:04:29.256 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:28 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:04:29.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:28 smithi107 ceph-mon[27622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T08:04:29.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:28 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi129.wvlmvo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T08:04:29.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:28 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T08:04:29.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:28 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:04:30.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:29 smithi129 ceph-mon[34472]: Upgrade: Updating mgr.smithi129.wvlmvo 2024-09-21T08:04:30.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:29 smithi129 ceph-mon[34472]: Deploying daemon mgr.smithi129.wvlmvo on smithi129 2024-09-21T08:04:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:29 smithi129 ceph-mon[34472]: pgmap v14: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 14 KiB/s rd, 575 KiB/s wr, 172 op/s 2024-09-21T08:04:30.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:29 smithi107 ceph-mon[27622]: Upgrade: Updating mgr.smithi129.wvlmvo 2024-09-21T08:04:30.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:29 smithi107 ceph-mon[27622]: Deploying daemon mgr.smithi129.wvlmvo on smithi129 2024-09-21T08:04:30.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:29 smithi107 ceph-mon[27622]: pgmap v14: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 14 KiB/s rd, 575 KiB/s wr, 172 op/s 2024-09-21T08:04:32.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:31 smithi129 ceph-mon[34472]: pgmap v15: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 23 KiB/s wr, 9 op/s 2024-09-21T08:04:32.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:31 smithi107 ceph-mon[27622]: pgmap v15: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 23 KiB/s wr, 9 op/s 2024-09-21T08:04:33.506 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:33 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:33.506 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:33 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:33.506 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:33 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:04:33.506 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:33 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:33.506 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:33 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:33.506 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:33 smithi107 ceph-mon[27622]: pgmap v16: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 23 KiB/s wr, 9 op/s 2024-09-21T08:04:33.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:33 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:33.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:33 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:33.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:33 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:04:33.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:33 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:33.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:33 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:33.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:33 smithi129 ceph-mon[34472]: pgmap v16: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 23 KiB/s wr, 9 op/s 2024-09-21T08:04:36.227 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:35 smithi129 ceph-mon[34472]: pgmap v17: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 23 KiB/s wr, 8 op/s 2024-09-21T08:04:36.227 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:35 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:36.227 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:35 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:36.227 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:35 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:36.227 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:35 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:36.302 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:35 smithi107 ceph-mon[27622]: pgmap v17: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 23 KiB/s wr, 8 op/s 2024-09-21T08:04:36.302 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:35 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:36.302 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:35 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:36.302 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:35 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:36.302 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:35 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:38.200 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:37 smithi129 ceph-mon[34472]: pgmap v18: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.5 KiB/s wr, 0 op/s 2024-09-21T08:04:38.200 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:37 smithi129 ceph-mon[34472]: Standby manager daemon smithi129.wvlmvo restarted 2024-09-21T08:04:38.200 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:37 smithi129 ceph-mon[34472]: Standby manager daemon smithi129.wvlmvo started 2024-09-21T08:04:38.200 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:37 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.129:0/274235125' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi129.wvlmvo/crt"}]: dispatch 2024-09-21T08:04:38.200 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:37 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.129:0/274235125' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T08:04:38.201 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:37 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.129:0/274235125' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi129.wvlmvo/key"}]: dispatch 2024-09-21T08:04:38.201 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:37 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.129:0/274235125' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T08:04:38.201 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:37 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:04:38.201 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:37 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:38.201 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:37 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:38.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:37 smithi107 ceph-mon[27622]: pgmap v18: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.5 KiB/s wr, 0 op/s 2024-09-21T08:04:38.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:37 smithi107 ceph-mon[27622]: Standby manager daemon smithi129.wvlmvo restarted 2024-09-21T08:04:38.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:37 smithi107 ceph-mon[27622]: Standby manager daemon smithi129.wvlmvo started 2024-09-21T08:04:38.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:37 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.129:0/274235125' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi129.wvlmvo/crt"}]: dispatch 2024-09-21T08:04:38.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:37 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.129:0/274235125' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T08:04:38.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:37 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.129:0/274235125' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi129.wvlmvo/key"}]: dispatch 2024-09-21T08:04:38.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:37 smithi107 ceph-mon[27622]: from='mgr.? 172.21.15.129:0/274235125' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T08:04:38.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:37 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:04:38.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:37 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:38.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:37 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:39.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:38 smithi129 ceph-mon[34472]: mgrmap e32: smithi107.wzulxb(active, since 31s), standbys: smithi129.wvlmvo 2024-09-21T08:04:39.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:38 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:39.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:38 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:39.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:38 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:04:39.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:38 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:04:39.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:38 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:38 smithi107 ceph-mon[27622]: mgrmap e32: smithi107.wzulxb(active, since 31s), standbys: smithi129.wvlmvo 2024-09-21T08:04:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:38 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:38 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:38 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:04:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:38 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:04:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:38 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:39.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.636+0000 7f8cd8d9d640 1 -- 172.21.15.107:0/385510744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd40fd660 msgr2=0x7f8cd40fdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:39.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.636+0000 7f8cd8d9d640 1 --2- 172.21.15.107:0/385510744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd40fd660 0x7f8cd40fdad0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80048d0 tx=0x7f8cc8009da0 comp rx=0 tx=0).stop 2024-09-21T08:04:39.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.636+0000 7f8cd8d9d640 1 -- 172.21.15.107:0/385510744 shutdown_connections 2024-09-21T08:04:39.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.636+0000 7f8cd8d9d640 1 --2- 172.21.15.107:0/385510744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd40fd660 0x7f8cd40fdad0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:39.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.636+0000 7f8cd8d9d640 1 --2- 172.21.15.107:0/385510744 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8cd40fc390 0x7f8cd40fc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:39.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.636+0000 7f8cd8d9d640 1 -- 172.21.15.107:0/385510744 >> 172.21.15.107:0/385510744 conn(0x7f8cd40f7b70 msgr2=0x7f8cd40f9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:39.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.637+0000 7f8cd8d9d640 1 -- 172.21.15.107:0/385510744 shutdown_connections 2024-09-21T08:04:39.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.637+0000 7f8cd8d9d640 1 -- 172.21.15.107:0/385510744 wait complete. 2024-09-21T08:04:39.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.637+0000 7f8cd8d9d640 1 Processor -- start 2024-09-21T08:04:39.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.637+0000 7f8cd8d9d640 1 -- start start 2024-09-21T08:04:39.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.637+0000 7f8cd8d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd40fc390 0x7f8cd410cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:39.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.637+0000 7f8cd8d9d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8cd40fd660 0x7f8cd410d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:39.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.637+0000 7f8cd8d9d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd410da70 con 0x7f8cd40fc390 2024-09-21T08:04:39.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.637+0000 7f8cd8d9d640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd410e290 con 0x7f8cd40fd660 2024-09-21T08:04:39.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.638+0000 7f8cd37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd40fc390 0x7f8cd410cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:39.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.638+0000 7f8cd37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd40fc390 0x7f8cd410cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43684/0 (socket says 172.21.15.107:43684) 2024-09-21T08:04:39.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.638+0000 7f8cd37fe640 1 -- 172.21.15.107:0/229561253 learned_addr learned my addr 172.21.15.107:0/229561253 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:04:39.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.638+0000 7f8cd2ffd640 1 --2- 172.21.15.107:0/229561253 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8cd40fd660 0x7f8cd410d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:39.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.638+0000 7f8cd2ffd640 1 -- 172.21.15.107:0/229561253 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd40fc390 msgr2=0x7f8cd410cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:39.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.638+0000 7f8cd2ffd640 1 --2- 172.21.15.107:0/229561253 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd40fc390 0x7f8cd410cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:39.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.638+0000 7f8cd2ffd640 1 -- 172.21.15.107:0/229561253 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc8005040 con 0x7f8cd40fd660 2024-09-21T08:04:39.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.638+0000 7f8cd37fe640 1 --2- 172.21.15.107:0/229561253 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd40fc390 0x7f8cd410cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:04:39.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.638+0000 7f8cd2ffd640 1 --2- 172.21.15.107:0/229561253 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8cd40fd660 0x7f8cd410d420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8cc802a530 tx=0x7f8cc8009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:39.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.638+0000 7f8cbbfff640 1 -- 172.21.15.107:0/229561253 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cc8038070 con 0x7f8cd40fd660 2024-09-21T08:04:39.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.638+0000 7f8cd8d9d640 1 -- 172.21.15.107:0/229561253 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd410e4c0 con 0x7f8cd40fd660 2024-09-21T08:04:39.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.638+0000 7f8cbbfff640 1 -- 172.21.15.107:0/229561253 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8cc802ae90 con 0x7f8cd40fd660 2024-09-21T08:04:39.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.638+0000 7f8cbbfff640 1 -- 172.21.15.107:0/229561253 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cc803e670 con 0x7f8cd40fd660 2024-09-21T08:04:39.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.639+0000 7f8cd8d9d640 1 -- 172.21.15.107:0/229561253 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd410ea60 con 0x7f8cd40fd660 2024-09-21T08:04:39.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.639+0000 7f8cd8d9d640 1 -- 172.21.15.107:0/229561253 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd405ed70 con 0x7f8cd40fd660 2024-09-21T08:04:39.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.640+0000 7f8cbbfff640 1 -- 172.21.15.107:0/229561253 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f8cc8030020 con 0x7f8cd40fd660 2024-09-21T08:04:39.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.641+0000 7f8cbbfff640 1 --2- 172.21.15.107:0/229561253 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f8cbc06df50 0x7f8cbc070400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:39.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.641+0000 7f8cd37fe640 1 --2- 172.21.15.107:0/229561253 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f8cbc06df50 0x7f8cbc070400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:39.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.641+0000 7f8cbbfff640 1 -- 172.21.15.107:0/229561253 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f8cc80ada50 con 0x7f8cd40fd660 2024-09-21T08:04:39.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.641+0000 7f8cd37fe640 1 --2- 172.21.15.107:0/229561253 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f8cbc06df50 0x7f8cbc070400 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4007e60 tx=0x7f8cc400b040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:39.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.645+0000 7f8cbbfff640 1 -- 172.21.15.107:0/229561253 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f8cc8077360 con 0x7f8cd40fd660 2024-09-21T08:04:39.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.838+0000 7f8cd8d9d640 1 -- 172.21.15.107:0/229561253 --> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cd410ed20 con 0x7f8cbc06df50 2024-09-21T08:04:39.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.839+0000 7f8cbbfff640 1 -- 172.21.15.107:0/229561253 <== mgr.14644 v2:172.21.15.107:6800/695383021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f8cd410ed20 con 0x7f8cbc06df50 2024-09-21T08:04:39.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.841+0000 7f8cd8d9d640 1 -- 172.21.15.107:0/229561253 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f8cbc06df50 msgr2=0x7f8cbc070400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:39.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.841+0000 7f8cd8d9d640 1 --2- 172.21.15.107:0/229561253 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f8cbc06df50 0x7f8cbc070400 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4007e60 tx=0x7f8cc400b040 comp rx=0 tx=0).stop 2024-09-21T08:04:39.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.841+0000 7f8cd8d9d640 1 -- 172.21.15.107:0/229561253 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8cd40fd660 msgr2=0x7f8cd410d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:39.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.841+0000 7f8cd8d9d640 1 --2- 172.21.15.107:0/229561253 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8cd40fd660 0x7f8cd410d420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8cc802a530 tx=0x7f8cc8009da0 comp rx=0 tx=0).stop 2024-09-21T08:04:39.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.842+0000 7f8cd8d9d640 1 -- 172.21.15.107:0/229561253 shutdown_connections 2024-09-21T08:04:39.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.842+0000 7f8cd8d9d640 1 --2- 172.21.15.107:0/229561253 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f8cbc06df50 0x7f8cbc070400 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:39.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.842+0000 7f8cd8d9d640 1 --2- 172.21.15.107:0/229561253 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8cd40fd660 0x7f8cd410d420 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:39.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.842+0000 7f8cd8d9d640 1 --2- 172.21.15.107:0/229561253 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd40fc390 0x7f8cd410cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:39.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.842+0000 7f8cd8d9d640 1 -- 172.21.15.107:0/229561253 >> 172.21.15.107:0/229561253 conn(0x7f8cd40f7b70 msgr2=0x7f8cd40f92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:39.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.842+0000 7f8cd8d9d640 1 -- 172.21.15.107:0/229561253 shutdown_connections 2024-09-21T08:04:39.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.842+0000 7f8cd8d9d640 1 -- 172.21.15.107:0/229561253 wait complete. 2024-09-21T08:04:39.851 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:04:39.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.921+0000 7f3dde619640 1 -- 172.21.15.107:0/2826534660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3dd80fe4f0 msgr2=0x7f3dd80fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:39.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.921+0000 7f3dde619640 1 --2- 172.21.15.107:0/2826534660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3dd80fe4f0 0x7f3dd80fa650 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0048d0 tx=0x7f3dcc009da0 comp rx=0 tx=0).stop 2024-09-21T08:04:39.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.921+0000 7f3dde619640 1 -- 172.21.15.107:0/2826534660 shutdown_connections 2024-09-21T08:04:39.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.921+0000 7f3dde619640 1 --2- 172.21.15.107:0/2826534660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3dd80fe4f0 0x7f3dd80fa650 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:39.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.921+0000 7f3dde619640 1 --2- 172.21.15.107:0/2826534660 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3dd80fdba0 0x7f3dd80fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:39.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.921+0000 7f3dde619640 1 -- 172.21.15.107:0/2826534660 >> 172.21.15.107:0/2826534660 conn(0x7f3dd80f63a0 msgr2=0x7f3dd80f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:39.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.921+0000 7f3dde619640 1 -- 172.21.15.107:0/2826534660 shutdown_connections 2024-09-21T08:04:39.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.921+0000 7f3dde619640 1 -- 172.21.15.107:0/2826534660 wait complete. 2024-09-21T08:04:39.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.921+0000 7f3dde619640 1 Processor -- start 2024-09-21T08:04:39.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.921+0000 7f3dde619640 1 -- start start 2024-09-21T08:04:39.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.922+0000 7f3dde619640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3dd80fdba0 0x7f3dd80fd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:39.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.922+0000 7f3dde619640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3dd80fe4f0 0x7f3dd80fb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:39.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.922+0000 7f3dde619640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80fbea0 con 0x7f3dd80fe4f0 2024-09-21T08:04:39.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.922+0000 7f3dde619640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80fbfe0 con 0x7f3dd80fdba0 2024-09-21T08:04:39.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.922+0000 7f3dd77fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3dd80fe4f0 0x7f3dd80fb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:39.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.922+0000 7f3dd77fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3dd80fe4f0 0x7f3dd80fb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43692/0 (socket says 172.21.15.107:43692) 2024-09-21T08:04:39.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.922+0000 7f3dd77fe640 1 -- 172.21.15.107:0/2476199300 learned_addr learned my addr 172.21.15.107:0/2476199300 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:04:39.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.922+0000 7f3dd7fff640 1 --2- 172.21.15.107:0/2476199300 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3dd80fdba0 0x7f3dd80fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:39.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.922+0000 7f3dd77fe640 1 -- 172.21.15.107:0/2476199300 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3dd80fdba0 msgr2=0x7f3dd80fd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:39.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.922+0000 7f3dd77fe640 1 --2- 172.21.15.107:0/2476199300 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3dd80fdba0 0x7f3dd80fd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:39.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.922+0000 7f3dd77fe640 1 -- 172.21.15.107:0/2476199300 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc005040 con 0x7f3dd80fe4f0 2024-09-21T08:04:39.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.922+0000 7f3dd77fe640 1 --2- 172.21.15.107:0/2476199300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3dd80fe4f0 0x7f3dd80fb880 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0048a0 tx=0x7f3dcc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:39.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.922+0000 7f3dd4ff9640 1 -- 172.21.15.107:0/2476199300 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dcc038070 con 0x7f3dd80fe4f0 2024-09-21T08:04:39.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.922+0000 7f3dd4ff9640 1 -- 172.21.15.107:0/2476199300 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3dcc02abd0 con 0x7f3dd80fe4f0 2024-09-21T08:04:39.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.922+0000 7f3dde619640 1 -- 172.21.15.107:0/2476199300 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd80fc260 con 0x7f3dd80fe4f0 2024-09-21T08:04:39.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.922+0000 7f3dd4ff9640 1 -- 172.21.15.107:0/2476199300 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dcc033640 con 0x7f3dd80fe4f0 2024-09-21T08:04:39.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.922+0000 7f3dde619640 1 -- 172.21.15.107:0/2476199300 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd8115160 con 0x7f3dd80fe4f0 2024-09-21T08:04:39.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.923+0000 7f3dde619640 1 -- 172.21.15.107:0/2476199300 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd80fa040 con 0x7f3dd80fe4f0 2024-09-21T08:04:39.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.924+0000 7f3dd4ff9640 1 -- 172.21.15.107:0/2476199300 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f3dcc030020 con 0x7f3dd80fe4f0 2024-09-21T08:04:39.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.924+0000 7f3dd4ff9640 1 --2- 172.21.15.107:0/2476199300 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3dc006df60 0x7f3dc0070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:39.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.924+0000 7f3dd4ff9640 1 -- 172.21.15.107:0/2476199300 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f3dcc0adc40 con 0x7f3dd80fe4f0 2024-09-21T08:04:39.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.924+0000 7f3dd7fff640 1 --2- 172.21.15.107:0/2476199300 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3dc006df60 0x7f3dc0070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:39.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.925+0000 7f3dd7fff640 1 --2- 172.21.15.107:0/2476199300 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3dc006df60 0x7f3dc0070410 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80fd140 tx=0x7f3dc8009120 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:39.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:39.929+0000 7f3dd4ff9640 1 -- 172.21.15.107:0/2476199300 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f3dcc077570 con 0x7f3dd80fe4f0 2024-09-21T08:04:40.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.117+0000 7f3dde619640 1 -- 172.21.15.107:0/2476199300 --> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3dd8101dd0 con 0x7f3dc006df60 2024-09-21T08:04:40.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.118+0000 7f3dd4ff9640 1 -- 172.21.15.107:0/2476199300 <== mgr.14644 v2:172.21.15.107:6800/695383021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f3dd8101dd0 con 0x7f3dc006df60 2024-09-21T08:04:40.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.120+0000 7f3dde619640 1 -- 172.21.15.107:0/2476199300 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3dc006df60 msgr2=0x7f3dc0070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:40.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.120+0000 7f3dde619640 1 --2- 172.21.15.107:0/2476199300 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3dc006df60 0x7f3dc0070410 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80fd140 tx=0x7f3dc8009120 comp rx=0 tx=0).stop 2024-09-21T08:04:40.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.120+0000 7f3dde619640 1 -- 172.21.15.107:0/2476199300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3dd80fe4f0 msgr2=0x7f3dd80fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:40.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.120+0000 7f3dde619640 1 --2- 172.21.15.107:0/2476199300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3dd80fe4f0 0x7f3dd80fb880 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0048a0 tx=0x7f3dcc009da0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.120+0000 7f3dde619640 1 -- 172.21.15.107:0/2476199300 shutdown_connections 2024-09-21T08:04:40.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.120+0000 7f3dde619640 1 --2- 172.21.15.107:0/2476199300 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3dc006df60 0x7f3dc0070410 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.120+0000 7f3dde619640 1 --2- 172.21.15.107:0/2476199300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3dd80fe4f0 0x7f3dd80fb880 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.120+0000 7f3dde619640 1 --2- 172.21.15.107:0/2476199300 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3dd80fdba0 0x7f3dd80fd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.120+0000 7f3dde619640 1 -- 172.21.15.107:0/2476199300 >> 172.21.15.107:0/2476199300 conn(0x7f3dd80f63a0 msgr2=0x7f3dd80f7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:40.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.120+0000 7f3dde619640 1 -- 172.21.15.107:0/2476199300 shutdown_connections 2024-09-21T08:04:40.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.120+0000 7f3dde619640 1 -- 172.21.15.107:0/2476199300 wait complete. 2024-09-21T08:04:40.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.198+0000 7f42b0349640 1 -- 172.21.15.107:0/3646726121 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42a8066690 msgr2=0x7f42a80ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:40.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.198+0000 7f42b0349640 1 --2- 172.21.15.107:0/3646726121 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42a8066690 0x7f42a80ff1c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f42a40048d0 tx=0x7f42a4009da0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.198+0000 7f42b0349640 1 -- 172.21.15.107:0/3646726121 shutdown_connections 2024-09-21T08:04:40.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.198+0000 7f42b0349640 1 --2- 172.21.15.107:0/3646726121 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f42a80ff700 0x7f42a8101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.198+0000 7f42b0349640 1 --2- 172.21.15.107:0/3646726121 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42a8066690 0x7f42a80ff1c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.198+0000 7f42b0349640 1 -- 172.21.15.107:0/3646726121 >> 172.21.15.107:0/3646726121 conn(0x7f42a80f6bf0 msgr2=0x7f42a80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:40.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.198+0000 7f42b0349640 1 -- 172.21.15.107:0/3646726121 shutdown_connections 2024-09-21T08:04:40.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.198+0000 7f42b0349640 1 -- 172.21.15.107:0/3646726121 wait complete. 2024-09-21T08:04:40.201 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: pgmap v19: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.5 KiB/s wr, 0 op/s 2024-09-21T08:04:40.201 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:04:40.201 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.201 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:40.201 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi107.wzulxb"}]: dispatch 2024-09-21T08:04:40.201 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi107.wzulxb"}]': finished 2024-09-21T08:04:40.201 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi129.wvlmvo"}]: dispatch 2024-09-21T08:04:40.201 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi129.wvlmvo"}]': finished 2024-09-21T08:04:40.202 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.202 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:40.202 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.202 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:40.202 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.202 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:40.202 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.203 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:40.203 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.203 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:40.203 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.203 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:40.203 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.203 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:40.203 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.203 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.203 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:39 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.198+0000 7f42b0349640 1 Processor -- start 2024-09-21T08:04:40.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.199+0000 7f42b0349640 1 -- start start 2024-09-21T08:04:40.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.199+0000 7f42b0349640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f42a8066690 0x7f42a810d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:40.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.199+0000 7f42b0349640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42a80ff700 0x7f42a810d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:40.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.199+0000 7f42b0349640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a810e510 con 0x7f42a80ff700 2024-09-21T08:04:40.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.199+0000 7f42b0349640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a810e680 con 0x7f42a8066690 2024-09-21T08:04:40.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.199+0000 7f42ad8e4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42a80ff700 0x7f42a810d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:40.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.199+0000 7f42ad8e4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42a80ff700 0x7f42a810d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43718/0 (socket says 172.21.15.107:43718) 2024-09-21T08:04:40.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.199+0000 7f42ad8e4640 1 -- 172.21.15.107:0/3324272188 learned_addr learned my addr 172.21.15.107:0/3324272188 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:04:40.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.199+0000 7f42ae0e5640 1 --2- 172.21.15.107:0/3324272188 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f42a8066690 0x7f42a810d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:40.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.199+0000 7f42ad8e4640 1 -- 172.21.15.107:0/3324272188 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f42a8066690 msgr2=0x7f42a810d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.199+0000 7f42ad8e4640 1 --2- 172.21.15.107:0/3324272188 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f42a8066690 0x7f42a810d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.199+0000 7f42ad8e4640 1 -- 172.21.15.107:0/3324272188 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a4005040 con 0x7f42a80ff700 2024-09-21T08:04:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.199+0000 7f42ad8e4640 1 --2- 172.21.15.107:0/3324272188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42a80ff700 0x7f42a810d6a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f429800b580 tx=0x7f42980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.199+0000 7f429effd640 1 -- 172.21.15.107:0/3324272188 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f429800f6f0 con 0x7f42a80ff700 2024-09-21T08:04:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.200+0000 7f429effd640 1 -- 172.21.15.107:0/3324272188 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f429800fcf0 con 0x7f42a80ff700 2024-09-21T08:04:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.200+0000 7f42b0349640 1 -- 172.21.15.107:0/3324272188 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a810e960 con 0x7f42a80ff700 2024-09-21T08:04:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.200+0000 7f429effd640 1 -- 172.21.15.107:0/3324272188 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42980103a0 con 0x7f42a80ff700 2024-09-21T08:04:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.200+0000 7f42b0349640 1 -- 172.21.15.107:0/3324272188 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a810ee80 con 0x7f42a80ff700 2024-09-21T08:04:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.201+0000 7f42b0349640 1 -- 172.21.15.107:0/3324272188 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a80fa890 con 0x7f42a80ff700 2024-09-21T08:04:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.201+0000 7f429effd640 1 -- 172.21.15.107:0/3324272188 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f42980116b0 con 0x7f42a80ff700 2024-09-21T08:04:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.202+0000 7f429effd640 1 --2- 172.21.15.107:0/3324272188 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f429406df60 0x7f4294070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.202+0000 7f429effd640 1 -- 172.21.15.107:0/3324272188 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f429808d790 con 0x7f42a80ff700 2024-09-21T08:04:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.202+0000 7f42ae0e5640 1 --2- 172.21.15.107:0/3324272188 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f429406df60 0x7f4294070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.202+0000 7f42ae0e5640 1 --2- 172.21.15.107:0/3324272188 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f429406df60 0x7f4294070410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f42a4000c00 tx=0x7f42a4035040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:40.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.206+0000 7f429effd640 1 -- 172.21.15.107:0/3324272188 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f4298057090 con 0x7f42a80ff700 2024-09-21T08:04:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: pgmap v19: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.5 KiB/s wr, 0 op/s 2024-09-21T08:04:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:04:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi107.wzulxb"}]: dispatch 2024-09-21T08:04:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi107.wzulxb"}]': finished 2024-09-21T08:04:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi129.wvlmvo"}]: dispatch 2024-09-21T08:04:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi129.wvlmvo"}]': finished 2024-09-21T08:04:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:40.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:40.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:40.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:40.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:40.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:40.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:40.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:39 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:40.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.382+0000 7f42b0349640 1 -- 172.21.15.107:0/3324272188 --> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f42a810f160 con 0x7f429406df60 2024-09-21T08:04:40.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.390+0000 7f429effd640 1 -- 172.21.15.107:0/3324272188 <== mgr.14644 v2:172.21.15.107:6800/695383021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f42a810f160 con 0x7f429406df60 2024-09-21T08:04:40.392 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:04:40.392 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (94s) 2s ago 9m 25.7M - 0.25.0 c8568f914cd2 2b499aa3b7de 2024-09-21T08:04:40.392 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (9m) 2s ago 9m 6899k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 4557b307c7dd 2024-09-21T08:04:40.392 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (9m) 5s ago 9m 6895k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be e74e9385abdf 2024-09-21T08:04:40.392 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (89s) 2s ago 9m 81.7M - 9.4.7 954c08fa6188 84ee0e853c1f 2024-09-21T08:04:40.392 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (4m) 2s ago 4m 155M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 3bc779f88228 2024-09-21T08:04:40.392 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (4m) 2s ago 4m 12.8M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be ea8f140aade7 2024-09-21T08:04:40.392 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (4m) 5s ago 4m 15.9M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 329346c3afec 2024-09-21T08:04:40.392 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (4m) 5s ago 4m 17.3M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be baf87f32bfbc 2024-09-21T08:04:40.393 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:8443,9283,8765 running (57s) 2s ago 10m 490M - 19.1.1-367-g9e2ac70b cc9251b744a3 49c237734f07 2024-09-21T08:04:40.393 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283,8765 running (8s) 5s ago 8m 78.0M - 19.1.1-367-g9e2ac70b cc9251b744a3 ed117096bdd8 2024-09-21T08:04:40.393 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (11m) 2s ago 11m 49.9M 2048M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7702e48722c8 2024-09-21T08:04:40.393 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (8m) 5s ago 8m 43.4M 2048M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be d9680c5a5b92 2024-09-21T08:04:40.393 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 running (104s) 2s ago 9m 17.0M - 1.5.0 0da6a335fe13 6de7c307ba0f 2024-09-21T08:04:40.393 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (80s) 5s ago 9m 16.8M - 1.5.0 0da6a335fe13 cb6d4577b24c 2024-09-21T08:04:40.393 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (8m) 2s ago 8m 243M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 6799bdf55207 2024-09-21T08:04:40.393 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (7m) 2s ago 7m 258M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 29d8ce3f3a52 2024-09-21T08:04:40.393 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (7m) 2s ago 7m 209M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be c9e1c4756c02 2024-09-21T08:04:40.393 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (6m) 5s ago 6m 278M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7d58f70b105c 2024-09-21T08:04:40.393 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (6m) 5s ago 6m 251M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 2f916ef76d22 2024-09-21T08:04:40.393 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (6m) 5s ago 6m 234M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 0f25d9454304 2024-09-21T08:04:40.394 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (13s) 2s ago 9m 43.8M - 2.43.0 a07b618ecd1d 9ed2abf5e8d8 2024-09-21T08:04:40.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.392+0000 7f42b0349640 1 -- 172.21.15.107:0/3324272188 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f429406df60 msgr2=0x7f4294070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:40.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.392+0000 7f42b0349640 1 --2- 172.21.15.107:0/3324272188 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f429406df60 0x7f4294070410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f42a4000c00 tx=0x7f42a4035040 comp rx=0 tx=0).stop 2024-09-21T08:04:40.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.392+0000 7f42b0349640 1 -- 172.21.15.107:0/3324272188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42a80ff700 msgr2=0x7f42a810d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:40.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.392+0000 7f42b0349640 1 --2- 172.21.15.107:0/3324272188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42a80ff700 0x7f42a810d6a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f429800b580 tx=0x7f42980091a0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.392+0000 7f42b0349640 1 -- 172.21.15.107:0/3324272188 shutdown_connections 2024-09-21T08:04:40.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.392+0000 7f42b0349640 1 --2- 172.21.15.107:0/3324272188 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f429406df60 0x7f4294070410 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.392+0000 7f42b0349640 1 --2- 172.21.15.107:0/3324272188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42a80ff700 0x7f42a810d6a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.392+0000 7f42b0349640 1 --2- 172.21.15.107:0/3324272188 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f42a8066690 0x7f42a810d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.393+0000 7f42b0349640 1 -- 172.21.15.107:0/3324272188 >> 172.21.15.107:0/3324272188 conn(0x7f42a80f6bf0 msgr2=0x7f42a80f7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:40.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.393+0000 7f42b0349640 1 -- 172.21.15.107:0/3324272188 shutdown_connections 2024-09-21T08:04:40.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.393+0000 7f42b0349640 1 -- 172.21.15.107:0/3324272188 wait complete. 2024-09-21T08:04:40.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.472+0000 7fabaf974640 1 -- 172.21.15.107:0/4157469774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faba80fb430 msgr2=0x7faba80fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:40.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.472+0000 7fabaf974640 1 --2- 172.21.15.107:0/4157469774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faba80fb430 0x7faba80fb840 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faba00048d0 tx=0x7faba0009da0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.473+0000 7fabaf974640 1 -- 172.21.15.107:0/4157469774 shutdown_connections 2024-09-21T08:04:40.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.473+0000 7fabaf974640 1 --2- 172.21.15.107:0/4157469774 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faba80fc700 0x7faba80fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.473+0000 7fabaf974640 1 --2- 172.21.15.107:0/4157469774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faba80fb430 0x7faba80fb840 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.473+0000 7fabaf974640 1 -- 172.21.15.107:0/4157469774 >> 172.21.15.107:0/4157469774 conn(0x7faba80f6c10 msgr2=0x7faba80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:40.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.473+0000 7fabaf974640 1 -- 172.21.15.107:0/4157469774 shutdown_connections 2024-09-21T08:04:40.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.473+0000 7fabaf974640 1 -- 172.21.15.107:0/4157469774 wait complete. 2024-09-21T08:04:40.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.473+0000 7fabaf974640 1 Processor -- start 2024-09-21T08:04:40.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.473+0000 7fabaf974640 1 -- start start 2024-09-21T08:04:40.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.473+0000 7fabaf974640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faba80fb430 0x7faba810bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:40.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.473+0000 7fabaf974640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faba80fc700 0x7faba810c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:40.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.473+0000 7fabaf974640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba810caf0 con 0x7faba80fb430 2024-09-21T08:04:40.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.473+0000 7fabaf974640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba810d310 con 0x7faba80fc700 2024-09-21T08:04:40.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.473+0000 7fabad710640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faba80fb430 0x7faba810bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:40.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.474+0000 7fabad710640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faba80fb430 0x7faba810bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43736/0 (socket says 172.21.15.107:43736) 2024-09-21T08:04:40.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.474+0000 7fabad710640 1 -- 172.21.15.107:0/2264606118 learned_addr learned my addr 172.21.15.107:0/2264606118 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:04:40.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.474+0000 7fabacf0f640 1 --2- 172.21.15.107:0/2264606118 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faba80fc700 0x7faba810c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:40.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.474+0000 7fabad710640 1 -- 172.21.15.107:0/2264606118 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faba80fc700 msgr2=0x7faba810c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:40.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.474+0000 7fabad710640 1 --2- 172.21.15.107:0/2264606118 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faba80fc700 0x7faba810c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.474+0000 7fabad710640 1 -- 172.21.15.107:0/2264606118 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba0005040 con 0x7faba80fb430 2024-09-21T08:04:40.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.474+0000 7fabacf0f640 1 --2- 172.21.15.107:0/2264606118 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faba80fc700 0x7faba810c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:04:40.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.474+0000 7fabad710640 1 --2- 172.21.15.107:0/2264606118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faba80fb430 0x7faba810bf60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faba00043d0 tx=0x7faba0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:40.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.474+0000 7faba5ffb640 1 -- 172.21.15.107:0/2264606118 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faba0038070 con 0x7faba80fb430 2024-09-21T08:04:40.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.474+0000 7fabaf974640 1 -- 172.21.15.107:0/2264606118 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba810d510 con 0x7faba80fb430 2024-09-21T08:04:40.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.474+0000 7faba5ffb640 1 -- 172.21.15.107:0/2264606118 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faba002ae90 con 0x7faba80fb430 2024-09-21T08:04:40.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.474+0000 7faba5ffb640 1 -- 172.21.15.107:0/2264606118 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faba003e670 con 0x7faba80fb430 2024-09-21T08:04:40.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.474+0000 7fabaf974640 1 -- 172.21.15.107:0/2264606118 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba810dab0 con 0x7faba80fb430 2024-09-21T08:04:40.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.476+0000 7fabaf974640 1 -- 172.21.15.107:0/2264606118 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba80fa890 con 0x7faba80fb430 2024-09-21T08:04:40.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.476+0000 7faba5ffb640 1 -- 172.21.15.107:0/2264606118 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7faba0030020 con 0x7faba80fb430 2024-09-21T08:04:40.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.476+0000 7faba5ffb640 1 --2- 172.21.15.107:0/2264606118 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fab9006df60 0x7fab90070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:40.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.477+0000 7faba5ffb640 1 -- 172.21.15.107:0/2264606118 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7faba00adbe0 con 0x7faba80fb430 2024-09-21T08:04:40.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.477+0000 7fabacf0f640 1 --2- 172.21.15.107:0/2264606118 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fab9006df60 0x7fab90070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:40.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.477+0000 7fabacf0f640 1 --2- 172.21.15.107:0/2264606118 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fab9006df60 0x7fab90070410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009fd0 tx=0x7fab9c009e50 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:40.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.481+0000 7faba5ffb640 1 -- 172.21.15.107:0/2264606118 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7faba0077460 con 0x7faba80fb430 2024-09-21T08:04:40.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.743+0000 7fabaf974640 1 -- 172.21.15.107:0/2264606118 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faba810de90 con 0x7faba80fb430 2024-09-21T08:04:40.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.744+0000 7faba5ffb640 1 -- 172.21.15.107:0/2264606118 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7faba007ab20 con 0x7faba80fb430 2024-09-21T08:04:40.746 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:04:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": { 2024-09-21T08:04:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 2 2024-09-21T08:04:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:04:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": { 2024-09-21T08:04:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:04:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:04:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": { 2024-09-21T08:04:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 6 2024-09-21T08:04:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:04:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-21T08:04:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 4 2024-09-21T08:04:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:04:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "overall": { 2024-09-21T08:04:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 12, 2024-09-21T08:04:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:04:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-21T08:04:40.747 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:04:40.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.747+0000 7fabaf974640 1 -- 172.21.15.107:0/2264606118 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fab9006df60 msgr2=0x7fab90070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:40.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.747+0000 7fabaf974640 1 --2- 172.21.15.107:0/2264606118 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fab9006df60 0x7fab90070410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009fd0 tx=0x7fab9c009e50 comp rx=0 tx=0).stop 2024-09-21T08:04:40.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.747+0000 7fabaf974640 1 -- 172.21.15.107:0/2264606118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faba80fb430 msgr2=0x7faba810bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:40.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.747+0000 7fabaf974640 1 --2- 172.21.15.107:0/2264606118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faba80fb430 0x7faba810bf60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faba00043d0 tx=0x7faba0009da0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.747+0000 7fabaf974640 1 -- 172.21.15.107:0/2264606118 shutdown_connections 2024-09-21T08:04:40.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.747+0000 7fabaf974640 1 --2- 172.21.15.107:0/2264606118 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fab9006df60 0x7fab90070410 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.747+0000 7fabaf974640 1 --2- 172.21.15.107:0/2264606118 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faba80fc700 0x7faba810c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.747+0000 7fabaf974640 1 --2- 172.21.15.107:0/2264606118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faba80fb430 0x7faba810bf60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.747+0000 7fabaf974640 1 -- 172.21.15.107:0/2264606118 >> 172.21.15.107:0/2264606118 conn(0x7faba80f6c10 msgr2=0x7faba80f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:40.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.747+0000 7fabaf974640 1 -- 172.21.15.107:0/2264606118 shutdown_connections 2024-09-21T08:04:40.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.747+0000 7fabaf974640 1 -- 172.21.15.107:0/2264606118 wait complete. 2024-09-21T08:04:40.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.831+0000 7f2942d3a640 1 -- 172.21.15.107:0/3490596743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f293c0fb430 msgr2=0x7f293c0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:40.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.831+0000 7f2942d3a640 1 --2- 172.21.15.107:0/3490596743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f293c0fb430 0x7f293c0fb840 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f29300048d0 tx=0x7f2930009da0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.831+0000 7f2942d3a640 1 -- 172.21.15.107:0/3490596743 shutdown_connections 2024-09-21T08:04:40.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.831+0000 7f2942d3a640 1 --2- 172.21.15.107:0/3490596743 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f293c0fc700 0x7f293c0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.831+0000 7f2942d3a640 1 --2- 172.21.15.107:0/3490596743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f293c0fb430 0x7f293c0fb840 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.831+0000 7f2942d3a640 1 -- 172.21.15.107:0/3490596743 >> 172.21.15.107:0/3490596743 conn(0x7f293c0f6c10 msgr2=0x7f293c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:40.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.831+0000 7f2942d3a640 1 -- 172.21.15.107:0/3490596743 shutdown_connections 2024-09-21T08:04:40.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.831+0000 7f2942d3a640 1 -- 172.21.15.107:0/3490596743 wait complete. 2024-09-21T08:04:40.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.832+0000 7f2942d3a640 1 Processor -- start 2024-09-21T08:04:40.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.832+0000 7f2942d3a640 1 -- start start 2024-09-21T08:04:40.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.832+0000 7f2942d3a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f293c0fb430 0x7f293c10d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:40.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.832+0000 7f2942d3a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f293c0fc700 0x7f293c10d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:40.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.832+0000 7f2942d3a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c10dc30 con 0x7f293c0fb430 2024-09-21T08:04:40.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.832+0000 7f2942d3a640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c10e450 con 0x7f293c0fc700 2024-09-21T08:04:40.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.832+0000 7f2940ad6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f293c0fb430 0x7f293c10d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:40.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.832+0000 7f2940ad6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f293c0fb430 0x7f293c10d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43758/0 (socket says 172.21.15.107:43758) 2024-09-21T08:04:40.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.832+0000 7f2940ad6640 1 -- 172.21.15.107:0/2058695874 learned_addr learned my addr 172.21.15.107:0/2058695874 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:04:40.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.832+0000 7f293bfff640 1 --2- 172.21.15.107:0/2058695874 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f293c0fc700 0x7f293c10d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:40.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.833+0000 7f2940ad6640 1 -- 172.21.15.107:0/2058695874 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f293c0fc700 msgr2=0x7f293c10d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:40.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.833+0000 7f2940ad6640 1 --2- 172.21.15.107:0/2058695874 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f293c0fc700 0x7f293c10d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:40.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.833+0000 7f2940ad6640 1 -- 172.21.15.107:0/2058695874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2930005040 con 0x7f293c0fb430 2024-09-21T08:04:40.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.833+0000 7f2940ad6640 1 --2- 172.21.15.107:0/2058695874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f293c0fb430 0x7f293c10d0a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f29300043d0 tx=0x7f2930009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:40.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.833+0000 7f29397fa640 1 -- 172.21.15.107:0/2058695874 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2930038070 con 0x7f293c0fb430 2024-09-21T08:04:40.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.833+0000 7f2942d3a640 1 -- 172.21.15.107:0/2058695874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f293c10e680 con 0x7f293c0fb430 2024-09-21T08:04:40.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.833+0000 7f2942d3a640 1 -- 172.21.15.107:0/2058695874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f293c10eba0 con 0x7f293c0fb430 2024-09-21T08:04:40.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.833+0000 7f29397fa640 1 -- 172.21.15.107:0/2058695874 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f293002ae90 con 0x7f293c0fb430 2024-09-21T08:04:40.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.833+0000 7f29397fa640 1 -- 172.21.15.107:0/2058695874 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f293003e670 con 0x7f293c0fb430 2024-09-21T08:04:40.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.834+0000 7f2942d3a640 1 -- 172.21.15.107:0/2058695874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2920005210 con 0x7f293c0fb430 2024-09-21T08:04:40.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.835+0000 7f29397fa640 1 -- 172.21.15.107:0/2058695874 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f2930030020 con 0x7f293c0fb430 2024-09-21T08:04:40.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.836+0000 7f29397fa640 1 --2- 172.21.15.107:0/2058695874 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f292c06df60 0x7f292c070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:40.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.836+0000 7f29397fa640 1 -- 172.21.15.107:0/2058695874 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f29300ad970 con 0x7f293c0fb430 2024-09-21T08:04:40.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.836+0000 7f293bfff640 1 --2- 172.21.15.107:0/2058695874 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f292c06df60 0x7f292c070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:40.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.836+0000 7f293bfff640 1 --2- 172.21.15.107:0/2058695874 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f292c06df60 0x7f292c070410 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f293c10ce50 tx=0x7f292800b040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:40.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:40.840+0000 7f29397fa640 1 -- 172.21.15.107:0/2058695874 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f2930077320 con 0x7f293c0fb430 2024-09-21T08:04:41.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:41.031+0000 7f2942d3a640 1 -- 172.21.15.107:0/2058695874 --> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2920000bc0 con 0x7f292c06df60 2024-09-21T08:04:41.032 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:40 smithi107 ceph-mon[27622]: Upgrade: Setting container_image for all mgr 2024-09-21T08:04:41.033 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:40 smithi107 ceph-mon[27622]: Upgrade: Setting container_image for all rgw 2024-09-21T08:04:41.033 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:40 smithi107 ceph-mon[27622]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T08:04:41.033 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:40 smithi107 ceph-mon[27622]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T08:04:41.033 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:40 smithi107 ceph-mon[27622]: Upgrade: Setting container_image for all ceph-exporter 2024-09-21T08:04:41.033 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:40 smithi107 ceph-mon[27622]: Upgrade: Setting container_image for all iscsi 2024-09-21T08:04:41.033 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:40 smithi107 ceph-mon[27622]: Upgrade: Setting container_image for all nfs 2024-09-21T08:04:41.033 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:40 smithi107 ceph-mon[27622]: Upgrade: Setting container_image for all nvmeof 2024-09-21T08:04:41.033 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:40 smithi107 ceph-mon[27622]: Upgrade: Setting container_image for all node-exporter 2024-09-21T08:04:41.033 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:40 smithi107 ceph-mon[27622]: Upgrade: Setting container_image for all prometheus 2024-09-21T08:04:41.033 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:40 smithi107 ceph-mon[27622]: Upgrade: Setting container_image for all alertmanager 2024-09-21T08:04:41.033 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:40 smithi107 ceph-mon[27622]: from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:04:41.033 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:40 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/2264606118' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:41.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:41.032+0000 7f29397fa640 1 -- 172.21.15.107:0/2058695874 <== mgr.14644 v2:172.21.15.107:6800/695383021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f2920000bc0 con 0x7f292c06df60 2024-09-21T08:04:41.034 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:04:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5", 2024-09-21T08:04:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "in_progress": true, 2024-09-21T08:04:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T08:04:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "services_complete": [ 2024-09-21T08:04:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr" 2024-09-21T08:04:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-21T08:04:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T08:04:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "message": "Currently upgrading grafana daemons", 2024-09-21T08:04:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "is_paused": false 2024-09-21T08:04:41.035 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:04:41.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:41.034+0000 7f2942d3a640 1 -- 172.21.15.107:0/2058695874 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f292c06df60 msgr2=0x7f292c070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:41.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:41.034+0000 7f2942d3a640 1 --2- 172.21.15.107:0/2058695874 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f292c06df60 0x7f292c070410 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f293c10ce50 tx=0x7f292800b040 comp rx=0 tx=0).stop 2024-09-21T08:04:41.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:41.034+0000 7f2942d3a640 1 -- 172.21.15.107:0/2058695874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f293c0fb430 msgr2=0x7f293c10d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:41.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:41.034+0000 7f2942d3a640 1 --2- 172.21.15.107:0/2058695874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f293c0fb430 0x7f293c10d0a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f29300043d0 tx=0x7f2930009da0 comp rx=0 tx=0).stop 2024-09-21T08:04:41.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:41.034+0000 7f2942d3a640 1 -- 172.21.15.107:0/2058695874 shutdown_connections 2024-09-21T08:04:41.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:41.034+0000 7f2942d3a640 1 --2- 172.21.15.107:0/2058695874 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f292c06df60 0x7f292c070410 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:41.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:41.034+0000 7f2942d3a640 1 --2- 172.21.15.107:0/2058695874 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f293c0fc700 0x7f293c10d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:41.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:41.034+0000 7f2942d3a640 1 --2- 172.21.15.107:0/2058695874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f293c0fb430 0x7f293c10d0a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:41.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:41.034+0000 7f2942d3a640 1 -- 172.21.15.107:0/2058695874 >> 172.21.15.107:0/2058695874 conn(0x7f293c0f6c10 msgr2=0x7f293c065670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:41.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:41.035+0000 7f2942d3a640 1 -- 172.21.15.107:0/2058695874 shutdown_connections 2024-09-21T08:04:41.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:04:41.035+0000 7f2942d3a640 1 -- 172.21.15.107:0/2058695874 wait complete. 2024-09-21T08:04:41.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:40 smithi129 ceph-mon[34472]: Upgrade: Setting container_image for all mgr 2024-09-21T08:04:41.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:40 smithi129 ceph-mon[34472]: Upgrade: Setting container_image for all rgw 2024-09-21T08:04:41.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:40 smithi129 ceph-mon[34472]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T08:04:41.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:40 smithi129 ceph-mon[34472]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T08:04:41.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:40 smithi129 ceph-mon[34472]: Upgrade: Setting container_image for all ceph-exporter 2024-09-21T08:04:41.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:40 smithi129 ceph-mon[34472]: Upgrade: Setting container_image for all iscsi 2024-09-21T08:04:41.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:40 smithi129 ceph-mon[34472]: Upgrade: Setting container_image for all nfs 2024-09-21T08:04:41.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:40 smithi129 ceph-mon[34472]: Upgrade: Setting container_image for all nvmeof 2024-09-21T08:04:41.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:40 smithi129 ceph-mon[34472]: Upgrade: Setting container_image for all node-exporter 2024-09-21T08:04:41.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:40 smithi129 ceph-mon[34472]: Upgrade: Setting container_image for all prometheus 2024-09-21T08:04:41.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:40 smithi129 ceph-mon[34472]: Upgrade: Setting container_image for all alertmanager 2024-09-21T08:04:41.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:40 smithi129 ceph-mon[34472]: from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:04:41.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:40 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/2264606118' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:04:42.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:41 smithi129 ceph-mon[34472]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:04:42.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:41 smithi129 ceph-mon[34472]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:04:42.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:41 smithi129 ceph-mon[34472]: Upgrade: Updating grafana.smithi107 2024-09-21T08:04:42.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:41 smithi129 ceph-mon[34472]: Deploying daemon grafana.smithi107 on smithi107 2024-09-21T08:04:42.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:41 smithi129 ceph-mon[34472]: pgmap v20: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:42.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:41 smithi107 ceph-mon[27622]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:04:42.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:41 smithi107 ceph-mon[27622]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:04:42.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:41 smithi107 ceph-mon[27622]: Upgrade: Updating grafana.smithi107 2024-09-21T08:04:42.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:41 smithi107 ceph-mon[27622]: Deploying daemon grafana.smithi107 on smithi107 2024-09-21T08:04:42.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:41 smithi107 ceph-mon[27622]: pgmap v20: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:43.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:42 smithi129 ceph-mon[34472]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:04:43.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:42 smithi107 ceph-mon[27622]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:04:44.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:43 smithi129 ceph-mon[34472]: pgmap v21: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:44.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:43 smithi107 ceph-mon[27622]: pgmap v21: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:46.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:45 smithi129 ceph-mon[34472]: pgmap v22: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:46.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:45 smithi107 ceph-mon[27622]: pgmap v22: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:48.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:47 smithi129 ceph-mon[34472]: pgmap v23: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:48.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:47 smithi107 ceph-mon[27622]: pgmap v23: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:50.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:49 smithi129 ceph-mon[34472]: pgmap v24: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:50.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:49 smithi107 ceph-mon[27622]: pgmap v24: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:52.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:51 smithi129 ceph-mon[34472]: pgmap v25: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:52.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:51 smithi107 ceph-mon[27622]: pgmap v25: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:53.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:52 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:04:53.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:52 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:04:54.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:53 smithi129 ceph-mon[34472]: pgmap v26: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:54.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:53 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:54.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:53 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:54.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:53 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:04:54.289 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:53 smithi107 ceph-mon[27622]: pgmap v26: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:54.289 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:53 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:54.290 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:53 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:54.290 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:53 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:04:56.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:55 smithi129 ceph-mon[34472]: pgmap v27: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:56.291 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:55 smithi107 ceph-mon[27622]: pgmap v27: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:58.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:57 smithi129 ceph-mon[34472]: pgmap v28: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:58.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:57 smithi107 ceph-mon[27622]: pgmap v28: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:59.655 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:59 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:59.655 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:59 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:59.655 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:59 smithi107 ceph-mon[27622]: pgmap v29: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:59.655 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:59 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:59.655 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:04:59 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:59.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:59 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:59.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:59 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:59.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:59 smithi129 ceph-mon[34472]: pgmap v29: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:04:59.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:59 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:04:59.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:04:59 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:02.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:01 smithi129 ceph-mon[34472]: pgmap v30: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:02.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:01 smithi107 ceph-mon[27622]: pgmap v30: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:03.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:03.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:03.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:05:03.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:05:03.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:03.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T08:05:03.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T08:05:03.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:05:03.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: Upgrade: Finalizing container_image settings 2024-09-21T08:05:03.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:03.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T08:05:03.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T08:05:03.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:05:03.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T08:05:03.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T08:05:03.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T08:05:03.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T08:05:03.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T08:05:03.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T08:05:03.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T08:05:03.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T08:05:03.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:05:03.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T08:05:03.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T08:05:03.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T08:05:03.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T08:05:03.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T08:05:03.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T08:05:03.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T08:05:03.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T08:05:03.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:05:03.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:05:03.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:05:03.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:05:03.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:05:03.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:05:03.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: Upgrade: Complete! 2024-09-21T08:05:03.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T08:05:03.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T08:05:03.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:05:03.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:05:03.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:05:03.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:03.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:05:03.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:05:03.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:05:03.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:03.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:03.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:03 smithi129 ceph-mon[34472]: pgmap v31: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:03.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:03.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:03.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:05:03.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:05:03.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:03.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T08:05:03.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T08:05:03.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:05:03.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:03.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: Upgrade: Finalizing container_image settings 2024-09-21T08:05:03.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:03.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T08:05:03.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T08:05:03.307 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:05:03.307 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T08:05:03.307 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T08:05:03.307 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T08:05:03.307 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T08:05:03.307 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T08:05:03.307 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T08:05:03.307 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T08:05:03.307 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T08:05:03.307 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:05:03.307 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T08:05:03.307 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T08:05:03.307 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T08:05:03.307 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T08:05:03.307 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T08:05:03.308 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T08:05:03.308 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T08:05:03.308 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T08:05:03.308 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:05:03.308 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:05:03.308 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:05:03.308 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:05:03.308 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:05:03.308 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:05:03.308 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: Upgrade: Complete! 2024-09-21T08:05:03.308 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T08:05:03.308 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T08:05:03.308 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:05:03.308 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:05:03.309 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:05:03.309 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:03.309 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:05:03.309 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:05:03.309 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:05:03.309 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:03.309 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:03.309 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:03 smithi107 ceph-mon[27622]: pgmap v31: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:06.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:05 smithi129 ceph-mon[34472]: pgmap v32: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:06.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:05 smithi107 ceph-mon[27622]: pgmap v32: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:08.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:07 smithi129 ceph-mon[34472]: pgmap v33: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:08.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:07 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:05:08.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:07 smithi107 ceph-mon[27622]: pgmap v33: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:08.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:07 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:05:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:09 smithi129 ceph-mon[34472]: pgmap v34: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:10.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:09 smithi107 ceph-mon[27622]: pgmap v34: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:11.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.128+0000 7f3e2ea9a640 1 -- 172.21.15.107:0/1101889846 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e280fc700 msgr2=0x7f3e280fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:11.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.128+0000 7f3e2ea9a640 1 --2- 172.21.15.107:0/1101889846 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e280fc700 0x7f3e280fcb70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009c50 tx=0x7f3e1c004d10 comp rx=0 tx=0).stop 2024-09-21T08:05:11.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.128+0000 7f3e2ea9a640 1 -- 172.21.15.107:0/1101889846 shutdown_connections 2024-09-21T08:05:11.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.128+0000 7f3e2ea9a640 1 --2- 172.21.15.107:0/1101889846 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e280fc700 0x7f3e280fcb70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:11.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.128+0000 7f3e2ea9a640 1 --2- 172.21.15.107:0/1101889846 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e280fb430 0x7f3e280fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:11.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.128+0000 7f3e2ea9a640 1 -- 172.21.15.107:0/1101889846 >> 172.21.15.107:0/1101889846 conn(0x7f3e280f6c10 msgr2=0x7f3e280f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:11.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.128+0000 7f3e2ea9a640 1 -- 172.21.15.107:0/1101889846 shutdown_connections 2024-09-21T08:05:11.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.128+0000 7f3e2ea9a640 1 -- 172.21.15.107:0/1101889846 wait complete. 2024-09-21T08:05:11.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.129+0000 7f3e2ea9a640 1 Processor -- start 2024-09-21T08:05:11.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.129+0000 7f3e2ea9a640 1 -- start start 2024-09-21T08:05:11.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.129+0000 7f3e2ea9a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e280fb430 0x7f3e2810bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:11.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.129+0000 7f3e2ea9a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e280fc700 0x7f3e2810c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:11.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.129+0000 7f3e2ea9a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2810cb10 con 0x7f3e280fb430 2024-09-21T08:05:11.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.129+0000 7f3e2ea9a640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2810d330 con 0x7f3e280fc700 2024-09-21T08:05:11.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.129+0000 7f3e2c836640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e280fb430 0x7f3e2810bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:11.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.129+0000 7f3e2c836640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e280fb430 0x7f3e2810bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48818/0 (socket says 172.21.15.107:48818) 2024-09-21T08:05:11.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.129+0000 7f3e2c836640 1 -- 172.21.15.107:0/1190161910 learned_addr learned my addr 172.21.15.107:0/1190161910 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:05:11.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.130+0000 7f3e27fff640 1 --2- 172.21.15.107:0/1190161910 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e280fc700 0x7f3e2810c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:11.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.130+0000 7f3e2c836640 1 -- 172.21.15.107:0/1190161910 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e280fc700 msgr2=0x7f3e2810c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:11.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.130+0000 7f3e2c836640 1 --2- 172.21.15.107:0/1190161910 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e280fc700 0x7f3e2810c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:11.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.130+0000 7f3e2c836640 1 -- 172.21.15.107:0/1190161910 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c0098b0 con 0x7f3e280fb430 2024-09-21T08:05:11.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.130+0000 7f3e2c836640 1 --2- 172.21.15.107:0/1190161910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e280fb430 0x7f3e2810bf80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800fce0 tx=0x7f3e18004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:11.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.130+0000 7f3e257fa640 1 -- 172.21.15.107:0/1190161910 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e18007a20 con 0x7f3e280fb430 2024-09-21T08:05:11.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.130+0000 7f3e2ea9a640 1 -- 172.21.15.107:0/1190161910 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2810d560 con 0x7f3e280fb430 2024-09-21T08:05:11.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.130+0000 7f3e257fa640 1 -- 172.21.15.107:0/1190161910 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3e18007b80 con 0x7f3e280fb430 2024-09-21T08:05:11.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.130+0000 7f3e257fa640 1 -- 172.21.15.107:0/1190161910 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e180126a0 con 0x7f3e280fb430 2024-09-21T08:05:11.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.130+0000 7f3e2ea9a640 1 -- 172.21.15.107:0/1190161910 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2810dad0 con 0x7f3e280fb430 2024-09-21T08:05:11.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.131+0000 7f3e2ea9a640 1 -- 172.21.15.107:0/1190161910 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e28104660 con 0x7f3e280fb430 2024-09-21T08:05:11.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.132+0000 7f3e257fa640 1 -- 172.21.15.107:0/1190161910 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f3e18007cf0 con 0x7f3e280fb430 2024-09-21T08:05:11.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.132+0000 7f3e257fa640 1 --2- 172.21.15.107:0/1190161910 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3e1006df60 0x7f3e10070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:11.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.132+0000 7f3e257fa640 1 -- 172.21.15.107:0/1190161910 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f3e1808ffb0 con 0x7f3e280fb430 2024-09-21T08:05:11.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.132+0000 7f3e27fff640 1 --2- 172.21.15.107:0/1190161910 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3e1006df60 0x7f3e10070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:11.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.133+0000 7f3e27fff640 1 --2- 172.21.15.107:0/1190161910 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3e1006df60 0x7f3e10070410 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c000f80 tx=0x7f3e1c004d10 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:11.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.137+0000 7f3e257fa640 1 -- 172.21.15.107:0/1190161910 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f3e180597d0 con 0x7f3e280fb430 2024-09-21T08:05:11.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.320+0000 7f3e2ea9a640 1 -- 172.21.15.107:0/1190161910 --> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e2810de00 con 0x7f3e1006df60 2024-09-21T08:05:11.322 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.321+0000 7f3e257fa640 1 -- 172.21.15.107:0/1190161910 <== mgr.14644 v2:172.21.15.107:6800/695383021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f3e2810de00 con 0x7f3e1006df60 2024-09-21T08:05:11.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.323+0000 7f3e2ea9a640 1 -- 172.21.15.107:0/1190161910 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3e1006df60 msgr2=0x7f3e10070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:11.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.323+0000 7f3e2ea9a640 1 --2- 172.21.15.107:0/1190161910 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3e1006df60 0x7f3e10070410 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c000f80 tx=0x7f3e1c004d10 comp rx=0 tx=0).stop 2024-09-21T08:05:11.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.323+0000 7f3e2ea9a640 1 -- 172.21.15.107:0/1190161910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e280fb430 msgr2=0x7f3e2810bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:11.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.323+0000 7f3e2ea9a640 1 --2- 172.21.15.107:0/1190161910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e280fb430 0x7f3e2810bf80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800fce0 tx=0x7f3e18004600 comp rx=0 tx=0).stop 2024-09-21T08:05:11.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.323+0000 7f3e2ea9a640 1 -- 172.21.15.107:0/1190161910 shutdown_connections 2024-09-21T08:05:11.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.323+0000 7f3e2ea9a640 1 --2- 172.21.15.107:0/1190161910 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3e1006df60 0x7f3e10070410 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:11.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.323+0000 7f3e2ea9a640 1 --2- 172.21.15.107:0/1190161910 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e280fc700 0x7f3e2810c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:11.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.323+0000 7f3e2ea9a640 1 --2- 172.21.15.107:0/1190161910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e280fb430 0x7f3e2810bf80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:11.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.323+0000 7f3e2ea9a640 1 -- 172.21.15.107:0/1190161910 >> 172.21.15.107:0/1190161910 conn(0x7f3e280f6c10 msgr2=0x7f3e280f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:11.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.323+0000 7f3e2ea9a640 1 -- 172.21.15.107:0/1190161910 shutdown_connections 2024-09-21T08:05:11.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:11.323+0000 7f3e2ea9a640 1 -- 172.21.15.107:0/1190161910 wait complete. 2024-09-21T08:05:12.063 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-21T08:05:12.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:11 smithi129 ceph-mon[34472]: pgmap v35: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:12.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:11 smithi107 ceph-mon[27622]: pgmap v35: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:12.314 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:05:13.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:12 smithi129 ceph-mon[34472]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:05:13.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:12 smithi107 ceph-mon[27622]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:05:13.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.901+0000 7f0a89f87640 1 -- 172.21.15.107:0/1156897892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a841014d0 msgr2=0x7f0a841018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:13.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.901+0000 7f0a89f87640 1 --2- 172.21.15.107:0/1156897892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a841014d0 0x7f0a841018a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0a740048d0 tx=0x7f0a74009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:13.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.901+0000 7f0a89f87640 1 -- 172.21.15.107:0/1156897892 shutdown_connections 2024-09-21T08:05:13.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.901+0000 7f0a89f87640 1 --2- 172.21.15.107:0/1156897892 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0a840fb490 0x7f0a840fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:13.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.901+0000 7f0a89f87640 1 --2- 172.21.15.107:0/1156897892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a841014d0 0x7f0a841018a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:13.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.901+0000 7f0a89f87640 1 -- 172.21.15.107:0/1156897892 >> 172.21.15.107:0/1156897892 conn(0x7f0a840f7010 msgr2=0x7f0a840f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:13.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.901+0000 7f0a89f87640 1 -- 172.21.15.107:0/1156897892 shutdown_connections 2024-09-21T08:05:13.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.901+0000 7f0a89f87640 1 -- 172.21.15.107:0/1156897892 wait complete. 2024-09-21T08:05:13.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.902+0000 7f0a89f87640 1 Processor -- start 2024-09-21T08:05:13.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.902+0000 7f0a89f87640 1 -- start start 2024-09-21T08:05:13.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.902+0000 7f0a89f87640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a840fb490 0x7f0a841120e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:13.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.902+0000 7f0a89f87640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0a841014d0 0x7f0a84112620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:13.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.902+0000 7f0a89f87640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a84112c20 con 0x7f0a840fb490 2024-09-21T08:05:13.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.902+0000 7f0a89f87640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8410c060 con 0x7f0a841014d0 2024-09-21T08:05:13.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.902+0000 7f0a837fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a840fb490 0x7f0a841120e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:13.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.902+0000 7f0a837fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a840fb490 0x7f0a841120e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49012/0 (socket says 172.21.15.107:49012) 2024-09-21T08:05:13.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.902+0000 7f0a837fe640 1 -- 172.21.15.107:0/4123606938 learned_addr learned my addr 172.21.15.107:0/4123606938 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:05:13.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.902+0000 7f0a82ffd640 1 --2- 172.21.15.107:0/4123606938 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0a841014d0 0x7f0a84112620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:13.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.902+0000 7f0a837fe640 1 -- 172.21.15.107:0/4123606938 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0a841014d0 msgr2=0x7f0a84112620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:13.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.902+0000 7f0a837fe640 1 --2- 172.21.15.107:0/4123606938 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0a841014d0 0x7f0a84112620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:13.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.902+0000 7f0a837fe640 1 -- 172.21.15.107:0/4123606938 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a74005040 con 0x7f0a840fb490 2024-09-21T08:05:13.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.903+0000 7f0a837fe640 1 --2- 172.21.15.107:0/4123606938 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a840fb490 0x7f0a841120e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0a74003080 tx=0x7f0a74009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:13.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.903+0000 7f0a6bfff640 1 -- 172.21.15.107:0/4123606938 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a74038070 con 0x7f0a840fb490 2024-09-21T08:05:13.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.903+0000 7f0a89f87640 1 -- 172.21.15.107:0/4123606938 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8410c2e0 con 0x7f0a840fb490 2024-09-21T08:05:13.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.903+0000 7f0a6bfff640 1 -- 172.21.15.107:0/4123606938 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0a740097e0 con 0x7f0a840fb490 2024-09-21T08:05:13.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.903+0000 7f0a6bfff640 1 -- 172.21.15.107:0/4123606938 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a7403d420 con 0x7f0a840fb490 2024-09-21T08:05:13.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.903+0000 7f0a89f87640 1 -- 172.21.15.107:0/4123606938 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8410c820 con 0x7f0a840fb490 2024-09-21T08:05:13.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.904+0000 7f0a89f87640 1 -- 172.21.15.107:0/4123606938 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a840fcbd0 con 0x7f0a840fb490 2024-09-21T08:05:13.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.904+0000 7f0a6bfff640 1 -- 172.21.15.107:0/4123606938 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f0a74030020 con 0x7f0a840fb490 2024-09-21T08:05:13.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.905+0000 7f0a6bfff640 1 --2- 172.21.15.107:0/4123606938 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f0a6c06df60 0x7f0a6c070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:13.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.905+0000 7f0a6bfff640 1 -- 172.21.15.107:0/4123606938 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f0a740adee0 con 0x7f0a840fb490 2024-09-21T08:05:13.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.905+0000 7f0a82ffd640 1 --2- 172.21.15.107:0/4123606938 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f0a6c06df60 0x7f0a6c070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:13.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.905+0000 7f0a82ffd640 1 --2- 172.21.15.107:0/4123606938 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f0a6c06df60 0x7f0a6c070410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0a78007fd0 tx=0x7f0a78009040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:13.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:13.909+0000 7f0a6bfff640 1 -- 172.21.15.107:0/4123606938 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f0a74077760 con 0x7f0a840fb490 2024-09-21T08:05:14.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:14.137+0000 7f0a89f87640 1 -- 172.21.15.107:0/4123606938 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0a840fac50 con 0x7f0a840fb490 2024-09-21T08:05:14.139 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:13 smithi107 ceph-mon[27622]: pgmap v36: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:14.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:14.138+0000 7f0a6bfff640 1 -- 172.21.15.107:0/4123606938 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f0a7407ae20 con 0x7f0a840fb490 2024-09-21T08:05:14.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:14.139+0000 7f0a89f87640 1 -- 172.21.15.107:0/4123606938 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f0a6c06df60 msgr2=0x7f0a6c070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:14.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:14.139+0000 7f0a89f87640 1 --2- 172.21.15.107:0/4123606938 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f0a6c06df60 0x7f0a6c070410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0a78007fd0 tx=0x7f0a78009040 comp rx=0 tx=0).stop 2024-09-21T08:05:14.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:14.139+0000 7f0a89f87640 1 -- 172.21.15.107:0/4123606938 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a840fb490 msgr2=0x7f0a841120e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:14.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:14.139+0000 7f0a89f87640 1 --2- 172.21.15.107:0/4123606938 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a840fb490 0x7f0a841120e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0a74003080 tx=0x7f0a74009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:14.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:14.140+0000 7f0a89f87640 1 -- 172.21.15.107:0/4123606938 shutdown_connections 2024-09-21T08:05:14.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:14.140+0000 7f0a89f87640 1 --2- 172.21.15.107:0/4123606938 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f0a6c06df60 0x7f0a6c070410 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:14.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:14.140+0000 7f0a89f87640 1 --2- 172.21.15.107:0/4123606938 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0a841014d0 0x7f0a84112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:14.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:14.140+0000 7f0a89f87640 1 --2- 172.21.15.107:0/4123606938 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a840fb490 0x7f0a841120e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:14.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:14.140+0000 7f0a89f87640 1 -- 172.21.15.107:0/4123606938 >> 172.21.15.107:0/4123606938 conn(0x7f0a840f7010 msgr2=0x7f0a840f8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:14.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:14.140+0000 7f0a89f87640 1 -- 172.21.15.107:0/4123606938 shutdown_connections 2024-09-21T08:05:14.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:14.140+0000 7f0a89f87640 1 -- 172.21.15.107:0/4123606938 wait complete. 2024-09-21T08:05:14.150 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:05:14.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:13 smithi129 ceph-mon[34472]: pgmap v36: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:14.922 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-21T08:05:15.178 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:05:15.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:14 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/4123606938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:15.299 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:14 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/4123606938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:16.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:15 smithi129 ceph-mon[34472]: pgmap v37: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:16.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:15 smithi107 ceph-mon[27622]: pgmap v37: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:17.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:17 smithi129 ceph-mon[34472]: pgmap v38: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:17.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:17 smithi107 ceph-mon[27622]: pgmap v38: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:19.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.832+0000 7fdedb23e640 1 -- 172.21.15.107:0/3476225073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded4102560 msgr2=0x7fded4102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:19.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.832+0000 7fdedb23e640 1 --2- 172.21.15.107:0/3476225073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded4102560 0x7fded4102930 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009c50 tx=0x7fdec4004d10 comp rx=0 tx=0).stop 2024-09-21T08:05:19.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.832+0000 7fdedb23e640 1 -- 172.21.15.107:0/3476225073 shutdown_connections 2024-09-21T08:05:19.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.832+0000 7fdedb23e640 1 --2- 172.21.15.107:0/3476225073 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fded4102f00 0x7fded40fc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:19.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.832+0000 7fdedb23e640 1 --2- 172.21.15.107:0/3476225073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded4102560 0x7fded4102930 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:19.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.832+0000 7fdedb23e640 1 -- 172.21.15.107:0/3476225073 >> 172.21.15.107:0/3476225073 conn(0x7fded40f8120 msgr2=0x7fded40fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:19.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.832+0000 7fdedb23e640 1 -- 172.21.15.107:0/3476225073 shutdown_connections 2024-09-21T08:05:19.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.832+0000 7fdedb23e640 1 -- 172.21.15.107:0/3476225073 wait complete. 2024-09-21T08:05:19.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.833+0000 7fdedb23e640 1 Processor -- start 2024-09-21T08:05:19.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.833+0000 7fdedb23e640 1 -- start start 2024-09-21T08:05:19.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.833+0000 7fdedb23e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded4102560 0x7fded4113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:19.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.833+0000 7fdedb23e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fded4102f00 0x7fded4113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:19.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.833+0000 7fdedb23e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded4113d60 con 0x7fded4102560 2024-09-21T08:05:19.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.833+0000 7fdedb23e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded410d1a0 con 0x7fded4102f00 2024-09-21T08:05:19.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.834+0000 7fded8fda640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded4102560 0x7fded4113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:19.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.834+0000 7fded8fda640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded4102560 0x7fded4113220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49026/0 (socket says 172.21.15.107:49026) 2024-09-21T08:05:19.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.834+0000 7fded8fda640 1 -- 172.21.15.107:0/4235993259 learned_addr learned my addr 172.21.15.107:0/4235993259 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:05:19.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.834+0000 7fded3fff640 1 --2- 172.21.15.107:0/4235993259 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fded4102f00 0x7fded4113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:19.568 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)" 2024-09-21T08:05:19.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.834+0000 7fded8fda640 1 -- 172.21.15.107:0/4235993259 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fded4102f00 msgr2=0x7fded4113760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:19.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.834+0000 7fded8fda640 1 --2- 172.21.15.107:0/4235993259 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fded4102f00 0x7fded4113760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:19.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.834+0000 7fded8fda640 1 -- 172.21.15.107:0/4235993259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec40098b0 con 0x7fded4102560 2024-09-21T08:05:19.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.834+0000 7fded8fda640 1 --2- 172.21.15.107:0/4235993259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded4102560 0x7fded4113220 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdec4004750 tx=0x7fdec4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:19.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.834+0000 7fded17fa640 1 -- 172.21.15.107:0/4235993259 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdec4009610 con 0x7fded4102560 2024-09-21T08:05:19.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.834+0000 7fdedb23e640 1 -- 172.21.15.107:0/4235993259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded410d420 con 0x7fded4102560 2024-09-21T08:05:19.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.834+0000 7fded17fa640 1 -- 172.21.15.107:0/4235993259 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdec4032b10 con 0x7fded4102560 2024-09-21T08:05:19.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.834+0000 7fded17fa640 1 -- 172.21.15.107:0/4235993259 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdec403d990 con 0x7fded4102560 2024-09-21T08:05:19.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.834+0000 7fdedb23e640 1 -- 172.21.15.107:0/4235993259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded410d9c0 con 0x7fded4102560 2024-09-21T08:05:19.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.835+0000 7fdedb23e640 1 -- 172.21.15.107:0/4235993259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded40fdce0 con 0x7fded4102560 2024-09-21T08:05:19.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.836+0000 7fded17fa640 1 -- 172.21.15.107:0/4235993259 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7fdec402f030 con 0x7fded4102560 2024-09-21T08:05:19.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.836+0000 7fded17fa640 1 --2- 172.21.15.107:0/4235993259 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fdec006df60 0x7fdec0070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:19.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.836+0000 7fded17fa640 1 -- 172.21.15.107:0/4235993259 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fdec40aebb0 con 0x7fded4102560 2024-09-21T08:05:19.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.837+0000 7fded3fff640 1 --2- 172.21.15.107:0/4235993259 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fdec006df60 0x7fdec0070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:19.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.837+0000 7fded3fff640 1 --2- 172.21.15.107:0/4235993259 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fdec006df60 0x7fdec0070410 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009fd0 tx=0x7fdebc009e50 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:19.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:18.841+0000 7fded17fa640 1 -- 172.21.15.107:0/4235993259 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fdec40b5080 con 0x7fded4102560 2024-09-21T08:05:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:19.075+0000 7fdedb23e640 1 -- 172.21.15.107:0/4235993259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fded40fbd60 con 0x7fded4102560 2024-09-21T08:05:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:19.075+0000 7fded17fa640 1 -- 172.21.15.107:0/4235993259 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7fdec4078320 con 0x7fded4102560 2024-09-21T08:05:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:19.077+0000 7fdedb23e640 1 -- 172.21.15.107:0/4235993259 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fdec006df60 msgr2=0x7fdec0070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:19.077+0000 7fdedb23e640 1 --2- 172.21.15.107:0/4235993259 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fdec006df60 0x7fdec0070410 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009fd0 tx=0x7fdebc009e50 comp rx=0 tx=0).stop 2024-09-21T08:05:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:19.077+0000 7fdedb23e640 1 -- 172.21.15.107:0/4235993259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded4102560 msgr2=0x7fded4113220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:19.077+0000 7fdedb23e640 1 --2- 172.21.15.107:0/4235993259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded4102560 0x7fded4113220 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdec4004750 tx=0x7fdec4004d10 comp rx=0 tx=0).stop 2024-09-21T08:05:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:19.077+0000 7fdedb23e640 1 -- 172.21.15.107:0/4235993259 shutdown_connections 2024-09-21T08:05:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:19.077+0000 7fdedb23e640 1 --2- 172.21.15.107:0/4235993259 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fdec006df60 0x7fdec0070410 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:19.077+0000 7fdedb23e640 1 --2- 172.21.15.107:0/4235993259 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fded4102f00 0x7fded4113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:19.077+0000 7fdedb23e640 1 --2- 172.21.15.107:0/4235993259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded4102560 0x7fded4113220 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:19.077+0000 7fdedb23e640 1 -- 172.21.15.107:0/4235993259 >> 172.21.15.107:0/4235993259 conn(0x7fded40f8120 msgr2=0x7fded40f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:19.077+0000 7fdedb23e640 1 -- 172.21.15.107:0/4235993259 shutdown_connections 2024-09-21T08:05:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:19.077+0000 7fdedb23e640 1 -- 172.21.15.107:0/4235993259 wait complete. 2024-09-21T08:05:20.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:19 smithi129 ceph-mon[34472]: pgmap v39: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:20.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:19 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/4235993259' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:20.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:19 smithi107 ceph-mon[27622]: pgmap v39: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:20.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:19 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/4235993259' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:20.385 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-21T08:05:20.640 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:05:22.108 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:21 smithi107 ceph-mon[27622]: pgmap v40: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:22.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:21 smithi129 ceph-mon[34472]: pgmap v40: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:22.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.307+0000 7f9d957b2640 1 -- 172.21.15.107:0/4274615683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d90100c70 msgr2=0x7f9d90101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:22.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.307+0000 7f9d957b2640 1 --2- 172.21.15.107:0/4274615683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d90100c70 0x7f9d90101040 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9d800049c0 tx=0x7f9d8000aeb0 comp rx=0 tx=0).stop 2024-09-21T08:05:22.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.307+0000 7f9d957b2640 1 -- 172.21.15.107:0/4274615683 shutdown_connections 2024-09-21T08:05:22.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.307+0000 7f9d957b2640 1 --2- 172.21.15.107:0/4274615683 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d900fac80 0x7f9d900fb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:22.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.307+0000 7f9d957b2640 1 --2- 172.21.15.107:0/4274615683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d90100c70 0x7f9d90101040 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:22.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.307+0000 7f9d957b2640 1 -- 172.21.15.107:0/4274615683 >> 172.21.15.107:0/4274615683 conn(0x7f9d90070ce0 msgr2=0x7f9d900710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:22.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.307+0000 7f9d957b2640 1 -- 172.21.15.107:0/4274615683 shutdown_connections 2024-09-21T08:05:22.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.307+0000 7f9d957b2640 1 -- 172.21.15.107:0/4274615683 wait complete. 2024-09-21T08:05:22.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.307+0000 7f9d957b2640 1 Processor -- start 2024-09-21T08:05:22.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.307+0000 7f9d957b2640 1 -- start start 2024-09-21T08:05:22.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.308+0000 7f9d957b2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d900fac80 0x7f9d90113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:22.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.308+0000 7f9d957b2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d90100c70 0x7f9d90113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:22.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.308+0000 7f9d957b2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d90113df0 con 0x7f9d900fac80 2024-09-21T08:05:22.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.308+0000 7f9d957b2640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9010d1f0 con 0x7f9d90100c70 2024-09-21T08:05:22.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.308+0000 7f9d8effd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d900fac80 0x7f9d90113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:22.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.308+0000 7f9d8effd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d900fac80 0x7f9d90113220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60608/0 (socket says 172.21.15.107:60608) 2024-09-21T08:05:22.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.308+0000 7f9d8effd640 1 -- 172.21.15.107:0/2461748677 learned_addr learned my addr 172.21.15.107:0/2461748677 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:05:22.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.308+0000 7f9d8e7fc640 1 --2- 172.21.15.107:0/2461748677 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d90100c70 0x7f9d90113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:22.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.308+0000 7f9d8effd640 1 -- 172.21.15.107:0/2461748677 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d90100c70 msgr2=0x7f9d90113760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:22.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.308+0000 7f9d8effd640 1 --2- 172.21.15.107:0/2461748677 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d90100c70 0x7f9d90113760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:22.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.308+0000 7f9d8effd640 1 -- 172.21.15.107:0/2461748677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d80005040 con 0x7f9d900fac80 2024-09-21T08:05:22.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.308+0000 7f9d8effd640 1 --2- 172.21.15.107:0/2461748677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d900fac80 0x7f9d90113220 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9d80000c00 tx=0x7f9d8000aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:22.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.308+0000 7f9d877fe640 1 -- 172.21.15.107:0/2461748677 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d80033920 con 0x7f9d900fac80 2024-09-21T08:05:22.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.308+0000 7f9d877fe640 1 -- 172.21.15.107:0/2461748677 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9d80034420 con 0x7f9d900fac80 2024-09-21T08:05:22.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.308+0000 7f9d877fe640 1 -- 172.21.15.107:0/2461748677 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d8003c600 con 0x7f9d900fac80 2024-09-21T08:05:22.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.308+0000 7f9d957b2640 1 -- 172.21.15.107:0/2461748677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9010d470 con 0x7f9d900fac80 2024-09-21T08:05:22.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.309+0000 7f9d957b2640 1 -- 172.21.15.107:0/2461748677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9010da10 con 0x7f9d900fac80 2024-09-21T08:05:22.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.309+0000 7f9d957b2640 1 -- 172.21.15.107:0/2461748677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d900fc370 con 0x7f9d900fac80 2024-09-21T08:05:22.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.310+0000 7f9d877fe640 1 -- 172.21.15.107:0/2461748677 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f9d80031020 con 0x7f9d900fac80 2024-09-21T08:05:22.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.310+0000 7f9d877fe640 1 --2- 172.21.15.107:0/2461748677 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f9d7c06df60 0x7f9d7c070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:22.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.310+0000 7f9d877fe640 1 -- 172.21.15.107:0/2461748677 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f9d800adff0 con 0x7f9d900fac80 2024-09-21T08:05:22.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.310+0000 7f9d8e7fc640 1 --2- 172.21.15.107:0/2461748677 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f9d7c06df60 0x7f9d7c070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:22.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.311+0000 7f9d8e7fc640 1 --2- 172.21.15.107:0/2461748677 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f9d7c06df60 0x7f9d7c070410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9d78006fd0 tx=0x7f9d78008040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:22.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.315+0000 7f9d877fe640 1 -- 172.21.15.107:0/2461748677 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f9d800778f0 con 0x7f9d900fac80 2024-09-21T08:05:22.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.547+0000 7f9d957b2640 1 -- 172.21.15.107:0/2461748677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9d9004b750 con 0x7f9d900fac80 2024-09-21T08:05:22.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.547+0000 7f9d877fe640 1 -- 172.21.15.107:0/2461748677 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f9d8007afb0 con 0x7f9d900fac80 2024-09-21T08:05:22.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.549+0000 7f9d957b2640 1 -- 172.21.15.107:0/2461748677 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f9d7c06df60 msgr2=0x7f9d7c070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:22.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.549+0000 7f9d957b2640 1 --2- 172.21.15.107:0/2461748677 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f9d7c06df60 0x7f9d7c070410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9d78006fd0 tx=0x7f9d78008040 comp rx=0 tx=0).stop 2024-09-21T08:05:22.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.549+0000 7f9d957b2640 1 -- 172.21.15.107:0/2461748677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d900fac80 msgr2=0x7f9d90113220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:22.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.549+0000 7f9d957b2640 1 --2- 172.21.15.107:0/2461748677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d900fac80 0x7f9d90113220 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9d80000c00 tx=0x7f9d8000aeb0 comp rx=0 tx=0).stop 2024-09-21T08:05:22.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.549+0000 7f9d957b2640 1 -- 172.21.15.107:0/2461748677 shutdown_connections 2024-09-21T08:05:22.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.549+0000 7f9d957b2640 1 --2- 172.21.15.107:0/2461748677 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f9d7c06df60 0x7f9d7c070410 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:22.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.549+0000 7f9d957b2640 1 --2- 172.21.15.107:0/2461748677 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d90100c70 0x7f9d90113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:22.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.549+0000 7f9d957b2640 1 --2- 172.21.15.107:0/2461748677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d900fac80 0x7f9d90113220 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:22.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.549+0000 7f9d957b2640 1 -- 172.21.15.107:0/2461748677 >> 172.21.15.107:0/2461748677 conn(0x7f9d90070ce0 msgr2=0x7f9d90103bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:22.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.549+0000 7f9d957b2640 1 -- 172.21.15.107:0/2461748677 shutdown_connections 2024-09-21T08:05:22.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:22.549+0000 7f9d957b2640 1 -- 172.21.15.107:0/2461748677 wait complete. 2024-09-21T08:05:22.559 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:05:23.162 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:22 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:05:23.162 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:22 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/2461748677' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:23.187 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-21T08:05:23.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:22 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:05:23.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:22 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/2461748677' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:23.436 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:05:24.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:23 smithi107 ceph-mon[27622]: pgmap v41: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:24.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:23 smithi129 ceph-mon[34472]: pgmap v41: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:25.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.309+0000 7f198ae4a640 1 -- 172.21.15.107:0/1703265404 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1984102620 msgr2=0x7f19841029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:25.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.309+0000 7f198ae4a640 1 --2- 172.21.15.107:0/1703265404 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1984102620 0x7f19841029f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f19740048d0 tx=0x7f1974009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:25.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.309+0000 7f198ae4a640 1 -- 172.21.15.107:0/1703265404 shutdown_connections 2024-09-21T08:05:25.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.309+0000 7f198ae4a640 1 --2- 172.21.15.107:0/1703265404 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19840fac80 0x7f19840fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:25.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.309+0000 7f198ae4a640 1 --2- 172.21.15.107:0/1703265404 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1984102620 0x7f19841029f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:25.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.309+0000 7f198ae4a640 1 -- 172.21.15.107:0/1703265404 >> 172.21.15.107:0/1703265404 conn(0x7f1984070ce0 msgr2=0x7f19840710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:25.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.310+0000 7f198ae4a640 1 -- 172.21.15.107:0/1703265404 shutdown_connections 2024-09-21T08:05:25.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.310+0000 7f198ae4a640 1 -- 172.21.15.107:0/1703265404 wait complete. 2024-09-21T08:05:25.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.310+0000 7f198ae4a640 1 Processor -- start 2024-09-21T08:05:25.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.310+0000 7f198ae4a640 1 -- start start 2024-09-21T08:05:25.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.311+0000 7f198ae4a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19840fac80 0x7f19841131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:25.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.311+0000 7f198ae4a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1984102620 0x7f1984113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:25.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.311+0000 7f198ae4a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1984113dc0 con 0x7f1984102620 2024-09-21T08:05:25.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.311+0000 7f198ae4a640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198410d170 con 0x7f19840fac80 2024-09-21T08:05:25.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.311+0000 7f1983fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1984102620 0x7f1984113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:25.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.311+0000 7f1983fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1984102620 0x7f1984113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60634/0 (socket says 172.21.15.107:60634) 2024-09-21T08:05:25.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.311+0000 7f1983fff640 1 -- 172.21.15.107:0/1229703979 learned_addr learned my addr 172.21.15.107:0/1229703979 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:05:25.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.311+0000 7f1988be6640 1 --2- 172.21.15.107:0/1229703979 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19840fac80 0x7f19841131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:25.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.311+0000 7f1983fff640 1 -- 172.21.15.107:0/1229703979 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19840fac80 msgr2=0x7f19841131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:25.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.311+0000 7f1983fff640 1 --2- 172.21.15.107:0/1229703979 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19840fac80 0x7f19841131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:25.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.311+0000 7f1983fff640 1 -- 172.21.15.107:0/1229703979 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1974005040 con 0x7f1984102620 2024-09-21T08:05:25.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.311+0000 7f1983fff640 1 --2- 172.21.15.107:0/1229703979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1984102620 0x7f1984113730 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f197800b790 tx=0x7f19780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:25.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.311+0000 7f19817fa640 1 -- 172.21.15.107:0/1229703979 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f197800c700 con 0x7f1984102620 2024-09-21T08:05:25.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.311+0000 7f198ae4a640 1 -- 172.21.15.107:0/1229703979 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198410d450 con 0x7f1984102620 2024-09-21T08:05:25.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.311+0000 7f19817fa640 1 -- 172.21.15.107:0/1229703979 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f197800cd00 con 0x7f1984102620 2024-09-21T08:05:25.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.311+0000 7f19817fa640 1 -- 172.21.15.107:0/1229703979 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1978015e80 con 0x7f1984102620 2024-09-21T08:05:25.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.311+0000 7f198ae4a640 1 -- 172.21.15.107:0/1229703979 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198410d970 con 0x7f1984102620 2024-09-21T08:05:25.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.313+0000 7f198ae4a640 1 -- 172.21.15.107:0/1229703979 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19840657b0 con 0x7f1984102620 2024-09-21T08:05:25.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.313+0000 7f19817fa640 1 -- 172.21.15.107:0/1229703979 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f1978012070 con 0x7f1984102620 2024-09-21T08:05:25.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.314+0000 7f19817fa640 1 --2- 172.21.15.107:0/1229703979 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f196c06df60 0x7f196c070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:25.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.314+0000 7f1988be6640 1 --2- 172.21.15.107:0/1229703979 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f196c06df60 0x7f196c070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:25.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.314+0000 7f19817fa640 1 -- 172.21.15.107:0/1229703979 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f197808d250 con 0x7f1984102620 2024-09-21T08:05:25.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.314+0000 7f1988be6640 1 --2- 172.21.15.107:0/1229703979 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f196c06df60 0x7f196c070410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1974009ac0 tx=0x7f1974035040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:25.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.318+0000 7f19817fa640 1 -- 172.21.15.107:0/1229703979 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f1978056ad0 con 0x7f1984102620 2024-09-21T08:05:25.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:25.503+0000 7f198ae4a640 1 -- 172.21.15.107:0/1229703979 --> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", "target": ["mon-mgr", ""]}) v1 -- 0x7f19841095f0 con 0x7f196c06df60 2024-09-21T08:05:26.261 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:25 smithi107 ceph-mon[27622]: pgmap v42: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:26.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:25 smithi129 ceph-mon[34472]: pgmap v42: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:27.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:26 smithi129 ceph-mon[34472]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:05:27.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:26 smithi107 ceph-mon[27622]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:05:27.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:27.428+0000 7f19817fa640 1 -- 172.21.15.107:0/1229703979 <== mgr.14644 v2:172.21.15.107:6800/695383021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5108 (secure 0 0 0) 0x7f19841095f0 con 0x7f196c06df60 2024-09-21T08:05:27.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:27.430+0000 7f198ae4a640 1 -- 172.21.15.107:0/1229703979 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f196c06df60 msgr2=0x7f196c070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:27.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:27.430+0000 7f198ae4a640 1 --2- 172.21.15.107:0/1229703979 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f196c06df60 0x7f196c070410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1974009ac0 tx=0x7f1974035040 comp rx=0 tx=0).stop 2024-09-21T08:05:27.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:27.430+0000 7f198ae4a640 1 -- 172.21.15.107:0/1229703979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1984102620 msgr2=0x7f1984113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:27.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:27.430+0000 7f198ae4a640 1 --2- 172.21.15.107:0/1229703979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1984102620 0x7f1984113730 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f197800b790 tx=0x7f19780091d0 comp rx=0 tx=0).stop 2024-09-21T08:05:27.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:27.431+0000 7f198ae4a640 1 -- 172.21.15.107:0/1229703979 shutdown_connections 2024-09-21T08:05:27.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:27.431+0000 7f198ae4a640 1 --2- 172.21.15.107:0/1229703979 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f196c06df60 0x7f196c070410 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:27.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:27.431+0000 7f198ae4a640 1 --2- 172.21.15.107:0/1229703979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1984102620 0x7f1984113730 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:27.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:27.431+0000 7f198ae4a640 1 --2- 172.21.15.107:0/1229703979 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19840fac80 0x7f19841131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:27.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:27.431+0000 7f198ae4a640 1 -- 172.21.15.107:0/1229703979 >> 172.21.15.107:0/1229703979 conn(0x7f1984070ce0 msgr2=0x7f1984105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:27.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:27.431+0000 7f198ae4a640 1 -- 172.21.15.107:0/1229703979 shutdown_connections 2024-09-21T08:05:27.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:27.431+0000 7f198ae4a640 1 -- 172.21.15.107:0/1229703979 wait complete. 2024-09-21T08:05:27.441 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:05:28.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:28 smithi107 ceph-mon[27622]: pgmap v43: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:28.131 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph orch ps' 2024-09-21T08:05:28.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:28 smithi129 ceph-mon[34472]: pgmap v43: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:28.378 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:05:29.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:29 smithi129 ceph-mon[34472]: pgmap v44: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:29.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:29 smithi107 ceph-mon[27622]: pgmap v44: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:30.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.052+0000 7f111ea56640 1 -- 172.21.15.107:0/394053077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11180fb480 msgr2=0x7f11180fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:30.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.052+0000 7f111ea56640 1 --2- 172.21.15.107:0/394053077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11180fb480 0x7f11180fb8f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f110c0048d0 tx=0x7f110c009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:30.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.052+0000 7f111ea56640 1 -- 172.21.15.107:0/394053077 shutdown_connections 2024-09-21T08:05:30.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.052+0000 7f111ea56640 1 --2- 172.21.15.107:0/394053077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11180fb480 0x7f11180fb8f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:30.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.052+0000 7f111ea56640 1 --2- 172.21.15.107:0/394053077 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11181014c0 0x7f1118101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:30.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.052+0000 7f111ea56640 1 -- 172.21.15.107:0/394053077 >> 172.21.15.107:0/394053077 conn(0x7f11180f7000 msgr2=0x7f11180f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:30.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.052+0000 7f111ea56640 1 -- 172.21.15.107:0/394053077 shutdown_connections 2024-09-21T08:05:30.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.052+0000 7f111ea56640 1 -- 172.21.15.107:0/394053077 wait complete. 2024-09-21T08:05:30.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.052+0000 7f111ea56640 1 Processor -- start 2024-09-21T08:05:30.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.052+0000 7f111ea56640 1 -- start start 2024-09-21T08:05:30.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.053+0000 7f111ea56640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11180fb480 0x7f11181131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:30.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.053+0000 7f111ea56640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11181014c0 0x7f1118113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:30.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.053+0000 7f111ea56640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1118113d20 con 0x7f11181014c0 2024-09-21T08:05:30.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.053+0000 7f111ea56640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111810d160 con 0x7f11180fb480 2024-09-21T08:05:30.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.053+0000 7f11177fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11181014c0 0x7f1118113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:30.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.053+0000 7f11177fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11181014c0 0x7f1118113720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60652/0 (socket says 172.21.15.107:60652) 2024-09-21T08:05:30.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.053+0000 7f11177fe640 1 -- 172.21.15.107:0/924497360 learned_addr learned my addr 172.21.15.107:0/924497360 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:05:30.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.053+0000 7f1117fff640 1 --2- 172.21.15.107:0/924497360 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11180fb480 0x7f11181131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:30.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.053+0000 7f11177fe640 1 -- 172.21.15.107:0/924497360 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11180fb480 msgr2=0x7f11181131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:30.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.053+0000 7f11177fe640 1 --2- 172.21.15.107:0/924497360 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11180fb480 0x7f11181131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:30.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.053+0000 7f11177fe640 1 -- 172.21.15.107:0/924497360 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c005040 con 0x7f11181014c0 2024-09-21T08:05:30.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.053+0000 7f11177fe640 1 --2- 172.21.15.107:0/924497360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11181014c0 0x7f1118113720 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f110c0043d0 tx=0x7f110c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:30.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.053+0000 7f1114ff9640 1 -- 172.21.15.107:0/924497360 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f110c038070 con 0x7f11181014c0 2024-09-21T08:05:30.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.053+0000 7f1114ff9640 1 -- 172.21.15.107:0/924497360 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f110c0096e0 con 0x7f11181014c0 2024-09-21T08:05:30.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.053+0000 7f111ea56640 1 -- 172.21.15.107:0/924497360 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111810d3e0 con 0x7f11181014c0 2024-09-21T08:05:30.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.053+0000 7f1114ff9640 1 -- 172.21.15.107:0/924497360 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f110c03d420 con 0x7f11181014c0 2024-09-21T08:05:30.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.054+0000 7f111ea56640 1 -- 172.21.15.107:0/924497360 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111810d980 con 0x7f11181014c0 2024-09-21T08:05:30.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.055+0000 7f111ea56640 1 -- 172.21.15.107:0/924497360 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11180fcbc0 con 0x7f11181014c0 2024-09-21T08:05:30.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.055+0000 7f1114ff9640 1 -- 172.21.15.107:0/924497360 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f110c030020 con 0x7f11181014c0 2024-09-21T08:05:30.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.055+0000 7f1114ff9640 1 --2- 172.21.15.107:0/924497360 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f110006df60 0x7f1100070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:30.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.056+0000 7f1114ff9640 1 -- 172.21.15.107:0/924497360 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f110c0adef0 con 0x7f11181014c0 2024-09-21T08:05:30.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.056+0000 7f1117fff640 1 --2- 172.21.15.107:0/924497360 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f110006df60 0x7f1100070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:30.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.056+0000 7f1117fff640 1 --2- 172.21.15.107:0/924497360 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f110006df60 0x7f1100070410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1108007fd0 tx=0x7f1108009e90 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:30.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.060+0000 7f1114ff9640 1 -- 172.21.15.107:0/924497360 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f110c077770 con 0x7f11181014c0 2024-09-21T08:05:30.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.233+0000 7f111ea56640 1 -- 172.21.15.107:0/924497360 --> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1118108460 con 0x7f110006df60 2024-09-21T08:05:30.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.242+0000 7f1114ff9640 1 -- 172.21.15.107:0/924497360 <== mgr.14644 v2:172.21.15.107:6800/695383021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f1118108460 con 0x7f110006df60 2024-09-21T08:05:30.243 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:05:30.243 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (2m) 31s ago 10m 25.7M - 0.25.0 c8568f914cd2 2b499aa3b7de 2024-09-21T08:05:30.243 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (10m) 31s ago 10m 6899k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 4557b307c7dd 2024-09-21T08:05:30.244 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (9m) 55s ago 9m 6895k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be e74e9385abdf 2024-09-21T08:05:30.244 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (37s) 31s ago 10m 46.1M - 9.4.12 2bacad6d85d8 63177dcfe25c 2024-09-21T08:05:30.244 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (5m) 31s ago 5m 155M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 3bc779f88228 2024-09-21T08:05:30.244 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (5m) 31s ago 5m 13.0M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be ea8f140aade7 2024-09-21T08:05:30.244 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (5m) 55s ago 5m 15.9M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 329346c3afec 2024-09-21T08:05:30.244 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (5m) 55s ago 5m 17.3M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be baf87f32bfbc 2024-09-21T08:05:30.244 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:8443,9283,8765 running (107s) 31s ago 11m 499M - 19.1.1-367-g9e2ac70b cc9251b744a3 49c237734f07 2024-09-21T08:05:30.244 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283,8765 running (58s) 55s ago 9m 78.0M - 19.1.1-367-g9e2ac70b cc9251b744a3 ed117096bdd8 2024-09-21T08:05:30.244 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (11m) 31s ago 12m 51.5M 2048M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7702e48722c8 2024-09-21T08:05:30.244 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (9m) 55s ago 9m 43.4M 2048M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be d9680c5a5b92 2024-09-21T08:05:30.244 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 running (2m) 31s ago 10m 17.1M - 1.5.0 0da6a335fe13 6de7c307ba0f 2024-09-21T08:05:30.244 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (2m) 55s ago 9m 16.8M - 1.5.0 0da6a335fe13 cb6d4577b24c 2024-09-21T08:05:30.244 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (9m) 31s ago 9m 244M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 6799bdf55207 2024-09-21T08:05:30.244 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (8m) 31s ago 8m 259M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 29d8ce3f3a52 2024-09-21T08:05:30.245 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (8m) 31s ago 8m 209M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be c9e1c4756c02 2024-09-21T08:05:30.245 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (7m) 55s ago 7m 278M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7d58f70b105c 2024-09-21T08:05:30.245 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (7m) 55s ago 7m 251M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 2f916ef76d22 2024-09-21T08:05:30.245 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (6m) 55s ago 6m 234M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 0f25d9454304 2024-09-21T08:05:30.245 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (63s) 31s ago 10m 50.7M - 2.43.0 a07b618ecd1d 9ed2abf5e8d8 2024-09-21T08:05:30.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.244+0000 7f111ea56640 1 -- 172.21.15.107:0/924497360 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f110006df60 msgr2=0x7f1100070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:30.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.244+0000 7f111ea56640 1 --2- 172.21.15.107:0/924497360 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f110006df60 0x7f1100070410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1108007fd0 tx=0x7f1108009e90 comp rx=0 tx=0).stop 2024-09-21T08:05:30.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.244+0000 7f111ea56640 1 -- 172.21.15.107:0/924497360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11181014c0 msgr2=0x7f1118113720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:30.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.244+0000 7f111ea56640 1 --2- 172.21.15.107:0/924497360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11181014c0 0x7f1118113720 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f110c0043d0 tx=0x7f110c009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:30.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.244+0000 7f111ea56640 1 -- 172.21.15.107:0/924497360 shutdown_connections 2024-09-21T08:05:30.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.244+0000 7f111ea56640 1 --2- 172.21.15.107:0/924497360 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f110006df60 0x7f1100070410 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:30.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.244+0000 7f111ea56640 1 --2- 172.21.15.107:0/924497360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11181014c0 0x7f1118113720 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:30.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.244+0000 7f111ea56640 1 --2- 172.21.15.107:0/924497360 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11180fb480 0x7f11181131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:30.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.244+0000 7f111ea56640 1 -- 172.21.15.107:0/924497360 >> 172.21.15.107:0/924497360 conn(0x7f11180f7000 msgr2=0x7f1118065a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:30.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.244+0000 7f111ea56640 1 -- 172.21.15.107:0/924497360 shutdown_connections 2024-09-21T08:05:30.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:30.244+0000 7f111ea56640 1 -- 172.21.15.107:0/924497360 wait complete. 2024-09-21T08:05:30.921 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T08:05:30.922 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi107.front.sepia.ceph.com 2024-09-21T08:05:30.923 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-21T08:05:31.171 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:05:32.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:31 smithi129 ceph-mon[34472]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:05:32.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:31 smithi129 ceph-mon[34472]: pgmap v45: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:32.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:31 smithi107 ceph-mon[27622]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:05:32.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:31 smithi107 ceph-mon[27622]: pgmap v45: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:32.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.911+0000 7f4354357640 1 -- 172.21.15.107:0/2761390383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f434c102ef0 msgr2=0x7f434c0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:32.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.911+0000 7f4354357640 1 --2- 172.21.15.107:0/2761390383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f434c102ef0 0x7f434c0fc5b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f433c0048d0 tx=0x7f433c009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:32.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.911+0000 7f4354357640 1 -- 172.21.15.107:0/2761390383 shutdown_connections 2024-09-21T08:05:32.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.911+0000 7f4354357640 1 --2- 172.21.15.107:0/2761390383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f434c102ef0 0x7f434c0fc5b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:32.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.911+0000 7f4354357640 1 --2- 172.21.15.107:0/2761390383 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f434c102550 0x7f434c102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:32.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.911+0000 7f4354357640 1 -- 172.21.15.107:0/2761390383 >> 172.21.15.107:0/2761390383 conn(0x7f434c0f80f0 msgr2=0x7f434c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:32.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.911+0000 7f4354357640 1 -- 172.21.15.107:0/2761390383 shutdown_connections 2024-09-21T08:05:32.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.911+0000 7f4354357640 1 -- 172.21.15.107:0/2761390383 wait complete. 2024-09-21T08:05:32.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.912+0000 7f4354357640 1 Processor -- start 2024-09-21T08:05:32.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.912+0000 7f4354357640 1 -- start start 2024-09-21T08:05:32.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.912+0000 7f4354357640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f434c102550 0x7f434c113500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:32.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.912+0000 7f4354357640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f434c102ef0 0x7f434c113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:32.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.912+0000 7f4354357640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c114090 con 0x7f434c102ef0 2024-09-21T08:05:32.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.912+0000 7f4354357640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c10d4a0 con 0x7f434c102550 2024-09-21T08:05:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.912+0000 7f43518f2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f434c102ef0 0x7f434c113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.912+0000 7f43518f2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f434c102ef0 0x7f434c113a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49156/0 (socket says 172.21.15.107:49156) 2024-09-21T08:05:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.912+0000 7f43518f2640 1 -- 172.21.15.107:0/1688277002 learned_addr learned my addr 172.21.15.107:0/1688277002 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:05:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.912+0000 7f43520f3640 1 --2- 172.21.15.107:0/1688277002 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f434c102550 0x7f434c113500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.912+0000 7f43518f2640 1 -- 172.21.15.107:0/1688277002 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f434c102550 msgr2=0x7f434c113500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.912+0000 7f43518f2640 1 --2- 172.21.15.107:0/1688277002 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f434c102550 0x7f434c113500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.912+0000 7f43518f2640 1 -- 172.21.15.107:0/1688277002 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c005040 con 0x7f434c102ef0 2024-09-21T08:05:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.912+0000 7f43520f3640 1 --2- 172.21.15.107:0/1688277002 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f434c102550 0x7f434c113500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:05:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.913+0000 7f43518f2640 1 --2- 172.21.15.107:0/1688277002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f434c102ef0 0x7f434c113a40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f433c0043d0 tx=0x7f433c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.913+0000 7f4342ffd640 1 -- 172.21.15.107:0/1688277002 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f433c038070 con 0x7f434c102ef0 2024-09-21T08:05:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.913+0000 7f4342ffd640 1 -- 172.21.15.107:0/1688277002 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f433c0096e0 con 0x7f434c102ef0 2024-09-21T08:05:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.913+0000 7f4342ffd640 1 -- 172.21.15.107:0/1688277002 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f433c02c8a0 con 0x7f434c102ef0 2024-09-21T08:05:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.913+0000 7f4354357640 1 -- 172.21.15.107:0/1688277002 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434c10d720 con 0x7f434c102ef0 2024-09-21T08:05:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.913+0000 7f4354357640 1 -- 172.21.15.107:0/1688277002 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f434c10dc60 con 0x7f434c102ef0 2024-09-21T08:05:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.914+0000 7f4354357640 1 -- 172.21.15.107:0/1688277002 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f434c0fdcd0 con 0x7f434c102ef0 2024-09-21T08:05:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.914+0000 7f4342ffd640 1 -- 172.21.15.107:0/1688277002 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f433c030020 con 0x7f434c102ef0 2024-09-21T08:05:32.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.915+0000 7f4342ffd640 1 --2- 172.21.15.107:0/1688277002 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f433806df60 0x7f4338070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:32.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.915+0000 7f4342ffd640 1 -- 172.21.15.107:0/1688277002 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f433c0ad6d0 con 0x7f434c102ef0 2024-09-21T08:05:32.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.915+0000 7f43520f3640 1 --2- 172.21.15.107:0/1688277002 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f433806df60 0x7f4338070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:32.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.915+0000 7f43520f3640 1 --2- 172.21.15.107:0/1688277002 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f433806df60 0x7f4338070410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4348009fd0 tx=0x7f4348009e50 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:32.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:32.919+0000 7f4342ffd640 1 -- 172.21.15.107:0/1688277002 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f433c076f50 con 0x7f434c102ef0 2024-09-21T08:05:33.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:33.085+0000 7f4354357640 1 -- 172.21.15.107:0/1688277002 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f434c0fbd50 con 0x7f434c102ef0 2024-09-21T08:05:33.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:33.090+0000 7f4342ffd640 1 -- 172.21.15.107:0/1688277002 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v47)=0 v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7f433c07a610 con 0x7f434c102ef0 2024-09-21T08:05:33.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:33.092+0000 7f4354357640 1 -- 172.21.15.107:0/1688277002 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f433806df60 msgr2=0x7f4338070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:33.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:33.092+0000 7f4354357640 1 --2- 172.21.15.107:0/1688277002 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f433806df60 0x7f4338070410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4348009fd0 tx=0x7f4348009e50 comp rx=0 tx=0).stop 2024-09-21T08:05:33.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:33.092+0000 7f4354357640 1 -- 172.21.15.107:0/1688277002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f434c102ef0 msgr2=0x7f434c113a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:33.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:33.092+0000 7f4354357640 1 --2- 172.21.15.107:0/1688277002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f434c102ef0 0x7f434c113a40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f433c0043d0 tx=0x7f433c009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:33.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:33.092+0000 7f4354357640 1 -- 172.21.15.107:0/1688277002 shutdown_connections 2024-09-21T08:05:33.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:33.092+0000 7f4354357640 1 --2- 172.21.15.107:0/1688277002 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f433806df60 0x7f4338070410 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:33.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:33.092+0000 7f4354357640 1 --2- 172.21.15.107:0/1688277002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f434c102ef0 0x7f434c113a40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:33.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:33.092+0000 7f4354357640 1 --2- 172.21.15.107:0/1688277002 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f434c102550 0x7f434c113500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:33.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:33.092+0000 7f4354357640 1 -- 172.21.15.107:0/1688277002 >> 172.21.15.107:0/1688277002 conn(0x7f434c0f80f0 msgr2=0x7f434c0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:33.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:33.092+0000 7f4354357640 1 -- 172.21.15.107:0/1688277002 shutdown_connections 2024-09-21T08:05:33.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:33.092+0000 7f4354357640 1 -- 172.21.15.107:0/1688277002 wait complete. 2024-09-21T08:05:33.852 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T08:05:33.853 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi107.front.sepia.ceph.com 2024-09-21T08:05:33.853 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-21T08:05:34.099 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:05:34.220 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:33 smithi107 ceph-mon[27622]: pgmap v46: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:34.220 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:33 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1688277002' entity='client.admin' 2024-09-21T08:05:34.221 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:33 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:05:34.221 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:33 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:34.221 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:33 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:34.221 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:33 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:05:34.221 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:33 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:05:34.221 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:33 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:34.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:33 smithi129 ceph-mon[34472]: pgmap v46: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:34.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:33 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/1688277002' entity='client.admin' 2024-09-21T08:05:34.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:33 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:05:34.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:33 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:34.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:33 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:34.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:33 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:05:34.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:33 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:05:34.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:33 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:35.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.746+0000 7f40c066e640 1 -- 172.21.15.107:0/939575229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40b81014c0 msgr2=0x7f40b8101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:35.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.746+0000 7f40c066e640 1 --2- 172.21.15.107:0/939575229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40b81014c0 0x7f40b8101890 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f40b40048d0 tx=0x7f40b4009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:35.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.746+0000 7f40c066e640 1 -- 172.21.15.107:0/939575229 shutdown_connections 2024-09-21T08:05:35.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.746+0000 7f40c066e640 1 --2- 172.21.15.107:0/939575229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40b80fb480 0x7f40b80fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:35.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.746+0000 7f40c066e640 1 --2- 172.21.15.107:0/939575229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40b81014c0 0x7f40b8101890 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:35.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.746+0000 7f40c066e640 1 -- 172.21.15.107:0/939575229 >> 172.21.15.107:0/939575229 conn(0x7f40b80f7000 msgr2=0x7f40b80f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:35.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.746+0000 7f40c066e640 1 -- 172.21.15.107:0/939575229 shutdown_connections 2024-09-21T08:05:35.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.746+0000 7f40c066e640 1 -- 172.21.15.107:0/939575229 wait complete. 2024-09-21T08:05:35.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.747+0000 7f40c066e640 1 Processor -- start 2024-09-21T08:05:35.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.747+0000 7f40c066e640 1 -- start start 2024-09-21T08:05:35.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.747+0000 7f40c066e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40b80fb480 0x7f40b810e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:35.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.747+0000 7f40c066e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40b81014c0 0x7f40b810e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:35.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.747+0000 7f40c066e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b810ece0 con 0x7f40b80fb480 2024-09-21T08:05:35.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.747+0000 7f40c066e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b810ee50 con 0x7f40b81014c0 2024-09-21T08:05:35.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.747+0000 7f40be40a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40b80fb480 0x7f40b810e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:35.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.747+0000 7f40be40a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40b80fb480 0x7f40b810e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49184/0 (socket says 172.21.15.107:49184) 2024-09-21T08:05:35.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.747+0000 7f40be40a640 1 -- 172.21.15.107:0/2413356056 learned_addr learned my addr 172.21.15.107:0/2413356056 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:05:35.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.747+0000 7f40be40a640 1 -- 172.21.15.107:0/2413356056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40b81014c0 msgr2=0x7f40b810e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:35.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.747+0000 7f40be40a640 1 --2- 172.21.15.107:0/2413356056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40b81014c0 0x7f40b810e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:35.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.747+0000 7f40be40a640 1 -- 172.21.15.107:0/2413356056 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b4005040 con 0x7f40b80fb480 2024-09-21T08:05:35.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.747+0000 7f40be40a640 1 --2- 172.21.15.107:0/2413356056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40b80fb480 0x7f40b810e150 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f40b4003080 tx=0x7f40b4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:35.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.748+0000 7f40aeffd640 1 -- 172.21.15.107:0/2413356056 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40b4038070 con 0x7f40b80fb480 2024-09-21T08:05:35.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.748+0000 7f40aeffd640 1 -- 172.21.15.107:0/2413356056 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f40b40097e0 con 0x7f40b80fb480 2024-09-21T08:05:35.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.748+0000 7f40aeffd640 1 -- 172.21.15.107:0/2413356056 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40b403d420 con 0x7f40b80fb480 2024-09-21T08:05:35.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.748+0000 7f40c066e640 1 -- 172.21.15.107:0/2413356056 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b81171c0 con 0x7f40b80fb480 2024-09-21T08:05:35.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.748+0000 7f40c066e640 1 -- 172.21.15.107:0/2413356056 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b8117620 con 0x7f40b80fb480 2024-09-21T08:05:35.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.749+0000 7f40c066e640 1 -- 172.21.15.107:0/2413356056 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b80fcbc0 con 0x7f40b80fb480 2024-09-21T08:05:35.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.749+0000 7f40aeffd640 1 -- 172.21.15.107:0/2413356056 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f40b4030020 con 0x7f40b80fb480 2024-09-21T08:05:35.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.750+0000 7f40aeffd640 1 --2- 172.21.15.107:0/2413356056 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f40a406df60 0x7f40a4070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:35.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.750+0000 7f40aeffd640 1 -- 172.21.15.107:0/2413356056 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f40b40adee0 con 0x7f40b80fb480 2024-09-21T08:05:35.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.750+0000 7f40bdc09640 1 --2- 172.21.15.107:0/2413356056 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f40a406df60 0x7f40a4070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:35.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.750+0000 7f40bdc09640 1 --2- 172.21.15.107:0/2413356056 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f40a406df60 0x7f40a4070410 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f40b8066450 tx=0x7f40a8007c30 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:35.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.754+0000 7f40aeffd640 1 -- 172.21.15.107:0/2413356056 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f40b4077760 con 0x7f40b80fb480 2024-09-21T08:05:35.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.920+0000 7f40c066e640 1 -- 172.21.15.107:0/2413356056 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f40b80fac40 con 0x7f40b80fb480 2024-09-21T08:05:35.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.920+0000 7f40aeffd640 1 -- 172.21.15.107:0/2413356056 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v47)=0 v47) v1 ==== 155+0+0 (secure 0 0 0) 0x7f40b407ae20 con 0x7f40b80fb480 2024-09-21T08:05:35.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.922+0000 7f40c066e640 1 -- 172.21.15.107:0/2413356056 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f40a406df60 msgr2=0x7f40a4070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:35.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.922+0000 7f40c066e640 1 --2- 172.21.15.107:0/2413356056 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f40a406df60 0x7f40a4070410 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f40b8066450 tx=0x7f40a8007c30 comp rx=0 tx=0).stop 2024-09-21T08:05:35.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.922+0000 7f40c066e640 1 -- 172.21.15.107:0/2413356056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40b80fb480 msgr2=0x7f40b810e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:35.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.922+0000 7f40c066e640 1 --2- 172.21.15.107:0/2413356056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40b80fb480 0x7f40b810e150 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f40b4003080 tx=0x7f40b4009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:35.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.922+0000 7f40c066e640 1 -- 172.21.15.107:0/2413356056 shutdown_connections 2024-09-21T08:05:35.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.922+0000 7f40c066e640 1 --2- 172.21.15.107:0/2413356056 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f40a406df60 0x7f40a4070410 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:35.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.922+0000 7f40c066e640 1 --2- 172.21.15.107:0/2413356056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40b81014c0 0x7f40b810e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:35.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.922+0000 7f40c066e640 1 --2- 172.21.15.107:0/2413356056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40b80fb480 0x7f40b810e150 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:35.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.922+0000 7f40c066e640 1 -- 172.21.15.107:0/2413356056 >> 172.21.15.107:0/2413356056 conn(0x7f40b80f7000 msgr2=0x7f40b80f8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:35.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.922+0000 7f40c066e640 1 -- 172.21.15.107:0/2413356056 shutdown_connections 2024-09-21T08:05:35.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:35.922+0000 7f40c066e640 1 -- 172.21.15.107:0/2413356056 wait complete. 2024-09-21T08:05:36.204 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:35 smithi107 ceph-mon[27622]: pgmap v47: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:36.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:35 smithi129 ceph-mon[34472]: pgmap v47: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:36.725 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-21T08:05:36.977 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:05:38.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:37 smithi129 ceph-mon[34472]: pgmap v48: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:38.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:37 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:05:38.278 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:37 smithi107 ceph-mon[27622]: pgmap v48: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:38.279 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:37 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:05:38.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.593+0000 7f3fb5782640 1 -- 172.21.15.107:0/4175708047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fb00fd5b0 msgr2=0x7f3fb00fd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:38.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.593+0000 7f3fb5782640 1 --2- 172.21.15.107:0/4175708047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fb00fd5b0 0x7f3fb00fd980 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00048d0 tx=0x7f3fa0009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:38.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.593+0000 7f3fb5782640 1 -- 172.21.15.107:0/4175708047 shutdown_connections 2024-09-21T08:05:38.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.593+0000 7f3fb5782640 1 --2- 172.21.15.107:0/4175708047 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3fb00fdf50 0x7f3fb0106590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:38.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.593+0000 7f3fb5782640 1 --2- 172.21.15.107:0/4175708047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fb00fd5b0 0x7f3fb00fd980 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:38.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.593+0000 7f3fb5782640 1 -- 172.21.15.107:0/4175708047 >> 172.21.15.107:0/4175708047 conn(0x7f3fb00f7000 msgr2=0x7f3fb00f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:38.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.593+0000 7f3fb5782640 1 -- 172.21.15.107:0/4175708047 shutdown_connections 2024-09-21T08:05:38.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.593+0000 7f3fb5782640 1 -- 172.21.15.107:0/4175708047 wait complete. 2024-09-21T08:05:38.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.594+0000 7f3fb5782640 1 Processor -- start 2024-09-21T08:05:38.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.594+0000 7f3fb5782640 1 -- start start 2024-09-21T08:05:38.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.594+0000 7f3fb5782640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fb00fd5b0 0x7f3fb00fb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:38.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.594+0000 7f3fb5782640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3fb00fdf50 0x7f3fb00fb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:38.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.594+0000 7f3fb5782640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00fbe60 con 0x7f3fb00fd5b0 2024-09-21T08:05:38.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.594+0000 7f3fb5782640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00fbfd0 con 0x7f3fb00fdf50 2024-09-21T08:05:38.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.594+0000 7f3faeffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fb00fd5b0 0x7f3fb00fb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:38.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.594+0000 7f3faeffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fb00fd5b0 0x7f3fb00fb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49194/0 (socket says 172.21.15.107:49194) 2024-09-21T08:05:38.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.594+0000 7f3faeffd640 1 -- 172.21.15.107:0/2482797753 learned_addr learned my addr 172.21.15.107:0/2482797753 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:05:38.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.594+0000 7f3fa7fff640 1 --2- 172.21.15.107:0/2482797753 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3fb00fdf50 0x7f3fb00fb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:38.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.595+0000 7f3faeffd640 1 -- 172.21.15.107:0/2482797753 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3fb00fdf50 msgr2=0x7f3fb00fb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:38.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.595+0000 7f3faeffd640 1 --2- 172.21.15.107:0/2482797753 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3fb00fdf50 0x7f3fb00fb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:38.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.595+0000 7f3faeffd640 1 -- 172.21.15.107:0/2482797753 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa0005040 con 0x7f3fb00fd5b0 2024-09-21T08:05:38.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.595+0000 7f3faeffd640 1 --2- 172.21.15.107:0/2482797753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fb00fd5b0 0x7f3fb00fb3e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0000c00 tx=0x7f3fa0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:38.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.595+0000 7f3fa77fe640 1 -- 172.21.15.107:0/2482797753 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fa0038070 con 0x7f3fb00fd5b0 2024-09-21T08:05:38.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.595+0000 7f3fa77fe640 1 -- 172.21.15.107:0/2482797753 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3fa002ade0 con 0x7f3fb00fd5b0 2024-09-21T08:05:38.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.595+0000 7f3fa77fe640 1 -- 172.21.15.107:0/2482797753 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fa002c7e0 con 0x7f3fb00fd5b0 2024-09-21T08:05:38.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.595+0000 7f3fb5782640 1 -- 172.21.15.107:0/2482797753 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb00fc200 con 0x7f3fb00fd5b0 2024-09-21T08:05:38.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.595+0000 7f3fb5782640 1 -- 172.21.15.107:0/2482797753 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb0119800 con 0x7f3fb00fd5b0 2024-09-21T08:05:38.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.596+0000 7f3fb5782640 1 -- 172.21.15.107:0/2482797753 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb00662d0 con 0x7f3fb00fd5b0 2024-09-21T08:05:38.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.597+0000 7f3fa77fe640 1 -- 172.21.15.107:0/2482797753 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f3fa0030020 con 0x7f3fb00fd5b0 2024-09-21T08:05:38.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.597+0000 7f3fa77fe640 1 --2- 172.21.15.107:0/2482797753 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3f9c06de30 0x7f3f9c0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:38.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.597+0000 7f3fa77fe640 1 -- 172.21.15.107:0/2482797753 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f3fa00ad440 con 0x7f3fb00fd5b0 2024-09-21T08:05:38.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.597+0000 7f3fa7fff640 1 --2- 172.21.15.107:0/2482797753 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3f9c06de30 0x7f3f9c0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:38.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.598+0000 7f3fa7fff640 1 --2- 172.21.15.107:0/2482797753 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3f9c06de30 0x7f3f9c0702e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00fcd20 tx=0x7f3f9800b040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:38.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.602+0000 7f3fa77fe640 1 -- 172.21.15.107:0/2482797753 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f3fa0076e80 con 0x7f3fb00fd5b0 2024-09-21T08:05:38.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.767+0000 7f3fb5782640 1 -- 172.21.15.107:0/2482797753 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f3fb00fac80 con 0x7f3fb00fd5b0 2024-09-21T08:05:38.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.767+0000 7f3fa77fe640 1 -- 172.21.15.107:0/2482797753 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v47)=0 v47) v1 ==== 163+0+0 (secure 0 0 0) 0x7f3fa007a540 con 0x7f3fb00fd5b0 2024-09-21T08:05:38.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.769+0000 7f3fb5782640 1 -- 172.21.15.107:0/2482797753 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3f9c06de30 msgr2=0x7f3f9c0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:38.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.769+0000 7f3fb5782640 1 --2- 172.21.15.107:0/2482797753 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3f9c06de30 0x7f3f9c0702e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00fcd20 tx=0x7f3f9800b040 comp rx=0 tx=0).stop 2024-09-21T08:05:38.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.769+0000 7f3fb5782640 1 -- 172.21.15.107:0/2482797753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fb00fd5b0 msgr2=0x7f3fb00fb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:38.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.769+0000 7f3fb5782640 1 --2- 172.21.15.107:0/2482797753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fb00fd5b0 0x7f3fb00fb3e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0000c00 tx=0x7f3fa0009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:38.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.769+0000 7f3fb5782640 1 -- 172.21.15.107:0/2482797753 shutdown_connections 2024-09-21T08:05:38.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.769+0000 7f3fb5782640 1 --2- 172.21.15.107:0/2482797753 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f3f9c06de30 0x7f3f9c0702e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:38.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.769+0000 7f3fb5782640 1 --2- 172.21.15.107:0/2482797753 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3fb00fdf50 0x7f3fb00fb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:38.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.769+0000 7f3fb5782640 1 --2- 172.21.15.107:0/2482797753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fb00fd5b0 0x7f3fb00fb3e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:38.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.769+0000 7f3fb5782640 1 -- 172.21.15.107:0/2482797753 >> 172.21.15.107:0/2482797753 conn(0x7f3fb00f7000 msgr2=0x7f3fb00f85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:38.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.769+0000 7f3fb5782640 1 -- 172.21.15.107:0/2482797753 shutdown_connections 2024-09-21T08:05:38.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:38.769+0000 7f3fb5782640 1 -- 172.21.15.107:0/2482797753 wait complete. 2024-09-21T08:05:39.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:39 smithi129 ceph-mon[34472]: mgrmap e33: smithi107.wzulxb(active, since 91s), standbys: smithi129.wvlmvo 2024-09-21T08:05:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:39 smithi107 ceph-mon[27622]: mgrmap e33: smithi107.wzulxb(active, since 91s), standbys: smithi129.wvlmvo 2024-09-21T08:05:39.528 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-21T08:05:39.776 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:05:40.203 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:40 smithi107 ceph-mon[27622]: pgmap v49: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T08:05:40.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:40 smithi129 ceph-mon[34472]: pgmap v49: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T08:05:41.210 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:41 smithi107 ceph-mon[27622]: pgmap v50: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T08:05:41.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:41 smithi129 ceph-mon[34472]: pgmap v50: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T08:05:41.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.416+0000 7f43938a9640 1 -- 172.21.15.107:0/4072335776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f438c102ef0 msgr2=0x7f438c0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:41.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.416+0000 7f43938a9640 1 --2- 172.21.15.107:0/4072335776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f438c102ef0 0x7f438c0fc5b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f437c0048d0 tx=0x7f437c009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:41.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.417+0000 7f43938a9640 1 -- 172.21.15.107:0/4072335776 shutdown_connections 2024-09-21T08:05:41.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.417+0000 7f43938a9640 1 --2- 172.21.15.107:0/4072335776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f438c102ef0 0x7f438c0fc5b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:41.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.417+0000 7f43938a9640 1 --2- 172.21.15.107:0/4072335776 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f438c102550 0x7f438c102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:41.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.417+0000 7f43938a9640 1 -- 172.21.15.107:0/4072335776 >> 172.21.15.107:0/4072335776 conn(0x7f438c0f80f0 msgr2=0x7f438c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:41.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.417+0000 7f43938a9640 1 -- 172.21.15.107:0/4072335776 shutdown_connections 2024-09-21T08:05:41.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.417+0000 7f43938a9640 1 -- 172.21.15.107:0/4072335776 wait complete. 2024-09-21T08:05:41.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.417+0000 7f43938a9640 1 Processor -- start 2024-09-21T08:05:41.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.417+0000 7f43938a9640 1 -- start start 2024-09-21T08:05:41.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.417+0000 7f43938a9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f438c102550 0x7f438c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:41.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.417+0000 7f43938a9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f438c102ef0 0x7f438c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:41.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.417+0000 7f43938a9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c070520 con 0x7f438c102ef0 2024-09-21T08:05:41.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.417+0000 7f43938a9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c070690 con 0x7f438c102550 2024-09-21T08:05:41.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.417+0000 7f4390e44640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f438c102ef0 0x7f438c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:41.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.417+0000 7f4390e44640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f438c102ef0 0x7f438c06ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52398/0 (socket says 172.21.15.107:52398) 2024-09-21T08:05:41.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.417+0000 7f4390e44640 1 -- 172.21.15.107:0/2289213454 learned_addr learned my addr 172.21.15.107:0/2289213454 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:05:41.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.418+0000 7f4390e44640 1 -- 172.21.15.107:0/2289213454 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f438c102550 msgr2=0x7f438c06fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:41.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.418+0000 7f4390e44640 1 --2- 172.21.15.107:0/2289213454 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f438c102550 0x7f438c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:41.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.418+0000 7f4390e44640 1 -- 172.21.15.107:0/2289213454 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437c005040 con 0x7f438c102ef0 2024-09-21T08:05:41.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.418+0000 7f4390e44640 1 --2- 172.21.15.107:0/2289213454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f438c102ef0 0x7f438c06ff50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f437c003080 tx=0x7f437c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:41.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.418+0000 7f4381ffb640 1 -- 172.21.15.107:0/2289213454 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f437c038070 con 0x7f438c102ef0 2024-09-21T08:05:41.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.418+0000 7f43938a9640 1 -- 172.21.15.107:0/2289213454 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438c1198b0 con 0x7f438c102ef0 2024-09-21T08:05:41.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.418+0000 7f4381ffb640 1 -- 172.21.15.107:0/2289213454 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f437c009760 con 0x7f438c102ef0 2024-09-21T08:05:41.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.418+0000 7f4381ffb640 1 -- 172.21.15.107:0/2289213454 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f437c033420 con 0x7f438c102ef0 2024-09-21T08:05:41.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.418+0000 7f43938a9640 1 -- 172.21.15.107:0/2289213454 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438c119be0 con 0x7f438c102ef0 2024-09-21T08:05:41.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.419+0000 7f43938a9640 1 -- 172.21.15.107:0/2289213454 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438c0fdcd0 con 0x7f438c102ef0 2024-09-21T08:05:41.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.420+0000 7f4381ffb640 1 -- 172.21.15.107:0/2289213454 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f437c030020 con 0x7f438c102ef0 2024-09-21T08:05:41.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.420+0000 7f4381ffb640 1 --2- 172.21.15.107:0/2289213454 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f437806de30 0x7f43780702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:41.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.421+0000 7f4381ffb640 1 -- 172.21.15.107:0/2289213454 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f437c0ad550 con 0x7f438c102ef0 2024-09-21T08:05:41.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.421+0000 7f4391645640 1 --2- 172.21.15.107:0/2289213454 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f437806de30 0x7f43780702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:41.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.421+0000 7f4391645640 1 --2- 172.21.15.107:0/2289213454 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f437806de30 0x7f43780702e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f43880097e0 tx=0x7f4388006d20 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:41.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.425+0000 7f4381ffb640 1 -- 172.21.15.107:0/2289213454 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f437c076ee0 con 0x7f438c102ef0 2024-09-21T08:05:41.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.591+0000 7f43938a9640 1 -- 172.21.15.107:0/2289213454 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f438c0fbd50 con 0x7f438c102ef0 2024-09-21T08:05:41.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.592+0000 7f4381ffb640 1 -- 172.21.15.107:0/2289213454 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v47)=0 v47) v1 ==== 135+0+0 (secure 0 0 0) 0x7f437c07a5a0 con 0x7f438c102ef0 2024-09-21T08:05:41.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.594+0000 7f43938a9640 1 -- 172.21.15.107:0/2289213454 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f437806de30 msgr2=0x7f43780702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:41.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.594+0000 7f43938a9640 1 --2- 172.21.15.107:0/2289213454 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f437806de30 0x7f43780702e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f43880097e0 tx=0x7f4388006d20 comp rx=0 tx=0).stop 2024-09-21T08:05:41.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.594+0000 7f43938a9640 1 -- 172.21.15.107:0/2289213454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f438c102ef0 msgr2=0x7f438c06ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:41.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.594+0000 7f43938a9640 1 --2- 172.21.15.107:0/2289213454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f438c102ef0 0x7f438c06ff50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f437c003080 tx=0x7f437c009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:41.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.594+0000 7f43938a9640 1 -- 172.21.15.107:0/2289213454 shutdown_connections 2024-09-21T08:05:41.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.594+0000 7f43938a9640 1 --2- 172.21.15.107:0/2289213454 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f437806de30 0x7f43780702e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:41.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.594+0000 7f43938a9640 1 --2- 172.21.15.107:0/2289213454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f438c102ef0 0x7f438c06ff50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:41.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.594+0000 7f43938a9640 1 --2- 172.21.15.107:0/2289213454 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f438c102550 0x7f438c06fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:41.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.594+0000 7f43938a9640 1 -- 172.21.15.107:0/2289213454 >> 172.21.15.107:0/2289213454 conn(0x7f438c0f80f0 msgr2=0x7f438c0f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:41.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.594+0000 7f43938a9640 1 -- 172.21.15.107:0/2289213454 shutdown_connections 2024-09-21T08:05:41.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:41.594+0000 7f43938a9640 1 -- 172.21.15.107:0/2289213454 wait complete. 2024-09-21T08:05:42.417 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-21T08:05:42.664 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:05:44.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.221+0000 7f294f9b1640 1 -- 172.21.15.107:0/3594011769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29481014b0 msgr2=0x7f2948101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:44.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.221+0000 7f294f9b1640 1 --2- 172.21.15.107:0/3594011769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29481014b0 0x7f2948101880 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f29440048d0 tx=0x7f2944009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:44.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.222+0000 7f294f9b1640 1 -- 172.21.15.107:0/3594011769 shutdown_connections 2024-09-21T08:05:44.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.222+0000 7f294f9b1640 1 --2- 172.21.15.107:0/3594011769 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29480fb470 0x7f29480fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:44.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.222+0000 7f294f9b1640 1 --2- 172.21.15.107:0/3594011769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29481014b0 0x7f2948101880 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:44.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.222+0000 7f294f9b1640 1 -- 172.21.15.107:0/3594011769 >> 172.21.15.107:0/3594011769 conn(0x7f29480f7030 msgr2=0x7f29480f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:44.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.222+0000 7f294f9b1640 1 -- 172.21.15.107:0/3594011769 shutdown_connections 2024-09-21T08:05:44.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.222+0000 7f294f9b1640 1 -- 172.21.15.107:0/3594011769 wait complete. 2024-09-21T08:05:44.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.222+0000 7f294f9b1640 1 Processor -- start 2024-09-21T08:05:44.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.222+0000 7f294f9b1640 1 -- start start 2024-09-21T08:05:44.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.223+0000 7f294f9b1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29480fb470 0x7f29481153b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:44.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.223+0000 7f294f9b1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29481014b0 0x7f29481158f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:44.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.223+0000 7f294f9b1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2948115ef0 con 0x7f29481014b0 2024-09-21T08:05:44.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.223+0000 7f294f9b1640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294810f330 con 0x7f29480fb470 2024-09-21T08:05:44.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.223+0000 7f294cf4c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29481014b0 0x7f29481158f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:44.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.223+0000 7f294cf4c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29481014b0 0x7f29481158f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52416/0 (socket says 172.21.15.107:52416) 2024-09-21T08:05:44.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.223+0000 7f294cf4c640 1 -- 172.21.15.107:0/148779619 learned_addr learned my addr 172.21.15.107:0/148779619 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:05:44.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.223+0000 7f294d74d640 1 --2- 172.21.15.107:0/148779619 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29480fb470 0x7f29481153b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:44.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.223+0000 7f294cf4c640 1 -- 172.21.15.107:0/148779619 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29480fb470 msgr2=0x7f29481153b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:44.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.223+0000 7f294cf4c640 1 --2- 172.21.15.107:0/148779619 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29480fb470 0x7f29481153b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:44.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.223+0000 7f294cf4c640 1 -- 172.21.15.107:0/148779619 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2944005040 con 0x7f29481014b0 2024-09-21T08:05:44.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.223+0000 7f294cf4c640 1 --2- 172.21.15.107:0/148779619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29481014b0 0x7f29481158f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f293800c830 tx=0x7f2938004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:44.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.223+0000 7f293dffb640 1 -- 172.21.15.107:0/148779619 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f293800a850 con 0x7f29481014b0 2024-09-21T08:05:44.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.223+0000 7f294f9b1640 1 -- 172.21.15.107:0/148779619 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294810f610 con 0x7f29481014b0 2024-09-21T08:05:44.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.223+0000 7f293dffb640 1 -- 172.21.15.107:0/148779619 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f293800ae50 con 0x7f29481014b0 2024-09-21T08:05:44.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.223+0000 7f293dffb640 1 -- 172.21.15.107:0/148779619 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29380113a0 con 0x7f29481014b0 2024-09-21T08:05:44.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.224+0000 7f294f9b1640 1 -- 172.21.15.107:0/148779619 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294810fbb0 con 0x7f29481014b0 2024-09-21T08:05:44.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.225+0000 7f294f9b1640 1 -- 172.21.15.107:0/148779619 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29480fcbb0 con 0x7f29481014b0 2024-09-21T08:05:44.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.225+0000 7f293dffb640 1 -- 172.21.15.107:0/148779619 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f2938012400 con 0x7f29481014b0 2024-09-21T08:05:44.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.225+0000 7f293dffb640 1 --2- 172.21.15.107:0/148779619 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f293406de30 0x7f29340702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:44.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.226+0000 7f293dffb640 1 -- 172.21.15.107:0/148779619 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f293808da00 con 0x7f29481014b0 2024-09-21T08:05:44.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.226+0000 7f294d74d640 1 --2- 172.21.15.107:0/148779619 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f293406de30 0x7f29340702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:44.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.226+0000 7f294d74d640 1 --2- 172.21.15.107:0/148779619 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f293406de30 0x7f29340702e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2944009ac0 tx=0x7f2944035040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:44.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.230+0000 7f293dffb640 1 -- 172.21.15.107:0/148779619 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f2938057410 con 0x7f29481014b0 2024-09-21T08:05:44.268 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:43 smithi107 ceph-mon[27622]: pgmap v51: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T08:05:44.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:43 smithi129 ceph-mon[34472]: pgmap v51: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T08:05:44.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.414+0000 7f294f9b1640 1 -- 172.21.15.107:0/148779619 --> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", "target": ["mon-mgr", ""]}) v1 -- 0x7f2948108430 con 0x7f293406de30 2024-09-21T08:05:44.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.420+0000 7f293dffb640 1 -- 172.21.15.107:0/148779619 <== mgr.14644 v2:172.21.15.107:6800/695383021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f2948108430 con 0x7f293406de30 2024-09-21T08:05:44.421 INFO:teuthology.orchestra.run.smithi107.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T08:05:44.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.422+0000 7f294f9b1640 1 -- 172.21.15.107:0/148779619 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f293406de30 msgr2=0x7f29340702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:44.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.422+0000 7f294f9b1640 1 --2- 172.21.15.107:0/148779619 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f293406de30 0x7f29340702e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2944009ac0 tx=0x7f2944035040 comp rx=0 tx=0).stop 2024-09-21T08:05:44.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.422+0000 7f294f9b1640 1 -- 172.21.15.107:0/148779619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29481014b0 msgr2=0x7f29481158f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:44.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.422+0000 7f294f9b1640 1 --2- 172.21.15.107:0/148779619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29481014b0 0x7f29481158f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f293800c830 tx=0x7f2938004430 comp rx=0 tx=0).stop 2024-09-21T08:05:44.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.422+0000 7f294f9b1640 1 -- 172.21.15.107:0/148779619 shutdown_connections 2024-09-21T08:05:44.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.422+0000 7f294f9b1640 1 --2- 172.21.15.107:0/148779619 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f293406de30 0x7f29340702e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:44.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.422+0000 7f294f9b1640 1 --2- 172.21.15.107:0/148779619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29481014b0 0x7f29481158f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:44.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.422+0000 7f294f9b1640 1 --2- 172.21.15.107:0/148779619 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29480fb470 0x7f29481153b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:44.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.422+0000 7f294f9b1640 1 -- 172.21.15.107:0/148779619 >> 172.21.15.107:0/148779619 conn(0x7f29480f7030 msgr2=0x7f29480fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:44.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.422+0000 7f294f9b1640 1 -- 172.21.15.107:0/148779619 shutdown_connections 2024-09-21T08:05:44.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:44.422+0000 7f294f9b1640 1 -- 172.21.15.107:0/148779619 wait complete. 2024-09-21T08:05:45.104 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T08:05:45.104 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi107.front.sepia.ceph.com 2024-09-21T08:05:45.105 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-21T08:05:45.369 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:05:45.746 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:45 smithi107 ceph-mon[27622]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:05:45.746 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:45 smithi107 ceph-mon[27622]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T08:05:45.746 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:45 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:45.746 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:45 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:05:45.746 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:45 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:05:45.746 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:45 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:05:45.746 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:45 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:45.746 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:45 smithi107 ceph-mon[27622]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T08:05:45.747 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:45 smithi107 ceph-mon[27622]: pgmap v52: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T08:05:45.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:45 smithi129 ceph-mon[34472]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:05:45.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:45 smithi129 ceph-mon[34472]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T08:05:45.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:45 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:45.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:45 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:05:45.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:45 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:05:45.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:45 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:05:45.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:45 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:45.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:45 smithi129 ceph-mon[34472]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T08:05:45.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:45 smithi129 ceph-mon[34472]: pgmap v52: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T08:05:48.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:47 smithi129 ceph-mon[34472]: pgmap v53: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T08:05:48.287 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:47 smithi107 ceph-mon[27622]: pgmap v53: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T08:05:48.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.284+0000 7f18cb098640 1 -- 172.21.15.107:0/1691837123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18c40fb810 msgr2=0x7f18c40fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:48.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.284+0000 7f18cb098640 1 --2- 172.21.15.107:0/1691837123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18c40fb810 0x7f18c40fbbe0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f18b40048d0 tx=0x7f18b4009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:48.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.284+0000 7f18cb098640 1 -- 172.21.15.107:0/1691837123 shutdown_connections 2024-09-21T08:05:48.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.284+0000 7f18cb098640 1 --2- 172.21.15.107:0/1691837123 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f18c40fcf80 0x7f18c40fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:48.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.284+0000 7f18cb098640 1 --2- 172.21.15.107:0/1691837123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18c40fb810 0x7f18c40fbbe0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:48.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.284+0000 7f18cb098640 1 -- 172.21.15.107:0/1691837123 >> 172.21.15.107:0/1691837123 conn(0x7f18c40723b0 msgr2=0x7f18c40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:48.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.284+0000 7f18cb098640 1 -- 172.21.15.107:0/1691837123 shutdown_connections 2024-09-21T08:05:48.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.285+0000 7f18cb098640 1 -- 172.21.15.107:0/1691837123 wait complete. 2024-09-21T08:05:48.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.285+0000 7f18cb098640 1 Processor -- start 2024-09-21T08:05:48.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.285+0000 7f18cb098640 1 -- start start 2024-09-21T08:05:48.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.286+0000 7f18cb098640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f18c40fb810 0x7f18c410e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:48.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.286+0000 7f18cb098640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18c40fcf80 0x7f18c410e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:48.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.286+0000 7f18cb098640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c410ed40 con 0x7f18c40fcf80 2024-09-21T08:05:48.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.286+0000 7f18cb098640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c410eeb0 con 0x7f18c40fb810 2024-09-21T08:05:48.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.286+0000 7f18c3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18c40fcf80 0x7f18c410e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:48.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.286+0000 7f18c3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18c40fcf80 0x7f18c410e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52430/0 (socket says 172.21.15.107:52430) 2024-09-21T08:05:48.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.286+0000 7f18c3fff640 1 -- 172.21.15.107:0/1868052738 learned_addr learned my addr 172.21.15.107:0/1868052738 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:05:48.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.286+0000 7f18c8e34640 1 --2- 172.21.15.107:0/1868052738 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f18c40fb810 0x7f18c410e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:48.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.286+0000 7f18c3fff640 1 -- 172.21.15.107:0/1868052738 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f18c40fb810 msgr2=0x7f18c410e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:48.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.286+0000 7f18c3fff640 1 --2- 172.21.15.107:0/1868052738 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f18c40fb810 0x7f18c410e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:48.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.286+0000 7f18c3fff640 1 -- 172.21.15.107:0/1868052738 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b4005040 con 0x7f18c40fcf80 2024-09-21T08:05:48.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.286+0000 7f18c3fff640 1 --2- 172.21.15.107:0/1868052738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18c40fcf80 0x7f18c410e6f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f18ac002a50 tx=0x7f18ac004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:48.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.286+0000 7f18c17fa640 1 -- 172.21.15.107:0/1868052738 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18ac007c30 con 0x7f18c40fcf80 2024-09-21T08:05:48.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.286+0000 7f18cb098640 1 -- 172.21.15.107:0/1868052738 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c4117220 con 0x7f18c40fcf80 2024-09-21T08:05:48.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.286+0000 7f18c17fa640 1 -- 172.21.15.107:0/1868052738 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f18ac00f040 con 0x7f18c40fcf80 2024-09-21T08:05:48.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.286+0000 7f18c17fa640 1 -- 172.21.15.107:0/1868052738 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18ac00da10 con 0x7f18c40fcf80 2024-09-21T08:05:48.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.286+0000 7f18cb098640 1 -- 172.21.15.107:0/1868052738 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c4117730 con 0x7f18c40fcf80 2024-09-21T08:05:48.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.287+0000 7f18cb098640 1 -- 172.21.15.107:0/1868052738 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c40fcbc0 con 0x7f18c40fcf80 2024-09-21T08:05:48.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.288+0000 7f18c17fa640 1 -- 172.21.15.107:0/1868052738 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f18ac00dc80 con 0x7f18c40fcf80 2024-09-21T08:05:48.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.289+0000 7f18c17fa640 1 --2- 172.21.15.107:0/1868052738 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f18b006de30 0x7f18b00702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:48.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.289+0000 7f18c17fa640 1 -- 172.21.15.107:0/1868052738 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f18ac08cf00 con 0x7f18c40fcf80 2024-09-21T08:05:48.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.289+0000 7f18c8e34640 1 --2- 172.21.15.107:0/1868052738 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f18b006de30 0x7f18b00702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:48.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.289+0000 7f18c8e34640 1 --2- 172.21.15.107:0/1868052738 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f18b006de30 0x7f18b00702e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f18b4009ac0 tx=0x7f18b4035040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:48.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.297+0000 7f18c17fa640 1 -- 172.21.15.107:0/1868052738 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f18ac056940 con 0x7f18c40fcf80 2024-09-21T08:05:48.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.489+0000 7f18cb098640 1 -- 172.21.15.107:0/1868052738 --> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f18c404b720 con 0x7f18b006de30 2024-09-21T08:05:48.492 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.490+0000 7f18c17fa640 1 -- 172.21.15.107:0/1868052738 <== mgr.14644 v2:172.21.15.107:6800/695383021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f18c404b720 con 0x7f18b006de30 2024-09-21T08:05:48.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.492+0000 7f18cb098640 1 -- 172.21.15.107:0/1868052738 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f18b006de30 msgr2=0x7f18b00702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:48.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.492+0000 7f18cb098640 1 --2- 172.21.15.107:0/1868052738 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f18b006de30 0x7f18b00702e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f18b4009ac0 tx=0x7f18b4035040 comp rx=0 tx=0).stop 2024-09-21T08:05:48.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.492+0000 7f18cb098640 1 -- 172.21.15.107:0/1868052738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18c40fcf80 msgr2=0x7f18c410e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:48.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.492+0000 7f18cb098640 1 --2- 172.21.15.107:0/1868052738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18c40fcf80 0x7f18c410e6f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f18ac002a50 tx=0x7f18ac004600 comp rx=0 tx=0).stop 2024-09-21T08:05:48.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.492+0000 7f18cb098640 1 -- 172.21.15.107:0/1868052738 shutdown_connections 2024-09-21T08:05:48.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.492+0000 7f18cb098640 1 --2- 172.21.15.107:0/1868052738 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f18b006de30 0x7f18b00702e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:48.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.492+0000 7f18cb098640 1 --2- 172.21.15.107:0/1868052738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18c40fcf80 0x7f18c410e6f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:48.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.492+0000 7f18cb098640 1 --2- 172.21.15.107:0/1868052738 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f18c40fb810 0x7f18c410e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:48.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.492+0000 7f18cb098640 1 -- 172.21.15.107:0/1868052738 >> 172.21.15.107:0/1868052738 conn(0x7f18c40723b0 msgr2=0x7f18c40fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:48.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.492+0000 7f18cb098640 1 -- 172.21.15.107:0/1868052738 shutdown_connections 2024-09-21T08:05:48.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.492+0000 7f18cb098640 1 -- 172.21.15.107:0/1868052738 wait complete. 2024-09-21T08:05:48.503 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:05:48.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.572+0000 7fd517ebe640 1 -- 172.21.15.107:0/4068134062 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5100fe460 msgr2=0x7fd5100fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:48.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.572+0000 7fd517ebe640 1 --2- 172.21.15.107:0/4068134062 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5100fe460 0x7fd5100fe830 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd5080048d0 tx=0x7fd508009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:48.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.572+0000 7fd517ebe640 1 -- 172.21.15.107:0/4068134062 shutdown_connections 2024-09-21T08:05:48.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.572+0000 7fd517ebe640 1 --2- 172.21.15.107:0/4068134062 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd5100fabe0 0x7fd5100fb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:48.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.572+0000 7fd517ebe640 1 --2- 172.21.15.107:0/4068134062 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5100fe460 0x7fd5100fe830 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:48.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.572+0000 7fd517ebe640 1 -- 172.21.15.107:0/4068134062 >> 172.21.15.107:0/4068134062 conn(0x7fd510071b00 msgr2=0x7fd510071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:48.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.573+0000 7fd517ebe640 1 -- 172.21.15.107:0/4068134062 shutdown_connections 2024-09-21T08:05:48.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.573+0000 7fd517ebe640 1 -- 172.21.15.107:0/4068134062 wait complete. 2024-09-21T08:05:48.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.573+0000 7fd517ebe640 1 Processor -- start 2024-09-21T08:05:48.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.573+0000 7fd517ebe640 1 -- start start 2024-09-21T08:05:48.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.573+0000 7fd517ebe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5100fabe0 0x7fd510113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:48.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.573+0000 7fd517ebe640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd5100fe460 0x7fd510113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:48.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.573+0000 7fd517ebe640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd510113e00 con 0x7fd5100fabe0 2024-09-21T08:05:48.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.573+0000 7fd517ebe640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51010d1b0 con 0x7fd5100fe460 2024-09-21T08:05:48.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.573+0000 7fd515c5a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5100fabe0 0x7fd510113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:48.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.573+0000 7fd515c5a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5100fabe0 0x7fd510113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52450/0 (socket says 172.21.15.107:52450) 2024-09-21T08:05:48.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.573+0000 7fd515c5a640 1 -- 172.21.15.107:0/2922428949 learned_addr learned my addr 172.21.15.107:0/2922428949 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:05:48.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.574+0000 7fd515459640 1 --2- 172.21.15.107:0/2922428949 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd5100fe460 0x7fd510113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:48.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.574+0000 7fd515c5a640 1 -- 172.21.15.107:0/2922428949 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd5100fe460 msgr2=0x7fd510113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:48.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.574+0000 7fd515c5a640 1 --2- 172.21.15.107:0/2922428949 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd5100fe460 0x7fd510113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:48.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.574+0000 7fd515c5a640 1 -- 172.21.15.107:0/2922428949 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd508005040 con 0x7fd5100fabe0 2024-09-21T08:05:48.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.574+0000 7fd515c5a640 1 --2- 172.21.15.107:0/2922428949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5100fabe0 0x7fd510113230 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd508003080 tx=0x7fd508009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:48.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.574+0000 7fd50e7fc640 1 -- 172.21.15.107:0/2922428949 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd508038070 con 0x7fd5100fabe0 2024-09-21T08:05:48.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.574+0000 7fd517ebe640 1 -- 172.21.15.107:0/2922428949 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51010d430 con 0x7fd5100fabe0 2024-09-21T08:05:48.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.574+0000 7fd50e7fc640 1 -- 172.21.15.107:0/2922428949 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd50802ade0 con 0x7fd5100fabe0 2024-09-21T08:05:48.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.574+0000 7fd50e7fc640 1 -- 172.21.15.107:0/2922428949 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd50802c880 con 0x7fd5100fabe0 2024-09-21T08:05:48.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.574+0000 7fd517ebe640 1 -- 172.21.15.107:0/2922428949 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51010d890 con 0x7fd5100fabe0 2024-09-21T08:05:48.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.575+0000 7fd517ebe640 1 -- 172.21.15.107:0/2922428949 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd510064d50 con 0x7fd5100fabe0 2024-09-21T08:05:48.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.576+0000 7fd50e7fc640 1 -- 172.21.15.107:0/2922428949 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7fd508030020 con 0x7fd5100fabe0 2024-09-21T08:05:48.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.576+0000 7fd50e7fc640 1 --2- 172.21.15.107:0/2922428949 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fd4f806de30 0x7fd4f80702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:48.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.576+0000 7fd50e7fc640 1 -- 172.21.15.107:0/2922428949 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fd5080ad7c0 con 0x7fd5100fabe0 2024-09-21T08:05:48.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.576+0000 7fd515459640 1 --2- 172.21.15.107:0/2922428949 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fd4f806de30 0x7fd4f80702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:48.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.577+0000 7fd515459640 1 --2- 172.21.15.107:0/2922428949 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fd4f806de30 0x7fd4f80702e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd51010eaf0 tx=0x7fd504008040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:48.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.580+0000 7fd50e7fc640 1 -- 172.21.15.107:0/2922428949 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fd5080771d0 con 0x7fd5100fabe0 2024-09-21T08:05:48.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.769+0000 7fd517ebe640 1 -- 172.21.15.107:0/2922428949 --> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd51010e8a0 con 0x7fd4f806de30 2024-09-21T08:05:48.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.771+0000 7fd50e7fc640 1 -- 172.21.15.107:0/2922428949 <== mgr.14644 v2:172.21.15.107:6800/695383021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fd51010e8a0 con 0x7fd4f806de30 2024-09-21T08:05:48.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.773+0000 7fd517ebe640 1 -- 172.21.15.107:0/2922428949 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fd4f806de30 msgr2=0x7fd4f80702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:48.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.773+0000 7fd517ebe640 1 --2- 172.21.15.107:0/2922428949 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fd4f806de30 0x7fd4f80702e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd51010eaf0 tx=0x7fd504008040 comp rx=0 tx=0).stop 2024-09-21T08:05:48.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.773+0000 7fd517ebe640 1 -- 172.21.15.107:0/2922428949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5100fabe0 msgr2=0x7fd510113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:48.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.773+0000 7fd517ebe640 1 --2- 172.21.15.107:0/2922428949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5100fabe0 0x7fd510113230 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd508003080 tx=0x7fd508009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:48.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.773+0000 7fd517ebe640 1 -- 172.21.15.107:0/2922428949 shutdown_connections 2024-09-21T08:05:48.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.773+0000 7fd517ebe640 1 --2- 172.21.15.107:0/2922428949 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fd4f806de30 0x7fd4f80702e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:48.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.773+0000 7fd517ebe640 1 --2- 172.21.15.107:0/2922428949 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd5100fe460 0x7fd510113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:48.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.773+0000 7fd517ebe640 1 --2- 172.21.15.107:0/2922428949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5100fabe0 0x7fd510113230 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:48.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.773+0000 7fd517ebe640 1 -- 172.21.15.107:0/2922428949 >> 172.21.15.107:0/2922428949 conn(0x7fd510071b00 msgr2=0x7fd5100f9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:48.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.773+0000 7fd517ebe640 1 -- 172.21.15.107:0/2922428949 shutdown_connections 2024-09-21T08:05:48.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.773+0000 7fd517ebe640 1 -- 172.21.15.107:0/2922428949 wait complete. 2024-09-21T08:05:48.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.853+0000 7f5ba288a640 1 -- 172.21.15.107:0/4080147069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b9c0fe460 msgr2=0x7f5b9c0fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:48.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.853+0000 7f5ba288a640 1 --2- 172.21.15.107:0/4080147069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b9c0fe460 0x7f5b9c0fe830 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0048d0 tx=0x7f5b8c009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:48.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.854+0000 7f5ba288a640 1 -- 172.21.15.107:0/4080147069 shutdown_connections 2024-09-21T08:05:48.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.854+0000 7f5ba288a640 1 --2- 172.21.15.107:0/4080147069 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5b9c064fc0 0x7f5b9c065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:48.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.854+0000 7f5ba288a640 1 --2- 172.21.15.107:0/4080147069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b9c0fe460 0x7f5b9c0fe830 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:48.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.854+0000 7f5ba288a640 1 -- 172.21.15.107:0/4080147069 >> 172.21.15.107:0/4080147069 conn(0x7f5b9c0723b0 msgr2=0x7f5b9c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:48.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.854+0000 7f5ba288a640 1 -- 172.21.15.107:0/4080147069 shutdown_connections 2024-09-21T08:05:48.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.854+0000 7f5ba288a640 1 -- 172.21.15.107:0/4080147069 wait complete. 2024-09-21T08:05:48.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.854+0000 7f5ba288a640 1 Processor -- start 2024-09-21T08:05:48.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.854+0000 7f5ba288a640 1 -- start start 2024-09-21T08:05:48.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.855+0000 7f5ba288a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b9c064fc0 0x7f5b9c115400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:48.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.855+0000 7f5ba288a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5b9c0fe460 0x7f5b9c115940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:48.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.855+0000 7f5ba288a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c115fd0 con 0x7f5b9c064fc0 2024-09-21T08:05:48.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.855+0000 7f5ba288a640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c10f3c0 con 0x7f5b9c0fe460 2024-09-21T08:05:48.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.855+0000 7f5b9bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b9c064fc0 0x7f5b9c115400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:48.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.855+0000 7f5b9bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b9c064fc0 0x7f5b9c115400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52464/0 (socket says 172.21.15.107:52464) 2024-09-21T08:05:48.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.855+0000 7f5b9bfff640 1 -- 172.21.15.107:0/731831580 learned_addr learned my addr 172.21.15.107:0/731831580 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:05:48.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.855+0000 7f5b9b7fe640 1 --2- 172.21.15.107:0/731831580 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5b9c0fe460 0x7f5b9c115940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:48.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.855+0000 7f5b9bfff640 1 -- 172.21.15.107:0/731831580 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5b9c0fe460 msgr2=0x7f5b9c115940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:48.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.855+0000 7f5b9bfff640 1 --2- 172.21.15.107:0/731831580 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5b9c0fe460 0x7f5b9c115940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:48.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.855+0000 7f5b9bfff640 1 -- 172.21.15.107:0/731831580 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8c005040 con 0x7f5b9c064fc0 2024-09-21T08:05:48.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.855+0000 7f5b9b7fe640 1 --2- 172.21.15.107:0/731831580 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5b9c0fe460 0x7f5b9c115940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:05:48.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.855+0000 7f5b9bfff640 1 --2- 172.21.15.107:0/731831580 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b9c064fc0 0x7f5b9c115400 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c003080 tx=0x7f5b8c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:48.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.855+0000 7f5b98ff9640 1 -- 172.21.15.107:0/731831580 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b8c038070 con 0x7f5b9c064fc0 2024-09-21T08:05:48.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.855+0000 7f5ba288a640 1 -- 172.21.15.107:0/731831580 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b9c10f640 con 0x7f5b9c064fc0 2024-09-21T08:05:48.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.855+0000 7f5b98ff9640 1 -- 172.21.15.107:0/731831580 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5b8c0097e0 con 0x7f5b9c064fc0 2024-09-21T08:05:48.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.855+0000 7f5b98ff9640 1 -- 172.21.15.107:0/731831580 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b8c03d420 con 0x7f5b9c064fc0 2024-09-21T08:05:48.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.856+0000 7f5ba288a640 1 -- 172.21.15.107:0/731831580 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b9c10fb00 con 0x7f5b9c064fc0 2024-09-21T08:05:48.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.857+0000 7f5ba288a640 1 -- 172.21.15.107:0/731831580 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b9c0fdcf0 con 0x7f5b9c064fc0 2024-09-21T08:05:48.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.857+0000 7f5b98ff9640 1 -- 172.21.15.107:0/731831580 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f5b8c030020 con 0x7f5b9c064fc0 2024-09-21T08:05:48.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.858+0000 7f5b98ff9640 1 --2- 172.21.15.107:0/731831580 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f5b8406de30 0x7f5b840702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:48.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.858+0000 7f5b98ff9640 1 -- 172.21.15.107:0/731831580 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f5b8c0add70 con 0x7f5b9c064fc0 2024-09-21T08:05:48.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.858+0000 7f5b9b7fe640 1 --2- 172.21.15.107:0/731831580 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f5b8406de30 0x7f5b840702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:48.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.858+0000 7f5b9b7fe640 1 --2- 172.21.15.107:0/731831580 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f5b8406de30 0x7f5b840702e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c110d00 tx=0x7f5b90008040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:48.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:48.862+0000 7f5b98ff9640 1 -- 172.21.15.107:0/731831580 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f5b8c077700 con 0x7f5b9c064fc0 2024-09-21T08:05:49.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.039+0000 7f5ba288a640 1 -- 172.21.15.107:0/731831580 --> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b9c04b7b0 con 0x7f5b8406de30 2024-09-21T08:05:49.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.048+0000 7f5b98ff9640 1 -- 172.21.15.107:0/731831580 <== mgr.14644 v2:172.21.15.107:6800/695383021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f5b9c04b7b0 con 0x7f5b8406de30 2024-09-21T08:05:49.050 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:05:49.050 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (2m) 50s ago 10m 25.7M - 0.25.0 c8568f914cd2 2b499aa3b7de 2024-09-21T08:05:49.050 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (11m) 50s ago 11m 6899k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 4557b307c7dd 2024-09-21T08:05:49.050 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (10m) 74s ago 10m 6895k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be e74e9385abdf 2024-09-21T08:05:49.050 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (56s) 50s ago 10m 46.1M - 9.4.12 2bacad6d85d8 63177dcfe25c 2024-09-21T08:05:49.050 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (5m) 50s ago 5m 155M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 3bc779f88228 2024-09-21T08:05:49.051 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (5m) 50s ago 5m 13.0M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be ea8f140aade7 2024-09-21T08:05:49.051 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (5m) 74s ago 5m 15.9M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 329346c3afec 2024-09-21T08:05:49.051 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (5m) 74s ago 5m 17.3M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be baf87f32bfbc 2024-09-21T08:05:49.051 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:8443,9283,8765 running (2m) 50s ago 12m 499M - 19.1.1-367-g9e2ac70b cc9251b744a3 49c237734f07 2024-09-21T08:05:49.051 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283,8765 running (77s) 74s ago 10m 78.0M - 19.1.1-367-g9e2ac70b cc9251b744a3 ed117096bdd8 2024-09-21T08:05:49.051 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (12m) 50s ago 12m 51.5M 2048M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7702e48722c8 2024-09-21T08:05:49.051 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (10m) 74s ago 10m 43.4M 2048M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be d9680c5a5b92 2024-09-21T08:05:49.051 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 running (2m) 50s ago 11m 17.1M - 1.5.0 0da6a335fe13 6de7c307ba0f 2024-09-21T08:05:49.051 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (2m) 74s ago 10m 16.8M - 1.5.0 0da6a335fe13 cb6d4577b24c 2024-09-21T08:05:49.051 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (9m) 50s ago 9m 244M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 6799bdf55207 2024-09-21T08:05:49.051 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (8m) 50s ago 8m 259M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 29d8ce3f3a52 2024-09-21T08:05:49.051 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (8m) 50s ago 8m 209M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be c9e1c4756c02 2024-09-21T08:05:49.051 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (8m) 74s ago 8m 278M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7d58f70b105c 2024-09-21T08:05:49.051 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (7m) 74s ago 7m 251M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 2f916ef76d22 2024-09-21T08:05:49.051 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (7m) 74s ago 7m 234M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 0f25d9454304 2024-09-21T08:05:49.051 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (82s) 50s ago 10m 50.7M - 2.43.0 a07b618ecd1d 9ed2abf5e8d8 2024-09-21T08:05:49.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.050+0000 7f5ba288a640 1 -- 172.21.15.107:0/731831580 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f5b8406de30 msgr2=0x7f5b840702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:49.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.050+0000 7f5ba288a640 1 --2- 172.21.15.107:0/731831580 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f5b8406de30 0x7f5b840702e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c110d00 tx=0x7f5b90008040 comp rx=0 tx=0).stop 2024-09-21T08:05:49.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.050+0000 7f5ba288a640 1 -- 172.21.15.107:0/731831580 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b9c064fc0 msgr2=0x7f5b9c115400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:49.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.050+0000 7f5ba288a640 1 --2- 172.21.15.107:0/731831580 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b9c064fc0 0x7f5b9c115400 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c003080 tx=0x7f5b8c009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.050+0000 7f5ba288a640 1 -- 172.21.15.107:0/731831580 shutdown_connections 2024-09-21T08:05:49.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.050+0000 7f5ba288a640 1 --2- 172.21.15.107:0/731831580 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f5b8406de30 0x7f5b840702e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.050+0000 7f5ba288a640 1 --2- 172.21.15.107:0/731831580 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5b9c0fe460 0x7f5b9c115940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.050+0000 7f5ba288a640 1 --2- 172.21.15.107:0/731831580 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b9c064fc0 0x7f5b9c115400 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.050+0000 7f5ba288a640 1 -- 172.21.15.107:0/731831580 >> 172.21.15.107:0/731831580 conn(0x7f5b9c0723b0 msgr2=0x7f5b9c103400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:49.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.050+0000 7f5ba288a640 1 -- 172.21.15.107:0/731831580 shutdown_connections 2024-09-21T08:05:49.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.050+0000 7f5ba288a640 1 -- 172.21.15.107:0/731831580 wait complete. 2024-09-21T08:05:49.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.128+0000 7f766fcfa640 1 -- 172.21.15.107:0/2544180060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76680fb490 msgr2=0x7f76680fb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:49.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.128+0000 7f766fcfa640 1 --2- 172.21.15.107:0/2544180060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76680fb490 0x7f76680fb900 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f76580048d0 tx=0x7f7658009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.128+0000 7f766fcfa640 1 -- 172.21.15.107:0/2544180060 shutdown_connections 2024-09-21T08:05:49.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.128+0000 7f766fcfa640 1 --2- 172.21.15.107:0/2544180060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76680fb490 0x7f76680fb900 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.128+0000 7f766fcfa640 1 --2- 172.21.15.107:0/2544180060 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76681014d0 0x7f76681018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.128+0000 7f766fcfa640 1 -- 172.21.15.107:0/2544180060 >> 172.21.15.107:0/2544180060 conn(0x7f76680f7050 msgr2=0x7f76680f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:49.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.128+0000 7f766fcfa640 1 -- 172.21.15.107:0/2544180060 shutdown_connections 2024-09-21T08:05:49.131 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:49 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:49.131 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:49 smithi107 ceph-mon[27622]: Upgrade: Target is version 19.1.1-367-g9e2ac70b (squid) 2024-09-21T08:05:49.131 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:49 smithi107 ceph-mon[27622]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, digests ['quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5'] 2024-09-21T08:05:49.131 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:49 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:05:49.132 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:49 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:49.132 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:49 smithi107 ceph-mon[27622]: Upgrade: Setting container_image for all mgr 2024-09-21T08:05:49.132 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:49 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:49.132 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:49 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T08:05:49.132 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:49 smithi107 ceph-mon[27622]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:05:49.132 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:49 smithi107 ceph-mon[27622]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:05:49.132 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:49 smithi107 ceph-mon[27622]: pgmap v54: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T08:05:49.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.129+0000 7f766fcfa640 1 -- 172.21.15.107:0/2544180060 wait complete. 2024-09-21T08:05:49.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.129+0000 7f766fcfa640 1 Processor -- start 2024-09-21T08:05:49.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.129+0000 7f766fcfa640 1 -- start start 2024-09-21T08:05:49.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.129+0000 7f766fcfa640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76680fb490 0x7f766810bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:49.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.129+0000 7f766fcfa640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76681014d0 0x7f766810c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:49.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.129+0000 7f766fcfa640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766810ca60 con 0x7f76680fb490 2024-09-21T08:05:49.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.129+0000 7f766fcfa640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766810cba0 con 0x7f76681014d0 2024-09-21T08:05:49.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.129+0000 7f766da96640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76680fb490 0x7f766810bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:49.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.129+0000 7f766da96640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76680fb490 0x7f766810bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52480/0 (socket says 172.21.15.107:52480) 2024-09-21T08:05:49.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.129+0000 7f766da96640 1 -- 172.21.15.107:0/816053363 learned_addr learned my addr 172.21.15.107:0/816053363 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:05:49.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.130+0000 7f766da96640 1 -- 172.21.15.107:0/816053363 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76681014d0 msgr2=0x7f766810c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:49.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.130+0000 7f766d295640 1 --2- 172.21.15.107:0/816053363 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76681014d0 0x7f766810c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:49.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.130+0000 7f766da96640 1 --2- 172.21.15.107:0/816053363 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76681014d0 0x7f766810c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.130+0000 7f766da96640 1 -- 172.21.15.107:0/816053363 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7658005040 con 0x7f76680fb490 2024-09-21T08:05:49.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.130+0000 7f766da96640 1 --2- 172.21.15.107:0/816053363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76680fb490 0x7f766810bfe0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f766400b790 tx=0x7f76640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:49.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.130+0000 7f765e7fc640 1 -- 172.21.15.107:0/816053363 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f766400c700 con 0x7f76680fb490 2024-09-21T08:05:49.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.130+0000 7f765e7fc640 1 -- 172.21.15.107:0/816053363 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f766400cd00 con 0x7f76680fb490 2024-09-21T08:05:49.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.130+0000 7f766fcfa640 1 -- 172.21.15.107:0/816053363 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7668119650 con 0x7f76680fb490 2024-09-21T08:05:49.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.130+0000 7f765e7fc640 1 -- 172.21.15.107:0/816053363 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7664015e80 con 0x7f76680fb490 2024-09-21T08:05:49.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.130+0000 7f766fcfa640 1 -- 172.21.15.107:0/816053363 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76681199d0 con 0x7f76680fb490 2024-09-21T08:05:49.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.131+0000 7f766fcfa640 1 -- 172.21.15.107:0/816053363 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76680fcbd0 con 0x7f76680fb490 2024-09-21T08:05:49.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.131+0000 7f765e7fc640 1 -- 172.21.15.107:0/816053363 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f7664012070 con 0x7f76680fb490 2024-09-21T08:05:49.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.132+0000 7f765e7fc640 1 --2- 172.21.15.107:0/816053363 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f765406de30 0x7f76540702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:49.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.132+0000 7f766d295640 1 --2- 172.21.15.107:0/816053363 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f765406de30 0x7f76540702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:49.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.132+0000 7f765e7fc640 1 -- 172.21.15.107:0/816053363 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f766408d0e0 con 0x7f76680fb490 2024-09-21T08:05:49.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.133+0000 7f766d295640 1 --2- 172.21.15.107:0/816053363 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f765406de30 0x7f76540702e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7658007ac0 tx=0x7f7658009da0 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:49.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.136+0000 7f765e7fc640 1 -- 172.21.15.107:0/816053363 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f7664056a70 con 0x7f76680fb490 2024-09-21T08:05:49.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.372+0000 7f766fcfa640 1 -- 172.21.15.107:0/816053363 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f76680fac50 con 0x7f76680fb490 2024-09-21T08:05:49.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.372+0000 7f765e7fc640 1 -- 172.21.15.107:0/816053363 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f766405a130 con 0x7f76680fb490 2024-09-21T08:05:49.375 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:05:49.375 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": { 2024-09-21T08:05:49.375 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 2 2024-09-21T08:05:49.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:05:49.375 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": { 2024-09-21T08:05:49.375 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:05:49.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:05:49.375 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": { 2024-09-21T08:05:49.375 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 6 2024-09-21T08:05:49.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:05:49.375 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-21T08:05:49.376 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 4 2024-09-21T08:05:49.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:05:49.376 INFO:teuthology.orchestra.run.smithi107.stdout: "overall": { 2024-09-21T08:05:49.376 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 12, 2024-09-21T08:05:49.376 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:05:49.376 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-21T08:05:49.376 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:05:49.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.374+0000 7f766fcfa640 1 -- 172.21.15.107:0/816053363 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f765406de30 msgr2=0x7f76540702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:49.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.374+0000 7f766fcfa640 1 --2- 172.21.15.107:0/816053363 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f765406de30 0x7f76540702e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7658007ac0 tx=0x7f7658009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.374+0000 7f766fcfa640 1 -- 172.21.15.107:0/816053363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76680fb490 msgr2=0x7f766810bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:49.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.374+0000 7f766fcfa640 1 --2- 172.21.15.107:0/816053363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76680fb490 0x7f766810bfe0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f766400b790 tx=0x7f76640091d0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.374+0000 7f766fcfa640 1 -- 172.21.15.107:0/816053363 shutdown_connections 2024-09-21T08:05:49.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.374+0000 7f766fcfa640 1 --2- 172.21.15.107:0/816053363 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7f765406de30 0x7f76540702e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.374+0000 7f766fcfa640 1 --2- 172.21.15.107:0/816053363 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76681014d0 0x7f766810c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.374+0000 7f766fcfa640 1 --2- 172.21.15.107:0/816053363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76680fb490 0x7f766810bfe0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.374+0000 7f766fcfa640 1 -- 172.21.15.107:0/816053363 >> 172.21.15.107:0/816053363 conn(0x7f76680f7050 msgr2=0x7f76680f88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:49.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.375+0000 7f766fcfa640 1 -- 172.21.15.107:0/816053363 shutdown_connections 2024-09-21T08:05:49.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.375+0000 7f766fcfa640 1 -- 172.21.15.107:0/816053363 wait complete. 2024-09-21T08:05:49.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.452+0000 7fbc5082f640 1 -- 172.21.15.107:0/4093335494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc4c0fdf20 msgr2=0x7fbc4c1065f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:49.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.452+0000 7fbc5082f640 1 --2- 172.21.15.107:0/4093335494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc4c0fdf20 0x7fbc4c1065f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbc40004900 tx=0x7fbc40009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.452+0000 7fbc5082f640 1 -- 172.21.15.107:0/4093335494 shutdown_connections 2024-09-21T08:05:49.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.452+0000 7fbc5082f640 1 --2- 172.21.15.107:0/4093335494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc4c0fdf20 0x7fbc4c1065f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.452+0000 7fbc5082f640 1 --2- 172.21.15.107:0/4093335494 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbc4c0fd580 0x7fbc4c0fd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.452+0000 7fbc5082f640 1 -- 172.21.15.107:0/4093335494 >> 172.21.15.107:0/4093335494 conn(0x7fbc4c0f7060 msgr2=0x7fbc4c0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:49.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.452+0000 7fbc5082f640 1 -- 172.21.15.107:0/4093335494 shutdown_connections 2024-09-21T08:05:49.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.452+0000 7fbc5082f640 1 -- 172.21.15.107:0/4093335494 wait complete. 2024-09-21T08:05:49.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.453+0000 7fbc5082f640 1 Processor -- start 2024-09-21T08:05:49.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.453+0000 7fbc5082f640 1 -- start start 2024-09-21T08:05:49.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.453+0000 7fbc5082f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc4c0fd580 0x7fbc4c113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:49.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.453+0000 7fbc5082f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbc4c0fdf20 0x7fbc4c1137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:49.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.453+0000 7fbc5082f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c113dd0 con 0x7fbc4c0fd580 2024-09-21T08:05:49.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.453+0000 7fbc5082f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c10d210 con 0x7fbc4c0fdf20 2024-09-21T08:05:49.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.453+0000 7fbc4a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc4c0fd580 0x7fbc4c113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:49.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.453+0000 7fbc4a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc4c0fd580 0x7fbc4c113290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52510/0 (socket says 172.21.15.107:52510) 2024-09-21T08:05:49.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.454+0000 7fbc4a59c640 1 -- 172.21.15.107:0/1136919802 learned_addr learned my addr 172.21.15.107:0/1136919802 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:05:49.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.454+0000 7fbc49d9b640 1 --2- 172.21.15.107:0/1136919802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbc4c0fdf20 0x7fbc4c1137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:49.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.454+0000 7fbc4a59c640 1 -- 172.21.15.107:0/1136919802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbc4c0fdf20 msgr2=0x7fbc4c1137d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:49.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.454+0000 7fbc4a59c640 1 --2- 172.21.15.107:0/1136919802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbc4c0fdf20 0x7fbc4c1137d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.454+0000 7fbc4a59c640 1 -- 172.21.15.107:0/1136919802 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc40005040 con 0x7fbc4c0fd580 2024-09-21T08:05:49.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.454+0000 7fbc4a59c640 1 --2- 172.21.15.107:0/1136919802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc4c0fd580 0x7fbc4c113290 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c002a50 tx=0x7fbc3c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:49.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.454+0000 7fbc3affd640 1 -- 172.21.15.107:0/1136919802 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc3c007c30 con 0x7fbc4c0fd580 2024-09-21T08:05:49.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.454+0000 7fbc3affd640 1 -- 172.21.15.107:0/1136919802 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbc3c00f040 con 0x7fbc4c0fd580 2024-09-21T08:05:49.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.454+0000 7fbc5082f640 1 -- 172.21.15.107:0/1136919802 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4c10d4f0 con 0x7fbc4c0fd580 2024-09-21T08:05:49.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.454+0000 7fbc3affd640 1 -- 172.21.15.107:0/1136919802 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc3c00dad0 con 0x7fbc4c0fd580 2024-09-21T08:05:49.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.454+0000 7fbc5082f640 1 -- 172.21.15.107:0/1136919802 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4c10da10 con 0x7fbc4c0fd580 2024-09-21T08:05:49.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.455+0000 7fbc5082f640 1 -- 172.21.15.107:0/1136919802 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4c0662d0 con 0x7fbc4c0fd580 2024-09-21T08:05:49.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.456+0000 7fbc3affd640 1 -- 172.21.15.107:0/1136919802 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7fbc3c00dc30 con 0x7fbc4c0fd580 2024-09-21T08:05:49.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.456+0000 7fbc3affd640 1 --2- 172.21.15.107:0/1136919802 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fbc3406de30 0x7fbc340702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:49.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.456+0000 7fbc49d9b640 1 --2- 172.21.15.107:0/1136919802 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fbc3406de30 0x7fbc340702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:49.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.456+0000 7fbc3affd640 1 -- 172.21.15.107:0/1136919802 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fbc3c08d5a0 con 0x7fbc4c0fd580 2024-09-21T08:05:49.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.457+0000 7fbc49d9b640 1 --2- 172.21.15.107:0/1136919802 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fbc3406de30 0x7fbc340702e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbc40004540 tx=0x7fbc40035040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:49.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.461+0000 7fbc3affd640 1 -- 172.21.15.107:0/1136919802 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fbc3c056fb0 con 0x7fbc4c0fd580 2024-09-21T08:05:49.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:49 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:49.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:49 smithi129 ceph-mon[34472]: Upgrade: Target is version 19.1.1-367-g9e2ac70b (squid) 2024-09-21T08:05:49.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:49 smithi129 ceph-mon[34472]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, digests ['quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5'] 2024-09-21T08:05:49.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:49 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:05:49.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:49 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:49.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:49 smithi129 ceph-mon[34472]: Upgrade: Setting container_image for all mgr 2024-09-21T08:05:49.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:49 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:49.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:49 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T08:05:49.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:49 smithi129 ceph-mon[34472]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:05:49.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:49 smithi129 ceph-mon[34472]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:05:49.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:49 smithi129 ceph-mon[34472]: pgmap v54: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T08:05:49.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.676+0000 7fbc5082f640 1 -- 172.21.15.107:0/1136919802 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbc4c04b770 con 0x7fbc4c0fd580 2024-09-21T08:05:49.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.676+0000 7fbc3affd640 1 -- 172.21.15.107:0/1136919802 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1814 (secure 0 0 0) 0x7fbc3c05a670 con 0x7fbc4c0fd580 2024-09-21T08:05:49.679 INFO:teuthology.orchestra.run.smithi107.stdout:e15 2024-09-21T08:05:49.679 INFO:teuthology.orchestra.run.smithi107.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T08:05:49.679 INFO:teuthology.orchestra.run.smithi107.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:05:49.679 INFO:teuthology.orchestra.run.smithi107.stdout:legacy client fscid: 1 2024-09-21T08:05:49.679 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:05:49.680 INFO:teuthology.orchestra.run.smithi107.stdout:Filesystem 'cephfs' (1) 2024-09-21T08:05:49.680 INFO:teuthology.orchestra.run.smithi107.stdout:fs_name cephfs 2024-09-21T08:05:49.680 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 15 2024-09-21T08:05:49.680 INFO:teuthology.orchestra.run.smithi107.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T08:05:49.680 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-09-21T08:00:03.244314+0000 2024-09-21T08:05:49.680 INFO:teuthology.orchestra.run.smithi107.stdout:modified 2024-09-21T08:00:21.458971+0000 2024-09-21T08:05:49.680 INFO:teuthology.orchestra.run.smithi107.stdout:tableserver 0 2024-09-21T08:05:49.680 INFO:teuthology.orchestra.run.smithi107.stdout:root 0 2024-09-21T08:05:49.680 INFO:teuthology.orchestra.run.smithi107.stdout:session_timeout 60 2024-09-21T08:05:49.680 INFO:teuthology.orchestra.run.smithi107.stdout:session_autoclose 300 2024-09-21T08:05:49.680 INFO:teuthology.orchestra.run.smithi107.stdout:max_file_size 1099511627776 2024-09-21T08:05:49.680 INFO:teuthology.orchestra.run.smithi107.stdout:required_client_features {} 2024-09-21T08:05:49.680 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure 0 2024-09-21T08:05:49.680 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure_osd_epoch 44 2024-09-21T08:05:49.680 INFO:teuthology.orchestra.run.smithi107.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:05:49.681 INFO:teuthology.orchestra.run.smithi107.stdout:max_mds 1 2024-09-21T08:05:49.681 INFO:teuthology.orchestra.run.smithi107.stdout:in 0 2024-09-21T08:05:49.681 INFO:teuthology.orchestra.run.smithi107.stdout:up {0=14458} 2024-09-21T08:05:49.681 INFO:teuthology.orchestra.run.smithi107.stdout:failed 2024-09-21T08:05:49.681 INFO:teuthology.orchestra.run.smithi107.stdout:damaged 2024-09-21T08:05:49.681 INFO:teuthology.orchestra.run.smithi107.stdout:stopped 2024-09-21T08:05:49.681 INFO:teuthology.orchestra.run.smithi107.stdout:data_pools [3] 2024-09-21T08:05:49.681 INFO:teuthology.orchestra.run.smithi107.stdout:metadata_pool 2 2024-09-21T08:05:49.681 INFO:teuthology.orchestra.run.smithi107.stdout:inline_data disabled 2024-09-21T08:05:49.681 INFO:teuthology.orchestra.run.smithi107.stdout:balancer 2024-09-21T08:05:49.681 INFO:teuthology.orchestra.run.smithi107.stdout:standby_count_wanted 1 2024-09-21T08:05:49.681 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.grqzkt{0:14458} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:05:49.681 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:05:49.681 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:05:49.681 INFO:teuthology.orchestra.run.smithi107.stdout:Standby daemons: 2024-09-21T08:05:49.681 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:05:49.681 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.qusoyf{-1:14468} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6826/2352538667,v1:172.21.15.107:6827/2352538667] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:05:49.682 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.fwmfcy{-1:24239} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:05:49.682 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.belyba{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:05:49.682 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 15 2024-09-21T08:05:49.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.678+0000 7fbc5082f640 1 -- 172.21.15.107:0/1136919802 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fbc3406de30 msgr2=0x7fbc340702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:49.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.678+0000 7fbc5082f640 1 --2- 172.21.15.107:0/1136919802 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fbc3406de30 0x7fbc340702e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbc40004540 tx=0x7fbc40035040 comp rx=0 tx=0).stop 2024-09-21T08:05:49.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.678+0000 7fbc5082f640 1 -- 172.21.15.107:0/1136919802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc4c0fd580 msgr2=0x7fbc4c113290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:49.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.678+0000 7fbc5082f640 1 --2- 172.21.15.107:0/1136919802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc4c0fd580 0x7fbc4c113290 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c002a50 tx=0x7fbc3c004600 comp rx=0 tx=0).stop 2024-09-21T08:05:49.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.678+0000 7fbc5082f640 1 -- 172.21.15.107:0/1136919802 shutdown_connections 2024-09-21T08:05:49.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.678+0000 7fbc5082f640 1 --2- 172.21.15.107:0/1136919802 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fbc3406de30 0x7fbc340702e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.678+0000 7fbc5082f640 1 --2- 172.21.15.107:0/1136919802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbc4c0fdf20 0x7fbc4c1137d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.678+0000 7fbc5082f640 1 --2- 172.21.15.107:0/1136919802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc4c0fd580 0x7fbc4c113290 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.678+0000 7fbc5082f640 1 -- 172.21.15.107:0/1136919802 >> 172.21.15.107:0/1136919802 conn(0x7fbc4c0f7060 msgr2=0x7fbc4c0f85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:49.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.679+0000 7fbc5082f640 1 -- 172.21.15.107:0/1136919802 shutdown_connections 2024-09-21T08:05:49.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.679+0000 7fbc5082f640 1 -- 172.21.15.107:0/1136919802 wait complete. 2024-09-21T08:05:49.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.762+0000 7fd121089640 1 -- 172.21.15.107:0/2217832952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd11c0fb810 msgr2=0x7fd11c0fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:49.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.762+0000 7fd121089640 1 --2- 172.21.15.107:0/2217832952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd11c0fb810 0x7fd11c0fbbe0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0048d0 tx=0x7fd10c009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.762+0000 7fd121089640 1 -- 172.21.15.107:0/2217832952 shutdown_connections 2024-09-21T08:05:49.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.762+0000 7fd121089640 1 --2- 172.21.15.107:0/2217832952 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd11c0fcf80 0x7fd11c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.762+0000 7fd121089640 1 --2- 172.21.15.107:0/2217832952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd11c0fb810 0x7fd11c0fbbe0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.762+0000 7fd121089640 1 -- 172.21.15.107:0/2217832952 >> 172.21.15.107:0/2217832952 conn(0x7fd11c0723b0 msgr2=0x7fd11c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:49.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.762+0000 7fd121089640 1 -- 172.21.15.107:0/2217832952 shutdown_connections 2024-09-21T08:05:49.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.762+0000 7fd121089640 1 -- 172.21.15.107:0/2217832952 wait complete. 2024-09-21T08:05:49.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.763+0000 7fd121089640 1 Processor -- start 2024-09-21T08:05:49.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.763+0000 7fd121089640 1 -- start start 2024-09-21T08:05:49.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.763+0000 7fd121089640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd11c0fb810 0x7fd11c10e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:49.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.763+0000 7fd121089640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd11c0fcf80 0x7fd11c10e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.763+0000 7fd121089640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c10ecd0 con 0x7fd11c0fb810 2024-09-21T08:05:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.763+0000 7fd121089640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c10ee40 con 0x7fd11c0fcf80 2024-09-21T08:05:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.763+0000 7fd11ad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd11c0fb810 0x7fd11c10e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.763+0000 7fd11ad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd11c0fb810 0x7fd11c10e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52538/0 (socket says 172.21.15.107:52538) 2024-09-21T08:05:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.763+0000 7fd11ad9d640 1 -- 172.21.15.107:0/8387431 learned_addr learned my addr 172.21.15.107:0/8387431 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:05:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.764+0000 7fd11a59c640 1 --2- 172.21.15.107:0/8387431 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd11c0fcf80 0x7fd11c10e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.764+0000 7fd11ad9d640 1 -- 172.21.15.107:0/8387431 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd11c0fcf80 msgr2=0x7fd11c10e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.764+0000 7fd11ad9d640 1 --2- 172.21.15.107:0/8387431 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd11c0fcf80 0x7fd11c10e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.764+0000 7fd11ad9d640 1 -- 172.21.15.107:0/8387431 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10c005040 con 0x7fd11c0fb810 2024-09-21T08:05:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.764+0000 7fd11ad9d640 1 --2- 172.21.15.107:0/8387431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd11c0fb810 0x7fd11c10e190 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd10c000c00 tx=0x7fd10c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:49.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.764+0000 7fd1037fe640 1 -- 172.21.15.107:0/8387431 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd10c038070 con 0x7fd11c0fb810 2024-09-21T08:05:49.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.764+0000 7fd121089640 1 -- 172.21.15.107:0/8387431 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd11c117200 con 0x7fd11c0fb810 2024-09-21T08:05:49.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.764+0000 7fd1037fe640 1 -- 172.21.15.107:0/8387431 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd10c02ade0 con 0x7fd11c0fb810 2024-09-21T08:05:49.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.764+0000 7fd1037fe640 1 -- 172.21.15.107:0/8387431 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd10c02c7e0 con 0x7fd11c0fb810 2024-09-21T08:05:49.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.764+0000 7fd121089640 1 -- 172.21.15.107:0/8387431 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11c117660 con 0x7fd11c0fb810 2024-09-21T08:05:49.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.765+0000 7fd121089640 1 -- 172.21.15.107:0/8387431 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd11c0fcbc0 con 0x7fd11c0fb810 2024-09-21T08:05:49.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.766+0000 7fd1037fe640 1 -- 172.21.15.107:0/8387431 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7fd10c030020 con 0x7fd11c0fb810 2024-09-21T08:05:49.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.766+0000 7fd1037fe640 1 --2- 172.21.15.107:0/8387431 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fd10406de30 0x7fd1040702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:49.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.767+0000 7fd1037fe640 1 -- 172.21.15.107:0/8387431 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fd10c0ad440 con 0x7fd11c0fb810 2024-09-21T08:05:49.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.767+0000 7fd11a59c640 1 --2- 172.21.15.107:0/8387431 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fd10406de30 0x7fd1040702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:49.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.767+0000 7fd11a59c640 1 --2- 172.21.15.107:0/8387431 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fd10406de30 0x7fd1040702e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd110007fd0 tx=0x7fd110009e90 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:49.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.771+0000 7fd1037fe640 1 -- 172.21.15.107:0/8387431 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fd10c076e80 con 0x7fd11c0fb810 2024-09-21T08:05:49.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.963+0000 7fd121089640 1 -- 172.21.15.107:0/8387431 --> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd11c065750 con 0x7fd10406de30 2024-09-21T08:05:49.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.964+0000 7fd1037fe640 1 -- 172.21.15.107:0/8387431 <== mgr.14644 v2:172.21.15.107:6800/695383021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fd11c065750 con 0x7fd10406de30 2024-09-21T08:05:49.967 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:05:49.967 INFO:teuthology.orchestra.run.smithi107.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5", 2024-09-21T08:05:49.967 INFO:teuthology.orchestra.run.smithi107.stdout: "in_progress": true, 2024-09-21T08:05:49.967 INFO:teuthology.orchestra.run.smithi107.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T08:05:49.967 INFO:teuthology.orchestra.run.smithi107.stdout: "services_complete": [ 2024-09-21T08:05:49.967 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr" 2024-09-21T08:05:49.967 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-21T08:05:49.968 INFO:teuthology.orchestra.run.smithi107.stdout: "progress": "2/21 daemons upgraded", 2024-09-21T08:05:49.968 INFO:teuthology.orchestra.run.smithi107.stdout: "message": "Currently upgrading mon daemons", 2024-09-21T08:05:49.968 INFO:teuthology.orchestra.run.smithi107.stdout: "is_paused": false 2024-09-21T08:05:49.968 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:05:49.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.966+0000 7fd121089640 1 -- 172.21.15.107:0/8387431 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fd10406de30 msgr2=0x7fd1040702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:49.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.966+0000 7fd121089640 1 --2- 172.21.15.107:0/8387431 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fd10406de30 0x7fd1040702e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd110007fd0 tx=0x7fd110009e90 comp rx=0 tx=0).stop 2024-09-21T08:05:49.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.966+0000 7fd121089640 1 -- 172.21.15.107:0/8387431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd11c0fb810 msgr2=0x7fd11c10e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:49.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.966+0000 7fd121089640 1 --2- 172.21.15.107:0/8387431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd11c0fb810 0x7fd11c10e190 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd10c000c00 tx=0x7fd10c009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.966+0000 7fd121089640 1 -- 172.21.15.107:0/8387431 shutdown_connections 2024-09-21T08:05:49.970 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.966+0000 7fd121089640 1 --2- 172.21.15.107:0/8387431 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fd10406de30 0x7fd1040702e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.970 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.966+0000 7fd121089640 1 --2- 172.21.15.107:0/8387431 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd11c0fcf80 0x7fd11c10e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.970 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.966+0000 7fd121089640 1 --2- 172.21.15.107:0/8387431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd11c0fb810 0x7fd11c10e190 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:49.970 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.966+0000 7fd121089640 1 -- 172.21.15.107:0/8387431 >> 172.21.15.107:0/8387431 conn(0x7fd11c0723b0 msgr2=0x7fd11c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:49.970 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.967+0000 7fd121089640 1 -- 172.21.15.107:0/8387431 shutdown_connections 2024-09-21T08:05:49.970 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:49.967+0000 7fd121089640 1 -- 172.21.15.107:0/8387431 wait complete. 2024-09-21T08:05:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.046+0000 7fe14a3f7640 1 -- 172.21.15.107:0/2834027857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1440fabd0 msgr2=0x7fe1440fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.046+0000 7fe14a3f7640 1 --2- 172.21.15.107:0/2834027857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1440fabd0 0x7fe1440fb040 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe1380048d0 tx=0x7fe138009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.046+0000 7fe14a3f7640 1 -- 172.21.15.107:0/2834027857 shutdown_connections 2024-09-21T08:05:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.046+0000 7fe14a3f7640 1 --2- 172.21.15.107:0/2834027857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1440fabd0 0x7fe1440fb040 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.046+0000 7fe14a3f7640 1 --2- 172.21.15.107:0/2834027857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe144102680 0x7fe144102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.046+0000 7fe14a3f7640 1 -- 172.21.15.107:0/2834027857 >> 172.21.15.107:0/2834027857 conn(0x7fe144071ac0 msgr2=0x7fe144071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:50.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.046+0000 7fe14a3f7640 1 -- 172.21.15.107:0/2834027857 shutdown_connections 2024-09-21T08:05:50.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.046+0000 7fe14a3f7640 1 -- 172.21.15.107:0/2834027857 wait complete. 2024-09-21T08:05:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.046+0000 7fe14a3f7640 1 Processor -- start 2024-09-21T08:05:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.047+0000 7fe14a3f7640 1 -- start start 2024-09-21T08:05:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.047+0000 7fe14a3f7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe1440fabd0 0x7fe1441132e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.047+0000 7fe14a3f7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe144102680 0x7fe144113820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.047+0000 7fe14a3f7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe144113eb0 con 0x7fe144102680 2024-09-21T08:05:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.047+0000 7fe14a3f7640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14410d260 con 0x7fe1440fabd0 2024-09-21T08:05:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.047+0000 7fe1437fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe144102680 0x7fe144113820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.047+0000 7fe1437fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe144102680 0x7fe144113820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52552/0 (socket says 172.21.15.107:52552) 2024-09-21T08:05:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.047+0000 7fe1437fe640 1 -- 172.21.15.107:0/3718085742 learned_addr learned my addr 172.21.15.107:0/3718085742 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:05:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.047+0000 7fe143fff640 1 --2- 172.21.15.107:0/3718085742 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe1440fabd0 0x7fe1441132e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.047+0000 7fe1437fe640 1 -- 172.21.15.107:0/3718085742 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe1440fabd0 msgr2=0x7fe1441132e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.047+0000 7fe1437fe640 1 --2- 172.21.15.107:0/3718085742 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe1440fabd0 0x7fe1441132e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.047+0000 7fe1437fe640 1 -- 172.21.15.107:0/3718085742 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe138005040 con 0x7fe144102680 2024-09-21T08:05:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.047+0000 7fe143fff640 1 --2- 172.21.15.107:0/3718085742 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe1440fabd0 0x7fe1441132e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:05:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.047+0000 7fe1437fe640 1 --2- 172.21.15.107:0/3718085742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe144102680 0x7fe144113820 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe138003080 tx=0x7fe138009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.048+0000 7fe140ff9640 1 -- 172.21.15.107:0/3718085742 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe138038070 con 0x7fe144102680 2024-09-21T08:05:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.048+0000 7fe140ff9640 1 -- 172.21.15.107:0/3718085742 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe1380097e0 con 0x7fe144102680 2024-09-21T08:05:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.048+0000 7fe140ff9640 1 -- 172.21.15.107:0/3718085742 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe13803d420 con 0x7fe144102680 2024-09-21T08:05:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.048+0000 7fe14a3f7640 1 -- 172.21.15.107:0/3718085742 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14410d4e0 con 0x7fe144102680 2024-09-21T08:05:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.048+0000 7fe14a3f7640 1 -- 172.21.15.107:0/3718085742 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14410d9a0 con 0x7fe144102680 2024-09-21T08:05:50.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.049+0000 7fe14a3f7640 1 -- 172.21.15.107:0/3718085742 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1440725d0 con 0x7fe144102680 2024-09-21T08:05:50.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.049+0000 7fe140ff9640 1 -- 172.21.15.107:0/3718085742 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7fe138030020 con 0x7fe144102680 2024-09-21T08:05:50.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.050+0000 7fe140ff9640 1 --2- 172.21.15.107:0/3718085742 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fe12c06de30 0x7fe12c0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:50.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.050+0000 7fe140ff9640 1 -- 172.21.15.107:0/3718085742 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe1380adc90 con 0x7fe144102680 2024-09-21T08:05:50.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.050+0000 7fe143fff640 1 --2- 172.21.15.107:0/3718085742 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fe12c06de30 0x7fe12c0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:50.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.050+0000 7fe143fff640 1 --2- 172.21.15.107:0/3718085742 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fe12c06de30 0x7fe12c0702e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe134006fd0 tx=0x7fe134008040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:50.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.054+0000 7fe140ff9640 1 -- 172.21.15.107:0/3718085742 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fe1380776a0 con 0x7fe144102680 2024-09-21T08:05:50.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.300+0000 7fe14a3f7640 1 -- 172.21.15.107:0/3718085742 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe14410e950 con 0x7fe144102680 2024-09-21T08:05:50.302 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:50 smithi107 ceph-mon[27622]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:05:50.303 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:50 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/816053363' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:50.303 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:50 smithi107 ceph-mon[27622]: Upgrade: Updating mon.smithi107 2024-09-21T08:05:50.303 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:50 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:50.303 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:50 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T08:05:50.303 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:50 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T08:05:50.303 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:50 smithi107 ceph-mon[27622]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:05:50.303 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:50 smithi107 ceph-mon[27622]: Deploying daemon mon.smithi107 on smithi107 2024-09-21T08:05:50.303 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:50 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/1136919802' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:05:50.303 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:50 smithi107 ceph-mon[27622]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:05:50.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.300+0000 7fe140ff9640 1 -- 172.21.15.107:0/3718085742 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe13807ad60 con 0x7fe144102680 2024-09-21T08:05:50.304 INFO:teuthology.orchestra.run.smithi107.stdout:HEALTH_OK 2024-09-21T08:05:50.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.302+0000 7fe14a3f7640 1 -- 172.21.15.107:0/3718085742 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fe12c06de30 msgr2=0x7fe12c0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:50.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.302+0000 7fe14a3f7640 1 --2- 172.21.15.107:0/3718085742 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fe12c06de30 0x7fe12c0702e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe134006fd0 tx=0x7fe134008040 comp rx=0 tx=0).stop 2024-09-21T08:05:50.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.302+0000 7fe14a3f7640 1 -- 172.21.15.107:0/3718085742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe144102680 msgr2=0x7fe144113820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:50.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.302+0000 7fe14a3f7640 1 --2- 172.21.15.107:0/3718085742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe144102680 0x7fe144113820 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe138003080 tx=0x7fe138009da0 comp rx=0 tx=0).stop 2024-09-21T08:05:50.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.302+0000 7fe14a3f7640 1 -- 172.21.15.107:0/3718085742 shutdown_connections 2024-09-21T08:05:50.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.302+0000 7fe14a3f7640 1 --2- 172.21.15.107:0/3718085742 >> [v2:172.21.15.107:6800/695383021,v1:172.21.15.107:6801/695383021] conn(0x7fe12c06de30 0x7fe12c0702e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:50.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.302+0000 7fe14a3f7640 1 --2- 172.21.15.107:0/3718085742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe144102680 0x7fe144113820 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:50.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.302+0000 7fe14a3f7640 1 --2- 172.21.15.107:0/3718085742 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe1440fabd0 0x7fe1441132e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:50.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.302+0000 7fe14a3f7640 1 -- 172.21.15.107:0/3718085742 >> 172.21.15.107:0/3718085742 conn(0x7fe144071ac0 msgr2=0x7fe144105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:50.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.302+0000 7fe14a3f7640 1 -- 172.21.15.107:0/3718085742 shutdown_connections 2024-09-21T08:05:50.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:05:50.302+0000 7fe14a3f7640 1 -- 172.21.15.107:0/3718085742 wait complete. 2024-09-21T08:05:50.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:50 smithi129 ceph-mon[34472]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:05:50.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:50 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/816053363' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:05:50.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:50 smithi129 ceph-mon[34472]: Upgrade: Updating mon.smithi107 2024-09-21T08:05:50.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:50 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' 2024-09-21T08:05:50.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:50 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T08:05:50.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:50 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T08:05:50.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:50 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:05:50.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:50 smithi129 ceph-mon[34472]: Deploying daemon mon.smithi107 on smithi107 2024-09-21T08:05:50.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:50 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/1136919802' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:05:50.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:50 smithi129 ceph-mon[34472]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:05:51.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:51 smithi107 ceph-mon[27622]: from='client.? 172.21.15.107:0/3718085742' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:05:51.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:51 smithi107 ceph-mon[27622]: pgmap v55: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:51.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:51 smithi129 ceph-mon[34472]: from='client.? 172.21.15.107:0/3718085742' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:05:51.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:51 smithi129 ceph-mon[34472]: pgmap v55: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:51.569 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:51 smithi107 systemd[1]: Stopping Ceph mon.smithi107 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:05:51.863 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:51 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107[27618]: 2024-09-21T08:05:51.566+0000 7f8a65328640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi107 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:05:51.863 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:51 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107[27618]: 2024-09-21T08:05:51.566+0000 7f8a65328640 -1 mon.smithi107@0(leader) e2 *** Got Signal Terminated *** 2024-09-21T08:05:51.863 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:51 smithi107 podman[97587]: 2024-09-21 08:05:51.75172281 +0000 UTC m=+0.296886104 container died 7702e48722c8f04d2809df9bac4dacb54849beb2f19ddcccbf94f118eb7f2a67 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107, io.buildah.version=1.37.2, RELEASE=quincy-fbd1a6a, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T08:05:52.545 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:52 smithi107 podman[97587]: 2024-09-21 08:05:52.201013637 +0000 UTC m=+0.746176930 container cleanup 7702e48722c8f04d2809df9bac4dacb54849beb2f19ddcccbf94f118eb7f2a67 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, RELEASE=quincy-fbd1a6a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T08:05:52.545 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:52 smithi107 bash[97587]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107 2024-09-21T08:05:52.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:52 smithi107 podman[97599]: 2024-09-21 08:05:52.544318814 +0000 UTC m=+0.787857205 container remove 7702e48722c8f04d2809df9bac4dacb54849beb2f19ddcccbf94f118eb7f2a67 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=quincy-fbd1a6a, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:05:52.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:52 smithi107 systemd[1]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490@mon.smithi107.service: Deactivated successfully. 2024-09-21T08:05:52.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:52 smithi107 systemd[1]: Stopped Ceph mon.smithi107 for 786d4f32-77ee-11ef-baf6-efdc52797490. 2024-09-21T08:05:52.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:52 smithi107 systemd[1]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490@mon.smithi107.service: Consumed 10.928s CPU time. 2024-09-21T08:05:53.256 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:52 smithi107 systemd[1]: Starting Ceph mon.smithi107 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:05:53.257 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 podman[97739]: 2024-09-21 08:05:53.011201676 +0000 UTC m=+0.016282403 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:05:53.257 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 podman[97739]: 2024-09-21 08:05:53.14561137 +0000 UTC m=+0.150692142 container create 445b3e6a800f7b9f506c554a80d1c0100204aba499bcb4d49dabda3d32ac6bcd (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T08:05:53.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 podman[97739]: 2024-09-21 08:05:53.373020873 +0000 UTC m=+0.378101600 container init 445b3e6a800f7b9f506c554a80d1c0100204aba499bcb4d49dabda3d32ac6bcd (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T08:05:53.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 podman[97739]: 2024-09-21 08:05:53.376185755 +0000 UTC m=+0.381266482 container start 445b3e6a800f7b9f506c554a80d1c0100204aba499bcb4d49dabda3d32ac6bcd (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T08:05:53.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T08:05:53.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable), process ceph-mon, pid 2 2024-09-21T08:05:53.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: pidfile_write: ignore empty --pid-file 2024-09-21T08:05:53.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: load: jerasure load: lrc 2024-09-21T08:05:53.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: RocksDB version: 7.9.2 2024-09-21T08:05:53.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Git sha 0 2024-09-21T08:05:53.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Compile date 2024-09-19 18:20:48 2024-09-21T08:05:53.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: DB SUMMARY 2024-09-21T08:05:53.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: DB Session ID: ZCN8F9CC16G52XJP0QBM 2024-09-21T08:05:53.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: CURRENT file: CURRENT 2024-09-21T08:05:53.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T08:05:53.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1155 Bytes 2024-09-21T08:05:53.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi107/store.db dir, Total Num: 1, files: 000033.sst 2024-09-21T08:05:53.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi107/store.db: 000031.log size: 389710 ; 2024-09-21T08:05:53.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.error_if_exists: 0 2024-09-21T08:05:53.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.create_if_missing: 0 2024-09-21T08:05:53.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.paranoid_checks: 1 2024-09-21T08:05:53.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T08:05:53.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T08:05:53.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T08:05:53.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.env: 0x55f41faec940 2024-09-21T08:05:53.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T08:05:53.557 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.info_log: 0x55f4210678c0 2024-09-21T08:05:53.557 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T08:05:53.558 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.statistics: (nil) 2024-09-21T08:05:53.558 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.use_fsync: 0 2024-09-21T08:05:53.558 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_log_file_size: 0 2024-09-21T08:05:53.558 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T08:05:53.558 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T08:05:53.558 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T08:05:53.558 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T08:05:53.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.allow_fallocate: 1 2024-09-21T08:05:53.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T08:05:53.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T08:05:53.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.use_direct_reads: 0 2024-09-21T08:05:53.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T08:05:53.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T08:05:53.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.db_log_dir: 2024-09-21T08:05:53.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.wal_dir: 2024-09-21T08:05:53.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T08:05:53.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T08:05:53.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T08:05:53.560 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T08:05:53.560 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T08:05:53.560 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T08:05:53.560 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T08:05:53.560 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T08:05:53.560 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.write_buffer_manager: 0x55f421076dc0 2024-09-21T08:05:53.560 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T08:05:53.560 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T08:05:53.560 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T08:05:53.560 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T08:05:53.560 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T08:05:53.560 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T08:05:53.560 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T08:05:53.560 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T08:05:53.561 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.unordered_write: 0 2024-09-21T08:05:53.561 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T08:05:53.561 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T08:05:53.561 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T08:05:53.561 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T08:05:53.561 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.row_cache: None 2024-09-21T08:05:53.561 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.wal_filter: None 2024-09-21T08:05:53.561 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T08:05:53.561 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T08:05:53.561 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.two_write_queues: 0 2024-09-21T08:05:53.561 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T08:05:53.561 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.wal_compression: 0 2024-09-21T08:05:53.562 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.atomic_flush: 0 2024-09-21T08:05:53.562 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T08:05:53.562 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T08:05:53.562 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T08:05:53.562 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.log_readahead_size: 0 2024-09-21T08:05:53.562 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T08:05:53.562 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T08:05:53.562 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T08:05:53.562 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T08:05:53.562 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T08:05:53.562 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T08:05:53.562 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T08:05:53.562 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_background_jobs: 2 2024-09-21T08:05:53.562 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_background_compactions: -1 2024-09-21T08:05:53.562 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_subcompactions: 1 2024-09-21T08:05:53.563 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T08:05:53.563 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T08:05:53.563 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T08:05:53.563 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T08:05:53.563 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T08:05:53.563 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T08:05:53.563 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T08:05:53.563 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T08:05:53.563 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_open_files: -1 2024-09-21T08:05:53.563 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T08:05:53.563 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T08:05:53.563 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T08:05:53.563 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T08:05:53.563 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_background_flushes: -1 2024-09-21T08:05:53.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Compression algorithms supported: 2024-09-21T08:05:53.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: kZSTD supported: 0 2024-09-21T08:05:53.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: kXpressCompression supported: 0 2024-09-21T08:05:53.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: kBZip2Compression supported: 0 2024-09-21T08:05:53.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T08:05:53.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: kLZ4Compression supported: 1 2024-09-21T08:05:53.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: kZlibCompression supported: 1 2024-09-21T08:05:53.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T08:05:53.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: kSnappyCompression supported: 1 2024-09-21T08:05:53.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T08:05:53.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T08:05:53.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi107/store.db/MANIFEST-000015 2024-09-21T08:05:53.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T08:05:53.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T08:05:53.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.merge_operator: 2024-09-21T08:05:53.565 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compaction_filter: None 2024-09-21T08:05:53.565 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T08:05:53.565 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T08:05:53.565 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T08:05:53.565 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T08:05:53.565 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f421067520) 2024-09-21T08:05:53.565 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: cache_index_and_filter_blocks: 1 2024-09-21T08:05:53.565 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T08:05:53.565 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T08:05:53.565 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: pin_top_level_index_and_filter: 1 2024-09-21T08:05:53.565 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: index_type: 0 2024-09-21T08:05:53.565 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: data_block_index_type: 0 2024-09-21T08:05:53.565 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: index_shortening: 1 2024-09-21T08:05:53.565 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T08:05:53.566 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: checksum: 4 2024-09-21T08:05:53.566 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: no_block_cache: 0 2024-09-21T08:05:53.566 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_cache: 0x55f42105b1f0 2024-09-21T08:05:53.566 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_cache_name: BinnedLRUCache 2024-09-21T08:05:53.566 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_cache_options: 2024-09-21T08:05:53.566 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: capacity : 536870912 2024-09-21T08:05:53.566 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: num_shard_bits : 4 2024-09-21T08:05:53.566 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: strict_capacity_limit : 0 2024-09-21T08:05:53.566 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: high_pri_pool_ratio: 0.000 2024-09-21T08:05:53.566 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_cache_compressed: (nil) 2024-09-21T08:05:53.566 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: persistent_cache: (nil) 2024-09-21T08:05:53.566 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_size: 4096 2024-09-21T08:05:53.566 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_size_deviation: 10 2024-09-21T08:05:53.566 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_restart_interval: 16 2024-09-21T08:05:53.566 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: index_block_restart_interval: 1 2024-09-21T08:05:53.567 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: metadata_block_size: 4096 2024-09-21T08:05:53.567 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: partition_filters: 0 2024-09-21T08:05:53.567 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: use_delta_encoding: 1 2024-09-21T08:05:53.567 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: filter_policy: bloomfilter 2024-09-21T08:05:53.567 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: whole_key_filtering: 1 2024-09-21T08:05:53.567 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: verify_compression: 0 2024-09-21T08:05:53.567 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: read_amp_bytes_per_bit: 0 2024-09-21T08:05:53.567 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: format_version: 5 2024-09-21T08:05:53.567 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: enable_index_compression: 1 2024-09-21T08:05:53.567 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_align: 0 2024-09-21T08:05:53.567 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: max_auto_readahead_size: 262144 2024-09-21T08:05:53.567 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: prepopulate_block_cache: 0 2024-09-21T08:05:53.567 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: initial_auto_readahead_size: 8192 2024-09-21T08:05:53.567 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T08:05:53.567 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T08:05:53.568 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T08:05:53.568 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compression: NoCompression 2024-09-21T08:05:53.568 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T08:05:53.568 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T08:05:53.568 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T08:05:53.568 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.num_levels: 7 2024-09-21T08:05:53.568 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T08:05:53.568 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T08:05:53.568 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T08:05:53.568 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T08:05:53.568 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T08:05:53.568 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T08:05:53.568 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T08:05:53.569 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T08:05:53.569 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T08:05:53.569 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T08:05:53.569 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T08:05:53.569 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T08:05:53.569 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T08:05:53.569 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T08:05:53.569 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T08:05:53.569 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T08:05:53.569 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T08:05:53.569 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T08:05:53.569 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T08:05:53.569 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T08:05:53.569 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T08:05:53.569 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T08:05:53.570 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T08:05:53.570 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T08:05:53.570 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T08:05:53.570 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T08:05:53.570 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T08:05:53.570 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T08:05:53.570 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T08:05:53.570 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T08:05:53.570 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T08:05:53.570 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T08:05:53.570 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T08:05:53.570 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T08:05:53.570 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T08:05:53.570 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T08:05:53.571 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T08:05:53.571 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T08:05:53.571 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T08:05:53.571 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T08:05:53.571 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T08:05:53.571 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T08:05:53.571 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T08:05:53.571 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T08:05:53.571 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T08:05:53.571 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T08:05:53.571 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T08:05:53.571 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T08:05:53.571 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T08:05:53.571 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T08:05:53.571 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T08:05:53.572 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T08:05:53.572 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T08:05:53.572 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T08:05:53.572 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.inplace_update_support: 0 2024-09-21T08:05:53.572 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T08:05:53.572 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T08:05:53.572 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T08:05:53.572 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T08:05:53.572 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.bloom_locality: 0 2024-09-21T08:05:53.572 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.max_successive_merges: 0 2024-09-21T08:05:53.572 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T08:05:53.572 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T08:05:53.572 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T08:05:53.572 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T08:05:53.573 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.ttl: 2592000 2024-09-21T08:05:53.573 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T08:05:53.573 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T08:05:53.573 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T08:05:53.573 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.enable_blob_files: false 2024-09-21T08:05:53.573 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.min_blob_size: 0 2024-09-21T08:05:53.573 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T08:05:53.573 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T08:05:53.573 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T08:05:53.573 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T08:05:53.573 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T08:05:53.573 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T08:05:53.574 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T08:05:53.574 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T08:05:53.574 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-09-21T08:05:53.574 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T08:05:53.574 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi107/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 12045, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T08:05:53.574 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-09-21T08:05:53.574 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c2375a6a-0b86-40c7-beb9-02b6ed44ba50 2024-09-21T08:05:53.574 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726905953402833, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-09-21T08:05:53.574 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-09-21T08:05:53.574 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726905953404870, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 386615, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12046, "largest_seqno": 12316, "table_properties": {"data_size": 384350, "index_size": 841, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 389, "raw_key_size": 3446, "raw_average_key_size": 25, "raw_value_size": 381238, "raw_average_value_size": 2782, "num_data_blocks": 37, "num_entries": 137, "num_filter_entries": 137, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726905953, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c2375a6a-0b86-40c7-beb9-02b6ed44ba50", "db_session_id": "ZCN8F9CC16G52XJP0QBM", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-09-21T08:05:53.574 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726905953404959, "job": 1, "event": "recovery_finished"} 2024-09-21T08:05:53.574 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-09-21T08:05:53.574 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T08:05:53.575 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi107/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T08:05:53.575 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f421088e00 2024-09-21T08:05:53.575 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: DB pointer 0x55f421184000 2024-09-21T08:05:53.575 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T08:05:53.575 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T08:05:53.575 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ** DB Stats ** 2024-09-21T08:05:53.575 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T08:05:53.575 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T08:05:53.575 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T08:05:53.575 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T08:05:53.575 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T08:05:53.575 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T08:05:53.575 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T08:05:53.576 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-21T08:05:53.576 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ** Compaction Stats [default] ** 2024-09-21T08:05:53.576 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T08:05:53.576 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T08:05:53.576 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: L0 1/0 377.55 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 291.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T08:05:53.576 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: L6 1/0 6.91 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-21T08:05:53.576 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Sum 2/0 7.27 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 291.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T08:05:53.576 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 291.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T08:05:53.576 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-21T08:05:53.576 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ** Compaction Stats [default] ** 2024-09-21T08:05:53.576 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T08:05:53.576 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T08:05:53.576 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 291.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T08:05:53.576 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-21T08:05:53.577 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T08:05:53.577 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-21T08:05:53.577 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T08:05:53.577 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T08:05:53.577 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T08:05:53.577 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T08:05:53.577 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T08:05:53.577 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T08:05:53.577 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Cumulative compaction: 0.00 GB write, 87.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T08:05:53.577 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Interval compaction: 0.00 GB write, 87.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T08:05:53.577 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T08:05:53.577 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Block cache BinnedLRUCache@0x55f42105b1f0#2 capacity: 512.00 MB usage: 1.39 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-21T08:05:53.578 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.44 KB,8.34465e-05%) IndexBlock(1,0.95 KB,0.000181794%) Misc(1,0.00 KB,0%) 2024-09-21T08:05:53.578 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-21T08:05:53.578 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T08:05:53.578 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: starting mon.smithi107 rank 0 at public addrs [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] at bind addrs [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi107 fsid 786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T08:05:53.578 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: mon.smithi107@-1(???) e2 preinit fsid 786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T08:05:53.578 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: mon.smithi107@-1(???).mds e15 new map 2024-09-21T08:05:53.578 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: mon.smithi107@-1(???).mds e15 print_map 2024-09-21T08:05:53.578 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: e15 2024-09-21T08:05:53.578 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-21T08:05:53.578 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T08:05:53.578 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:05:53.579 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: legacy client fscid: 1 2024-09-21T08:05:53.579 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-21T08:05:53.579 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Filesystem 'cephfs' (1) 2024-09-21T08:05:53.579 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: fs_name cephfs 2024-09-21T08:05:53.579 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: epoch 15 2024-09-21T08:05:53.579 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T08:05:53.579 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: created 2024-09-21T08:00:03.244314+0000 2024-09-21T08:05:53.579 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: modified 2024-09-21T08:00:21.458971+0000 2024-09-21T08:05:53.579 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: tableserver 0 2024-09-21T08:05:53.579 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: root 0 2024-09-21T08:05:53.579 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: session_timeout 60 2024-09-21T08:05:53.579 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: session_autoclose 300 2024-09-21T08:05:53.579 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: max_file_size 1099511627776 2024-09-21T08:05:53.579 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: max_xattr_size 65536 2024-09-21T08:05:53.580 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: required_client_features {} 2024-09-21T08:05:53.580 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: last_failure 0 2024-09-21T08:05:53.580 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: last_failure_osd_epoch 44 2024-09-21T08:05:53.580 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:05:53.580 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: max_mds 1 2024-09-21T08:05:53.580 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: in 0 2024-09-21T08:05:53.580 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: up {0=14458} 2024-09-21T08:05:53.580 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: failed 2024-09-21T08:05:53.580 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: damaged 2024-09-21T08:05:53.580 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: stopped 2024-09-21T08:05:53.580 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: data_pools [3] 2024-09-21T08:05:53.580 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: metadata_pool 2 2024-09-21T08:05:53.580 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: inline_data disabled 2024-09-21T08:05:53.581 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: balancer 2024-09-21T08:05:53.581 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: bal_rank_mask -1 2024-09-21T08:05:53.581 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: standby_count_wanted 1 2024-09-21T08:05:53.581 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: qdb_cluster leader: 0 members: 2024-09-21T08:05:53.581 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: [mds.cephfs.smithi107.grqzkt{0:14458} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:05:53.581 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-21T08:05:53.581 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-21T08:05:53.581 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Standby daemons: 2024-09-21T08:05:53.581 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-21T08:05:53.581 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: [mds.cephfs.smithi107.qusoyf{-1:14468} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6826/2352538667,v1:172.21.15.107:6827/2352538667] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:05:53.581 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: [mds.cephfs.smithi129.fwmfcy{-1:24239} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:05:53.581 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: [mds.cephfs.smithi129.belyba{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:05:53.581 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: mon.smithi107@-1(???).osd e46 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-21T08:05:53.581 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: mon.smithi107@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T08:05:53.582 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: mon.smithi107@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T08:05:53.582 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: mon.smithi107@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T08:05:53.582 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 ceph-mon[97757]: mon.smithi107@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-09-21T08:05:53.582 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 bash[97739]: 445b3e6a800f7b9f506c554a80d1c0100204aba499bcb4d49dabda3d32ac6bcd 2024-09-21T08:05:53.582 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:53 smithi107 systemd[1]: Started Ceph mon.smithi107 for 786d4f32-77ee-11ef-baf6-efdc52797490. 2024-09-21T08:05:55.185 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:54 smithi107 ceph-mon[97757]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-21T08:05:55.185 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:54 smithi107 ceph-mon[97757]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T08:05:55.185 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:54 smithi107 ceph-mon[97757]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:05:55.185 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:54 smithi107 ceph-mon[97757]: pgmap v56: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:55.185 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:54 smithi107 ceph-mon[97757]: mon.smithi107 calling monitor election 2024-09-21T08:05:55.185 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:54 smithi107 ceph-mon[97757]: mon.smithi107 is new leader, mons smithi107,smithi129 in quorum (ranks 0,1) 2024-09-21T08:05:55.185 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:54 smithi107 ceph-mon[97757]: monmap epoch 2 2024-09-21T08:05:55.185 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:54 smithi107 ceph-mon[97757]: fsid 786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T08:05:55.186 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:54 smithi107 ceph-mon[97757]: last_changed 2024-09-21T07:55:47.387739+0000 2024-09-21T08:05:55.186 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:54 smithi107 ceph-mon[97757]: created 2024-09-21T07:53:19.696564+0000 2024-09-21T08:05:55.186 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:54 smithi107 ceph-mon[97757]: min_mon_release 17 (quincy) 2024-09-21T08:05:55.186 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:54 smithi107 ceph-mon[97757]: election_strategy: 1 2024-09-21T08:05:55.186 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:54 smithi107 ceph-mon[97757]: 0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.smithi107 2024-09-21T08:05:55.186 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:54 smithi107 ceph-mon[97757]: 1: [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] mon.smithi129 2024-09-21T08:05:55.186 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:54 smithi107 ceph-mon[97757]: fsmap cephfs:1 {0=cephfs.smithi107.grqzkt=up:active} 3 up:standby 2024-09-21T08:05:55.186 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:54 smithi107 ceph-mon[97757]: osdmap e46: 6 total, 6 up, 6 in 2024-09-21T08:05:55.186 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:54 smithi107 ceph-mon[97757]: mgrmap e33: smithi107.wzulxb(active, since 107s), standbys: smithi129.wvlmvo 2024-09-21T08:05:55.186 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:54 smithi107 ceph-mon[97757]: overall HEALTH_OK 2024-09-21T08:05:55.186 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:54 smithi107 ceph-mon[97757]: from='mgr.14644 ' entity='' 2024-09-21T08:05:55.186 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:54 smithi107 ceph-mon[97757]: mgrmap e34: smithi107.wzulxb(active, since 107s), standbys: smithi129.wvlmvo 2024-09-21T08:05:55.187 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:54 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-21T08:05:55.187 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:54 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T08:05:55.187 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:54 smithi129 ceph-mon[34472]: from='mgr.14644 172.21.15.107:0/1319604737' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:05:55.187 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:54 smithi129 ceph-mon[34472]: pgmap v56: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:05:55.187 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:54 smithi129 ceph-mon[34472]: mon.smithi107 calling monitor election 2024-09-21T08:05:55.187 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:54 smithi129 ceph-mon[34472]: mon.smithi107 is new leader, mons smithi107,smithi129 in quorum (ranks 0,1) 2024-09-21T08:05:55.187 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:54 smithi129 ceph-mon[34472]: monmap epoch 2 2024-09-21T08:05:55.187 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:54 smithi129 ceph-mon[34472]: fsid 786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T08:05:55.187 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:54 smithi129 ceph-mon[34472]: last_changed 2024-09-21T07:55:47.387739+0000 2024-09-21T08:05:55.187 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:54 smithi129 ceph-mon[34472]: created 2024-09-21T07:53:19.696564+0000 2024-09-21T08:05:55.187 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:54 smithi129 ceph-mon[34472]: min_mon_release 17 (quincy) 2024-09-21T08:05:55.188 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:54 smithi129 ceph-mon[34472]: election_strategy: 1 2024-09-21T08:05:55.188 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:54 smithi129 ceph-mon[34472]: 0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.smithi107 2024-09-21T08:05:55.188 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:54 smithi129 ceph-mon[34472]: 1: [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] mon.smithi129 2024-09-21T08:05:55.188 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:54 smithi129 ceph-mon[34472]: fsmap cephfs:1 {0=cephfs.smithi107.grqzkt=up:active} 3 up:standby 2024-09-21T08:05:55.188 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:54 smithi129 ceph-mon[34472]: osdmap e46: 6 total, 6 up, 6 in 2024-09-21T08:05:55.188 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:54 smithi129 ceph-mon[34472]: mgrmap e33: smithi107.wzulxb(active, since 107s), standbys: smithi129.wvlmvo 2024-09-21T08:05:55.188 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:54 smithi129 ceph-mon[34472]: overall HEALTH_OK 2024-09-21T08:05:55.188 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:54 smithi129 ceph-mon[34472]: from='mgr.14644 ' entity='' 2024-09-21T08:05:55.188 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:54 smithi129 ceph-mon[34472]: mgrmap e34: smithi107.wzulxb(active, since 107s), standbys: smithi129.wvlmvo 2024-09-21T08:05:59.832 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: Standby manager daemon smithi129.wvlmvo restarted 2024-09-21T08:05:59.832 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: Standby manager daemon smithi129.wvlmvo started 2024-09-21T08:05:59.832 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: Active manager daemon smithi107.wzulxb restarted 2024-09-21T08:05:59.832 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: Activating manager daemon smithi107.wzulxb 2024-09-21T08:05:59.832 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.? 172.21.15.129:0/818720073' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi129.wvlmvo/crt"}]: dispatch 2024-09-21T08:05:59.832 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.? 172.21.15.129:0/818720073' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T08:05:59.832 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T08:05:59.833 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: mgrmap e35: smithi107.wzulxb(active, starting, since 0.0055204s), standbys: smithi129.wvlmvo 2024-09-21T08:05:59.833 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-21T08:05:59.833 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T08:05:59.833 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.grqzkt"}]: dispatch 2024-09-21T08:05:59.833 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.qusoyf"}]: dispatch 2024-09-21T08:05:59.833 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.fwmfcy"}]: dispatch 2024-09-21T08:05:59.833 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.belyba"}]: dispatch 2024-09-21T08:05:59.833 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.? 172.21.15.129:0/818720073' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi129.wvlmvo/key"}]: dispatch 2024-09-21T08:05:59.833 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.? 172.21.15.129:0/818720073' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T08:05:59.833 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr metadata", "who": "smithi107.wzulxb", "id": "smithi107.wzulxb"}]: dispatch 2024-09-21T08:05:59.833 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr metadata", "who": "smithi129.wvlmvo", "id": "smithi129.wvlmvo"}]: dispatch 2024-09-21T08:05:59.833 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T08:05:59.833 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T08:05:59.833 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T08:05:59.833 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T08:05:59.834 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T08:05:59.834 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T08:05:59.834 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T08:05:59.834 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T08:05:59.834 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T08:05:59.834 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: Manager daemon smithi107.wzulxb is now available 2024-09-21T08:05:59.834 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:05:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:05:59.916 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: Standby manager daemon smithi129.wvlmvo restarted 2024-09-21T08:05:59.917 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: Standby manager daemon smithi129.wvlmvo started 2024-09-21T08:05:59.917 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: Active manager daemon smithi107.wzulxb restarted 2024-09-21T08:05:59.917 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: Activating manager daemon smithi107.wzulxb 2024-09-21T08:05:59.917 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.129:0/818720073' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi129.wvlmvo/crt"}]: dispatch 2024-09-21T08:05:59.917 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.129:0/818720073' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T08:05:59.917 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T08:05:59.917 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: mgrmap e35: smithi107.wzulxb(active, starting, since 0.0055204s), standbys: smithi129.wvlmvo 2024-09-21T08:05:59.917 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-21T08:05:59.917 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T08:05:59.917 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.grqzkt"}]: dispatch 2024-09-21T08:05:59.917 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.qusoyf"}]: dispatch 2024-09-21T08:05:59.917 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.fwmfcy"}]: dispatch 2024-09-21T08:05:59.917 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.belyba"}]: dispatch 2024-09-21T08:05:59.917 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.129:0/818720073' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi129.wvlmvo/key"}]: dispatch 2024-09-21T08:05:59.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.? 172.21.15.129:0/818720073' entity='mgr.smithi129.wvlmvo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T08:05:59.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr metadata", "who": "smithi107.wzulxb", "id": "smithi107.wzulxb"}]: dispatch 2024-09-21T08:05:59.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr metadata", "who": "smithi129.wvlmvo", "id": "smithi129.wvlmvo"}]: dispatch 2024-09-21T08:05:59.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T08:05:59.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T08:05:59.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T08:05:59.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T08:05:59.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T08:05:59.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T08:05:59.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T08:05:59.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T08:05:59.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T08:05:59.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: Manager daemon smithi107.wzulxb is now available 2024-09-21T08:05:59.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:05:59 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:06:00.911 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:00 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:06:00.911 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:00 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.wzulxb/mirror_snapshot_schedule"}]: dispatch 2024-09-21T08:06:00.911 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:00 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.wzulxb/trash_purge_schedule"}]: dispatch 2024-09-21T08:06:00.911 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:00 smithi129 ceph-mon[34472]: mgrmap e36: smithi107.wzulxb(active, since 1.00836s), standbys: smithi129.wvlmvo 2024-09-21T08:06:00.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:00 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:06:00.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:00 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.wzulxb/mirror_snapshot_schedule"}]: dispatch 2024-09-21T08:06:00.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:00 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.wzulxb/trash_purge_schedule"}]: dispatch 2024-09-21T08:06:00.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:00 smithi107 ceph-mon[97757]: mgrmap e36: smithi107.wzulxb(active, since 1.00836s), standbys: smithi129.wvlmvo 2024-09-21T08:06:01.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:01 smithi107 ceph-mon[97757]: [21/Sep/2024:08:06:00] ENGINE Bus STARTING 2024-09-21T08:06:01.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:01 smithi107 ceph-mon[97757]: [21/Sep/2024:08:06:00] ENGINE Serving on http://172.21.15.107:8765 2024-09-21T08:06:01.976 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:01 smithi129 ceph-mon[34472]: [21/Sep/2024:08:06:00] ENGINE Bus STARTING 2024-09-21T08:06:01.976 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:01 smithi129 ceph-mon[34472]: [21/Sep/2024:08:06:00] ENGINE Serving on http://172.21.15.107:8765 2024-09-21T08:06:02.956 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:02 smithi107 ceph-mon[97757]: [21/Sep/2024:08:06:00] ENGINE Serving on https://172.21.15.107:7150 2024-09-21T08:06:02.956 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:02 smithi107 ceph-mon[97757]: [21/Sep/2024:08:06:00] ENGINE Bus STARTED 2024-09-21T08:06:02.956 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:02 smithi107 ceph-mon[97757]: [21/Sep/2024:08:06:00] ENGINE Error in HTTPServer.serve 2024-09-21T08:06:02.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Traceback (most recent call last): 2024-09-21T08:06:02.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T08:06:02.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._connections.run(self.expiration_interval) 2024-09-21T08:06:02.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T08:06:02.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._run(expiration_interval) 2024-09-21T08:06:02.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T08:06:02.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T08:06:02.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T08:06:02.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T08:06:02.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T08:06:02.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: s = self.context.wrap_socket( 2024-09-21T08:06:02.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T08:06:02.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: return self.sslsocket_class._create( 2024-09-21T08:06:02.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T08:06:02.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self.do_handshake() 2024-09-21T08:06:02.958 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T08:06:02.958 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._sslobj.do_handshake() 2024-09-21T08:06:02.958 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T08:06:02.958 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:02 smithi107 ceph-mon[97757]: pgmap v4: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:02.958 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:02 smithi107 ceph-mon[97757]: mgrmap e37: smithi107.wzulxb(active, since 2s), standbys: smithi129.wvlmvo 2024-09-21T08:06:03.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:02 smithi129 ceph-mon[34472]: [21/Sep/2024:08:06:00] ENGINE Serving on https://172.21.15.107:7150 2024-09-21T08:06:03.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:02 smithi129 ceph-mon[34472]: [21/Sep/2024:08:06:00] ENGINE Bus STARTED 2024-09-21T08:06:03.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:02 smithi129 ceph-mon[34472]: [21/Sep/2024:08:06:00] ENGINE Error in HTTPServer.serve 2024-09-21T08:06:03.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Traceback (most recent call last): 2024-09-21T08:06:03.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T08:06:03.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: self._connections.run(self.expiration_interval) 2024-09-21T08:06:03.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T08:06:03.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: self._run(expiration_interval) 2024-09-21T08:06:03.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T08:06:03.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T08:06:03.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T08:06:03.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T08:06:03.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T08:06:03.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: s = self.context.wrap_socket( 2024-09-21T08:06:03.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T08:06:03.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: return self.sslsocket_class._create( 2024-09-21T08:06:03.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T08:06:03.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: self.do_handshake() 2024-09-21T08:06:03.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T08:06:03.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: self._sslobj.do_handshake() 2024-09-21T08:06:03.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T08:06:03.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:02 smithi129 ceph-mon[34472]: pgmap v4: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:03.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:02 smithi129 ceph-mon[34472]: mgrmap e37: smithi107.wzulxb(active, since 2s), standbys: smithi129.wvlmvo 2024-09-21T08:06:03.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:03.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:03.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:03.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:04.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:03 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:04.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:03 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:04.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:03 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:04.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:03 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:04.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:04 smithi107 ceph-mon[97757]: pgmap v5: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:04.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:04 smithi107 ceph-mon[97757]: mgrmap e38: smithi107.wzulxb(active, since 4s), standbys: smithi129.wvlmvo 2024-09-21T08:06:05.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:04 smithi129 ceph-mon[34472]: pgmap v5: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:05.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:04 smithi129 ceph-mon[34472]: mgrmap e38: smithi107.wzulxb(active, since 4s), standbys: smithi129.wvlmvo 2024-09-21T08:06:06.148 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:05 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:06.148 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:05 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:06.148 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:05 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:06.148 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:05 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:06.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:05 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:06.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:05 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:06.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:05 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:06.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:05 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:07.159 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:06 smithi107 ceph-mon[97757]: pgmap v6: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:07.168 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:06 smithi129 ceph-mon[34472]: pgmap v6: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:09.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:08 smithi129 ceph-mon[34472]: pgmap v7: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-21T08:06:09.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:08 smithi107 ceph-mon[97757]: pgmap v7: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-21T08:06:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:09 smithi129 ceph-mon[34472]: Detected new or changed devices on smithi107 2024-09-21T08:06:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:09 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:09 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:09 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:09 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:06:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:09 smithi129 ceph-mon[34472]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-21T08:06:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:09 smithi129 ceph-mon[34472]: Updating smithi129:/etc/ceph/ceph.conf 2024-09-21T08:06:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:09 smithi129 ceph-mon[34472]: Updating smithi129:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T08:06:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:09 smithi129 ceph-mon[34472]: Updating smithi107:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T08:06:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:09 smithi129 ceph-mon[34472]: Updating smithi129:/etc/ceph/ceph.client.admin.keyring 2024-09-21T08:06:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:09 smithi129 ceph-mon[34472]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-09-21T08:06:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:09 smithi129 ceph-mon[34472]: pgmap v8: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-21T08:06:10.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:09 smithi129 ceph-mon[34472]: Updating smithi129:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T08:06:10.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:09 smithi129 ceph-mon[34472]: Updating smithi107:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T08:06:10.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:09 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:10.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:09 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:10.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:09 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:10.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:09 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:10.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:09 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:10.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:09 smithi107 ceph-mon[97757]: Detected new or changed devices on smithi107 2024-09-21T08:06:10.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:10.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:10.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:10.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:06:10.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:09 smithi107 ceph-mon[97757]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-21T08:06:10.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:09 smithi107 ceph-mon[97757]: Updating smithi129:/etc/ceph/ceph.conf 2024-09-21T08:06:10.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:09 smithi107 ceph-mon[97757]: Updating smithi129:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T08:06:10.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:09 smithi107 ceph-mon[97757]: Updating smithi107:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T08:06:10.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:09 smithi107 ceph-mon[97757]: Updating smithi129:/etc/ceph/ceph.client.admin.keyring 2024-09-21T08:06:10.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:09 smithi107 ceph-mon[97757]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-09-21T08:06:10.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:09 smithi107 ceph-mon[97757]: pgmap v8: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-21T08:06:10.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:09 smithi107 ceph-mon[97757]: Updating smithi129:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T08:06:10.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:09 smithi107 ceph-mon[97757]: Updating smithi107:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T08:06:10.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:10.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:10.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:10.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:10.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:11.262 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:10 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:06:11.263 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:10 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:06:11.263 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:10 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T08:06:11.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:10 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:06:11.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:10 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:06:11.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:10 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T08:06:12.739 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:12 smithi129 ceph-mon[34472]: Upgrade: Updating mon.smithi129 2024-09-21T08:06:12.740 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:12 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:12.740 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:12 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T08:06:12.740 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:12 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T08:06:12.740 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:12 smithi129 ceph-mon[34472]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:12.740 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:12 smithi129 ceph-mon[34472]: Deploying daemon mon.smithi129 on smithi129 2024-09-21T08:06:12.740 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:12 smithi129 ceph-mon[34472]: pgmap v9: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T08:06:12.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:12 smithi107 ceph-mon[97757]: Upgrade: Updating mon.smithi129 2024-09-21T08:06:12.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:12 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:12.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:12 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T08:06:12.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:12 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T08:06:12.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:12 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:12.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:12 smithi107 ceph-mon[97757]: Deploying daemon mon.smithi129 on smithi129 2024-09-21T08:06:12.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:12 smithi107 ceph-mon[97757]: pgmap v9: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T08:06:13.320 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:13 smithi129 systemd[1]: Stopping Ceph mon.smithi129 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:06:13.320 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:13 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi129[34446]: 2024-09-21T08:06:13.267+0000 7f9dfc6cd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi129 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:06:13.320 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:13 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi129[34446]: 2024-09-21T08:06:13.267+0000 7f9dfc6cd640 -1 mon.smithi129@1(peon) e2 *** Got Signal Terminated *** 2024-09-21T08:06:13.736 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:13 smithi129 podman[76560]: 2024-09-21 08:06:13.31964843 +0000 UTC m=+0.147099616 container died d9680c5a5b92c2521bd1a9fed9446e5a8417287d897f6202db5317119c6b4c03 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi129, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=quincy-fbd1a6a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T08:06:14.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:13 smithi129 podman[76560]: 2024-09-21 08:06:13.80994989 +0000 UTC m=+0.637401075 container cleanup d9680c5a5b92c2521bd1a9fed9446e5a8417287d897f6202db5317119c6b4c03 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi129, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=quincy-fbd1a6a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:06:14.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:13 smithi129 bash[76560]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi129 2024-09-21T08:06:14.350 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 podman[76573]: 2024-09-21 08:06:14.01975124 +0000 UTC m=+0.698954984 container remove d9680c5a5b92c2521bd1a9fed9446e5a8417287d897f6202db5317119c6b4c03 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi129, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-fbd1a6a, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T08:06:14.351 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 systemd[1]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490@mon.smithi129.service: Deactivated successfully. 2024-09-21T08:06:14.351 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 systemd[1]: Stopped Ceph mon.smithi129 for 786d4f32-77ee-11ef-baf6-efdc52797490. 2024-09-21T08:06:14.351 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 systemd[1]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490@mon.smithi129.service: Consumed 6.135s CPU time. 2024-09-21T08:06:14.688 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 systemd[1]: Starting Ceph mon.smithi129 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:06:14.688 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 podman[76703]: 2024-09-21 08:06:14.55512502 +0000 UTC m=+0.112013015 container create 12706f82362117cb20701f74c07d77ae64e47749d5c32dc8aaa1e19822a02c7a (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi129, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T08:06:14.688 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 podman[76703]: 2024-09-21 08:06:14.45871802 +0000 UTC m=+0.015606031 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:06:15.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 podman[76703]: 2024-09-21 08:06:14.774406741 +0000 UTC m=+0.331294743 container init 12706f82362117cb20701f74c07d77ae64e47749d5c32dc8aaa1e19822a02c7a (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi129, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T08:06:15.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 podman[76703]: 2024-09-21 08:06:14.777726801 +0000 UTC m=+0.334614795 container start 12706f82362117cb20701f74c07d77ae64e47749d5c32dc8aaa1e19822a02c7a (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi129, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:06:15.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T08:06:15.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable), process ceph-mon, pid 2 2024-09-21T08:06:15.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: pidfile_write: ignore empty --pid-file 2024-09-21T08:06:15.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: load: jerasure load: lrc 2024-09-21T08:06:15.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: RocksDB version: 7.9.2 2024-09-21T08:06:15.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Git sha 0 2024-09-21T08:06:15.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Compile date 2024-09-19 18:20:48 2024-09-21T08:06:15.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: DB SUMMARY 2024-09-21T08:06:15.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: DB Session ID: VPZSKCHLINXHAGWNRXJV 2024-09-21T08:06:15.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: CURRENT file: CURRENT 2024-09-21T08:06:15.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T08:06:15.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1079 Bytes 2024-09-21T08:06:15.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi129/store.db dir, Total Num: 1, files: 000027.sst 2024-09-21T08:06:15.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi129/store.db: 000025.log size: 3169878 ; 2024-09-21T08:06:15.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.error_if_exists: 0 2024-09-21T08:06:15.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.create_if_missing: 0 2024-09-21T08:06:15.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.paranoid_checks: 1 2024-09-21T08:06:15.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T08:06:15.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T08:06:15.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T08:06:15.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.env: 0x561430381940 2024-09-21T08:06:15.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T08:06:15.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.info_log: 0x5614315d18c0 2024-09-21T08:06:15.269 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T08:06:15.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.statistics: (nil) 2024-09-21T08:06:15.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.use_fsync: 0 2024-09-21T08:06:15.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_log_file_size: 0 2024-09-21T08:06:15.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T08:06:15.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T08:06:15.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T08:06:15.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T08:06:15.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.allow_fallocate: 1 2024-09-21T08:06:15.270 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T08:06:15.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T08:06:15.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.use_direct_reads: 0 2024-09-21T08:06:15.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T08:06:15.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T08:06:15.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.db_log_dir: 2024-09-21T08:06:15.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.wal_dir: 2024-09-21T08:06:15.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T08:06:15.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T08:06:15.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T08:06:15.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T08:06:15.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T08:06:15.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T08:06:15.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T08:06:15.271 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T08:06:15.272 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.write_buffer_manager: 0x5614315e0dc0 2024-09-21T08:06:15.272 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T08:06:15.272 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T08:06:15.272 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T08:06:15.272 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T08:06:15.272 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T08:06:15.272 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T08:06:15.272 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T08:06:15.272 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T08:06:15.272 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.unordered_write: 0 2024-09-21T08:06:15.272 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T08:06:15.272 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T08:06:15.272 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T08:06:15.272 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T08:06:15.272 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.row_cache: None 2024-09-21T08:06:15.272 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.wal_filter: None 2024-09-21T08:06:15.273 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T08:06:15.273 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T08:06:15.273 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.two_write_queues: 0 2024-09-21T08:06:15.273 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T08:06:15.273 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.wal_compression: 0 2024-09-21T08:06:15.273 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.atomic_flush: 0 2024-09-21T08:06:15.273 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T08:06:15.273 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T08:06:15.273 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T08:06:15.273 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.log_readahead_size: 0 2024-09-21T08:06:15.273 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T08:06:15.273 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T08:06:15.273 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T08:06:15.273 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T08:06:15.273 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T08:06:15.273 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T08:06:15.274 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T08:06:15.274 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_background_jobs: 2 2024-09-21T08:06:15.274 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_background_compactions: -1 2024-09-21T08:06:15.274 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_subcompactions: 1 2024-09-21T08:06:15.274 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T08:06:15.274 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T08:06:15.274 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T08:06:15.274 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T08:06:15.274 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T08:06:15.274 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T08:06:15.274 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T08:06:15.274 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T08:06:15.274 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_open_files: -1 2024-09-21T08:06:15.274 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T08:06:15.274 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T08:06:15.274 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T08:06:15.275 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T08:06:15.275 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_background_flushes: -1 2024-09-21T08:06:15.275 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Compression algorithms supported: 2024-09-21T08:06:15.275 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: kZSTD supported: 0 2024-09-21T08:06:15.275 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: kXpressCompression supported: 0 2024-09-21T08:06:15.275 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: kBZip2Compression supported: 0 2024-09-21T08:06:15.275 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T08:06:15.275 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: kLZ4Compression supported: 1 2024-09-21T08:06:15.275 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: kZlibCompression supported: 1 2024-09-21T08:06:15.275 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T08:06:15.275 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: kSnappyCompression supported: 1 2024-09-21T08:06:15.275 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T08:06:15.275 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T08:06:15.275 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi129/store.db/MANIFEST-000009 2024-09-21T08:06:15.275 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T08:06:15.276 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T08:06:15.276 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.merge_operator: 2024-09-21T08:06:15.276 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compaction_filter: None 2024-09-21T08:06:15.276 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T08:06:15.276 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T08:06:15.276 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T08:06:15.276 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T08:06:15.276 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5614315d1520) 2024-09-21T08:06:15.276 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: cache_index_and_filter_blocks: 1 2024-09-21T08:06:15.276 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T08:06:15.276 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T08:06:15.276 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: pin_top_level_index_and_filter: 1 2024-09-21T08:06:15.276 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: index_type: 0 2024-09-21T08:06:15.276 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: data_block_index_type: 0 2024-09-21T08:06:15.277 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: index_shortening: 1 2024-09-21T08:06:15.277 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T08:06:15.277 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: checksum: 4 2024-09-21T08:06:15.277 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: no_block_cache: 0 2024-09-21T08:06:15.277 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: block_cache: 0x5614315c51f0 2024-09-21T08:06:15.277 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: block_cache_name: BinnedLRUCache 2024-09-21T08:06:15.277 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: block_cache_options: 2024-09-21T08:06:15.277 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: capacity : 536870912 2024-09-21T08:06:15.277 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: num_shard_bits : 4 2024-09-21T08:06:15.277 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: strict_capacity_limit : 0 2024-09-21T08:06:15.277 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: high_pri_pool_ratio: 0.000 2024-09-21T08:06:15.277 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: block_cache_compressed: (nil) 2024-09-21T08:06:15.277 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: persistent_cache: (nil) 2024-09-21T08:06:15.277 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: block_size: 4096 2024-09-21T08:06:15.277 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: block_size_deviation: 10 2024-09-21T08:06:15.277 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: block_restart_interval: 16 2024-09-21T08:06:15.278 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: index_block_restart_interval: 1 2024-09-21T08:06:15.278 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: metadata_block_size: 4096 2024-09-21T08:06:15.278 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: partition_filters: 0 2024-09-21T08:06:15.278 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: use_delta_encoding: 1 2024-09-21T08:06:15.278 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: filter_policy: bloomfilter 2024-09-21T08:06:15.278 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: whole_key_filtering: 1 2024-09-21T08:06:15.278 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: verify_compression: 0 2024-09-21T08:06:15.278 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: read_amp_bytes_per_bit: 0 2024-09-21T08:06:15.278 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: format_version: 5 2024-09-21T08:06:15.278 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: enable_index_compression: 1 2024-09-21T08:06:15.278 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: block_align: 0 2024-09-21T08:06:15.278 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: max_auto_readahead_size: 262144 2024-09-21T08:06:15.278 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: prepopulate_block_cache: 0 2024-09-21T08:06:15.278 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: initial_auto_readahead_size: 8192 2024-09-21T08:06:15.279 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T08:06:15.279 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T08:06:15.279 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T08:06:15.279 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compression: NoCompression 2024-09-21T08:06:15.279 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T08:06:15.279 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T08:06:15.279 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T08:06:15.279 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.num_levels: 7 2024-09-21T08:06:15.279 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T08:06:15.279 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T08:06:15.279 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T08:06:15.279 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T08:06:15.279 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T08:06:15.279 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T08:06:15.279 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T08:06:15.280 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T08:06:15.280 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T08:06:15.280 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T08:06:15.280 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T08:06:15.280 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T08:06:15.280 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T08:06:15.280 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T08:06:15.280 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T08:06:15.280 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T08:06:15.280 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T08:06:15.280 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T08:06:15.280 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T08:06:15.280 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T08:06:15.280 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T08:06:15.280 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T08:06:15.281 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T08:06:15.281 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T08:06:15.281 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T08:06:15.281 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T08:06:15.281 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T08:06:15.281 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T08:06:15.281 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T08:06:15.281 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T08:06:15.281 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T08:06:15.281 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T08:06:15.281 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T08:06:15.281 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T08:06:15.281 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T08:06:15.281 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T08:06:15.281 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T08:06:15.282 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T08:06:15.282 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T08:06:15.282 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T08:06:15.282 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T08:06:15.282 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T08:06:15.282 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T08:06:15.282 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T08:06:15.282 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T08:06:15.282 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T08:06:15.282 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T08:06:15.282 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T08:06:15.282 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T08:06:15.282 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T08:06:15.282 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T08:06:15.282 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T08:06:15.283 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T08:06:15.283 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T08:06:15.283 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.inplace_update_support: 0 2024-09-21T08:06:15.283 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T08:06:15.283 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T08:06:15.283 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T08:06:15.283 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T08:06:15.283 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.bloom_locality: 0 2024-09-21T08:06:15.283 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.max_successive_merges: 0 2024-09-21T08:06:15.283 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T08:06:15.283 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T08:06:15.283 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T08:06:15.283 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T08:06:15.283 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.ttl: 2592000 2024-09-21T08:06:15.283 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T08:06:15.284 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T08:06:15.284 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T08:06:15.284 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.enable_blob_files: false 2024-09-21T08:06:15.284 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.min_blob_size: 0 2024-09-21T08:06:15.284 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T08:06:15.284 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T08:06:15.284 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T08:06:15.284 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T08:06:15.284 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T08:06:15.284 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T08:06:15.284 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T08:06:15.284 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T08:06:15.284 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-09-21T08:06:15.284 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T08:06:15.284 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi129/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12343, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T08:06:15.285 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-21T08:06:15.285 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 57aa567c-343a-4e25-8ae6-16846e555cf3 2024-09-21T08:06:15.285 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726905974804013, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-21T08:06:15.285 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-21T08:06:15.285 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726905974811364, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2024802, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12348, "largest_seqno": 13111, "table_properties": {"data_size": 2020626, "index_size": 2240, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 901, "raw_key_size": 8504, "raw_average_key_size": 24, "raw_value_size": 2012996, "raw_average_value_size": 5767, "num_data_blocks": 102, "num_entries": 349, "num_filter_entries": 349, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726905974, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "57aa567c-343a-4e25-8ae6-16846e555cf3", "db_session_id": "VPZSKCHLINXHAGWNRXJV", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-21T08:06:15.285 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726905974811490, "job": 1, "event": "recovery_finished"} 2024-09-21T08:06:15.285 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-21T08:06:15.285 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T08:06:15.285 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi129/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T08:06:15.285 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5614315f2e00 2024-09-21T08:06:15.285 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: DB pointer 0x5614316ee000 2024-09-21T08:06:15.285 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T08:06:15.285 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T08:06:15.285 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: ** DB Stats ** 2024-09-21T08:06:15.286 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T08:06:15.286 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T08:06:15.286 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T08:06:15.286 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T08:06:15.286 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T08:06:15.286 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T08:06:15.286 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T08:06:15.286 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: 2024-09-21T08:06:15.286 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: ** Compaction Stats [default] ** 2024-09-21T08:06:15.286 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T08:06:15.286 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T08:06:15.286 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: L0 1/0 1.93 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 632.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-21T08:06:15.286 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: L6 1/0 6.91 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-21T08:06:15.286 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Sum 2/0 8.84 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 632.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-21T08:06:15.287 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 632.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-21T08:06:15.287 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: 2024-09-21T08:06:15.287 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: ** Compaction Stats [default] ** 2024-09-21T08:06:15.287 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T08:06:15.287 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T08:06:15.287 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 632.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-21T08:06:15.287 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: 2024-09-21T08:06:15.287 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T08:06:15.287 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: 2024-09-21T08:06:15.287 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T08:06:15.287 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-21T08:06:15.287 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T08:06:15.287 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T08:06:15.287 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T08:06:15.287 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T08:06:15.288 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Cumulative compaction: 0.00 GB write, 155.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T08:06:15.288 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Interval compaction: 0.00 GB write, 155.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T08:06:15.288 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T08:06:15.288 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Block cache BinnedLRUCache@0x5614315c51f0#2 capacity: 512.00 MB usage: 3.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-09-21T08:06:15.288 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.03 KB,0.000196695%) IndexBlock(1,2.33 KB,0.000444055%) Misc(1,0.00 KB,0%) 2024-09-21T08:06:15.288 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: 2024-09-21T08:06:15.288 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T08:06:15.288 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: starting mon.smithi129 rank 1 at public addrs [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] at bind addrs [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi129 fsid 786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T08:06:15.288 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: mon.smithi129@-1(???) e2 preinit fsid 786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T08:06:15.288 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: mon.smithi129@-1(???).mds e15 new map 2024-09-21T08:06:15.288 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: mon.smithi129@-1(???).mds e15 print_map 2024-09-21T08:06:15.288 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: e15 2024-09-21T08:06:15.288 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-21T08:06:15.288 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T08:06:15.288 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:06:15.289 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: legacy client fscid: 1 2024-09-21T08:06:15.289 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: 2024-09-21T08:06:15.289 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Filesystem 'cephfs' (1) 2024-09-21T08:06:15.289 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: fs_name cephfs 2024-09-21T08:06:15.289 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: epoch 15 2024-09-21T08:06:15.289 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T08:06:15.289 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: created 2024-09-21T08:00:03.244314+0000 2024-09-21T08:06:15.289 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: modified 2024-09-21T08:00:21.458971+0000 2024-09-21T08:06:15.289 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: tableserver 0 2024-09-21T08:06:15.289 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: root 0 2024-09-21T08:06:15.289 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: session_timeout 60 2024-09-21T08:06:15.289 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: session_autoclose 300 2024-09-21T08:06:15.289 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: max_file_size 1099511627776 2024-09-21T08:06:15.289 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: max_xattr_size 65536 2024-09-21T08:06:15.290 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: required_client_features {} 2024-09-21T08:06:15.290 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: last_failure 0 2024-09-21T08:06:15.290 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: last_failure_osd_epoch 44 2024-09-21T08:06:15.290 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:06:15.290 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: max_mds 1 2024-09-21T08:06:15.290 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: in 0 2024-09-21T08:06:15.290 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: up {0=14458} 2024-09-21T08:06:15.290 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: failed 2024-09-21T08:06:15.290 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: damaged 2024-09-21T08:06:15.290 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: stopped 2024-09-21T08:06:15.290 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: data_pools [3] 2024-09-21T08:06:15.290 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: metadata_pool 2 2024-09-21T08:06:15.290 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: inline_data disabled 2024-09-21T08:06:15.290 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: balancer 2024-09-21T08:06:15.290 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: bal_rank_mask -1 2024-09-21T08:06:15.291 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: standby_count_wanted 1 2024-09-21T08:06:15.291 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: qdb_cluster leader: 0 members: 2024-09-21T08:06:15.291 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: [mds.cephfs.smithi107.grqzkt{0:14458} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:06:15.291 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: 2024-09-21T08:06:15.291 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: 2024-09-21T08:06:15.291 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: Standby daemons: 2024-09-21T08:06:15.291 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: 2024-09-21T08:06:15.291 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: [mds.cephfs.smithi107.qusoyf{-1:14468} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6826/2352538667,v1:172.21.15.107:6827/2352538667] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:06:15.291 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: [mds.cephfs.smithi129.fwmfcy{-1:24239} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:06:15.291 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout: [mds.cephfs.smithi129.belyba{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:06:15.291 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: mon.smithi129@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-21T08:06:15.291 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: mon.smithi129@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T08:06:15.291 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: mon.smithi129@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T08:06:15.291 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: mon.smithi129@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T08:06:15.291 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 ceph-mon[76722]: mon.smithi129@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-09-21T08:06:15.292 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 bash[76703]: 12706f82362117cb20701f74c07d77ae64e47749d5c32dc8aaa1e19822a02c7a 2024-09-21T08:06:15.292 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:14 smithi129 systemd[1]: Started Ceph mon.smithi129 for 786d4f32-77ee-11ef-baf6-efdc52797490. 2024-09-21T08:06:16.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T08:06:16.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: mgrmap e38: smithi107.wzulxb(active, since 15s), standbys: smithi129.wvlmvo 2024-09-21T08:06:16.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: overall HEALTH_OK 2024-09-21T08:06:16.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: mon.smithi107 calling monitor election 2024-09-21T08:06:16.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: mon.smithi129 calling monitor election 2024-09-21T08:06:16.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-21T08:06:16.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: mon.smithi107 is new leader, mons smithi107,smithi129 in quorum (ranks 0,1) 2024-09-21T08:06:16.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: monmap epoch 3 2024-09-21T08:06:16.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: fsid 786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T08:06:16.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: last_changed 2024-09-21T08:06:15.049366+0000 2024-09-21T08:06:16.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: created 2024-09-21T07:53:19.696564+0000 2024-09-21T08:06:16.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: min_mon_release 19 (squid) 2024-09-21T08:06:16.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: election_strategy: 1 2024-09-21T08:06:16.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: 0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.smithi107 2024-09-21T08:06:16.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: 1: [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] mon.smithi129 2024-09-21T08:06:16.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: fsmap cephfs:1 {0=cephfs.smithi107.grqzkt=up:active} 3 up:standby 2024-09-21T08:06:16.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T08:06:16.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: mgrmap e38: smithi107.wzulxb(active, since 15s), standbys: smithi129.wvlmvo 2024-09-21T08:06:16.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: overall HEALTH_OK 2024-09-21T08:06:16.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T08:06:16.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:16.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:16.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:06:16.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:16 smithi107 ceph-mon[97757]: pgmap v11: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T08:06:16.307 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T08:06:16.307 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: mgrmap e38: smithi107.wzulxb(active, since 15s), standbys: smithi129.wvlmvo 2024-09-21T08:06:16.307 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: overall HEALTH_OK 2024-09-21T08:06:16.307 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: mon.smithi107 calling monitor election 2024-09-21T08:06:16.307 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: mon.smithi129 calling monitor election 2024-09-21T08:06:16.307 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-21T08:06:16.307 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: mon.smithi107 is new leader, mons smithi107,smithi129 in quorum (ranks 0,1) 2024-09-21T08:06:16.307 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: monmap epoch 3 2024-09-21T08:06:16.307 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: fsid 786d4f32-77ee-11ef-baf6-efdc52797490 2024-09-21T08:06:16.308 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: last_changed 2024-09-21T08:06:15.049366+0000 2024-09-21T08:06:16.308 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: created 2024-09-21T07:53:19.696564+0000 2024-09-21T08:06:16.308 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: min_mon_release 19 (squid) 2024-09-21T08:06:16.308 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: election_strategy: 1 2024-09-21T08:06:16.308 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: 0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.smithi107 2024-09-21T08:06:16.308 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: 1: [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] mon.smithi129 2024-09-21T08:06:16.308 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: fsmap cephfs:1 {0=cephfs.smithi107.grqzkt=up:active} 3 up:standby 2024-09-21T08:06:16.308 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T08:06:16.308 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: mgrmap e38: smithi107.wzulxb(active, since 15s), standbys: smithi129.wvlmvo 2024-09-21T08:06:16.308 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: overall HEALTH_OK 2024-09-21T08:06:16.308 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mon metadata", "id": "smithi129"}]: dispatch 2024-09-21T08:06:16.308 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:16.308 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:16.308 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:06:16.309 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:16 smithi129 ceph-mon[76722]: pgmap v11: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T08:06:18.983 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:18 smithi129 ceph-mon[76722]: pgmap v12: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T08:06:18.983 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:18 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:18.983 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:18 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:18.983 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:18 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:18.983 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:18 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:19.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:18 smithi107 ceph-mon[97757]: pgmap v12: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T08:06:19.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:18 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:19.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:18 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:19.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:18 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:19.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:18 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:20.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.393+0000 7fb908332640 1 -- 172.21.15.107:0/162037350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9000fdf10 msgr2=0x7fb900106550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:20.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.393+0000 7fb908332640 1 --2- 172.21.15.107:0/162037350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9000fdf10 0x7fb900106550 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb8f40048d0 tx=0x7fb8f4009da0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.393+0000 7fb908332640 1 -- 172.21.15.107:0/162037350 shutdown_connections 2024-09-21T08:06:20.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.393+0000 7fb908332640 1 --2- 172.21.15.107:0/162037350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9000fdf10 0x7fb900106550 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.393+0000 7fb908332640 1 --2- 172.21.15.107:0/162037350 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb9000fd570 0x7fb9000fd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.393+0000 7fb908332640 1 -- 172.21.15.107:0/162037350 >> 172.21.15.107:0/162037350 conn(0x7fb9000f7000 msgr2=0x7fb9000f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:20.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.393+0000 7fb908332640 1 -- 172.21.15.107:0/162037350 shutdown_connections 2024-09-21T08:06:20.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.393+0000 7fb908332640 1 -- 172.21.15.107:0/162037350 wait complete. 2024-09-21T08:06:20.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.394+0000 7fb908332640 1 Processor -- start 2024-09-21T08:06:20.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.394+0000 7fb908332640 1 -- start start 2024-09-21T08:06:20.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.394+0000 7fb908332640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb9000fd570 0x7fb9000fb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.394+0000 7fb908332640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9000fdf10 0x7fb9000fb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.394+0000 7fb908332640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000fbe20 con 0x7fb9000fdf10 2024-09-21T08:06:20.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.394+0000 7fb908332640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000fbf90 con 0x7fb9000fd570 2024-09-21T08:06:20.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.394+0000 7fb9058cd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9000fdf10 0x7fb9000fb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.394+0000 7fb9058cd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9000fdf10 0x7fb9000fb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59278/0 (socket says 172.21.15.107:59278) 2024-09-21T08:06:20.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.394+0000 7fb9058cd640 1 -- 172.21.15.107:0/1166445952 learned_addr learned my addr 172.21.15.107:0/1166445952 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:06:20.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.394+0000 7fb9060ce640 1 --2- 172.21.15.107:0/1166445952 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb9000fd570 0x7fb9000fb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.394+0000 7fb9058cd640 1 -- 172.21.15.107:0/1166445952 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb9000fd570 msgr2=0x7fb9000fb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:20.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.394+0000 7fb9058cd640 1 --2- 172.21.15.107:0/1166445952 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb9000fd570 0x7fb9000fb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.394+0000 7fb9058cd640 1 -- 172.21.15.107:0/1166445952 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f4005040 con 0x7fb9000fdf10 2024-09-21T08:06:20.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.395+0000 7fb9058cd640 1 --2- 172.21.15.107:0/1166445952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9000fdf10 0x7fb9000fb8e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4000c00 tx=0x7fb8f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:20.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.395+0000 7fb8feffd640 1 -- 172.21.15.107:0/1166445952 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8f4038070 con 0x7fb9000fdf10 2024-09-21T08:06:20.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.395+0000 7fb8feffd640 1 -- 172.21.15.107:0/1166445952 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb8f402ade0 con 0x7fb9000fdf10 2024-09-21T08:06:20.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.395+0000 7fb908332640 1 -- 172.21.15.107:0/1166445952 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9000fc1c0 con 0x7fb9000fdf10 2024-09-21T08:06:20.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.395+0000 7fb8feffd640 1 -- 172.21.15.107:0/1166445952 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8f402c7e0 con 0x7fb9000fdf10 2024-09-21T08:06:20.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.395+0000 7fb908332640 1 -- 172.21.15.107:0/1166445952 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb900119880 con 0x7fb9000fdf10 2024-09-21T08:06:20.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.396+0000 7fb908332640 1 -- 172.21.15.107:0/1166445952 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb900066330 con 0x7fb9000fdf10 2024-09-21T08:06:20.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.396+0000 7fb8feffd640 1 -- 172.21.15.107:0/1166445952 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fb8f4030020 con 0x7fb9000fdf10 2024-09-21T08:06:20.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.397+0000 7fb8feffd640 1 --2- 172.21.15.107:0/1166445952 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb8e806e660 0x7fb8e8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.397+0000 7fb8feffd640 1 -- 172.21.15.107:0/1166445952 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb8f40ade20 con 0x7fb9000fdf10 2024-09-21T08:06:20.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.397+0000 7fb9060ce640 1 --2- 172.21.15.107:0/1166445952 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb8e806e660 0x7fb8e8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.397+0000 7fb9060ce640 1 --2- 172.21.15.107:0/1166445952 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb8e806e660 0x7fb8e8070b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0004ed0 tx=0x7fb8f000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:20.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.402+0000 7fb8feffd640 1 -- 172.21.15.107:0/1166445952 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb8f4076fd0 con 0x7fb9000fdf10 2024-09-21T08:06:20.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.586+0000 7fb908332640 1 -- 172.21.15.107:0/1166445952 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9001095e0 con 0x7fb8e806e660 2024-09-21T08:06:20.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.588+0000 7fb8feffd640 1 -- 172.21.15.107:0/1166445952 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fb9001095e0 con 0x7fb8e806e660 2024-09-21T08:06:20.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.590+0000 7fb908332640 1 -- 172.21.15.107:0/1166445952 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb8e806e660 msgr2=0x7fb8e8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:20.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.590+0000 7fb908332640 1 --2- 172.21.15.107:0/1166445952 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb8e806e660 0x7fb8e8070b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0004ed0 tx=0x7fb8f000b040 comp rx=0 tx=0).stop 2024-09-21T08:06:20.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.590+0000 7fb908332640 1 -- 172.21.15.107:0/1166445952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9000fdf10 msgr2=0x7fb9000fb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:20.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.590+0000 7fb908332640 1 --2- 172.21.15.107:0/1166445952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9000fdf10 0x7fb9000fb8e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4000c00 tx=0x7fb8f4009da0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.590+0000 7fb908332640 1 -- 172.21.15.107:0/1166445952 shutdown_connections 2024-09-21T08:06:20.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.590+0000 7fb908332640 1 --2- 172.21.15.107:0/1166445952 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb8e806e660 0x7fb8e8070b10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.590+0000 7fb908332640 1 --2- 172.21.15.107:0/1166445952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9000fdf10 0x7fb9000fb8e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.590+0000 7fb908332640 1 --2- 172.21.15.107:0/1166445952 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb9000fd570 0x7fb9000fb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.590+0000 7fb908332640 1 -- 172.21.15.107:0/1166445952 >> 172.21.15.107:0/1166445952 conn(0x7fb9000f7000 msgr2=0x7fb9000f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:20.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.590+0000 7fb908332640 1 -- 172.21.15.107:0/1166445952 shutdown_connections 2024-09-21T08:06:20.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.590+0000 7fb908332640 1 -- 172.21.15.107:0/1166445952 wait complete. 2024-09-21T08:06:20.600 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:06:20.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.669+0000 7f11907f9640 1 -- 172.21.15.107:0/3702024186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1188102ed0 msgr2=0x7f11880fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:20.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.669+0000 7f11907f9640 1 --2- 172.21.15.107:0/3702024186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1188102ed0 0x7f11880fc590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f11780048d0 tx=0x7f1178009da0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.669+0000 7f11907f9640 1 -- 172.21.15.107:0/3702024186 shutdown_connections 2024-09-21T08:06:20.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.669+0000 7f11907f9640 1 --2- 172.21.15.107:0/3702024186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1188102ed0 0x7f11880fc590 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.669+0000 7f11907f9640 1 --2- 172.21.15.107:0/3702024186 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1188102530 0x7f1188102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.669+0000 7f11907f9640 1 -- 172.21.15.107:0/3702024186 >> 172.21.15.107:0/3702024186 conn(0x7f11880f80f0 msgr2=0x7f11880fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:20.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.669+0000 7f11907f9640 1 -- 172.21.15.107:0/3702024186 shutdown_connections 2024-09-21T08:06:20.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.669+0000 7f11907f9640 1 -- 172.21.15.107:0/3702024186 wait complete. 2024-09-21T08:06:20.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.670+0000 7f11907f9640 1 Processor -- start 2024-09-21T08:06:20.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.670+0000 7f11907f9640 1 -- start start 2024-09-21T08:06:20.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.670+0000 7f11907f9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1188102530 0x7f11881131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.670+0000 7f11907f9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1188102ed0 0x7f1188113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.670+0000 7f11907f9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1188113d10 con 0x7f1188102530 2024-09-21T08:06:20.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.670+0000 7f11907f9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118810d150 con 0x7f1188102ed0 2024-09-21T08:06:20.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.670+0000 7f118e595640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1188102530 0x7f11881131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.670+0000 7f118e595640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1188102530 0x7f11881131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59292/0 (socket says 172.21.15.107:59292) 2024-09-21T08:06:20.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.670+0000 7f118e595640 1 -- 172.21.15.107:0/3322368440 learned_addr learned my addr 172.21.15.107:0/3322368440 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:06:20.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.670+0000 7f118dd94640 1 --2- 172.21.15.107:0/3322368440 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1188102ed0 0x7f1188113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.671+0000 7f118e595640 1 -- 172.21.15.107:0/3322368440 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1188102ed0 msgr2=0x7f1188113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:20.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.671+0000 7f118e595640 1 --2- 172.21.15.107:0/3322368440 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1188102ed0 0x7f1188113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.671+0000 7f118e595640 1 -- 172.21.15.107:0/3322368440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1178005040 con 0x7f1188102530 2024-09-21T08:06:20.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.671+0000 7f118e595640 1 --2- 172.21.15.107:0/3322368440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1188102530 0x7f11881131d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1184002a50 tx=0x7f1184004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:20.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.671+0000 7f117effd640 1 -- 172.21.15.107:0/3322368440 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1184007c30 con 0x7f1188102530 2024-09-21T08:06:20.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.671+0000 7f117effd640 1 -- 172.21.15.107:0/3322368440 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f118400f040 con 0x7f1188102530 2024-09-21T08:06:20.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.671+0000 7f11907f9640 1 -- 172.21.15.107:0/3322368440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118810d430 con 0x7f1188102530 2024-09-21T08:06:20.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.671+0000 7f117effd640 1 -- 172.21.15.107:0/3322368440 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f118400da90 con 0x7f1188102530 2024-09-21T08:06:20.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.671+0000 7f11907f9640 1 -- 172.21.15.107:0/3322368440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118810d9a0 con 0x7f1188102530 2024-09-21T08:06:20.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.673+0000 7f11907f9640 1 -- 172.21.15.107:0/3322368440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11880fdcb0 con 0x7f1188102530 2024-09-21T08:06:20.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.673+0000 7f117effd640 1 -- 172.21.15.107:0/3322368440 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f1184009670 con 0x7f1188102530 2024-09-21T08:06:20.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.673+0000 7f117effd640 1 --2- 172.21.15.107:0/3322368440 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f117406e660 0x7f1174070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.673+0000 7f117effd640 1 -- 172.21.15.107:0/3322368440 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f118408e1a0 con 0x7f1188102530 2024-09-21T08:06:20.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.673+0000 7f118dd94640 1 --2- 172.21.15.107:0/3322368440 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f117406e660 0x7f1174070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.674+0000 7f118dd94640 1 --2- 172.21.15.107:0/3322368440 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f117406e660 0x7f1174070b10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f11780048a0 tx=0x7f1178035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:20.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.678+0000 7f117effd640 1 -- 172.21.15.107:0/3322368440 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f118405acc0 con 0x7f1188102530 2024-09-21T08:06:20.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.858+0000 7f11907f9640 1 -- 172.21.15.107:0/3322368440 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f118804b720 con 0x7f117406e660 2024-09-21T08:06:20.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.859+0000 7f117effd640 1 -- 172.21.15.107:0/3322368440 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f118804b720 con 0x7f117406e660 2024-09-21T08:06:20.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.861+0000 7f11907f9640 1 -- 172.21.15.107:0/3322368440 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f117406e660 msgr2=0x7f1174070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:20.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.861+0000 7f11907f9640 1 --2- 172.21.15.107:0/3322368440 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f117406e660 0x7f1174070b10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f11780048a0 tx=0x7f1178035040 comp rx=0 tx=0).stop 2024-09-21T08:06:20.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.861+0000 7f11907f9640 1 -- 172.21.15.107:0/3322368440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1188102530 msgr2=0x7f11881131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:20.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.861+0000 7f11907f9640 1 --2- 172.21.15.107:0/3322368440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1188102530 0x7f11881131d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1184002a50 tx=0x7f1184004600 comp rx=0 tx=0).stop 2024-09-21T08:06:20.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.861+0000 7f11907f9640 1 -- 172.21.15.107:0/3322368440 shutdown_connections 2024-09-21T08:06:20.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.861+0000 7f11907f9640 1 --2- 172.21.15.107:0/3322368440 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f117406e660 0x7f1174070b10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.861+0000 7f11907f9640 1 --2- 172.21.15.107:0/3322368440 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1188102ed0 0x7f1188113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.861+0000 7f11907f9640 1 --2- 172.21.15.107:0/3322368440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1188102530 0x7f11881131d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.861+0000 7f11907f9640 1 -- 172.21.15.107:0/3322368440 >> 172.21.15.107:0/3322368440 conn(0x7f11880f80f0 msgr2=0x7f11880f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:20.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.861+0000 7f11907f9640 1 -- 172.21.15.107:0/3322368440 shutdown_connections 2024-09-21T08:06:20.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.861+0000 7f11907f9640 1 -- 172.21.15.107:0/3322368440 wait complete. 2024-09-21T08:06:20.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.937+0000 7f9ea9163640 1 -- 172.21.15.107:0/4067284654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea40fcf80 msgr2=0x7f9ea40fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:20.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.937+0000 7f9ea9163640 1 --2- 172.21.15.107:0/4067284654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea40fcf80 0x7f9ea40fd3d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0048d0 tx=0x7f9e8c009da0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.937+0000 7f9ea9163640 1 -- 172.21.15.107:0/4067284654 shutdown_connections 2024-09-21T08:06:20.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.937+0000 7f9ea9163640 1 --2- 172.21.15.107:0/4067284654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea40fcf80 0x7f9ea40fd3d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.937+0000 7f9ea9163640 1 --2- 172.21.15.107:0/4067284654 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ea40fb810 0x7f9ea40fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.937+0000 7f9ea9163640 1 -- 172.21.15.107:0/4067284654 >> 172.21.15.107:0/4067284654 conn(0x7f9ea40723b0 msgr2=0x7f9ea40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:20.940 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:20 smithi107 ceph-mon[97757]: pgmap v13: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:20.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.938+0000 7f9ea9163640 1 -- 172.21.15.107:0/4067284654 shutdown_connections 2024-09-21T08:06:20.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.938+0000 7f9ea9163640 1 -- 172.21.15.107:0/4067284654 wait complete. 2024-09-21T08:06:20.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.938+0000 7f9ea9163640 1 Processor -- start 2024-09-21T08:06:20.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.938+0000 7f9ea9163640 1 -- start start 2024-09-21T08:06:20.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.938+0000 7f9ea9163640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea40fb810 0x7f9ea4113130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.938+0000 7f9ea9163640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ea40fcf80 0x7f9ea4113670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.938+0000 7f9ea9163640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea4113c70 con 0x7f9ea40fb810 2024-09-21T08:06:20.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.938+0000 7f9ea9163640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea410d0b0 con 0x7f9ea40fcf80 2024-09-21T08:06:20.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.939+0000 7f9ea2d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea40fb810 0x7f9ea4113130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.939+0000 7f9ea2d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea40fb810 0x7f9ea4113130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59320/0 (socket says 172.21.15.107:59320) 2024-09-21T08:06:20.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.939+0000 7f9ea2d9d640 1 -- 172.21.15.107:0/237306416 learned_addr learned my addr 172.21.15.107:0/237306416 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:06:20.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.939+0000 7f9ea259c640 1 --2- 172.21.15.107:0/237306416 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ea40fcf80 0x7f9ea4113670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.939+0000 7f9ea2d9d640 1 -- 172.21.15.107:0/237306416 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ea40fcf80 msgr2=0x7f9ea4113670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:20.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.939+0000 7f9ea2d9d640 1 --2- 172.21.15.107:0/237306416 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ea40fcf80 0x7f9ea4113670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.939+0000 7f9ea2d9d640 1 -- 172.21.15.107:0/237306416 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c005040 con 0x7f9ea40fb810 2024-09-21T08:06:20.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.939+0000 7f9ea2d9d640 1 --2- 172.21.15.107:0/237306416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea40fb810 0x7f9ea4113130 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9e94002a80 tx=0x7f9e94004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:20.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.939+0000 7f9e9b7fe640 1 -- 172.21.15.107:0/237306416 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e94007c30 con 0x7f9ea40fb810 2024-09-21T08:06:20.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.939+0000 7f9e9b7fe640 1 -- 172.21.15.107:0/237306416 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9e9400f040 con 0x7f9ea40fb810 2024-09-21T08:06:20.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.939+0000 7f9e9b7fe640 1 -- 172.21.15.107:0/237306416 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e94009530 con 0x7f9ea40fb810 2024-09-21T08:06:20.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.939+0000 7f9ea9163640 1 -- 172.21.15.107:0/237306416 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea410d390 con 0x7f9ea40fb810 2024-09-21T08:06:20.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.939+0000 7f9ea9163640 1 -- 172.21.15.107:0/237306416 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea410d880 con 0x7f9ea40fb810 2024-09-21T08:06:20.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.941+0000 7f9ea9163640 1 -- 172.21.15.107:0/237306416 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea40fcbc0 con 0x7f9ea40fb810 2024-09-21T08:06:20.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.941+0000 7f9e9b7fe640 1 -- 172.21.15.107:0/237306416 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f9e940096b0 con 0x7f9ea40fb810 2024-09-21T08:06:20.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.942+0000 7f9e9b7fe640 1 --2- 172.21.15.107:0/237306416 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f9e9006e660 0x7f9e90070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.942+0000 7f9e9b7fe640 1 -- 172.21.15.107:0/237306416 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f9e9408dc80 con 0x7f9ea40fb810 2024-09-21T08:06:20.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.942+0000 7f9ea259c640 1 --2- 172.21.15.107:0/237306416 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f9e9006e660 0x7f9e90070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.942+0000 7f9ea259c640 1 --2- 172.21.15.107:0/237306416 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f9e9006e660 0x7f9e90070b10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4072890 tx=0x7f9e8c035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:20.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:20.946+0000 7f9e9b7fe640 1 -- 172.21.15.107:0/237306416 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9e94056c70 con 0x7f9ea40fb810 2024-09-21T08:06:21.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.119+0000 7f9ea9163640 1 -- 172.21.15.107:0/237306416 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ea404b750 con 0x7f9e9006e660 2024-09-21T08:06:21.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.128+0000 7f9e9b7fe640 1 -- 172.21.15.107:0/237306416 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f9ea404b750 con 0x7f9e9006e660 2024-09-21T08:06:21.130 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:06:21.130 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (3m) 16s ago 11m 27.8M - 0.25.0 c8568f914cd2 2b499aa3b7de 2024-09-21T08:06:21.130 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (11m) 16s ago 11m 6899k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 4557b307c7dd 2024-09-21T08:06:21.130 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (10m) 3s ago 10m 6895k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be e74e9385abdf 2024-09-21T08:06:21.130 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (88s) 16s ago 11m 76.8M - 9.4.12 2bacad6d85d8 63177dcfe25c 2024-09-21T08:06:21.130 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (6m) 16s ago 6m 155M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 3bc779f88228 2024-09-21T08:06:21.130 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (6m) 16s ago 6m 13.4M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be ea8f140aade7 2024-09-21T08:06:21.130 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (6m) 3s ago 6m 16.5M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 329346c3afec 2024-09-21T08:06:21.130 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (6m) 3s ago 6m 17.9M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be baf87f32bfbc 2024-09-21T08:06:21.130 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:8443,9283,8765 running (2m) 16s ago 12m 472M - 19.1.1-367-g9e2ac70b cc9251b744a3 49c237734f07 2024-09-21T08:06:21.131 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283,8765 running (109s) 3s ago 10m 438M - 19.1.1-367-g9e2ac70b cc9251b744a3 ed117096bdd8 2024-09-21T08:06:21.131 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (28s) 16s ago 12m 27.5M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 445b3e6a800f 2024-09-21T08:06:21.131 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (6s) 3s ago 10m 20.0M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 12706f823621 2024-09-21T08:06:21.131 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 running (3m) 16s ago 11m 18.1M - 1.5.0 0da6a335fe13 6de7c307ba0f 2024-09-21T08:06:21.131 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (3m) 3s ago 10m 16.3M - 1.5.0 0da6a335fe13 cb6d4577b24c 2024-09-21T08:06:21.131 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (9m) 16s ago 9m 245M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 6799bdf55207 2024-09-21T08:06:21.131 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (9m) 16s ago 9m 260M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 29d8ce3f3a52 2024-09-21T08:06:21.131 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (8m) 16s ago 8m 210M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be c9e1c4756c02 2024-09-21T08:06:21.131 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (8m) 3s ago 8m 279M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7d58f70b105c 2024-09-21T08:06:21.132 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (8m) 3s ago 8m 252M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 2f916ef76d22 2024-09-21T08:06:21.132 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (7m) 3s ago 7m 235M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 0f25d9454304 2024-09-21T08:06:21.132 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (114s) 16s ago 11m 59.9M - 2.43.0 a07b618ecd1d 9ed2abf5e8d8 2024-09-21T08:06:21.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.130+0000 7f9ea9163640 1 -- 172.21.15.107:0/237306416 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f9e9006e660 msgr2=0x7f9e90070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:21.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.130+0000 7f9ea9163640 1 --2- 172.21.15.107:0/237306416 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f9e9006e660 0x7f9e90070b10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4072890 tx=0x7f9e8c035040 comp rx=0 tx=0).stop 2024-09-21T08:06:21.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.130+0000 7f9ea9163640 1 -- 172.21.15.107:0/237306416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea40fb810 msgr2=0x7f9ea4113130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:21.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.130+0000 7f9ea9163640 1 --2- 172.21.15.107:0/237306416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea40fb810 0x7f9ea4113130 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9e94002a80 tx=0x7f9e94004600 comp rx=0 tx=0).stop 2024-09-21T08:06:21.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.130+0000 7f9ea9163640 1 -- 172.21.15.107:0/237306416 shutdown_connections 2024-09-21T08:06:21.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.130+0000 7f9ea9163640 1 --2- 172.21.15.107:0/237306416 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f9e9006e660 0x7f9e90070b10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.130+0000 7f9ea9163640 1 --2- 172.21.15.107:0/237306416 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ea40fcf80 0x7f9ea4113670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.130+0000 7f9ea9163640 1 --2- 172.21.15.107:0/237306416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea40fb810 0x7f9ea4113130 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.130+0000 7f9ea9163640 1 -- 172.21.15.107:0/237306416 >> 172.21.15.107:0/237306416 conn(0x7f9ea40723b0 msgr2=0x7f9ea4101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:21.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.130+0000 7f9ea9163640 1 -- 172.21.15.107:0/237306416 shutdown_connections 2024-09-21T08:06:21.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.130+0000 7f9ea9163640 1 -- 172.21.15.107:0/237306416 wait complete. 2024-09-21T08:06:21.153 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:20 smithi129 ceph-mon[76722]: pgmap v13: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:21.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.207+0000 7f3c19c20640 1 -- 172.21.15.107:0/679413836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c14102550 msgr2=0x7f3c14102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:21.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.207+0000 7f3c19c20640 1 --2- 172.21.15.107:0/679413836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c14102550 0x7f3c14102920 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3c040048d0 tx=0x7f3c04009da0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.207+0000 7f3c19c20640 1 -- 172.21.15.107:0/679413836 shutdown_connections 2024-09-21T08:06:21.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.207+0000 7f3c19c20640 1 --2- 172.21.15.107:0/679413836 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3c14102ef0 0x7f3c140fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.207+0000 7f3c19c20640 1 --2- 172.21.15.107:0/679413836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c14102550 0x7f3c14102920 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.207+0000 7f3c19c20640 1 -- 172.21.15.107:0/679413836 >> 172.21.15.107:0/679413836 conn(0x7f3c140f80f0 msgr2=0x7f3c140fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:21.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.207+0000 7f3c19c20640 1 -- 172.21.15.107:0/679413836 shutdown_connections 2024-09-21T08:06:21.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.207+0000 7f3c19c20640 1 -- 172.21.15.107:0/679413836 wait complete. 2024-09-21T08:06:21.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.208+0000 7f3c19c20640 1 Processor -- start 2024-09-21T08:06:21.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.208+0000 7f3c19c20640 1 -- start start 2024-09-21T08:06:21.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.208+0000 7f3c19c20640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3c14102550 0x7f3c14113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:21.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.208+0000 7f3c19c20640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c14102ef0 0x7f3c14113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:21.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.208+0000 7f3c19c20640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c14114100 con 0x7f3c14102ef0 2024-09-21T08:06:21.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.208+0000 7f3c19c20640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1410d510 con 0x7f3c14102550 2024-09-21T08:06:21.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.208+0000 7f3c12ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c14102ef0 0x7f3c14113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:21.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.208+0000 7f3c12ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c14102ef0 0x7f3c14113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49962/0 (socket says 172.21.15.107:49962) 2024-09-21T08:06:21.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.208+0000 7f3c12ffd640 1 -- 172.21.15.107:0/4076976766 learned_addr learned my addr 172.21.15.107:0/4076976766 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:06:21.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.209+0000 7f3c137fe640 1 --2- 172.21.15.107:0/4076976766 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3c14102550 0x7f3c14113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:21.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.209+0000 7f3c12ffd640 1 -- 172.21.15.107:0/4076976766 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3c14102550 msgr2=0x7f3c14113570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:21.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.209+0000 7f3c12ffd640 1 --2- 172.21.15.107:0/4076976766 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3c14102550 0x7f3c14113570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.209+0000 7f3c12ffd640 1 -- 172.21.15.107:0/4076976766 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c04005040 con 0x7f3c14102ef0 2024-09-21T08:06:21.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.209+0000 7f3c12ffd640 1 --2- 172.21.15.107:0/4076976766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c14102ef0 0x7f3c14113ab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3c08002870 tx=0x7f3c08004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:21.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.209+0000 7f3bfbfff640 1 -- 172.21.15.107:0/4076976766 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c08007c30 con 0x7f3c14102ef0 2024-09-21T08:06:21.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.209+0000 7f3c19c20640 1 -- 172.21.15.107:0/4076976766 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c1410d7f0 con 0x7f3c14102ef0 2024-09-21T08:06:21.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.209+0000 7f3bfbfff640 1 -- 172.21.15.107:0/4076976766 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3c0800f040 con 0x7f3c14102ef0 2024-09-21T08:06:21.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.209+0000 7f3bfbfff640 1 -- 172.21.15.107:0/4076976766 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c08009640 con 0x7f3c14102ef0 2024-09-21T08:06:21.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.209+0000 7f3c19c20640 1 -- 172.21.15.107:0/4076976766 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1410dd10 con 0x7f3c14102ef0 2024-09-21T08:06:21.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.211+0000 7f3c19c20640 1 -- 172.21.15.107:0/4076976766 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c140fdcd0 con 0x7f3c14102ef0 2024-09-21T08:06:21.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.211+0000 7f3bfbfff640 1 -- 172.21.15.107:0/4076976766 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f3c080097a0 con 0x7f3c14102ef0 2024-09-21T08:06:21.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.211+0000 7f3bfbfff640 1 --2- 172.21.15.107:0/4076976766 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f3bfc06e660 0x7f3bfc070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:21.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.211+0000 7f3bfbfff640 1 -- 172.21.15.107:0/4076976766 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f3c0808e270 con 0x7f3c14102ef0 2024-09-21T08:06:21.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.211+0000 7f3c137fe640 1 --2- 172.21.15.107:0/4076976766 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f3bfc06e660 0x7f3bfc070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:21.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.212+0000 7f3c137fe640 1 --2- 172.21.15.107:0/4076976766 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f3bfc06e660 0x7f3bfc070b10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009ac0 tx=0x7f3c04035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:21.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.216+0000 7f3bfbfff640 1 -- 172.21.15.107:0/4076976766 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3c08057260 con 0x7f3c14102ef0 2024-09-21T08:06:21.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.447+0000 7f3c19c20640 1 -- 172.21.15.107:0/4076976766 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3c1410ec10 con 0x7f3c14102ef0 2024-09-21T08:06:21.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.448+0000 7f3bfbfff640 1 -- 172.21.15.107:0/4076976766 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7f3c0805a920 con 0x7f3c14102ef0 2024-09-21T08:06:21.449 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:06:21.449 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": { 2024-09-21T08:06:21.449 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:06:21.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:06:21.450 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": { 2024-09-21T08:06:21.450 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:06:21.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:06:21.450 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": { 2024-09-21T08:06:21.450 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 6 2024-09-21T08:06:21.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:06:21.450 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-21T08:06:21.450 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 4 2024-09-21T08:06:21.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:06:21.450 INFO:teuthology.orchestra.run.smithi107.stdout: "overall": { 2024-09-21T08:06:21.450 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 10, 2024-09-21T08:06:21.450 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 4 2024-09-21T08:06:21.450 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-21T08:06:21.450 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:06:21.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.450+0000 7f3c19c20640 1 -- 172.21.15.107:0/4076976766 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f3bfc06e660 msgr2=0x7f3bfc070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:21.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.450+0000 7f3c19c20640 1 --2- 172.21.15.107:0/4076976766 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f3bfc06e660 0x7f3bfc070b10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009ac0 tx=0x7f3c04035040 comp rx=0 tx=0).stop 2024-09-21T08:06:21.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.450+0000 7f3c19c20640 1 -- 172.21.15.107:0/4076976766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c14102ef0 msgr2=0x7f3c14113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:21.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.450+0000 7f3c19c20640 1 --2- 172.21.15.107:0/4076976766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c14102ef0 0x7f3c14113ab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3c08002870 tx=0x7f3c08004600 comp rx=0 tx=0).stop 2024-09-21T08:06:21.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.450+0000 7f3c19c20640 1 -- 172.21.15.107:0/4076976766 shutdown_connections 2024-09-21T08:06:21.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.450+0000 7f3c19c20640 1 --2- 172.21.15.107:0/4076976766 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f3bfc06e660 0x7f3bfc070b10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.450+0000 7f3c19c20640 1 --2- 172.21.15.107:0/4076976766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c14102ef0 0x7f3c14113ab0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.450+0000 7f3c19c20640 1 --2- 172.21.15.107:0/4076976766 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3c14102550 0x7f3c14113570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.450+0000 7f3c19c20640 1 -- 172.21.15.107:0/4076976766 >> 172.21.15.107:0/4076976766 conn(0x7f3c140f80f0 msgr2=0x7f3c140f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:21.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.450+0000 7f3c19c20640 1 -- 172.21.15.107:0/4076976766 shutdown_connections 2024-09-21T08:06:21.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.450+0000 7f3c19c20640 1 -- 172.21.15.107:0/4076976766 wait complete. 2024-09-21T08:06:21.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.534+0000 7fc3e3ace640 1 -- 172.21.15.107:0/1757214645 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3dc0fd410 msgr2=0x7fc3dc0fd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:21.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.534+0000 7fc3e3ace640 1 --2- 172.21.15.107:0/1757214645 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3dc0fd410 0x7fc3dc0fd7e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80048d0 tx=0x7fc3d8009da0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.534+0000 7fc3e3ace640 1 -- 172.21.15.107:0/1757214645 shutdown_connections 2024-09-21T08:06:21.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.534+0000 7fc3e3ace640 1 --2- 172.21.15.107:0/1757214645 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc3dc0facf0 0x7fc3dc0fb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.534+0000 7fc3e3ace640 1 --2- 172.21.15.107:0/1757214645 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3dc0fd410 0x7fc3dc0fd7e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.534+0000 7fc3e3ace640 1 -- 172.21.15.107:0/1757214645 >> 172.21.15.107:0/1757214645 conn(0x7fc3dc070d50 msgr2=0x7fc3dc071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:21.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.534+0000 7fc3e3ace640 1 -- 172.21.15.107:0/1757214645 shutdown_connections 2024-09-21T08:06:21.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.534+0000 7fc3e3ace640 1 -- 172.21.15.107:0/1757214645 wait complete. 2024-09-21T08:06:21.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.535+0000 7fc3e3ace640 1 Processor -- start 2024-09-21T08:06:21.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.535+0000 7fc3e3ace640 1 -- start start 2024-09-21T08:06:21.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.535+0000 7fc3e3ace640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3dc0facf0 0x7fc3dc1153d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:21.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.535+0000 7fc3e3ace640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc3dc0fd410 0x7fc3dc115910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:21.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.535+0000 7fc3e3ace640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc115f10 con 0x7fc3dc0facf0 2024-09-21T08:06:21.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.535+0000 7fc3e3ace640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc116080 con 0x7fc3dc0fd410 2024-09-21T08:06:21.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.535+0000 7fc3e186a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3dc0facf0 0x7fc3dc1153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:21.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.535+0000 7fc3e1069640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc3dc0fd410 0x7fc3dc115910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:21.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.535+0000 7fc3e1069640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc3dc0fd410 0x7fc3dc115910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.107:60156/0 (socket says 172.21.15.107:60156) 2024-09-21T08:06:21.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.535+0000 7fc3e186a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3dc0facf0 0x7fc3dc1153d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49988/0 (socket says 172.21.15.107:49988) 2024-09-21T08:06:21.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.535+0000 7fc3e1069640 1 -- 172.21.15.107:0/3627953281 learned_addr learned my addr 172.21.15.107:0/3627953281 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:06:21.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.536+0000 7fc3e1069640 1 -- 172.21.15.107:0/3627953281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3dc0facf0 msgr2=0x7fc3dc1153d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:21.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.536+0000 7fc3e1069640 1 --2- 172.21.15.107:0/3627953281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3dc0facf0 0x7fc3dc1153d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.536+0000 7fc3e1069640 1 -- 172.21.15.107:0/3627953281 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d8005040 con 0x7fc3dc0fd410 2024-09-21T08:06:21.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.536+0000 7fc3e186a640 1 --2- 172.21.15.107:0/3627953281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3dc0facf0 0x7fc3dc1153d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:06:21.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.536+0000 7fc3e1069640 1 --2- 172.21.15.107:0/3627953281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc3dc0fd410 0x7fc3dc115910 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00eb70 tx=0x7fc3cc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:21.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.536+0000 7fc3d27fc640 1 -- 172.21.15.107:0/3627953281 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3cc007c30 con 0x7fc3dc0fd410 2024-09-21T08:06:21.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.536+0000 7fc3d27fc640 1 -- 172.21.15.107:0/3627953281 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc3cc00f040 con 0x7fc3dc0fd410 2024-09-21T08:06:21.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.536+0000 7fc3e3ace640 1 -- 172.21.15.107:0/3627953281 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3dc10f4f0 con 0x7fc3dc0fd410 2024-09-21T08:06:21.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.536+0000 7fc3d27fc640 1 -- 172.21.15.107:0/3627953281 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3cc009420 con 0x7fc3dc0fd410 2024-09-21T08:06:21.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.536+0000 7fc3e3ace640 1 -- 172.21.15.107:0/3627953281 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3dc10fa10 con 0x7fc3dc0fd410 2024-09-21T08:06:21.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.537+0000 7fc3e3ace640 1 -- 172.21.15.107:0/3627953281 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3dc0fbd00 con 0x7fc3dc0fd410 2024-09-21T08:06:21.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.538+0000 7fc3d27fc640 1 -- 172.21.15.107:0/3627953281 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fc3cc009690 con 0x7fc3dc0fd410 2024-09-21T08:06:21.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.538+0000 7fc3d27fc640 1 --2- 172.21.15.107:0/3627953281 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc3c806e660 0x7fc3c8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:21.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.538+0000 7fc3d27fc640 1 -- 172.21.15.107:0/3627953281 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc3cc08e0a0 con 0x7fc3dc0fd410 2024-09-21T08:06:21.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.538+0000 7fc3e186a640 1 --2- 172.21.15.107:0/3627953281 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc3c806e660 0x7fc3c8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:21.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.539+0000 7fc3e186a640 1 --2- 172.21.15.107:0/3627953281 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc3c806e660 0x7fc3c8070b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009ac0 tx=0x7fc3d8035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:21.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.543+0000 7fc3d27fc640 1 -- 172.21.15.107:0/3627953281 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc3cc057020 con 0x7fc3dc0fd410 2024-09-21T08:06:21.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.753+0000 7fc3e3ace640 1 -- 172.21.15.107:0/3627953281 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc3dc074c70 con 0x7fc3dc0fd410 2024-09-21T08:06:21.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.753+0000 7fc3d27fc640 1 -- 172.21.15.107:0/3627953281 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1922 (secure 0 0 0) 0x7fc3cc05a6e0 con 0x7fc3dc0fd410 2024-09-21T08:06:21.755 INFO:teuthology.orchestra.run.smithi107.stdout:e15 2024-09-21T08:06:21.755 INFO:teuthology.orchestra.run.smithi107.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-21T08:06:21.755 INFO:teuthology.orchestra.run.smithi107.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T08:06:21.755 INFO:teuthology.orchestra.run.smithi107.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:06:21.755 INFO:teuthology.orchestra.run.smithi107.stdout:legacy client fscid: 1 2024-09-21T08:06:21.755 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:06:21.755 INFO:teuthology.orchestra.run.smithi107.stdout:Filesystem 'cephfs' (1) 2024-09-21T08:06:21.755 INFO:teuthology.orchestra.run.smithi107.stdout:fs_name cephfs 2024-09-21T08:06:21.756 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 15 2024-09-21T08:06:21.756 INFO:teuthology.orchestra.run.smithi107.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T08:06:21.756 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-09-21T08:00:03.244314+0000 2024-09-21T08:06:21.756 INFO:teuthology.orchestra.run.smithi107.stdout:modified 2024-09-21T08:00:21.458971+0000 2024-09-21T08:06:21.756 INFO:teuthology.orchestra.run.smithi107.stdout:tableserver 0 2024-09-21T08:06:21.756 INFO:teuthology.orchestra.run.smithi107.stdout:root 0 2024-09-21T08:06:21.756 INFO:teuthology.orchestra.run.smithi107.stdout:session_timeout 60 2024-09-21T08:06:21.756 INFO:teuthology.orchestra.run.smithi107.stdout:session_autoclose 300 2024-09-21T08:06:21.756 INFO:teuthology.orchestra.run.smithi107.stdout:max_file_size 1099511627776 2024-09-21T08:06:21.756 INFO:teuthology.orchestra.run.smithi107.stdout:max_xattr_size 65536 2024-09-21T08:06:21.756 INFO:teuthology.orchestra.run.smithi107.stdout:required_client_features {} 2024-09-21T08:06:21.756 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure 0 2024-09-21T08:06:21.756 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure_osd_epoch 44 2024-09-21T08:06:21.756 INFO:teuthology.orchestra.run.smithi107.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:06:21.756 INFO:teuthology.orchestra.run.smithi107.stdout:max_mds 1 2024-09-21T08:06:21.756 INFO:teuthology.orchestra.run.smithi107.stdout:in 0 2024-09-21T08:06:21.757 INFO:teuthology.orchestra.run.smithi107.stdout:up {0=14458} 2024-09-21T08:06:21.757 INFO:teuthology.orchestra.run.smithi107.stdout:failed 2024-09-21T08:06:21.757 INFO:teuthology.orchestra.run.smithi107.stdout:damaged 2024-09-21T08:06:21.757 INFO:teuthology.orchestra.run.smithi107.stdout:stopped 2024-09-21T08:06:21.757 INFO:teuthology.orchestra.run.smithi107.stdout:data_pools [3] 2024-09-21T08:06:21.757 INFO:teuthology.orchestra.run.smithi107.stdout:metadata_pool 2 2024-09-21T08:06:21.757 INFO:teuthology.orchestra.run.smithi107.stdout:inline_data disabled 2024-09-21T08:06:21.757 INFO:teuthology.orchestra.run.smithi107.stdout:balancer 2024-09-21T08:06:21.757 INFO:teuthology.orchestra.run.smithi107.stdout:bal_rank_mask -1 2024-09-21T08:06:21.757 INFO:teuthology.orchestra.run.smithi107.stdout:standby_count_wanted 1 2024-09-21T08:06:21.757 INFO:teuthology.orchestra.run.smithi107.stdout:qdb_cluster leader: 0 members: 2024-09-21T08:06:21.757 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.grqzkt{0:14458} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:06:21.757 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:06:21.757 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:06:21.758 INFO:teuthology.orchestra.run.smithi107.stdout:Standby daemons: 2024-09-21T08:06:21.758 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:06:21.758 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.qusoyf{-1:14468} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6826/2352538667,v1:172.21.15.107:6827/2352538667] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:06:21.758 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.fwmfcy{-1:24239} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:06:21.758 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.belyba{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:06:21.758 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 15 2024-09-21T08:06:21.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.756+0000 7fc3e3ace640 1 -- 172.21.15.107:0/3627953281 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc3c806e660 msgr2=0x7fc3c8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:21.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.756+0000 7fc3e3ace640 1 --2- 172.21.15.107:0/3627953281 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc3c806e660 0x7fc3c8070b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009ac0 tx=0x7fc3d8035040 comp rx=0 tx=0).stop 2024-09-21T08:06:21.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.756+0000 7fc3e3ace640 1 -- 172.21.15.107:0/3627953281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc3dc0fd410 msgr2=0x7fc3dc115910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:21.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.756+0000 7fc3e3ace640 1 --2- 172.21.15.107:0/3627953281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc3dc0fd410 0x7fc3dc115910 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00eb70 tx=0x7fc3cc00b040 comp rx=0 tx=0).stop 2024-09-21T08:06:21.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.756+0000 7fc3e3ace640 1 -- 172.21.15.107:0/3627953281 shutdown_connections 2024-09-21T08:06:21.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.756+0000 7fc3e3ace640 1 --2- 172.21.15.107:0/3627953281 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc3c806e660 0x7fc3c8070b10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.756+0000 7fc3e3ace640 1 --2- 172.21.15.107:0/3627953281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc3dc0fd410 0x7fc3dc115910 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.756+0000 7fc3e3ace640 1 --2- 172.21.15.107:0/3627953281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3dc0facf0 0x7fc3dc1153d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.756+0000 7fc3e3ace640 1 -- 172.21.15.107:0/3627953281 >> 172.21.15.107:0/3627953281 conn(0x7fc3dc070d50 msgr2=0x7fc3dc0fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:21.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.756+0000 7fc3e3ace640 1 -- 172.21.15.107:0/3627953281 shutdown_connections 2024-09-21T08:06:21.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.756+0000 7fc3e3ace640 1 -- 172.21.15.107:0/3627953281 wait complete. 2024-09-21T08:06:21.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.842+0000 7febdd714640 1 -- 172.21.15.107:0/533389612 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febd8102ef0 msgr2=0x7febd80fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:21.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.842+0000 7febdd714640 1 --2- 172.21.15.107:0/533389612 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febd8102ef0 0x7febd80fc5b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7febc00048d0 tx=0x7febc0009da0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.842+0000 7febdd714640 1 -- 172.21.15.107:0/533389612 shutdown_connections 2024-09-21T08:06:21.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.842+0000 7febdd714640 1 --2- 172.21.15.107:0/533389612 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febd8102ef0 0x7febd80fc5b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.842+0000 7febdd714640 1 --2- 172.21.15.107:0/533389612 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7febd8102550 0x7febd8102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.842+0000 7febdd714640 1 -- 172.21.15.107:0/533389612 >> 172.21.15.107:0/533389612 conn(0x7febd80f80f0 msgr2=0x7febd80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:21.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.842+0000 7febdd714640 1 -- 172.21.15.107:0/533389612 shutdown_connections 2024-09-21T08:06:21.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.842+0000 7febdd714640 1 -- 172.21.15.107:0/533389612 wait complete. 2024-09-21T08:06:21.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.843+0000 7febdd714640 1 Processor -- start 2024-09-21T08:06:21.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.843+0000 7febdd714640 1 -- start start 2024-09-21T08:06:21.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.843+0000 7febdd714640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7febd8102550 0x7febd806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:21.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.843+0000 7febdd714640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febd8102ef0 0x7febd806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:21.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.843+0000 7febdd714640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd8070490 con 0x7febd8102ef0 2024-09-21T08:06:21.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.843+0000 7febdd714640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd8070600 con 0x7febd8102550 2024-09-21T08:06:21.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.843+0000 7febd67fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febd8102ef0 0x7febd806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:21.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.843+0000 7febd67fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febd8102ef0 0x7febd806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50004/0 (socket says 172.21.15.107:50004) 2024-09-21T08:06:21.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.843+0000 7febd67fc640 1 -- 172.21.15.107:0/2404179064 learned_addr learned my addr 172.21.15.107:0/2404179064 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:06:21.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.843+0000 7febd6ffd640 1 --2- 172.21.15.107:0/2404179064 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7febd8102550 0x7febd806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:21.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.843+0000 7febd67fc640 1 -- 172.21.15.107:0/2404179064 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7febd8102550 msgr2=0x7febd806fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:21.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.843+0000 7febd67fc640 1 --2- 172.21.15.107:0/2404179064 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7febd8102550 0x7febd806fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:21.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.844+0000 7febd67fc640 1 -- 172.21.15.107:0/2404179064 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc0005040 con 0x7febd8102ef0 2024-09-21T08:06:21.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.844+0000 7febd67fc640 1 --2- 172.21.15.107:0/2404179064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febd8102ef0 0x7febd806ff50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7febc00043d0 tx=0x7febc0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:21.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.844+0000 7febcf7fe640 1 -- 172.21.15.107:0/2404179064 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febc0038070 con 0x7febd8102ef0 2024-09-21T08:06:21.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.844+0000 7febdd714640 1 -- 172.21.15.107:0/2404179064 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd8070830 con 0x7febd8102ef0 2024-09-21T08:06:21.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.844+0000 7febcf7fe640 1 -- 172.21.15.107:0/2404179064 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7febc00096e0 con 0x7febd8102ef0 2024-09-21T08:06:21.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.844+0000 7febcf7fe640 1 -- 172.21.15.107:0/2404179064 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febc002c8a0 con 0x7febd8102ef0 2024-09-21T08:06:21.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.844+0000 7febdd714640 1 -- 172.21.15.107:0/2404179064 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd8119ba0 con 0x7febd8102ef0 2024-09-21T08:06:21.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.845+0000 7febdd714640 1 -- 172.21.15.107:0/2404179064 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd80fdcd0 con 0x7febd8102ef0 2024-09-21T08:06:21.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.845+0000 7febcf7fe640 1 -- 172.21.15.107:0/2404179064 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7febc0030020 con 0x7febd8102ef0 2024-09-21T08:06:21.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.846+0000 7febcf7fe640 1 --2- 172.21.15.107:0/2404179064 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7febc406e660 0x7febc4070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:21.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.846+0000 7febcf7fe640 1 -- 172.21.15.107:0/2404179064 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6324+0+0 (secure 0 0 0) 0x7febc00adf70 con 0x7febd8102ef0 2024-09-21T08:06:21.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.846+0000 7febd6ffd640 1 --2- 172.21.15.107:0/2404179064 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7febc406e660 0x7febc4070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:21.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.846+0000 7febd6ffd640 1 --2- 172.21.15.107:0/2404179064 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7febc406e660 0x7febc4070b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7febd0004fd0 tx=0x7febd0009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:21.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:21.850+0000 7febcf7fe640 1 -- 172.21.15.107:0/2404179064 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7febc00e3210 con 0x7febd8102ef0 2024-09-21T08:06:22.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.035+0000 7febdd714640 1 -- 172.21.15.107:0/2404179064 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7febd81095f0 con 0x7febc406e660 2024-09-21T08:06:22.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.036+0000 7febcf7fe640 1 -- 172.21.15.107:0/2404179064 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7febd81095f0 con 0x7febc406e660 2024-09-21T08:06:22.038 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:06:22.038 INFO:teuthology.orchestra.run.smithi107.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5", 2024-09-21T08:06:22.038 INFO:teuthology.orchestra.run.smithi107.stdout: "in_progress": true, 2024-09-21T08:06:22.038 INFO:teuthology.orchestra.run.smithi107.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T08:06:22.038 INFO:teuthology.orchestra.run.smithi107.stdout: "services_complete": [ 2024-09-21T08:06:22.038 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr", 2024-09-21T08:06:22.038 INFO:teuthology.orchestra.run.smithi107.stdout: "mon" 2024-09-21T08:06:22.038 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-21T08:06:22.038 INFO:teuthology.orchestra.run.smithi107.stdout: "progress": "4/21 daemons upgraded", 2024-09-21T08:06:22.038 INFO:teuthology.orchestra.run.smithi107.stdout: "message": "Currently upgrading mon daemons", 2024-09-21T08:06:22.039 INFO:teuthology.orchestra.run.smithi107.stdout: "is_paused": false 2024-09-21T08:06:22.039 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:06:22.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.038+0000 7febdd714640 1 -- 172.21.15.107:0/2404179064 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7febc406e660 msgr2=0x7febc4070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:22.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.038+0000 7febdd714640 1 --2- 172.21.15.107:0/2404179064 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7febc406e660 0x7febc4070b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7febd0004fd0 tx=0x7febd0009040 comp rx=0 tx=0).stop 2024-09-21T08:06:22.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.038+0000 7febdd714640 1 -- 172.21.15.107:0/2404179064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febd8102ef0 msgr2=0x7febd806ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:22.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.038+0000 7febdd714640 1 --2- 172.21.15.107:0/2404179064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febd8102ef0 0x7febd806ff50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7febc00043d0 tx=0x7febc0009da0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.038+0000 7febdd714640 1 -- 172.21.15.107:0/2404179064 shutdown_connections 2024-09-21T08:06:22.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.038+0000 7febdd714640 1 --2- 172.21.15.107:0/2404179064 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7febc406e660 0x7febc4070b10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.038+0000 7febdd714640 1 --2- 172.21.15.107:0/2404179064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febd8102ef0 0x7febd806ff50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.038+0000 7febdd714640 1 --2- 172.21.15.107:0/2404179064 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7febd8102550 0x7febd806fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.038+0000 7febdd714640 1 -- 172.21.15.107:0/2404179064 >> 172.21.15.107:0/2404179064 conn(0x7febd80f80f0 msgr2=0x7febd80f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:22.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.038+0000 7febdd714640 1 -- 172.21.15.107:0/2404179064 shutdown_connections 2024-09-21T08:06:22.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.038+0000 7febdd714640 1 -- 172.21.15.107:0/2404179064 wait complete. 2024-09-21T08:06:22.077 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:21 smithi107 ceph-mon[97757]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:06:22.077 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:21 smithi107 ceph-mon[97757]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:06:22.077 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:21 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/4076976766' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:06:22.078 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:21 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:22.078 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:21 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:22.078 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:21 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:22.078 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:21 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:06:22.078 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:21 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:22.078 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:21 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T08:06:22.078 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:21 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T08:06:22.078 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:21 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:22.078 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:21 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/3627953281' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:06:22.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.120+0000 7f9f002e4640 1 -- 172.21.15.107:0/1502116659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ef8102ed0 msgr2=0x7f9ef80fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:22.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.120+0000 7f9f002e4640 1 --2- 172.21.15.107:0/1502116659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ef8102ed0 0x7f9ef80fc590 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0048d0 tx=0x7f9eec009da0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.120+0000 7f9f002e4640 1 -- 172.21.15.107:0/1502116659 shutdown_connections 2024-09-21T08:06:22.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.120+0000 7f9f002e4640 1 --2- 172.21.15.107:0/1502116659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ef8102ed0 0x7f9ef80fc590 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.120+0000 7f9f002e4640 1 --2- 172.21.15.107:0/1502116659 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ef8102530 0x7f9ef8102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.120+0000 7f9f002e4640 1 -- 172.21.15.107:0/1502116659 >> 172.21.15.107:0/1502116659 conn(0x7f9ef80f8110 msgr2=0x7f9ef80fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:22.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.120+0000 7f9f002e4640 1 -- 172.21.15.107:0/1502116659 shutdown_connections 2024-09-21T08:06:22.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.120+0000 7f9f002e4640 1 -- 172.21.15.107:0/1502116659 wait complete. 2024-09-21T08:06:22.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.120+0000 7f9f002e4640 1 Processor -- start 2024-09-21T08:06:22.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.120+0000 7f9f002e4640 1 -- start start 2024-09-21T08:06:22.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.120+0000 7f9f002e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ef8102530 0x7f9ef81131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.120+0000 7f9f002e4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ef8102ed0 0x7f9ef8113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.120+0000 7f9f002e4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef8113d30 con 0x7f9ef8102ed0 2024-09-21T08:06:22.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.120+0000 7f9f002e4640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef810d170 con 0x7f9ef8102530 2024-09-21T08:06:22.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.121+0000 7f9efd87f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ef8102ed0 0x7f9ef8113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.121+0000 7f9efd87f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ef8102ed0 0x7f9ef8113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50022/0 (socket says 172.21.15.107:50022) 2024-09-21T08:06:22.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.121+0000 7f9efd87f640 1 -- 172.21.15.107:0/3198943211 learned_addr learned my addr 172.21.15.107:0/3198943211 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:06:22.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.121+0000 7f9efe080640 1 --2- 172.21.15.107:0/3198943211 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ef8102530 0x7f9ef81131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.121+0000 7f9efd87f640 1 -- 172.21.15.107:0/3198943211 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ef8102530 msgr2=0x7f9ef81131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:22.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.121+0000 7f9efd87f640 1 --2- 172.21.15.107:0/3198943211 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ef8102530 0x7f9ef81131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.121+0000 7f9efd87f640 1 -- 172.21.15.107:0/3198943211 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec005040 con 0x7f9ef8102ed0 2024-09-21T08:06:22.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.121+0000 7f9efd87f640 1 --2- 172.21.15.107:0/3198943211 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ef8102ed0 0x7f9ef8113730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0043d0 tx=0x7f9eec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:22.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.121+0000 7f9eeaffd640 1 -- 172.21.15.107:0/3198943211 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eec038070 con 0x7f9ef8102ed0 2024-09-21T08:06:22.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.121+0000 7f9eeaffd640 1 -- 172.21.15.107:0/3198943211 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9eec0096e0 con 0x7f9ef8102ed0 2024-09-21T08:06:22.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.121+0000 7f9f002e4640 1 -- 172.21.15.107:0/3198943211 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef810d3f0 con 0x7f9ef8102ed0 2024-09-21T08:06:22.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.121+0000 7f9eeaffd640 1 -- 172.21.15.107:0/3198943211 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eec02c8a0 con 0x7f9ef8102ed0 2024-09-21T08:06:22.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.121+0000 7f9f002e4640 1 -- 172.21.15.107:0/3198943211 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef810d8b0 con 0x7f9ef8102ed0 2024-09-21T08:06:22.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.122+0000 7f9f002e4640 1 -- 172.21.15.107:0/3198943211 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef80fdcb0 con 0x7f9ef8102ed0 2024-09-21T08:06:22.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.123+0000 7f9eeaffd640 1 -- 172.21.15.107:0/3198943211 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f9eec030020 con 0x7f9ef8102ed0 2024-09-21T08:06:22.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.123+0000 7f9eeaffd640 1 --2- 172.21.15.107:0/3198943211 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f9ee406e660 0x7f9ee4070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.123+0000 7f9efe080640 1 --2- 172.21.15.107:0/3198943211 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f9ee406e660 0x7f9ee4070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.123+0000 7f9eeaffd640 1 -- 172.21.15.107:0/3198943211 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f9eec0adf20 con 0x7f9ef8102ed0 2024-09-21T08:06:22.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.124+0000 7f9efe080640 1 --2- 172.21.15.107:0/3198943211 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f9ee406e660 0x7f9ee4070b10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4009fd0 tx=0x7f9ef400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:22.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.128+0000 7f9eeaffd640 1 -- 172.21.15.107:0/3198943211 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9eec0e3210 con 0x7f9ef8102ed0 2024-09-21T08:06:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:21 smithi129 ceph-mon[76722]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:06:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:21 smithi129 ceph-mon[76722]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:06:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:21 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/4076976766' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:06:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:21 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:21 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:21 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:21 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:06:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:21 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:21 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T08:06:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:21 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T08:06:22.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:21 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:22.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:21 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/3627953281' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:06:22.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.368+0000 7f9f002e4640 1 -- 172.21.15.107:0/3198943211 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9ef8109540 con 0x7f9ef8102ed0 2024-09-21T08:06:22.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.369+0000 7f9eeaffd640 1 -- 172.21.15.107:0/3198943211 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9eec0770d0 con 0x7f9ef8102ed0 2024-09-21T08:06:22.371 INFO:teuthology.orchestra.run.smithi107.stdout:HEALTH_OK 2024-09-21T08:06:22.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.371+0000 7f9f002e4640 1 -- 172.21.15.107:0/3198943211 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f9ee406e660 msgr2=0x7f9ee4070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:22.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.371+0000 7f9f002e4640 1 --2- 172.21.15.107:0/3198943211 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f9ee406e660 0x7f9ee4070b10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4009fd0 tx=0x7f9ef400b040 comp rx=0 tx=0).stop 2024-09-21T08:06:22.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.371+0000 7f9f002e4640 1 -- 172.21.15.107:0/3198943211 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ef8102ed0 msgr2=0x7f9ef8113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:22.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.371+0000 7f9f002e4640 1 --2- 172.21.15.107:0/3198943211 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ef8102ed0 0x7f9ef8113730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0043d0 tx=0x7f9eec009da0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.371+0000 7f9f002e4640 1 -- 172.21.15.107:0/3198943211 shutdown_connections 2024-09-21T08:06:22.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.371+0000 7f9f002e4640 1 --2- 172.21.15.107:0/3198943211 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f9ee406e660 0x7f9ee4070b10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.371+0000 7f9f002e4640 1 --2- 172.21.15.107:0/3198943211 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ef8102ed0 0x7f9ef8113730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.371+0000 7f9f002e4640 1 --2- 172.21.15.107:0/3198943211 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ef8102530 0x7f9ef81131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.371+0000 7f9f002e4640 1 -- 172.21.15.107:0/3198943211 >> 172.21.15.107:0/3198943211 conn(0x7f9ef80f8110 msgr2=0x7f9ef80f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:22.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.371+0000 7f9f002e4640 1 -- 172.21.15.107:0/3198943211 shutdown_connections 2024-09-21T08:06:22.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:22.371+0000 7f9f002e4640 1 -- 172.21.15.107:0/3198943211 wait complete. 2024-09-21T08:06:23.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:22 smithi129 ceph-mon[76722]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:06:23.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:22 smithi129 ceph-mon[76722]: Detected new or changed devices on smithi129 2024-09-21T08:06:23.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:22 smithi129 ceph-mon[76722]: Reconfiguring mon.smithi107 (monmap changed)... 2024-09-21T08:06:23.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:22 smithi129 ceph-mon[76722]: Reconfiguring daemon mon.smithi107 on smithi107 2024-09-21T08:06:23.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:22 smithi129 ceph-mon[76722]: pgmap v14: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:23.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:22 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/3198943211' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:06:23.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:22 smithi107 ceph-mon[97757]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:06:23.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:22 smithi107 ceph-mon[97757]: Detected new or changed devices on smithi129 2024-09-21T08:06:23.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:22 smithi107 ceph-mon[97757]: Reconfiguring mon.smithi107 (monmap changed)... 2024-09-21T08:06:23.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:22 smithi107 ceph-mon[97757]: Reconfiguring daemon mon.smithi107 on smithi107 2024-09-21T08:06:23.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:22 smithi107 ceph-mon[97757]: pgmap v14: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:23.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:22 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/3198943211' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:06:23.989 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:23 smithi107 ceph-mon[97757]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:06:23.990 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:23 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:23.990 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:23 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:23.990 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:23 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi107.wzulxb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T08:06:23.990 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:23 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T08:06:23.990 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:23 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:24.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:23 smithi129 ceph-mon[76722]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:06:24.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:23 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:24.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:23 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:24.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:23 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi107.wzulxb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T08:06:24.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:23 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T08:06:24.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:23 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:25.168 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:24 smithi107 ceph-mon[97757]: Reconfiguring mgr.smithi107.wzulxb (monmap changed)... 2024-09-21T08:06:25.169 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:24 smithi107 ceph-mon[97757]: Reconfiguring daemon mgr.smithi107.wzulxb on smithi107 2024-09-21T08:06:25.169 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:24 smithi107 ceph-mon[97757]: pgmap v15: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:25.169 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:24 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:25.169 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:24 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:25.169 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:24 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi107", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T08:06:25.169 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:24 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:25.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:24 smithi129 ceph-mon[76722]: Reconfiguring mgr.smithi107.wzulxb (monmap changed)... 2024-09-21T08:06:25.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:24 smithi129 ceph-mon[76722]: Reconfiguring daemon mgr.smithi107.wzulxb on smithi107 2024-09-21T08:06:25.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:24 smithi129 ceph-mon[76722]: pgmap v15: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:25.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:24 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:25.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:24 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:25.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:24 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi107", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T08:06:25.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:24 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:26.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:25 smithi129 ceph-mon[76722]: Reconfiguring crash.smithi107 (monmap changed)... 2024-09-21T08:06:26.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:25 smithi129 ceph-mon[76722]: Reconfiguring daemon crash.smithi107 on smithi107 2024-09-21T08:06:26.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:25 smithi107 ceph-mon[97757]: Reconfiguring crash.smithi107 (monmap changed)... 2024-09-21T08:06:26.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:25 smithi107 ceph-mon[97757]: Reconfiguring daemon crash.smithi107 on smithi107 2024-09-21T08:06:26.987 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:26 smithi107 ceph-mon[97757]: pgmap v16: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:26.988 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:26 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:26.988 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:26 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:26.988 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:26 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-21T08:06:26.988 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:26 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:27.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:26 smithi129 ceph-mon[76722]: pgmap v16: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:27.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:26 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:27.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:26 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:27.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:26 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-21T08:06:27.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:26 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:28.149 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:27 smithi107 ceph-mon[97757]: Reconfiguring osd.0 (monmap changed)... 2024-09-21T08:06:28.149 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:27 smithi107 ceph-mon[97757]: Reconfiguring daemon osd.0 on smithi107 2024-09-21T08:06:28.149 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:27 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:28.150 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:27 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:28.150 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:27 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-21T08:06:28.150 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:27 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:28.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:27 smithi129 ceph-mon[76722]: Reconfiguring osd.0 (monmap changed)... 2024-09-21T08:06:28.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:27 smithi129 ceph-mon[76722]: Reconfiguring daemon osd.0 on smithi107 2024-09-21T08:06:28.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:27 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:28.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:27 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:28.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:27 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-21T08:06:28.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:27 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:29.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:28 smithi107 ceph-mon[97757]: Reconfiguring osd.1 (monmap changed)... 2024-09-21T08:06:29.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:28 smithi107 ceph-mon[97757]: Reconfiguring daemon osd.1 on smithi107 2024-09-21T08:06:29.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:28 smithi107 ceph-mon[97757]: pgmap v17: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:29.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:28 smithi129 ceph-mon[76722]: Reconfiguring osd.1 (monmap changed)... 2024-09-21T08:06:29.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:28 smithi129 ceph-mon[76722]: Reconfiguring daemon osd.1 on smithi107 2024-09-21T08:06:29.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:28 smithi129 ceph-mon[76722]: pgmap v17: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:30.193 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:30.193 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:30.193 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:29 smithi107 ceph-mon[97757]: Reconfiguring osd.2 (monmap changed)... 2024-09-21T08:06:30.193 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-21T08:06:30.193 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:30.193 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:29 smithi107 ceph-mon[97757]: Reconfiguring daemon osd.2 on smithi107 2024-09-21T08:06:30.194 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:06:30.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:29 smithi129 ceph-mon[76722]: Reconfiguring osd.2 (monmap changed)... 2024-09-21T08:06:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-21T08:06:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:29 smithi129 ceph-mon[76722]: Reconfiguring daemon osd.2 on smithi107 2024-09-21T08:06:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:06:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:30 smithi107 ceph-mon[97757]: pgmap v18: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:30 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:30 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:30 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.qusoyf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:06:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:30 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:31.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:30 smithi129 ceph-mon[76722]: pgmap v18: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:31.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:30 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:31.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:30 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:31.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:30 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.qusoyf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:06:31.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:30 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:32.223 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:31 smithi107 ceph-mon[97757]: Reconfiguring mds.cephfs.smithi107.qusoyf (monmap changed)... 2024-09-21T08:06:32.223 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:31 smithi107 ceph-mon[97757]: Reconfiguring daemon mds.cephfs.smithi107.qusoyf on smithi107 2024-09-21T08:06:32.223 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:31 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:32.223 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:31 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:32.223 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:31 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.grqzkt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:06:32.223 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:31 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:32.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:31 smithi129 ceph-mon[76722]: Reconfiguring mds.cephfs.smithi107.qusoyf (monmap changed)... 2024-09-21T08:06:32.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:31 smithi129 ceph-mon[76722]: Reconfiguring daemon mds.cephfs.smithi107.qusoyf on smithi107 2024-09-21T08:06:32.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:31 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:32.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:31 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:32.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:31 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.grqzkt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:06:32.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:31 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:33.223 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:32 smithi107 ceph-mon[97757]: pgmap v19: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:33.224 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:32 smithi107 ceph-mon[97757]: Reconfiguring mds.cephfs.smithi107.grqzkt (monmap changed)... 2024-09-21T08:06:33.224 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:32 smithi107 ceph-mon[97757]: Reconfiguring daemon mds.cephfs.smithi107.grqzkt on smithi107 2024-09-21T08:06:33.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:32 smithi129 ceph-mon[76722]: pgmap v19: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:33.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:32 smithi129 ceph-mon[76722]: Reconfiguring mds.cephfs.smithi107.grqzkt (monmap changed)... 2024-09-21T08:06:33.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:32 smithi129 ceph-mon[76722]: Reconfiguring daemon mds.cephfs.smithi107.grqzkt on smithi107 2024-09-21T08:06:34.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:34 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:34.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:34 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:34.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:34 smithi107 ceph-mon[97757]: Reconfiguring crash.smithi129 (monmap changed)... 2024-09-21T08:06:34.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:34 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi129", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T08:06:34.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:34 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:34.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:34 smithi107 ceph-mon[97757]: Reconfiguring daemon crash.smithi129 on smithi129 2024-09-21T08:06:34.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:34 smithi107 ceph-mon[97757]: pgmap v20: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:34.579 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:34 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:34.579 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:34 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:34.580 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:34 smithi129 ceph-mon[76722]: Reconfiguring crash.smithi129 (monmap changed)... 2024-09-21T08:06:34.580 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:34 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi129", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T08:06:34.580 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:34 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:34.580 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:34 smithi129 ceph-mon[76722]: Reconfiguring daemon crash.smithi129 on smithi129 2024-09-21T08:06:34.580 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:34 smithi129 ceph-mon[76722]: pgmap v20: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:35.970 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:35 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:35.970 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:35 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:35.970 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:35 smithi129 ceph-mon[76722]: Reconfiguring mgr.smithi129.wvlmvo (monmap changed)... 2024-09-21T08:06:35.970 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:35 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi129.wvlmvo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T08:06:35.970 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:35 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T08:06:35.970 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:35 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:35.970 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:35 smithi129 ceph-mon[76722]: Reconfiguring daemon mgr.smithi129.wvlmvo on smithi129 2024-09-21T08:06:36.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:35 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:36.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:35 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:36.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:35 smithi107 ceph-mon[97757]: Reconfiguring mgr.smithi129.wvlmvo (monmap changed)... 2024-09-21T08:06:36.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:35 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi129.wvlmvo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T08:06:36.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:35 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T08:06:36.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:35 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:36.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:35 smithi107 ceph-mon[97757]: Reconfiguring daemon mgr.smithi129.wvlmvo on smithi129 2024-09-21T08:06:36.716 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:36 smithi129 ceph-mon[76722]: pgmap v21: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:36.716 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:36 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:36.716 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:36 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:36.716 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:36 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T08:06:36.717 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:36 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T08:06:36.717 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:36 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:37.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:36 smithi107 ceph-mon[97757]: pgmap v21: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:37.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:36 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:37.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:36 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:37.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:36 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T08:06:37.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:36 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T08:06:37.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:36 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:37.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:37 smithi129 ceph-mon[76722]: Reconfiguring mon.smithi129 (monmap changed)... 2024-09-21T08:06:37.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:37 smithi129 ceph-mon[76722]: Reconfiguring daemon mon.smithi129 on smithi129 2024-09-21T08:06:37.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:37 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:37.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:37 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:37.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:37 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-21T08:06:37.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:37 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:38.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:37 smithi107 ceph-mon[97757]: Reconfiguring mon.smithi129 (monmap changed)... 2024-09-21T08:06:38.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:37 smithi107 ceph-mon[97757]: Reconfiguring daemon mon.smithi129 on smithi129 2024-09-21T08:06:38.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:37 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:38.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:37 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:38.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:37 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-21T08:06:38.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:37 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:38.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:38 smithi129 ceph-mon[76722]: Reconfiguring osd.3 (monmap changed)... 2024-09-21T08:06:38.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:38 smithi129 ceph-mon[76722]: Reconfiguring daemon osd.3 on smithi129 2024-09-21T08:06:38.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:38 smithi129 ceph-mon[76722]: pgmap v22: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:39.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:38 smithi107 ceph-mon[97757]: Reconfiguring osd.3 (monmap changed)... 2024-09-21T08:06:39.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:38 smithi107 ceph-mon[97757]: Reconfiguring daemon osd.3 on smithi129 2024-09-21T08:06:39.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:38 smithi107 ceph-mon[97757]: pgmap v22: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:40.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:39 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:39 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:39 smithi129 ceph-mon[76722]: Reconfiguring osd.4 (monmap changed)... 2024-09-21T08:06:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:39 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-21T08:06:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:39 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:39 smithi129 ceph-mon[76722]: Reconfiguring daemon osd.4 on smithi129 2024-09-21T08:06:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:39 smithi129 ceph-mon[76722]: pgmap v23: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:40.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:39 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:40.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:39 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:40.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:39 smithi107 ceph-mon[97757]: Reconfiguring osd.4 (monmap changed)... 2024-09-21T08:06:40.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:39 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-21T08:06:40.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:39 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:40.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:39 smithi107 ceph-mon[97757]: Reconfiguring daemon osd.4 on smithi129 2024-09-21T08:06:40.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:39 smithi107 ceph-mon[97757]: pgmap v23: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:41.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:41 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:41.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:41 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:41.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:41 smithi107 ceph-mon[97757]: Reconfiguring osd.5 (monmap changed)... 2024-09-21T08:06:41.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:41 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-21T08:06:41.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:41 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:41.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:41 smithi107 ceph-mon[97757]: Reconfiguring daemon osd.5 on smithi129 2024-09-21T08:06:41.662 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:41 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:41.662 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:41 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:41.662 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:41 smithi129 ceph-mon[76722]: Reconfiguring osd.5 (monmap changed)... 2024-09-21T08:06:41.662 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:41 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-21T08:06:41.662 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:41 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:41.663 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:41 smithi129 ceph-mon[76722]: Reconfiguring daemon osd.5 on smithi129 2024-09-21T08:06:43.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:42 smithi129 ceph-mon[76722]: pgmap v24: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:43.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:42 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:43.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:42 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:43.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:42 smithi129 ceph-mon[76722]: Reconfiguring mds.cephfs.smithi129.fwmfcy (monmap changed)... 2024-09-21T08:06:43.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:42 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi129.fwmfcy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:06:43.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:42 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:43.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:42 smithi129 ceph-mon[76722]: Reconfiguring daemon mds.cephfs.smithi129.fwmfcy on smithi129 2024-09-21T08:06:43.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:42 smithi107 ceph-mon[97757]: pgmap v24: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:43.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:42 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:43.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:42 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:43.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:42 smithi107 ceph-mon[97757]: Reconfiguring mds.cephfs.smithi129.fwmfcy (monmap changed)... 2024-09-21T08:06:43.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:42 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi129.fwmfcy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:06:43.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:42 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:43.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:42 smithi107 ceph-mon[97757]: Reconfiguring daemon mds.cephfs.smithi129.fwmfcy on smithi129 2024-09-21T08:06:44.324 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:44 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:44.324 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:44 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:44.324 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:44 smithi107 ceph-mon[97757]: Reconfiguring mds.cephfs.smithi129.belyba (monmap changed)... 2024-09-21T08:06:44.324 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:44 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi129.belyba", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:06:44.324 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:44 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:44.324 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:44 smithi107 ceph-mon[97757]: Reconfiguring daemon mds.cephfs.smithi129.belyba on smithi129 2024-09-21T08:06:44.325 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:44 smithi107 ceph-mon[97757]: pgmap v25: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:44.502 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:44 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:44.503 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:44 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:44.503 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:44 smithi129 ceph-mon[76722]: Reconfiguring mds.cephfs.smithi129.belyba (monmap changed)... 2024-09-21T08:06:44.503 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:44 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi129.belyba", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:06:44.503 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:44 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:44.503 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:44 smithi129 ceph-mon[76722]: Reconfiguring daemon mds.cephfs.smithi129.belyba on smithi129 2024-09-21T08:06:44.503 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:44 smithi129 ceph-mon[76722]: pgmap v25: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:45.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:45 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:45.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:45 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:45.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:45 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:06:45.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:45 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:06:45.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:45 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:06:45.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:45 smithi107 ceph-mon[97757]: Upgrade: Setting container_image for all mon 2024-09-21T08:06:45.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:45 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:45.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:45 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi107"}]: dispatch 2024-09-21T08:06:45.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:45 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi107"}]': finished 2024-09-21T08:06:45.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:45 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi129"}]: dispatch 2024-09-21T08:06:45.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:45 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi129"}]': finished 2024-09-21T08:06:45.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:45 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:06:46.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:45 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:46.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:45 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:46.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:45 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:06:46.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:45 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:06:46.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:45 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:06:46.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:45 smithi129 ceph-mon[76722]: Upgrade: Setting container_image for all mon 2024-09-21T08:06:46.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:45 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:46.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:45 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi107"}]: dispatch 2024-09-21T08:06:46.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:45 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi107"}]': finished 2024-09-21T08:06:46.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:45 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi129"}]: dispatch 2024-09-21T08:06:46.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:45 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi129"}]': finished 2024-09-21T08:06:46.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:45 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:06:46.664 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:46 smithi107 ceph-mon[97757]: pgmap v26: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:46.664 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:46 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:46.664 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:46 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi107", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T08:06:46.664 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:46 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:47.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:46 smithi129 ceph-mon[76722]: pgmap v26: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:47.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:46 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:47.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:46 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi107", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T08:06:47.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:46 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:47.639 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:47 smithi107 ceph-mon[97757]: Upgrade: Updating crash.smithi107 (1/2) 2024-09-21T08:06:47.640 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:47 smithi107 ceph-mon[97757]: Deploying daemon crash.smithi107 on smithi107 2024-09-21T08:06:48.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:47 smithi129 ceph-mon[76722]: Upgrade: Updating crash.smithi107 (1/2) 2024-09-21T08:06:48.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:47 smithi129 ceph-mon[76722]: Deploying daemon crash.smithi107 on smithi107 2024-09-21T08:06:48.911 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:48 smithi107 ceph-mon[97757]: pgmap v27: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:49.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:48 smithi129 ceph-mon[76722]: pgmap v27: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:50.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:50 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:50.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:50 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:50.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:50 smithi107 ceph-mon[97757]: pgmap v28: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:50.826 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:50 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:50.826 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:50 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:50.826 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:50 smithi129 ceph-mon[76722]: pgmap v28: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:52.254 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:51 smithi129 ceph-mon[76722]: Upgrade: Updating crash.smithi129 (2/2) 2024-09-21T08:06:52.254 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:51 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:52.254 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:51 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi129", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T08:06:52.254 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:51 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:52.255 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:51 smithi129 ceph-mon[76722]: Deploying daemon crash.smithi129 on smithi129 2024-09-21T08:06:52.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:51 smithi107 ceph-mon[97757]: Upgrade: Updating crash.smithi129 (2/2) 2024-09-21T08:06:52.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:51 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:52.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:51 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi129", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T08:06:52.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:51 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:06:52.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:51 smithi107 ceph-mon[97757]: Deploying daemon crash.smithi129 on smithi129 2024-09-21T08:06:52.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.462+0000 7fa18839f640 1 -- 172.21.15.107:0/621941859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa180102550 msgr2=0x7fa180102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:52.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.462+0000 7fa18839f640 1 --2- 172.21.15.107:0/621941859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa180102550 0x7fa180102920 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0048d0 tx=0x7fa17c009da0 comp rx=0 tx=0).stop 2024-09-21T08:06:52.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.463+0000 7fa18839f640 1 -- 172.21.15.107:0/621941859 shutdown_connections 2024-09-21T08:06:52.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.463+0000 7fa18839f640 1 --2- 172.21.15.107:0/621941859 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa180102ef0 0x7fa1800fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:52.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.463+0000 7fa18839f640 1 --2- 172.21.15.107:0/621941859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa180102550 0x7fa180102920 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:52.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.463+0000 7fa18839f640 1 -- 172.21.15.107:0/621941859 >> 172.21.15.107:0/621941859 conn(0x7fa1800f80f0 msgr2=0x7fa1800fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:52.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.463+0000 7fa18839f640 1 -- 172.21.15.107:0/621941859 shutdown_connections 2024-09-21T08:06:52.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.463+0000 7fa18839f640 1 -- 172.21.15.107:0/621941859 wait complete. 2024-09-21T08:06:52.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.463+0000 7fa18839f640 1 Processor -- start 2024-09-21T08:06:52.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.463+0000 7fa18839f640 1 -- start start 2024-09-21T08:06:52.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.464+0000 7fa18839f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa180102550 0x7fa180113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:52.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.464+0000 7fa18839f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa180102ef0 0x7fa180113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:52.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.464+0000 7fa18839f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa180114100 con 0x7fa180102ef0 2024-09-21T08:06:52.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.464+0000 7fa18839f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18010d510 con 0x7fa180102550 2024-09-21T08:06:52.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.464+0000 7fa18593a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa180102ef0 0x7fa180113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:52.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.464+0000 7fa18593a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa180102ef0 0x7fa180113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36796/0 (socket says 172.21.15.107:36796) 2024-09-21T08:06:52.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.464+0000 7fa18593a640 1 -- 172.21.15.107:0/2696195226 learned_addr learned my addr 172.21.15.107:0/2696195226 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:06:52.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.464+0000 7fa18613b640 1 --2- 172.21.15.107:0/2696195226 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa180102550 0x7fa180113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:52.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.464+0000 7fa18593a640 1 -- 172.21.15.107:0/2696195226 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa180102550 msgr2=0x7fa180113570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:52.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.464+0000 7fa18593a640 1 --2- 172.21.15.107:0/2696195226 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa180102550 0x7fa180113570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:52.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.464+0000 7fa18593a640 1 -- 172.21.15.107:0/2696195226 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17c005040 con 0x7fa180102ef0 2024-09-21T08:06:52.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.464+0000 7fa18613b640 1 --2- 172.21.15.107:0/2696195226 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa180102550 0x7fa180113570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:06:52.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.464+0000 7fa18593a640 1 --2- 172.21.15.107:0/2696195226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa180102ef0 0x7fa180113ab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa170002870 tx=0x7fa170004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:52.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.464+0000 7fa176ffd640 1 -- 172.21.15.107:0/2696195226 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa170007c30 con 0x7fa180102ef0 2024-09-21T08:06:52.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.464+0000 7fa176ffd640 1 -- 172.21.15.107:0/2696195226 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa17000f040 con 0x7fa180102ef0 2024-09-21T08:06:52.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.464+0000 7fa18839f640 1 -- 172.21.15.107:0/2696195226 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18010d7f0 con 0x7fa180102ef0 2024-09-21T08:06:52.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.464+0000 7fa176ffd640 1 -- 172.21.15.107:0/2696195226 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1700094a0 con 0x7fa180102ef0 2024-09-21T08:06:52.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.465+0000 7fa18839f640 1 -- 172.21.15.107:0/2696195226 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18010dd10 con 0x7fa180102ef0 2024-09-21T08:06:52.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.466+0000 7fa18839f640 1 -- 172.21.15.107:0/2696195226 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1800fdcd0 con 0x7fa180102ef0 2024-09-21T08:06:52.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.466+0000 7fa176ffd640 1 -- 172.21.15.107:0/2696195226 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fa170009710 con 0x7fa180102ef0 2024-09-21T08:06:52.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.467+0000 7fa176ffd640 1 --2- 172.21.15.107:0/2696195226 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fa16c06e660 0x7fa16c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:52.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.467+0000 7fa176ffd640 1 -- 172.21.15.107:0/2696195226 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa17008dad0 con 0x7fa180102ef0 2024-09-21T08:06:52.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.467+0000 7fa18613b640 1 --2- 172.21.15.107:0/2696195226 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fa16c06e660 0x7fa16c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:52.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.467+0000 7fa18613b640 1 --2- 172.21.15.107:0/2696195226 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fa16c06e660 0x7fa16c070b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa17c009ac0 tx=0x7fa17c035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:52.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.471+0000 7fa176ffd640 1 -- 172.21.15.107:0/2696195226 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa170056b70 con 0x7fa180102ef0 2024-09-21T08:06:52.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.653+0000 7fa18839f640 1 -- 172.21.15.107:0/2696195226 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa180113260 con 0x7fa16c06e660 2024-09-21T08:06:52.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.654+0000 7fa176ffd640 1 -- 172.21.15.107:0/2696195226 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fa180113260 con 0x7fa16c06e660 2024-09-21T08:06:52.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.656+0000 7fa18839f640 1 -- 172.21.15.107:0/2696195226 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fa16c06e660 msgr2=0x7fa16c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:52.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.656+0000 7fa18839f640 1 --2- 172.21.15.107:0/2696195226 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fa16c06e660 0x7fa16c070b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa17c009ac0 tx=0x7fa17c035040 comp rx=0 tx=0).stop 2024-09-21T08:06:52.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.656+0000 7fa18839f640 1 -- 172.21.15.107:0/2696195226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa180102ef0 msgr2=0x7fa180113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:52.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.656+0000 7fa18839f640 1 --2- 172.21.15.107:0/2696195226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa180102ef0 0x7fa180113ab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa170002870 tx=0x7fa170004600 comp rx=0 tx=0).stop 2024-09-21T08:06:52.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.657+0000 7fa18839f640 1 -- 172.21.15.107:0/2696195226 shutdown_connections 2024-09-21T08:06:52.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.657+0000 7fa18839f640 1 --2- 172.21.15.107:0/2696195226 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fa16c06e660 0x7fa16c070b10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:52.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.657+0000 7fa18839f640 1 --2- 172.21.15.107:0/2696195226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa180102ef0 0x7fa180113ab0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:52.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.657+0000 7fa18839f640 1 --2- 172.21.15.107:0/2696195226 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa180102550 0x7fa180113570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:52.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.657+0000 7fa18839f640 1 -- 172.21.15.107:0/2696195226 >> 172.21.15.107:0/2696195226 conn(0x7fa1800f80f0 msgr2=0x7fa1800f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:52.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.657+0000 7fa18839f640 1 -- 172.21.15.107:0/2696195226 shutdown_connections 2024-09-21T08:06:52.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.657+0000 7fa18839f640 1 -- 172.21.15.107:0/2696195226 wait complete. 2024-09-21T08:06:52.668 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:06:52.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.737+0000 7f301f9b4640 1 -- 172.21.15.107:0/2934446672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30180fcf80 msgr2=0x7f30180fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:52.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.737+0000 7f301f9b4640 1 --2- 172.21.15.107:0/2934446672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30180fcf80 0x7f30180fd3d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f300c0048d0 tx=0x7f300c009da0 comp rx=0 tx=0).stop 2024-09-21T08:06:52.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.737+0000 7f301f9b4640 1 -- 172.21.15.107:0/2934446672 shutdown_connections 2024-09-21T08:06:52.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.737+0000 7f301f9b4640 1 --2- 172.21.15.107:0/2934446672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30180fcf80 0x7f30180fd3d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:52.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.737+0000 7f301f9b4640 1 --2- 172.21.15.107:0/2934446672 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f30180fb810 0x7f30180fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:52.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.737+0000 7f301f9b4640 1 -- 172.21.15.107:0/2934446672 >> 172.21.15.107:0/2934446672 conn(0x7f30180723b0 msgr2=0x7f30180727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:52.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.737+0000 7f301f9b4640 1 -- 172.21.15.107:0/2934446672 shutdown_connections 2024-09-21T08:06:52.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.737+0000 7f301f9b4640 1 -- 172.21.15.107:0/2934446672 wait complete. 2024-09-21T08:06:52.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.737+0000 7f301f9b4640 1 Processor -- start 2024-09-21T08:06:52.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.737+0000 7f301f9b4640 1 -- start start 2024-09-21T08:06:52.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.737+0000 7f301f9b4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f30180fb810 0x7f3018115360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:52.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.737+0000 7f301f9b4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30180fcf80 0x7f30181158a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:52.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.737+0000 7f301f9b4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3018115ea0 con 0x7f30180fcf80 2024-09-21T08:06:52.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.737+0000 7f301f9b4640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301810f2e0 con 0x7f30180fb810 2024-09-21T08:06:52.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.738+0000 7f301cf4f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30180fcf80 0x7f30181158a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:52.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.738+0000 7f301cf4f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30180fcf80 0x7f30181158a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36814/0 (socket says 172.21.15.107:36814) 2024-09-21T08:06:52.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.738+0000 7f301cf4f640 1 -- 172.21.15.107:0/3852343060 learned_addr learned my addr 172.21.15.107:0/3852343060 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:06:52.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.738+0000 7f301d750640 1 --2- 172.21.15.107:0/3852343060 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f30180fb810 0x7f3018115360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:52.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.738+0000 7f301cf4f640 1 -- 172.21.15.107:0/3852343060 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f30180fb810 msgr2=0x7f3018115360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:52.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.738+0000 7f301cf4f640 1 --2- 172.21.15.107:0/3852343060 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f30180fb810 0x7f3018115360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:52.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.738+0000 7f301cf4f640 1 -- 172.21.15.107:0/3852343060 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300c005040 con 0x7f30180fcf80 2024-09-21T08:06:52.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.738+0000 7f301cf4f640 1 --2- 172.21.15.107:0/3852343060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30180fcf80 0x7f30181158a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f300c000c00 tx=0x7f300c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:52.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.738+0000 7f3015ffb640 1 -- 172.21.15.107:0/3852343060 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f300c038070 con 0x7f30180fcf80 2024-09-21T08:06:52.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.738+0000 7f3015ffb640 1 -- 172.21.15.107:0/3852343060 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f300c02ade0 con 0x7f30180fcf80 2024-09-21T08:06:52.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.738+0000 7f301f9b4640 1 -- 172.21.15.107:0/3852343060 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f301810f560 con 0x7f30180fcf80 2024-09-21T08:06:52.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.738+0000 7f3015ffb640 1 -- 172.21.15.107:0/3852343060 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f300c02c7e0 con 0x7f30180fcf80 2024-09-21T08:06:52.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.739+0000 7f301f9b4640 1 -- 172.21.15.107:0/3852343060 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f301810faa0 con 0x7f30180fcf80 2024-09-21T08:06:52.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.740+0000 7f301f9b4640 1 -- 172.21.15.107:0/3852343060 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30180fcbc0 con 0x7f30180fcf80 2024-09-21T08:06:52.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.740+0000 7f3015ffb640 1 -- 172.21.15.107:0/3852343060 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f300c030020 con 0x7f30180fcf80 2024-09-21T08:06:52.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.740+0000 7f3015ffb640 1 --2- 172.21.15.107:0/3852343060 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f300006e660 0x7f3000070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:52.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.741+0000 7f3015ffb640 1 -- 172.21.15.107:0/3852343060 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f300c0ade20 con 0x7f30180fcf80 2024-09-21T08:06:52.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.741+0000 7f301d750640 1 --2- 172.21.15.107:0/3852343060 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f300006e660 0x7f3000070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:52.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.741+0000 7f301d750640 1 --2- 172.21.15.107:0/3852343060 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f300006e660 0x7f3000070b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3008007fd0 tx=0x7f3008009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:52.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.745+0000 7f3015ffb640 1 -- 172.21.15.107:0/3852343060 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f300c076fd0 con 0x7f30180fcf80 2024-09-21T08:06:52.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.927+0000 7f301f9b4640 1 -- 172.21.15.107:0/3852343060 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3018110a00 con 0x7f300006e660 2024-09-21T08:06:52.930 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:52 smithi107 ceph-mon[97757]: pgmap v29: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:52.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.928+0000 7f3015ffb640 1 -- 172.21.15.107:0/3852343060 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f3018110a00 con 0x7f300006e660 2024-09-21T08:06:52.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.930+0000 7f301f9b4640 1 -- 172.21.15.107:0/3852343060 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f300006e660 msgr2=0x7f3000070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:52.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.930+0000 7f301f9b4640 1 --2- 172.21.15.107:0/3852343060 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f300006e660 0x7f3000070b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3008007fd0 tx=0x7f3008009040 comp rx=0 tx=0).stop 2024-09-21T08:06:52.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.930+0000 7f301f9b4640 1 -- 172.21.15.107:0/3852343060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30180fcf80 msgr2=0x7f30181158a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:52.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.930+0000 7f301f9b4640 1 --2- 172.21.15.107:0/3852343060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30180fcf80 0x7f30181158a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f300c000c00 tx=0x7f300c009da0 comp rx=0 tx=0).stop 2024-09-21T08:06:52.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.931+0000 7f301f9b4640 1 -- 172.21.15.107:0/3852343060 shutdown_connections 2024-09-21T08:06:52.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.931+0000 7f301f9b4640 1 --2- 172.21.15.107:0/3852343060 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f300006e660 0x7f3000070b10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:52.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.931+0000 7f301f9b4640 1 --2- 172.21.15.107:0/3852343060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30180fcf80 0x7f30181158a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:52.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.931+0000 7f301f9b4640 1 --2- 172.21.15.107:0/3852343060 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f30180fb810 0x7f3018115360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:52.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.931+0000 7f301f9b4640 1 -- 172.21.15.107:0/3852343060 >> 172.21.15.107:0/3852343060 conn(0x7f30180723b0 msgr2=0x7f3018105580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:52.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.931+0000 7f301f9b4640 1 -- 172.21.15.107:0/3852343060 shutdown_connections 2024-09-21T08:06:52.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:52.931+0000 7f301f9b4640 1 -- 172.21.15.107:0/3852343060 wait complete. 2024-09-21T08:06:53.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.009+0000 7f18439fe640 1 -- 172.21.15.107:0/1434298753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f183c102530 msgr2=0x7f183c102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:53.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.009+0000 7f18439fe640 1 --2- 172.21.15.107:0/1434298753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f183c102530 0x7f183c102900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f18380048d0 tx=0x7f1838009da0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.009+0000 7f18439fe640 1 -- 172.21.15.107:0/1434298753 shutdown_connections 2024-09-21T08:06:53.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.009+0000 7f18439fe640 1 --2- 172.21.15.107:0/1434298753 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f183c102ed0 0x7f183c0fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.009+0000 7f18439fe640 1 --2- 172.21.15.107:0/1434298753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f183c102530 0x7f183c102900 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.009+0000 7f18439fe640 1 -- 172.21.15.107:0/1434298753 >> 172.21.15.107:0/1434298753 conn(0x7f183c0f8110 msgr2=0x7f183c0fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:53.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.009+0000 7f18439fe640 1 -- 172.21.15.107:0/1434298753 shutdown_connections 2024-09-21T08:06:53.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.009+0000 7f18439fe640 1 -- 172.21.15.107:0/1434298753 wait complete. 2024-09-21T08:06:53.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.009+0000 7f18439fe640 1 Processor -- start 2024-09-21T08:06:53.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.009+0000 7f18439fe640 1 -- start start 2024-09-21T08:06:53.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.009+0000 7f18439fe640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f183c102530 0x7f183c113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:53.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.009+0000 7f18439fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f183c102ed0 0x7f183c113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:53.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.009+0000 7f18439fe640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c113d50 con 0x7f183c102ed0 2024-09-21T08:06:53.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.010+0000 7f18439fe640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c10d190 con 0x7f183c102530 2024-09-21T08:06:53.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.010+0000 7f1840f99640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f183c102ed0 0x7f183c113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:53.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.010+0000 7f1840f99640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f183c102ed0 0x7f183c113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36836/0 (socket says 172.21.15.107:36836) 2024-09-21T08:06:53.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.010+0000 7f1840f99640 1 -- 172.21.15.107:0/3926558228 learned_addr learned my addr 172.21.15.107:0/3926558228 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:06:53.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.010+0000 7f184179a640 1 --2- 172.21.15.107:0/3926558228 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f183c102530 0x7f183c113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:53.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.010+0000 7f1840f99640 1 -- 172.21.15.107:0/3926558228 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f183c102530 msgr2=0x7f183c113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:53.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.010+0000 7f1840f99640 1 --2- 172.21.15.107:0/3926558228 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f183c102530 0x7f183c113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.010+0000 7f1840f99640 1 -- 172.21.15.107:0/3926558228 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1838005040 con 0x7f183c102ed0 2024-09-21T08:06:53.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.010+0000 7f1840f99640 1 --2- 172.21.15.107:0/3926558228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f183c102ed0 0x7f183c113750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f182c002870 tx=0x7f182c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:53.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.010+0000 7f1831ffb640 1 -- 172.21.15.107:0/3926558228 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f182c007c30 con 0x7f183c102ed0 2024-09-21T08:06:53.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.010+0000 7f1831ffb640 1 -- 172.21.15.107:0/3926558228 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f182c00f040 con 0x7f183c102ed0 2024-09-21T08:06:53.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.010+0000 7f18439fe640 1 -- 172.21.15.107:0/3926558228 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183c10d470 con 0x7f183c102ed0 2024-09-21T08:06:53.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.010+0000 7f1831ffb640 1 -- 172.21.15.107:0/3926558228 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f182c00daf0 con 0x7f183c102ed0 2024-09-21T08:06:53.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.011+0000 7f18439fe640 1 -- 172.21.15.107:0/3926558228 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f183c10d990 con 0x7f183c102ed0 2024-09-21T08:06:53.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.011+0000 7f18439fe640 1 -- 172.21.15.107:0/3926558228 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183c0fdcb0 con 0x7f183c102ed0 2024-09-21T08:06:53.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.012+0000 7f1831ffb640 1 -- 172.21.15.107:0/3926558228 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f182c00dc50 con 0x7f183c102ed0 2024-09-21T08:06:53.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.012+0000 7f1831ffb640 1 --2- 172.21.15.107:0/3926558228 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f182806e660 0x7f1828070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:53.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.012+0000 7f1831ffb640 1 -- 172.21.15.107:0/3926558228 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f182c08e0e0 con 0x7f183c102ed0 2024-09-21T08:06:53.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.012+0000 7f184179a640 1 --2- 172.21.15.107:0/3926558228 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f182806e660 0x7f1828070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:53.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.013+0000 7f184179a640 1 --2- 172.21.15.107:0/3926558228 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f182806e660 0x7f1828070b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1838009ac0 tx=0x7f1838035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:53.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.017+0000 7f1831ffb640 1 -- 172.21.15.107:0/3926558228 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f182c0570d0 con 0x7f183c102ed0 2024-09-21T08:06:53.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.191+0000 7f18439fe640 1 -- 172.21.15.107:0/3926558228 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f183c109580 con 0x7f182806e660 2024-09-21T08:06:53.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.202+0000 7f1831ffb640 1 -- 172.21.15.107:0/3926558228 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f183c109580 con 0x7f182806e660 2024-09-21T08:06:53.203 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:06:53.204 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (3m) 48s ago 11m 27.8M - 0.25.0 c8568f914cd2 2b499aa3b7de 2024-09-21T08:06:53.204 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 starting - - - - 2024-09-21T08:06:53.204 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (11m) 35s ago 11m 6895k - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be e74e9385abdf 2024-09-21T08:06:53.204 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (2m) 48s ago 11m 76.8M - 9.4.12 2bacad6d85d8 63177dcfe25c 2024-09-21T08:06:53.204 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (6m) 48s ago 6m 155M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 3bc779f88228 2024-09-21T08:06:53.204 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (6m) 48s ago 6m 13.4M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be ea8f140aade7 2024-09-21T08:06:53.205 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (6m) 35s ago 6m 16.5M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 329346c3afec 2024-09-21T08:06:53.205 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (6m) 35s ago 6m 17.9M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be baf87f32bfbc 2024-09-21T08:06:53.205 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:8443,9283,8765 running (3m) 48s ago 13m 472M - 19.1.1-367-g9e2ac70b cc9251b744a3 49c237734f07 2024-09-21T08:06:53.205 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283,8765 running (2m) 35s ago 11m 438M - 19.1.1-367-g9e2ac70b cc9251b744a3 ed117096bdd8 2024-09-21T08:06:53.205 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (60s) 48s ago 13m 27.5M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 445b3e6a800f 2024-09-21T08:06:53.205 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (38s) 35s ago 11m 20.0M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 12706f823621 2024-09-21T08:06:53.205 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 running (3m) 48s ago 12m 18.1M - 1.5.0 0da6a335fe13 6de7c307ba0f 2024-09-21T08:06:53.206 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (3m) 35s ago 11m 16.3M - 1.5.0 0da6a335fe13 cb6d4577b24c 2024-09-21T08:06:53.206 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (10m) 48s ago 10m 245M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 6799bdf55207 2024-09-21T08:06:53.206 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (9m) 48s ago 9m 260M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 29d8ce3f3a52 2024-09-21T08:06:53.206 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (9m) 48s ago 9m 210M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be c9e1c4756c02 2024-09-21T08:06:53.206 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (9m) 35s ago 9m 279M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7d58f70b105c 2024-09-21T08:06:53.206 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (8m) 35s ago 8m 252M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 2f916ef76d22 2024-09-21T08:06:53.207 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (8m) 35s ago 8m 235M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 0f25d9454304 2024-09-21T08:06:53.207 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (2m) 48s ago 11m 59.9M - 2.43.0 a07b618ecd1d 9ed2abf5e8d8 2024-09-21T08:06:53.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.204+0000 7f18439fe640 1 -- 172.21.15.107:0/3926558228 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f182806e660 msgr2=0x7f1828070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:53.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.204+0000 7f18439fe640 1 --2- 172.21.15.107:0/3926558228 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f182806e660 0x7f1828070b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1838009ac0 tx=0x7f1838035040 comp rx=0 tx=0).stop 2024-09-21T08:06:53.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.204+0000 7f18439fe640 1 -- 172.21.15.107:0/3926558228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f183c102ed0 msgr2=0x7f183c113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:53.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.204+0000 7f18439fe640 1 --2- 172.21.15.107:0/3926558228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f183c102ed0 0x7f183c113750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f182c002870 tx=0x7f182c004600 comp rx=0 tx=0).stop 2024-09-21T08:06:53.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.204+0000 7f18439fe640 1 -- 172.21.15.107:0/3926558228 shutdown_connections 2024-09-21T08:06:53.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.204+0000 7f18439fe640 1 --2- 172.21.15.107:0/3926558228 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f182806e660 0x7f1828070b10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.204+0000 7f18439fe640 1 --2- 172.21.15.107:0/3926558228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f183c102ed0 0x7f183c113750 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.204+0000 7f18439fe640 1 --2- 172.21.15.107:0/3926558228 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f183c102530 0x7f183c113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.204+0000 7f18439fe640 1 -- 172.21.15.107:0/3926558228 >> 172.21.15.107:0/3926558228 conn(0x7f183c0f8110 msgr2=0x7f183c0f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:53.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.204+0000 7f18439fe640 1 -- 172.21.15.107:0/3926558228 shutdown_connections 2024-09-21T08:06:53.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.204+0000 7f18439fe640 1 -- 172.21.15.107:0/3926558228 wait complete. 2024-09-21T08:06:53.215 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:52 smithi129 ceph-mon[76722]: pgmap v29: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.281+0000 7f93ce478640 1 -- 172.21.15.107:0/2669838750 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93c8102ef0 msgr2=0x7f93c80fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.281+0000 7f93ce478640 1 --2- 172.21.15.107:0/2669838750 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93c8102ef0 0x7f93c80fc5b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0048d0 tx=0x7f93bc009da0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.281+0000 7f93ce478640 1 -- 172.21.15.107:0/2669838750 shutdown_connections 2024-09-21T08:06:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.281+0000 7f93ce478640 1 --2- 172.21.15.107:0/2669838750 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93c8102ef0 0x7f93c80fc5b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.281+0000 7f93ce478640 1 --2- 172.21.15.107:0/2669838750 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93c8102550 0x7f93c8102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.281+0000 7f93ce478640 1 -- 172.21.15.107:0/2669838750 >> 172.21.15.107:0/2669838750 conn(0x7f93c80f80f0 msgr2=0x7f93c80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.281+0000 7f93ce478640 1 -- 172.21.15.107:0/2669838750 shutdown_connections 2024-09-21T08:06:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.281+0000 7f93ce478640 1 -- 172.21.15.107:0/2669838750 wait complete. 2024-09-21T08:06:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.281+0000 7f93ce478640 1 Processor -- start 2024-09-21T08:06:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.281+0000 7f93ce478640 1 -- start start 2024-09-21T08:06:53.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.282+0000 7f93ce478640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93c8102550 0x7f93c8113500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:53.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.282+0000 7f93ce478640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93c8102ef0 0x7f93c8113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:53.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.282+0000 7f93ce478640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c8114090 con 0x7f93c8102550 2024-09-21T08:06:53.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.282+0000 7f93ce478640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c810d4a0 con 0x7f93c8102ef0 2024-09-21T08:06:53.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.282+0000 7f93c7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93c8102550 0x7f93c8113500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:53.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.282+0000 7f93c7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93c8102550 0x7f93c8113500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36858/0 (socket says 172.21.15.107:36858) 2024-09-21T08:06:53.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.282+0000 7f93c7fff640 1 -- 172.21.15.107:0/3989363602 learned_addr learned my addr 172.21.15.107:0/3989363602 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:06:53.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.282+0000 7f93c77fe640 1 --2- 172.21.15.107:0/3989363602 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93c8102ef0 0x7f93c8113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:53.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.282+0000 7f93c7fff640 1 -- 172.21.15.107:0/3989363602 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93c8102ef0 msgr2=0x7f93c8113a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:53.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.282+0000 7f93c7fff640 1 --2- 172.21.15.107:0/3989363602 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93c8102ef0 0x7f93c8113a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.282+0000 7f93c7fff640 1 -- 172.21.15.107:0/3989363602 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc005040 con 0x7f93c8102550 2024-09-21T08:06:53.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.282+0000 7f93c7fff640 1 --2- 172.21.15.107:0/3989363602 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93c8102550 0x7f93c8113500 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f93b8002a50 tx=0x7f93b8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:53.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.282+0000 7f93c4ff9640 1 -- 172.21.15.107:0/3989363602 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93b8007c30 con 0x7f93c8102550 2024-09-21T08:06:53.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.282+0000 7f93c4ff9640 1 -- 172.21.15.107:0/3989363602 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f93b800f040 con 0x7f93c8102550 2024-09-21T08:06:53.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.282+0000 7f93ce478640 1 -- 172.21.15.107:0/3989363602 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c810d780 con 0x7f93c8102550 2024-09-21T08:06:53.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.282+0000 7f93c4ff9640 1 -- 172.21.15.107:0/3989363602 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93b800dad0 con 0x7f93c8102550 2024-09-21T08:06:53.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.282+0000 7f93ce478640 1 -- 172.21.15.107:0/3989363602 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c810dcf0 con 0x7f93c8102550 2024-09-21T08:06:53.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.283+0000 7f93ce478640 1 -- 172.21.15.107:0/3989363602 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c80fdcd0 con 0x7f93c8102550 2024-09-21T08:06:53.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.284+0000 7f93c4ff9640 1 -- 172.21.15.107:0/3989363602 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f93b800dc30 con 0x7f93c8102550 2024-09-21T08:06:53.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.284+0000 7f93c4ff9640 1 --2- 172.21.15.107:0/3989363602 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f93b006e660 0x7f93b0070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:53.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.285+0000 7f93c77fe640 1 --2- 172.21.15.107:0/3989363602 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f93b006e660 0x7f93b0070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:53.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.285+0000 7f93c4ff9640 1 -- 172.21.15.107:0/3989363602 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f93b808e1f0 con 0x7f93c8102550 2024-09-21T08:06:53.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.285+0000 7f93c77fe640 1 --2- 172.21.15.107:0/3989363602 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f93b006e660 0x7f93b0070b10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0048a0 tx=0x7f93bc035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:53.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.289+0000 7f93c4ff9640 1 -- 172.21.15.107:0/3989363602 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f93b8057160 con 0x7f93c8102550 2024-09-21T08:06:53.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.519+0000 7f93ce478640 1 -- 172.21.15.107:0/3989363602 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f93c804b750 con 0x7f93c8102550 2024-09-21T08:06:53.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.519+0000 7f93c4ff9640 1 -- 172.21.15.107:0/3989363602 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7f93b805a820 con 0x7f93c8102550 2024-09-21T08:06:53.521 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:06:53.521 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": { 2024-09-21T08:06:53.521 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:06:53.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:06:53.521 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": { 2024-09-21T08:06:53.521 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:06:53.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:06:53.521 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": { 2024-09-21T08:06:53.521 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 6 2024-09-21T08:06:53.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:06:53.521 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-21T08:06:53.522 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 4 2024-09-21T08:06:53.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:06:53.522 INFO:teuthology.orchestra.run.smithi107.stdout: "overall": { 2024-09-21T08:06:53.522 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 10, 2024-09-21T08:06:53.522 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 4 2024-09-21T08:06:53.522 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-21T08:06:53.522 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:06:53.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.521+0000 7f93ce478640 1 -- 172.21.15.107:0/3989363602 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f93b006e660 msgr2=0x7f93b0070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:53.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.521+0000 7f93ce478640 1 --2- 172.21.15.107:0/3989363602 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f93b006e660 0x7f93b0070b10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0048a0 tx=0x7f93bc035040 comp rx=0 tx=0).stop 2024-09-21T08:06:53.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.521+0000 7f93ce478640 1 -- 172.21.15.107:0/3989363602 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93c8102550 msgr2=0x7f93c8113500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:53.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.521+0000 7f93ce478640 1 --2- 172.21.15.107:0/3989363602 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93c8102550 0x7f93c8113500 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f93b8002a50 tx=0x7f93b8004600 comp rx=0 tx=0).stop 2024-09-21T08:06:53.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.521+0000 7f93ce478640 1 -- 172.21.15.107:0/3989363602 shutdown_connections 2024-09-21T08:06:53.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.521+0000 7f93ce478640 1 --2- 172.21.15.107:0/3989363602 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f93b006e660 0x7f93b0070b10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.521+0000 7f93ce478640 1 --2- 172.21.15.107:0/3989363602 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93c8102ef0 0x7f93c8113a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.521+0000 7f93ce478640 1 --2- 172.21.15.107:0/3989363602 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f93c8102550 0x7f93c8113500 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.521+0000 7f93ce478640 1 -- 172.21.15.107:0/3989363602 >> 172.21.15.107:0/3989363602 conn(0x7f93c80f80f0 msgr2=0x7f93c80f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:53.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.521+0000 7f93ce478640 1 -- 172.21.15.107:0/3989363602 shutdown_connections 2024-09-21T08:06:53.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.521+0000 7f93ce478640 1 -- 172.21.15.107:0/3989363602 wait complete. 2024-09-21T08:06:53.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.598+0000 7f484b365640 1 -- 172.21.15.107:0/1187651328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4844102ed0 msgr2=0x7f48440fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:53.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.598+0000 7f484b365640 1 --2- 172.21.15.107:0/1187651328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4844102ed0 0x7f48440fc590 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48340048d0 tx=0x7f4834009da0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.598+0000 7f484b365640 1 -- 172.21.15.107:0/1187651328 shutdown_connections 2024-09-21T08:06:53.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.598+0000 7f484b365640 1 --2- 172.21.15.107:0/1187651328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4844102ed0 0x7f48440fc590 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.598+0000 7f484b365640 1 --2- 172.21.15.107:0/1187651328 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4844102530 0x7f4844102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.598+0000 7f484b365640 1 -- 172.21.15.107:0/1187651328 >> 172.21.15.107:0/1187651328 conn(0x7f48440f80f0 msgr2=0x7f48440fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:53.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.599+0000 7f484b365640 1 -- 172.21.15.107:0/1187651328 shutdown_connections 2024-09-21T08:06:53.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.599+0000 7f484b365640 1 -- 172.21.15.107:0/1187651328 wait complete. 2024-09-21T08:06:53.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.599+0000 7f484b365640 1 Processor -- start 2024-09-21T08:06:53.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.599+0000 7f484b365640 1 -- start start 2024-09-21T08:06:53.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.599+0000 7f484b365640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4844102530 0x7f48441131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:53.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.599+0000 7f484b365640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4844102ed0 0x7f4844113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:53.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.599+0000 7f484b365640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4844113d30 con 0x7f4844102530 2024-09-21T08:06:53.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.599+0000 7f484b365640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484410d170 con 0x7f4844102ed0 2024-09-21T08:06:53.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.599+0000 7f4849101640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4844102530 0x7f48441131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:53.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.599+0000 7f4849101640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4844102530 0x7f48441131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36872/0 (socket says 172.21.15.107:36872) 2024-09-21T08:06:53.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.599+0000 7f4849101640 1 -- 172.21.15.107:0/3325058866 learned_addr learned my addr 172.21.15.107:0/3325058866 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:06:53.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.599+0000 7f4848900640 1 --2- 172.21.15.107:0/3325058866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4844102ed0 0x7f4844113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:53.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.600+0000 7f4849101640 1 -- 172.21.15.107:0/3325058866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4844102ed0 msgr2=0x7f4844113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:53.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.600+0000 7f4849101640 1 --2- 172.21.15.107:0/3325058866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4844102ed0 0x7f4844113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.600+0000 7f4849101640 1 -- 172.21.15.107:0/3325058866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4834005040 con 0x7f4844102530 2024-09-21T08:06:53.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.600+0000 7f4849101640 1 --2- 172.21.15.107:0/3325058866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4844102530 0x7f48441131f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4840002a50 tx=0x7f4840004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:53.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.600+0000 7f4839ffb640 1 -- 172.21.15.107:0/3325058866 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4840007c30 con 0x7f4844102530 2024-09-21T08:06:53.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.600+0000 7f4839ffb640 1 -- 172.21.15.107:0/3325058866 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f484000f040 con 0x7f4844102530 2024-09-21T08:06:53.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.600+0000 7f4839ffb640 1 -- 172.21.15.107:0/3325058866 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f484000da10 con 0x7f4844102530 2024-09-21T08:06:53.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.600+0000 7f484b365640 1 -- 172.21.15.107:0/3325058866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484410d450 con 0x7f4844102530 2024-09-21T08:06:53.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.600+0000 7f484b365640 1 -- 172.21.15.107:0/3325058866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484410d9c0 con 0x7f4844102530 2024-09-21T08:06:53.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.601+0000 7f484b365640 1 -- 172.21.15.107:0/3325058866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48440fdcb0 con 0x7f4844102530 2024-09-21T08:06:53.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.602+0000 7f4839ffb640 1 -- 172.21.15.107:0/3325058866 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f484000dbb0 con 0x7f4844102530 2024-09-21T08:06:53.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.602+0000 7f4839ffb640 1 --2- 172.21.15.107:0/3325058866 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f483006e660 0x7f4830070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:53.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.602+0000 7f4839ffb640 1 -- 172.21.15.107:0/3325058866 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f484008daa0 con 0x7f4844102530 2024-09-21T08:06:53.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.602+0000 7f4848900640 1 --2- 172.21.15.107:0/3325058866 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f483006e660 0x7f4830070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:53.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.603+0000 7f4848900640 1 --2- 172.21.15.107:0/3325058866 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f483006e660 0x7f4830070b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f48340048a0 tx=0x7f4834035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:53.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.606+0000 7f4839ffb640 1 -- 172.21.15.107:0/3325058866 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4840056b40 con 0x7f4844102530 2024-09-21T08:06:53.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.807+0000 7f484b365640 1 -- 172.21.15.107:0/3325058866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f484404b750 con 0x7f4844102530 2024-09-21T08:06:53.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.808+0000 7f4839ffb640 1 -- 172.21.15.107:0/3325058866 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1922 (secure 0 0 0) 0x7f484008d070 con 0x7f4844102530 2024-09-21T08:06:53.809 INFO:teuthology.orchestra.run.smithi107.stdout:e15 2024-09-21T08:06:53.809 INFO:teuthology.orchestra.run.smithi107.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-21T08:06:53.810 INFO:teuthology.orchestra.run.smithi107.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T08:06:53.810 INFO:teuthology.orchestra.run.smithi107.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:06:53.810 INFO:teuthology.orchestra.run.smithi107.stdout:legacy client fscid: 1 2024-09-21T08:06:53.810 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:06:53.810 INFO:teuthology.orchestra.run.smithi107.stdout:Filesystem 'cephfs' (1) 2024-09-21T08:06:53.810 INFO:teuthology.orchestra.run.smithi107.stdout:fs_name cephfs 2024-09-21T08:06:53.810 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 15 2024-09-21T08:06:53.810 INFO:teuthology.orchestra.run.smithi107.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T08:06:53.810 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-09-21T08:00:03.244314+0000 2024-09-21T08:06:53.810 INFO:teuthology.orchestra.run.smithi107.stdout:modified 2024-09-21T08:00:21.458971+0000 2024-09-21T08:06:53.810 INFO:teuthology.orchestra.run.smithi107.stdout:tableserver 0 2024-09-21T08:06:53.810 INFO:teuthology.orchestra.run.smithi107.stdout:root 0 2024-09-21T08:06:53.810 INFO:teuthology.orchestra.run.smithi107.stdout:session_timeout 60 2024-09-21T08:06:53.811 INFO:teuthology.orchestra.run.smithi107.stdout:session_autoclose 300 2024-09-21T08:06:53.811 INFO:teuthology.orchestra.run.smithi107.stdout:max_file_size 1099511627776 2024-09-21T08:06:53.811 INFO:teuthology.orchestra.run.smithi107.stdout:max_xattr_size 65536 2024-09-21T08:06:53.811 INFO:teuthology.orchestra.run.smithi107.stdout:required_client_features {} 2024-09-21T08:06:53.811 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure 0 2024-09-21T08:06:53.811 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure_osd_epoch 44 2024-09-21T08:06:53.811 INFO:teuthology.orchestra.run.smithi107.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:06:53.811 INFO:teuthology.orchestra.run.smithi107.stdout:max_mds 1 2024-09-21T08:06:53.811 INFO:teuthology.orchestra.run.smithi107.stdout:in 0 2024-09-21T08:06:53.811 INFO:teuthology.orchestra.run.smithi107.stdout:up {0=14458} 2024-09-21T08:06:53.811 INFO:teuthology.orchestra.run.smithi107.stdout:failed 2024-09-21T08:06:53.811 INFO:teuthology.orchestra.run.smithi107.stdout:damaged 2024-09-21T08:06:53.811 INFO:teuthology.orchestra.run.smithi107.stdout:stopped 2024-09-21T08:06:53.811 INFO:teuthology.orchestra.run.smithi107.stdout:data_pools [3] 2024-09-21T08:06:53.812 INFO:teuthology.orchestra.run.smithi107.stdout:metadata_pool 2 2024-09-21T08:06:53.812 INFO:teuthology.orchestra.run.smithi107.stdout:inline_data disabled 2024-09-21T08:06:53.812 INFO:teuthology.orchestra.run.smithi107.stdout:balancer 2024-09-21T08:06:53.812 INFO:teuthology.orchestra.run.smithi107.stdout:bal_rank_mask -1 2024-09-21T08:06:53.812 INFO:teuthology.orchestra.run.smithi107.stdout:standby_count_wanted 1 2024-09-21T08:06:53.812 INFO:teuthology.orchestra.run.smithi107.stdout:qdb_cluster leader: 0 members: 2024-09-21T08:06:53.812 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.grqzkt{0:14458} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:06:53.812 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:06:53.812 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:06:53.812 INFO:teuthology.orchestra.run.smithi107.stdout:Standby daemons: 2024-09-21T08:06:53.812 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:06:53.812 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.qusoyf{-1:14468} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6826/2352538667,v1:172.21.15.107:6827/2352538667] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:06:53.812 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.fwmfcy{-1:24239} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:06:53.812 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.belyba{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:06:53.813 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 15 2024-09-21T08:06:53.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.810+0000 7f484b365640 1 -- 172.21.15.107:0/3325058866 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f483006e660 msgr2=0x7f4830070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:53.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.810+0000 7f484b365640 1 --2- 172.21.15.107:0/3325058866 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f483006e660 0x7f4830070b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f48340048a0 tx=0x7f4834035040 comp rx=0 tx=0).stop 2024-09-21T08:06:53.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.810+0000 7f484b365640 1 -- 172.21.15.107:0/3325058866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4844102530 msgr2=0x7f48441131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:53.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.810+0000 7f484b365640 1 --2- 172.21.15.107:0/3325058866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4844102530 0x7f48441131f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4840002a50 tx=0x7f4840004600 comp rx=0 tx=0).stop 2024-09-21T08:06:53.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.811+0000 7f484b365640 1 -- 172.21.15.107:0/3325058866 shutdown_connections 2024-09-21T08:06:53.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.811+0000 7f484b365640 1 --2- 172.21.15.107:0/3325058866 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f483006e660 0x7f4830070b10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.811+0000 7f484b365640 1 --2- 172.21.15.107:0/3325058866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4844102ed0 0x7f4844113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.811+0000 7f484b365640 1 --2- 172.21.15.107:0/3325058866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4844102530 0x7f48441131f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.811+0000 7f484b365640 1 -- 172.21.15.107:0/3325058866 >> 172.21.15.107:0/3325058866 conn(0x7f48440f80f0 msgr2=0x7f48440f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:53.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.811+0000 7f484b365640 1 -- 172.21.15.107:0/3325058866 shutdown_connections 2024-09-21T08:06:53.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.811+0000 7f484b365640 1 -- 172.21.15.107:0/3325058866 wait complete. 2024-09-21T08:06:53.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.890+0000 7efdb7c4b640 1 -- 172.21.15.107:0/2257669698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb00fb360 msgr2=0x7efdb00fb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:53.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.890+0000 7efdb7c4b640 1 --2- 172.21.15.107:0/2257669698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb00fb360 0x7efdb00fb730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efdac0048d0 tx=0x7efdac009da0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.890+0000 7efdb7c4b640 1 -- 172.21.15.107:0/2257669698 shutdown_connections 2024-09-21T08:06:53.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.890+0000 7efdb7c4b640 1 --2- 172.21.15.107:0/2257669698 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efdb00fbd00 0x7efdb0100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.890+0000 7efdb7c4b640 1 --2- 172.21.15.107:0/2257669698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb00fb360 0x7efdb00fb730 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.890+0000 7efdb7c4b640 1 -- 172.21.15.107:0/2257669698 >> 172.21.15.107:0/2257669698 conn(0x7efdb00f7000 msgr2=0x7efdb00f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:53.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.890+0000 7efdb7c4b640 1 -- 172.21.15.107:0/2257669698 shutdown_connections 2024-09-21T08:06:53.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.890+0000 7efdb7c4b640 1 -- 172.21.15.107:0/2257669698 wait complete. 2024-09-21T08:06:53.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.891+0000 7efdb7c4b640 1 Processor -- start 2024-09-21T08:06:53.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.891+0000 7efdb7c4b640 1 -- start start 2024-09-21T08:06:53.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.891+0000 7efdb7c4b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb00fb360 0x7efdb0119830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:53.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.891+0000 7efdb7c4b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efdb00fbd00 0x7efdb0119d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:53.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.891+0000 7efdb7c4b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb011a3c0 con 0x7efdb00fb360 2024-09-21T08:06:53.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.891+0000 7efdb7c4b640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb01137d0 con 0x7efdb00fbd00 2024-09-21T08:06:53.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.891+0000 7efdb59e7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb00fb360 0x7efdb0119830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:53.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.891+0000 7efdb59e7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb00fb360 0x7efdb0119830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36878/0 (socket says 172.21.15.107:36878) 2024-09-21T08:06:53.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.891+0000 7efdb59e7640 1 -- 172.21.15.107:0/2474271577 learned_addr learned my addr 172.21.15.107:0/2474271577 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:06:53.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.891+0000 7efdb51e6640 1 --2- 172.21.15.107:0/2474271577 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efdb00fbd00 0x7efdb0119d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:53.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.891+0000 7efdb59e7640 1 -- 172.21.15.107:0/2474271577 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efdb00fbd00 msgr2=0x7efdb0119d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:53.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.891+0000 7efdb59e7640 1 --2- 172.21.15.107:0/2474271577 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efdb00fbd00 0x7efdb0119d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:53.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.891+0000 7efdb59e7640 1 -- 172.21.15.107:0/2474271577 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac005040 con 0x7efdb00fb360 2024-09-21T08:06:53.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.892+0000 7efdb59e7640 1 --2- 172.21.15.107:0/2474271577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb00fb360 0x7efdb0119830 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efdac000c00 tx=0x7efdac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:53.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.892+0000 7efda67fc640 1 -- 172.21.15.107:0/2474271577 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdac038070 con 0x7efdb00fb360 2024-09-21T08:06:53.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.892+0000 7efdb7c4b640 1 -- 172.21.15.107:0/2474271577 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb0113a50 con 0x7efdb00fb360 2024-09-21T08:06:53.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.892+0000 7efda67fc640 1 -- 172.21.15.107:0/2474271577 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efdac02ade0 con 0x7efdb00fb360 2024-09-21T08:06:53.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.892+0000 7efda67fc640 1 -- 172.21.15.107:0/2474271577 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdac02c7e0 con 0x7efdb00fb360 2024-09-21T08:06:53.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.892+0000 7efdb7c4b640 1 -- 172.21.15.107:0/2474271577 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb0113f10 con 0x7efdb00fb360 2024-09-21T08:06:53.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.893+0000 7efdb7c4b640 1 -- 172.21.15.107:0/2474271577 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb0066330 con 0x7efdb00fb360 2024-09-21T08:06:53.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.893+0000 7efda67fc640 1 -- 172.21.15.107:0/2474271577 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7efdac030020 con 0x7efdb00fb360 2024-09-21T08:06:53.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.894+0000 7efda67fc640 1 --2- 172.21.15.107:0/2474271577 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7efd9c06e660 0x7efd9c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:53.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.894+0000 7efda67fc640 1 -- 172.21.15.107:0/2474271577 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6324+0+0 (secure 0 0 0) 0x7efdac0ade30 con 0x7efdb00fb360 2024-09-21T08:06:53.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.894+0000 7efdb51e6640 1 --2- 172.21.15.107:0/2474271577 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7efd9c06e660 0x7efd9c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:53.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.894+0000 7efdb51e6640 1 --2- 172.21.15.107:0/2474271577 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7efd9c06e660 0x7efd9c070b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efdb0114ab0 tx=0x7efda000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:53.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:53.898+0000 7efda67fc640 1 -- 172.21.15.107:0/2474271577 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7efdac076f60 con 0x7efdb00fb360 2024-09-21T08:06:54.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.081+0000 7efdb7c4b640 1 -- 172.21.15.107:0/2474271577 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efdb010fb60 con 0x7efd9c06e660 2024-09-21T08:06:54.082 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:53 smithi107 ceph-mon[97757]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:06:54.083 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:53 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/3989363602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:06:54.083 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:53 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/3325058866' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:06:54.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.082+0000 7efda67fc640 1 -- 172.21.15.107:0/2474271577 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7efdb010fb60 con 0x7efd9c06e660 2024-09-21T08:06:54.083 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:06:54.083 INFO:teuthology.orchestra.run.smithi107.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5", 2024-09-21T08:06:54.083 INFO:teuthology.orchestra.run.smithi107.stdout: "in_progress": true, 2024-09-21T08:06:54.084 INFO:teuthology.orchestra.run.smithi107.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T08:06:54.084 INFO:teuthology.orchestra.run.smithi107.stdout: "services_complete": [ 2024-09-21T08:06:54.084 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr", 2024-09-21T08:06:54.084 INFO:teuthology.orchestra.run.smithi107.stdout: "mon" 2024-09-21T08:06:54.084 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-21T08:06:54.084 INFO:teuthology.orchestra.run.smithi107.stdout: "progress": "4/21 daemons upgraded", 2024-09-21T08:06:54.084 INFO:teuthology.orchestra.run.smithi107.stdout: "message": "Currently upgrading crash daemons", 2024-09-21T08:06:54.084 INFO:teuthology.orchestra.run.smithi107.stdout: "is_paused": false 2024-09-21T08:06:54.084 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:06:54.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.085+0000 7efdb7c4b640 1 -- 172.21.15.107:0/2474271577 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7efd9c06e660 msgr2=0x7efd9c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:54.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.085+0000 7efdb7c4b640 1 --2- 172.21.15.107:0/2474271577 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7efd9c06e660 0x7efd9c070b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efdb0114ab0 tx=0x7efda000b040 comp rx=0 tx=0).stop 2024-09-21T08:06:54.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.085+0000 7efdb7c4b640 1 -- 172.21.15.107:0/2474271577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb00fb360 msgr2=0x7efdb0119830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:54.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.085+0000 7efdb7c4b640 1 --2- 172.21.15.107:0/2474271577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb00fb360 0x7efdb0119830 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efdac000c00 tx=0x7efdac009da0 comp rx=0 tx=0).stop 2024-09-21T08:06:54.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.085+0000 7efdb7c4b640 1 -- 172.21.15.107:0/2474271577 shutdown_connections 2024-09-21T08:06:54.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.085+0000 7efdb7c4b640 1 --2- 172.21.15.107:0/2474271577 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7efd9c06e660 0x7efd9c070b10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:54.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.085+0000 7efdb7c4b640 1 --2- 172.21.15.107:0/2474271577 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efdb00fbd00 0x7efdb0119d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:54.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.085+0000 7efdb7c4b640 1 --2- 172.21.15.107:0/2474271577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdb00fb360 0x7efdb0119830 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:54.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.085+0000 7efdb7c4b640 1 -- 172.21.15.107:0/2474271577 >> 172.21.15.107:0/2474271577 conn(0x7efdb00f7000 msgr2=0x7efdb00f8670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:54.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.085+0000 7efdb7c4b640 1 -- 172.21.15.107:0/2474271577 shutdown_connections 2024-09-21T08:06:54.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.085+0000 7efdb7c4b640 1 -- 172.21.15.107:0/2474271577 wait complete. 2024-09-21T08:06:54.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.167+0000 7fc6603d9640 1 -- 172.21.15.107:0/3321852279 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6580fcf80 msgr2=0x7fc6580fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:54.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.167+0000 7fc6603d9640 1 --2- 172.21.15.107:0/3321852279 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6580fcf80 0x7fc6580fd3d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc6480048d0 tx=0x7fc648009da0 comp rx=0 tx=0).stop 2024-09-21T08:06:54.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.167+0000 7fc6603d9640 1 -- 172.21.15.107:0/3321852279 shutdown_connections 2024-09-21T08:06:54.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.167+0000 7fc6603d9640 1 --2- 172.21.15.107:0/3321852279 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6580fcf80 0x7fc6580fd3d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:54.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.167+0000 7fc6603d9640 1 --2- 172.21.15.107:0/3321852279 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6580fb810 0x7fc6580fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:54.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.167+0000 7fc6603d9640 1 -- 172.21.15.107:0/3321852279 >> 172.21.15.107:0/3321852279 conn(0x7fc6580723b0 msgr2=0x7fc6580727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:54.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.167+0000 7fc6603d9640 1 -- 172.21.15.107:0/3321852279 shutdown_connections 2024-09-21T08:06:54.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.167+0000 7fc6603d9640 1 -- 172.21.15.107:0/3321852279 wait complete. 2024-09-21T08:06:54.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.167+0000 7fc6603d9640 1 Processor -- start 2024-09-21T08:06:54.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.167+0000 7fc6603d9640 1 -- start start 2024-09-21T08:06:54.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.168+0000 7fc6603d9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6580fb810 0x7fc65810e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:54.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.168+0000 7fc6603d9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6580fcf80 0x7fc65810e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:54.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.168+0000 7fc6603d9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65810ed20 con 0x7fc6580fb810 2024-09-21T08:06:54.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.168+0000 7fc6603d9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65810ee90 con 0x7fc6580fcf80 2024-09-21T08:06:54.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.168+0000 7fc65e175640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6580fb810 0x7fc65810e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:54.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.168+0000 7fc65e175640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6580fb810 0x7fc65810e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36898/0 (socket says 172.21.15.107:36898) 2024-09-21T08:06:54.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.168+0000 7fc65e175640 1 -- 172.21.15.107:0/4251214250 learned_addr learned my addr 172.21.15.107:0/4251214250 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:06:54.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.168+0000 7fc65d974640 1 --2- 172.21.15.107:0/4251214250 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6580fcf80 0x7fc65810e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:54.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.168+0000 7fc65e175640 1 -- 172.21.15.107:0/4251214250 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6580fcf80 msgr2=0x7fc65810e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:54.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.168+0000 7fc65e175640 1 --2- 172.21.15.107:0/4251214250 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6580fcf80 0x7fc65810e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:54.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.168+0000 7fc65e175640 1 -- 172.21.15.107:0/4251214250 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc648005040 con 0x7fc6580fb810 2024-09-21T08:06:54.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.168+0000 7fc65e175640 1 --2- 172.21.15.107:0/4251214250 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6580fb810 0x7fc65810e190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc65000ece0 tx=0x7fc65000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:54.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.168+0000 7fc64effd640 1 -- 172.21.15.107:0/4251214250 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc65000ee40 con 0x7fc6580fb810 2024-09-21T08:06:54.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.169+0000 7fc64effd640 1 -- 172.21.15.107:0/4251214250 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc65000f040 con 0x7fc6580fb810 2024-09-21T08:06:54.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.169+0000 7fc6603d9640 1 -- 172.21.15.107:0/4251214250 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc658117200 con 0x7fc6580fb810 2024-09-21T08:06:54.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.169+0000 7fc64effd640 1 -- 172.21.15.107:0/4251214250 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc650009580 con 0x7fc6580fb810 2024-09-21T08:06:54.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.169+0000 7fc6603d9640 1 -- 172.21.15.107:0/4251214250 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc658117710 con 0x7fc6580fb810 2024-09-21T08:06:54.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.170+0000 7fc6603d9640 1 -- 172.21.15.107:0/4251214250 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6580fcbc0 con 0x7fc6580fb810 2024-09-21T08:06:54.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.170+0000 7fc64effd640 1 -- 172.21.15.107:0/4251214250 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fc650014480 con 0x7fc6580fb810 2024-09-21T08:06:54.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.170+0000 7fc64effd640 1 --2- 172.21.15.107:0/4251214250 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc64406e660 0x7fc644070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:54.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.171+0000 7fc64effd640 1 -- 172.21.15.107:0/4251214250 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc65008e860 con 0x7fc6580fb810 2024-09-21T08:06:54.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.171+0000 7fc65d974640 1 --2- 172.21.15.107:0/4251214250 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc64406e660 0x7fc644070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:54.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.171+0000 7fc65d974640 1 --2- 172.21.15.107:0/4251214250 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc64406e660 0x7fc644070b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc658065980 tx=0x7fc648035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:54.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.175+0000 7fc64effd640 1 -- 172.21.15.107:0/4251214250 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc650057930 con 0x7fc6580fb810 2024-09-21T08:06:54.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:53 smithi129 ceph-mon[76722]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:06:54.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:53 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/3989363602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:06:54.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:53 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/3325058866' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:06:54.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.425+0000 7fc6603d9640 1 -- 172.21.15.107:0/4251214250 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc65804b7b0 con 0x7fc6580fb810 2024-09-21T08:06:54.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.425+0000 7fc64effd640 1 -- 172.21.15.107:0/4251214250 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc65005aff0 con 0x7fc6580fb810 2024-09-21T08:06:54.427 INFO:teuthology.orchestra.run.smithi107.stdout:HEALTH_OK 2024-09-21T08:06:54.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.428+0000 7fc6603d9640 1 -- 172.21.15.107:0/4251214250 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc64406e660 msgr2=0x7fc644070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:54.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.428+0000 7fc6603d9640 1 --2- 172.21.15.107:0/4251214250 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc64406e660 0x7fc644070b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc658065980 tx=0x7fc648035040 comp rx=0 tx=0).stop 2024-09-21T08:06:54.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.428+0000 7fc6603d9640 1 -- 172.21.15.107:0/4251214250 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6580fb810 msgr2=0x7fc65810e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:54.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.428+0000 7fc6603d9640 1 --2- 172.21.15.107:0/4251214250 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6580fb810 0x7fc65810e190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc65000ece0 tx=0x7fc65000b040 comp rx=0 tx=0).stop 2024-09-21T08:06:54.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.428+0000 7fc6603d9640 1 -- 172.21.15.107:0/4251214250 shutdown_connections 2024-09-21T08:06:54.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.428+0000 7fc6603d9640 1 --2- 172.21.15.107:0/4251214250 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc64406e660 0x7fc644070b10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:54.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.428+0000 7fc6603d9640 1 --2- 172.21.15.107:0/4251214250 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6580fcf80 0x7fc65810e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:54.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.428+0000 7fc6603d9640 1 --2- 172.21.15.107:0/4251214250 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6580fb810 0x7fc65810e190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:54.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.428+0000 7fc6603d9640 1 -- 172.21.15.107:0/4251214250 >> 172.21.15.107:0/4251214250 conn(0x7fc6580723b0 msgr2=0x7fc6580fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:54.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.428+0000 7fc6603d9640 1 -- 172.21.15.107:0/4251214250 shutdown_connections 2024-09-21T08:06:54.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:06:54.428+0000 7fc6603d9640 1 -- 172.21.15.107:0/4251214250 wait complete. 2024-09-21T08:06:54.966 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:54 smithi129 ceph-mon[76722]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:06:54.966 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:54 smithi129 ceph-mon[76722]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:06:54.966 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:54 smithi129 ceph-mon[76722]: pgmap v30: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:54.967 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:54 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:54.967 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:54 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:54.967 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:54 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:06:54.967 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:54 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/4251214250' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:06:55.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:54 smithi107 ceph-mon[97757]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:06:55.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:54 smithi107 ceph-mon[97757]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:06:55.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:54 smithi107 ceph-mon[97757]: pgmap v30: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:55.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:54 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:55.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:54 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:55.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:54 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:06:55.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:54 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/4251214250' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:06:56.161 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:55 smithi107 ceph-mon[97757]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:06:56.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:55 smithi129 ceph-mon[76722]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:06:57.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:56 smithi129 ceph-mon[76722]: pgmap v31: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:57.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:56 smithi107 ceph-mon[97757]: pgmap v31: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:58.223 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:57 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:58.224 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:57 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:58.224 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:57 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:58.224 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:57 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:58.224 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:57 smithi129 ceph-mon[76722]: pgmap v32: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:06:58.247 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:57 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:58.247 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:57 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:58.247 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:57 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:58.247 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:57 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:06:58.247 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:57 smithi107 ceph-mon[97757]: pgmap v32: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:07:00.113 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:00.114 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:00.114 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:00.114 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:00.114 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:06:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:07:00.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:00.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:00.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:00.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:00.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:06:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:07:01.202 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:00 smithi107 ceph-mon[97757]: pgmap v33: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:07:01.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:00 smithi129 ceph-mon[76722]: pgmap v33: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:07:02.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:01 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:02.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:01 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:02.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:01 smithi129 ceph-mon[76722]: pgmap v34: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:07:02.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:01 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:02.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:01 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:02.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:01 smithi107 ceph-mon[97757]: pgmap v34: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:07:03.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:03.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:03.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:07:03.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:07:03.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:03.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:07:03.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:03.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:03.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:03.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:03 smithi107 ceph-mon[97757]: Upgrade: Setting container_image for all crash 2024-09-21T08:07:03.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:03.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi107"}]: dispatch 2024-09-21T08:07:03.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi107"}]': finished 2024-09-21T08:07:03.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi129"}]: dispatch 2024-09-21T08:07:03.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi129"}]': finished 2024-09-21T08:07:03.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-21T08:07:03.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:03 smithi107 ceph-mon[97757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-21T08:07:03.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:03 smithi107 ceph-mon[97757]: Upgrade: osd.0 is safe to restart 2024-09-21T08:07:04.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:04.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:04.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:07:04.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:07:04.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:04.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:07:04.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:04.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:04.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:04.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:03 smithi129 ceph-mon[76722]: Upgrade: Setting container_image for all crash 2024-09-21T08:07:04.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:04.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi107"}]: dispatch 2024-09-21T08:07:04.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi107"}]': finished 2024-09-21T08:07:04.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi129"}]: dispatch 2024-09-21T08:07:04.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi129"}]': finished 2024-09-21T08:07:04.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-21T08:07:04.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:03 smithi129 ceph-mon[76722]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-21T08:07:04.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:03 smithi129 ceph-mon[76722]: Upgrade: osd.0 is safe to restart 2024-09-21T08:07:05.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:04 smithi129 ceph-mon[76722]: pgmap v35: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:07:05.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:04 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:05.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:04 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-21T08:07:05.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:04 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:07:05.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:04 smithi107 ceph-mon[97757]: pgmap v35: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:07:05.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:04 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:05.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:04 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-21T08:07:05.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:04 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:07:06.051 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:05 smithi107 ceph-mon[97757]: Upgrade: Updating osd.0 2024-09-21T08:07:06.051 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:05 smithi107 ceph-mon[97757]: Deploying daemon osd.0 on smithi107 2024-09-21T08:07:06.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:05 smithi129 ceph-mon[76722]: Upgrade: Updating osd.0 2024-09-21T08:07:06.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:05 smithi129 ceph-mon[76722]: Deploying daemon osd.0 on smithi107 2024-09-21T08:07:07.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:06 smithi129 ceph-mon[76722]: pgmap v36: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:07:07.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:06 smithi107 ceph-mon[97757]: pgmap v36: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:07:07.584 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:07 smithi107 systemd[1]: Stopping Ceph osd.0 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:07:07.895 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:07 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0[45651]: 2024-09-21T08:07:07.582+0000 7f12cf907640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:07:07.895 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:07 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0[45651]: 2024-09-21T08:07:07.582+0000 7f12cf907640 -1 osd.0 47 *** Got signal Terminated *** 2024-09-21T08:07:07.895 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:07 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0[45651]: 2024-09-21T08:07:07.582+0000 7f12cf907640 -1 osd.0 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:07:08.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:07 smithi129 ceph-mon[76722]: osd.0 marked itself down and dead 2024-09-21T08:07:08.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:07 smithi107 ceph-mon[97757]: osd.0 marked itself down and dead 2024-09-21T08:07:08.661 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:08 smithi107 podman[108892]: 2024-09-21 08:07:08.399990498 +0000 UTC m=+0.946470803 container died 6799bdf55207fabcfcc2dbd4f8e5bcd0311756b31164264ca6ef93941166cc43 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=quincy-fbd1a6a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T08:07:08.943 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:08 smithi107 ceph-mon[97757]: pgmap v37: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:07:08.943 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:08 smithi107 ceph-mon[97757]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T08:07:08.943 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:08 smithi107 ceph-mon[97757]: osdmap e48: 6 total, 5 up, 6 in 2024-09-21T08:07:08.943 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:08 smithi107 podman[108892]: 2024-09-21 08:07:08.766177074 +0000 UTC m=+1.312657371 container cleanup 6799bdf55207fabcfcc2dbd4f8e5bcd0311756b31164264ca6ef93941166cc43 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=quincy-fbd1a6a, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T08:07:08.943 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:08 smithi107 bash[108892]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0 2024-09-21T08:07:09.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:08 smithi129 ceph-mon[76722]: pgmap v37: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:07:09.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:08 smithi129 ceph-mon[76722]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T08:07:09.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:08 smithi129 ceph-mon[76722]: osdmap e48: 6 total, 5 up, 6 in 2024-09-21T08:07:09.304 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:08 smithi107 podman[108907]: 2024-09-21 08:07:08.942336001 +0000 UTC m=+0.544173332 container remove 6799bdf55207fabcfcc2dbd4f8e5bcd0311756b31164264ca6ef93941166cc43 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=quincy-fbd1a6a, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T08:07:09.705 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:09 smithi107 podman[108997]: 2024-09-21 08:07:09.376741774 +0000 UTC m=+0.111994189 container create f180dd89dbdffbb7cd0b17b5ae8737657522b640e995d1b2e08ef11bf7044950 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-09-21T08:07:09.705 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:09 smithi107 podman[108997]: 2024-09-21 08:07:09.286781612 +0000 UTC m=+0.022033985 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:07:09.705 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:09 smithi107 podman[108997]: 2024-09-21 08:07:09.620998118 +0000 UTC m=+0.356250498 container init f180dd89dbdffbb7cd0b17b5ae8737657522b640e995d1b2e08ef11bf7044950 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:07:09.705 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:09 smithi107 podman[108997]: 2024-09-21 08:07:09.624295852 +0000 UTC m=+0.359548224 container start f180dd89dbdffbb7cd0b17b5ae8737657522b640e995d1b2e08ef11bf7044950 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T08:07:09.706 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:09 smithi107 podman[108997]: 2024-09-21 08:07:09.704359275 +0000 UTC m=+0.439611656 container attach f180dd89dbdffbb7cd0b17b5ae8737657522b640e995d1b2e08ef11bf7044950 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T08:07:10.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:09 smithi107 ceph-mon[97757]: osdmap e49: 6 total, 5 up, 6 in 2024-09-21T08:07:10.054 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:09 smithi107 podman[108997]: 2024-09-21 08:07:09.812409635 +0000 UTC m=+0.547662012 container died f180dd89dbdffbb7cd0b17b5ae8737657522b640e995d1b2e08ef11bf7044950 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T08:07:10.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:09 smithi129 ceph-mon[76722]: osdmap e49: 6 total, 5 up, 6 in 2024-09-21T08:07:10.907 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:10 smithi107 podman[109019]: 2024-09-21 08:07:10.558201629 +0000 UTC m=+0.738768010 container remove f180dd89dbdffbb7cd0b17b5ae8737657522b640e995d1b2e08ef11bf7044950 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T08:07:10.907 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:10 smithi107 systemd[1]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.0.service: Deactivated successfully. 2024-09-21T08:07:10.907 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:10 smithi107 systemd[1]: Stopped Ceph osd.0 for 786d4f32-77ee-11ef-baf6-efdc52797490. 2024-09-21T08:07:10.907 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:10 smithi107 systemd[1]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.0.service: Consumed 58.144s CPU time. 2024-09-21T08:07:10.907 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:10 smithi107 systemd[1]: Starting Ceph osd.0 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:07:11.253 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:10 smithi107 ceph-mon[97757]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:07:11.253 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:11 smithi107 podman[109116]: 2024-09-21 08:07:10.909572041 +0000 UTC m=+0.016417623 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:07:11.253 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:11 smithi107 podman[109116]: 2024-09-21 08:07:11.026312873 +0000 UTC m=+0.133158455 container create 77231918856a247c27739589c6496c0fe0ca16e9432e16ab2177b1e43675849d (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:07:11.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:10 smithi129 ceph-mon[76722]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:07:11.554 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:11 smithi107 podman[109116]: 2024-09-21 08:07:11.271404737 +0000 UTC m=+0.378250321 container init 77231918856a247c27739589c6496c0fe0ca16e9432e16ab2177b1e43675849d (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T08:07:11.555 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:11 smithi107 podman[109116]: 2024-09-21 08:07:11.27528119 +0000 UTC m=+0.382126770 container start 77231918856a247c27739589c6496c0fe0ca16e9432e16ab2177b1e43675849d (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-activate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T08:07:11.555 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:11 smithi107 podman[109116]: 2024-09-21 08:07:11.362445787 +0000 UTC m=+0.469291375 container attach 77231918856a247c27739589c6496c0fe0ca16e9432e16ab2177b1e43675849d (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T08:07:11.555 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:11 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-activate[109131]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:07:11.555 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:11 smithi107 bash[109116]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:07:11.555 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:11 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-activate[109131]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:07:11.555 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:11 smithi107 bash[109116]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:07:12.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:11 smithi129 ceph-mon[76722]: pgmap v41: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-21T08:07:12.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:11 smithi107 ceph-mon[97757]: pgmap v41: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-21T08:07:12.304 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:12 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-activate[109131]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T08:07:12.305 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:12 smithi107 bash[109116]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T08:07:12.305 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:12 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-activate[109131]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-21T08:07:12.305 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:12 smithi107 bash[109116]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-21T08:07:12.741 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:12 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-activate[109131]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-21T08:07:12.742 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:12 smithi107 bash[109116]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-21T08:07:12.742 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:12 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-activate[109131]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T08:07:12.742 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:12 smithi107 bash[109116]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T08:07:12.742 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:12 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-activate[109131]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-21T08:07:12.742 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:12 smithi107 bash[109116]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-21T08:07:12.742 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:12 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-activate[109131]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T08:07:12.742 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:12 smithi107 bash[109116]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T08:07:12.742 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:12 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-activate[109131]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-21T08:07:12.742 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:12 smithi107 bash[109116]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-21T08:07:12.742 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:12 smithi107 podman[109116]: 2024-09-21 08:07:12.452995766 +0000 UTC m=+1.559841352 container died 77231918856a247c27739589c6496c0fe0ca16e9432e16ab2177b1e43675849d (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-activate, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, GIT_CLEAN=True) 2024-09-21T08:07:13.008 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:12 smithi107 ceph-mon[97757]: Health check failed: Degraded data redundancy: 44/219 objects degraded (20.091%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T08:07:13.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:12 smithi129 ceph-mon[76722]: Health check failed: Degraded data redundancy: 44/219 objects degraded (20.091%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T08:07:13.304 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:13 smithi107 podman[109266]: 2024-09-21 08:07:13.007883799 +0000 UTC m=+0.549283995 container remove 77231918856a247c27739589c6496c0fe0ca16e9432e16ab2177b1e43675849d (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-activate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70) 2024-09-21T08:07:13.304 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:13 smithi107 podman[109323]: 2024-09-21 08:07:13.121016257 +0000 UTC m=+0.015904971 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:07:13.304 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:13 smithi107 podman[109323]: 2024-09-21 08:07:13.225400726 +0000 UTC m=+0.120289432 container create d0a742b31d8a123a34003f5ab4166afd187542161498896d470d624ccb8b11da (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:07:13.804 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:13 smithi107 podman[109323]: 2024-09-21 08:07:13.469345201 +0000 UTC m=+0.364233916 container init d0a742b31d8a123a34003f5ab4166afd187542161498896d470d624ccb8b11da (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T08:07:13.804 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:13 smithi107 podman[109323]: 2024-09-21 08:07:13.472807831 +0000 UTC m=+0.367696532 container start d0a742b31d8a123a34003f5ab4166afd187542161498896d470d624ccb8b11da (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T08:07:13.804 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:13 smithi107 bash[109323]: d0a742b31d8a123a34003f5ab4166afd187542161498896d470d624ccb8b11da 2024-09-21T08:07:13.804 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:13 smithi107 systemd[1]: Started Ceph osd.0 for 786d4f32-77ee-11ef-baf6-efdc52797490. 2024-09-21T08:07:14.990 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:14 smithi107 ceph-mon[97757]: pgmap v42: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-21T08:07:14.990 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:14 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:14.990 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:14 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:14.990 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:14 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:07:14.990 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:14 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:14.990 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:14 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:07:15.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:14 smithi129 ceph-mon[76722]: pgmap v42: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-21T08:07:15.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:14 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:15.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:14 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:15.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:14 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:07:15.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:14 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:15.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:14 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:07:15.260 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:15 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0[109337]: 2024-09-21T08:07:15.134+0000 7fa5185a7640 -1 Falling back to public interface 2024-09-21T08:07:17.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:16 smithi129 ceph-mon[76722]: pgmap v43: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-21T08:07:17.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:16 smithi107 ceph-mon[97757]: pgmap v43: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-21T08:07:19.013 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:18 smithi129 ceph-mon[76722]: pgmap v44: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-21T08:07:19.013 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:18 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:19.013 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:18 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:19.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:18 smithi107 ceph-mon[97757]: pgmap v44: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-21T08:07:19.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:18 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:19.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:18 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:20.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:20 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:20.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:20 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:20.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:20 smithi107 ceph-mon[97757]: pgmap v45: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-21T08:07:20.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:20 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:20.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:20 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:20.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:20 smithi129 ceph-mon[76722]: pgmap v45: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-21T08:07:21.289 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:21 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0[109337]: 2024-09-21T08:07:21.188+0000 7fa5185a7640 -1 osd.0 47 log_to_monitors true 2024-09-21T08:07:21.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:21 smithi107 ceph-mon[97757]: from='osd.0 [v2:172.21.15.107:6802/3041497899,v1:172.21.15.107:6803/3041497899]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-21T08:07:21.554 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:07:21 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0[109337]: 2024-09-21T08:07:21.310+0000 7fa510341640 -1 osd.0 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T08:07:21.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:21 smithi129 ceph-mon[76722]: from='osd.0 [v2:172.21.15.107:6802/3041497899,v1:172.21.15.107:6803/3041497899]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-21T08:07:22.467 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:22 smithi107 ceph-mon[97757]: from='osd.0 [v2:172.21.15.107:6802/3041497899,v1:172.21.15.107:6803/3041497899]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T08:07:22.467 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:22 smithi107 ceph-mon[97757]: osdmap e50: 6 total, 5 up, 6 in 2024-09-21T08:07:22.467 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:22 smithi107 ceph-mon[97757]: from='osd.0 [v2:172.21.15.107:6802/3041497899,v1:172.21.15.107:6803/3041497899]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-21T08:07:22.467 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:22 smithi107 ceph-mon[97757]: pgmap v47: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-21T08:07:22.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:22 smithi129 ceph-mon[76722]: from='osd.0 [v2:172.21.15.107:6802/3041497899,v1:172.21.15.107:6803/3041497899]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T08:07:22.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:22 smithi129 ceph-mon[76722]: osdmap e50: 6 total, 5 up, 6 in 2024-09-21T08:07:22.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:22 smithi129 ceph-mon[76722]: from='osd.0 [v2:172.21.15.107:6802/3041497899,v1:172.21.15.107:6803/3041497899]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-21T08:07:22.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:22 smithi129 ceph-mon[76722]: pgmap v47: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-21T08:07:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:23 smithi129 ceph-mon[76722]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T08:07:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:23 smithi129 ceph-mon[76722]: osd.0 [v2:172.21.15.107:6802/3041497899,v1:172.21.15.107:6803/3041497899] boot 2024-09-21T08:07:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:23 smithi129 ceph-mon[76722]: osdmap e51: 6 total, 6 up, 6 in 2024-09-21T08:07:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:23 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T08:07:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:23 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:23 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:23 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:07:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:23 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:07:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:23 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:23 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:07:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:23 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:23.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:23 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:23.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:23 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:23.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:23 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T08:07:23.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:23 smithi129 ceph-mon[76722]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T08:07:23.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:23 smithi129 ceph-mon[76722]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-21T08:07:23.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:23 smithi107 ceph-mon[97757]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T08:07:23.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:23 smithi107 ceph-mon[97757]: osd.0 [v2:172.21.15.107:6802/3041497899,v1:172.21.15.107:6803/3041497899] boot 2024-09-21T08:07:23.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:23 smithi107 ceph-mon[97757]: osdmap e51: 6 total, 6 up, 6 in 2024-09-21T08:07:23.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:23 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T08:07:23.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:23 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:23.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:23 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:23.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:23 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:07:23.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:23 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:07:23.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:23 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:23.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:23 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:07:23.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:23 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:23.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:23 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:23.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:23 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:23.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:23 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T08:07:23.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:23 smithi107 ceph-mon[97757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T08:07:23.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:23 smithi107 ceph-mon[97757]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-21T08:07:24.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.519+0000 7fe4854fb640 1 -- 172.21.15.107:0/2116484805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe480102550 msgr2=0x7fe480102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:24.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.519+0000 7fe4854fb640 1 --2- 172.21.15.107:0/2116484805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe480102550 0x7fe480102920 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe4700048d0 tx=0x7fe470009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:24.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.519+0000 7fe4854fb640 1 -- 172.21.15.107:0/2116484805 shutdown_connections 2024-09-21T08:07:24.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.519+0000 7fe4854fb640 1 --2- 172.21.15.107:0/2116484805 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe480102ef0 0x7fe4800fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:24.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.519+0000 7fe4854fb640 1 --2- 172.21.15.107:0/2116484805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe480102550 0x7fe480102920 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:24.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.519+0000 7fe4854fb640 1 -- 172.21.15.107:0/2116484805 >> 172.21.15.107:0/2116484805 conn(0x7fe4800f80f0 msgr2=0x7fe4800fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:24.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.519+0000 7fe4854fb640 1 -- 172.21.15.107:0/2116484805 shutdown_connections 2024-09-21T08:07:24.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.519+0000 7fe4854fb640 1 -- 172.21.15.107:0/2116484805 wait complete. 2024-09-21T08:07:24.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.520+0000 7fe4854fb640 1 Processor -- start 2024-09-21T08:07:24.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.520+0000 7fe4854fb640 1 -- start start 2024-09-21T08:07:24.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.520+0000 7fe4854fb640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe480102550 0x7fe480113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:24.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.520+0000 7fe4854fb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe480102ef0 0x7fe480113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:24.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.520+0000 7fe4854fb640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe480114100 con 0x7fe480102ef0 2024-09-21T08:07:24.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.520+0000 7fe4854fb640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48010d510 con 0x7fe480102550 2024-09-21T08:07:24.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.520+0000 7fe47e7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe480102ef0 0x7fe480113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:24.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.520+0000 7fe47e7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe480102ef0 0x7fe480113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52714/0 (socket says 172.21.15.107:52714) 2024-09-21T08:07:24.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.520+0000 7fe47e7fc640 1 -- 172.21.15.107:0/3680099385 learned_addr learned my addr 172.21.15.107:0/3680099385 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:07:24.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.521+0000 7fe47effd640 1 --2- 172.21.15.107:0/3680099385 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe480102550 0x7fe480113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:24.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.521+0000 7fe47e7fc640 1 -- 172.21.15.107:0/3680099385 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe480102550 msgr2=0x7fe480113570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:24.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.521+0000 7fe47e7fc640 1 --2- 172.21.15.107:0/3680099385 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe480102550 0x7fe480113570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:24.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.521+0000 7fe47e7fc640 1 -- 172.21.15.107:0/3680099385 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe470005040 con 0x7fe480102ef0 2024-09-21T08:07:24.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.521+0000 7fe47e7fc640 1 --2- 172.21.15.107:0/3680099385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe480102ef0 0x7fe480113ab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe47400c740 tx=0x7fe4740043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:24.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.521+0000 7fe4677fe640 1 -- 172.21.15.107:0/3680099385 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe474012810 con 0x7fe480102ef0 2024-09-21T08:07:24.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.521+0000 7fe4854fb640 1 -- 172.21.15.107:0/3680099385 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48010d7f0 con 0x7fe480102ef0 2024-09-21T08:07:24.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.521+0000 7fe4677fe640 1 -- 172.21.15.107:0/3680099385 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe474012e10 con 0x7fe480102ef0 2024-09-21T08:07:24.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.521+0000 7fe4854fb640 1 -- 172.21.15.107:0/3680099385 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48010dd90 con 0x7fe480102ef0 2024-09-21T08:07:24.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.521+0000 7fe4677fe640 1 -- 172.21.15.107:0/3680099385 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe47400a2f0 con 0x7fe480102ef0 2024-09-21T08:07:24.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.522+0000 7fe4854fb640 1 -- 172.21.15.107:0/3680099385 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4800fdcd0 con 0x7fe480102ef0 2024-09-21T08:07:24.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.523+0000 7fe4677fe640 1 -- 172.21.15.107:0/3680099385 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fe474011380 con 0x7fe480102ef0 2024-09-21T08:07:24.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.523+0000 7fe4677fe640 1 --2- 172.21.15.107:0/3680099385 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fe46806e660 0x7fe468070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:24.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.523+0000 7fe4677fe640 1 -- 172.21.15.107:0/3680099385 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe47408e6a0 con 0x7fe480102ef0 2024-09-21T08:07:24.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.524+0000 7fe47effd640 1 --2- 172.21.15.107:0/3680099385 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fe46806e660 0x7fe468070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:24.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.524+0000 7fe47effd640 1 --2- 172.21.15.107:0/3680099385 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fe46806e660 0x7fe468070b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe470009ac0 tx=0x7fe470035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:24.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.528+0000 7fe4677fe640 1 -- 172.21.15.107:0/3680099385 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe4740577a0 con 0x7fe480102ef0 2024-09-21T08:07:24.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.709+0000 7fe4854fb640 1 -- 172.21.15.107:0/3680099385 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4801095a0 con 0x7fe46806e660 2024-09-21T08:07:24.711 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:24 smithi107 ceph-mon[97757]: osdmap e52: 6 total, 6 up, 6 in 2024-09-21T08:07:24.711 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:24 smithi107 ceph-mon[97757]: pgmap v50: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-21T08:07:24.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.710+0000 7fe4677fe640 1 -- 172.21.15.107:0/3680099385 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe4801095a0 con 0x7fe46806e660 2024-09-21T08:07:24.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.712+0000 7fe4854fb640 1 -- 172.21.15.107:0/3680099385 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fe46806e660 msgr2=0x7fe468070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:24.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.712+0000 7fe4854fb640 1 --2- 172.21.15.107:0/3680099385 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fe46806e660 0x7fe468070b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe470009ac0 tx=0x7fe470035040 comp rx=0 tx=0).stop 2024-09-21T08:07:24.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.712+0000 7fe4854fb640 1 -- 172.21.15.107:0/3680099385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe480102ef0 msgr2=0x7fe480113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:24.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.712+0000 7fe4854fb640 1 --2- 172.21.15.107:0/3680099385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe480102ef0 0x7fe480113ab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe47400c740 tx=0x7fe4740043c0 comp rx=0 tx=0).stop 2024-09-21T08:07:24.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.713+0000 7fe4854fb640 1 -- 172.21.15.107:0/3680099385 shutdown_connections 2024-09-21T08:07:24.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.713+0000 7fe4854fb640 1 --2- 172.21.15.107:0/3680099385 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fe46806e660 0x7fe468070b10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:24.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.713+0000 7fe4854fb640 1 --2- 172.21.15.107:0/3680099385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe480102ef0 0x7fe480113ab0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:24.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.713+0000 7fe4854fb640 1 --2- 172.21.15.107:0/3680099385 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe480102550 0x7fe480113570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:24.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.713+0000 7fe4854fb640 1 -- 172.21.15.107:0/3680099385 >> 172.21.15.107:0/3680099385 conn(0x7fe4800f80f0 msgr2=0x7fe4800f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:24.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.713+0000 7fe4854fb640 1 -- 172.21.15.107:0/3680099385 shutdown_connections 2024-09-21T08:07:24.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.713+0000 7fe4854fb640 1 -- 172.21.15.107:0/3680099385 wait complete. 2024-09-21T08:07:24.723 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:07:24.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:24 smithi129 ceph-mon[76722]: osdmap e52: 6 total, 6 up, 6 in 2024-09-21T08:07:24.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:24 smithi129 ceph-mon[76722]: pgmap v50: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-21T08:07:24.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.791+0000 7ffa6fa25640 1 -- 172.21.15.107:0/3120789401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa680fb4a0 msgr2=0x7ffa680fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:24.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.791+0000 7ffa6fa25640 1 --2- 172.21.15.107:0/3120789401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa680fb4a0 0x7ffa680fb910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffa580048d0 tx=0x7ffa58009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:24.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.791+0000 7ffa6fa25640 1 -- 172.21.15.107:0/3120789401 shutdown_connections 2024-09-21T08:07:24.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.791+0000 7ffa6fa25640 1 --2- 172.21.15.107:0/3120789401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa680fb4a0 0x7ffa680fb910 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:24.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.791+0000 7ffa6fa25640 1 --2- 172.21.15.107:0/3120789401 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffa681014e0 0x7ffa681018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:24.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.791+0000 7ffa6fa25640 1 -- 172.21.15.107:0/3120789401 >> 172.21.15.107:0/3120789401 conn(0x7ffa680f7060 msgr2=0x7ffa680f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:24.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.791+0000 7ffa6fa25640 1 -- 172.21.15.107:0/3120789401 shutdown_connections 2024-09-21T08:07:24.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.791+0000 7ffa6fa25640 1 -- 172.21.15.107:0/3120789401 wait complete. 2024-09-21T08:07:24.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.792+0000 7ffa6fa25640 1 Processor -- start 2024-09-21T08:07:24.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.792+0000 7ffa6fa25640 1 -- start start 2024-09-21T08:07:24.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.792+0000 7ffa6fa25640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa680fb4a0 0x7ffa6810e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:24.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.792+0000 7ffa6fa25640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffa681014e0 0x7ffa6810e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:24.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.792+0000 7ffa6fa25640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6810ed00 con 0x7ffa680fb4a0 2024-09-21T08:07:24.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.792+0000 7ffa6fa25640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6810ee70 con 0x7ffa681014e0 2024-09-21T08:07:24.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.792+0000 7ffa6d7c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa680fb4a0 0x7ffa6810e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:24.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.792+0000 7ffa6d7c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa680fb4a0 0x7ffa6810e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52730/0 (socket says 172.21.15.107:52730) 2024-09-21T08:07:24.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.792+0000 7ffa6d7c1640 1 -- 172.21.15.107:0/3984674736 learned_addr learned my addr 172.21.15.107:0/3984674736 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:07:24.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.792+0000 7ffa6cfc0640 1 --2- 172.21.15.107:0/3984674736 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffa681014e0 0x7ffa6810e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:24.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.793+0000 7ffa6d7c1640 1 -- 172.21.15.107:0/3984674736 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffa681014e0 msgr2=0x7ffa6810e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:24.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.793+0000 7ffa6d7c1640 1 --2- 172.21.15.107:0/3984674736 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffa681014e0 0x7ffa6810e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:24.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.793+0000 7ffa6d7c1640 1 -- 172.21.15.107:0/3984674736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa58005040 con 0x7ffa680fb4a0 2024-09-21T08:07:24.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.793+0000 7ffa6d7c1640 1 --2- 172.21.15.107:0/3984674736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa680fb4a0 0x7ffa6810e170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400c830 tx=0x7ffa64004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:24.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.793+0000 7ffa5dffb640 1 -- 172.21.15.107:0/3984674736 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa6400a7d0 con 0x7ffa680fb4a0 2024-09-21T08:07:24.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.793+0000 7ffa5dffb640 1 -- 172.21.15.107:0/3984674736 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffa6400add0 con 0x7ffa680fb4a0 2024-09-21T08:07:24.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.793+0000 7ffa6fa25640 1 -- 172.21.15.107:0/3984674736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa681171e0 con 0x7ffa680fb4a0 2024-09-21T08:07:24.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.793+0000 7ffa5dffb640 1 -- 172.21.15.107:0/3984674736 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa640113a0 con 0x7ffa680fb4a0 2024-09-21T08:07:24.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.793+0000 7ffa6fa25640 1 -- 172.21.15.107:0/3984674736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6810c180 con 0x7ffa680fb4a0 2024-09-21T08:07:24.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.794+0000 7ffa6fa25640 1 -- 172.21.15.107:0/3984674736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa680fcbe0 con 0x7ffa680fb4a0 2024-09-21T08:07:24.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.794+0000 7ffa5dffb640 1 -- 172.21.15.107:0/3984674736 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7ffa6400a930 con 0x7ffa680fb4a0 2024-09-21T08:07:24.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.795+0000 7ffa5dffb640 1 --2- 172.21.15.107:0/3984674736 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ffa54072a70 0x7ffa54074f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:24.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.795+0000 7ffa5dffb640 1 -- 172.21.15.107:0/3984674736 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ffa6408e370 con 0x7ffa680fb4a0 2024-09-21T08:07:24.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.795+0000 7ffa6cfc0640 1 --2- 172.21.15.107:0/3984674736 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ffa54072a70 0x7ffa54074f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:24.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.795+0000 7ffa6cfc0640 1 --2- 172.21.15.107:0/3984674736 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ffa54072a70 0x7ffa54074f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009ac0 tx=0x7ffa58009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:24.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.799+0000 7ffa5dffb640 1 -- 172.21.15.107:0/3984674736 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ffa64057470 con 0x7ffa680fb4a0 2024-09-21T08:07:24.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.980+0000 7ffa6fa25640 1 -- 172.21.15.107:0/3984674736 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa68066220 con 0x7ffa54072a70 2024-09-21T08:07:24.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.982+0000 7ffa5dffb640 1 -- 172.21.15.107:0/3984674736 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ffa68066220 con 0x7ffa54072a70 2024-09-21T08:07:24.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.984+0000 7ffa6fa25640 1 -- 172.21.15.107:0/3984674736 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ffa54072a70 msgr2=0x7ffa54074f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:24.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.984+0000 7ffa6fa25640 1 --2- 172.21.15.107:0/3984674736 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ffa54072a70 0x7ffa54074f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009ac0 tx=0x7ffa58009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:24.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.984+0000 7ffa6fa25640 1 -- 172.21.15.107:0/3984674736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa680fb4a0 msgr2=0x7ffa6810e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:24.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.984+0000 7ffa6fa25640 1 --2- 172.21.15.107:0/3984674736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa680fb4a0 0x7ffa6810e170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400c830 tx=0x7ffa64004430 comp rx=0 tx=0).stop 2024-09-21T08:07:24.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.984+0000 7ffa6fa25640 1 -- 172.21.15.107:0/3984674736 shutdown_connections 2024-09-21T08:07:24.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.984+0000 7ffa6fa25640 1 --2- 172.21.15.107:0/3984674736 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ffa54072a70 0x7ffa54074f20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:24.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.984+0000 7ffa6fa25640 1 --2- 172.21.15.107:0/3984674736 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffa681014e0 0x7ffa6810e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:24.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.984+0000 7ffa6fa25640 1 --2- 172.21.15.107:0/3984674736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa680fb4a0 0x7ffa6810e170 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:24.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.984+0000 7ffa6fa25640 1 -- 172.21.15.107:0/3984674736 >> 172.21.15.107:0/3984674736 conn(0x7ffa680f7060 msgr2=0x7ffa680f8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:24.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.984+0000 7ffa6fa25640 1 -- 172.21.15.107:0/3984674736 shutdown_connections 2024-09-21T08:07:24.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:24.984+0000 7ffa6fa25640 1 -- 172.21.15.107:0/3984674736 wait complete. 2024-09-21T08:07:25.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.062+0000 7f051998d640 1 -- 172.21.15.107:0/1477956492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05140fe450 msgr2=0x7f05140fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:25.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.062+0000 7f051998d640 1 --2- 172.21.15.107:0/1477956492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05140fe450 0x7f05140fe820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f05040048d0 tx=0x7f0504009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.062+0000 7f051998d640 1 -- 172.21.15.107:0/1477956492 shutdown_connections 2024-09-21T08:07:25.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.062+0000 7f051998d640 1 --2- 172.21.15.107:0/1477956492 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0514064fe0 0x7f0514065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.062+0000 7f051998d640 1 --2- 172.21.15.107:0/1477956492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05140fe450 0x7f05140fe820 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.062+0000 7f051998d640 1 -- 172.21.15.107:0/1477956492 >> 172.21.15.107:0/1477956492 conn(0x7f05140723b0 msgr2=0x7f05140727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:25.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.062+0000 7f051998d640 1 -- 172.21.15.107:0/1477956492 shutdown_connections 2024-09-21T08:07:25.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.062+0000 7f051998d640 1 -- 172.21.15.107:0/1477956492 wait complete. 2024-09-21T08:07:25.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.063+0000 7f051998d640 1 Processor -- start 2024-09-21T08:07:25.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.063+0000 7f051998d640 1 -- start start 2024-09-21T08:07:25.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.063+0000 7f051998d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0514064fe0 0x7f05141131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:25.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.063+0000 7f051998d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f05140fe450 0x7f0514113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:25.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.063+0000 7f051998d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0514113d10 con 0x7f0514064fe0 2024-09-21T08:07:25.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.063+0000 7f051998d640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051410d150 con 0x7f05140fe450 2024-09-21T08:07:25.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.063+0000 7f0512ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0514064fe0 0x7f05141131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:25.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.063+0000 7f0512ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0514064fe0 0x7f05141131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52740/0 (socket says 172.21.15.107:52740) 2024-09-21T08:07:25.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.064+0000 7f0512ffd640 1 -- 172.21.15.107:0/3853163590 learned_addr learned my addr 172.21.15.107:0/3853163590 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:07:25.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.064+0000 7f050a7fc640 1 --2- 172.21.15.107:0/3853163590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f05140fe450 0x7f0514113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:25.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.064+0000 7f0512ffd640 1 -- 172.21.15.107:0/3853163590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f05140fe450 msgr2=0x7f0514113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:25.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.064+0000 7f0512ffd640 1 --2- 172.21.15.107:0/3853163590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f05140fe450 0x7f0514113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.064+0000 7f0512ffd640 1 -- 172.21.15.107:0/3853163590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0504005040 con 0x7f0514064fe0 2024-09-21T08:07:25.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.064+0000 7f0512ffd640 1 --2- 172.21.15.107:0/3853163590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0514064fe0 0x7f05141131d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0504003080 tx=0x7f0504009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:25.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.064+0000 7f050bfff640 1 -- 172.21.15.107:0/3853163590 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0504038070 con 0x7f0514064fe0 2024-09-21T08:07:25.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.064+0000 7f051998d640 1 -- 172.21.15.107:0/3853163590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f051410d3d0 con 0x7f0514064fe0 2024-09-21T08:07:25.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.064+0000 7f050bfff640 1 -- 172.21.15.107:0/3853163590 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f050402ade0 con 0x7f0514064fe0 2024-09-21T08:07:25.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.064+0000 7f050bfff640 1 -- 172.21.15.107:0/3853163590 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f050402c880 con 0x7f0514064fe0 2024-09-21T08:07:25.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.064+0000 7f051998d640 1 -- 172.21.15.107:0/3853163590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f051410d8b0 con 0x7f0514064fe0 2024-09-21T08:07:25.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.065+0000 7f051998d640 1 -- 172.21.15.107:0/3853163590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05140fdce0 con 0x7f0514064fe0 2024-09-21T08:07:25.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.066+0000 7f050bfff640 1 -- 172.21.15.107:0/3853163590 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f0504030020 con 0x7f0514064fe0 2024-09-21T08:07:25.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.067+0000 7f050bfff640 1 --2- 172.21.15.107:0/3853163590 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f050006e660 0x7f0500070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:25.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.067+0000 7f050a7fc640 1 --2- 172.21.15.107:0/3853163590 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f050006e660 0x7f0500070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:25.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.067+0000 7f050bfff640 1 -- 172.21.15.107:0/3853163590 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f05040ae2f0 con 0x7f0514064fe0 2024-09-21T08:07:25.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.067+0000 7f050a7fc640 1 --2- 172.21.15.107:0/3853163590 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f050006e660 0x7f0500070b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f051410ea90 tx=0x7f04fc009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:25.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.071+0000 7f050bfff640 1 -- 172.21.15.107:0/3853163590 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0504077370 con 0x7f0514064fe0 2024-09-21T08:07:25.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.247+0000 7f051998d640 1 -- 172.21.15.107:0/3853163590 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f051404b780 con 0x7f050006e660 2024-09-21T08:07:25.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.256+0000 7f050bfff640 1 -- 172.21.15.107:0/3853163590 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f051404b780 con 0x7f050006e660 2024-09-21T08:07:25.258 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:07:25.258 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (4m) 6s ago 12m 26.2M - 0.25.0 c8568f914cd2 2b499aa3b7de 2024-09-21T08:07:25.258 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (36s) 6s ago 12m 6899k - 19.1.1-367-g9e2ac70b cc9251b744a3 69be0e9aa842 2024-09-21T08:07:25.258 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (31s) 28s ago 11m 6891k - 19.1.1-367-g9e2ac70b cc9251b744a3 926ed03c78b9 2024-09-21T08:07:25.258 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (2m) 6s ago 12m 82.4M - 9.4.12 2bacad6d85d8 63177dcfe25c 2024-09-21T08:07:25.258 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (7m) 6s ago 7m 155M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 3bc779f88228 2024-09-21T08:07:25.258 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (7m) 6s ago 7m 13.8M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be ea8f140aade7 2024-09-21T08:07:25.258 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (7m) 28s ago 7m 16.7M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 329346c3afec 2024-09-21T08:07:25.258 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (7m) 28s ago 7m 18.1M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be baf87f32bfbc 2024-09-21T08:07:25.259 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:8443,9283,8765 running (3m) 6s ago 13m 496M - 19.1.1-367-g9e2ac70b cc9251b744a3 49c237734f07 2024-09-21T08:07:25.259 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283,8765 running (2m) 28s ago 11m 439M - 19.1.1-367-g9e2ac70b cc9251b744a3 ed117096bdd8 2024-09-21T08:07:25.259 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (92s) 6s ago 13m 42.0M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 445b3e6a800f 2024-09-21T08:07:25.259 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (70s) 28s ago 11m 33.1M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 12706f823621 2024-09-21T08:07:25.259 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 running (4m) 6s ago 12m 16.9M - 1.5.0 0da6a335fe13 6de7c307ba0f 2024-09-21T08:07:25.259 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (4m) 28s ago 11m 16.6M - 1.5.0 0da6a335fe13 cb6d4577b24c 2024-09-21T08:07:25.259 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (12s) 6s ago 10m 14.4M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 d0a742b31d8a 2024-09-21T08:07:25.259 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (10m) 6s ago 10m 260M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 29d8ce3f3a52 2024-09-21T08:07:25.259 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (10m) 6s ago 10m 208M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be c9e1c4756c02 2024-09-21T08:07:25.259 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (9m) 28s ago 9m 280M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7d58f70b105c 2024-09-21T08:07:25.259 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (9m) 28s ago 9m 252M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 2f916ef76d22 2024-09-21T08:07:25.259 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (8m) 28s ago 8m 235M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 0f25d9454304 2024-09-21T08:07:25.259 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (2m) 6s ago 12m 62.6M - 2.43.0 a07b618ecd1d 9ed2abf5e8d8 2024-09-21T08:07:25.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.258+0000 7f051998d640 1 -- 172.21.15.107:0/3853163590 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f050006e660 msgr2=0x7f0500070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:25.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.258+0000 7f051998d640 1 --2- 172.21.15.107:0/3853163590 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f050006e660 0x7f0500070b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f051410ea90 tx=0x7f04fc009040 comp rx=0 tx=0).stop 2024-09-21T08:07:25.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.258+0000 7f051998d640 1 -- 172.21.15.107:0/3853163590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0514064fe0 msgr2=0x7f05141131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:25.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.258+0000 7f051998d640 1 --2- 172.21.15.107:0/3853163590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0514064fe0 0x7f05141131d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0504003080 tx=0x7f0504009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.258+0000 7f051998d640 1 -- 172.21.15.107:0/3853163590 shutdown_connections 2024-09-21T08:07:25.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.258+0000 7f051998d640 1 --2- 172.21.15.107:0/3853163590 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f050006e660 0x7f0500070b10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.258+0000 7f051998d640 1 --2- 172.21.15.107:0/3853163590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f05140fe450 0x7f0514113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.258+0000 7f051998d640 1 --2- 172.21.15.107:0/3853163590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0514064fe0 0x7f05141131d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.258+0000 7f051998d640 1 -- 172.21.15.107:0/3853163590 >> 172.21.15.107:0/3853163590 conn(0x7f05140723b0 msgr2=0x7f05140fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:25.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.258+0000 7f051998d640 1 -- 172.21.15.107:0/3853163590 shutdown_connections 2024-09-21T08:07:25.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.258+0000 7f051998d640 1 -- 172.21.15.107:0/3853163590 wait complete. 2024-09-21T08:07:25.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.336+0000 7f733871e640 1 -- 172.21.15.107:0/735383766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7330102550 msgr2=0x7f7330102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:25.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.336+0000 7f733871e640 1 --2- 172.21.15.107:0/735383766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7330102550 0x7f7330102920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f732c0048d0 tx=0x7f732c009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.336+0000 7f733871e640 1 -- 172.21.15.107:0/735383766 shutdown_connections 2024-09-21T08:07:25.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.336+0000 7f733871e640 1 --2- 172.21.15.107:0/735383766 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7330102ef0 0x7f73300fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.336+0000 7f733871e640 1 --2- 172.21.15.107:0/735383766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7330102550 0x7f7330102920 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.336+0000 7f733871e640 1 -- 172.21.15.107:0/735383766 >> 172.21.15.107:0/735383766 conn(0x7f73300f80f0 msgr2=0x7f73300fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:25.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.336+0000 7f733871e640 1 -- 172.21.15.107:0/735383766 shutdown_connections 2024-09-21T08:07:25.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.336+0000 7f733871e640 1 -- 172.21.15.107:0/735383766 wait complete. 2024-09-21T08:07:25.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.337+0000 7f733871e640 1 Processor -- start 2024-09-21T08:07:25.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.337+0000 7f733871e640 1 -- start start 2024-09-21T08:07:25.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.337+0000 7f733871e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7330102550 0x7f73301135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:25.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.337+0000 7f733871e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7330102ef0 0x7f7330113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:25.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.337+0000 7f733871e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73301141d0 con 0x7f7330102550 2024-09-21T08:07:25.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.337+0000 7f733871e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733010d550 con 0x7f7330102ef0 2024-09-21T08:07:25.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.337+0000 7f73364ba640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7330102550 0x7f73301135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:25.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.337+0000 7f73364ba640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7330102550 0x7f73301135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52760/0 (socket says 172.21.15.107:52760) 2024-09-21T08:07:25.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.337+0000 7f73364ba640 1 -- 172.21.15.107:0/1909915489 learned_addr learned my addr 172.21.15.107:0/1909915489 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:07:25.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.337+0000 7f73364ba640 1 -- 172.21.15.107:0/1909915489 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7330102ef0 msgr2=0x7f7330113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:25.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.337+0000 7f73364ba640 1 --2- 172.21.15.107:0/1909915489 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7330102ef0 0x7f7330113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.337+0000 7f73364ba640 1 -- 172.21.15.107:0/1909915489 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c005040 con 0x7f7330102550 2024-09-21T08:07:25.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.337+0000 7f73364ba640 1 --2- 172.21.15.107:0/1909915489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7330102550 0x7f73301135b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f732c000c00 tx=0x7f732c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:25.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.337+0000 7f7326ffd640 1 -- 172.21.15.107:0/1909915489 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f732c038070 con 0x7f7330102550 2024-09-21T08:07:25.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.337+0000 7f7326ffd640 1 -- 172.21.15.107:0/1909915489 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f732c03daf0 con 0x7f7330102550 2024-09-21T08:07:25.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.337+0000 7f733871e640 1 -- 172.21.15.107:0/1909915489 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733010d780 con 0x7f7330102550 2024-09-21T08:07:25.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.338+0000 7f733871e640 1 -- 172.21.15.107:0/1909915489 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733010dca0 con 0x7f7330102550 2024-09-21T08:07:25.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.338+0000 7f7326ffd640 1 -- 172.21.15.107:0/1909915489 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f732c033b20 con 0x7f7330102550 2024-09-21T08:07:25.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.338+0000 7f733871e640 1 -- 172.21.15.107:0/1909915489 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73300fdcd0 con 0x7f7330102550 2024-09-21T08:07:25.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.339+0000 7f7326ffd640 1 -- 172.21.15.107:0/1909915489 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f732c030020 con 0x7f7330102550 2024-09-21T08:07:25.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.339+0000 7f7326ffd640 1 --2- 172.21.15.107:0/1909915489 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f731c06e660 0x7f731c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:25.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.340+0000 7f7326ffd640 1 -- 172.21.15.107:0/1909915489 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f732c0ae4b0 con 0x7f7330102550 2024-09-21T08:07:25.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.340+0000 7f7335cb9640 1 --2- 172.21.15.107:0/1909915489 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f731c06e660 0x7f731c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:25.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.340+0000 7f7335cb9640 1 --2- 172.21.15.107:0/1909915489 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f731c06e660 0x7f731c070b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f733010e830 tx=0x7f7320006d20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:25.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.344+0000 7f7326ffd640 1 -- 172.21.15.107:0/1909915489 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f732c077530 con 0x7f7330102550 2024-09-21T08:07:25.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:25 smithi107 ceph-mon[97757]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:07:25.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.577+0000 7f733871e640 1 -- 172.21.15.107:0/1909915489 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f733004b720 con 0x7f7330102550 2024-09-21T08:07:25.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.577+0000 7f7326ffd640 1 -- 172.21.15.107:0/1909915489 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f732c07abf0 con 0x7f7330102550 2024-09-21T08:07:25.579 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:07:25.579 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": { 2024-09-21T08:07:25.579 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:07:25.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:07:25.579 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": { 2024-09-21T08:07:25.579 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:07:25.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:07:25.579 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": { 2024-09-21T08:07:25.579 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 5, 2024-09-21T08:07:25.580 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 1 2024-09-21T08:07:25.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:07:25.580 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-21T08:07:25.580 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 4 2024-09-21T08:07:25.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:07:25.580 INFO:teuthology.orchestra.run.smithi107.stdout: "overall": { 2024-09-21T08:07:25.580 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 9, 2024-09-21T08:07:25.580 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 5 2024-09-21T08:07:25.580 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-21T08:07:25.580 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:07:25.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.579+0000 7f733871e640 1 -- 172.21.15.107:0/1909915489 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f731c06e660 msgr2=0x7f731c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:25.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.579+0000 7f733871e640 1 --2- 172.21.15.107:0/1909915489 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f731c06e660 0x7f731c070b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f733010e830 tx=0x7f7320006d20 comp rx=0 tx=0).stop 2024-09-21T08:07:25.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.579+0000 7f733871e640 1 -- 172.21.15.107:0/1909915489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7330102550 msgr2=0x7f73301135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:25.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.579+0000 7f733871e640 1 --2- 172.21.15.107:0/1909915489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7330102550 0x7f73301135b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f732c000c00 tx=0x7f732c009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.580+0000 7f733871e640 1 -- 172.21.15.107:0/1909915489 shutdown_connections 2024-09-21T08:07:25.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.580+0000 7f733871e640 1 --2- 172.21.15.107:0/1909915489 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f731c06e660 0x7f731c070b10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.580+0000 7f733871e640 1 --2- 172.21.15.107:0/1909915489 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7330102ef0 0x7f7330113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.580+0000 7f733871e640 1 --2- 172.21.15.107:0/1909915489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7330102550 0x7f73301135b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.580+0000 7f733871e640 1 -- 172.21.15.107:0/1909915489 >> 172.21.15.107:0/1909915489 conn(0x7f73300f80f0 msgr2=0x7f73300f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:25.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.580+0000 7f733871e640 1 -- 172.21.15.107:0/1909915489 shutdown_connections 2024-09-21T08:07:25.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.580+0000 7f733871e640 1 -- 172.21.15.107:0/1909915489 wait complete. 2024-09-21T08:07:25.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.659+0000 7f4ab1b6d640 1 -- 172.21.15.107:0/3011511678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4aac102ef0 msgr2=0x7f4aac0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:25.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.659+0000 7f4ab1b6d640 1 --2- 172.21.15.107:0/3011511678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4aac102ef0 0x7f4aac0fc5b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4aa00048d0 tx=0x7f4aa0009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.659+0000 7f4ab1b6d640 1 -- 172.21.15.107:0/3011511678 shutdown_connections 2024-09-21T08:07:25.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.659+0000 7f4ab1b6d640 1 --2- 172.21.15.107:0/3011511678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4aac102ef0 0x7f4aac0fc5b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.659+0000 7f4ab1b6d640 1 --2- 172.21.15.107:0/3011511678 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4aac102550 0x7f4aac102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.659+0000 7f4ab1b6d640 1 -- 172.21.15.107:0/3011511678 >> 172.21.15.107:0/3011511678 conn(0x7f4aac0f80f0 msgr2=0x7f4aac0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:25.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.659+0000 7f4ab1b6d640 1 -- 172.21.15.107:0/3011511678 shutdown_connections 2024-09-21T08:07:25.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.659+0000 7f4ab1b6d640 1 -- 172.21.15.107:0/3011511678 wait complete. 2024-09-21T08:07:25.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.660+0000 7f4ab1b6d640 1 Processor -- start 2024-09-21T08:07:25.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.660+0000 7f4ab1b6d640 1 -- start start 2024-09-21T08:07:25.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.660+0000 7f4ab1b6d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4aac102550 0x7f4aac113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:25.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.660+0000 7f4ab1b6d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4aac102ef0 0x7f4aac113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:25.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.660+0000 7f4ab1b6d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac1140b0 con 0x7f4aac102ef0 2024-09-21T08:07:25.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.660+0000 7f4ab1b6d640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac10d4c0 con 0x7f4aac102550 2024-09-21T08:07:25.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.660+0000 7f4aaaffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4aac102ef0 0x7f4aac113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:25.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.660+0000 7f4aaaffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4aac102ef0 0x7f4aac113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52772/0 (socket says 172.21.15.107:52772) 2024-09-21T08:07:25.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.660+0000 7f4aaaffd640 1 -- 172.21.15.107:0/122431562 learned_addr learned my addr 172.21.15.107:0/122431562 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:07:25.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.661+0000 7f4aab7fe640 1 --2- 172.21.15.107:0/122431562 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4aac102550 0x7f4aac113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:25.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.661+0000 7f4aaaffd640 1 -- 172.21.15.107:0/122431562 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4aac102550 msgr2=0x7f4aac113520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:25.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.661+0000 7f4aaaffd640 1 --2- 172.21.15.107:0/122431562 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4aac102550 0x7f4aac113520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.661+0000 7f4aaaffd640 1 -- 172.21.15.107:0/122431562 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa0005040 con 0x7f4aac102ef0 2024-09-21T08:07:25.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.661+0000 7f4aaaffd640 1 --2- 172.21.15.107:0/122431562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4aac102ef0 0x7f4aac113a60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0003080 tx=0x7f4aa0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:25.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.661+0000 7f4a93fff640 1 -- 172.21.15.107:0/122431562 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4aa0038070 con 0x7f4aac102ef0 2024-09-21T08:07:25.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.661+0000 7f4a93fff640 1 -- 172.21.15.107:0/122431562 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4aa0009760 con 0x7f4aac102ef0 2024-09-21T08:07:25.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.661+0000 7f4ab1b6d640 1 -- 172.21.15.107:0/122431562 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aac10d740 con 0x7f4aac102ef0 2024-09-21T08:07:25.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.661+0000 7f4a93fff640 1 -- 172.21.15.107:0/122431562 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4aa003d420 con 0x7f4aac102ef0 2024-09-21T08:07:25.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.661+0000 7f4ab1b6d640 1 -- 172.21.15.107:0/122431562 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aac10dc80 con 0x7f4aac102ef0 2024-09-21T08:07:25.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.662+0000 7f4ab1b6d640 1 -- 172.21.15.107:0/122431562 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aac0fdcd0 con 0x7f4aac102ef0 2024-09-21T08:07:25.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.663+0000 7f4a93fff640 1 -- 172.21.15.107:0/122431562 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f4aa0030020 con 0x7f4aac102ef0 2024-09-21T08:07:25.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.663+0000 7f4a93fff640 1 --2- 172.21.15.107:0/122431562 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4a9406e660 0x7f4a94070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:25.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.663+0000 7f4a93fff640 1 -- 172.21.15.107:0/122431562 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4aa00ae690 con 0x7f4aac102ef0 2024-09-21T08:07:25.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.663+0000 7f4aab7fe640 1 --2- 172.21.15.107:0/122431562 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4a9406e660 0x7f4a94070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:25.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.663+0000 7f4aab7fe640 1 --2- 172.21.15.107:0/122431562 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4a9406e660 0x7f4a94070b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0041d0 tx=0x7f4a9c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:25.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.667+0000 7f4a93fff640 1 -- 172.21.15.107:0/122431562 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4aa0077790 con 0x7f4aac102ef0 2024-09-21T08:07:25.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:25 smithi129 ceph-mon[76722]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:07:25.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.867+0000 7f4ab1b6d640 1 -- 172.21.15.107:0/122431562 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4aac0fbd50 con 0x7f4aac102ef0 2024-09-21T08:07:25.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.868+0000 7f4a93fff640 1 -- 172.21.15.107:0/122431562 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1922 (secure 0 0 0) 0x7f4aa007ae50 con 0x7f4aac102ef0 2024-09-21T08:07:25.869 INFO:teuthology.orchestra.run.smithi107.stdout:e15 2024-09-21T08:07:25.869 INFO:teuthology.orchestra.run.smithi107.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-21T08:07:25.869 INFO:teuthology.orchestra.run.smithi107.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T08:07:25.870 INFO:teuthology.orchestra.run.smithi107.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:07:25.870 INFO:teuthology.orchestra.run.smithi107.stdout:legacy client fscid: 1 2024-09-21T08:07:25.870 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:07:25.870 INFO:teuthology.orchestra.run.smithi107.stdout:Filesystem 'cephfs' (1) 2024-09-21T08:07:25.870 INFO:teuthology.orchestra.run.smithi107.stdout:fs_name cephfs 2024-09-21T08:07:25.870 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 15 2024-09-21T08:07:25.870 INFO:teuthology.orchestra.run.smithi107.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T08:07:25.870 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-09-21T08:00:03.244314+0000 2024-09-21T08:07:25.870 INFO:teuthology.orchestra.run.smithi107.stdout:modified 2024-09-21T08:00:21.458971+0000 2024-09-21T08:07:25.870 INFO:teuthology.orchestra.run.smithi107.stdout:tableserver 0 2024-09-21T08:07:25.870 INFO:teuthology.orchestra.run.smithi107.stdout:root 0 2024-09-21T08:07:25.870 INFO:teuthology.orchestra.run.smithi107.stdout:session_timeout 60 2024-09-21T08:07:25.870 INFO:teuthology.orchestra.run.smithi107.stdout:session_autoclose 300 2024-09-21T08:07:25.871 INFO:teuthology.orchestra.run.smithi107.stdout:max_file_size 1099511627776 2024-09-21T08:07:25.871 INFO:teuthology.orchestra.run.smithi107.stdout:max_xattr_size 65536 2024-09-21T08:07:25.871 INFO:teuthology.orchestra.run.smithi107.stdout:required_client_features {} 2024-09-21T08:07:25.871 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure 0 2024-09-21T08:07:25.871 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure_osd_epoch 44 2024-09-21T08:07:25.871 INFO:teuthology.orchestra.run.smithi107.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:07:25.871 INFO:teuthology.orchestra.run.smithi107.stdout:max_mds 1 2024-09-21T08:07:25.871 INFO:teuthology.orchestra.run.smithi107.stdout:in 0 2024-09-21T08:07:25.871 INFO:teuthology.orchestra.run.smithi107.stdout:up {0=14458} 2024-09-21T08:07:25.871 INFO:teuthology.orchestra.run.smithi107.stdout:failed 2024-09-21T08:07:25.871 INFO:teuthology.orchestra.run.smithi107.stdout:damaged 2024-09-21T08:07:25.871 INFO:teuthology.orchestra.run.smithi107.stdout:stopped 2024-09-21T08:07:25.871 INFO:teuthology.orchestra.run.smithi107.stdout:data_pools [3] 2024-09-21T08:07:25.871 INFO:teuthology.orchestra.run.smithi107.stdout:metadata_pool 2 2024-09-21T08:07:25.872 INFO:teuthology.orchestra.run.smithi107.stdout:inline_data disabled 2024-09-21T08:07:25.872 INFO:teuthology.orchestra.run.smithi107.stdout:balancer 2024-09-21T08:07:25.872 INFO:teuthology.orchestra.run.smithi107.stdout:bal_rank_mask -1 2024-09-21T08:07:25.872 INFO:teuthology.orchestra.run.smithi107.stdout:standby_count_wanted 1 2024-09-21T08:07:25.872 INFO:teuthology.orchestra.run.smithi107.stdout:qdb_cluster leader: 0 members: 2024-09-21T08:07:25.872 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.grqzkt{0:14458} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:07:25.872 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:07:25.872 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:07:25.872 INFO:teuthology.orchestra.run.smithi107.stdout:Standby daemons: 2024-09-21T08:07:25.872 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:07:25.872 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.qusoyf{-1:14468} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6826/2352538667,v1:172.21.15.107:6827/2352538667] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:07:25.872 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.fwmfcy{-1:24239} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:07:25.872 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.belyba{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:07:25.873 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 15 2024-09-21T08:07:25.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.870+0000 7f4ab1b6d640 1 -- 172.21.15.107:0/122431562 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4a9406e660 msgr2=0x7f4a94070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:25.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.870+0000 7f4ab1b6d640 1 --2- 172.21.15.107:0/122431562 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4a9406e660 0x7f4a94070b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0041d0 tx=0x7f4a9c009040 comp rx=0 tx=0).stop 2024-09-21T08:07:25.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.870+0000 7f4ab1b6d640 1 -- 172.21.15.107:0/122431562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4aac102ef0 msgr2=0x7f4aac113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:25.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.870+0000 7f4ab1b6d640 1 --2- 172.21.15.107:0/122431562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4aac102ef0 0x7f4aac113a60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0003080 tx=0x7f4aa0009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.870+0000 7f4ab1b6d640 1 -- 172.21.15.107:0/122431562 shutdown_connections 2024-09-21T08:07:25.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.870+0000 7f4ab1b6d640 1 --2- 172.21.15.107:0/122431562 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4a9406e660 0x7f4a94070b10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.870+0000 7f4ab1b6d640 1 --2- 172.21.15.107:0/122431562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4aac102ef0 0x7f4aac113a60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.870+0000 7f4ab1b6d640 1 --2- 172.21.15.107:0/122431562 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4aac102550 0x7f4aac113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.870+0000 7f4ab1b6d640 1 -- 172.21.15.107:0/122431562 >> 172.21.15.107:0/122431562 conn(0x7f4aac0f80f0 msgr2=0x7f4aac0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:25.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.870+0000 7f4ab1b6d640 1 -- 172.21.15.107:0/122431562 shutdown_connections 2024-09-21T08:07:25.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.870+0000 7f4ab1b6d640 1 -- 172.21.15.107:0/122431562 wait complete. 2024-09-21T08:07:25.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.949+0000 7f2a915cd640 1 -- 172.21.15.107:0/4227867881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a8c102620 msgr2=0x7f2a8c1029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:25.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.949+0000 7f2a915cd640 1 --2- 172.21.15.107:0/4227867881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a8c102620 0x7f2a8c1029f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0048d0 tx=0x7f2a7c009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.949+0000 7f2a915cd640 1 -- 172.21.15.107:0/4227867881 shutdown_connections 2024-09-21T08:07:25.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.949+0000 7f2a915cd640 1 --2- 172.21.15.107:0/4227867881 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2a8c0fac80 0x7f2a8c0fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.949+0000 7f2a915cd640 1 --2- 172.21.15.107:0/4227867881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a8c102620 0x7f2a8c1029f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.949+0000 7f2a915cd640 1 -- 172.21.15.107:0/4227867881 >> 172.21.15.107:0/4227867881 conn(0x7f2a8c070ce0 msgr2=0x7f2a8c0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:25.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.949+0000 7f2a915cd640 1 -- 172.21.15.107:0/4227867881 shutdown_connections 2024-09-21T08:07:25.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.949+0000 7f2a915cd640 1 -- 172.21.15.107:0/4227867881 wait complete. 2024-09-21T08:07:25.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.950+0000 7f2a915cd640 1 Processor -- start 2024-09-21T08:07:25.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.950+0000 7f2a915cd640 1 -- start start 2024-09-21T08:07:25.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.950+0000 7f2a915cd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2a8c0fac80 0x7f2a8c1131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:25.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.950+0000 7f2a915cd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a8c102620 0x7f2a8c113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:25.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.950+0000 7f2a915cd640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c113d30 con 0x7f2a8c102620 2024-09-21T08:07:25.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.950+0000 7f2a915cd640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c10d170 con 0x7f2a8c0fac80 2024-09-21T08:07:25.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.950+0000 7f2a8a7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a8c102620 0x7f2a8c113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:25.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.950+0000 7f2a8a7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a8c102620 0x7f2a8c113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52782/0 (socket says 172.21.15.107:52782) 2024-09-21T08:07:25.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.950+0000 7f2a8a7fc640 1 -- 172.21.15.107:0/1086004163 learned_addr learned my addr 172.21.15.107:0/1086004163 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:07:25.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.950+0000 7f2a8affd640 1 --2- 172.21.15.107:0/1086004163 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2a8c0fac80 0x7f2a8c1131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:25.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.951+0000 7f2a8a7fc640 1 -- 172.21.15.107:0/1086004163 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2a8c0fac80 msgr2=0x7f2a8c1131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:25.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.951+0000 7f2a8a7fc640 1 --2- 172.21.15.107:0/1086004163 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2a8c0fac80 0x7f2a8c1131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:25.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.951+0000 7f2a8a7fc640 1 -- 172.21.15.107:0/1086004163 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c005040 con 0x7f2a8c102620 2024-09-21T08:07:25.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.951+0000 7f2a8a7fc640 1 --2- 172.21.15.107:0/1086004163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a8c102620 0x7f2a8c113730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2a80002a50 tx=0x7f2a80004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:25.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.951+0000 7f2a737fe640 1 -- 172.21.15.107:0/1086004163 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a80007c30 con 0x7f2a8c102620 2024-09-21T08:07:25.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.951+0000 7f2a737fe640 1 -- 172.21.15.107:0/1086004163 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2a8000f040 con 0x7f2a8c102620 2024-09-21T08:07:25.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.951+0000 7f2a915cd640 1 -- 172.21.15.107:0/1086004163 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8c10d450 con 0x7f2a8c102620 2024-09-21T08:07:25.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.951+0000 7f2a737fe640 1 -- 172.21.15.107:0/1086004163 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a8000da90 con 0x7f2a8c102620 2024-09-21T08:07:25.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.951+0000 7f2a915cd640 1 -- 172.21.15.107:0/1086004163 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8c10d9f0 con 0x7f2a8c102620 2024-09-21T08:07:25.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.952+0000 7f2a915cd640 1 -- 172.21.15.107:0/1086004163 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a8c0657b0 con 0x7f2a8c102620 2024-09-21T08:07:25.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.952+0000 7f2a737fe640 1 -- 172.21.15.107:0/1086004163 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f2a8000dc30 con 0x7f2a8c102620 2024-09-21T08:07:25.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.953+0000 7f2a737fe640 1 --2- 172.21.15.107:0/1086004163 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2a7406e660 0x7f2a74070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:25.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.953+0000 7f2a737fe640 1 -- 172.21.15.107:0/1086004163 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f2a8008dba0 con 0x7f2a8c102620 2024-09-21T08:07:25.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.953+0000 7f2a8affd640 1 --2- 172.21.15.107:0/1086004163 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2a7406e660 0x7f2a74070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:25.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.953+0000 7f2a8affd640 1 --2- 172.21.15.107:0/1086004163 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2a7406e660 0x7f2a74070b10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c004540 tx=0x7f2a7c009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:25.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:25.957+0000 7f2a737fe640 1 -- 172.21.15.107:0/1086004163 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2a80056b90 con 0x7f2a8c102620 2024-09-21T08:07:26.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.140+0000 7f2a915cd640 1 -- 172.21.15.107:0/1086004163 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a8c1095c0 con 0x7f2a7406e660 2024-09-21T08:07:26.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.141+0000 7f2a737fe640 1 -- 172.21.15.107:0/1086004163 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2a8c1095c0 con 0x7f2a7406e660 2024-09-21T08:07:26.143 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:07:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5", 2024-09-21T08:07:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: "in_progress": true, 2024-09-21T08:07:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T08:07:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: "services_complete": [ 2024-09-21T08:07:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr", 2024-09-21T08:07:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: "mon", 2024-09-21T08:07:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: "crash" 2024-09-21T08:07:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-21T08:07:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: "progress": "7/21 daemons upgraded", 2024-09-21T08:07:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T08:07:26.144 INFO:teuthology.orchestra.run.smithi107.stdout: "is_paused": false 2024-09-21T08:07:26.144 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:07:26.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.143+0000 7f2a915cd640 1 -- 172.21.15.107:0/1086004163 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2a7406e660 msgr2=0x7f2a74070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:26.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.143+0000 7f2a915cd640 1 --2- 172.21.15.107:0/1086004163 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2a7406e660 0x7f2a74070b10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c004540 tx=0x7f2a7c009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.143+0000 7f2a915cd640 1 -- 172.21.15.107:0/1086004163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a8c102620 msgr2=0x7f2a8c113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:26.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.143+0000 7f2a915cd640 1 --2- 172.21.15.107:0/1086004163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a8c102620 0x7f2a8c113730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2a80002a50 tx=0x7f2a80004600 comp rx=0 tx=0).stop 2024-09-21T08:07:26.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.143+0000 7f2a915cd640 1 -- 172.21.15.107:0/1086004163 shutdown_connections 2024-09-21T08:07:26.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.143+0000 7f2a915cd640 1 --2- 172.21.15.107:0/1086004163 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2a7406e660 0x7f2a74070b10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.143+0000 7f2a915cd640 1 --2- 172.21.15.107:0/1086004163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a8c102620 0x7f2a8c113730 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.143+0000 7f2a915cd640 1 --2- 172.21.15.107:0/1086004163 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2a8c0fac80 0x7f2a8c1131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.143+0000 7f2a915cd640 1 -- 172.21.15.107:0/1086004163 >> 172.21.15.107:0/1086004163 conn(0x7f2a8c070ce0 msgr2=0x7f2a8c105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:26.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.143+0000 7f2a915cd640 1 -- 172.21.15.107:0/1086004163 shutdown_connections 2024-09-21T08:07:26.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.143+0000 7f2a915cd640 1 -- 172.21.15.107:0/1086004163 wait complete. 2024-09-21T08:07:26.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.221+0000 7f6ec5825640 1 -- 172.21.15.107:0/188954665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ec01014c0 msgr2=0x7f6ec0101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:26.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.221+0000 7f6ec5825640 1 --2- 172.21.15.107:0/188954665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ec01014c0 0x7f6ec0101890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00048d0 tx=0x7f6eb0009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.221+0000 7f6ec5825640 1 -- 172.21.15.107:0/188954665 shutdown_connections 2024-09-21T08:07:26.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.221+0000 7f6ec5825640 1 --2- 172.21.15.107:0/188954665 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6ec00fb480 0x7f6ec00fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.221+0000 7f6ec5825640 1 --2- 172.21.15.107:0/188954665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ec01014c0 0x7f6ec0101890 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.221+0000 7f6ec5825640 1 -- 172.21.15.107:0/188954665 >> 172.21.15.107:0/188954665 conn(0x7f6ec00f7000 msgr2=0x7f6ec00f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:26.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.221+0000 7f6ec5825640 1 -- 172.21.15.107:0/188954665 shutdown_connections 2024-09-21T08:07:26.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.221+0000 7f6ec5825640 1 -- 172.21.15.107:0/188954665 wait complete. 2024-09-21T08:07:26.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.222+0000 7f6ec5825640 1 Processor -- start 2024-09-21T08:07:26.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.222+0000 7f6ec5825640 1 -- start start 2024-09-21T08:07:26.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.222+0000 7f6ec5825640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ec00fb480 0x7f6ec0115480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:26.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.222+0000 7f6ec5825640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6ec01014c0 0x7f6ec01159c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:26.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.222+0000 7f6ec5825640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec01160a0 con 0x7f6ec00fb480 2024-09-21T08:07:26.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.222+0000 7f6ec5825640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec010f420 con 0x7f6ec01014c0 2024-09-21T08:07:26.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.222+0000 7f6ebeffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ec00fb480 0x7f6ec0115480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:26.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.222+0000 7f6ebeffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ec00fb480 0x7f6ec0115480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52806/0 (socket says 172.21.15.107:52806) 2024-09-21T08:07:26.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.222+0000 7f6ebeffd640 1 -- 172.21.15.107:0/4185671249 learned_addr learned my addr 172.21.15.107:0/4185671249 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:07:26.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.222+0000 7f6ebeffd640 1 -- 172.21.15.107:0/4185671249 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6ec01014c0 msgr2=0x7f6ec01159c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:26.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.222+0000 7f6ebe7fc640 1 --2- 172.21.15.107:0/4185671249 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6ec01014c0 0x7f6ec01159c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:26.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.222+0000 7f6ebeffd640 1 --2- 172.21.15.107:0/4185671249 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6ec01014c0 0x7f6ec01159c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.222+0000 7f6ebeffd640 1 -- 172.21.15.107:0/4185671249 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb0005040 con 0x7f6ec00fb480 2024-09-21T08:07:26.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.222+0000 7f6ebeffd640 1 --2- 172.21.15.107:0/4185671249 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ec00fb480 0x7f6ec0115480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0003080 tx=0x7f6eb0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:26.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.223+0000 7f6eb77fe640 1 -- 172.21.15.107:0/4185671249 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6eb0038070 con 0x7f6ec00fb480 2024-09-21T08:07:26.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.223+0000 7f6ec5825640 1 -- 172.21.15.107:0/4185671249 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec010f650 con 0x7f6ec00fb480 2024-09-21T08:07:26.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.223+0000 7f6eb77fe640 1 -- 172.21.15.107:0/4185671249 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6eb002ade0 con 0x7f6ec00fb480 2024-09-21T08:07:26.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.223+0000 7f6eb77fe640 1 -- 172.21.15.107:0/4185671249 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6eb002c880 con 0x7f6ec00fb480 2024-09-21T08:07:26.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.223+0000 7f6ec5825640 1 -- 172.21.15.107:0/4185671249 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec010fab0 con 0x7f6ec00fb480 2024-09-21T08:07:26.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.224+0000 7f6ec5825640 1 -- 172.21.15.107:0/4185671249 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec00fcbc0 con 0x7f6ec00fb480 2024-09-21T08:07:26.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.224+0000 7f6eb77fe640 1 -- 172.21.15.107:0/4185671249 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f6eb0030020 con 0x7f6ec00fb480 2024-09-21T08:07:26.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.225+0000 7f6eb77fe640 1 --2- 172.21.15.107:0/4185671249 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6eac06e660 0x7f6eac070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:26.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.225+0000 7f6eb77fe640 1 -- 172.21.15.107:0/4185671249 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6eb00ae260 con 0x7f6ec00fb480 2024-09-21T08:07:26.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.225+0000 7f6ebe7fc640 1 --2- 172.21.15.107:0/4185671249 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6eac06e660 0x7f6eac070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:26.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.225+0000 7f6ebe7fc640 1 --2- 172.21.15.107:0/4185671249 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6eac06e660 0x7f6eac070b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0110700 tx=0x7f6ea8008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:26.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.229+0000 7f6eb77fe640 1 -- 172.21.15.107:0/4185671249 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6eb00772e0 con 0x7f6ec00fb480 2024-09-21T08:07:26.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.461+0000 7f6ec5825640 1 -- 172.21.15.107:0/4185671249 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6ec0110af0 con 0x7f6ec00fb480 2024-09-21T08:07:26.463 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:26 smithi107 ceph-mon[97757]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:07:26.463 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:26 smithi107 ceph-mon[97757]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:07:26.463 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:26 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/1909915489' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:26.463 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:26 smithi107 ceph-mon[97757]: pgmap v51: 65 pgs: 7 active+undersized, 2 active+undersized+degraded, 56 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6/219 objects degraded (2.740%) 2024-09-21T08:07:26.463 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:26 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/122431562' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:07:26.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.461+0000 7f6eb77fe640 1 -- 172.21.15.107:0/4185671249 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+291 (secure 0 0 0) 0x7f6eb007a9a0 con 0x7f6ec00fb480 2024-09-21T08:07:26.464 INFO:teuthology.orchestra.run.smithi107.stdout:HEALTH_WARN Degraded data redundancy: 6/219 objects degraded (2.740%), 2 pgs degraded 2024-09-21T08:07:26.464 INFO:teuthology.orchestra.run.smithi107.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 6/219 objects degraded (2.740%), 2 pgs degraded 2024-09-21T08:07:26.464 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-21T08:07:26.464 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-21T08:07:26.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.463+0000 7f6ec5825640 1 -- 172.21.15.107:0/4185671249 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6eac06e660 msgr2=0x7f6eac070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:26.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.463+0000 7f6ec5825640 1 --2- 172.21.15.107:0/4185671249 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6eac06e660 0x7f6eac070b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0110700 tx=0x7f6ea8008040 comp rx=0 tx=0).stop 2024-09-21T08:07:26.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.463+0000 7f6ec5825640 1 -- 172.21.15.107:0/4185671249 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ec00fb480 msgr2=0x7f6ec0115480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:26.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.463+0000 7f6ec5825640 1 --2- 172.21.15.107:0/4185671249 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ec00fb480 0x7f6ec0115480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0003080 tx=0x7f6eb0009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.463+0000 7f6ec5825640 1 -- 172.21.15.107:0/4185671249 shutdown_connections 2024-09-21T08:07:26.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.463+0000 7f6ec5825640 1 --2- 172.21.15.107:0/4185671249 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6eac06e660 0x7f6eac070b10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.463+0000 7f6ec5825640 1 --2- 172.21.15.107:0/4185671249 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6ec01014c0 0x7f6ec01159c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.463+0000 7f6ec5825640 1 --2- 172.21.15.107:0/4185671249 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ec00fb480 0x7f6ec0115480 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.463+0000 7f6ec5825640 1 -- 172.21.15.107:0/4185671249 >> 172.21.15.107:0/4185671249 conn(0x7f6ec00f7000 msgr2=0x7f6ec00659f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:26.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.463+0000 7f6ec5825640 1 -- 172.21.15.107:0/4185671249 shutdown_connections 2024-09-21T08:07:26.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:26.463+0000 7f6ec5825640 1 -- 172.21.15.107:0/4185671249 wait complete. 2024-09-21T08:07:26.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:26 smithi129 ceph-mon[76722]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:07:26.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:26 smithi129 ceph-mon[76722]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:07:26.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:26 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/1909915489' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:26.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:26 smithi129 ceph-mon[76722]: pgmap v51: 65 pgs: 7 active+undersized, 2 active+undersized+degraded, 56 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6/219 objects degraded (2.740%) 2024-09-21T08:07:26.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:26 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/122431562' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:07:27.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:27 smithi129 ceph-mon[76722]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:07:27.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:27 smithi129 ceph-mon[76722]: Health check update: Degraded data redundancy: 6/219 objects degraded (2.740%), 2 pgs degraded (PG_DEGRADED) 2024-09-21T08:07:27.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:27 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/4185671249' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:07:27.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:27 smithi107 ceph-mon[97757]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:07:27.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:27 smithi107 ceph-mon[97757]: Health check update: Degraded data redundancy: 6/219 objects degraded (2.740%), 2 pgs degraded (PG_DEGRADED) 2024-09-21T08:07:27.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:27 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/4185671249' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:07:28.660 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:28 smithi107 ceph-mon[97757]: pgmap v52: 65 pgs: 65 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:07:28.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:28 smithi129 ceph-mon[76722]: pgmap v52: 65 pgs: 65 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:07:29.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:29 smithi129 ceph-mon[76722]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/219 objects degraded (2.740%), 2 pgs degraded) 2024-09-21T08:07:29.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:29 smithi129 ceph-mon[76722]: Cluster is now healthy 2024-09-21T08:07:29.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:29 smithi107 ceph-mon[97757]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/219 objects degraded (2.740%), 2 pgs degraded) 2024-09-21T08:07:29.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:29 smithi107 ceph-mon[97757]: Cluster is now healthy 2024-09-21T08:07:31.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:30 smithi129 ceph-mon[76722]: pgmap v53: 65 pgs: 65 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:07:31.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:30 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:31.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:30 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:07:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:30 smithi107 ceph-mon[97757]: pgmap v53: 65 pgs: 65 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:07:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:30 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:30 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:07:33.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:32 smithi129 ceph-mon[76722]: pgmap v54: 65 pgs: 65 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 330 B/s wr, 0 op/s 2024-09-21T08:07:33.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:32 smithi129 ceph-mon[76722]: mgrmap e39: smithi107.wzulxb(active, since 92s), standbys: smithi129.wvlmvo 2024-09-21T08:07:33.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:32 smithi107 ceph-mon[97757]: pgmap v54: 65 pgs: 65 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 330 B/s wr, 0 op/s 2024-09-21T08:07:33.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:32 smithi107 ceph-mon[97757]: mgrmap e39: smithi107.wzulxb(active, since 92s), standbys: smithi129.wvlmvo 2024-09-21T08:07:34.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:34 smithi107 ceph-mon[97757]: pgmap v55: 65 pgs: 65 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 298 B/s wr, 0 op/s 2024-09-21T08:07:34.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:34 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:35.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:34 smithi129 ceph-mon[76722]: pgmap v55: 65 pgs: 65 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 298 B/s wr, 0 op/s 2024-09-21T08:07:35.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:34 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:37.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:36 smithi129 ceph-mon[76722]: pgmap v56: 65 pgs: 65 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T08:07:37.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:36 smithi107 ceph-mon[97757]: pgmap v56: 65 pgs: 65 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T08:07:37.918 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:37 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T08:07:38.025 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:37 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T08:07:39.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:38 smithi129 ceph-mon[76722]: pgmap v57: 65 pgs: 65 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T08:07:39.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:38 smithi129 ceph-mon[76722]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T08:07:39.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:38 smithi129 ceph-mon[76722]: Upgrade: osd.1 is safe to restart 2024-09-21T08:07:39.028 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:38 smithi107 ceph-mon[97757]: pgmap v57: 65 pgs: 65 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T08:07:39.028 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:38 smithi107 ceph-mon[97757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T08:07:39.028 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:38 smithi107 ceph-mon[97757]: Upgrade: osd.1 is safe to restart 2024-09-21T08:07:40.188 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:39 smithi107 ceph-mon[97757]: Upgrade: Updating osd.1 2024-09-21T08:07:40.189 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:39 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:40.189 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:39 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-21T08:07:40.189 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:39 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:07:40.189 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:39 smithi107 ceph-mon[97757]: Deploying daemon osd.1 on smithi107 2024-09-21T08:07:40.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:39 smithi129 ceph-mon[76722]: Upgrade: Updating osd.1 2024-09-21T08:07:40.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:39 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:39 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-21T08:07:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:39 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:07:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:39 smithi129 ceph-mon[76722]: Deploying daemon osd.1 on smithi107 2024-09-21T08:07:41.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:40 smithi107 ceph-mon[97757]: pgmap v58: 65 pgs: 65 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T08:07:41.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:40 smithi129 ceph-mon[76722]: pgmap v58: 65 pgs: 65 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T08:07:42.027 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:41 smithi107 systemd[1]: Stopping Ceph osd.1 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:07:42.027 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:42 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1[53285]: 2024-09-21T08:07:42.024+0000 7f02a6a3f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:07:42.027 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:42 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1[53285]: 2024-09-21T08:07:42.024+0000 7f02a6a3f640 -1 osd.1 52 *** Got signal Terminated *** 2024-09-21T08:07:42.027 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:42 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1[53285]: 2024-09-21T08:07:42.024+0000 7f02a6a3f640 -1 osd.1 52 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:07:43.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:42 smithi129 ceph-mon[76722]: pgmap v59: 65 pgs: 65 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T08:07:43.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:42 smithi129 ceph-mon[76722]: osd.1 marked itself down and dead 2024-09-21T08:07:43.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:42 smithi107 ceph-mon[97757]: pgmap v59: 65 pgs: 65 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T08:07:43.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:42 smithi107 ceph-mon[97757]: osd.1 marked itself down and dead 2024-09-21T08:07:43.582 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:43 smithi107 podman[114651]: 2024-09-21 08:07:43.434579243 +0000 UTC m=+1.514820865 container died 29d8ce3f3a527a8b850d68c0d501f50b2b48fe3eec52e7f983ce711bc9533e63 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=quincy-fbd1a6a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:07:43.909 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:43 smithi107 podman[114651]: 2024-09-21 08:07:43.799676067 +0000 UTC m=+1.879917688 container cleanup 29d8ce3f3a527a8b850d68c0d501f50b2b48fe3eec52e7f983ce711bc9533e63 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, RELEASE=quincy-fbd1a6a) 2024-09-21T08:07:43.909 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:43 smithi107 bash[114651]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1 2024-09-21T08:07:44.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:43 smithi129 ceph-mon[76722]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T08:07:44.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:43 smithi129 ceph-mon[76722]: osdmap e53: 6 total, 5 up, 6 in 2024-09-21T08:07:44.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:43 smithi107 ceph-mon[97757]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T08:07:44.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:43 smithi107 ceph-mon[97757]: osdmap e53: 6 total, 5 up, 6 in 2024-09-21T08:07:44.304 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:44 smithi107 podman[114669]: 2024-09-21 08:07:44.101508732 +0000 UTC m=+0.662373784 container remove 29d8ce3f3a527a8b850d68c0d501f50b2b48fe3eec52e7f983ce711bc9533e63 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=quincy-fbd1a6a, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T08:07:44.780 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:44 smithi107 podman[114766]: 2024-09-21 08:07:44.468990104 +0000 UTC m=+0.109743264 container create 26ef011d2f4ff4f112fae3bb20ecf6c8aa9cac2eebca080679a24e18647f392f (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T08:07:44.781 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:44 smithi107 podman[114766]: 2024-09-21 08:07:44.375466753 +0000 UTC m=+0.016219911 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:07:44.781 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:44 smithi107 podman[114766]: 2024-09-21 08:07:44.696712275 +0000 UTC m=+0.337465434 container init 26ef011d2f4ff4f112fae3bb20ecf6c8aa9cac2eebca080679a24e18647f392f (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T08:07:44.781 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:44 smithi107 podman[114766]: 2024-09-21 08:07:44.700103922 +0000 UTC m=+0.340857078 container start 26ef011d2f4ff4f112fae3bb20ecf6c8aa9cac2eebca080679a24e18647f392f (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:07:44.781 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:44 smithi107 podman[114766]: 2024-09-21 08:07:44.779856815 +0000 UTC m=+0.420609965 container attach 26ef011d2f4ff4f112fae3bb20ecf6c8aa9cac2eebca080679a24e18647f392f (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-deactivate, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T08:07:45.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:44 smithi107 ceph-mon[97757]: pgmap v61: 65 pgs: 12 stale+active+clean, 53 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:07:45.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:44 smithi107 ceph-mon[97757]: osdmap e54: 6 total, 5 up, 6 in 2024-09-21T08:07:45.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:44 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:45.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:44 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:07:45.055 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:44 smithi107 podman[114766]: 2024-09-21 08:07:44.884516793 +0000 UTC m=+0.525269942 container died 26ef011d2f4ff4f112fae3bb20ecf6c8aa9cac2eebca080679a24e18647f392f (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T08:07:45.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:44 smithi129 ceph-mon[76722]: pgmap v61: 65 pgs: 12 stale+active+clean, 53 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-21T08:07:45.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:44 smithi129 ceph-mon[76722]: osdmap e54: 6 total, 5 up, 6 in 2024-09-21T08:07:45.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:44 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:45.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:44 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:07:45.468 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:45 smithi107 podman[114790]: 2024-09-21 08:07:45.450675546 +0000 UTC m=+0.559703878 container remove 26ef011d2f4ff4f112fae3bb20ecf6c8aa9cac2eebca080679a24e18647f392f (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0) 2024-09-21T08:07:45.804 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:45 smithi107 systemd[1]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.1.service: Deactivated successfully. 2024-09-21T08:07:45.804 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:45 smithi107 systemd[1]: Stopped Ceph osd.1 for 786d4f32-77ee-11ef-baf6-efdc52797490. 2024-09-21T08:07:45.804 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:45 smithi107 systemd[1]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.1.service: Consumed 1min 4.098s CPU time. 2024-09-21T08:07:45.804 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:45 smithi107 systemd[1]: Starting Ceph osd.1 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:07:46.230 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:45 smithi107 ceph-mon[97757]: pgmap v63: 65 pgs: 18 active+undersized, 3 stale+active+clean, 11 active+undersized+degraded, 33 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-21T08:07:46.230 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:45 smithi107 podman[114889]: 2024-09-21 08:07:45.795636527 +0000 UTC m=+0.016084492 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:07:46.230 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:45 smithi107 podman[114889]: 2024-09-21 08:07:45.927169224 +0000 UTC m=+0.147617244 container create a196a953c0fb2ad925585572deeda9258f3160e8a64ac46edb368d587231fd68 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T08:07:46.231 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:46 smithi107 podman[114889]: 2024-09-21 08:07:46.229623314 +0000 UTC m=+0.450071275 container init a196a953c0fb2ad925585572deeda9258f3160e8a64ac46edb368d587231fd68 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-activate, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70) 2024-09-21T08:07:46.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:45 smithi129 ceph-mon[76722]: pgmap v63: 65 pgs: 18 active+undersized, 3 stale+active+clean, 11 active+undersized+degraded, 33 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-21T08:07:46.554 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:46 smithi107 podman[114889]: 2024-09-21 08:07:46.233112344 +0000 UTC m=+0.453560304 container start a196a953c0fb2ad925585572deeda9258f3160e8a64ac46edb368d587231fd68 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-activate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T08:07:46.554 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:46 smithi107 podman[114889]: 2024-09-21 08:07:46.338048602 +0000 UTC m=+0.558496574 container attach a196a953c0fb2ad925585572deeda9258f3160e8a64ac46edb368d587231fd68 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T08:07:46.555 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:46 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-activate[114904]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:07:46.555 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:46 smithi107 bash[114889]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:07:46.555 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:46 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-activate[114904]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:07:46.555 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:46 smithi107 bash[114889]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:07:47.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:46 smithi129 ceph-mon[76722]: Health check failed: Degraded data redundancy: 29/219 objects degraded (13.242%), 11 pgs degraded (PG_DEGRADED) 2024-09-21T08:07:47.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:46 smithi107 ceph-mon[97757]: Health check failed: Degraded data redundancy: 29/219 objects degraded (13.242%), 11 pgs degraded (PG_DEGRADED) 2024-09-21T08:07:47.305 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:47 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-activate[114904]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T08:07:47.305 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:47 smithi107 bash[114889]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T08:07:47.305 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:47 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-activate[114904]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-21T08:07:47.305 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:47 smithi107 bash[114889]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-21T08:07:47.725 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:47 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-activate[114904]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-21T08:07:47.726 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:47 smithi107 bash[114889]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-21T08:07:47.726 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:47 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-activate[114904]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T08:07:47.726 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:47 smithi107 bash[114889]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T08:07:47.726 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:47 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-activate[114904]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-21T08:07:47.726 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:47 smithi107 bash[114889]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-21T08:07:47.727 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:47 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-activate[114904]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T08:07:47.727 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:47 smithi107 bash[114889]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T08:07:47.727 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:47 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-activate[114904]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-21T08:07:47.727 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:47 smithi107 bash[114889]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-21T08:07:47.727 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:47 smithi107 podman[114889]: 2024-09-21 08:07:47.405947717 +0000 UTC m=+1.626395682 container died a196a953c0fb2ad925585572deeda9258f3160e8a64ac46edb368d587231fd68 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-activate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T08:07:48.001 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:47 smithi107 ceph-mon[97757]: pgmap v64: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-21T08:07:48.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:47 smithi129 ceph-mon[76722]: pgmap v64: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-21T08:07:48.304 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:48 smithi107 podman[115055]: 2024-09-21 08:07:48.00050176 +0000 UTC m=+0.588478412 container remove a196a953c0fb2ad925585572deeda9258f3160e8a64ac46edb368d587231fd68 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:07:48.304 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:48 smithi107 podman[115116]: 2024-09-21 08:07:48.111442299 +0000 UTC m=+0.016394147 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:07:48.304 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:48 smithi107 podman[115116]: 2024-09-21 08:07:48.234851246 +0000 UTC m=+0.139803062 container create 4bb3f4c8f75a902bd7edde5c9f0ca6aa802aaa42eb1e5c2a431a1698a9f6dd13 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T08:07:48.661 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:48 smithi107 podman[115116]: 2024-09-21 08:07:48.445340739 +0000 UTC m=+0.350292567 container init 4bb3f4c8f75a902bd7edde5c9f0ca6aa802aaa42eb1e5c2a431a1698a9f6dd13 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T08:07:48.661 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:48 smithi107 podman[115116]: 2024-09-21 08:07:48.448708809 +0000 UTC m=+0.353660626 container start 4bb3f4c8f75a902bd7edde5c9f0ca6aa802aaa42eb1e5c2a431a1698a9f6dd13 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T08:07:48.661 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:48 smithi107 ceph-osd[115135]: -- 172.21.15.107:0/2986830190 <== mon.0 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556c9bf921e0 con 0x556c9bf28000 2024-09-21T08:07:48.661 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:48 smithi107 bash[115116]: 4bb3f4c8f75a902bd7edde5c9f0ca6aa802aaa42eb1e5c2a431a1698a9f6dd13 2024-09-21T08:07:48.661 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:48 smithi107 systemd[1]: Started Ceph osd.1 for 786d4f32-77ee-11ef-baf6-efdc52797490. 2024-09-21T08:07:49.920 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:49 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:49.920 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:49 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:49.920 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:49 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:07:50.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:49 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:50.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:49 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:50.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:49 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:07:50.599 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:50 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1[115131]: 2024-09-21T08:07:50.330+0000 7f5c45666640 -1 Falling back to public interface 2024-09-21T08:07:51.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:50 smithi129 ceph-mon[76722]: pgmap v65: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-21T08:07:51.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:50 smithi107 ceph-mon[97757]: pgmap v65: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-21T08:07:52.948 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:52 smithi107 ceph-mon[97757]: pgmap v66: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-21T08:07:53.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:52 smithi129 ceph-mon[76722]: pgmap v66: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-21T08:07:54.372 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:54 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:54.372 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:54 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:54.373 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:54 smithi107 ceph-mon[97757]: Health check update: Degraded data redundancy: 31/219 objects degraded (14.155%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T08:07:54.373 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:54 smithi107 ceph-mon[97757]: pgmap v67: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-21T08:07:54.373 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:54 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:54.373 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:54 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:54.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:54 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:54.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:54 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:54.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:54 smithi129 ceph-mon[76722]: Health check update: Degraded data redundancy: 31/219 objects degraded (14.155%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T08:07:54.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:54 smithi129 ceph-mon[76722]: pgmap v67: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-21T08:07:54.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:54 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:54.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:54 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:56.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.549+0000 7f5b9707a640 1 -- 172.21.15.107:0/3106657639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b900fcf80 msgr2=0x7f5b900fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:56.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.549+0000 7f5b9707a640 1 --2- 172.21.15.107:0/3106657639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b900fcf80 0x7f5b900fd3d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0048d0 tx=0x7f5b7c009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:56.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.549+0000 7f5b9707a640 1 -- 172.21.15.107:0/3106657639 shutdown_connections 2024-09-21T08:07:56.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.549+0000 7f5b9707a640 1 --2- 172.21.15.107:0/3106657639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b900fcf80 0x7f5b900fd3d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:56.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.549+0000 7f5b9707a640 1 --2- 172.21.15.107:0/3106657639 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5b900fb810 0x7f5b900fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:56.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.549+0000 7f5b9707a640 1 -- 172.21.15.107:0/3106657639 >> 172.21.15.107:0/3106657639 conn(0x7f5b900723b0 msgr2=0x7f5b900727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:56.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.549+0000 7f5b9707a640 1 -- 172.21.15.107:0/3106657639 shutdown_connections 2024-09-21T08:07:56.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.549+0000 7f5b9707a640 1 -- 172.21.15.107:0/3106657639 wait complete. 2024-09-21T08:07:56.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.550+0000 7f5b9707a640 1 Processor -- start 2024-09-21T08:07:56.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.550+0000 7f5b9707a640 1 -- start start 2024-09-21T08:07:56.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.550+0000 7f5b9707a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b900fb810 0x7f5b90113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:56.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.550+0000 7f5b9707a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5b900fcf80 0x7f5b901136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:56.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.550+0000 7f5b9707a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b90113cb0 con 0x7f5b900fb810 2024-09-21T08:07:56.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.550+0000 7f5b9707a640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9010d0f0 con 0x7f5b900fcf80 2024-09-21T08:07:56.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.550+0000 7f5b94e16640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b900fb810 0x7f5b90113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:56.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.551+0000 7f5b94e16640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b900fb810 0x7f5b90113170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48790/0 (socket says 172.21.15.107:48790) 2024-09-21T08:07:56.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.551+0000 7f5b94e16640 1 -- 172.21.15.107:0/4149317212 learned_addr learned my addr 172.21.15.107:0/4149317212 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:07:56.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.551+0000 7f5b8ffff640 1 --2- 172.21.15.107:0/4149317212 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5b900fcf80 0x7f5b901136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:56.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.551+0000 7f5b94e16640 1 -- 172.21.15.107:0/4149317212 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5b900fcf80 msgr2=0x7f5b901136b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:56.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.551+0000 7f5b94e16640 1 --2- 172.21.15.107:0/4149317212 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5b900fcf80 0x7f5b901136b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:56.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.551+0000 7f5b94e16640 1 -- 172.21.15.107:0/4149317212 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c005040 con 0x7f5b900fb810 2024-09-21T08:07:56.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.551+0000 7f5b94e16640 1 --2- 172.21.15.107:0/4149317212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b900fb810 0x7f5b90113170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5b84002a50 tx=0x7f5b84004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:56.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.551+0000 7f5b8d7fa640 1 -- 172.21.15.107:0/4149317212 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b84007c30 con 0x7f5b900fb810 2024-09-21T08:07:56.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.551+0000 7f5b9707a640 1 -- 172.21.15.107:0/4149317212 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b9010d3d0 con 0x7f5b900fb810 2024-09-21T08:07:56.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.552+0000 7f5b8d7fa640 1 -- 172.21.15.107:0/4149317212 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5b8400f040 con 0x7f5b900fb810 2024-09-21T08:07:56.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.552+0000 7f5b9707a640 1 -- 172.21.15.107:0/4149317212 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b9010d940 con 0x7f5b900fb810 2024-09-21T08:07:56.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.552+0000 7f5b8d7fa640 1 -- 172.21.15.107:0/4149317212 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b8400dad0 con 0x7f5b900fb810 2024-09-21T08:07:56.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.553+0000 7f5b9707a640 1 -- 172.21.15.107:0/4149317212 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b900fcbc0 con 0x7f5b900fb810 2024-09-21T08:07:56.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.553+0000 7f5b8d7fa640 1 -- 172.21.15.107:0/4149317212 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5b8400dc90 con 0x7f5b900fb810 2024-09-21T08:07:56.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.554+0000 7f5b8d7fa640 1 --2- 172.21.15.107:0/4149317212 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f5b8006e530 0x7f5b800709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:56.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.554+0000 7f5b8d7fa640 1 -- 172.21.15.107:0/4149317212 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f5b8408dea0 con 0x7f5b900fb810 2024-09-21T08:07:56.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.554+0000 7f5b8ffff640 1 --2- 172.21.15.107:0/4149317212 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f5b8006e530 0x7f5b800709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:56.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.554+0000 7f5b8ffff640 1 --2- 172.21.15.107:0/4149317212 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f5b8006e530 0x7f5b800709e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009ac0 tx=0x7f5b7c035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:56.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.558+0000 7f5b8d7fa640 1 -- 172.21.15.107:0/4149317212 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5b840570b0 con 0x7f5b900fb810 2024-09-21T08:07:56.670 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:56 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1[115131]: 2024-09-21T08:07:56.470+0000 7f5c45666640 -1 osd.1 52 log_to_monitors true 2024-09-21T08:07:56.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.773+0000 7f5b9707a640 1 -- 172.21.15.107:0/4149317212 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b9004b720 con 0x7f5b8006e530 2024-09-21T08:07:56.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.775+0000 7f5b8d7fa640 1 -- 172.21.15.107:0/4149317212 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5b9004b720 con 0x7f5b8006e530 2024-09-21T08:07:56.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.777+0000 7f5b9707a640 1 -- 172.21.15.107:0/4149317212 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f5b8006e530 msgr2=0x7f5b800709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:56.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.777+0000 7f5b9707a640 1 --2- 172.21.15.107:0/4149317212 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f5b8006e530 0x7f5b800709e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009ac0 tx=0x7f5b7c035040 comp rx=0 tx=0).stop 2024-09-21T08:07:56.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.777+0000 7f5b9707a640 1 -- 172.21.15.107:0/4149317212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b900fb810 msgr2=0x7f5b90113170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:56.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.777+0000 7f5b9707a640 1 --2- 172.21.15.107:0/4149317212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b900fb810 0x7f5b90113170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5b84002a50 tx=0x7f5b84004600 comp rx=0 tx=0).stop 2024-09-21T08:07:56.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.777+0000 7f5b9707a640 1 -- 172.21.15.107:0/4149317212 shutdown_connections 2024-09-21T08:07:56.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.777+0000 7f5b9707a640 1 --2- 172.21.15.107:0/4149317212 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f5b8006e530 0x7f5b800709e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:56.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.777+0000 7f5b9707a640 1 --2- 172.21.15.107:0/4149317212 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5b900fcf80 0x7f5b901136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:56.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.777+0000 7f5b9707a640 1 --2- 172.21.15.107:0/4149317212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b900fb810 0x7f5b90113170 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:56.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.777+0000 7f5b9707a640 1 -- 172.21.15.107:0/4149317212 >> 172.21.15.107:0/4149317212 conn(0x7f5b900723b0 msgr2=0x7f5b90065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:56.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.777+0000 7f5b9707a640 1 -- 172.21.15.107:0/4149317212 shutdown_connections 2024-09-21T08:07:56.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.777+0000 7f5b9707a640 1 -- 172.21.15.107:0/4149317212 wait complete. 2024-09-21T08:07:56.790 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:07:56.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.901+0000 7fd3dc99c640 1 -- 172.21.15.107:0/3012841403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d81014c0 msgr2=0x7fd3d8101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:56.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.901+0000 7fd3dc99c640 1 --2- 172.21.15.107:0/3012841403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d81014c0 0x7fd3d8101890 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd3c80048d0 tx=0x7fd3c8009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:56.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.901+0000 7fd3dc99c640 1 -- 172.21.15.107:0/3012841403 shutdown_connections 2024-09-21T08:07:56.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.901+0000 7fd3dc99c640 1 --2- 172.21.15.107:0/3012841403 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3d80fb480 0x7fd3d80fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:56.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.901+0000 7fd3dc99c640 1 --2- 172.21.15.107:0/3012841403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d81014c0 0x7fd3d8101890 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:56.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.901+0000 7fd3dc99c640 1 -- 172.21.15.107:0/3012841403 >> 172.21.15.107:0/3012841403 conn(0x7fd3d80f7000 msgr2=0x7fd3d80f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:56.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.901+0000 7fd3dc99c640 1 -- 172.21.15.107:0/3012841403 shutdown_connections 2024-09-21T08:07:56.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.901+0000 7fd3dc99c640 1 -- 172.21.15.107:0/3012841403 wait complete. 2024-09-21T08:07:56.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.902+0000 7fd3dc99c640 1 Processor -- start 2024-09-21T08:07:56.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.902+0000 7fd3dc99c640 1 -- start start 2024-09-21T08:07:56.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.903+0000 7fd3dc99c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3d80fb480 0x7fd3d810e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:56.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.903+0000 7fd3dc99c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d810e830 0x7fd3d810ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:56.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.903+0000 7fd3dc99c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d8117360 con 0x7fd3d810e830 2024-09-21T08:07:56.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.903+0000 7fd3dc99c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d81174a0 con 0x7fd3d80fb480 2024-09-21T08:07:56.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.903+0000 7fd3cffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d810e830 0x7fd3d810ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:56.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.903+0000 7fd3d659c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3d80fb480 0x7fd3d810e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:56.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.903+0000 7fd3cffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d810e830 0x7fd3d810ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48812/0 (socket says 172.21.15.107:48812) 2024-09-21T08:07:56.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.903+0000 7fd3cffff640 1 -- 172.21.15.107:0/3800047447 learned_addr learned my addr 172.21.15.107:0/3800047447 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:07:56.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.903+0000 7fd3d659c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3d80fb480 0x7fd3d810e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.107:47628/0 (socket says 172.21.15.107:47628) 2024-09-21T08:07:56.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.903+0000 7fd3cffff640 1 -- 172.21.15.107:0/3800047447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3d80fb480 msgr2=0x7fd3d810e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:56.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.903+0000 7fd3cffff640 1 --2- 172.21.15.107:0/3800047447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3d80fb480 0x7fd3d810e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:56.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.903+0000 7fd3cffff640 1 -- 172.21.15.107:0/3800047447 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c8005040 con 0x7fd3d810e830 2024-09-21T08:07:56.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.904+0000 7fd3cffff640 1 --2- 172.21.15.107:0/3800047447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d810e830 0x7fd3d810ec60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000eb70 tx=0x7fd3c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:56.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.904+0000 7fd3ceffd640 1 -- 172.21.15.107:0/3800047447 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3c0007c30 con 0x7fd3d810e830 2024-09-21T08:07:56.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.904+0000 7fd3ceffd640 1 -- 172.21.15.107:0/3800047447 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd3c000f040 con 0x7fd3d810e830 2024-09-21T08:07:56.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.904+0000 7fd3dc99c640 1 -- 172.21.15.107:0/3800047447 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d81176a0 con 0x7fd3d810e830 2024-09-21T08:07:56.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.904+0000 7fd3ceffd640 1 -- 172.21.15.107:0/3800047447 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3c0009420 con 0x7fd3d810e830 2024-09-21T08:07:56.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.904+0000 7fd3dc99c640 1 -- 172.21.15.107:0/3800047447 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d8117c10 con 0x7fd3d810e830 2024-09-21T08:07:56.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.905+0000 7fd3dc99c640 1 -- 172.21.15.107:0/3800047447 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d80fcbc0 con 0x7fd3d810e830 2024-09-21T08:07:56.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.906+0000 7fd3ceffd640 1 -- 172.21.15.107:0/3800047447 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd3c0009690 con 0x7fd3d810e830 2024-09-21T08:07:56.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.907+0000 7fd3ceffd640 1 --2- 172.21.15.107:0/3800047447 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fd3c406e590 0x7fd3c4070a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:56.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.907+0000 7fd3ceffd640 1 -- 172.21.15.107:0/3800047447 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd3c008e170 con 0x7fd3d810e830 2024-09-21T08:07:56.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.907+0000 7fd3d659c640 1 --2- 172.21.15.107:0/3800047447 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fd3c406e590 0x7fd3c4070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:56.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.908+0000 7fd3d659c640 1 --2- 172.21.15.107:0/3800047447 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fd3c406e590 0x7fd3c4070a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd3c80048a0 tx=0x7fd3c8035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:56.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:56.911+0000 7fd3ceffd640 1 -- 172.21.15.107:0/3800047447 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd3c0057390 con 0x7fd3d810e830 2024-09-21T08:07:57.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:56 smithi129 ceph-mon[76722]: pgmap v68: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-21T08:07:57.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:56 smithi129 ceph-mon[76722]: from='osd.1 [v2:172.21.15.107:6810/1889850097,v1:172.21.15.107:6811/1889850097]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-21T08:07:57.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:56 smithi107 ceph-mon[97757]: pgmap v68: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-21T08:07:57.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:56 smithi107 ceph-mon[97757]: from='osd.1 [v2:172.21.15.107:6810/1889850097,v1:172.21.15.107:6811/1889850097]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-21T08:07:57.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.134+0000 7fd3dc99c640 1 -- 172.21.15.107:0/3800047447 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3d81084d0 con 0x7fd3c406e590 2024-09-21T08:07:57.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.136+0000 7fd3ceffd640 1 -- 172.21.15.107:0/3800047447 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd3d81084d0 con 0x7fd3c406e590 2024-09-21T08:07:57.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.138+0000 7fd3dc99c640 1 -- 172.21.15.107:0/3800047447 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fd3c406e590 msgr2=0x7fd3c4070a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:57.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.138+0000 7fd3dc99c640 1 --2- 172.21.15.107:0/3800047447 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fd3c406e590 0x7fd3c4070a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd3c80048a0 tx=0x7fd3c8035040 comp rx=0 tx=0).stop 2024-09-21T08:07:57.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.138+0000 7fd3dc99c640 1 -- 172.21.15.107:0/3800047447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d810e830 msgr2=0x7fd3d810ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:57.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.138+0000 7fd3dc99c640 1 --2- 172.21.15.107:0/3800047447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d810e830 0x7fd3d810ec60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000eb70 tx=0x7fd3c000b040 comp rx=0 tx=0).stop 2024-09-21T08:07:57.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.138+0000 7fd3dc99c640 1 -- 172.21.15.107:0/3800047447 shutdown_connections 2024-09-21T08:07:57.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.138+0000 7fd3dc99c640 1 --2- 172.21.15.107:0/3800047447 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fd3c406e590 0x7fd3c4070a40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.138+0000 7fd3dc99c640 1 --2- 172.21.15.107:0/3800047447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d810e830 0x7fd3d810ec60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.138+0000 7fd3dc99c640 1 --2- 172.21.15.107:0/3800047447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3d80fb480 0x7fd3d810e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.138+0000 7fd3dc99c640 1 -- 172.21.15.107:0/3800047447 >> 172.21.15.107:0/3800047447 conn(0x7fd3d80f7000 msgr2=0x7fd3d80f73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:57.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.138+0000 7fd3dc99c640 1 -- 172.21.15.107:0/3800047447 shutdown_connections 2024-09-21T08:07:57.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.138+0000 7fd3dc99c640 1 -- 172.21.15.107:0/3800047447 wait complete. 2024-09-21T08:07:57.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.235+0000 7f249ebfe640 1 -- 172.21.15.107:0/3825733751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24980fcf80 msgr2=0x7f24980fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:57.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.235+0000 7f249ebfe640 1 --2- 172.21.15.107:0/3825733751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24980fcf80 0x7f24980fd3d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f24840048d0 tx=0x7f2484009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.235+0000 7f249ebfe640 1 -- 172.21.15.107:0/3825733751 shutdown_connections 2024-09-21T08:07:57.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.235+0000 7f249ebfe640 1 --2- 172.21.15.107:0/3825733751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24980fcf80 0x7f24980fd3d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.235+0000 7f249ebfe640 1 --2- 172.21.15.107:0/3825733751 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f24980fb810 0x7f24980fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.235+0000 7f249ebfe640 1 -- 172.21.15.107:0/3825733751 >> 172.21.15.107:0/3825733751 conn(0x7f24980723b0 msgr2=0x7f24980727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:57.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.236+0000 7f249ebfe640 1 -- 172.21.15.107:0/3825733751 shutdown_connections 2024-09-21T08:07:57.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.236+0000 7f249ebfe640 1 -- 172.21.15.107:0/3825733751 wait complete. 2024-09-21T08:07:57.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.236+0000 7f249ebfe640 1 Processor -- start 2024-09-21T08:07:57.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.236+0000 7f249ebfe640 1 -- start start 2024-09-21T08:07:57.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.237+0000 7f249ebfe640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f24980fb810 0x7f249810e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:57.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.237+0000 7f249ebfe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24980fcf80 0x7f249810e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:57.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.237+0000 7f249ebfe640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249810ed20 con 0x7f24980fcf80 2024-09-21T08:07:57.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.237+0000 7f249ebfe640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249810ee90 con 0x7f24980fb810 2024-09-21T08:07:57.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.237+0000 7f2497fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24980fcf80 0x7f249810e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:57.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.237+0000 7f2497fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24980fcf80 0x7f249810e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48836/0 (socket says 172.21.15.107:48836) 2024-09-21T08:07:57.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.237+0000 7f2497fff640 1 -- 172.21.15.107:0/3246835179 learned_addr learned my addr 172.21.15.107:0/3246835179 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:07:57.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.237+0000 7f249c99a640 1 --2- 172.21.15.107:0/3246835179 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f24980fb810 0x7f249810e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:57.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.237+0000 7f2497fff640 1 -- 172.21.15.107:0/3246835179 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f24980fb810 msgr2=0x7f249810e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:57.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.237+0000 7f2497fff640 1 --2- 172.21.15.107:0/3246835179 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f24980fb810 0x7f249810e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.237+0000 7f2497fff640 1 -- 172.21.15.107:0/3246835179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2484005040 con 0x7f24980fcf80 2024-09-21T08:07:57.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.238+0000 7f2497fff640 1 --2- 172.21.15.107:0/3246835179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24980fcf80 0x7f249810e6d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f24840043d0 tx=0x7f2484009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:57.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.238+0000 7f24957fa640 1 -- 172.21.15.107:0/3246835179 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2484038070 con 0x7f24980fcf80 2024-09-21T08:07:57.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.238+0000 7f24957fa640 1 -- 172.21.15.107:0/3246835179 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f24840096e0 con 0x7f24980fcf80 2024-09-21T08:07:57.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.238+0000 7f24957fa640 1 -- 172.21.15.107:0/3246835179 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f248403d420 con 0x7f24980fcf80 2024-09-21T08:07:57.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.238+0000 7f249ebfe640 1 -- 172.21.15.107:0/3246835179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2498117200 con 0x7f24980fcf80 2024-09-21T08:07:57.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.239+0000 7f249ebfe640 1 -- 172.21.15.107:0/3246835179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2498117660 con 0x7f24980fcf80 2024-09-21T08:07:57.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.240+0000 7f249ebfe640 1 -- 172.21.15.107:0/3246835179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24980fcbc0 con 0x7f24980fcf80 2024-09-21T08:07:57.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.241+0000 7f24957fa640 1 -- 172.21.15.107:0/3246835179 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2484030020 con 0x7f24980fcf80 2024-09-21T08:07:57.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.241+0000 7f24957fa640 1 --2- 172.21.15.107:0/3246835179 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f248806e530 0x7f24880709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:57.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.241+0000 7f24957fa640 1 -- 172.21.15.107:0/3246835179 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f24840ae470 con 0x7f24980fcf80 2024-09-21T08:07:57.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.241+0000 7f249c99a640 1 --2- 172.21.15.107:0/3246835179 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f248806e530 0x7f24880709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:57.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.242+0000 7f249c99a640 1 --2- 172.21.15.107:0/3246835179 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f248806e530 0x7f24880709e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f248c004ed0 tx=0x7f248c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:57.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.249+0000 7f24957fa640 1 -- 172.21.15.107:0/3246835179 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2484077680 con 0x7f24980fcf80 2024-09-21T08:07:57.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.553+0000 7f249ebfe640 1 -- 172.21.15.107:0/3246835179 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f24980657d0 con 0x7f248806e530 2024-09-21T08:07:57.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.565+0000 7f24957fa640 1 -- 172.21.15.107:0/3246835179 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f24980657d0 con 0x7f248806e530 2024-09-21T08:07:57.567 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:07:57.567 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (4m) 4s ago 13m 26.2M - 0.25.0 c8568f914cd2 2b499aa3b7de 2024-09-21T08:07:57.567 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (68s) 4s ago 13m 6899k - 19.1.1-367-g9e2ac70b cc9251b744a3 69be0e9aa842 2024-09-21T08:07:57.567 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (63s) 60s ago 12m 6891k - 19.1.1-367-g9e2ac70b cc9251b744a3 926ed03c78b9 2024-09-21T08:07:57.567 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (3m) 4s ago 12m 82.4M - 9.4.12 2bacad6d85d8 63177dcfe25c 2024-09-21T08:07:57.567 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (7m) 4s ago 7m 155M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 3bc779f88228 2024-09-21T08:07:57.567 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (7m) 4s ago 7m 13.9M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be ea8f140aade7 2024-09-21T08:07:57.567 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (7m) 60s ago 7m 16.7M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 329346c3afec 2024-09-21T08:07:57.567 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (7m) 60s ago 7m 18.1M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be baf87f32bfbc 2024-09-21T08:07:57.567 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:8443,9283,8765 running (4m) 4s ago 14m 498M - 19.1.1-367-g9e2ac70b cc9251b744a3 49c237734f07 2024-09-21T08:07:57.567 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283,8765 running (3m) 60s ago 12m 439M - 19.1.1-367-g9e2ac70b cc9251b744a3 ed117096bdd8 2024-09-21T08:07:57.568 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (2m) 4s ago 14m 44.5M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 445b3e6a800f 2024-09-21T08:07:57.568 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (103s) 60s ago 12m 33.1M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 12706f823621 2024-09-21T08:07:57.568 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 running (5m) 4s ago 13m 16.9M - 1.5.0 0da6a335fe13 6de7c307ba0f 2024-09-21T08:07:57.568 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (4m) 60s ago 12m 16.6M - 1.5.0 0da6a335fe13 cb6d4577b24c 2024-09-21T08:07:57.568 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (44s) 4s ago 11m 98.7M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 d0a742b31d8a 2024-09-21T08:07:57.568 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (9s) 4s ago 11m 12.1M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 4bb3f4c8f75a 2024-09-21T08:07:57.568 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (10m) 4s ago 10m 208M 1557M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be c9e1c4756c02 2024-09-21T08:07:57.568 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (10m) 60s ago 10m 280M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7d58f70b105c 2024-09-21T08:07:57.568 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (9m) 60s ago 9m 252M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 2f916ef76d22 2024-09-21T08:07:57.568 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (9m) 60s ago 9m 235M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 0f25d9454304 2024-09-21T08:07:57.568 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (3m) 4s ago 12m 62.7M - 2.43.0 a07b618ecd1d 9ed2abf5e8d8 2024-09-21T08:07:57.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.567+0000 7f249ebfe640 1 -- 172.21.15.107:0/3246835179 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f248806e530 msgr2=0x7f24880709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:57.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.567+0000 7f249ebfe640 1 --2- 172.21.15.107:0/3246835179 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f248806e530 0x7f24880709e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f248c004ed0 tx=0x7f248c00b040 comp rx=0 tx=0).stop 2024-09-21T08:07:57.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.567+0000 7f249ebfe640 1 -- 172.21.15.107:0/3246835179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24980fcf80 msgr2=0x7f249810e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:57.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.567+0000 7f249ebfe640 1 --2- 172.21.15.107:0/3246835179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24980fcf80 0x7f249810e6d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f24840043d0 tx=0x7f2484009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.568+0000 7f249ebfe640 1 -- 172.21.15.107:0/3246835179 shutdown_connections 2024-09-21T08:07:57.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.568+0000 7f249ebfe640 1 --2- 172.21.15.107:0/3246835179 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f248806e530 0x7f24880709e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.568+0000 7f249ebfe640 1 --2- 172.21.15.107:0/3246835179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24980fcf80 0x7f249810e6d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.568+0000 7f249ebfe640 1 --2- 172.21.15.107:0/3246835179 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f24980fb810 0x7f249810e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.568+0000 7f249ebfe640 1 -- 172.21.15.107:0/3246835179 >> 172.21.15.107:0/3246835179 conn(0x7f24980723b0 msgr2=0x7f24980fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:57.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.568+0000 7f249ebfe640 1 -- 172.21.15.107:0/3246835179 shutdown_connections 2024-09-21T08:07:57.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.568+0000 7f249ebfe640 1 -- 172.21.15.107:0/3246835179 wait complete. 2024-09-21T08:07:57.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.654+0000 7fa5d9f60640 1 -- 172.21.15.107:0/1109406635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5d40fb470 msgr2=0x7fa5d40fb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:57.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.654+0000 7fa5d9f60640 1 --2- 172.21.15.107:0/1109406635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5d40fb470 0x7fa5d40fb8e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa5c80048d0 tx=0x7fa5c8009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.654+0000 7fa5d9f60640 1 -- 172.21.15.107:0/1109406635 shutdown_connections 2024-09-21T08:07:57.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.654+0000 7fa5d9f60640 1 --2- 172.21.15.107:0/1109406635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5d40fb470 0x7fa5d40fb8e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.654+0000 7fa5d9f60640 1 --2- 172.21.15.107:0/1109406635 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa5d41014b0 0x7fa5d4101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.654+0000 7fa5d9f60640 1 -- 172.21.15.107:0/1109406635 >> 172.21.15.107:0/1109406635 conn(0x7fa5d40f7030 msgr2=0x7fa5d40f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:57.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.654+0000 7fa5d9f60640 1 -- 172.21.15.107:0/1109406635 shutdown_connections 2024-09-21T08:07:57.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.654+0000 7fa5d9f60640 1 -- 172.21.15.107:0/1109406635 wait complete. 2024-09-21T08:07:57.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.654+0000 7fa5d9f60640 1 Processor -- start 2024-09-21T08:07:57.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.655+0000 7fa5d9f60640 1 -- start start 2024-09-21T08:07:57.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.655+0000 7fa5d9f60640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa5d40fb470 0x7fa5d4113180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:57.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.655+0000 7fa5d9f60640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5d41014b0 0x7fa5d41136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:57.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.655+0000 7fa5d9f60640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d4113cc0 con 0x7fa5d41014b0 2024-09-21T08:07:57.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.655+0000 7fa5d9f60640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d410d100 con 0x7fa5d40fb470 2024-09-21T08:07:57.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.655+0000 7fa5d2ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5d41014b0 0x7fa5d41136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:57.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.655+0000 7fa5d2ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5d41014b0 0x7fa5d41136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48846/0 (socket says 172.21.15.107:48846) 2024-09-21T08:07:57.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.655+0000 7fa5d2ffd640 1 -- 172.21.15.107:0/1181980999 learned_addr learned my addr 172.21.15.107:0/1181980999 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:07:57.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.655+0000 7fa5d37fe640 1 --2- 172.21.15.107:0/1181980999 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa5d40fb470 0x7fa5d4113180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:57.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.655+0000 7fa5d2ffd640 1 -- 172.21.15.107:0/1181980999 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa5d40fb470 msgr2=0x7fa5d4113180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:57.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.655+0000 7fa5d2ffd640 1 --2- 172.21.15.107:0/1181980999 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa5d40fb470 0x7fa5d4113180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.655+0000 7fa5d2ffd640 1 -- 172.21.15.107:0/1181980999 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c8005040 con 0x7fa5d41014b0 2024-09-21T08:07:57.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.656+0000 7fa5d2ffd640 1 --2- 172.21.15.107:0/1181980999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5d41014b0 0x7fa5d41136c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8003080 tx=0x7fa5c8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:57.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.656+0000 7fa5bbfff640 1 -- 172.21.15.107:0/1181980999 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5c8038070 con 0x7fa5d41014b0 2024-09-21T08:07:57.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.656+0000 7fa5d9f60640 1 -- 172.21.15.107:0/1181980999 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d410d380 con 0x7fa5d41014b0 2024-09-21T08:07:57.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.656+0000 7fa5bbfff640 1 -- 172.21.15.107:0/1181980999 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa5c80097e0 con 0x7fa5d41014b0 2024-09-21T08:07:57.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.656+0000 7fa5d9f60640 1 -- 172.21.15.107:0/1181980999 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d410d8c0 con 0x7fa5d41014b0 2024-09-21T08:07:57.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.656+0000 7fa5bbfff640 1 -- 172.21.15.107:0/1181980999 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5c803d420 con 0x7fa5d41014b0 2024-09-21T08:07:57.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.657+0000 7fa5d9f60640 1 -- 172.21.15.107:0/1181980999 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c0005210 con 0x7fa5d41014b0 2024-09-21T08:07:57.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.658+0000 7fa5bbfff640 1 -- 172.21.15.107:0/1181980999 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa5c8030020 con 0x7fa5d41014b0 2024-09-21T08:07:57.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.658+0000 7fa5bbfff640 1 --2- 172.21.15.107:0/1181980999 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fa5bc06e530 0x7fa5bc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:57.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.658+0000 7fa5bbfff640 1 -- 172.21.15.107:0/1181980999 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa5c80ae4a0 con 0x7fa5d41014b0 2024-09-21T08:07:57.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.659+0000 7fa5d37fe640 1 --2- 172.21.15.107:0/1181980999 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fa5bc06e530 0x7fa5bc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:57.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.659+0000 7fa5d37fe640 1 --2- 172.21.15.107:0/1181980999 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fa5bc06e530 0x7fa5bc0709e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40041d0 tx=0x7fa5c4004330 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:57.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.663+0000 7fa5bbfff640 1 -- 172.21.15.107:0/1181980999 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa5c8077630 con 0x7fa5d41014b0 2024-09-21T08:07:57.804 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:07:57 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1[115131]: 2024-09-21T08:07:57.635+0000 7f5c393f8640 -1 osd.1 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T08:07:57.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:57 smithi107 ceph-mon[97757]: from='osd.1 [v2:172.21.15.107:6810/1889850097,v1:172.21.15.107:6811/1889850097]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T08:07:57.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:57 smithi107 ceph-mon[97757]: osdmap e55: 6 total, 5 up, 6 in 2024-09-21T08:07:57.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:57 smithi107 ceph-mon[97757]: from='osd.1 [v2:172.21.15.107:6810/1889850097,v1:172.21.15.107:6811/1889850097]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-21T08:07:57.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:57 smithi107 ceph-mon[97757]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:07:57.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:57 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:57.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:57 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:57.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:57 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:07:57.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:57 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:07:57.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:57 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:57.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:57 smithi107 ceph-mon[97757]: from='osd.1 [v2:172.21.15.107:6810/1889850097,v1:172.21.15.107:6811/1889850097]' entity='osd.1' 2024-09-21T08:07:57.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.904+0000 7fa5d9f60640 1 -- 172.21.15.107:0/1181980999 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa5c0005cd0 con 0x7fa5d41014b0 2024-09-21T08:07:57.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.904+0000 7fa5bbfff640 1 -- 172.21.15.107:0/1181980999 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7fa5c807acf0 con 0x7fa5d41014b0 2024-09-21T08:07:57.906 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:07:57.906 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": { 2024-09-21T08:07:57.906 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:07:57.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:07:57.906 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": { 2024-09-21T08:07:57.906 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:07:57.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:07:57.906 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": { 2024-09-21T08:07:57.906 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 4, 2024-09-21T08:07:57.906 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 1 2024-09-21T08:07:57.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:07:57.906 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-21T08:07:57.906 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 4 2024-09-21T08:07:57.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:07:57.907 INFO:teuthology.orchestra.run.smithi107.stdout: "overall": { 2024-09-21T08:07:57.907 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 8, 2024-09-21T08:07:57.907 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 5 2024-09-21T08:07:57.907 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-21T08:07:57.907 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:07:57.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.906+0000 7fa5d9f60640 1 -- 172.21.15.107:0/1181980999 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fa5bc06e530 msgr2=0x7fa5bc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:57.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.906+0000 7fa5d9f60640 1 --2- 172.21.15.107:0/1181980999 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fa5bc06e530 0x7fa5bc0709e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40041d0 tx=0x7fa5c4004330 comp rx=0 tx=0).stop 2024-09-21T08:07:57.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.906+0000 7fa5d9f60640 1 -- 172.21.15.107:0/1181980999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5d41014b0 msgr2=0x7fa5d41136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:57.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.906+0000 7fa5d9f60640 1 --2- 172.21.15.107:0/1181980999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5d41014b0 0x7fa5d41136c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8003080 tx=0x7fa5c8009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.906+0000 7fa5d9f60640 1 -- 172.21.15.107:0/1181980999 shutdown_connections 2024-09-21T08:07:57.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.906+0000 7fa5d9f60640 1 --2- 172.21.15.107:0/1181980999 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fa5bc06e530 0x7fa5bc0709e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.906+0000 7fa5d9f60640 1 --2- 172.21.15.107:0/1181980999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5d41014b0 0x7fa5d41136c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.906+0000 7fa5d9f60640 1 --2- 172.21.15.107:0/1181980999 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa5d40fb470 0x7fa5d4113180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.906+0000 7fa5d9f60640 1 -- 172.21.15.107:0/1181980999 >> 172.21.15.107:0/1181980999 conn(0x7fa5d40f7030 msgr2=0x7fa5d40f7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:57.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.907+0000 7fa5d9f60640 1 -- 172.21.15.107:0/1181980999 shutdown_connections 2024-09-21T08:07:57.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.907+0000 7fa5d9f60640 1 -- 172.21.15.107:0/1181980999 wait complete. 2024-09-21T08:07:57.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.984+0000 7f612e60a640 1 -- 172.21.15.107:0/1289986607 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61280fcf80 msgr2=0x7f61280fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:57.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.984+0000 7f612e60a640 1 --2- 172.21.15.107:0/1289986607 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61280fcf80 0x7f61280fd3d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f611c0048d0 tx=0x7f611c009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.984+0000 7f612e60a640 1 -- 172.21.15.107:0/1289986607 shutdown_connections 2024-09-21T08:07:57.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.984+0000 7f612e60a640 1 --2- 172.21.15.107:0/1289986607 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61280fcf80 0x7f61280fd3d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.984+0000 7f612e60a640 1 --2- 172.21.15.107:0/1289986607 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f61280fb810 0x7f61280fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.984+0000 7f612e60a640 1 -- 172.21.15.107:0/1289986607 >> 172.21.15.107:0/1289986607 conn(0x7f61280723b0 msgr2=0x7f61280727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:57.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.984+0000 7f612e60a640 1 -- 172.21.15.107:0/1289986607 shutdown_connections 2024-09-21T08:07:57.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.984+0000 7f612e60a640 1 -- 172.21.15.107:0/1289986607 wait complete. 2024-09-21T08:07:57.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.985+0000 7f612e60a640 1 Processor -- start 2024-09-21T08:07:57.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.985+0000 7f612e60a640 1 -- start start 2024-09-21T08:07:57.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.985+0000 7f612e60a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f61280fb810 0x7f6128113150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:57.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.985+0000 7f612e60a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61280fcf80 0x7f6128113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:57.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.985+0000 7f612e60a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6128113c90 con 0x7f61280fcf80 2024-09-21T08:07:57.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.985+0000 7f612e60a640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612810d0d0 con 0x7f61280fb810 2024-09-21T08:07:57.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.985+0000 7f61277fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61280fcf80 0x7f6128113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:57.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.985+0000 7f61277fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61280fcf80 0x7f6128113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48854/0 (socket says 172.21.15.107:48854) 2024-09-21T08:07:57.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.985+0000 7f61277fe640 1 -- 172.21.15.107:0/1165432376 learned_addr learned my addr 172.21.15.107:0/1165432376 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:07:57.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.985+0000 7f6127fff640 1 --2- 172.21.15.107:0/1165432376 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f61280fb810 0x7f6128113150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:57.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.986+0000 7f61277fe640 1 -- 172.21.15.107:0/1165432376 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f61280fb810 msgr2=0x7f6128113150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:57.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.986+0000 7f61277fe640 1 --2- 172.21.15.107:0/1165432376 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f61280fb810 0x7f6128113150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:57.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.986+0000 7f61277fe640 1 -- 172.21.15.107:0/1165432376 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c005040 con 0x7f61280fcf80 2024-09-21T08:07:57.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.986+0000 7f6127fff640 1 --2- 172.21.15.107:0/1165432376 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f61280fb810 0x7f6128113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:07:57.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.986+0000 7f61277fe640 1 --2- 172.21.15.107:0/1165432376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61280fcf80 0x7f6128113690 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f611c003080 tx=0x7f611c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:57.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.986+0000 7f6124ff9640 1 -- 172.21.15.107:0/1165432376 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f611c038070 con 0x7f61280fcf80 2024-09-21T08:07:57.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.986+0000 7f612e60a640 1 -- 172.21.15.107:0/1165432376 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612810d350 con 0x7f61280fcf80 2024-09-21T08:07:57.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.986+0000 7f6124ff9640 1 -- 172.21.15.107:0/1165432376 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f611c0097e0 con 0x7f61280fcf80 2024-09-21T08:07:57.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.986+0000 7f6124ff9640 1 -- 172.21.15.107:0/1165432376 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f611c03d420 con 0x7f61280fcf80 2024-09-21T08:07:57.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.986+0000 7f612e60a640 1 -- 172.21.15.107:0/1165432376 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612810d890 con 0x7f61280fcf80 2024-09-21T08:07:57.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.987+0000 7f612e60a640 1 -- 172.21.15.107:0/1165432376 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61280fcbc0 con 0x7f61280fcf80 2024-09-21T08:07:57.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.987+0000 7f6124ff9640 1 -- 172.21.15.107:0/1165432376 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f611c030020 con 0x7f61280fcf80 2024-09-21T08:07:57.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.988+0000 7f6124ff9640 1 --2- 172.21.15.107:0/1165432376 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f611006e530 0x7f61100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:57.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.988+0000 7f6124ff9640 1 -- 172.21.15.107:0/1165432376 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f611c0ae5a0 con 0x7f61280fcf80 2024-09-21T08:07:57.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.988+0000 7f6127fff640 1 --2- 172.21.15.107:0/1165432376 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f611006e530 0x7f61100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:57.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.988+0000 7f6127fff640 1 --2- 172.21.15.107:0/1165432376 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f611006e530 0x7f61100709e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6118004c60 tx=0x7f6118009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:57.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:57.992+0000 7f6124ff9640 1 -- 172.21.15.107:0/1165432376 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f611c0777b0 con 0x7f61280fcf80 2024-09-21T08:07:58.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:57 smithi129 ceph-mon[76722]: from='osd.1 [v2:172.21.15.107:6810/1889850097,v1:172.21.15.107:6811/1889850097]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T08:07:58.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:57 smithi129 ceph-mon[76722]: osdmap e55: 6 total, 5 up, 6 in 2024-09-21T08:07:58.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:57 smithi129 ceph-mon[76722]: from='osd.1 [v2:172.21.15.107:6810/1889850097,v1:172.21.15.107:6811/1889850097]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-21T08:07:58.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:57 smithi129 ceph-mon[76722]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:07:58.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:57 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:58.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:57 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:58.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:57 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:07:58.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:57 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:07:58.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:57 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:07:58.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:57 smithi129 ceph-mon[76722]: from='osd.1 [v2:172.21.15.107:6810/1889850097,v1:172.21.15.107:6811/1889850097]' entity='osd.1' 2024-09-21T08:07:58.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.191+0000 7f612e60a640 1 -- 172.21.15.107:0/1165432376 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f612810e7c0 con 0x7f61280fcf80 2024-09-21T08:07:58.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.191+0000 7f6124ff9640 1 -- 172.21.15.107:0/1165432376 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1922 (secure 0 0 0) 0x7f611c07ae70 con 0x7f61280fcf80 2024-09-21T08:07:58.193 INFO:teuthology.orchestra.run.smithi107.stdout:e15 2024-09-21T08:07:58.193 INFO:teuthology.orchestra.run.smithi107.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-21T08:07:58.193 INFO:teuthology.orchestra.run.smithi107.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T08:07:58.194 INFO:teuthology.orchestra.run.smithi107.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:07:58.194 INFO:teuthology.orchestra.run.smithi107.stdout:legacy client fscid: 1 2024-09-21T08:07:58.194 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:07:58.194 INFO:teuthology.orchestra.run.smithi107.stdout:Filesystem 'cephfs' (1) 2024-09-21T08:07:58.194 INFO:teuthology.orchestra.run.smithi107.stdout:fs_name cephfs 2024-09-21T08:07:58.194 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 15 2024-09-21T08:07:58.194 INFO:teuthology.orchestra.run.smithi107.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T08:07:58.194 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-09-21T08:00:03.244314+0000 2024-09-21T08:07:58.194 INFO:teuthology.orchestra.run.smithi107.stdout:modified 2024-09-21T08:00:21.458971+0000 2024-09-21T08:07:58.194 INFO:teuthology.orchestra.run.smithi107.stdout:tableserver 0 2024-09-21T08:07:58.194 INFO:teuthology.orchestra.run.smithi107.stdout:root 0 2024-09-21T08:07:58.194 INFO:teuthology.orchestra.run.smithi107.stdout:session_timeout 60 2024-09-21T08:07:58.194 INFO:teuthology.orchestra.run.smithi107.stdout:session_autoclose 300 2024-09-21T08:07:58.195 INFO:teuthology.orchestra.run.smithi107.stdout:max_file_size 1099511627776 2024-09-21T08:07:58.195 INFO:teuthology.orchestra.run.smithi107.stdout:max_xattr_size 65536 2024-09-21T08:07:58.195 INFO:teuthology.orchestra.run.smithi107.stdout:required_client_features {} 2024-09-21T08:07:58.195 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure 0 2024-09-21T08:07:58.195 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure_osd_epoch 44 2024-09-21T08:07:58.195 INFO:teuthology.orchestra.run.smithi107.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:07:58.195 INFO:teuthology.orchestra.run.smithi107.stdout:max_mds 1 2024-09-21T08:07:58.195 INFO:teuthology.orchestra.run.smithi107.stdout:in 0 2024-09-21T08:07:58.195 INFO:teuthology.orchestra.run.smithi107.stdout:up {0=14458} 2024-09-21T08:07:58.195 INFO:teuthology.orchestra.run.smithi107.stdout:failed 2024-09-21T08:07:58.195 INFO:teuthology.orchestra.run.smithi107.stdout:damaged 2024-09-21T08:07:58.195 INFO:teuthology.orchestra.run.smithi107.stdout:stopped 2024-09-21T08:07:58.195 INFO:teuthology.orchestra.run.smithi107.stdout:data_pools [3] 2024-09-21T08:07:58.196 INFO:teuthology.orchestra.run.smithi107.stdout:metadata_pool 2 2024-09-21T08:07:58.196 INFO:teuthology.orchestra.run.smithi107.stdout:inline_data disabled 2024-09-21T08:07:58.196 INFO:teuthology.orchestra.run.smithi107.stdout:balancer 2024-09-21T08:07:58.196 INFO:teuthology.orchestra.run.smithi107.stdout:bal_rank_mask -1 2024-09-21T08:07:58.196 INFO:teuthology.orchestra.run.smithi107.stdout:standby_count_wanted 1 2024-09-21T08:07:58.196 INFO:teuthology.orchestra.run.smithi107.stdout:qdb_cluster leader: 0 members: 2024-09-21T08:07:58.196 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.grqzkt{0:14458} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:07:58.196 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:07:58.196 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:07:58.196 INFO:teuthology.orchestra.run.smithi107.stdout:Standby daemons: 2024-09-21T08:07:58.196 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:07:58.196 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.qusoyf{-1:14468} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6826/2352538667,v1:172.21.15.107:6827/2352538667] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:07:58.196 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.fwmfcy{-1:24239} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:07:58.196 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.belyba{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:07:58.197 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 15 2024-09-21T08:07:58.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.194+0000 7f612e60a640 1 -- 172.21.15.107:0/1165432376 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f611006e530 msgr2=0x7f61100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:58.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.194+0000 7f612e60a640 1 --2- 172.21.15.107:0/1165432376 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f611006e530 0x7f61100709e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6118004c60 tx=0x7f6118009040 comp rx=0 tx=0).stop 2024-09-21T08:07:58.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.194+0000 7f612e60a640 1 -- 172.21.15.107:0/1165432376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61280fcf80 msgr2=0x7f6128113690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:58.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.194+0000 7f612e60a640 1 --2- 172.21.15.107:0/1165432376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61280fcf80 0x7f6128113690 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f611c003080 tx=0x7f611c009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:58.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.194+0000 7f612e60a640 1 -- 172.21.15.107:0/1165432376 shutdown_connections 2024-09-21T08:07:58.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.194+0000 7f612e60a640 1 --2- 172.21.15.107:0/1165432376 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f611006e530 0x7f61100709e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:58.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.194+0000 7f612e60a640 1 --2- 172.21.15.107:0/1165432376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61280fcf80 0x7f6128113690 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:58.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.194+0000 7f612e60a640 1 --2- 172.21.15.107:0/1165432376 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f61280fb810 0x7f6128113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:58.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.194+0000 7f612e60a640 1 -- 172.21.15.107:0/1165432376 >> 172.21.15.107:0/1165432376 conn(0x7f61280723b0 msgr2=0x7f6128065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:58.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.194+0000 7f612e60a640 1 -- 172.21.15.107:0/1165432376 shutdown_connections 2024-09-21T08:07:58.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.194+0000 7f612e60a640 1 -- 172.21.15.107:0/1165432376 wait complete. 2024-09-21T08:07:58.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.274+0000 7f53873d0640 1 -- 172.21.15.107:0/475590168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5380102ef0 msgr2=0x7f53800fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:58.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.274+0000 7f53873d0640 1 --2- 172.21.15.107:0/475590168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5380102ef0 0x7f53800fc5b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f53740048d0 tx=0x7f5374009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:58.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.274+0000 7f53873d0640 1 -- 172.21.15.107:0/475590168 shutdown_connections 2024-09-21T08:07:58.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.274+0000 7f53873d0640 1 --2- 172.21.15.107:0/475590168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5380102ef0 0x7f53800fc5b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:58.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.274+0000 7f53873d0640 1 --2- 172.21.15.107:0/475590168 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5380102550 0x7f5380102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:58.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.274+0000 7f53873d0640 1 -- 172.21.15.107:0/475590168 >> 172.21.15.107:0/475590168 conn(0x7f53800f80f0 msgr2=0x7f53800fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:58.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.274+0000 7f53873d0640 1 -- 172.21.15.107:0/475590168 shutdown_connections 2024-09-21T08:07:58.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.274+0000 7f53873d0640 1 -- 172.21.15.107:0/475590168 wait complete. 2024-09-21T08:07:58.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.275+0000 7f53873d0640 1 Processor -- start 2024-09-21T08:07:58.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.275+0000 7f53873d0640 1 -- start start 2024-09-21T08:07:58.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.275+0000 7f53873d0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5380102550 0x7f5380113500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:58.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.275+0000 7f53873d0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5380102ef0 0x7f5380113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:58.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.275+0000 7f53873d0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5380114090 con 0x7f5380102550 2024-09-21T08:07:58.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.275+0000 7f53873d0640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538010d4a0 con 0x7f5380102ef0 2024-09-21T08:07:58.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.275+0000 7f538516c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5380102550 0x7f5380113500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:58.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.275+0000 7f538516c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5380102550 0x7f5380113500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48866/0 (socket says 172.21.15.107:48866) 2024-09-21T08:07:58.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.275+0000 7f538516c640 1 -- 172.21.15.107:0/3474794053 learned_addr learned my addr 172.21.15.107:0/3474794053 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:07:58.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.275+0000 7f538516c640 1 -- 172.21.15.107:0/3474794053 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5380102ef0 msgr2=0x7f5380113a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:58.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.275+0000 7f538516c640 1 --2- 172.21.15.107:0/3474794053 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5380102ef0 0x7f5380113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:58.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.275+0000 7f538516c640 1 -- 172.21.15.107:0/3474794053 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5374005040 con 0x7f5380102550 2024-09-21T08:07:58.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.275+0000 7f538516c640 1 --2- 172.21.15.107:0/3474794053 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5380102550 0x7f5380113500 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f537c002a80 tx=0x7f537c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:58.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.276+0000 7f5371ffb640 1 -- 172.21.15.107:0/3474794053 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f537c007c30 con 0x7f5380102550 2024-09-21T08:07:58.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.276+0000 7f5371ffb640 1 -- 172.21.15.107:0/3474794053 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f537c00f040 con 0x7f5380102550 2024-09-21T08:07:58.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.276+0000 7f53873d0640 1 -- 172.21.15.107:0/3474794053 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538010d780 con 0x7f5380102550 2024-09-21T08:07:58.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.276+0000 7f5371ffb640 1 -- 172.21.15.107:0/3474794053 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f537c009530 con 0x7f5380102550 2024-09-21T08:07:58.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.276+0000 7f53873d0640 1 -- 172.21.15.107:0/3474794053 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538010dca0 con 0x7f5380102550 2024-09-21T08:07:58.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.277+0000 7f53873d0640 1 -- 172.21.15.107:0/3474794053 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53800fdcd0 con 0x7f5380102550 2024-09-21T08:07:58.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.277+0000 7f5371ffb640 1 -- 172.21.15.107:0/3474794053 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f537c0097a0 con 0x7f5380102550 2024-09-21T08:07:58.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.277+0000 7f5371ffb640 1 --2- 172.21.15.107:0/3474794053 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f536c06e530 0x7f536c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:58.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.278+0000 7f5371ffb640 1 -- 172.21.15.107:0/3474794053 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f537c08dae0 con 0x7f5380102550 2024-09-21T08:07:58.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.278+0000 7f538496b640 1 --2- 172.21.15.107:0/3474794053 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f536c06e530 0x7f536c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:58.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.278+0000 7f538496b640 1 --2- 172.21.15.107:0/3474794053 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f536c06e530 0x7f536c0709e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5374009ac0 tx=0x7f5374009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:58.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.282+0000 7f5371ffb640 1 -- 172.21.15.107:0/3474794053 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f537c056c70 con 0x7f5380102550 2024-09-21T08:07:58.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.465+0000 7f53873d0640 1 -- 172.21.15.107:0/3474794053 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f53801095f0 con 0x7f536c06e530 2024-09-21T08:07:58.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.466+0000 7f5371ffb640 1 -- 172.21.15.107:0/3474794053 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f53801095f0 con 0x7f536c06e530 2024-09-21T08:07:58.468 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:07:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5", 2024-09-21T08:07:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: "in_progress": true, 2024-09-21T08:07:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T08:07:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: "services_complete": [ 2024-09-21T08:07:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr", 2024-09-21T08:07:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: "mon", 2024-09-21T08:07:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: "crash" 2024-09-21T08:07:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-21T08:07:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: "progress": "8/21 daemons upgraded", 2024-09-21T08:07:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T08:07:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: "is_paused": false 2024-09-21T08:07:58.468 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:07:58.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.468+0000 7f53873d0640 1 -- 172.21.15.107:0/3474794053 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f536c06e530 msgr2=0x7f536c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:58.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.468+0000 7f53873d0640 1 --2- 172.21.15.107:0/3474794053 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f536c06e530 0x7f536c0709e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5374009ac0 tx=0x7f5374009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:58.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.468+0000 7f53873d0640 1 -- 172.21.15.107:0/3474794053 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5380102550 msgr2=0x7f5380113500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:58.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.468+0000 7f53873d0640 1 --2- 172.21.15.107:0/3474794053 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5380102550 0x7f5380113500 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f537c002a80 tx=0x7f537c004600 comp rx=0 tx=0).stop 2024-09-21T08:07:58.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.469+0000 7f53873d0640 1 -- 172.21.15.107:0/3474794053 shutdown_connections 2024-09-21T08:07:58.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.469+0000 7f53873d0640 1 --2- 172.21.15.107:0/3474794053 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f536c06e530 0x7f536c0709e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:58.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.469+0000 7f53873d0640 1 --2- 172.21.15.107:0/3474794053 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5380102ef0 0x7f5380113a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:58.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.469+0000 7f53873d0640 1 --2- 172.21.15.107:0/3474794053 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5380102550 0x7f5380113500 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:58.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.469+0000 7f53873d0640 1 -- 172.21.15.107:0/3474794053 >> 172.21.15.107:0/3474794053 conn(0x7f53800f80f0 msgr2=0x7f53800f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:58.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.469+0000 7f53873d0640 1 -- 172.21.15.107:0/3474794053 shutdown_connections 2024-09-21T08:07:58.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.469+0000 7f53873d0640 1 -- 172.21.15.107:0/3474794053 wait complete. 2024-09-21T08:07:58.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.546+0000 7f1b59105640 1 -- 172.21.15.107:0/4243100425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b540fac60 msgr2=0x7f1b540fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:58.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.546+0000 7f1b59105640 1 --2- 172.21.15.107:0/4243100425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b540fac60 0x7f1b540fb0b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b480048d0 tx=0x7f1b48009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:58.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.546+0000 7f1b59105640 1 -- 172.21.15.107:0/4243100425 shutdown_connections 2024-09-21T08:07:58.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.546+0000 7f1b59105640 1 --2- 172.21.15.107:0/4243100425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b540fac60 0x7f1b540fb0b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:58.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.546+0000 7f1b59105640 1 --2- 172.21.15.107:0/4243100425 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1b541025f0 0x7f1b541029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:58.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.546+0000 7f1b59105640 1 -- 172.21.15.107:0/4243100425 >> 172.21.15.107:0/4243100425 conn(0x7f1b54070c80 msgr2=0x7f1b54071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:58.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.546+0000 7f1b59105640 1 -- 172.21.15.107:0/4243100425 shutdown_connections 2024-09-21T08:07:58.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.546+0000 7f1b59105640 1 -- 172.21.15.107:0/4243100425 wait complete. 2024-09-21T08:07:58.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.547+0000 7f1b59105640 1 Processor -- start 2024-09-21T08:07:58.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.547+0000 7f1b59105640 1 -- start start 2024-09-21T08:07:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.547+0000 7f1b59105640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b540fac60 0x7f1b541131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.547+0000 7f1b59105640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1b541025f0 0x7f1b54113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.547+0000 7f1b59105640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b54113d10 con 0x7f1b540fac60 2024-09-21T08:07:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.547+0000 7f1b59105640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5410d150 con 0x7f1b541025f0 2024-09-21T08:07:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.547+0000 7f1b52d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b540fac60 0x7f1b541131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.547+0000 7f1b52d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b540fac60 0x7f1b541131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48890/0 (socket says 172.21.15.107:48890) 2024-09-21T08:07:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.547+0000 7f1b52d9d640 1 -- 172.21.15.107:0/3014911544 learned_addr learned my addr 172.21.15.107:0/3014911544 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:07:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.547+0000 7f1b5259c640 1 --2- 172.21.15.107:0/3014911544 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1b541025f0 0x7f1b54113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.547+0000 7f1b52d9d640 1 -- 172.21.15.107:0/3014911544 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1b541025f0 msgr2=0x7f1b54113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.548+0000 7f1b52d9d640 1 --2- 172.21.15.107:0/3014911544 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1b541025f0 0x7f1b54113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.548+0000 7f1b52d9d640 1 -- 172.21.15.107:0/3014911544 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b48005040 con 0x7f1b540fac60 2024-09-21T08:07:58.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.548+0000 7f1b5259c640 1 --2- 172.21.15.107:0/3014911544 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1b541025f0 0x7f1b54113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:07:58.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.548+0000 7f1b52d9d640 1 --2- 172.21.15.107:0/3014911544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b540fac60 0x7f1b541131d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1b44002a50 tx=0x7f1b44004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:58.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.548+0000 7f1b3b7fe640 1 -- 172.21.15.107:0/3014911544 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b44007c30 con 0x7f1b540fac60 2024-09-21T08:07:58.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.548+0000 7f1b3b7fe640 1 -- 172.21.15.107:0/3014911544 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1b4400f040 con 0x7f1b540fac60 2024-09-21T08:07:58.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.548+0000 7f1b59105640 1 -- 172.21.15.107:0/3014911544 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b5410d430 con 0x7f1b540fac60 2024-09-21T08:07:58.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.548+0000 7f1b3b7fe640 1 -- 172.21.15.107:0/3014911544 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b4400da50 con 0x7f1b540fac60 2024-09-21T08:07:58.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.548+0000 7f1b59105640 1 -- 172.21.15.107:0/3014911544 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5410d9d0 con 0x7f1b540fac60 2024-09-21T08:07:58.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.549+0000 7f1b59105640 1 -- 172.21.15.107:0/3014911544 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b54065810 con 0x7f1b540fac60 2024-09-21T08:07:58.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.549+0000 7f1b3b7fe640 1 -- 172.21.15.107:0/3014911544 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1b4400dbf0 con 0x7f1b540fac60 2024-09-21T08:07:58.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.550+0000 7f1b3b7fe640 1 --2- 172.21.15.107:0/3014911544 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1b3c06e530 0x7f1b3c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:58.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.550+0000 7f1b3b7fe640 1 -- 172.21.15.107:0/3014911544 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f1b4408d8d0 con 0x7f1b540fac60 2024-09-21T08:07:58.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.550+0000 7f1b5259c640 1 --2- 172.21.15.107:0/3014911544 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1b3c06e530 0x7f1b3c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:58.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.550+0000 7f1b5259c640 1 --2- 172.21.15.107:0/3014911544 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1b3c06e530 0x7f1b3c0709e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1b48007ac0 tx=0x7f1b48009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:58.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.554+0000 7f1b3b7fe640 1 -- 172.21.15.107:0/3014911544 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1b44056a60 con 0x7f1b540fac60 2024-09-21T08:07:58.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:58 smithi107 ceph-mon[97757]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:07:58.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:58 smithi107 ceph-mon[97757]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:07:58.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:58 smithi107 ceph-mon[97757]: pgmap v70: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-21T08:07:58.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:58 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:07:58.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:58 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:58.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:58 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:58.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:58 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:58.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:58 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T08:07:58.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:58 smithi107 ceph-mon[97757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T08:07:58.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:58 smithi107 ceph-mon[97757]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-21T08:07:58.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:58 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/1181980999' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:58.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:58 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/1165432376' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:07:58.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:58 smithi107 ceph-mon[97757]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T08:07:58.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:58 smithi107 ceph-mon[97757]: osd.1 [v2:172.21.15.107:6810/1889850097,v1:172.21.15.107:6811/1889850097] boot 2024-09-21T08:07:58.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:58 smithi107 ceph-mon[97757]: osdmap e56: 6 total, 6 up, 6 in 2024-09-21T08:07:58.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:58 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T08:07:58.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.804+0000 7f1b59105640 1 -- 172.21.15.107:0/3014911544 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1b5404b750 con 0x7f1b540fac60 2024-09-21T08:07:58.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.804+0000 7f1b3b7fe640 1 -- 172.21.15.107:0/3014911544 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+903 (secure 0 0 0) 0x7f1b4405a120 con 0x7f1b540fac60 2024-09-21T08:07:58.806 INFO:teuthology.orchestra.run.smithi107.stdout:HEALTH_WARN Degraded data redundancy: 31/219 objects degraded (14.155%), 13 pgs degraded 2024-09-21T08:07:58.806 INFO:teuthology.orchestra.run.smithi107.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 31/219 objects degraded (14.155%), 13 pgs degraded 2024-09-21T08:07:58.806 INFO:teuthology.orchestra.run.smithi107.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-21T08:07:58.806 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-21T08:07:58.806 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-21T08:07:58.806 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-21T08:07:58.806 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-21T08:07:58.807 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-21T08:07:58.807 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-21T08:07:58.807 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-21T08:07:58.807 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-21T08:07:58.807 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-21T08:07:58.807 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-21T08:07:58.807 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-21T08:07:58.807 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-21T08:07:58.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.806+0000 7f1b59105640 1 -- 172.21.15.107:0/3014911544 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1b3c06e530 msgr2=0x7f1b3c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:58.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.806+0000 7f1b59105640 1 --2- 172.21.15.107:0/3014911544 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1b3c06e530 0x7f1b3c0709e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1b48007ac0 tx=0x7f1b48009da0 comp rx=0 tx=0).stop 2024-09-21T08:07:58.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.806+0000 7f1b59105640 1 -- 172.21.15.107:0/3014911544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b540fac60 msgr2=0x7f1b541131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:58.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.806+0000 7f1b59105640 1 --2- 172.21.15.107:0/3014911544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b540fac60 0x7f1b541131d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1b44002a50 tx=0x7f1b44004600 comp rx=0 tx=0).stop 2024-09-21T08:07:58.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.807+0000 7f1b59105640 1 -- 172.21.15.107:0/3014911544 shutdown_connections 2024-09-21T08:07:58.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.807+0000 7f1b59105640 1 --2- 172.21.15.107:0/3014911544 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1b3c06e530 0x7f1b3c0709e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:58.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.807+0000 7f1b59105640 1 --2- 172.21.15.107:0/3014911544 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1b541025f0 0x7f1b54113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:58.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.807+0000 7f1b59105640 1 --2- 172.21.15.107:0/3014911544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b540fac60 0x7f1b541131d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:58.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.807+0000 7f1b59105640 1 -- 172.21.15.107:0/3014911544 >> 172.21.15.107:0/3014911544 conn(0x7f1b54070c80 msgr2=0x7f1b540f9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:58.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.807+0000 7f1b59105640 1 -- 172.21.15.107:0/3014911544 shutdown_connections 2024-09-21T08:07:58.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:07:58.807+0000 7f1b59105640 1 -- 172.21.15.107:0/3014911544 wait complete. 2024-09-21T08:07:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:58 smithi129 ceph-mon[76722]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:07:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:58 smithi129 ceph-mon[76722]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:07:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:58 smithi129 ceph-mon[76722]: pgmap v70: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-21T08:07:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:58 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:07:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:58 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:58 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:58 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:58 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T08:07:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:58 smithi129 ceph-mon[76722]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T08:07:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:58 smithi129 ceph-mon[76722]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-21T08:07:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:58 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/1181980999' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:07:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:58 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/1165432376' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:07:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:58 smithi129 ceph-mon[76722]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T08:07:59.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:58 smithi129 ceph-mon[76722]: osd.1 [v2:172.21.15.107:6810/1889850097,v1:172.21.15.107:6811/1889850097] boot 2024-09-21T08:07:59.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:58 smithi129 ceph-mon[76722]: osdmap e56: 6 total, 6 up, 6 in 2024-09-21T08:07:59.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:58 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T08:08:00.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:59 smithi129 ceph-mon[76722]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:08:00.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:59 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/3014911544' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:08:00.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:59 smithi129 ceph-mon[76722]: osdmap e57: 6 total, 6 up, 6 in 2024-09-21T08:08:00.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:00.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:07:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:08:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:59 smithi107 ceph-mon[97757]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:08:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:59 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/3014911544' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:08:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:59 smithi107 ceph-mon[97757]: osdmap e57: 6 total, 6 up, 6 in 2024-09-21T08:08:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:00.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:07:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:08:01.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:00 smithi129 ceph-mon[76722]: pgmap v72: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-21T08:08:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:00 smithi107 ceph-mon[97757]: pgmap v72: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-21T08:08:02.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:01 smithi129 ceph-mon[76722]: Health check update: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T08:08:02.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:01 smithi107 ceph-mon[97757]: Health check update: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T08:08:03.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:02 smithi129 ceph-mon[76722]: pgmap v74: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-09-21T08:08:03.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:02 smithi107 ceph-mon[97757]: pgmap v74: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-09-21T08:08:04.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:03 smithi107 ceph-mon[97757]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded) 2024-09-21T08:08:04.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:03 smithi107 ceph-mon[97757]: Cluster is now healthy 2024-09-21T08:08:04.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:03 smithi129 ceph-mon[76722]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded) 2024-09-21T08:08:04.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:03 smithi129 ceph-mon[76722]: Cluster is now healthy 2024-09-21T08:08:05.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:04 smithi107 ceph-mon[97757]: pgmap v75: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:05.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:04 smithi129 ceph-mon[76722]: pgmap v75: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:07.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:06 smithi107 ceph-mon[97757]: pgmap v76: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:07.068 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:06 smithi129 ceph-mon[76722]: pgmap v76: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:09.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:08 smithi107 ceph-mon[97757]: pgmap v77: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:09.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:08 smithi129 ceph-mon[76722]: pgmap v77: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:11.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:10 smithi129 ceph-mon[76722]: pgmap v78: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:11.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:10 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:11.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:10 smithi107 ceph-mon[97757]: pgmap v78: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:11.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:10 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:13.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:12 smithi129 ceph-mon[76722]: pgmap v79: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:13.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:12 smithi107 ceph-mon[97757]: pgmap v79: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:14.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:13 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T08:08:14.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:13 smithi129 ceph-mon[76722]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T08:08:14.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:13 smithi129 ceph-mon[76722]: Upgrade: osd.2 is safe to restart 2024-09-21T08:08:14.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:13 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T08:08:14.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:13 smithi107 ceph-mon[97757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T08:08:14.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:13 smithi107 ceph-mon[97757]: Upgrade: osd.2 is safe to restart 2024-09-21T08:08:14.926 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:14 smithi107 ceph-mon[97757]: pgmap v80: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:14.927 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:14 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:14.927 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:14 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-21T08:08:14.927 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:14 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:08:14.927 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:14 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:14.927 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:14 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:08:15.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:14 smithi129 ceph-mon[76722]: pgmap v80: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:15.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:14 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:15.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:14 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-21T08:08:15.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:14 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:08:15.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:14 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:15.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:14 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:08:15.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:15 smithi107 ceph-mon[97757]: Upgrade: Updating osd.2 2024-09-21T08:08:15.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:15 smithi107 ceph-mon[97757]: Deploying daemon osd.2 on smithi107 2024-09-21T08:08:16.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:15 smithi129 ceph-mon[76722]: Upgrade: Updating osd.2 2024-09-21T08:08:16.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:15 smithi129 ceph-mon[76722]: Deploying daemon osd.2 on smithi107 2024-09-21T08:08:16.780 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:16 smithi107 ceph-mon[97757]: pgmap v81: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:17.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:16 smithi129 ceph-mon[76722]: pgmap v81: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:17.410 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:17 smithi107 systemd[1]: Stopping Ceph osd.2 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:08:17.677 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:17 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2[60972]: 2024-09-21T08:08:17.408+0000 7f19255f7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:08:17.677 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:17 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2[60972]: 2024-09-21T08:08:17.408+0000 7f19255f7640 -1 osd.2 57 *** Got signal Terminated *** 2024-09-21T08:08:17.677 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:17 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2[60972]: 2024-09-21T08:08:17.408+0000 7f19255f7640 -1 osd.2 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:08:18.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:17 smithi129 ceph-mon[76722]: osd.2 marked itself down and dead 2024-09-21T08:08:18.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:17 smithi107 ceph-mon[97757]: osd.2 marked itself down and dead 2024-09-21T08:08:18.419 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:18 smithi107 podman[120152]: 2024-09-21 08:08:18.145110448 +0000 UTC m=+0.855727904 container died c9e1c4756c020f56e2e59367a8552998d07f321546b4c63a6aa8eefce0d5dbc2 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2, RELEASE=quincy-fbd1a6a, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:08:18.678 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:18 smithi107 podman[120152]: 2024-09-21 08:08:18.508610972 +0000 UTC m=+1.219228469 container cleanup c9e1c4756c020f56e2e59367a8552998d07f321546b4c63a6aa8eefce0d5dbc2 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=quincy-fbd1a6a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T08:08:18.678 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:18 smithi107 bash[120152]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2 2024-09-21T08:08:19.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:18 smithi129 ceph-mon[76722]: pgmap v82: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:19.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:18 smithi129 ceph-mon[76722]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T08:08:19.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:18 smithi129 ceph-mon[76722]: osdmap e58: 6 total, 5 up, 6 in 2024-09-21T08:08:19.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:18 smithi107 ceph-mon[97757]: pgmap v82: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:19.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:18 smithi107 ceph-mon[97757]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T08:08:19.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:18 smithi107 ceph-mon[97757]: osdmap e58: 6 total, 5 up, 6 in 2024-09-21T08:08:19.054 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:18 smithi107 podman[120167]: 2024-09-21 08:08:18.785314654 +0000 UTC m=+0.639233434 container remove c9e1c4756c020f56e2e59367a8552998d07f321546b4c63a6aa8eefce0d5dbc2 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=quincy-fbd1a6a, org.label-schema.vendor=CentOS) 2024-09-21T08:08:19.423 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:19 smithi107 podman[120256]: 2024-09-21 08:08:19.026660982 +0000 UTC m=+0.016237543 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:08:19.423 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:19 smithi107 podman[120256]: 2024-09-21 08:08:19.153034979 +0000 UTC m=+0.142611542 container create 488021986d87bd2e5a36c44c7a8b795ed298bfed8809e9d1eb694c12b792a87e (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:08:19.423 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:19 smithi107 podman[120256]: 2024-09-21 08:08:19.422724507 +0000 UTC m=+0.412301082 container init 488021986d87bd2e5a36c44c7a8b795ed298bfed8809e9d1eb694c12b792a87e (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:08:19.689 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:19 smithi107 podman[120256]: 2024-09-21 08:08:19.426163125 +0000 UTC m=+0.415739688 container start 488021986d87bd2e5a36c44c7a8b795ed298bfed8809e9d1eb694c12b792a87e (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T08:08:19.689 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:19 smithi107 podman[120256]: 2024-09-21 08:08:19.506074772 +0000 UTC m=+0.495651346 container attach 488021986d87bd2e5a36c44c7a8b795ed298bfed8809e9d1eb694c12b792a87e (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T08:08:19.689 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:19 smithi107 podman[120256]: 2024-09-21 08:08:19.610257151 +0000 UTC m=+0.599833712 container died 488021986d87bd2e5a36c44c7a8b795ed298bfed8809e9d1eb694c12b792a87e (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:08:20.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:19 smithi129 ceph-mon[76722]: osdmap e59: 6 total, 5 up, 6 in 2024-09-21T08:08:20.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:19 smithi107 ceph-mon[97757]: osdmap e59: 6 total, 5 up, 6 in 2024-09-21T08:08:20.554 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:20 smithi107 podman[120279]: 2024-09-21 08:08:20.176441606 +0000 UTC m=+0.560223526 container remove 488021986d87bd2e5a36c44c7a8b795ed298bfed8809e9d1eb694c12b792a87e (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-deactivate, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:08:20.554 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:20 smithi107 systemd[1]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.2.service: Deactivated successfully. 2024-09-21T08:08:20.554 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:20 smithi107 systemd[1]: Stopped Ceph osd.2 for 786d4f32-77ee-11ef-baf6-efdc52797490. 2024-09-21T08:08:20.554 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:20 smithi107 systemd[1]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.2.service: Consumed 51.343s CPU time. 2024-09-21T08:08:20.555 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:20 smithi107 systemd[1]: Starting Ceph osd.2 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:08:20.931 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:20 smithi107 ceph-mon[97757]: pgmap v85: 65 pgs: 9 stale+active+clean, 56 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:20.931 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:20 smithi107 podman[120380]: 2024-09-21 08:08:20.532282151 +0000 UTC m=+0.016086176 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:08:20.931 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:20 smithi107 podman[120380]: 2024-09-21 08:08:20.669577314 +0000 UTC m=+0.153381333 container create 99d2a8c48598c2d25f883693874fc72331a0170866c6a1587345f6ca7d7f48ef (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T08:08:20.931 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:20 smithi107 podman[120380]: 2024-09-21 08:08:20.930510213 +0000 UTC m=+0.414314242 container init 99d2a8c48598c2d25f883693874fc72331a0170866c6a1587345f6ca7d7f48ef (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-activate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731) 2024-09-21T08:08:21.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:20 smithi129 ceph-mon[76722]: pgmap v85: 65 pgs: 9 stale+active+clean, 56 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:21.252 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:20 smithi107 podman[120380]: 2024-09-21 08:08:20.934005119 +0000 UTC m=+0.417809144 container start 99d2a8c48598c2d25f883693874fc72331a0170866c6a1587345f6ca7d7f48ef (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-activate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-9e2ac70) 2024-09-21T08:08:21.252 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:21 smithi107 podman[120380]: 2024-09-21 08:08:21.022073798 +0000 UTC m=+0.505877822 container attach 99d2a8c48598c2d25f883693874fc72331a0170866c6a1587345f6ca7d7f48ef (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-activate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T08:08:21.253 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:21 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-activate[120395]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:08:21.253 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:21 smithi107 bash[120380]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:08:21.253 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:21 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-activate[120395]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:08:21.253 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:21 smithi107 bash[120380]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:08:22.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:21 smithi129 ceph-mon[76722]: Health check failed: Degraded data redundancy: 16/219 objects degraded (7.306%), 8 pgs degraded (PG_DEGRADED) 2024-09-21T08:08:22.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:21 smithi107 ceph-mon[97757]: Health check failed: Degraded data redundancy: 16/219 objects degraded (7.306%), 8 pgs degraded (PG_DEGRADED) 2024-09-21T08:08:22.054 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:21 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-activate[120395]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T08:08:22.054 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:21 smithi107 bash[120380]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T08:08:22.054 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:21 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-activate[120395]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-21T08:08:22.054 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:21 smithi107 bash[120380]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-21T08:08:22.418 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:22 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-activate[120395]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-21T08:08:22.419 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:22 smithi107 bash[120380]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-21T08:08:22.419 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:22 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-activate[120395]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T08:08:22.419 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:22 smithi107 bash[120380]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T08:08:22.419 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:22 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-activate[120395]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-21T08:08:22.419 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:22 smithi107 bash[120380]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-21T08:08:22.419 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:22 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-activate[120395]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T08:08:22.419 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:22 smithi107 bash[120380]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T08:08:22.419 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:22 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-activate[120395]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-21T08:08:22.419 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:22 smithi107 bash[120380]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-21T08:08:22.419 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:22 smithi107 podman[120380]: 2024-09-21 08:08:22.106068094 +0000 UTC m=+1.589872114 container died 99d2a8c48598c2d25f883693874fc72331a0170866c6a1587345f6ca7d7f48ef (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-activate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:08:23.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:22 smithi129 ceph-mon[76722]: pgmap v86: 65 pgs: 12 active+undersized, 4 stale+active+clean, 8 active+undersized+degraded, 41 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-09-21T08:08:23.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:22 smithi107 ceph-mon[97757]: pgmap v86: 65 pgs: 12 active+undersized, 4 stale+active+clean, 8 active+undersized+degraded, 41 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-09-21T08:08:23.054 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:22 smithi107 podman[120528]: 2024-09-21 08:08:22.776074452 +0000 UTC m=+0.663326893 container remove 99d2a8c48598c2d25f883693874fc72331a0170866c6a1587345f6ca7d7f48ef (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-activate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T08:08:23.054 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:22 smithi107 podman[120587]: 2024-09-21 08:08:22.893333612 +0000 UTC m=+0.016376311 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:08:23.054 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:22 smithi107 podman[120587]: 2024-09-21 08:08:22.993666144 +0000 UTC m=+0.116708885 container create 15f45fa18e6438279b6f829d8bcadaf08dc115c4a1ebb8969716ea3b7603ec3d (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T08:08:23.554 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:23 smithi107 podman[120587]: 2024-09-21 08:08:23.24684861 +0000 UTC m=+0.369891304 container init 15f45fa18e6438279b6f829d8bcadaf08dc115c4a1ebb8969716ea3b7603ec3d (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T08:08:23.554 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:23 smithi107 podman[120587]: 2024-09-21 08:08:23.250270905 +0000 UTC m=+0.373313597 container start 15f45fa18e6438279b6f829d8bcadaf08dc115c4a1ebb8969716ea3b7603ec3d (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:08:23.554 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:23 smithi107 ceph-osd[120607]: -- 172.21.15.107:0/1717296065 <== mon.0 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b3637d01e0 con 0x55b363766000 2024-09-21T08:08:23.555 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:23 smithi107 bash[120587]: 15f45fa18e6438279b6f829d8bcadaf08dc115c4a1ebb8969716ea3b7603ec3d 2024-09-21T08:08:23.555 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:23 smithi107 systemd[1]: Started Ceph osd.2 for 786d4f32-77ee-11ef-baf6-efdc52797490. 2024-09-21T08:08:24.728 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:24 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:24.728 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:24 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:24.728 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:24 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:08:24.728 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:24 smithi107 ceph-mon[97757]: pgmap v87: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-21T08:08:24.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:24 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:24.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:24 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:24.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:24 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:08:24.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:24 smithi129 ceph-mon[76722]: pgmap v87: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-21T08:08:25.512 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:25 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2[120603]: 2024-09-21T08:08:25.139+0000 7f222d967640 -1 Falling back to public interface 2024-09-21T08:08:26.933 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:26 smithi107 ceph-mon[97757]: pgmap v88: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-21T08:08:27.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:26 smithi129 ceph-mon[76722]: pgmap v88: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-21T08:08:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.896+0000 7f07c641e640 1 -- 172.21.15.107:0/4066988453 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07c00fd580 msgr2=0x7f07c00fd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.896+0000 7f07c641e640 1 --2- 172.21.15.107:0/4066988453 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07c00fd580 0x7f07c00fd950 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f07b00048d0 tx=0x7f07b0009da0 comp rx=0 tx=0).stop 2024-09-21T08:08:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.896+0000 7f07c641e640 1 -- 172.21.15.107:0/4066988453 shutdown_connections 2024-09-21T08:08:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.896+0000 7f07c641e640 1 --2- 172.21.15.107:0/4066988453 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07c00fdf20 0x7f07c01065f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.896+0000 7f07c641e640 1 --2- 172.21.15.107:0/4066988453 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07c00fd580 0x7f07c00fd950 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.896+0000 7f07c641e640 1 -- 172.21.15.107:0/4066988453 >> 172.21.15.107:0/4066988453 conn(0x7f07c00f7000 msgr2=0x7f07c00f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.896+0000 7f07c641e640 1 -- 172.21.15.107:0/4066988453 shutdown_connections 2024-09-21T08:08:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.896+0000 7f07c641e640 1 -- 172.21.15.107:0/4066988453 wait complete. 2024-09-21T08:08:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.897+0000 7f07c641e640 1 Processor -- start 2024-09-21T08:08:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.897+0000 7f07c641e640 1 -- start start 2024-09-21T08:08:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.897+0000 7f07c641e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07c00fd580 0x7f07c0113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.897+0000 7f07c641e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07c00fdf20 0x7f07c0113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.897+0000 7f07c641e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0113d50 con 0x7f07c00fdf20 2024-09-21T08:08:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.897+0000 7f07c641e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c010d190 con 0x7f07c00fd580 2024-09-21T08:08:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.897+0000 7f07bf7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07c00fdf20 0x7f07c0113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.897+0000 7f07bf7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07c00fdf20 0x7f07c0113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33978/0 (socket says 172.21.15.107:33978) 2024-09-21T08:08:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.897+0000 7f07bf7fe640 1 -- 172.21.15.107:0/173701815 learned_addr learned my addr 172.21.15.107:0/173701815 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:08:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.898+0000 7f07bffff640 1 --2- 172.21.15.107:0/173701815 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07c00fd580 0x7f07c0113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.898+0000 7f07bf7fe640 1 -- 172.21.15.107:0/173701815 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07c00fd580 msgr2=0x7f07c0113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:28.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.898+0000 7f07bf7fe640 1 --2- 172.21.15.107:0/173701815 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07c00fd580 0x7f07c0113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:28.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.898+0000 7f07bf7fe640 1 -- 172.21.15.107:0/173701815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b0005040 con 0x7f07c00fdf20 2024-09-21T08:08:28.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.898+0000 7f07bf7fe640 1 --2- 172.21.15.107:0/173701815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07c00fdf20 0x7f07c0113750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f07b4002a50 tx=0x7f07b4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:28.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.898+0000 7f07bcff9640 1 -- 172.21.15.107:0/173701815 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07b4007c30 con 0x7f07c00fdf20 2024-09-21T08:08:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.898+0000 7f07bcff9640 1 -- 172.21.15.107:0/173701815 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f07b400f040 con 0x7f07c00fdf20 2024-09-21T08:08:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.898+0000 7f07c641e640 1 -- 172.21.15.107:0/173701815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c010d470 con 0x7f07c00fdf20 2024-09-21T08:08:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.898+0000 7f07bcff9640 1 -- 172.21.15.107:0/173701815 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07b400dad0 con 0x7f07c00fdf20 2024-09-21T08:08:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.898+0000 7f07c641e640 1 -- 172.21.15.107:0/173701815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c010d990 con 0x7f07c00fdf20 2024-09-21T08:08:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.900+0000 7f07c641e640 1 -- 172.21.15.107:0/173701815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c0066230 con 0x7f07c00fdf20 2024-09-21T08:08:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.900+0000 7f07bcff9640 1 -- 172.21.15.107:0/173701815 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f07b400dc30 con 0x7f07c00fdf20 2024-09-21T08:08:28.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.901+0000 7f07bcff9640 1 --2- 172.21.15.107:0/173701815 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f07a806e530 0x7f07a80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:28.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.901+0000 7f07bcff9640 1 -- 172.21.15.107:0/173701815 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f07b408dec0 con 0x7f07c00fdf20 2024-09-21T08:08:28.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.901+0000 7f07bffff640 1 --2- 172.21.15.107:0/173701815 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f07a806e530 0x7f07a80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:28.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.902+0000 7f07bffff640 1 --2- 172.21.15.107:0/173701815 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f07a806e530 0x7f07a80709e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009ac0 tx=0x7f07b0035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:28.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:28.906+0000 7f07bcff9640 1 -- 172.21.15.107:0/173701815 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f07b40570d0 con 0x7f07c00fdf20 2024-09-21T08:08:29.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:28 smithi129 ceph-mon[76722]: pgmap v89: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-21T08:08:29.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:29.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:29.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:28 smithi129 ceph-mon[76722]: Health check update: Degraded data redundancy: 29/219 objects degraded (13.242%), 11 pgs degraded (PG_DEGRADED) 2024-09-21T08:08:29.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:28 smithi107 ceph-mon[97757]: pgmap v89: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-21T08:08:29.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:29.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:29.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:28 smithi107 ceph-mon[97757]: Health check update: Degraded data redundancy: 29/219 objects degraded (13.242%), 11 pgs degraded (PG_DEGRADED) 2024-09-21T08:08:29.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.105+0000 7f07c641e640 1 -- 172.21.15.107:0/173701815 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07c0109560 con 0x7f07a806e530 2024-09-21T08:08:29.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.106+0000 7f07bcff9640 1 -- 172.21.15.107:0/173701815 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f07c0109560 con 0x7f07a806e530 2024-09-21T08:08:29.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.108+0000 7f07c641e640 1 -- 172.21.15.107:0/173701815 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f07a806e530 msgr2=0x7f07a80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:29.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.108+0000 7f07c641e640 1 --2- 172.21.15.107:0/173701815 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f07a806e530 0x7f07a80709e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009ac0 tx=0x7f07b0035040 comp rx=0 tx=0).stop 2024-09-21T08:08:29.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.108+0000 7f07c641e640 1 -- 172.21.15.107:0/173701815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07c00fdf20 msgr2=0x7f07c0113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:29.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.108+0000 7f07c641e640 1 --2- 172.21.15.107:0/173701815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07c00fdf20 0x7f07c0113750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f07b4002a50 tx=0x7f07b4004600 comp rx=0 tx=0).stop 2024-09-21T08:08:29.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.108+0000 7f07c641e640 1 -- 172.21.15.107:0/173701815 shutdown_connections 2024-09-21T08:08:29.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.108+0000 7f07c641e640 1 --2- 172.21.15.107:0/173701815 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f07a806e530 0x7f07a80709e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.108+0000 7f07c641e640 1 --2- 172.21.15.107:0/173701815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07c00fdf20 0x7f07c0113750 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.108+0000 7f07c641e640 1 --2- 172.21.15.107:0/173701815 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07c00fd580 0x7f07c0113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.108+0000 7f07c641e640 1 -- 172.21.15.107:0/173701815 >> 172.21.15.107:0/173701815 conn(0x7f07c00f7000 msgr2=0x7f07c00f8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:29.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.109+0000 7f07c641e640 1 -- 172.21.15.107:0/173701815 shutdown_connections 2024-09-21T08:08:29.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.109+0000 7f07c641e640 1 -- 172.21.15.107:0/173701815 wait complete. 2024-09-21T08:08:29.118 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:08:29.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.190+0000 7f576609c640 1 -- 172.21.15.107:0/2558392639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5760102620 msgr2=0x7f57601029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:29.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.190+0000 7f576609c640 1 --2- 172.21.15.107:0/2558392639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5760102620 0x7f57601029f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f57500048d0 tx=0x7f5750009da0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.190+0000 7f576609c640 1 -- 172.21.15.107:0/2558392639 shutdown_connections 2024-09-21T08:08:29.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.190+0000 7f576609c640 1 --2- 172.21.15.107:0/2558392639 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f57600fac80 0x7f57600fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.190+0000 7f576609c640 1 --2- 172.21.15.107:0/2558392639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5760102620 0x7f57601029f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.190+0000 7f576609c640 1 -- 172.21.15.107:0/2558392639 >> 172.21.15.107:0/2558392639 conn(0x7f5760070ce0 msgr2=0x7f57600710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:29.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.190+0000 7f576609c640 1 -- 172.21.15.107:0/2558392639 shutdown_connections 2024-09-21T08:08:29.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.190+0000 7f576609c640 1 -- 172.21.15.107:0/2558392639 wait complete. 2024-09-21T08:08:29.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.191+0000 7f576609c640 1 Processor -- start 2024-09-21T08:08:29.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.191+0000 7f576609c640 1 -- start start 2024-09-21T08:08:29.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.191+0000 7f576609c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57600fac80 0x7f57600fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:29.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.191+0000 7f576609c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5760102620 0x7f57600fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:29.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.191+0000 7f576609c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57600fc8e0 con 0x7f57600fac80 2024-09-21T08:08:29.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.191+0000 7f576609c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57600fca50 con 0x7f5760102620 2024-09-21T08:08:29.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.191+0000 7f575f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57600fac80 0x7f57600fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:29.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.191+0000 7f575f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57600fac80 0x7f57600fbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33984/0 (socket says 172.21.15.107:33984) 2024-09-21T08:08:29.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.191+0000 7f575f7fe640 1 -- 172.21.15.107:0/1678871980 learned_addr learned my addr 172.21.15.107:0/1678871980 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:08:29.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.191+0000 7f575effd640 1 --2- 172.21.15.107:0/1678871980 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5760102620 0x7f57600fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:29.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.192+0000 7f575f7fe640 1 -- 172.21.15.107:0/1678871980 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5760102620 msgr2=0x7f57600fc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:29.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.192+0000 7f575f7fe640 1 --2- 172.21.15.107:0/1678871980 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5760102620 0x7f57600fc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.192+0000 7f575f7fe640 1 -- 172.21.15.107:0/1678871980 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5750005040 con 0x7f57600fac80 2024-09-21T08:08:29.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.192+0000 7f575effd640 1 --2- 172.21.15.107:0/1678871980 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5760102620 0x7f57600fc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:08:29.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.192+0000 7f575f7fe640 1 --2- 172.21.15.107:0/1678871980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57600fac80 0x7f57600fbe60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5750000c00 tx=0x7f5750009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:29.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.192+0000 7f5747fff640 1 -- 172.21.15.107:0/1678871980 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5750038070 con 0x7f57600fac80 2024-09-21T08:08:29.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.192+0000 7f5747fff640 1 -- 172.21.15.107:0/1678871980 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f575002ade0 con 0x7f57600fac80 2024-09-21T08:08:29.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.192+0000 7f576609c640 1 -- 172.21.15.107:0/1678871980 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57600fcc80 con 0x7f57600fac80 2024-09-21T08:08:29.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.192+0000 7f5747fff640 1 -- 172.21.15.107:0/1678871980 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f575002c7b0 con 0x7f57600fac80 2024-09-21T08:08:29.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.192+0000 7f576609c640 1 -- 172.21.15.107:0/1678871980 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5760119870 con 0x7f57600fac80 2024-09-21T08:08:29.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.193+0000 7f576609c640 1 -- 172.21.15.107:0/1678871980 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57600657b0 con 0x7f57600fac80 2024-09-21T08:08:29.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.193+0000 7f5747fff640 1 -- 172.21.15.107:0/1678871980 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5750030020 con 0x7f57600fac80 2024-09-21T08:08:29.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.194+0000 7f5747fff640 1 --2- 172.21.15.107:0/1678871980 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f574806e530 0x7f57480709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:29.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.194+0000 7f5747fff640 1 -- 172.21.15.107:0/1678871980 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f57500ae660 con 0x7f57600fac80 2024-09-21T08:08:29.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.194+0000 7f575effd640 1 --2- 172.21.15.107:0/1678871980 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f574806e530 0x7f57480709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:29.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.194+0000 7f575effd640 1 --2- 172.21.15.107:0/1678871980 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f574806e530 0x7f57480709e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f57600fd7a0 tx=0x7f575400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:29.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.198+0000 7f5747fff640 1 -- 172.21.15.107:0/1678871980 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5750077790 con 0x7f57600fac80 2024-09-21T08:08:29.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.395+0000 7f576609c640 1 -- 172.21.15.107:0/1678871980 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f576004b7b0 con 0x7f574806e530 2024-09-21T08:08:29.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.397+0000 7f5747fff640 1 -- 172.21.15.107:0/1678871980 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f576004b7b0 con 0x7f574806e530 2024-09-21T08:08:29.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.399+0000 7f576609c640 1 -- 172.21.15.107:0/1678871980 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f574806e530 msgr2=0x7f57480709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:29.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.399+0000 7f576609c640 1 --2- 172.21.15.107:0/1678871980 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f574806e530 0x7f57480709e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f57600fd7a0 tx=0x7f575400b040 comp rx=0 tx=0).stop 2024-09-21T08:08:29.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.399+0000 7f576609c640 1 -- 172.21.15.107:0/1678871980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57600fac80 msgr2=0x7f57600fbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:29.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.399+0000 7f576609c640 1 --2- 172.21.15.107:0/1678871980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57600fac80 0x7f57600fbe60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5750000c00 tx=0x7f5750009da0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.399+0000 7f576609c640 1 -- 172.21.15.107:0/1678871980 shutdown_connections 2024-09-21T08:08:29.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.399+0000 7f576609c640 1 --2- 172.21.15.107:0/1678871980 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f574806e530 0x7f57480709e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.399+0000 7f576609c640 1 --2- 172.21.15.107:0/1678871980 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5760102620 0x7f57600fc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.399+0000 7f576609c640 1 --2- 172.21.15.107:0/1678871980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57600fac80 0x7f57600fbe60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.399+0000 7f576609c640 1 -- 172.21.15.107:0/1678871980 >> 172.21.15.107:0/1678871980 conn(0x7f5760070ce0 msgr2=0x7f5760105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:29.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.399+0000 7f576609c640 1 -- 172.21.15.107:0/1678871980 shutdown_connections 2024-09-21T08:08:29.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.399+0000 7f576609c640 1 -- 172.21.15.107:0/1678871980 wait complete. 2024-09-21T08:08:29.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.477+0000 7fcc08183640 1 -- 172.21.15.107:0/452044132 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc00064fc0 msgr2=0x7fcc00065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:29.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.477+0000 7fcc08183640 1 --2- 172.21.15.107:0/452044132 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc00064fc0 0x7fcc00065430 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00048d0 tx=0x7fcbf0009da0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.477+0000 7fcc08183640 1 -- 172.21.15.107:0/452044132 shutdown_connections 2024-09-21T08:08:29.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.477+0000 7fcc08183640 1 --2- 172.21.15.107:0/452044132 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc00064fc0 0x7fcc00065430 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.477+0000 7fcc08183640 1 --2- 172.21.15.107:0/452044132 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcc000fe460 0x7fcc000fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.477+0000 7fcc08183640 1 -- 172.21.15.107:0/452044132 >> 172.21.15.107:0/452044132 conn(0x7fcc000723b0 msgr2=0x7fcc000727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:29.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.477+0000 7fcc08183640 1 -- 172.21.15.107:0/452044132 shutdown_connections 2024-09-21T08:08:29.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.477+0000 7fcc08183640 1 -- 172.21.15.107:0/452044132 wait complete. 2024-09-21T08:08:29.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.478+0000 7fcc08183640 1 Processor -- start 2024-09-21T08:08:29.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.478+0000 7fcc08183640 1 -- start start 2024-09-21T08:08:29.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.478+0000 7fcc08183640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcc00064fc0 0x7fcc001131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:29.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.478+0000 7fcc08183640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc000fe460 0x7fcc001136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:29.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.478+0000 7fcc08183640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00113cf0 con 0x7fcc000fe460 2024-09-21T08:08:29.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.478+0000 7fcc08183640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0010d180 con 0x7fcc00064fc0 2024-09-21T08:08:29.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.478+0000 7fcc0571e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc000fe460 0x7fcc001136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:29.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.478+0000 7fcc0571e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc000fe460 0x7fcc001136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34008/0 (socket says 172.21.15.107:34008) 2024-09-21T08:08:29.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.478+0000 7fcc0571e640 1 -- 172.21.15.107:0/3210538497 learned_addr learned my addr 172.21.15.107:0/3210538497 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:08:29.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.478+0000 7fcc05f1f640 1 --2- 172.21.15.107:0/3210538497 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcc00064fc0 0x7fcc001131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:29.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.478+0000 7fcc0571e640 1 -- 172.21.15.107:0/3210538497 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcc00064fc0 msgr2=0x7fcc001131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:29.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.478+0000 7fcc0571e640 1 --2- 172.21.15.107:0/3210538497 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcc00064fc0 0x7fcc001131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.478+0000 7fcc0571e640 1 -- 172.21.15.107:0/3210538497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf0005040 con 0x7fcc000fe460 2024-09-21T08:08:29.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.479+0000 7fcc0571e640 1 --2- 172.21.15.107:0/3210538497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc000fe460 0x7fcc001136f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0000c00 tx=0x7fcbf0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:29.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.479+0000 7fcbf67fc640 1 -- 172.21.15.107:0/3210538497 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbf0038070 con 0x7fcc000fe460 2024-09-21T08:08:29.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.479+0000 7fcbf67fc640 1 -- 172.21.15.107:0/3210538497 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcbf002ade0 con 0x7fcc000fe460 2024-09-21T08:08:29.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.479+0000 7fcc08183640 1 -- 172.21.15.107:0/3210538497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0010d400 con 0x7fcc000fe460 2024-09-21T08:08:29.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.479+0000 7fcbf67fc640 1 -- 172.21.15.107:0/3210538497 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbf002c7e0 con 0x7fcc000fe460 2024-09-21T08:08:29.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.479+0000 7fcc08183640 1 -- 172.21.15.107:0/3210538497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0010d940 con 0x7fcc000fe460 2024-09-21T08:08:29.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.480+0000 7fcc08183640 1 -- 172.21.15.107:0/3210538497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc000fdcf0 con 0x7fcc000fe460 2024-09-21T08:08:29.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.480+0000 7fcbf67fc640 1 -- 172.21.15.107:0/3210538497 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fcbf0030020 con 0x7fcc000fe460 2024-09-21T08:08:29.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.481+0000 7fcbf67fc640 1 --2- 172.21.15.107:0/3210538497 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fcbec06e530 0x7fcbec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:29.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.481+0000 7fcbf67fc640 1 -- 172.21.15.107:0/3210538497 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fcbf00adcb0 con 0x7fcc000fe460 2024-09-21T08:08:29.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.481+0000 7fcc05f1f640 1 --2- 172.21.15.107:0/3210538497 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fcbec06e530 0x7fcbec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:29.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.481+0000 7fcc05f1f640 1 --2- 172.21.15.107:0/3210538497 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fcbec06e530 0x7fcbec0709e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc004eb0 tx=0x7fcbfc00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:29.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.485+0000 7fcbf67fc640 1 -- 172.21.15.107:0/3210538497 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fcbf0076f70 con 0x7fcc000fe460 2024-09-21T08:08:29.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.663+0000 7fcc08183640 1 -- 172.21.15.107:0/3210538497 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc0010e850 con 0x7fcbec06e530 2024-09-21T08:08:29.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.672+0000 7fcbf67fc640 1 -- 172.21.15.107:0/3210538497 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fcc0010e850 con 0x7fcbec06e530 2024-09-21T08:08:29.674 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:08:29.674 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (5m) 1s ago 13m 26.2M - 0.25.0 c8568f914cd2 2b499aa3b7de 2024-09-21T08:08:29.674 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (100s) 1s ago 13m 6899k - 19.1.1-367-g9e2ac70b cc9251b744a3 69be0e9aa842 2024-09-21T08:08:29.674 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (95s) 92s ago 12m 6891k - 19.1.1-367-g9e2ac70b cc9251b744a3 926ed03c78b9 2024-09-21T08:08:29.674 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (3m) 1s ago 13m 81.2M - 9.4.12 2bacad6d85d8 63177dcfe25c 2024-09-21T08:08:29.674 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (8m) 1s ago 8m 155M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 3bc779f88228 2024-09-21T08:08:29.674 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (8m) 1s ago 8m 14.1M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be ea8f140aade7 2024-09-21T08:08:29.674 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (8m) 92s ago 8m 16.7M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 329346c3afec 2024-09-21T08:08:29.674 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (8m) 92s ago 8m 18.1M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be baf87f32bfbc 2024-09-21T08:08:29.674 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:8443,9283,8765 running (4m) 1s ago 14m 498M - 19.1.1-367-g9e2ac70b cc9251b744a3 49c237734f07 2024-09-21T08:08:29.675 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283,8765 running (3m) 92s ago 12m 439M - 19.1.1-367-g9e2ac70b cc9251b744a3 ed117096bdd8 2024-09-21T08:08:29.675 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (2m) 1s ago 15m 45.9M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 445b3e6a800f 2024-09-21T08:08:29.675 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (2m) 92s ago 12m 33.1M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 12706f823621 2024-09-21T08:08:29.675 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 running (5m) 1s ago 13m 17.1M - 1.5.0 0da6a335fe13 6de7c307ba0f 2024-09-21T08:08:29.675 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (5m) 92s ago 12m 16.6M - 1.5.0 0da6a335fe13 cb6d4577b24c 2024-09-21T08:08:29.675 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (76s) 1s ago 12m 98.8M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 d0a742b31d8a 2024-09-21T08:08:29.675 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (41s) 1s ago 11m 107M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 4bb3f4c8f75a 2024-09-21T08:08:29.675 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (6s) 1s ago 11m 12.1M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 15f45fa18e64 2024-09-21T08:08:29.675 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (10m) 92s ago 10m 280M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 7d58f70b105c 2024-09-21T08:08:29.675 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (10m) 92s ago 10m 252M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 2f916ef76d22 2024-09-21T08:08:29.675 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (9m) 92s ago 9m 235M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 0f25d9454304 2024-09-21T08:08:29.675 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (4m) 1s ago 13m 61.0M - 2.43.0 a07b618ecd1d 9ed2abf5e8d8 2024-09-21T08:08:29.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.674+0000 7fcc08183640 1 -- 172.21.15.107:0/3210538497 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fcbec06e530 msgr2=0x7fcbec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:29.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.674+0000 7fcc08183640 1 --2- 172.21.15.107:0/3210538497 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fcbec06e530 0x7fcbec0709e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc004eb0 tx=0x7fcbfc00b040 comp rx=0 tx=0).stop 2024-09-21T08:08:29.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.674+0000 7fcc08183640 1 -- 172.21.15.107:0/3210538497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc000fe460 msgr2=0x7fcc001136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:29.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.674+0000 7fcc08183640 1 --2- 172.21.15.107:0/3210538497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc000fe460 0x7fcc001136f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0000c00 tx=0x7fcbf0009da0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.674+0000 7fcc08183640 1 -- 172.21.15.107:0/3210538497 shutdown_connections 2024-09-21T08:08:29.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.674+0000 7fcc08183640 1 --2- 172.21.15.107:0/3210538497 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fcbec06e530 0x7fcbec0709e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.674+0000 7fcc08183640 1 --2- 172.21.15.107:0/3210538497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc000fe460 0x7fcc001136f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.674+0000 7fcc08183640 1 --2- 172.21.15.107:0/3210538497 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcc00064fc0 0x7fcc001131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.674+0000 7fcc08183640 1 -- 172.21.15.107:0/3210538497 >> 172.21.15.107:0/3210538497 conn(0x7fcc000723b0 msgr2=0x7fcc001053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:29.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.674+0000 7fcc08183640 1 -- 172.21.15.107:0/3210538497 shutdown_connections 2024-09-21T08:08:29.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.674+0000 7fcc08183640 1 -- 172.21.15.107:0/3210538497 wait complete. 2024-09-21T08:08:29.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.756+0000 7fa66311f640 1 -- 172.21.15.107:0/2097263607 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c0fcf80 msgr2=0x7fa65c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:29.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.756+0000 7fa66311f640 1 --2- 172.21.15.107:0/2097263607 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c0fcf80 0x7fa65c0fd3d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa6480048d0 tx=0x7fa648009da0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.756+0000 7fa66311f640 1 -- 172.21.15.107:0/2097263607 shutdown_connections 2024-09-21T08:08:29.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.756+0000 7fa66311f640 1 --2- 172.21.15.107:0/2097263607 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c0fcf80 0x7fa65c0fd3d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.756+0000 7fa66311f640 1 --2- 172.21.15.107:0/2097263607 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa65c0fb810 0x7fa65c0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.756+0000 7fa66311f640 1 -- 172.21.15.107:0/2097263607 >> 172.21.15.107:0/2097263607 conn(0x7fa65c0723b0 msgr2=0x7fa65c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:29.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.756+0000 7fa66311f640 1 -- 172.21.15.107:0/2097263607 shutdown_connections 2024-09-21T08:08:29.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.756+0000 7fa66311f640 1 -- 172.21.15.107:0/2097263607 wait complete. 2024-09-21T08:08:29.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.757+0000 7fa66311f640 1 Processor -- start 2024-09-21T08:08:29.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.757+0000 7fa66311f640 1 -- start start 2024-09-21T08:08:29.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.757+0000 7fa66311f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa65c0fb810 0x7fa65c113180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:29.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.757+0000 7fa66311f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c0fcf80 0x7fa65c1136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:29.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.757+0000 7fa66311f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c113cc0 con 0x7fa65c0fcf80 2024-09-21T08:08:29.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.757+0000 7fa66311f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c10d100 con 0x7fa65c0fb810 2024-09-21T08:08:29.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.758+0000 7fa65bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c0fcf80 0x7fa65c1136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:29.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.758+0000 7fa65bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c0fcf80 0x7fa65c1136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34026/0 (socket says 172.21.15.107:34026) 2024-09-21T08:08:29.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.758+0000 7fa65bfff640 1 -- 172.21.15.107:0/2589683368 learned_addr learned my addr 172.21.15.107:0/2589683368 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:08:29.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.758+0000 7fa660ebb640 1 --2- 172.21.15.107:0/2589683368 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa65c0fb810 0x7fa65c113180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:29.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.758+0000 7fa660ebb640 1 -- 172.21.15.107:0/2589683368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c0fcf80 msgr2=0x7fa65c1136c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:29.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.758+0000 7fa660ebb640 1 --2- 172.21.15.107:0/2589683368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c0fcf80 0x7fa65c1136c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:29.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.758+0000 7fa660ebb640 1 -- 172.21.15.107:0/2589683368 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa648005040 con 0x7fa65c0fb810 2024-09-21T08:08:29.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.758+0000 7fa65bfff640 1 --2- 172.21.15.107:0/2589683368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c0fcf80 0x7fa65c1136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:08:29.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.758+0000 7fa660ebb640 1 --2- 172.21.15.107:0/2589683368 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa65c0fb810 0x7fa65c113180 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa6500027d0 tx=0x7fa650009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:29.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.758+0000 7fa6597fa640 1 -- 172.21.15.107:0/2589683368 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa650002dc0 con 0x7fa65c0fb810 2024-09-21T08:08:29.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.758+0000 7fa6597fa640 1 -- 172.21.15.107:0/2589683368 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa65000f040 con 0x7fa65c0fb810 2024-09-21T08:08:29.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.758+0000 7fa66311f640 1 -- 172.21.15.107:0/2589683368 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65c10d3e0 con 0x7fa65c0fb810 2024-09-21T08:08:29.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.759+0000 7fa6597fa640 1 -- 172.21.15.107:0/2589683368 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa65000d9f0 con 0x7fa65c0fb810 2024-09-21T08:08:29.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.759+0000 7fa66311f640 1 -- 172.21.15.107:0/2589683368 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65c10d980 con 0x7fa65c0fb810 2024-09-21T08:08:29.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.760+0000 7fa66311f640 1 -- 172.21.15.107:0/2589683368 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65c0fcbc0 con 0x7fa65c0fb810 2024-09-21T08:08:29.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.760+0000 7fa6597fa640 1 -- 172.21.15.107:0/2589683368 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa65000db50 con 0x7fa65c0fb810 2024-09-21T08:08:29.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.761+0000 7fa6597fa640 1 --2- 172.21.15.107:0/2589683368 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fa64c06e530 0x7fa64c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:29.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.761+0000 7fa6597fa640 1 -- 172.21.15.107:0/2589683368 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa65008d7b0 con 0x7fa65c0fb810 2024-09-21T08:08:29.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.761+0000 7fa65bfff640 1 --2- 172.21.15.107:0/2589683368 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fa64c06e530 0x7fa64c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:29.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.761+0000 7fa65bfff640 1 --2- 172.21.15.107:0/2589683368 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fa64c06e530 0x7fa64c0709e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa65c10ea40 tx=0x7fa648035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:29.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:29.766+0000 7fa6597fa640 1 -- 172.21.15.107:0/2589683368 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa65005a540 con 0x7fa65c0fb810 2024-09-21T08:08:30.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.007+0000 7fa66311f640 1 -- 172.21.15.107:0/2589683368 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa65c04b750 con 0x7fa65c0fb810 2024-09-21T08:08:30.009 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:30.009 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:30.009 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:30.009 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:08:30.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.007+0000 7fa6597fa640 1 -- 172.21.15.107:0/2589683368 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7fa65005a0d0 con 0x7fa65c0fb810 2024-09-21T08:08:30.009 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:08:30.010 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": { 2024-09-21T08:08:30.010 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:08:30.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:08:30.010 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": { 2024-09-21T08:08:30.010 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:08:30.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:08:30.010 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": { 2024-09-21T08:08:30.010 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 3, 2024-09-21T08:08:30.010 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:08:30.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:08:30.010 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-21T08:08:30.010 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 4 2024-09-21T08:08:30.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:08:30.010 INFO:teuthology.orchestra.run.smithi107.stdout: "overall": { 2024-09-21T08:08:30.011 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 7, 2024-09-21T08:08:30.011 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 6 2024-09-21T08:08:30.011 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-21T08:08:30.011 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:08:30.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.010+0000 7fa66311f640 1 -- 172.21.15.107:0/2589683368 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fa64c06e530 msgr2=0x7fa64c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.010+0000 7fa66311f640 1 --2- 172.21.15.107:0/2589683368 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fa64c06e530 0x7fa64c0709e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa65c10ea40 tx=0x7fa648035040 comp rx=0 tx=0).stop 2024-09-21T08:08:30.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.010+0000 7fa66311f640 1 -- 172.21.15.107:0/2589683368 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa65c0fb810 msgr2=0x7fa65c113180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.010+0000 7fa66311f640 1 --2- 172.21.15.107:0/2589683368 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa65c0fb810 0x7fa65c113180 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa6500027d0 tx=0x7fa650009f70 comp rx=0 tx=0).stop 2024-09-21T08:08:30.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.010+0000 7fa66311f640 1 -- 172.21.15.107:0/2589683368 shutdown_connections 2024-09-21T08:08:30.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.010+0000 7fa66311f640 1 --2- 172.21.15.107:0/2589683368 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fa64c06e530 0x7fa64c0709e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.010+0000 7fa66311f640 1 --2- 172.21.15.107:0/2589683368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c0fcf80 0x7fa65c1136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.010+0000 7fa66311f640 1 --2- 172.21.15.107:0/2589683368 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa65c0fb810 0x7fa65c113180 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.010+0000 7fa66311f640 1 -- 172.21.15.107:0/2589683368 >> 172.21.15.107:0/2589683368 conn(0x7fa65c0723b0 msgr2=0x7fa65c065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:30.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.010+0000 7fa66311f640 1 -- 172.21.15.107:0/2589683368 shutdown_connections 2024-09-21T08:08:30.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.010+0000 7fa66311f640 1 -- 172.21.15.107:0/2589683368 wait complete. 2024-09-21T08:08:30.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:30.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:30.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:30.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:08:30.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.091+0000 7f1db6e79640 1 -- 172.21.15.107:0/2676372529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1db0065300 msgr2=0x7f1db00656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.091+0000 7f1db6e79640 1 --2- 172.21.15.107:0/2676372529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1db0065300 0x7f1db00656d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1da40048d0 tx=0x7f1da4009da0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.091+0000 7f1db6e79640 1 -- 172.21.15.107:0/2676372529 shutdown_connections 2024-09-21T08:08:30.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.091+0000 7f1db6e79640 1 --2- 172.21.15.107:0/2676372529 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1db0065c10 0x7f1db00fe0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.091+0000 7f1db6e79640 1 --2- 172.21.15.107:0/2676372529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1db0065300 0x7f1db00656d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.091+0000 7f1db6e79640 1 -- 172.21.15.107:0/2676372529 >> 172.21.15.107:0/2676372529 conn(0x7f1db00723b0 msgr2=0x7f1db00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:30.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.091+0000 7f1db6e79640 1 -- 172.21.15.107:0/2676372529 shutdown_connections 2024-09-21T08:08:30.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.091+0000 7f1db6e79640 1 -- 172.21.15.107:0/2676372529 wait complete. 2024-09-21T08:08:30.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.092+0000 7f1db6e79640 1 Processor -- start 2024-09-21T08:08:30.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.092+0000 7f1db6e79640 1 -- start start 2024-09-21T08:08:30.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.092+0000 7f1db6e79640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1db0065300 0x7f1db0113180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.092+0000 7f1db6e79640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1db0065c10 0x7f1db01136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.092+0000 7f1db6e79640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db0113cc0 con 0x7f1db0065300 2024-09-21T08:08:30.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.092+0000 7f1db6e79640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db010d100 con 0x7f1db0065c10 2024-09-21T08:08:30.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.093+0000 7f1db4c15640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1db0065300 0x7f1db0113180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.093+0000 7f1db4c15640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1db0065300 0x7f1db0113180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34048/0 (socket says 172.21.15.107:34048) 2024-09-21T08:08:30.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.093+0000 7f1db4c15640 1 -- 172.21.15.107:0/1096304146 learned_addr learned my addr 172.21.15.107:0/1096304146 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:08:30.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.093+0000 7f1daffff640 1 --2- 172.21.15.107:0/1096304146 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1db0065c10 0x7f1db01136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.093+0000 7f1db4c15640 1 -- 172.21.15.107:0/1096304146 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1db0065c10 msgr2=0x7f1db01136c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.093+0000 7f1db4c15640 1 --2- 172.21.15.107:0/1096304146 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1db0065c10 0x7f1db01136c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.093+0000 7f1db4c15640 1 -- 172.21.15.107:0/1096304146 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da4005040 con 0x7f1db0065300 2024-09-21T08:08:30.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.093+0000 7f1daffff640 1 --2- 172.21.15.107:0/1096304146 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1db0065c10 0x7f1db01136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:08:30.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.093+0000 7f1db4c15640 1 --2- 172.21.15.107:0/1096304146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1db0065300 0x7f1db0113180 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1da4003080 tx=0x7f1da4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:30.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.093+0000 7f1dad7fa640 1 -- 172.21.15.107:0/1096304146 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1da4038070 con 0x7f1db0065300 2024-09-21T08:08:30.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.093+0000 7f1db6e79640 1 -- 172.21.15.107:0/1096304146 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db010d380 con 0x7f1db0065300 2024-09-21T08:08:30.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.093+0000 7f1dad7fa640 1 -- 172.21.15.107:0/1096304146 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1da402ade0 con 0x7f1db0065300 2024-09-21T08:08:30.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.093+0000 7f1db6e79640 1 -- 172.21.15.107:0/1096304146 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db010d860 con 0x7f1db0065300 2024-09-21T08:08:30.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.094+0000 7f1dad7fa640 1 -- 172.21.15.107:0/1096304146 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1da4033420 con 0x7f1db0065300 2024-09-21T08:08:30.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.094+0000 7f1db6e79640 1 -- 172.21.15.107:0/1096304146 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db00fdcf0 con 0x7f1db0065300 2024-09-21T08:08:30.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.095+0000 7f1dad7fa640 1 -- 172.21.15.107:0/1096304146 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1da4030020 con 0x7f1db0065300 2024-09-21T08:08:30.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.095+0000 7f1dad7fa640 1 --2- 172.21.15.107:0/1096304146 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1da006e530 0x7f1da00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.096+0000 7f1dad7fa640 1 -- 172.21.15.107:0/1096304146 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f1da40ae130 con 0x7f1db0065300 2024-09-21T08:08:30.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.096+0000 7f1daffff640 1 --2- 172.21.15.107:0/1096304146 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1da006e530 0x7f1da00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.096+0000 7f1daffff640 1 --2- 172.21.15.107:0/1096304146 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1da006e530 0x7f1da00709e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1db010ea40 tx=0x7f1d9c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:30.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.102+0000 7f1dad7fa640 1 -- 172.21.15.107:0/1096304146 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1da4077370 con 0x7f1db0065300 2024-09-21T08:08:30.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.343+0000 7f1db6e79640 1 -- 172.21.15.107:0/1096304146 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1db004b780 con 0x7f1db0065300 2024-09-21T08:08:30.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.344+0000 7f1dad7fa640 1 -- 172.21.15.107:0/1096304146 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1922 (secure 0 0 0) 0x7f1da407aa30 con 0x7f1db0065300 2024-09-21T08:08:30.345 INFO:teuthology.orchestra.run.smithi107.stdout:e15 2024-09-21T08:08:30.345 INFO:teuthology.orchestra.run.smithi107.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-21T08:08:30.345 INFO:teuthology.orchestra.run.smithi107.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T08:08:30.346 INFO:teuthology.orchestra.run.smithi107.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:08:30.346 INFO:teuthology.orchestra.run.smithi107.stdout:legacy client fscid: 1 2024-09-21T08:08:30.346 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:08:30.346 INFO:teuthology.orchestra.run.smithi107.stdout:Filesystem 'cephfs' (1) 2024-09-21T08:08:30.346 INFO:teuthology.orchestra.run.smithi107.stdout:fs_name cephfs 2024-09-21T08:08:30.346 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 15 2024-09-21T08:08:30.346 INFO:teuthology.orchestra.run.smithi107.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T08:08:30.346 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-09-21T08:00:03.244314+0000 2024-09-21T08:08:30.346 INFO:teuthology.orchestra.run.smithi107.stdout:modified 2024-09-21T08:00:21.458971+0000 2024-09-21T08:08:30.346 INFO:teuthology.orchestra.run.smithi107.stdout:tableserver 0 2024-09-21T08:08:30.346 INFO:teuthology.orchestra.run.smithi107.stdout:root 0 2024-09-21T08:08:30.346 INFO:teuthology.orchestra.run.smithi107.stdout:session_timeout 60 2024-09-21T08:08:30.347 INFO:teuthology.orchestra.run.smithi107.stdout:session_autoclose 300 2024-09-21T08:08:30.347 INFO:teuthology.orchestra.run.smithi107.stdout:max_file_size 1099511627776 2024-09-21T08:08:30.347 INFO:teuthology.orchestra.run.smithi107.stdout:max_xattr_size 65536 2024-09-21T08:08:30.347 INFO:teuthology.orchestra.run.smithi107.stdout:required_client_features {} 2024-09-21T08:08:30.347 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure 0 2024-09-21T08:08:30.347 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure_osd_epoch 44 2024-09-21T08:08:30.347 INFO:teuthology.orchestra.run.smithi107.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:08:30.347 INFO:teuthology.orchestra.run.smithi107.stdout:max_mds 1 2024-09-21T08:08:30.347 INFO:teuthology.orchestra.run.smithi107.stdout:in 0 2024-09-21T08:08:30.347 INFO:teuthology.orchestra.run.smithi107.stdout:up {0=14458} 2024-09-21T08:08:30.347 INFO:teuthology.orchestra.run.smithi107.stdout:failed 2024-09-21T08:08:30.347 INFO:teuthology.orchestra.run.smithi107.stdout:damaged 2024-09-21T08:08:30.347 INFO:teuthology.orchestra.run.smithi107.stdout:stopped 2024-09-21T08:08:30.347 INFO:teuthology.orchestra.run.smithi107.stdout:data_pools [3] 2024-09-21T08:08:30.348 INFO:teuthology.orchestra.run.smithi107.stdout:metadata_pool 2 2024-09-21T08:08:30.348 INFO:teuthology.orchestra.run.smithi107.stdout:inline_data disabled 2024-09-21T08:08:30.348 INFO:teuthology.orchestra.run.smithi107.stdout:balancer 2024-09-21T08:08:30.348 INFO:teuthology.orchestra.run.smithi107.stdout:bal_rank_mask -1 2024-09-21T08:08:30.348 INFO:teuthology.orchestra.run.smithi107.stdout:standby_count_wanted 1 2024-09-21T08:08:30.348 INFO:teuthology.orchestra.run.smithi107.stdout:qdb_cluster leader: 0 members: 2024-09-21T08:08:30.348 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.grqzkt{0:14458} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:08:30.348 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:08:30.348 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:08:30.348 INFO:teuthology.orchestra.run.smithi107.stdout:Standby daemons: 2024-09-21T08:08:30.348 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:08:30.348 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.qusoyf{-1:14468} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6826/2352538667,v1:172.21.15.107:6827/2352538667] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:08:30.348 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.fwmfcy{-1:24239} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:08:30.348 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.belyba{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:08:30.349 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 15 2024-09-21T08:08:30.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.346+0000 7f1db6e79640 1 -- 172.21.15.107:0/1096304146 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1da006e530 msgr2=0x7f1da00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.346+0000 7f1db6e79640 1 --2- 172.21.15.107:0/1096304146 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1da006e530 0x7f1da00709e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1db010ea40 tx=0x7f1d9c009040 comp rx=0 tx=0).stop 2024-09-21T08:08:30.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.346+0000 7f1db6e79640 1 -- 172.21.15.107:0/1096304146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1db0065300 msgr2=0x7f1db0113180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.346+0000 7f1db6e79640 1 --2- 172.21.15.107:0/1096304146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1db0065300 0x7f1db0113180 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1da4003080 tx=0x7f1da4009da0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.346+0000 7f1db6e79640 1 -- 172.21.15.107:0/1096304146 shutdown_connections 2024-09-21T08:08:30.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.346+0000 7f1db6e79640 1 --2- 172.21.15.107:0/1096304146 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1da006e530 0x7f1da00709e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.346+0000 7f1db6e79640 1 --2- 172.21.15.107:0/1096304146 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1db0065c10 0x7f1db01136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.346+0000 7f1db6e79640 1 --2- 172.21.15.107:0/1096304146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1db0065300 0x7f1db0113180 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.346+0000 7f1db6e79640 1 -- 172.21.15.107:0/1096304146 >> 172.21.15.107:0/1096304146 conn(0x7f1db00723b0 msgr2=0x7f1db0105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:30.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.346+0000 7f1db6e79640 1 -- 172.21.15.107:0/1096304146 shutdown_connections 2024-09-21T08:08:30.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.347+0000 7f1db6e79640 1 -- 172.21.15.107:0/1096304146 wait complete. 2024-09-21T08:08:30.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.429+0000 7f74d3622640 1 -- 172.21.15.107:0/1695165461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74cc064fe0 msgr2=0x7f74cc065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.429+0000 7f74d3622640 1 --2- 172.21.15.107:0/1695165461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74cc064fe0 0x7f74cc065430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0048d0 tx=0x7f74bc009da0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.429+0000 7f74d3622640 1 -- 172.21.15.107:0/1695165461 shutdown_connections 2024-09-21T08:08:30.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.429+0000 7f74d3622640 1 --2- 172.21.15.107:0/1695165461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74cc064fe0 0x7f74cc065430 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.429+0000 7f74d3622640 1 --2- 172.21.15.107:0/1695165461 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f74cc0fe450 0x7f74cc0fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.429+0000 7f74d3622640 1 -- 172.21.15.107:0/1695165461 >> 172.21.15.107:0/1695165461 conn(0x7f74cc0723b0 msgr2=0x7f74cc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:30.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.429+0000 7f74d3622640 1 -- 172.21.15.107:0/1695165461 shutdown_connections 2024-09-21T08:08:30.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.429+0000 7f74d3622640 1 -- 172.21.15.107:0/1695165461 wait complete. 2024-09-21T08:08:30.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.430+0000 7f74d3622640 1 Processor -- start 2024-09-21T08:08:30.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.430+0000 7f74d3622640 1 -- start start 2024-09-21T08:08:30.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.430+0000 7f74d3622640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74cc064fe0 0x7f74cc1131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.430+0000 7f74d3622640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f74cc0fe450 0x7f74cc1136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.430+0000 7f74d3622640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc113cf0 con 0x7f74cc064fe0 2024-09-21T08:08:30.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.430+0000 7f74d3622640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc10d130 con 0x7f74cc0fe450 2024-09-21T08:08:30.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.430+0000 7f74d13be640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74cc064fe0 0x7f74cc1131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.430+0000 7f74d13be640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74cc064fe0 0x7f74cc1131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34068/0 (socket says 172.21.15.107:34068) 2024-09-21T08:08:30.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.430+0000 7f74d13be640 1 -- 172.21.15.107:0/173364317 learned_addr learned my addr 172.21.15.107:0/173364317 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:08:30.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.430+0000 7f74d0bbd640 1 --2- 172.21.15.107:0/173364317 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f74cc0fe450 0x7f74cc1136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.431+0000 7f74d13be640 1 -- 172.21.15.107:0/173364317 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f74cc0fe450 msgr2=0x7f74cc1136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.431+0000 7f74d13be640 1 --2- 172.21.15.107:0/173364317 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f74cc0fe450 0x7f74cc1136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.431+0000 7f74d13be640 1 -- 172.21.15.107:0/173364317 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc005040 con 0x7f74cc064fe0 2024-09-21T08:08:30.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.431+0000 7f74d0bbd640 1 --2- 172.21.15.107:0/173364317 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f74cc0fe450 0x7f74cc1136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:08:30.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.431+0000 7f74d13be640 1 --2- 172.21.15.107:0/173364317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74cc064fe0 0x7f74cc1131b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f74c800c810 tx=0x7f74c80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:30.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.431+0000 7f74c1ffb640 1 -- 172.21.15.107:0/173364317 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74c800a820 con 0x7f74cc064fe0 2024-09-21T08:08:30.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.431+0000 7f74c1ffb640 1 -- 172.21.15.107:0/173364317 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f74c800ae20 con 0x7f74cc064fe0 2024-09-21T08:08:30.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.431+0000 7f74c1ffb640 1 -- 172.21.15.107:0/173364317 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74c80115c0 con 0x7f74cc064fe0 2024-09-21T08:08:30.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.431+0000 7f74d3622640 1 -- 172.21.15.107:0/173364317 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74cc10d410 con 0x7f74cc064fe0 2024-09-21T08:08:30.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.432+0000 7f74d3622640 1 -- 172.21.15.107:0/173364317 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74cc10d950 con 0x7f74cc064fe0 2024-09-21T08:08:30.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.433+0000 7f74d3622640 1 -- 172.21.15.107:0/173364317 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74cc0fdce0 con 0x7f74cc064fe0 2024-09-21T08:08:30.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.433+0000 7f74c1ffb640 1 -- 172.21.15.107:0/173364317 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f74c8012840 con 0x7f74cc064fe0 2024-09-21T08:08:30.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.434+0000 7f74c1ffb640 1 --2- 172.21.15.107:0/173364317 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f74b806e530 0x7f74b80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.434+0000 7f74c1ffb640 1 -- 172.21.15.107:0/173364317 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f74c808dba0 con 0x7f74cc064fe0 2024-09-21T08:08:30.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.434+0000 7f74d0bbd640 1 --2- 172.21.15.107:0/173364317 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f74b806e530 0x7f74b80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.435+0000 7f74d0bbd640 1 --2- 172.21.15.107:0/173364317 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f74b806e530 0x7f74b80709e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00b020 tx=0x7f74bc009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:30.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.440+0000 7f74c1ffb640 1 -- 172.21.15.107:0/173364317 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f74c805a7d0 con 0x7f74cc064fe0 2024-09-21T08:08:30.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.641+0000 7f74d3622640 1 -- 172.21.15.107:0/173364317 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f74cc10e820 con 0x7f74b806e530 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.642+0000 7f74c1ffb640 1 -- 172.21.15.107:0/173364317 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f74cc10e820 con 0x7f74b806e530 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi107.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5", 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi107.stdout: "in_progress": true, 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi107.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi107.stdout: "services_complete": [ 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr", 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi107.stdout: "mon", 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi107.stdout: "crash" 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi107.stdout: "progress": "9/21 daemons upgraded", 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi107.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T08:08:30.645 INFO:teuthology.orchestra.run.smithi107.stdout: "is_paused": false 2024-09-21T08:08:30.645 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.644+0000 7f74d3622640 1 -- 172.21.15.107:0/173364317 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f74b806e530 msgr2=0x7f74b80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.644+0000 7f74d3622640 1 --2- 172.21.15.107:0/173364317 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f74b806e530 0x7f74b80709e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00b020 tx=0x7f74bc009da0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.644+0000 7f74d3622640 1 -- 172.21.15.107:0/173364317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74cc064fe0 msgr2=0x7f74cc1131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.644+0000 7f74d3622640 1 --2- 172.21.15.107:0/173364317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74cc064fe0 0x7f74cc1131b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f74c800c810 tx=0x7f74c80043c0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.644+0000 7f74d3622640 1 -- 172.21.15.107:0/173364317 shutdown_connections 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.645+0000 7f74d3622640 1 --2- 172.21.15.107:0/173364317 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f74b806e530 0x7f74b80709e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.645+0000 7f74d3622640 1 --2- 172.21.15.107:0/173364317 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f74cc0fe450 0x7f74cc1136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.645+0000 7f74d3622640 1 --2- 172.21.15.107:0/173364317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74cc064fe0 0x7f74cc1131b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.645+0000 7f74d3622640 1 -- 172.21.15.107:0/173364317 >> 172.21.15.107:0/173364317 conn(0x7f74cc0723b0 msgr2=0x7f74cc105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:30.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.645+0000 7f74d3622640 1 -- 172.21.15.107:0/173364317 shutdown_connections 2024-09-21T08:08:30.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.645+0000 7f74d3622640 1 -- 172.21.15.107:0/173364317 wait complete. 2024-09-21T08:08:30.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.723+0000 7fd06c5a0640 1 -- 172.21.15.107:0/1713480936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd064102ed0 msgr2=0x7fd0640fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.723+0000 7fd06c5a0640 1 --2- 172.21.15.107:0/1713480936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd064102ed0 0x7fd0640fc590 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd0540048d0 tx=0x7fd054009da0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.723+0000 7fd06c5a0640 1 -- 172.21.15.107:0/1713480936 shutdown_connections 2024-09-21T08:08:30.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.723+0000 7fd06c5a0640 1 --2- 172.21.15.107:0/1713480936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd064102ed0 0x7fd0640fc590 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.723+0000 7fd06c5a0640 1 --2- 172.21.15.107:0/1713480936 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd064102530 0x7fd064102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.723+0000 7fd06c5a0640 1 -- 172.21.15.107:0/1713480936 >> 172.21.15.107:0/1713480936 conn(0x7fd0640f80f0 msgr2=0x7fd0640fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:30.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.724+0000 7fd06c5a0640 1 -- 172.21.15.107:0/1713480936 shutdown_connections 2024-09-21T08:08:30.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.724+0000 7fd06c5a0640 1 -- 172.21.15.107:0/1713480936 wait complete. 2024-09-21T08:08:30.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.724+0000 7fd06c5a0640 1 Processor -- start 2024-09-21T08:08:30.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.724+0000 7fd06c5a0640 1 -- start start 2024-09-21T08:08:30.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.724+0000 7fd06c5a0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd064102530 0x7fd0641132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.724+0000 7fd06c5a0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd064102ed0 0x7fd0641137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.724+0000 7fd06c5a0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd064113e80 con 0x7fd064102ed0 2024-09-21T08:08:30.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.724+0000 7fd06c5a0640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06410d230 con 0x7fd064102530 2024-09-21T08:08:30.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.724+0000 7fd069b3b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd064102ed0 0x7fd0641137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.724+0000 7fd069b3b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd064102ed0 0x7fd0641137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34100/0 (socket says 172.21.15.107:34100) 2024-09-21T08:08:30.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.724+0000 7fd069b3b640 1 -- 172.21.15.107:0/3075389545 learned_addr learned my addr 172.21.15.107:0/3075389545 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:08:30.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.725+0000 7fd06a33c640 1 --2- 172.21.15.107:0/3075389545 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd064102530 0x7fd0641132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.725+0000 7fd069b3b640 1 -- 172.21.15.107:0/3075389545 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd064102530 msgr2=0x7fd0641132b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.725+0000 7fd069b3b640 1 --2- 172.21.15.107:0/3075389545 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd064102530 0x7fd0641132b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.725+0000 7fd069b3b640 1 -- 172.21.15.107:0/3075389545 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd054005040 con 0x7fd064102ed0 2024-09-21T08:08:30.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.725+0000 7fd069b3b640 1 --2- 172.21.15.107:0/3075389545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd064102ed0 0x7fd0641137f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd054003080 tx=0x7fd054009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:30.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.725+0000 7fd05affd640 1 -- 172.21.15.107:0/3075389545 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd054038070 con 0x7fd064102ed0 2024-09-21T08:08:30.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.725+0000 7fd05affd640 1 -- 172.21.15.107:0/3075389545 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd054009760 con 0x7fd064102ed0 2024-09-21T08:08:30.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.725+0000 7fd05affd640 1 -- 172.21.15.107:0/3075389545 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd054033420 con 0x7fd064102ed0 2024-09-21T08:08:30.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.725+0000 7fd06c5a0640 1 -- 172.21.15.107:0/3075389545 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06410d4b0 con 0x7fd064102ed0 2024-09-21T08:08:30.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.725+0000 7fd06c5a0640 1 -- 172.21.15.107:0/3075389545 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06410d910 con 0x7fd064102ed0 2024-09-21T08:08:30.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.726+0000 7fd06c5a0640 1 -- 172.21.15.107:0/3075389545 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0640fdcb0 con 0x7fd064102ed0 2024-09-21T08:08:30.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.727+0000 7fd05affd640 1 -- 172.21.15.107:0/3075389545 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd054030020 con 0x7fd064102ed0 2024-09-21T08:08:30.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.727+0000 7fd05affd640 1 --2- 172.21.15.107:0/3075389545 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fd05006e530 0x7fd0500709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.727+0000 7fd05affd640 1 -- 172.21.15.107:0/3075389545 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd0540add20 con 0x7fd064102ed0 2024-09-21T08:08:30.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.727+0000 7fd06a33c640 1 --2- 172.21.15.107:0/3075389545 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fd05006e530 0x7fd0500709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.728+0000 7fd06a33c640 1 --2- 172.21.15.107:0/3075389545 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fd05006e530 0x7fd0500709e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd060006fd0 tx=0x7fd060008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:30.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.732+0000 7fd05affd640 1 -- 172.21.15.107:0/3075389545 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd054076f30 con 0x7fd064102ed0 2024-09-21T08:08:30.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.977+0000 7fd06c5a0640 1 -- 172.21.15.107:0/3075389545 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd0640fbd30 con 0x7fd064102ed0 2024-09-21T08:08:30.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.978+0000 7fd05affd640 1 -- 172.21.15.107:0/3075389545 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+884 (secure 0 0 0) 0x7fd05407a5f0 con 0x7fd064102ed0 2024-09-21T08:08:30.980 INFO:teuthology.orchestra.run.smithi107.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 29/219 objects degraded (13.242%), 11 pgs degraded 2024-09-21T08:08:30.980 INFO:teuthology.orchestra.run.smithi107.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T08:08:30.980 INFO:teuthology.orchestra.run.smithi107.stdout: osd.2 (root=default,host=smithi107) is down 2024-09-21T08:08:30.980 INFO:teuthology.orchestra.run.smithi107.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 29/219 objects degraded (13.242%), 11 pgs degraded 2024-09-21T08:08:30.980 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-21T08:08:30.980 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-21T08:08:30.980 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-21T08:08:30.980 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-09-21T08:08:30.980 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-21T08:08:30.981 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-21T08:08:30.981 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-21T08:08:30.981 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-21T08:08:30.981 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-21T08:08:30.981 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-21T08:08:30.981 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-21T08:08:30.981 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:30 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2[120603]: 2024-09-21T08:08:30.589+0000 7f222d967640 -1 osd.2 57 log_to_monitors true 2024-09-21T08:08:30.981 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:08:30 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2[120603]: 2024-09-21T08:08:30.782+0000 7f2225701640 -1 osd.2 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T08:08:30.981 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:30 smithi107 ceph-mon[97757]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:08:30.981 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:30 smithi107 ceph-mon[97757]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:08:30.982 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:30 smithi107 ceph-mon[97757]: pgmap v90: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-21T08:08:30.982 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:30 smithi107 ceph-mon[97757]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:08:30.982 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:30 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/2589683368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:08:30.982 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:30 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/1096304146' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:08:30.982 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:30 smithi107 ceph-mon[97757]: from='osd.2 [v2:172.21.15.107:6818/449576708,v1:172.21.15.107:6819/449576708]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-21T08:08:30.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.981+0000 7fd06c5a0640 1 -- 172.21.15.107:0/3075389545 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fd05006e530 msgr2=0x7fd0500709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.981+0000 7fd06c5a0640 1 --2- 172.21.15.107:0/3075389545 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fd05006e530 0x7fd0500709e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd060006fd0 tx=0x7fd060008040 comp rx=0 tx=0).stop 2024-09-21T08:08:30.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.981+0000 7fd06c5a0640 1 -- 172.21.15.107:0/3075389545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd064102ed0 msgr2=0x7fd0641137f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.981+0000 7fd06c5a0640 1 --2- 172.21.15.107:0/3075389545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd064102ed0 0x7fd0641137f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd054003080 tx=0x7fd054009da0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.981+0000 7fd06c5a0640 1 -- 172.21.15.107:0/3075389545 shutdown_connections 2024-09-21T08:08:30.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.981+0000 7fd06c5a0640 1 --2- 172.21.15.107:0/3075389545 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fd05006e530 0x7fd0500709e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.981+0000 7fd06c5a0640 1 --2- 172.21.15.107:0/3075389545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd064102ed0 0x7fd0641137f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.981+0000 7fd06c5a0640 1 --2- 172.21.15.107:0/3075389545 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd064102530 0x7fd0641132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.981+0000 7fd06c5a0640 1 -- 172.21.15.107:0/3075389545 >> 172.21.15.107:0/3075389545 conn(0x7fd0640f80f0 msgr2=0x7fd0640f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:30.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.981+0000 7fd06c5a0640 1 -- 172.21.15.107:0/3075389545 shutdown_connections 2024-09-21T08:08:30.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:08:30.981+0000 7fd06c5a0640 1 -- 172.21.15.107:0/3075389545 wait complete. 2024-09-21T08:08:31.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:30 smithi129 ceph-mon[76722]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:08:31.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:30 smithi129 ceph-mon[76722]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:08:31.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:30 smithi129 ceph-mon[76722]: pgmap v90: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-21T08:08:31.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:30 smithi129 ceph-mon[76722]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:08:31.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:30 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/2589683368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:08:31.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:30 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/1096304146' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:08:31.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:30 smithi129 ceph-mon[76722]: from='osd.2 [v2:172.21.15.107:6818/449576708,v1:172.21.15.107:6819/449576708]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-21T08:08:31.996 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:31 smithi107 ceph-mon[97757]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:08:31.997 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:31 smithi107 ceph-mon[97757]: from='osd.2 [v2:172.21.15.107:6818/449576708,v1:172.21.15.107:6819/449576708]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T08:08:31.997 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:31 smithi107 ceph-mon[97757]: osdmap e60: 6 total, 5 up, 6 in 2024-09-21T08:08:31.997 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:31 smithi107 ceph-mon[97757]: from='osd.2 [v2:172.21.15.107:6818/449576708,v1:172.21.15.107:6819/449576708]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-21T08:08:31.997 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:31 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/3075389545' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:08:32.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:31 smithi129 ceph-mon[76722]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:08:32.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:31 smithi129 ceph-mon[76722]: from='osd.2 [v2:172.21.15.107:6818/449576708,v1:172.21.15.107:6819/449576708]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T08:08:32.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:31 smithi129 ceph-mon[76722]: osdmap e60: 6 total, 5 up, 6 in 2024-09-21T08:08:32.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:31 smithi129 ceph-mon[76722]: from='osd.2 [v2:172.21.15.107:6818/449576708,v1:172.21.15.107:6819/449576708]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-21T08:08:32.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:31 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/3075389545' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:08:33.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:32 smithi107 ceph-mon[97757]: pgmap v92: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-21T08:08:33.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:32 smithi107 ceph-mon[97757]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T08:08:33.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:32 smithi107 ceph-mon[97757]: osd.2 [v2:172.21.15.107:6818/449576708,v1:172.21.15.107:6819/449576708] boot 2024-09-21T08:08:33.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:32 smithi107 ceph-mon[97757]: osdmap e61: 6 total, 6 up, 6 in 2024-09-21T08:08:33.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:32 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T08:08:33.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:32 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:33.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:32 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:33.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:32 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:08:33.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:32 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:08:33.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:32 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:33.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:32 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:08:33.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:32 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:08:33.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:32 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:08:33.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:32 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:08:33.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:32 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T08:08:33.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:32 smithi107 ceph-mon[97757]: osdmap e62: 6 total, 6 up, 6 in 2024-09-21T08:08:33.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:32 smithi129 ceph-mon[76722]: pgmap v92: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-21T08:08:33.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:32 smithi129 ceph-mon[76722]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T08:08:33.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:32 smithi129 ceph-mon[76722]: osd.2 [v2:172.21.15.107:6818/449576708,v1:172.21.15.107:6819/449576708] boot 2024-09-21T08:08:33.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:32 smithi129 ceph-mon[76722]: osdmap e61: 6 total, 6 up, 6 in 2024-09-21T08:08:33.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:32 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T08:08:33.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:32 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:33.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:32 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:33.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:32 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:08:33.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:32 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:08:33.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:32 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:33.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:32 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:08:33.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:32 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:08:33.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:32 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:08:33.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:32 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:08:33.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:32 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T08:08:33.268 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:32 smithi129 ceph-mon[76722]: osdmap e62: 6 total, 6 up, 6 in 2024-09-21T08:08:34.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:33 smithi107 ceph-mon[97757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T08:08:34.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:33 smithi107 ceph-mon[97757]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T08:08:34.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:33 smithi129 ceph-mon[76722]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T08:08:34.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:33 smithi129 ceph-mon[76722]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T08:08:35.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:34 smithi107 ceph-mon[97757]: pgmap v95: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-21T08:08:35.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:34 smithi129 ceph-mon[76722]: pgmap v95: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-21T08:08:36.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:35 smithi129 ceph-mon[76722]: Health check update: Degraded data redundancy: 22/219 objects degraded (10.046%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T08:08:36.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:35 smithi107 ceph-mon[97757]: Health check update: Degraded data redundancy: 22/219 objects degraded (10.046%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T08:08:37.168 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:36 smithi129 ceph-mon[76722]: pgmap v96: 65 pgs: 10 active+undersized, 7 active+undersized+degraded, 48 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22/219 objects degraded (10.046%) 2024-09-21T08:08:37.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:36 smithi107 ceph-mon[97757]: pgmap v96: 65 pgs: 10 active+undersized, 7 active+undersized+degraded, 48 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22/219 objects degraded (10.046%) 2024-09-21T08:08:38.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:37 smithi129 ceph-mon[76722]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/219 objects degraded (10.046%), 7 pgs degraded) 2024-09-21T08:08:38.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:37 smithi129 ceph-mon[76722]: Cluster is now healthy 2024-09-21T08:08:38.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:37 smithi107 ceph-mon[97757]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/219 objects degraded (10.046%), 7 pgs degraded) 2024-09-21T08:08:38.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:37 smithi107 ceph-mon[97757]: Cluster is now healthy 2024-09-21T08:08:39.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:38 smithi129 ceph-mon[76722]: pgmap v97: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:38 smithi107 ceph-mon[97757]: pgmap v97: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:41.252 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:40 smithi107 ceph-mon[97757]: pgmap v98: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:41.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:40 smithi129 ceph-mon[76722]: pgmap v98: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:43.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:42 smithi107 ceph-mon[97757]: pgmap v99: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:43.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:42 smithi129 ceph-mon[76722]: pgmap v99: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:45.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:44 smithi129 ceph-mon[76722]: pgmap v100: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:45.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:44 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:45.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:44 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:08:45.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:44 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:45.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:44 smithi107 ceph-mon[97757]: pgmap v100: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:45.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:44 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:45.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:44 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:08:45.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:44 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:47.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:46 smithi129 ceph-mon[76722]: pgmap v101: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:47.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:46 smithi107 ceph-mon[97757]: pgmap v101: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:48.212 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:47 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T08:08:48.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:47 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T08:08:49.167 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:48 smithi129 ceph-mon[76722]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T08:08:49.167 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:48 smithi129 ceph-mon[76722]: Upgrade: osd.3 is safe to restart 2024-09-21T08:08:49.167 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:48 smithi129 ceph-mon[76722]: pgmap v102: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:49.167 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:48 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:49.167 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:48 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-21T08:08:49.167 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:48 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:08:49.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:48 smithi107 ceph-mon[97757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T08:08:49.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:48 smithi107 ceph-mon[97757]: Upgrade: osd.3 is safe to restart 2024-09-21T08:08:49.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:48 smithi107 ceph-mon[97757]: pgmap v102: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:49.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:48 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:49.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:48 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-21T08:08:49.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:48 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:08:50.224 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:49 smithi129 ceph-mon[76722]: Upgrade: Updating osd.3 2024-09-21T08:08:50.225 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:49 smithi129 ceph-mon[76722]: Deploying daemon osd.3 on smithi129 2024-09-21T08:08:50.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:49 smithi107 ceph-mon[97757]: Upgrade: Updating osd.3 2024-09-21T08:08:50.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:49 smithi107 ceph-mon[97757]: Deploying daemon osd.3 on smithi129 2024-09-21T08:08:51.251 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:50 smithi129 ceph-mon[76722]: pgmap v103: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:51.253 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:50 smithi107 ceph-mon[97757]: pgmap v103: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:51.516 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:51 smithi129 systemd[1]: Stopping Ceph osd.3 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:08:52.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:51 smithi129 ceph-mon[76722]: pgmap v104: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:52.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:51 smithi129 ceph-mon[76722]: osd.3 marked itself down and dead 2024-09-21T08:08:52.017 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:51 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3[39767]: 2024-09-21T08:08:51.706+0000 7f05dde0f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:08:52.017 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:51 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3[39767]: 2024-09-21T08:08:51.706+0000 7f05dde0f640 -1 osd.3 62 *** Got signal Terminated *** 2024-09-21T08:08:52.017 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:51 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3[39767]: 2024-09-21T08:08:51.706+0000 7f05dde0f640 -1 osd.3 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:08:52.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:51 smithi107 ceph-mon[97757]: pgmap v104: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:52.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:51 smithi107 ceph-mon[97757]: osd.3 marked itself down and dead 2024-09-21T08:08:52.766 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:52 smithi129 podman[85083]: 2024-09-21 08:08:52.48022476 +0000 UTC m=+0.858507511 container died 7d58f70b105cc2e7fa06feab7c30ba27199220b8e34d079de8f67bc648667c75 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=quincy-fbd1a6a, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:08:53.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:52 smithi129 ceph-mon[76722]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T08:08:53.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:52 smithi129 ceph-mon[76722]: osdmap e63: 6 total, 5 up, 6 in 2024-09-21T08:08:53.017 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:52 smithi129 podman[85083]: 2024-09-21 08:08:52.864307851 +0000 UTC m=+1.242590612 container cleanup 7d58f70b105cc2e7fa06feab7c30ba27199220b8e34d079de8f67bc648667c75 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=quincy-fbd1a6a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T08:08:53.017 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:52 smithi129 bash[85083]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3 2024-09-21T08:08:53.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:52 smithi107 ceph-mon[97757]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T08:08:53.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:52 smithi107 ceph-mon[97757]: osdmap e63: 6 total, 5 up, 6 in 2024-09-21T08:08:53.482 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:53 smithi129 podman[85109]: 2024-09-21 08:08:53.140880617 +0000 UTC m=+0.655313568 container remove 7d58f70b105cc2e7fa06feab7c30ba27199220b8e34d079de8f67bc648667c75 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-fbd1a6a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T08:08:53.766 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:53 smithi129 podman[85202]: 2024-09-21 08:08:53.384311312 +0000 UTC m=+0.016301188 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:08:53.767 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:53 smithi129 podman[85202]: 2024-09-21 08:08:53.500030687 +0000 UTC m=+0.132020565 container create 55f78a2290a3cd59baa4e863d1b550424403be421a79c31e1d9c6ce58d6a79b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-deactivate, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T08:08:54.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:53 smithi129 ceph-mon[76722]: osdmap e64: 6 total, 5 up, 6 in 2024-09-21T08:08:54.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:53 smithi129 ceph-mon[76722]: pgmap v107: 65 pgs: 16 stale+active+clean, 49 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:54.267 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:53 smithi129 podman[85202]: 2024-09-21 08:08:53.76923036 +0000 UTC m=+0.401220241 container init 55f78a2290a3cd59baa4e863d1b550424403be421a79c31e1d9c6ce58d6a79b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:08:54.267 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:53 smithi129 podman[85202]: 2024-09-21 08:08:53.772747783 +0000 UTC m=+0.404737665 container start 55f78a2290a3cd59baa4e863d1b550424403be421a79c31e1d9c6ce58d6a79b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T08:08:54.267 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:53 smithi129 podman[85202]: 2024-09-21 08:08:53.85245469 +0000 UTC m=+0.484444580 container attach 55f78a2290a3cd59baa4e863d1b550424403be421a79c31e1d9c6ce58d6a79b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T08:08:54.267 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:53 smithi129 podman[85202]: 2024-09-21 08:08:53.956693778 +0000 UTC m=+0.588683657 container died 55f78a2290a3cd59baa4e863d1b550424403be421a79c31e1d9c6ce58d6a79b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T08:08:54.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:53 smithi107 ceph-mon[97757]: osdmap e64: 6 total, 5 up, 6 in 2024-09-21T08:08:54.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:53 smithi107 ceph-mon[97757]: pgmap v107: 65 pgs: 16 stale+active+clean, 49 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:08:55.017 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:54 smithi129 podman[85225]: 2024-09-21 08:08:54.597547049 +0000 UTC m=+0.631692471 container remove 55f78a2290a3cd59baa4e863d1b550424403be421a79c31e1d9c6ce58d6a79b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, GIT_CLEAN=True) 2024-09-21T08:08:55.017 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:54 smithi129 systemd[1]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.3.service: Deactivated successfully. 2024-09-21T08:08:55.017 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:54 smithi129 systemd[1]: Stopped Ceph osd.3 for 786d4f32-77ee-11ef-baf6-efdc52797490. 2024-09-21T08:08:55.017 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:54 smithi129 systemd[1]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.3.service: Consumed 1min 9.583s CPU time. 2024-09-21T08:08:55.017 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:54 smithi129 systemd[1]: Starting Ceph osd.3 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:08:55.310 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:55 smithi129 podman[85324]: 2024-09-21 08:08:54.925928464 +0000 UTC m=+0.015542824 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:08:55.310 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:55 smithi129 podman[85324]: 2024-09-21 08:08:55.040300341 +0000 UTC m=+0.129914753 container create 4b6a0a323d2a6223c43f52958bceb461b4998b1587eba8442711471c63050659 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-activate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T08:08:55.310 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:55 smithi129 podman[85324]: 2024-09-21 08:08:55.234611774 +0000 UTC m=+0.324226141 container init 4b6a0a323d2a6223c43f52958bceb461b4998b1587eba8442711471c63050659 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-activate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T08:08:55.310 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:55 smithi129 podman[85324]: 2024-09-21 08:08:55.237884108 +0000 UTC m=+0.327498478 container start 4b6a0a323d2a6223c43f52958bceb461b4998b1587eba8442711471c63050659 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-activate, ceph=True, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T08:08:55.310 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:55 smithi129 podman[85324]: 2024-09-21 08:08:55.309371548 +0000 UTC m=+0.398985917 container attach 4b6a0a323d2a6223c43f52958bceb461b4998b1587eba8442711471c63050659 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T08:08:55.731 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:55 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-activate[85338]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:08:55.731 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:55 smithi129 bash[85324]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:08:55.731 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:55 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-activate[85338]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:08:55.732 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:55 smithi129 bash[85324]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:08:56.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:55 smithi129 ceph-mon[76722]: Health check failed: Degraded data redundancy: 23/219 objects degraded (10.502%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T08:08:56.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:55 smithi107 ceph-mon[97757]: Health check failed: Degraded data redundancy: 23/219 objects degraded (10.502%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T08:08:56.393 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:56 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-activate[85338]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T08:08:56.394 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:56 smithi129 bash[85324]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T08:08:56.394 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:56 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-activate[85338]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-21T08:08:56.394 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:56 smithi129 bash[85324]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-21T08:08:56.713 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:56 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-activate[85338]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-21T08:08:56.714 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:56 smithi129 bash[85324]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-21T08:08:56.714 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:56 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-activate[85338]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T08:08:56.714 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:56 smithi129 bash[85324]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T08:08:56.714 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:56 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-activate[85338]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-21T08:08:56.714 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:56 smithi129 bash[85324]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-21T08:08:56.714 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:56 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-activate[85338]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T08:08:56.714 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:56 smithi129 bash[85324]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T08:08:56.714 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:56 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-activate[85338]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-21T08:08:56.714 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:56 smithi129 bash[85324]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-21T08:08:56.714 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:56 smithi129 podman[85324]: 2024-09-21 08:08:56.42202518 +0000 UTC m=+1.511639549 container died 4b6a0a323d2a6223c43f52958bceb461b4998b1587eba8442711471c63050659 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:08:56.988 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:56 smithi129 ceph-mon[76722]: pgmap v108: 65 pgs: 11 active+undersized, 6 stale+active+clean, 7 active+undersized+degraded, 41 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 23/219 objects degraded (10.502%) 2024-09-21T08:08:57.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:56 smithi107 ceph-mon[97757]: pgmap v108: 65 pgs: 11 active+undersized, 6 stale+active+clean, 7 active+undersized+degraded, 41 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 23/219 objects degraded (10.502%) 2024-09-21T08:08:57.266 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:56 smithi129 podman[85483]: 2024-09-21 08:08:56.988023503 +0000 UTC m=+0.557154758 container remove 4b6a0a323d2a6223c43f52958bceb461b4998b1587eba8442711471c63050659 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-activate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T08:08:57.267 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:57 smithi129 podman[85542]: 2024-09-21 08:08:57.18890228 +0000 UTC m=+0.111754179 container create ee4efea3e442aeb7cadb5de8fdc1d49dd496cca00e13e96876010b3bf41dc7b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T08:08:57.267 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:57 smithi129 podman[85542]: 2024-09-21 08:08:57.093087259 +0000 UTC m=+0.015939113 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:08:57.766 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:57 smithi129 podman[85542]: 2024-09-21 08:08:57.40012161 +0000 UTC m=+0.322973466 container init ee4efea3e442aeb7cadb5de8fdc1d49dd496cca00e13e96876010b3bf41dc7b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731) 2024-09-21T08:08:57.767 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:57 smithi129 podman[85542]: 2024-09-21 08:08:57.403625363 +0000 UTC m=+0.326477217 container start ee4efea3e442aeb7cadb5de8fdc1d49dd496cca00e13e96876010b3bf41dc7b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:08:57.767 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:57 smithi129 ceph-osd[85561]: -- 172.21.15.129:0/3830065698 <== mon.1 v2:172.21.15.129:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5563465461e0 con 0x55634575bc00 2024-09-21T08:08:57.767 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:57 smithi129 bash[85542]: ee4efea3e442aeb7cadb5de8fdc1d49dd496cca00e13e96876010b3bf41dc7b6 2024-09-21T08:08:57.767 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:57 smithi129 systemd[1]: Started Ceph osd.3 for 786d4f32-77ee-11ef-baf6-efdc52797490. 2024-09-21T08:08:58.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:58 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:58.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:58 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:58.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:58 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:08:58.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:08:58 smithi107 ceph-mon[97757]: pgmap v109: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-21T08:08:58.864 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:58 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:58.865 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:58 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:08:58.865 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:58 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:08:58.865 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:08:58 smithi129 ceph-mon[76722]: pgmap v109: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-21T08:08:59.123 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:08:59 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3[85557]: 2024-09-21T08:08:59.048+0000 7fc47660c640 -1 Falling back to public interface 2024-09-21T08:09:01.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:00 smithi129 ceph-mon[76722]: pgmap v110: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-21T08:09:01.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:00 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:01.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:00 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:09:01.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:00 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:01.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:00 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:00 smithi107 ceph-mon[97757]: pgmap v110: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-21T08:09:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:00 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:00 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:09:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:00 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:00 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:01.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.072+0000 7f72210dd640 1 -- 172.21.15.107:0/1092816269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f721c0fdf20 msgr2=0x7f721c1065f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:01.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.072+0000 7f72210dd640 1 --2- 172.21.15.107:0/1092816269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f721c0fdf20 0x7f721c1065f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f72100048d0 tx=0x7f7210009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.072+0000 7f72210dd640 1 -- 172.21.15.107:0/1092816269 shutdown_connections 2024-09-21T08:09:01.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.073+0000 7f72210dd640 1 --2- 172.21.15.107:0/1092816269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f721c0fdf20 0x7f721c1065f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.073+0000 7f72210dd640 1 --2- 172.21.15.107:0/1092816269 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f721c0fd580 0x7f721c0fd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.073+0000 7f72210dd640 1 -- 172.21.15.107:0/1092816269 >> 172.21.15.107:0/1092816269 conn(0x7f721c0f7000 msgr2=0x7f721c0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:01.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.073+0000 7f72210dd640 1 -- 172.21.15.107:0/1092816269 shutdown_connections 2024-09-21T08:09:01.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.073+0000 7f72210dd640 1 -- 172.21.15.107:0/1092816269 wait complete. 2024-09-21T08:09:01.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.073+0000 7f72210dd640 1 Processor -- start 2024-09-21T08:09:01.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.073+0000 7f72210dd640 1 -- start start 2024-09-21T08:09:01.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.074+0000 7f72210dd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f721c0fd580 0x7f721c113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:01.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.074+0000 7f72210dd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f721c0fdf20 0x7f721c1137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:01.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.074+0000 7f72210dd640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c113dd0 con 0x7f721c0fdf20 2024-09-21T08:09:01.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.074+0000 7f72210dd640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c10d210 con 0x7f721c0fd580 2024-09-21T08:09:01.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.074+0000 7f721a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f721c0fdf20 0x7f721c1137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:01.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.074+0000 7f721a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f721c0fdf20 0x7f721c1137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55954/0 (socket says 172.21.15.107:55954) 2024-09-21T08:09:01.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.074+0000 7f721a59c640 1 -- 172.21.15.107:0/3658537474 learned_addr learned my addr 172.21.15.107:0/3658537474 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:09:01.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.074+0000 7f721ad9d640 1 --2- 172.21.15.107:0/3658537474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f721c0fd580 0x7f721c113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:01.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.074+0000 7f721a59c640 1 -- 172.21.15.107:0/3658537474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f721c0fd580 msgr2=0x7f721c113290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:01.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.074+0000 7f721a59c640 1 --2- 172.21.15.107:0/3658537474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f721c0fd580 0x7f721c113290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.074+0000 7f721a59c640 1 -- 172.21.15.107:0/3658537474 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7210005040 con 0x7f721c0fdf20 2024-09-21T08:09:01.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.074+0000 7f721a59c640 1 --2- 172.21.15.107:0/3658537474 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f721c0fdf20 0x7f721c1137d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7210000c00 tx=0x7f7210009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:01.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.074+0000 7f72037fe640 1 -- 172.21.15.107:0/3658537474 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7210038070 con 0x7f721c0fdf20 2024-09-21T08:09:01.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.074+0000 7f72037fe640 1 -- 172.21.15.107:0/3658537474 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f721002ade0 con 0x7f721c0fdf20 2024-09-21T08:09:01.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.074+0000 7f72210dd640 1 -- 172.21.15.107:0/3658537474 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721c10d490 con 0x7f721c0fdf20 2024-09-21T08:09:01.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.074+0000 7f72037fe640 1 -- 172.21.15.107:0/3658537474 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f721002c7d0 con 0x7f721c0fdf20 2024-09-21T08:09:01.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.075+0000 7f72210dd640 1 -- 172.21.15.107:0/3658537474 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721c10d950 con 0x7f721c0fdf20 2024-09-21T08:09:01.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.076+0000 7f72210dd640 1 -- 172.21.15.107:0/3658537474 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721c066290 con 0x7f721c0fdf20 2024-09-21T08:09:01.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.076+0000 7f72037fe640 1 -- 172.21.15.107:0/3658537474 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f7210030020 con 0x7f721c0fdf20 2024-09-21T08:09:01.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.076+0000 7f72037fe640 1 --2- 172.21.15.107:0/3658537474 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f720406e530 0x7f72040709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:01.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.077+0000 7f72037fe640 1 -- 172.21.15.107:0/3658537474 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f72100ae430 con 0x7f721c0fdf20 2024-09-21T08:09:01.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.077+0000 7f721ad9d640 1 --2- 172.21.15.107:0/3658537474 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f720406e530 0x7f72040709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:01.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.077+0000 7f721ad9d640 1 --2- 172.21.15.107:0/3658537474 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f720406e530 0x7f72040709e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f720c009af0 tx=0x7f720c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:01.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.081+0000 7f72037fe640 1 -- 172.21.15.107:0/3658537474 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7210077640 con 0x7f721c0fdf20 2024-09-21T08:09:01.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.265+0000 7f72210dd640 1 -- 172.21.15.107:0/3658537474 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f721c109580 con 0x7f720406e530 2024-09-21T08:09:01.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.266+0000 7f72037fe640 1 -- 172.21.15.107:0/3658537474 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f721c109580 con 0x7f720406e530 2024-09-21T08:09:01.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.269+0000 7f72210dd640 1 -- 172.21.15.107:0/3658537474 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f720406e530 msgr2=0x7f72040709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:01.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.269+0000 7f72210dd640 1 --2- 172.21.15.107:0/3658537474 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f720406e530 0x7f72040709e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f720c009af0 tx=0x7f720c00b040 comp rx=0 tx=0).stop 2024-09-21T08:09:01.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.269+0000 7f72210dd640 1 -- 172.21.15.107:0/3658537474 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f721c0fdf20 msgr2=0x7f721c1137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:01.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.269+0000 7f72210dd640 1 --2- 172.21.15.107:0/3658537474 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f721c0fdf20 0x7f721c1137d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7210000c00 tx=0x7f7210009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.269+0000 7f72210dd640 1 -- 172.21.15.107:0/3658537474 shutdown_connections 2024-09-21T08:09:01.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.269+0000 7f72210dd640 1 --2- 172.21.15.107:0/3658537474 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f720406e530 0x7f72040709e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.269+0000 7f72210dd640 1 --2- 172.21.15.107:0/3658537474 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f721c0fdf20 0x7f721c1137d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.269+0000 7f72210dd640 1 --2- 172.21.15.107:0/3658537474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f721c0fd580 0x7f721c113290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.269+0000 7f72210dd640 1 -- 172.21.15.107:0/3658537474 >> 172.21.15.107:0/3658537474 conn(0x7f721c0f7000 msgr2=0x7f721c0f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:01.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.269+0000 7f72210dd640 1 -- 172.21.15.107:0/3658537474 shutdown_connections 2024-09-21T08:09:01.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.269+0000 7f72210dd640 1 -- 172.21.15.107:0/3658537474 wait complete. 2024-09-21T08:09:01.279 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:09:01.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.348+0000 7f2077d92640 1 -- 172.21.15.107:0/564282383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20700fac60 msgr2=0x7f20700fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:01.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.348+0000 7f2077d92640 1 --2- 172.21.15.107:0/564282383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20700fac60 0x7f20700fb0b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f20600048d0 tx=0x7f2060009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.348+0000 7f2077d92640 1 -- 172.21.15.107:0/564282383 shutdown_connections 2024-09-21T08:09:01.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.348+0000 7f2077d92640 1 --2- 172.21.15.107:0/564282383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20700fac60 0x7f20700fb0b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.348+0000 7f2077d92640 1 --2- 172.21.15.107:0/564282383 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f20701025f0 0x7f20701029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.348+0000 7f2077d92640 1 -- 172.21.15.107:0/564282383 >> 172.21.15.107:0/564282383 conn(0x7f2070070c80 msgr2=0x7f2070071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:01.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.349+0000 7f2077d92640 1 -- 172.21.15.107:0/564282383 shutdown_connections 2024-09-21T08:09:01.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.349+0000 7f2077d92640 1 -- 172.21.15.107:0/564282383 wait complete. 2024-09-21T08:09:01.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.349+0000 7f2077d92640 1 Processor -- start 2024-09-21T08:09:01.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.349+0000 7f2077d92640 1 -- start start 2024-09-21T08:09:01.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.350+0000 7f2077d92640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20700fac60 0x7f2070113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:01.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.350+0000 7f2077d92640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f20701025f0 0x7f2070113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:01.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.350+0000 7f2077d92640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2070113e00 con 0x7f20700fac60 2024-09-21T08:09:01.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.350+0000 7f2077d92640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207010d1b0 con 0x7f20701025f0 2024-09-21T08:09:01.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.350+0000 7f2075b2e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20700fac60 0x7f2070113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:01.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.350+0000 7f2075b2e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20700fac60 0x7f2070113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51156/0 (socket says 172.21.15.107:51156) 2024-09-21T08:09:01.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.350+0000 7f2075b2e640 1 -- 172.21.15.107:0/557578930 learned_addr learned my addr 172.21.15.107:0/557578930 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:09:01.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.350+0000 7f207532d640 1 --2- 172.21.15.107:0/557578930 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f20701025f0 0x7f2070113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:01.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.350+0000 7f2075b2e640 1 -- 172.21.15.107:0/557578930 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f20701025f0 msgr2=0x7f2070113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:01.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.350+0000 7f2075b2e640 1 --2- 172.21.15.107:0/557578930 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f20701025f0 0x7f2070113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.350+0000 7f2075b2e640 1 -- 172.21.15.107:0/557578930 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2060005040 con 0x7f20700fac60 2024-09-21T08:09:01.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.350+0000 7f2075b2e640 1 --2- 172.21.15.107:0/557578930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20700fac60 0x7f2070113230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f206c00b790 tx=0x7f206c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:01.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.350+0000 7f20667fc640 1 -- 172.21.15.107:0/557578930 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f206c00c700 con 0x7f20700fac60 2024-09-21T08:09:01.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.350+0000 7f20667fc640 1 -- 172.21.15.107:0/557578930 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f206c00cd00 con 0x7f20700fac60 2024-09-21T08:09:01.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.350+0000 7f2077d92640 1 -- 172.21.15.107:0/557578930 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f207010d490 con 0x7f20700fac60 2024-09-21T08:09:01.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.351+0000 7f20667fc640 1 -- 172.21.15.107:0/557578930 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f206c015e80 con 0x7f20700fac60 2024-09-21T08:09:01.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.351+0000 7f2077d92640 1 -- 172.21.15.107:0/557578930 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207010d980 con 0x7f20700fac60 2024-09-21T08:09:01.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.352+0000 7f2077d92640 1 -- 172.21.15.107:0/557578930 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2054005210 con 0x7f20700fac60 2024-09-21T08:09:01.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.352+0000 7f20667fc640 1 -- 172.21.15.107:0/557578930 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f206c012070 con 0x7f20700fac60 2024-09-21T08:09:01.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.353+0000 7f20667fc640 1 --2- 172.21.15.107:0/557578930 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f205c06e530 0x7f205c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:01.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.353+0000 7f20667fc640 1 -- 172.21.15.107:0/557578930 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f206c08d930 con 0x7f20700fac60 2024-09-21T08:09:01.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.353+0000 7f207532d640 1 --2- 172.21.15.107:0/557578930 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f205c06e530 0x7f205c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:01.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.353+0000 7f207532d640 1 --2- 172.21.15.107:0/557578930 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f205c06e530 0x7f205c0709e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2060009ac0 tx=0x7f2060035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:01.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.357+0000 7f20667fc640 1 -- 172.21.15.107:0/557578930 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f206c056ac0 con 0x7f20700fac60 2024-09-21T08:09:01.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.537+0000 7f2077d92640 1 -- 172.21.15.107:0/557578930 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2054000bc0 con 0x7f205c06e530 2024-09-21T08:09:01.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.538+0000 7f20667fc640 1 -- 172.21.15.107:0/557578930 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f2054000bc0 con 0x7f205c06e530 2024-09-21T08:09:01.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.540+0000 7f2077d92640 1 -- 172.21.15.107:0/557578930 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f205c06e530 msgr2=0x7f205c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:01.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.540+0000 7f2077d92640 1 --2- 172.21.15.107:0/557578930 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f205c06e530 0x7f205c0709e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2060009ac0 tx=0x7f2060035040 comp rx=0 tx=0).stop 2024-09-21T08:09:01.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.540+0000 7f2077d92640 1 -- 172.21.15.107:0/557578930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20700fac60 msgr2=0x7f2070113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:01.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.540+0000 7f2077d92640 1 --2- 172.21.15.107:0/557578930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20700fac60 0x7f2070113230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f206c00b790 tx=0x7f206c0091d0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.541+0000 7f2077d92640 1 -- 172.21.15.107:0/557578930 shutdown_connections 2024-09-21T08:09:01.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.541+0000 7f2077d92640 1 --2- 172.21.15.107:0/557578930 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f205c06e530 0x7f205c0709e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.541+0000 7f2077d92640 1 --2- 172.21.15.107:0/557578930 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f20701025f0 0x7f2070113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.541+0000 7f2077d92640 1 --2- 172.21.15.107:0/557578930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20700fac60 0x7f2070113230 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.541+0000 7f2077d92640 1 -- 172.21.15.107:0/557578930 >> 172.21.15.107:0/557578930 conn(0x7f2070070c80 msgr2=0x7f20700f9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:01.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.541+0000 7f2077d92640 1 -- 172.21.15.107:0/557578930 shutdown_connections 2024-09-21T08:09:01.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.541+0000 7f2077d92640 1 -- 172.21.15.107:0/557578930 wait complete. 2024-09-21T08:09:01.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.618+0000 7fb7d7773640 1 -- 172.21.15.107:0/2225515196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7d01014e0 msgr2=0x7fb7d01018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:01.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.618+0000 7fb7d7773640 1 --2- 172.21.15.107:0/2225515196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7d01014e0 0x7fb7d01018b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00048d0 tx=0x7fb7c0009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.618+0000 7fb7d7773640 1 -- 172.21.15.107:0/2225515196 shutdown_connections 2024-09-21T08:09:01.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.618+0000 7fb7d7773640 1 --2- 172.21.15.107:0/2225515196 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb7d00fb4a0 0x7fb7d00fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.618+0000 7fb7d7773640 1 --2- 172.21.15.107:0/2225515196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7d01014e0 0x7fb7d01018b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.618+0000 7fb7d7773640 1 -- 172.21.15.107:0/2225515196 >> 172.21.15.107:0/2225515196 conn(0x7fb7d00f7060 msgr2=0x7fb7d00f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:01.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.618+0000 7fb7d7773640 1 -- 172.21.15.107:0/2225515196 shutdown_connections 2024-09-21T08:09:01.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.618+0000 7fb7d7773640 1 -- 172.21.15.107:0/2225515196 wait complete. 2024-09-21T08:09:01.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.619+0000 7fb7d7773640 1 Processor -- start 2024-09-21T08:09:01.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.619+0000 7fb7d7773640 1 -- start start 2024-09-21T08:09:01.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.619+0000 7fb7d7773640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb7d00fb4a0 0x7fb7d01153d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:01.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.619+0000 7fb7d7773640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7d01014e0 0x7fb7d0115910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:01.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.619+0000 7fb7d7773640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d0115f10 con 0x7fb7d01014e0 2024-09-21T08:09:01.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.619+0000 7fb7d7773640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d010f350 con 0x7fb7d00fb4a0 2024-09-21T08:09:01.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.619+0000 7fb7d4d0e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7d01014e0 0x7fb7d0115910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:01.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.619+0000 7fb7d4d0e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7d01014e0 0x7fb7d0115910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51176/0 (socket says 172.21.15.107:51176) 2024-09-21T08:09:01.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.619+0000 7fb7d4d0e640 1 -- 172.21.15.107:0/2555270589 learned_addr learned my addr 172.21.15.107:0/2555270589 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:09:01.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.619+0000 7fb7d550f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb7d00fb4a0 0x7fb7d01153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:01.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.619+0000 7fb7d4d0e640 1 -- 172.21.15.107:0/2555270589 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb7d00fb4a0 msgr2=0x7fb7d01153d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:01.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.619+0000 7fb7d4d0e640 1 --2- 172.21.15.107:0/2555270589 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb7d00fb4a0 0x7fb7d01153d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.619+0000 7fb7d4d0e640 1 -- 172.21.15.107:0/2555270589 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c0005040 con 0x7fb7d01014e0 2024-09-21T08:09:01.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.619+0000 7fb7d550f640 1 --2- 172.21.15.107:0/2555270589 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb7d00fb4a0 0x7fb7d01153d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:09:01.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.620+0000 7fb7d4d0e640 1 --2- 172.21.15.107:0/2555270589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7d01014e0 0x7fb7d0115910 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc002a50 tx=0x7fb7cc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:01.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.620+0000 7fb7c5ffb640 1 -- 172.21.15.107:0/2555270589 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7cc007c30 con 0x7fb7d01014e0 2024-09-21T08:09:01.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.620+0000 7fb7c5ffb640 1 -- 172.21.15.107:0/2555270589 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb7cc00f040 con 0x7fb7d01014e0 2024-09-21T08:09:01.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.620+0000 7fb7c5ffb640 1 -- 172.21.15.107:0/2555270589 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7cc00da50 con 0x7fb7d01014e0 2024-09-21T08:09:01.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.620+0000 7fb7d7773640 1 -- 172.21.15.107:0/2555270589 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d010f630 con 0x7fb7d01014e0 2024-09-21T08:09:01.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.620+0000 7fb7d7773640 1 -- 172.21.15.107:0/2555270589 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d010fbd0 con 0x7fb7d01014e0 2024-09-21T08:09:01.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.621+0000 7fb7c5ffb640 1 -- 172.21.15.107:0/2555270589 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb7cc00dbf0 con 0x7fb7d01014e0 2024-09-21T08:09:01.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.621+0000 7fb7d7773640 1 -- 172.21.15.107:0/2555270589 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d00fcbe0 con 0x7fb7d01014e0 2024-09-21T08:09:01.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.622+0000 7fb7c5ffb640 1 --2- 172.21.15.107:0/2555270589 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb7bc06e530 0x7fb7bc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:01.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.622+0000 7fb7c5ffb640 1 -- 172.21.15.107:0/2555270589 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb7cc08d820 con 0x7fb7d01014e0 2024-09-21T08:09:01.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.622+0000 7fb7d550f640 1 --2- 172.21.15.107:0/2555270589 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb7bc06e530 0x7fb7bc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:01.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.622+0000 7fb7d550f640 1 --2- 172.21.15.107:0/2555270589 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb7bc06e530 0x7fb7bc0709e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0009ac0 tx=0x7fb7c0035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:01.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.626+0000 7fb7c5ffb640 1 -- 172.21.15.107:0/2555270589 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb7cc056a60 con 0x7fb7d01014e0 2024-09-21T08:09:01.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.802+0000 7fb7d7773640 1 -- 172.21.15.107:0/2555270589 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7d01084b0 con 0x7fb7bc06e530 2024-09-21T08:09:01.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.811+0000 7fb7c5ffb640 1 -- 172.21.15.107:0/2555270589 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fb7d01084b0 con 0x7fb7bc06e530 2024-09-21T08:09:01.813 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:09:01.813 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (5m) 33s ago 14m 26.2M - 0.25.0 c8568f914cd2 2b499aa3b7de 2024-09-21T08:09:01.813 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (2m) 33s ago 14m 6899k - 19.1.1-367-g9e2ac70b cc9251b744a3 69be0e9aa842 2024-09-21T08:09:01.814 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (2m) 1s ago 13m 6891k - 19.1.1-367-g9e2ac70b cc9251b744a3 926ed03c78b9 2024-09-21T08:09:01.814 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (4m) 33s ago 13m 81.2M - 9.4.12 2bacad6d85d8 63177dcfe25c 2024-09-21T08:09:01.814 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (8m) 33s ago 8m 155M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 3bc779f88228 2024-09-21T08:09:01.814 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (8m) 33s ago 8m 14.1M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be ea8f140aade7 2024-09-21T08:09:01.814 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (8m) 1s ago 8m 17.2M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 329346c3afec 2024-09-21T08:09:01.814 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (8m) 1s ago 8m 18.6M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be baf87f32bfbc 2024-09-21T08:09:01.815 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:8443,9283,8765 running (5m) 33s ago 15m 498M - 19.1.1-367-g9e2ac70b cc9251b744a3 49c237734f07 2024-09-21T08:09:01.815 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283,8765 running (4m) 1s ago 13m 441M - 19.1.1-367-g9e2ac70b cc9251b744a3 ed117096bdd8 2024-09-21T08:09:01.815 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (3m) 33s ago 15m 45.9M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 445b3e6a800f 2024-09-21T08:09:01.815 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (2m) 1s ago 13m 37.3M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 12706f823621 2024-09-21T08:09:01.815 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 running (6m) 33s ago 14m 17.1M - 1.5.0 0da6a335fe13 6de7c307ba0f 2024-09-21T08:09:01.815 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (5m) 1s ago 13m 16.3M - 1.5.0 0da6a335fe13 cb6d4577b24c 2024-09-21T08:09:01.816 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (108s) 33s ago 12m 98.8M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 d0a742b31d8a 2024-09-21T08:09:01.816 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (73s) 33s ago 12m 107M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 4bb3f4c8f75a 2024-09-21T08:09:01.816 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (38s) 33s ago 11m 12.1M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 15f45fa18e64 2024-09-21T08:09:01.816 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (4s) 1s ago 11m 12.1M 2581M 19.1.1-367-g9e2ac70b cc9251b744a3 ee4efea3e442 2024-09-21T08:09:01.816 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (10m) 1s ago 10m 254M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 2f916ef76d22 2024-09-21T08:09:01.816 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (10m) 1s ago 10m 233M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 0f25d9454304 2024-09-21T08:09:01.816 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (4m) 33s ago 13m 61.0M - 2.43.0 a07b618ecd1d 9ed2abf5e8d8 2024-09-21T08:09:01.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.813+0000 7fb7d7773640 1 -- 172.21.15.107:0/2555270589 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb7bc06e530 msgr2=0x7fb7bc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:01.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.813+0000 7fb7d7773640 1 --2- 172.21.15.107:0/2555270589 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb7bc06e530 0x7fb7bc0709e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0009ac0 tx=0x7fb7c0035040 comp rx=0 tx=0).stop 2024-09-21T08:09:01.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.813+0000 7fb7d7773640 1 -- 172.21.15.107:0/2555270589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7d01014e0 msgr2=0x7fb7d0115910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:01.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.813+0000 7fb7d7773640 1 --2- 172.21.15.107:0/2555270589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7d01014e0 0x7fb7d0115910 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc002a50 tx=0x7fb7cc004600 comp rx=0 tx=0).stop 2024-09-21T08:09:01.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.814+0000 7fb7d7773640 1 -- 172.21.15.107:0/2555270589 shutdown_connections 2024-09-21T08:09:01.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.814+0000 7fb7d7773640 1 --2- 172.21.15.107:0/2555270589 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb7bc06e530 0x7fb7bc0709e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.814+0000 7fb7d7773640 1 --2- 172.21.15.107:0/2555270589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7d01014e0 0x7fb7d0115910 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.814+0000 7fb7d7773640 1 --2- 172.21.15.107:0/2555270589 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb7d00fb4a0 0x7fb7d01153d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.814+0000 7fb7d7773640 1 -- 172.21.15.107:0/2555270589 >> 172.21.15.107:0/2555270589 conn(0x7fb7d00f7060 msgr2=0x7fb7d0065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:01.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.814+0000 7fb7d7773640 1 -- 172.21.15.107:0/2555270589 shutdown_connections 2024-09-21T08:09:01.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.814+0000 7fb7d7773640 1 -- 172.21.15.107:0/2555270589 wait complete. 2024-09-21T08:09:01.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.891+0000 7f645eb4c640 1 -- 172.21.15.107:0/330197340 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6458102530 msgr2=0x7f6458102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:01.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.891+0000 7f645eb4c640 1 --2- 172.21.15.107:0/330197340 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6458102530 0x7f6458102900 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f64540048d0 tx=0x7f6454009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.891+0000 7f645eb4c640 1 -- 172.21.15.107:0/330197340 shutdown_connections 2024-09-21T08:09:01.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.891+0000 7f645eb4c640 1 --2- 172.21.15.107:0/330197340 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6458102ed0 0x7f64580fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.891+0000 7f645eb4c640 1 --2- 172.21.15.107:0/330197340 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6458102530 0x7f6458102900 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.891+0000 7f645eb4c640 1 -- 172.21.15.107:0/330197340 >> 172.21.15.107:0/330197340 conn(0x7f64580f80f0 msgr2=0x7f64580fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:01.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.891+0000 7f645eb4c640 1 -- 172.21.15.107:0/330197340 shutdown_connections 2024-09-21T08:09:01.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.891+0000 7f645eb4c640 1 -- 172.21.15.107:0/330197340 wait complete. 2024-09-21T08:09:01.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.892+0000 7f645eb4c640 1 Processor -- start 2024-09-21T08:09:01.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.892+0000 7f645eb4c640 1 -- start start 2024-09-21T08:09:01.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.892+0000 7f645eb4c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6458102530 0x7f6458113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:01.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.892+0000 7f645eb4c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6458102ed0 0x7f6458113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:01.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.892+0000 7f645eb4c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6458113d80 con 0x7f6458102ed0 2024-09-21T08:09:01.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.892+0000 7f645eb4c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645810d1c0 con 0x7f6458102530 2024-09-21T08:09:01.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.893+0000 7f644ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6458102ed0 0x7f6458113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:01.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.893+0000 7f645c8e8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6458102530 0x7f6458113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:01.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.893+0000 7f645c8e8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6458102530 0x7f6458113240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.107:36884/0 (socket says 172.21.15.107:36884) 2024-09-21T08:09:01.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.893+0000 7f645c8e8640 1 -- 172.21.15.107:0/4128729968 learned_addr learned my addr 172.21.15.107:0/4128729968 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:09:01.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.893+0000 7f645c8e8640 1 -- 172.21.15.107:0/4128729968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6458102ed0 msgr2=0x7f6458113780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:01.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.893+0000 7f645c8e8640 1 --2- 172.21.15.107:0/4128729968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6458102ed0 0x7f6458113780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:01.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.893+0000 7f645c8e8640 1 -- 172.21.15.107:0/4128729968 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6454005040 con 0x7f6458102530 2024-09-21T08:09:01.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.893+0000 7f644ffff640 1 --2- 172.21.15.107:0/4128729968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6458102ed0 0x7f6458113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:09:01.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.893+0000 7f645c8e8640 1 --2- 172.21.15.107:0/4128729968 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6458102530 0x7f6458113240 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6454000c00 tx=0x7f6454009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:01.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.893+0000 7f644d7fa640 1 -- 172.21.15.107:0/4128729968 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6454038070 con 0x7f6458102530 2024-09-21T08:09:01.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.893+0000 7f645eb4c640 1 -- 172.21.15.107:0/4128729968 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645810d440 con 0x7f6458102530 2024-09-21T08:09:01.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.893+0000 7f644d7fa640 1 -- 172.21.15.107:0/4128729968 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f645402ade0 con 0x7f6458102530 2024-09-21T08:09:01.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.893+0000 7f644d7fa640 1 -- 172.21.15.107:0/4128729968 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f645402c7e0 con 0x7f6458102530 2024-09-21T08:09:01.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.893+0000 7f645eb4c640 1 -- 172.21.15.107:0/4128729968 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645810d980 con 0x7f6458102530 2024-09-21T08:09:01.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.894+0000 7f645eb4c640 1 -- 172.21.15.107:0/4128729968 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64580fdcb0 con 0x7f6458102530 2024-09-21T08:09:01.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.895+0000 7f644d7fa640 1 -- 172.21.15.107:0/4128729968 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f6454030020 con 0x7f6458102530 2024-09-21T08:09:01.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.896+0000 7f644d7fa640 1 --2- 172.21.15.107:0/4128729968 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f644006e530 0x7f64400709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:01.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.896+0000 7f644d7fa640 1 -- 172.21.15.107:0/4128729968 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f64540add50 con 0x7f6458102530 2024-09-21T08:09:01.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.896+0000 7f644ffff640 1 --2- 172.21.15.107:0/4128729968 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f644006e530 0x7f64400709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:01.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.896+0000 7f644ffff640 1 --2- 172.21.15.107:0/4128729968 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f644006e530 0x7f64400709e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6448004fd0 tx=0x7f644800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:01.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:01.901+0000 7f644d7fa640 1 -- 172.21.15.107:0/4128729968 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6454076f90 con 0x7f6458102530 2024-09-21T08:09:02.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.138+0000 7f645eb4c640 1 -- 172.21.15.107:0/4128729968 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f645804b720 con 0x7f6458102530 2024-09-21T08:09:02.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.139+0000 7f644d7fa640 1 -- 172.21.15.107:0/4128729968 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f645407a650 con 0x7f6458102530 2024-09-21T08:09:02.140 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:09:02.140 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": { 2024-09-21T08:09:02.141 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:09:02.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:09:02.141 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": { 2024-09-21T08:09:02.141 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:09:02.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:09:02.141 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": { 2024-09-21T08:09:02.141 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 2, 2024-09-21T08:09:02.141 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-21T08:09:02.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:09:02.141 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-21T08:09:02.141 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 4 2024-09-21T08:09:02.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:09:02.141 INFO:teuthology.orchestra.run.smithi107.stdout: "overall": { 2024-09-21T08:09:02.141 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 6, 2024-09-21T08:09:02.141 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 7 2024-09-21T08:09:02.142 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-21T08:09:02.142 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:09:02.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.141+0000 7f645eb4c640 1 -- 172.21.15.107:0/4128729968 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f644006e530 msgr2=0x7f64400709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:02.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.141+0000 7f645eb4c640 1 --2- 172.21.15.107:0/4128729968 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f644006e530 0x7f64400709e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6448004fd0 tx=0x7f644800b040 comp rx=0 tx=0).stop 2024-09-21T08:09:02.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.141+0000 7f645eb4c640 1 -- 172.21.15.107:0/4128729968 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6458102530 msgr2=0x7f6458113240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:02.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.141+0000 7f645eb4c640 1 --2- 172.21.15.107:0/4128729968 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6458102530 0x7f6458113240 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6454000c00 tx=0x7f6454009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.141+0000 7f645eb4c640 1 -- 172.21.15.107:0/4128729968 shutdown_connections 2024-09-21T08:09:02.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.141+0000 7f645eb4c640 1 --2- 172.21.15.107:0/4128729968 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f644006e530 0x7f64400709e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.141+0000 7f645eb4c640 1 --2- 172.21.15.107:0/4128729968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6458102ed0 0x7f6458113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.141+0000 7f645eb4c640 1 --2- 172.21.15.107:0/4128729968 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6458102530 0x7f6458113240 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.141+0000 7f645eb4c640 1 -- 172.21.15.107:0/4128729968 >> 172.21.15.107:0/4128729968 conn(0x7f64580f80f0 msgr2=0x7f64580f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:02.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.141+0000 7f645eb4c640 1 -- 172.21.15.107:0/4128729968 shutdown_connections 2024-09-21T08:09:02.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.141+0000 7f645eb4c640 1 -- 172.21.15.107:0/4128729968 wait complete. 2024-09-21T08:09:02.144 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:01 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:02.144 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:01 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:02.144 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:01 smithi107 ceph-mon[97757]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:09:02.144 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:01 smithi107 ceph-mon[97757]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:09:02.144 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:01 smithi107 ceph-mon[97757]: pgmap v111: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-21T08:09:02.144 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:01 smithi107 ceph-mon[97757]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:09:02.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.220+0000 7fd110994640 1 -- 172.21.15.107:0/641796883 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd10c064fc0 msgr2=0x7fd10c065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:02.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.220+0000 7fd110994640 1 --2- 172.21.15.107:0/641796883 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd10c064fc0 0x7fd10c065430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd1000048d0 tx=0x7fd100009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.220+0000 7fd110994640 1 -- 172.21.15.107:0/641796883 shutdown_connections 2024-09-21T08:09:02.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.220+0000 7fd110994640 1 --2- 172.21.15.107:0/641796883 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd10c064fc0 0x7fd10c065430 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.220+0000 7fd110994640 1 --2- 172.21.15.107:0/641796883 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd10c0fe460 0x7fd10c0fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.220+0000 7fd110994640 1 -- 172.21.15.107:0/641796883 >> 172.21.15.107:0/641796883 conn(0x7fd10c0723b0 msgr2=0x7fd10c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:02.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.220+0000 7fd110994640 1 -- 172.21.15.107:0/641796883 shutdown_connections 2024-09-21T08:09:02.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.220+0000 7fd110994640 1 -- 172.21.15.107:0/641796883 wait complete. 2024-09-21T08:09:02.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.221+0000 7fd110994640 1 Processor -- start 2024-09-21T08:09:02.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.221+0000 7fd110994640 1 -- start start 2024-09-21T08:09:02.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.221+0000 7fd110994640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd10c064fc0 0x7fd10c0fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:02.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.221+0000 7fd110994640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd10c0fe460 0x7fd10c0fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:02.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.221+0000 7fd110994640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c0fd2c0 con 0x7fd10c064fc0 2024-09-21T08:09:02.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.221+0000 7fd110994640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c0fd430 con 0x7fd10c0fe460 2024-09-21T08:09:02.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.221+0000 7fd10a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd10c064fc0 0x7fd10c0fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:02.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.221+0000 7fd10a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd10c064fc0 0x7fd10c0fb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51220/0 (socket says 172.21.15.107:51220) 2024-09-21T08:09:02.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.221+0000 7fd10a59c640 1 -- 172.21.15.107:0/2210514690 learned_addr learned my addr 172.21.15.107:0/2210514690 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:09:02.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.221+0000 7fd109d9b640 1 --2- 172.21.15.107:0/2210514690 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd10c0fe460 0x7fd10c0fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:02.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.221+0000 7fd10a59c640 1 -- 172.21.15.107:0/2210514690 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd10c0fe460 msgr2=0x7fd10c0fbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:02.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.221+0000 7fd10a59c640 1 --2- 172.21.15.107:0/2210514690 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd10c0fe460 0x7fd10c0fbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.221+0000 7fd10a59c640 1 -- 172.21.15.107:0/2210514690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd100005040 con 0x7fd10c064fc0 2024-09-21T08:09:02.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.222+0000 7fd10a59c640 1 --2- 172.21.15.107:0/2210514690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd10c064fc0 0x7fd10c0fb560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc002a50 tx=0x7fd0fc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:02.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.222+0000 7fd0faffd640 1 -- 172.21.15.107:0/2210514690 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0fc007c30 con 0x7fd10c064fc0 2024-09-21T08:09:02.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.222+0000 7fd0faffd640 1 -- 172.21.15.107:0/2210514690 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd0fc00f040 con 0x7fd10c064fc0 2024-09-21T08:09:02.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.222+0000 7fd110994640 1 -- 172.21.15.107:0/2210514690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10c0fc0a0 con 0x7fd10c064fc0 2024-09-21T08:09:02.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.222+0000 7fd0faffd640 1 -- 172.21.15.107:0/2210514690 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0fc00da10 con 0x7fd10c064fc0 2024-09-21T08:09:02.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.222+0000 7fd110994640 1 -- 172.21.15.107:0/2210514690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10c11dd10 con 0x7fd10c064fc0 2024-09-21T08:09:02.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.223+0000 7fd110994640 1 -- 172.21.15.107:0/2210514690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10c0fdcf0 con 0x7fd10c064fc0 2024-09-21T08:09:02.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.223+0000 7fd0faffd640 1 -- 172.21.15.107:0/2210514690 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd0fc00dbb0 con 0x7fd10c064fc0 2024-09-21T08:09:02.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.224+0000 7fd0faffd640 1 --2- 172.21.15.107:0/2210514690 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fd0f406e530 0x7fd0f40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:02.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.224+0000 7fd0faffd640 1 -- 172.21.15.107:0/2210514690 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd0fc08d820 con 0x7fd10c064fc0 2024-09-21T08:09:02.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.224+0000 7fd109d9b640 1 --2- 172.21.15.107:0/2210514690 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fd0f406e530 0x7fd0f40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:02.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.224+0000 7fd109d9b640 1 --2- 172.21.15.107:0/2210514690 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fd0f406e530 0x7fd0f40709e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd100009ac0 tx=0x7fd100035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:02.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.228+0000 7fd0faffd640 1 -- 172.21.15.107:0/2210514690 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd0fc056ae0 con 0x7fd10c064fc0 2024-09-21T08:09:02.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:01 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:02.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:01 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:02.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:01 smithi129 ceph-mon[76722]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:09:02.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:01 smithi129 ceph-mon[76722]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:09:02.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:01 smithi129 ceph-mon[76722]: pgmap v111: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-21T08:09:02.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:01 smithi129 ceph-mon[76722]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:09:02.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.426+0000 7fd110994640 1 -- 172.21.15.107:0/2210514690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd10c0fcc00 con 0x7fd10c064fc0 2024-09-21T08:09:02.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.426+0000 7fd0faffd640 1 -- 172.21.15.107:0/2210514690 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1922 (secure 0 0 0) 0x7fd0fc00de60 con 0x7fd10c064fc0 2024-09-21T08:09:02.428 INFO:teuthology.orchestra.run.smithi107.stdout:e15 2024-09-21T08:09:02.428 INFO:teuthology.orchestra.run.smithi107.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-21T08:09:02.428 INFO:teuthology.orchestra.run.smithi107.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T08:09:02.428 INFO:teuthology.orchestra.run.smithi107.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:09:02.428 INFO:teuthology.orchestra.run.smithi107.stdout:legacy client fscid: 1 2024-09-21T08:09:02.428 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:09:02.428 INFO:teuthology.orchestra.run.smithi107.stdout:Filesystem 'cephfs' (1) 2024-09-21T08:09:02.429 INFO:teuthology.orchestra.run.smithi107.stdout:fs_name cephfs 2024-09-21T08:09:02.429 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 15 2024-09-21T08:09:02.429 INFO:teuthology.orchestra.run.smithi107.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T08:09:02.429 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-09-21T08:00:03.244314+0000 2024-09-21T08:09:02.429 INFO:teuthology.orchestra.run.smithi107.stdout:modified 2024-09-21T08:00:21.458971+0000 2024-09-21T08:09:02.429 INFO:teuthology.orchestra.run.smithi107.stdout:tableserver 0 2024-09-21T08:09:02.429 INFO:teuthology.orchestra.run.smithi107.stdout:root 0 2024-09-21T08:09:02.429 INFO:teuthology.orchestra.run.smithi107.stdout:session_timeout 60 2024-09-21T08:09:02.429 INFO:teuthology.orchestra.run.smithi107.stdout:session_autoclose 300 2024-09-21T08:09:02.429 INFO:teuthology.orchestra.run.smithi107.stdout:max_file_size 1099511627776 2024-09-21T08:09:02.429 INFO:teuthology.orchestra.run.smithi107.stdout:max_xattr_size 65536 2024-09-21T08:09:02.429 INFO:teuthology.orchestra.run.smithi107.stdout:required_client_features {} 2024-09-21T08:09:02.429 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure 0 2024-09-21T08:09:02.429 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure_osd_epoch 44 2024-09-21T08:09:02.430 INFO:teuthology.orchestra.run.smithi107.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:09:02.430 INFO:teuthology.orchestra.run.smithi107.stdout:max_mds 1 2024-09-21T08:09:02.430 INFO:teuthology.orchestra.run.smithi107.stdout:in 0 2024-09-21T08:09:02.430 INFO:teuthology.orchestra.run.smithi107.stdout:up {0=14458} 2024-09-21T08:09:02.430 INFO:teuthology.orchestra.run.smithi107.stdout:failed 2024-09-21T08:09:02.430 INFO:teuthology.orchestra.run.smithi107.stdout:damaged 2024-09-21T08:09:02.430 INFO:teuthology.orchestra.run.smithi107.stdout:stopped 2024-09-21T08:09:02.430 INFO:teuthology.orchestra.run.smithi107.stdout:data_pools [3] 2024-09-21T08:09:02.430 INFO:teuthology.orchestra.run.smithi107.stdout:metadata_pool 2 2024-09-21T08:09:02.430 INFO:teuthology.orchestra.run.smithi107.stdout:inline_data disabled 2024-09-21T08:09:02.430 INFO:teuthology.orchestra.run.smithi107.stdout:balancer 2024-09-21T08:09:02.430 INFO:teuthology.orchestra.run.smithi107.stdout:bal_rank_mask -1 2024-09-21T08:09:02.430 INFO:teuthology.orchestra.run.smithi107.stdout:standby_count_wanted 1 2024-09-21T08:09:02.431 INFO:teuthology.orchestra.run.smithi107.stdout:qdb_cluster leader: 0 members: 2024-09-21T08:09:02.431 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.grqzkt{0:14458} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:09:02.431 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:09:02.431 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:09:02.431 INFO:teuthology.orchestra.run.smithi107.stdout:Standby daemons: 2024-09-21T08:09:02.431 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:09:02.431 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.qusoyf{-1:14468} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6826/2352538667,v1:172.21.15.107:6827/2352538667] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:09:02.431 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.fwmfcy{-1:24239} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:09:02.431 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.belyba{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:09:02.432 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 15 2024-09-21T08:09:02.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.429+0000 7fd110994640 1 -- 172.21.15.107:0/2210514690 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fd0f406e530 msgr2=0x7fd0f40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:02.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.429+0000 7fd110994640 1 --2- 172.21.15.107:0/2210514690 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fd0f406e530 0x7fd0f40709e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd100009ac0 tx=0x7fd100035040 comp rx=0 tx=0).stop 2024-09-21T08:09:02.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.429+0000 7fd110994640 1 -- 172.21.15.107:0/2210514690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd10c064fc0 msgr2=0x7fd10c0fb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:02.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.429+0000 7fd110994640 1 --2- 172.21.15.107:0/2210514690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd10c064fc0 0x7fd10c0fb560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc002a50 tx=0x7fd0fc004600 comp rx=0 tx=0).stop 2024-09-21T08:09:02.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.429+0000 7fd110994640 1 -- 172.21.15.107:0/2210514690 shutdown_connections 2024-09-21T08:09:02.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.429+0000 7fd110994640 1 --2- 172.21.15.107:0/2210514690 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fd0f406e530 0x7fd0f40709e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.429+0000 7fd110994640 1 --2- 172.21.15.107:0/2210514690 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd10c0fe460 0x7fd10c0fbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.429+0000 7fd110994640 1 --2- 172.21.15.107:0/2210514690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd10c064fc0 0x7fd10c0fb560 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.429+0000 7fd110994640 1 -- 172.21.15.107:0/2210514690 >> 172.21.15.107:0/2210514690 conn(0x7fd10c0723b0 msgr2=0x7fd10c1053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:02.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.429+0000 7fd110994640 1 -- 172.21.15.107:0/2210514690 shutdown_connections 2024-09-21T08:09:02.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.430+0000 7fd110994640 1 -- 172.21.15.107:0/2210514690 wait complete. 2024-09-21T08:09:02.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.510+0000 7f49fa652640 1 -- 172.21.15.107:0/3689639174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49f4102ed0 msgr2=0x7f49f40fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:02.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.510+0000 7f49fa652640 1 --2- 172.21.15.107:0/3689639174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49f4102ed0 0x7f49f40fc590 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f49e80048d0 tx=0x7f49e8009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.510+0000 7f49fa652640 1 -- 172.21.15.107:0/3689639174 shutdown_connections 2024-09-21T08:09:02.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.510+0000 7f49fa652640 1 --2- 172.21.15.107:0/3689639174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49f4102ed0 0x7f49f40fc590 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.510+0000 7f49fa652640 1 --2- 172.21.15.107:0/3689639174 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49f4102530 0x7f49f4102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.510+0000 7f49fa652640 1 -- 172.21.15.107:0/3689639174 >> 172.21.15.107:0/3689639174 conn(0x7f49f40f8110 msgr2=0x7f49f40fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:02.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.510+0000 7f49fa652640 1 -- 172.21.15.107:0/3689639174 shutdown_connections 2024-09-21T08:09:02.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.510+0000 7f49fa652640 1 -- 172.21.15.107:0/3689639174 wait complete. 2024-09-21T08:09:02.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.510+0000 7f49fa652640 1 Processor -- start 2024-09-21T08:09:02.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.511+0000 7f49fa652640 1 -- start start 2024-09-21T08:09:02.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.511+0000 7f49fa652640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49f4102530 0x7f49f406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:02.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.511+0000 7f49fa652640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49f4102ed0 0x7f49f406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:02.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.511+0000 7f49fa652640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f4070490 con 0x7f49f4102ed0 2024-09-21T08:09:02.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.511+0000 7f49fa652640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f4070600 con 0x7f49f4102530 2024-09-21T08:09:02.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.511+0000 7f49f37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49f4102ed0 0x7f49f406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:02.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.511+0000 7f49f37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49f4102ed0 0x7f49f406ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51236/0 (socket says 172.21.15.107:51236) 2024-09-21T08:09:02.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.511+0000 7f49f37fe640 1 -- 172.21.15.107:0/2882944444 learned_addr learned my addr 172.21.15.107:0/2882944444 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:09:02.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.511+0000 7f49f3fff640 1 --2- 172.21.15.107:0/2882944444 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49f4102530 0x7f49f406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:02.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.511+0000 7f49f37fe640 1 -- 172.21.15.107:0/2882944444 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49f4102530 msgr2=0x7f49f406fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:02.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.511+0000 7f49f37fe640 1 --2- 172.21.15.107:0/2882944444 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49f4102530 0x7f49f406fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.511+0000 7f49f37fe640 1 -- 172.21.15.107:0/2882944444 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e8005040 con 0x7f49f4102ed0 2024-09-21T08:09:02.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.511+0000 7f49f37fe640 1 --2- 172.21.15.107:0/2882944444 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49f4102ed0 0x7f49f406ff50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f49e80043d0 tx=0x7f49e8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:02.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.512+0000 7f49f0ff9640 1 -- 172.21.15.107:0/2882944444 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49e8038070 con 0x7f49f4102ed0 2024-09-21T08:09:02.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.512+0000 7f49fa652640 1 -- 172.21.15.107:0/2882944444 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f4070830 con 0x7f49f4102ed0 2024-09-21T08:09:02.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.512+0000 7f49f0ff9640 1 -- 172.21.15.107:0/2882944444 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f49e80096e0 con 0x7f49f4102ed0 2024-09-21T08:09:02.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.512+0000 7f49f0ff9640 1 -- 172.21.15.107:0/2882944444 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49e802c8a0 con 0x7f49f4102ed0 2024-09-21T08:09:02.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.512+0000 7f49fa652640 1 -- 172.21.15.107:0/2882944444 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f41197f0 con 0x7f49f4102ed0 2024-09-21T08:09:02.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.513+0000 7f49fa652640 1 -- 172.21.15.107:0/2882944444 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f40fdcb0 con 0x7f49f4102ed0 2024-09-21T08:09:02.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.513+0000 7f49f0ff9640 1 -- 172.21.15.107:0/2882944444 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f49e8030020 con 0x7f49f4102ed0 2024-09-21T08:09:02.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.513+0000 7f49f0ff9640 1 --2- 172.21.15.107:0/2882944444 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f49dc06e530 0x7f49dc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:02.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.514+0000 7f49f0ff9640 1 -- 172.21.15.107:0/2882944444 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f49e80ade20 con 0x7f49f4102ed0 2024-09-21T08:09:02.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.514+0000 7f49f3fff640 1 --2- 172.21.15.107:0/2882944444 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f49dc06e530 0x7f49dc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:02.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.514+0000 7f49f3fff640 1 --2- 172.21.15.107:0/2882944444 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f49dc06e530 0x7f49dc0709e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f49e4009fd0 tx=0x7f49e400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:02.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.518+0000 7f49f0ff9640 1 -- 172.21.15.107:0/2882944444 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f49e8077060 con 0x7f49f4102ed0 2024-09-21T08:09:02.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.701+0000 7f49fa652640 1 -- 172.21.15.107:0/2882944444 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49f41095b0 con 0x7f49dc06e530 2024-09-21T08:09:02.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.702+0000 7f49f0ff9640 1 -- 172.21.15.107:0/2882944444 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f49f41095b0 con 0x7f49dc06e530 2024-09-21T08:09:02.704 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:09:02.704 INFO:teuthology.orchestra.run.smithi107.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5", 2024-09-21T08:09:02.704 INFO:teuthology.orchestra.run.smithi107.stdout: "in_progress": true, 2024-09-21T08:09:02.704 INFO:teuthology.orchestra.run.smithi107.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T08:09:02.704 INFO:teuthology.orchestra.run.smithi107.stdout: "services_complete": [ 2024-09-21T08:09:02.704 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr", 2024-09-21T08:09:02.704 INFO:teuthology.orchestra.run.smithi107.stdout: "mon", 2024-09-21T08:09:02.705 INFO:teuthology.orchestra.run.smithi107.stdout: "crash" 2024-09-21T08:09:02.705 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-21T08:09:02.705 INFO:teuthology.orchestra.run.smithi107.stdout: "progress": "10/21 daemons upgraded", 2024-09-21T08:09:02.705 INFO:teuthology.orchestra.run.smithi107.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T08:09:02.705 INFO:teuthology.orchestra.run.smithi107.stdout: "is_paused": false 2024-09-21T08:09:02.705 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:09:02.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.704+0000 7f49fa652640 1 -- 172.21.15.107:0/2882944444 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f49dc06e530 msgr2=0x7f49dc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:02.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.704+0000 7f49fa652640 1 --2- 172.21.15.107:0/2882944444 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f49dc06e530 0x7f49dc0709e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f49e4009fd0 tx=0x7f49e400b040 comp rx=0 tx=0).stop 2024-09-21T08:09:02.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.704+0000 7f49fa652640 1 -- 172.21.15.107:0/2882944444 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49f4102ed0 msgr2=0x7f49f406ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:02.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.704+0000 7f49fa652640 1 --2- 172.21.15.107:0/2882944444 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49f4102ed0 0x7f49f406ff50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f49e80043d0 tx=0x7f49e8009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.704+0000 7f49fa652640 1 -- 172.21.15.107:0/2882944444 shutdown_connections 2024-09-21T08:09:02.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.704+0000 7f49fa652640 1 --2- 172.21.15.107:0/2882944444 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f49dc06e530 0x7f49dc0709e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.704+0000 7f49fa652640 1 --2- 172.21.15.107:0/2882944444 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49f4102ed0 0x7f49f406ff50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.704+0000 7f49fa652640 1 --2- 172.21.15.107:0/2882944444 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49f4102530 0x7f49f406fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.704+0000 7f49fa652640 1 -- 172.21.15.107:0/2882944444 >> 172.21.15.107:0/2882944444 conn(0x7f49f40f8110 msgr2=0x7f49f40f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:02.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.704+0000 7f49fa652640 1 -- 172.21.15.107:0/2882944444 shutdown_connections 2024-09-21T08:09:02.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.704+0000 7f49fa652640 1 -- 172.21.15.107:0/2882944444 wait complete. 2024-09-21T08:09:02.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.782+0000 7f6a4ec4c640 1 -- 172.21.15.107:0/3222899265 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a481014c0 msgr2=0x7f6a48101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:02.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.782+0000 7f6a4ec4c640 1 --2- 172.21.15.107:0/3222899265 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a481014c0 0x7f6a48101890 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0048d0 tx=0x7f6a3c009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.782+0000 7f6a4ec4c640 1 -- 172.21.15.107:0/3222899265 shutdown_connections 2024-09-21T08:09:02.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.782+0000 7f6a4ec4c640 1 --2- 172.21.15.107:0/3222899265 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6a480fb480 0x7f6a480fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.782+0000 7f6a4ec4c640 1 --2- 172.21.15.107:0/3222899265 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a481014c0 0x7f6a48101890 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.782+0000 7f6a4ec4c640 1 -- 172.21.15.107:0/3222899265 >> 172.21.15.107:0/3222899265 conn(0x7f6a480f7020 msgr2=0x7f6a480f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:02.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.782+0000 7f6a4ec4c640 1 -- 172.21.15.107:0/3222899265 shutdown_connections 2024-09-21T08:09:02.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.782+0000 7f6a4ec4c640 1 -- 172.21.15.107:0/3222899265 wait complete. 2024-09-21T08:09:02.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.783+0000 7f6a4ec4c640 1 Processor -- start 2024-09-21T08:09:02.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.783+0000 7f6a4ec4c640 1 -- start start 2024-09-21T08:09:02.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.783+0000 7f6a4ec4c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a480fb480 0x7f6a4810e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:02.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.783+0000 7f6a4ec4c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6a481014c0 0x7f6a4810e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:02.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.783+0000 7f6a4ec4c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4810ed90 con 0x7f6a480fb480 2024-09-21T08:09:02.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.783+0000 7f6a4ec4c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4810ef00 con 0x7f6a481014c0 2024-09-21T08:09:02.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.783+0000 7f6a4c9e8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a480fb480 0x7f6a4810e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:02.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.783+0000 7f6a4c9e8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a480fb480 0x7f6a4810e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51250/0 (socket says 172.21.15.107:51250) 2024-09-21T08:09:02.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.783+0000 7f6a4c9e8640 1 -- 172.21.15.107:0/3194635762 learned_addr learned my addr 172.21.15.107:0/3194635762 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:09:02.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.783+0000 7f6a47fff640 1 --2- 172.21.15.107:0/3194635762 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6a481014c0 0x7f6a4810e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:02.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.783+0000 7f6a4c9e8640 1 -- 172.21.15.107:0/3194635762 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6a481014c0 msgr2=0x7f6a4810e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:02.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.783+0000 7f6a4c9e8640 1 --2- 172.21.15.107:0/3194635762 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6a481014c0 0x7f6a4810e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.783+0000 7f6a4c9e8640 1 -- 172.21.15.107:0/3194635762 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c005040 con 0x7f6a480fb480 2024-09-21T08:09:02.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.784+0000 7f6a4c9e8640 1 --2- 172.21.15.107:0/3194635762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a480fb480 0x7f6a4810e310 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c000c00 tx=0x7f6a3c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:02.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.784+0000 7f6a457fa640 1 -- 172.21.15.107:0/3194635762 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a3c038070 con 0x7f6a480fb480 2024-09-21T08:09:02.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.784+0000 7f6a457fa640 1 -- 172.21.15.107:0/3194635762 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6a3c02ade0 con 0x7f6a480fb480 2024-09-21T08:09:02.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.784+0000 7f6a4ec4c640 1 -- 172.21.15.107:0/3194635762 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a481171e0 con 0x7f6a480fb480 2024-09-21T08:09:02.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.784+0000 7f6a457fa640 1 -- 172.21.15.107:0/3194635762 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a3c02c7b0 con 0x7f6a480fb480 2024-09-21T08:09:02.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.784+0000 7f6a4ec4c640 1 -- 172.21.15.107:0/3194635762 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a481176a0 con 0x7f6a480fb480 2024-09-21T08:09:02.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.785+0000 7f6a4ec4c640 1 -- 172.21.15.107:0/3194635762 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a480fcbc0 con 0x7f6a480fb480 2024-09-21T08:09:02.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.785+0000 7f6a457fa640 1 -- 172.21.15.107:0/3194635762 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f6a3c030020 con 0x7f6a480fb480 2024-09-21T08:09:02.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.786+0000 7f6a457fa640 1 --2- 172.21.15.107:0/3194635762 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6a3806e530 0x7f6a380709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:02.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.786+0000 7f6a457fa640 1 -- 172.21.15.107:0/3194635762 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6a3c0ae430 con 0x7f6a480fb480 2024-09-21T08:09:02.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.786+0000 7f6a47fff640 1 --2- 172.21.15.107:0/3194635762 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6a3806e530 0x7f6a380709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:02.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.786+0000 7f6a47fff640 1 --2- 172.21.15.107:0/3194635762 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6a3806e530 0x7f6a380709e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6a480664f0 tx=0x7f6a3400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:02.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:02.790+0000 7f6a457fa640 1 -- 172.21.15.107:0/3194635762 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6a3c077640 con 0x7f6a480fb480 2024-09-21T08:09:03.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:03.020+0000 7f6a4ec4c640 1 -- 172.21.15.107:0/3194635762 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6a480fac40 con 0x7f6a480fb480 2024-09-21T08:09:03.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:03.020+0000 7f6a457fa640 1 -- 172.21.15.107:0/3194635762 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1216 (secure 0 0 0) 0x7f6a3c07ad00 con 0x7f6a480fb480 2024-09-21T08:09:03.022 INFO:teuthology.orchestra.run.smithi107.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 48/219 objects degraded (21.918%), 17 pgs degraded 2024-09-21T08:09:03.022 INFO:teuthology.orchestra.run.smithi107.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T08:09:03.022 INFO:teuthology.orchestra.run.smithi107.stdout: osd.3 (root=default,host=smithi129) is down 2024-09-21T08:09:03.022 INFO:teuthology.orchestra.run.smithi107.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 48/219 objects degraded (21.918%), 17 pgs degraded 2024-09-21T08:09:03.022 INFO:teuthology.orchestra.run.smithi107.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-21T08:09:03.022 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-21T08:09:03.022 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-21T08:09:03.022 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-21T08:09:03.022 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-21T08:09:03.022 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-21T08:09:03.023 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-21T08:09:03.023 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-09-21T08:09:03.023 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-21T08:09:03.023 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-21T08:09:03.023 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-21T08:09:03.023 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-21T08:09:03.023 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-21T08:09:03.023 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-21T08:09:03.023 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-21T08:09:03.023 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-21T08:09:03.023 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-21T08:09:03.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:03.022+0000 7f6a4ec4c640 1 -- 172.21.15.107:0/3194635762 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6a3806e530 msgr2=0x7f6a380709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:03.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:03.022+0000 7f6a4ec4c640 1 --2- 172.21.15.107:0/3194635762 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6a3806e530 0x7f6a380709e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6a480664f0 tx=0x7f6a3400b040 comp rx=0 tx=0).stop 2024-09-21T08:09:03.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:03.022+0000 7f6a4ec4c640 1 -- 172.21.15.107:0/3194635762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a480fb480 msgr2=0x7f6a4810e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:03.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:03.022+0000 7f6a4ec4c640 1 --2- 172.21.15.107:0/3194635762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a480fb480 0x7f6a4810e310 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c000c00 tx=0x7f6a3c009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:03.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:03.022+0000 7f6a4ec4c640 1 -- 172.21.15.107:0/3194635762 shutdown_connections 2024-09-21T08:09:03.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:03.022+0000 7f6a4ec4c640 1 --2- 172.21.15.107:0/3194635762 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6a3806e530 0x7f6a380709e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:03.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:03.022+0000 7f6a4ec4c640 1 --2- 172.21.15.107:0/3194635762 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6a481014c0 0x7f6a4810e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:03.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:03.022+0000 7f6a4ec4c640 1 --2- 172.21.15.107:0/3194635762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a480fb480 0x7f6a4810e310 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:03.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:03.022+0000 7f6a4ec4c640 1 -- 172.21.15.107:0/3194635762 >> 172.21.15.107:0/3194635762 conn(0x7f6a480f7020 msgr2=0x7f6a480f8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:03.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:03.022+0000 7f6a4ec4c640 1 -- 172.21.15.107:0/3194635762 shutdown_connections 2024-09-21T08:09:03.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:03.022+0000 7f6a4ec4c640 1 -- 172.21.15.107:0/3194635762 wait complete. 2024-09-21T08:09:03.211 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:02 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/4128729968' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:09:03.212 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:02 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/2210514690' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:09:03.212 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:02 smithi129 ceph-mon[76722]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:09:03.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:02 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/4128729968' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:09:03.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:02 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/2210514690' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:09:03.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:02 smithi107 ceph-mon[97757]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:09:04.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:03 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/3194635762' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:09:04.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:03 smithi129 ceph-mon[76722]: Health check update: Degraded data redundancy: 48/219 objects degraded (21.918%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T08:09:04.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:03 smithi129 ceph-mon[76722]: pgmap v112: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-21T08:09:04.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:04.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:04.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:09:04.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:09:04.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:04.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:09:04.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:03 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:09:04.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:03 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/3194635762' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:09:04.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:03 smithi107 ceph-mon[97757]: Health check update: Degraded data redundancy: 48/219 objects degraded (21.918%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T08:09:04.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:03 smithi107 ceph-mon[97757]: pgmap v112: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-21T08:09:04.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:04.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:04.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:09:04.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:09:04.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:04.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:09:04.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:03 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:09:05.226 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:04 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:09:05.226 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:04 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:09:05.226 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:04 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T08:09:05.226 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:04 smithi129 ceph-mon[76722]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T08:09:05.226 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:04 smithi129 ceph-mon[76722]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-21T08:09:05.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:04 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:09:05.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:04 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:09:05.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:04 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T08:09:05.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:04 smithi107 ceph-mon[97757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T08:09:05.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:04 smithi107 ceph-mon[97757]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-21T08:09:05.516 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:09:05 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3[85557]: 2024-09-21T08:09:05.224+0000 7fc47660c640 -1 osd.3 62 log_to_monitors true 2024-09-21T08:09:06.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:05 smithi129 ceph-mon[76722]: from='osd.3 [v2:172.21.15.129:6800/974477155,v1:172.21.15.129:6801/974477155]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T08:09:06.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:05 smithi129 ceph-mon[76722]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T08:09:06.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:05 smithi129 ceph-mon[76722]: pgmap v113: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-21T08:09:06.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:05 smithi107 ceph-mon[97757]: from='osd.3 [v2:172.21.15.129:6800/974477155,v1:172.21.15.129:6801/974477155]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T08:09:06.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:05 smithi107 ceph-mon[97757]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T08:09:06.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:05 smithi107 ceph-mon[97757]: pgmap v113: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-21T08:09:07.016 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:09:06 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3[85557]: 2024-09-21T08:09:06.745+0000 7fc46a39e640 -1 osd.3 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T08:09:07.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:06 smithi129 ceph-mon[76722]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T08:09:07.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:06 smithi129 ceph-mon[76722]: osdmap e65: 6 total, 5 up, 6 in 2024-09-21T08:09:07.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:06 smithi129 ceph-mon[76722]: from='osd.3 [v2:172.21.15.129:6800/974477155,v1:172.21.15.129:6801/974477155]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T08:09:07.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:06 smithi129 ceph-mon[76722]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T08:09:07.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:06 smithi129 ceph-mon[76722]: from='osd.3 ' entity='osd.3' 2024-09-21T08:09:07.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:06 smithi107 ceph-mon[97757]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T08:09:07.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:06 smithi107 ceph-mon[97757]: osdmap e65: 6 total, 5 up, 6 in 2024-09-21T08:09:07.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:06 smithi107 ceph-mon[97757]: from='osd.3 [v2:172.21.15.129:6800/974477155,v1:172.21.15.129:6801/974477155]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T08:09:07.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:06 smithi107 ceph-mon[97757]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T08:09:07.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:06 smithi107 ceph-mon[97757]: from='osd.3 ' entity='osd.3' 2024-09-21T08:09:08.244 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:07 smithi129 ceph-mon[76722]: pgmap v115: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-21T08:09:08.244 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:07 smithi129 ceph-mon[76722]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T08:09:08.244 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:07 smithi129 ceph-mon[76722]: osd.3 [v2:172.21.15.129:6800/974477155,v1:172.21.15.129:6801/974477155] boot 2024-09-21T08:09:08.244 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:07 smithi129 ceph-mon[76722]: osdmap e66: 6 total, 6 up, 6 in 2024-09-21T08:09:08.244 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:07 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T08:09:08.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:07 smithi107 ceph-mon[97757]: pgmap v115: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-21T08:09:08.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:07 smithi107 ceph-mon[97757]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T08:09:08.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:07 smithi107 ceph-mon[97757]: osd.3 [v2:172.21.15.129:6800/974477155,v1:172.21.15.129:6801/974477155] boot 2024-09-21T08:09:08.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:07 smithi107 ceph-mon[97757]: osdmap e66: 6 total, 6 up, 6 in 2024-09-21T08:09:08.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:07 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T08:09:10.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:09 smithi129 ceph-mon[76722]: osdmap e67: 6 total, 6 up, 6 in 2024-09-21T08:09:10.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:09 smithi107 ceph-mon[97757]: osdmap e67: 6 total, 6 up, 6 in 2024-09-21T08:09:11.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:10 smithi129 ceph-mon[76722]: pgmap v118: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-21T08:09:11.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:10 smithi107 ceph-mon[97757]: pgmap v118: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-21T08:09:12.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:11 smithi107 ceph-mon[97757]: Health check update: Degraded data redundancy: 12/219 objects degraded (5.479%), 4 pgs degraded (PG_DEGRADED) 2024-09-21T08:09:12.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:11 smithi129 ceph-mon[76722]: Health check update: Degraded data redundancy: 12/219 objects degraded (5.479%), 4 pgs degraded (PG_DEGRADED) 2024-09-21T08:09:13.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:12 smithi107 ceph-mon[97757]: pgmap v119: 65 pgs: 3 active+undersized, 4 active+undersized+degraded, 58 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 12/219 objects degraded (5.479%) 2024-09-21T08:09:13.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:12 smithi129 ceph-mon[76722]: pgmap v119: 65 pgs: 3 active+undersized, 4 active+undersized+degraded, 58 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 12/219 objects degraded (5.479%) 2024-09-21T08:09:14.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:13 smithi129 ceph-mon[76722]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/219 objects degraded (5.479%), 4 pgs degraded) 2024-09-21T08:09:14.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:13 smithi129 ceph-mon[76722]: Cluster is now healthy 2024-09-21T08:09:14.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:13 smithi107 ceph-mon[97757]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/219 objects degraded (5.479%), 4 pgs degraded) 2024-09-21T08:09:14.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:13 smithi107 ceph-mon[97757]: Cluster is now healthy 2024-09-21T08:09:15.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:14 smithi129 ceph-mon[76722]: pgmap v120: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:15.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:14 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:15.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:14 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:09:15.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:14 smithi107 ceph-mon[97757]: pgmap v120: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:15.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:14 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:15.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:14 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:09:17.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:16 smithi129 ceph-mon[76722]: pgmap v121: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:17.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:16 smithi107 ceph-mon[97757]: pgmap v121: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:19.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:18 smithi129 ceph-mon[76722]: pgmap v122: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:19.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:18 smithi107 ceph-mon[97757]: pgmap v122: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:20.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:19 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T08:09:20.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:19 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:20.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:19 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T08:09:20.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:19 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:21.253 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:20 smithi107 ceph-mon[97757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T08:09:21.253 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:20 smithi107 ceph-mon[97757]: Upgrade: osd.4 is safe to restart 2024-09-21T08:09:21.253 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:20 smithi107 ceph-mon[97757]: pgmap v123: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:21.253 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:20 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:21.253 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:20 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-21T08:09:21.253 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:20 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:09:21.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:20 smithi129 ceph-mon[76722]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T08:09:21.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:20 smithi129 ceph-mon[76722]: Upgrade: osd.4 is safe to restart 2024-09-21T08:09:21.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:20 smithi129 ceph-mon[76722]: pgmap v123: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:21.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:20 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:21.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:20 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-21T08:09:21.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:20 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:09:21.994 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:21 smithi129 ceph-mon[76722]: Upgrade: Updating osd.4 2024-09-21T08:09:21.994 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:21 smithi129 ceph-mon[76722]: Deploying daemon osd.4 on smithi129 2024-09-21T08:09:22.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:21 smithi107 ceph-mon[97757]: Upgrade: Updating osd.4 2024-09-21T08:09:22.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:21 smithi107 ceph-mon[97757]: Deploying daemon osd.4 on smithi129 2024-09-21T08:09:23.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:22 smithi129 ceph-mon[76722]: pgmap v124: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:23.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:22 smithi107 ceph-mon[97757]: pgmap v124: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:23.532 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:23 smithi129 systemd[1]: Stopping Ceph osd.4 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:09:23.884 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:23 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[46116]: 2024-09-21T08:09:23.529+0000 7f662c892640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:09:23.884 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:23 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[46116]: 2024-09-21T08:09:23.529+0000 7f662c892640 -1 osd.4 67 *** Got signal Terminated *** 2024-09-21T08:09:23.885 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:23 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[46116]: 2024-09-21T08:09:23.529+0000 7f662c892640 -1 osd.4 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:09:24.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:23 smithi129 ceph-mon[76722]: osd.4 marked itself down and dead 2024-09-21T08:09:24.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:23 smithi107 ceph-mon[97757]: osd.4 marked itself down and dead 2024-09-21T08:09:24.524 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:24 smithi129 podman[89956]: 2024-09-21 08:09:24.267135366 +0000 UTC m=+0.846251969 container died 2f916ef76d2267574f93253a74f8971ce7559c2dca733804883b7b7950aea092 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=quincy-fbd1a6a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:09:24.883 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:24 smithi129 podman[89956]: 2024-09-21 08:09:24.614563599 +0000 UTC m=+1.193680211 container cleanup 2f916ef76d2267574f93253a74f8971ce7559c2dca733804883b7b7950aea092 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=quincy-fbd1a6a) 2024-09-21T08:09:24.883 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:24 smithi129 bash[89956]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4 2024-09-21T08:09:25.266 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:24 smithi129 podman[89971]: 2024-09-21 08:09:24.96184207 +0000 UTC m=+0.689379049 container remove 2f916ef76d2267574f93253a74f8971ce7559c2dca733804883b7b7950aea092 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=quincy-fbd1a6a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:09:25.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:24 smithi129 ceph-mon[76722]: pgmap v125: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:25.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:24 smithi129 ceph-mon[76722]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T08:09:25.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:24 smithi129 ceph-mon[76722]: osdmap e68: 6 total, 5 up, 6 in 2024-09-21T08:09:25.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:24 smithi107 ceph-mon[97757]: pgmap v125: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:25.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:24 smithi107 ceph-mon[97757]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T08:09:25.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:24 smithi107 ceph-mon[97757]: osdmap e68: 6 total, 5 up, 6 in 2024-09-21T08:09:25.582 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:25 smithi129 podman[90058]: 2024-09-21 08:09:25.176584679 +0000 UTC m=+0.015817304 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:09:25.582 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:25 smithi129 podman[90058]: 2024-09-21 08:09:25.285004382 +0000 UTC m=+0.124237041 container create e5a1c8b844d8822cc1b3c352053adcf90ec579b0942c6b309498e62c91b18844 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T08:09:25.582 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:25 smithi129 podman[90058]: 2024-09-21 08:09:25.506757919 +0000 UTC m=+0.345990543 container init e5a1c8b844d8822cc1b3c352053adcf90ec579b0942c6b309498e62c91b18844 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70) 2024-09-21T08:09:25.583 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:25 smithi129 podman[90058]: 2024-09-21 08:09:25.510109223 +0000 UTC m=+0.349341837 container start e5a1c8b844d8822cc1b3c352053adcf90ec579b0942c6b309498e62c91b18844 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T08:09:25.583 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:25 smithi129 podman[90058]: 2024-09-21 08:09:25.581916987 +0000 UTC m=+0.421149611 container attach e5a1c8b844d8822cc1b3c352053adcf90ec579b0942c6b309498e62c91b18844 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T08:09:25.892 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:25 smithi129 podman[90058]: 2024-09-21 08:09:25.694109525 +0000 UTC m=+0.533342140 container died e5a1c8b844d8822cc1b3c352053adcf90ec579b0942c6b309498e62c91b18844 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70) 2024-09-21T08:09:26.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:25 smithi129 ceph-mon[76722]: osdmap e69: 6 total, 5 up, 6 in 2024-09-21T08:09:26.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:25 smithi107 ceph-mon[97757]: osdmap e69: 6 total, 5 up, 6 in 2024-09-21T08:09:26.704 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:26 smithi129 podman[90081]: 2024-09-21 08:09:26.268944905 +0000 UTC m=+0.568809897 container remove e5a1c8b844d8822cc1b3c352053adcf90ec579b0942c6b309498e62c91b18844 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T08:09:26.705 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:26 smithi129 systemd[1]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.4.service: Deactivated successfully. 2024-09-21T08:09:26.705 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:26 smithi129 systemd[1]: Stopped Ceph osd.4 for 786d4f32-77ee-11ef-baf6-efdc52797490. 2024-09-21T08:09:26.705 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:26 smithi129 systemd[1]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.4.service: Consumed 59.822s CPU time. 2024-09-21T08:09:26.705 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:26 smithi129 systemd[1]: Starting Ceph osd.4 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:09:27.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:26 smithi129 ceph-mon[76722]: pgmap v128: 65 pgs: 3 active+undersized, 5 stale+active+clean, 2 active+undersized+degraded, 55 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4/219 objects degraded (1.826%) 2024-09-21T08:09:27.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:26 smithi129 ceph-mon[76722]: Health check failed: Degraded data redundancy: 4/219 objects degraded (1.826%), 2 pgs degraded (PG_DEGRADED) 2024-09-21T08:09:27.017 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:26 smithi129 podman[90179]: 2024-09-21 08:09:26.606721391 +0000 UTC m=+0.015677664 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:09:27.017 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:26 smithi129 podman[90179]: 2024-09-21 08:09:26.736747369 +0000 UTC m=+0.145703627 container create dc2c2e78ade2dad3b5f0b38ce4aa1ca46891cf0b2e204a7fc9a97077d8f501ef (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-activate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70) 2024-09-21T08:09:27.017 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:26 smithi129 podman[90179]: 2024-09-21 08:09:26.948931295 +0000 UTC m=+0.357887558 container init dc2c2e78ade2dad3b5f0b38ce4aa1ca46891cf0b2e204a7fc9a97077d8f501ef (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-activate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:09:27.017 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:26 smithi129 podman[90179]: 2024-09-21 08:09:26.952274286 +0000 UTC m=+0.361230548 container start dc2c2e78ade2dad3b5f0b38ce4aa1ca46891cf0b2e204a7fc9a97077d8f501ef (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:09:27.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:26 smithi107 ceph-mon[97757]: pgmap v128: 65 pgs: 3 active+undersized, 5 stale+active+clean, 2 active+undersized+degraded, 55 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4/219 objects degraded (1.826%) 2024-09-21T08:09:27.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:26 smithi107 ceph-mon[97757]: Health check failed: Degraded data redundancy: 4/219 objects degraded (1.826%), 2 pgs degraded (PG_DEGRADED) 2024-09-21T08:09:27.516 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:27 smithi129 podman[90179]: 2024-09-21 08:09:27.037327458 +0000 UTC m=+0.446283732 container attach dc2c2e78ade2dad3b5f0b38ce4aa1ca46891cf0b2e204a7fc9a97077d8f501ef (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-activate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:09:27.516 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:27 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-activate[90194]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:09:27.517 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:27 smithi129 bash[90179]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:09:27.517 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:27 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-activate[90194]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:09:27.517 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:27 smithi129 bash[90179]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:09:28.116 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:27 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-activate[90194]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T08:09:28.116 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:27 smithi129 bash[90179]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T08:09:28.116 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:27 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-activate[90194]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-21T08:09:28.116 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:27 smithi129 bash[90179]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-21T08:09:28.448 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:28 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-activate[90194]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-21T08:09:28.448 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:28 smithi129 bash[90179]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-21T08:09:28.448 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:28 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-activate[90194]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T08:09:28.448 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:28 smithi129 bash[90179]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T08:09:28.448 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:28 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-activate[90194]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-21T08:09:28.448 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:28 smithi129 bash[90179]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-21T08:09:28.449 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:28 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-activate[90194]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T08:09:28.449 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:28 smithi129 bash[90179]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T08:09:28.449 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:28 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-activate[90194]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-21T08:09:28.449 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:28 smithi129 bash[90179]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-21T08:09:28.449 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:28 smithi129 podman[90179]: 2024-09-21 08:09:28.144073039 +0000 UTC m=+1.553029298 container died dc2c2e78ade2dad3b5f0b38ce4aa1ca46891cf0b2e204a7fc9a97077d8f501ef (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-activate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T08:09:29.067 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:28 smithi129 ceph-mon[76722]: pgmap v129: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-21T08:09:29.067 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:28 smithi129 podman[90339]: 2024-09-21 08:09:28.76925362 +0000 UTC m=+0.618777296 container remove dc2c2e78ade2dad3b5f0b38ce4aa1ca46891cf0b2e204a7fc9a97077d8f501ef (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-activate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T08:09:29.068 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:28 smithi129 podman[90400]: 2024-09-21 08:09:28.876128623 +0000 UTC m=+0.015858320 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:09:29.068 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:28 smithi129 podman[90400]: 2024-09-21 08:09:28.978662505 +0000 UTC m=+0.118392228 container create 0d09ba7072ba81887b6820d877ebddeb8e2ca9655701d25f142c71f1224ee984 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T08:09:29.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:28 smithi107 ceph-mon[97757]: pgmap v129: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-21T08:09:29.516 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:29 smithi129 podman[90400]: 2024-09-21 08:09:29.20642924 +0000 UTC m=+0.346158935 container init 0d09ba7072ba81887b6820d877ebddeb8e2ca9655701d25f142c71f1224ee984 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T08:09:29.517 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:29 smithi129 podman[90400]: 2024-09-21 08:09:29.209620386 +0000 UTC m=+0.349350071 container start 0d09ba7072ba81887b6820d877ebddeb8e2ca9655701d25f142c71f1224ee984 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T08:09:29.517 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:29 smithi129 ceph-osd[90419]: -- 172.21.15.129:0/1944739791 <== mon.1 v2:172.21.15.129:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e8863801e0 con 0x55e886368000 2024-09-21T08:09:29.517 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:29 smithi129 bash[90400]: 0d09ba7072ba81887b6820d877ebddeb8e2ca9655701d25f142c71f1224ee984 2024-09-21T08:09:29.517 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:29 smithi129 systemd[1]: Started Ceph osd.4 for 786d4f32-77ee-11ef-baf6-efdc52797490. 2024-09-21T08:09:30.698 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:30 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:30.698 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:30 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:30.698 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:30 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:09:30.698 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:30 smithi129 ceph-mon[76722]: pgmap v130: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-21T08:09:30.698 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:30 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:30.698 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:30 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:09:30.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:30 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:30.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:30 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:30.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:30 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:09:30.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:30 smithi107 ceph-mon[97757]: pgmap v130: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-21T08:09:30.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:30 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:30.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:30 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:09:31.516 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:31 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[90415]: 2024-09-21T08:09:31.080+0000 7f1c8e45c640 -1 Falling back to public interface 2024-09-21T08:09:33.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:32 smithi129 ceph-mon[76722]: pgmap v131: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-21T08:09:33.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:32 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:33.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:32 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:33.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:32 smithi107 ceph-mon[97757]: pgmap v131: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-21T08:09:33.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:32 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:33.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:32 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:33.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.114+0000 7f15c9588640 1 -- 172.21.15.107:0/1231954000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15c4102660 msgr2=0x7f15c4102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:33.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.114+0000 7f15c9588640 1 --2- 172.21.15.107:0/1231954000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15c4102660 0x7f15c4102a30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f15b40048d0 tx=0x7f15b4009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.114+0000 7f15c9588640 1 -- 172.21.15.107:0/1231954000 shutdown_connections 2024-09-21T08:09:33.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.114+0000 7f15c9588640 1 --2- 172.21.15.107:0/1231954000 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15c40fac80 0x7f15c40fb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.114+0000 7f15c9588640 1 --2- 172.21.15.107:0/1231954000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15c4102660 0x7f15c4102a30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.114+0000 7f15c9588640 1 -- 172.21.15.107:0/1231954000 >> 172.21.15.107:0/1231954000 conn(0x7f15c4070ce0 msgr2=0x7f15c40710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:33.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.114+0000 7f15c9588640 1 -- 172.21.15.107:0/1231954000 shutdown_connections 2024-09-21T08:09:33.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.114+0000 7f15c9588640 1 -- 172.21.15.107:0/1231954000 wait complete. 2024-09-21T08:09:33.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.115+0000 7f15c9588640 1 Processor -- start 2024-09-21T08:09:33.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.115+0000 7f15c9588640 1 -- start start 2024-09-21T08:09:33.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.115+0000 7f15c9588640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15c40fac80 0x7f15c4113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:33.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.115+0000 7f15c9588640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15c4102660 0x7f15c41136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:33.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.115+0000 7f15c9588640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c4113cb0 con 0x7f15c4102660 2024-09-21T08:09:33.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.115+0000 7f15c9588640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c4113e20 con 0x7f15c40fac80 2024-09-21T08:09:33.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.116+0000 7f15ba7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15c4102660 0x7f15c41136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:33.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.116+0000 7f15c2ffd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15c40fac80 0x7f15c4113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:33.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.116+0000 7f15c2ffd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15c40fac80 0x7f15c4113170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.107:52934/0 (socket says 172.21.15.107:52934) 2024-09-21T08:09:33.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.116+0000 7f15ba7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15c4102660 0x7f15c41136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57416/0 (socket says 172.21.15.107:57416) 2024-09-21T08:09:33.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.116+0000 7f15c2ffd640 1 -- 172.21.15.107:0/3314440743 learned_addr learned my addr 172.21.15.107:0/3314440743 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:09:33.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.116+0000 7f15ba7fc640 1 -- 172.21.15.107:0/3314440743 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15c40fac80 msgr2=0x7f15c4113170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:33.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.116+0000 7f15ba7fc640 1 --2- 172.21.15.107:0/3314440743 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15c40fac80 0x7f15c4113170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.116+0000 7f15ba7fc640 1 -- 172.21.15.107:0/3314440743 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b4005040 con 0x7f15c4102660 2024-09-21T08:09:33.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.116+0000 7f15c2ffd640 1 --2- 172.21.15.107:0/3314440743 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15c40fac80 0x7f15c4113170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:09:33.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.116+0000 7f15ba7fc640 1 --2- 172.21.15.107:0/3314440743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15c4102660 0x7f15c41136b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0027d0 tx=0x7f15ac009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:33.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.116+0000 7f15bbfff640 1 -- 172.21.15.107:0/3314440743 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15ac007a20 con 0x7f15c4102660 2024-09-21T08:09:33.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.116+0000 7f15bbfff640 1 -- 172.21.15.107:0/3314440743 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f15ac00f040 con 0x7f15c4102660 2024-09-21T08:09:33.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.116+0000 7f15c9588640 1 -- 172.21.15.107:0/3314440743 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c410d2a0 con 0x7f15c4102660 2024-09-21T08:09:33.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.116+0000 7f15bbfff640 1 -- 172.21.15.107:0/3314440743 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15ac009470 con 0x7f15c4102660 2024-09-21T08:09:33.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.117+0000 7f15c9588640 1 -- 172.21.15.107:0/3314440743 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c410d840 con 0x7f15c4102660 2024-09-21T08:09:33.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.118+0000 7f15c9588640 1 -- 172.21.15.107:0/3314440743 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c40657d0 con 0x7f15c4102660 2024-09-21T08:09:33.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.118+0000 7f15bbfff640 1 -- 172.21.15.107:0/3314440743 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f15ac0096e0 con 0x7f15c4102660 2024-09-21T08:09:33.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.119+0000 7f15bbfff640 1 --2- 172.21.15.107:0/3314440743 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f15b006e530 0x7f15b00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:33.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.119+0000 7f15bbfff640 1 -- 172.21.15.107:0/3314440743 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f15ac08d800 con 0x7f15c4102660 2024-09-21T08:09:33.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.119+0000 7f15c2ffd640 1 --2- 172.21.15.107:0/3314440743 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f15b006e530 0x7f15b00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:33.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.119+0000 7f15c2ffd640 1 --2- 172.21.15.107:0/3314440743 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f15b006e530 0x7f15b00709e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f15b4004540 tx=0x7f15b4035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:33.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.123+0000 7f15bbfff640 1 -- 172.21.15.107:0/3314440743 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f15ac056a40 con 0x7f15c4102660 2024-09-21T08:09:33.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.308+0000 7f15c9588640 1 -- 172.21.15.107:0/3314440743 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f15c404b720 con 0x7f15b006e530 2024-09-21T08:09:33.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.309+0000 7f15bbfff640 1 -- 172.21.15.107:0/3314440743 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f15c404b720 con 0x7f15b006e530 2024-09-21T08:09:33.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.311+0000 7f15c9588640 1 -- 172.21.15.107:0/3314440743 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f15b006e530 msgr2=0x7f15b00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:33.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.311+0000 7f15c9588640 1 --2- 172.21.15.107:0/3314440743 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f15b006e530 0x7f15b00709e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f15b4004540 tx=0x7f15b4035040 comp rx=0 tx=0).stop 2024-09-21T08:09:33.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.311+0000 7f15c9588640 1 -- 172.21.15.107:0/3314440743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15c4102660 msgr2=0x7f15c41136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:33.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.311+0000 7f15c9588640 1 --2- 172.21.15.107:0/3314440743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15c4102660 0x7f15c41136b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0027d0 tx=0x7f15ac009f70 comp rx=0 tx=0).stop 2024-09-21T08:09:33.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.311+0000 7f15c9588640 1 -- 172.21.15.107:0/3314440743 shutdown_connections 2024-09-21T08:09:33.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.311+0000 7f15c9588640 1 --2- 172.21.15.107:0/3314440743 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f15b006e530 0x7f15b00709e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.311+0000 7f15c9588640 1 --2- 172.21.15.107:0/3314440743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15c4102660 0x7f15c41136b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.311+0000 7f15c9588640 1 --2- 172.21.15.107:0/3314440743 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15c40fac80 0x7f15c4113170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.311+0000 7f15c9588640 1 -- 172.21.15.107:0/3314440743 >> 172.21.15.107:0/3314440743 conn(0x7f15c4070ce0 msgr2=0x7f15c40fa050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:33.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.312+0000 7f15c9588640 1 -- 172.21.15.107:0/3314440743 shutdown_connections 2024-09-21T08:09:33.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.312+0000 7f15c9588640 1 -- 172.21.15.107:0/3314440743 wait complete. 2024-09-21T08:09:33.322 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:09:33.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.390+0000 7f1c4acd7640 1 -- 172.21.15.107:0/1359377192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c440fb480 msgr2=0x7f1c440fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:33.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.390+0000 7f1c4acd7640 1 --2- 172.21.15.107:0/1359377192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c440fb480 0x7f1c440fb8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1c300048d0 tx=0x7f1c30009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.390+0000 7f1c4acd7640 1 -- 172.21.15.107:0/1359377192 shutdown_connections 2024-09-21T08:09:33.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.390+0000 7f1c4acd7640 1 --2- 172.21.15.107:0/1359377192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c440fb480 0x7f1c440fb8f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.390+0000 7f1c4acd7640 1 --2- 172.21.15.107:0/1359377192 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1c441014c0 0x7f1c44101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.390+0000 7f1c4acd7640 1 -- 172.21.15.107:0/1359377192 >> 172.21.15.107:0/1359377192 conn(0x7f1c440f7000 msgr2=0x7f1c440f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:33.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.391+0000 7f1c4acd7640 1 -- 172.21.15.107:0/1359377192 shutdown_connections 2024-09-21T08:09:33.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.391+0000 7f1c4acd7640 1 -- 172.21.15.107:0/1359377192 wait complete. 2024-09-21T08:09:33.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.391+0000 7f1c4acd7640 1 Processor -- start 2024-09-21T08:09:33.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.391+0000 7f1c4acd7640 1 -- start start 2024-09-21T08:09:33.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.392+0000 7f1c4acd7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1c440fb480 0x7f1c4410e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:33.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.392+0000 7f1c4acd7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c441014c0 0x7f1c4410e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:33.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.392+0000 7f1c4acd7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4410ee30 con 0x7f1c441014c0 2024-09-21T08:09:33.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.392+0000 7f1c4acd7640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4410efa0 con 0x7f1c440fb480 2024-09-21T08:09:33.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.392+0000 7f1c43fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c441014c0 0x7f1c4410e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:33.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.392+0000 7f1c43fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c441014c0 0x7f1c4410e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57426/0 (socket says 172.21.15.107:57426) 2024-09-21T08:09:33.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.392+0000 7f1c43fff640 1 -- 172.21.15.107:0/252152100 learned_addr learned my addr 172.21.15.107:0/252152100 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:09:33.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.392+0000 7f1c48a73640 1 --2- 172.21.15.107:0/252152100 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1c440fb480 0x7f1c4410e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:33.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.392+0000 7f1c43fff640 1 -- 172.21.15.107:0/252152100 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1c440fb480 msgr2=0x7f1c4410e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:33.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.392+0000 7f1c43fff640 1 --2- 172.21.15.107:0/252152100 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1c440fb480 0x7f1c4410e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.392+0000 7f1c43fff640 1 -- 172.21.15.107:0/252152100 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c30005040 con 0x7f1c441014c0 2024-09-21T08:09:33.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.392+0000 7f1c43fff640 1 --2- 172.21.15.107:0/252152100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c441014c0 0x7f1c4410e750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1c30003080 tx=0x7f1c30009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:33.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.393+0000 7f1c417fa640 1 -- 172.21.15.107:0/252152100 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c30038070 con 0x7f1c441014c0 2024-09-21T08:09:33.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.393+0000 7f1c4acd7640 1 -- 172.21.15.107:0/252152100 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c44117280 con 0x7f1c441014c0 2024-09-21T08:09:33.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.393+0000 7f1c417fa640 1 -- 172.21.15.107:0/252152100 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1c300097e0 con 0x7f1c441014c0 2024-09-21T08:09:33.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.393+0000 7f1c417fa640 1 -- 172.21.15.107:0/252152100 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c3003d420 con 0x7f1c441014c0 2024-09-21T08:09:33.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.393+0000 7f1c4acd7640 1 -- 172.21.15.107:0/252152100 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c441176f0 con 0x7f1c441014c0 2024-09-21T08:09:33.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.395+0000 7f1c4acd7640 1 -- 172.21.15.107:0/252152100 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c440fcbc0 con 0x7f1c441014c0 2024-09-21T08:09:33.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.395+0000 7f1c417fa640 1 -- 172.21.15.107:0/252152100 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1c30030020 con 0x7f1c441014c0 2024-09-21T08:09:33.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.395+0000 7f1c417fa640 1 --2- 172.21.15.107:0/252152100 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1c3406e530 0x7f1c340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:33.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.395+0000 7f1c417fa640 1 -- 172.21.15.107:0/252152100 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f1c300ae490 con 0x7f1c441014c0 2024-09-21T08:09:33.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.395+0000 7f1c48a73640 1 --2- 172.21.15.107:0/252152100 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1c3406e530 0x7f1c340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:33.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.396+0000 7f1c48a73640 1 --2- 172.21.15.107:0/252152100 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1c3406e530 0x7f1c340709e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1c38009b50 tx=0x7f1c38009120 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:33.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.400+0000 7f1c417fa640 1 -- 172.21.15.107:0/252152100 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1c30077620 con 0x7f1c441014c0 2024-09-21T08:09:33.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.584+0000 7f1c4acd7640 1 -- 172.21.15.107:0/252152100 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c4404b720 con 0x7f1c3406e530 2024-09-21T08:09:33.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.586+0000 7f1c417fa640 1 -- 172.21.15.107:0/252152100 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f1c4404b720 con 0x7f1c3406e530 2024-09-21T08:09:33.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.588+0000 7f1c4acd7640 1 -- 172.21.15.107:0/252152100 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1c3406e530 msgr2=0x7f1c340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:33.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.588+0000 7f1c4acd7640 1 --2- 172.21.15.107:0/252152100 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1c3406e530 0x7f1c340709e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1c38009b50 tx=0x7f1c38009120 comp rx=0 tx=0).stop 2024-09-21T08:09:33.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.588+0000 7f1c4acd7640 1 -- 172.21.15.107:0/252152100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c441014c0 msgr2=0x7f1c4410e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:33.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.588+0000 7f1c4acd7640 1 --2- 172.21.15.107:0/252152100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c441014c0 0x7f1c4410e750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1c30003080 tx=0x7f1c30009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.588+0000 7f1c4acd7640 1 -- 172.21.15.107:0/252152100 shutdown_connections 2024-09-21T08:09:33.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.588+0000 7f1c4acd7640 1 --2- 172.21.15.107:0/252152100 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1c3406e530 0x7f1c340709e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.588+0000 7f1c4acd7640 1 --2- 172.21.15.107:0/252152100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c441014c0 0x7f1c4410e750 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.588+0000 7f1c4acd7640 1 --2- 172.21.15.107:0/252152100 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1c440fb480 0x7f1c4410e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.588+0000 7f1c4acd7640 1 -- 172.21.15.107:0/252152100 >> 172.21.15.107:0/252152100 conn(0x7f1c440f7000 msgr2=0x7f1c440f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:33.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.588+0000 7f1c4acd7640 1 -- 172.21.15.107:0/252152100 shutdown_connections 2024-09-21T08:09:33.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.588+0000 7f1c4acd7640 1 -- 172.21.15.107:0/252152100 wait complete. 2024-09-21T08:09:33.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.666+0000 7f4f31b45640 1 -- 172.21.15.107:0/3483415973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f2c0fd580 msgr2=0x7f4f2c0fd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:33.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.666+0000 7f4f31b45640 1 --2- 172.21.15.107:0/3483415973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f2c0fd580 0x7f4f2c0fd950 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c004900 tx=0x7f4f1c009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.666+0000 7f4f31b45640 1 -- 172.21.15.107:0/3483415973 shutdown_connections 2024-09-21T08:09:33.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.666+0000 7f4f31b45640 1 --2- 172.21.15.107:0/3483415973 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f2c0fdf20 0x7f4f2c1065f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.666+0000 7f4f31b45640 1 --2- 172.21.15.107:0/3483415973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f2c0fd580 0x7f4f2c0fd950 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.666+0000 7f4f31b45640 1 -- 172.21.15.107:0/3483415973 >> 172.21.15.107:0/3483415973 conn(0x7f4f2c0f7060 msgr2=0x7f4f2c0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:33.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.667+0000 7f4f31b45640 1 -- 172.21.15.107:0/3483415973 shutdown_connections 2024-09-21T08:09:33.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.667+0000 7f4f31b45640 1 -- 172.21.15.107:0/3483415973 wait complete. 2024-09-21T08:09:33.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.667+0000 7f4f31b45640 1 Processor -- start 2024-09-21T08:09:33.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.667+0000 7f4f31b45640 1 -- start start 2024-09-21T08:09:33.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.668+0000 7f4f31b45640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f2c0fd580 0x7f4f2c0fb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:33.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.668+0000 7f4f31b45640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f2c0fdf20 0x7f4f2c0fb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:33.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.668+0000 7f4f31b45640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c0fbec0 con 0x7f4f2c0fdf20 2024-09-21T08:09:33.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.668+0000 7f4f31b45640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c0fc030 con 0x7f4f2c0fd580 2024-09-21T08:09:33.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.668+0000 7f4f2affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f2c0fdf20 0x7f4f2c0fb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:33.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.668+0000 7f4f2affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f2c0fdf20 0x7f4f2c0fb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57442/0 (socket says 172.21.15.107:57442) 2024-09-21T08:09:33.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.668+0000 7f4f2affd640 1 -- 172.21.15.107:0/2280492225 learned_addr learned my addr 172.21.15.107:0/2280492225 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:09:33.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.668+0000 7f4f2b7fe640 1 --2- 172.21.15.107:0/2280492225 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f2c0fd580 0x7f4f2c0fb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:33.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.668+0000 7f4f2affd640 1 -- 172.21.15.107:0/2280492225 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f2c0fd580 msgr2=0x7f4f2c0fb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:33.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.668+0000 7f4f2affd640 1 --2- 172.21.15.107:0/2280492225 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f2c0fd580 0x7f4f2c0fb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.668+0000 7f4f2affd640 1 -- 172.21.15.107:0/2280492225 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1c005040 con 0x7f4f2c0fdf20 2024-09-21T08:09:33.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.668+0000 7f4f2affd640 1 --2- 172.21.15.107:0/2280492225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f2c0fdf20 0x7f4f2c0fb980 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4f20002a50 tx=0x7f4f20004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:33.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.668+0000 7f4f13fff640 1 -- 172.21.15.107:0/2280492225 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f20007c30 con 0x7f4f2c0fdf20 2024-09-21T08:09:33.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.668+0000 7f4f13fff640 1 -- 172.21.15.107:0/2280492225 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4f2000f040 con 0x7f4f2c0fdf20 2024-09-21T08:09:33.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.668+0000 7f4f13fff640 1 -- 172.21.15.107:0/2280492225 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f2000da10 con 0x7f4f2c0fdf20 2024-09-21T08:09:33.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.668+0000 7f4f31b45640 1 -- 172.21.15.107:0/2280492225 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c0fc2c0 con 0x7f4f2c0fdf20 2024-09-21T08:09:33.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.669+0000 7f4f31b45640 1 -- 172.21.15.107:0/2280492225 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2c1198f0 con 0x7f4f2c0fdf20 2024-09-21T08:09:33.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.669+0000 7f4f31b45640 1 -- 172.21.15.107:0/2280492225 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2c0662d0 con 0x7f4f2c0fdf20 2024-09-21T08:09:33.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.670+0000 7f4f13fff640 1 -- 172.21.15.107:0/2280492225 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4f2000dbb0 con 0x7f4f2c0fdf20 2024-09-21T08:09:33.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.671+0000 7f4f13fff640 1 --2- 172.21.15.107:0/2280492225 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4f1406e530 0x7f4f140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:33.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.671+0000 7f4f13fff640 1 -- 172.21.15.107:0/2280492225 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4f2008d7d0 con 0x7f4f2c0fdf20 2024-09-21T08:09:33.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.671+0000 7f4f2b7fe640 1 --2- 172.21.15.107:0/2280492225 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4f1406e530 0x7f4f140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:33.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.671+0000 7f4f2b7fe640 1 --2- 172.21.15.107:0/2280492225 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4f1406e530 0x7f4f140709e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c004540 tx=0x7f4f1c035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:33.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.675+0000 7f4f13fff640 1 -- 172.21.15.107:0/2280492225 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4f20056a90 con 0x7f4f2c0fdf20 2024-09-21T08:09:33.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.851+0000 7f4f31b45640 1 -- 172.21.15.107:0/2280492225 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f2c109610 con 0x7f4f1406e530 2024-09-21T08:09:33.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.860+0000 7f4f13fff640 1 -- 172.21.15.107:0/2280492225 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f4f2c109610 con 0x7f4f1406e530 2024-09-21T08:09:33.862 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:09:33.862 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (6m) 65s ago 14m 26.2M - 0.25.0 c8568f914cd2 2b499aa3b7de 2024-09-21T08:09:33.862 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (2m) 65s ago 14m 6899k - 19.1.1-367-g9e2ac70b cc9251b744a3 69be0e9aa842 2024-09-21T08:09:33.862 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (2m) 1s ago 13m 6891k - 19.1.1-367-g9e2ac70b cc9251b744a3 926ed03c78b9 2024-09-21T08:09:33.862 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (4m) 65s ago 14m 81.2M - 9.4.12 2bacad6d85d8 63177dcfe25c 2024-09-21T08:09:33.862 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (9m) 65s ago 9m 155M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 3bc779f88228 2024-09-21T08:09:33.862 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (9m) 65s ago 9m 14.1M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be ea8f140aade7 2024-09-21T08:09:33.862 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (9m) 1s ago 9m 17.4M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 329346c3afec 2024-09-21T08:09:33.862 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (9m) 1s ago 9m 18.8M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be baf87f32bfbc 2024-09-21T08:09:33.862 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:8443,9283,8765 running (5m) 65s ago 15m 498M - 19.1.1-367-g9e2ac70b cc9251b744a3 49c237734f07 2024-09-21T08:09:33.862 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283,8765 running (5m) 1s ago 13m 441M - 19.1.1-367-g9e2ac70b cc9251b744a3 ed117096bdd8 2024-09-21T08:09:33.862 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (3m) 65s ago 16m 45.9M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 445b3e6a800f 2024-09-21T08:09:33.863 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (3m) 1s ago 13m 38.5M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 12706f823621 2024-09-21T08:09:33.863 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 running (6m) 65s ago 14m 17.1M - 1.5.0 0da6a335fe13 6de7c307ba0f 2024-09-21T08:09:33.863 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (6m) 1s ago 13m 16.7M - 1.5.0 0da6a335fe13 cb6d4577b24c 2024-09-21T08:09:33.863 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (2m) 65s ago 13m 98.8M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 d0a742b31d8a 2024-09-21T08:09:33.863 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (105s) 65s ago 12m 107M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 4bb3f4c8f75a 2024-09-21T08:09:33.863 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (70s) 65s ago 12m 12.1M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 15f45fa18e64 2024-09-21T08:09:33.863 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (36s) 1s ago 11m 110M 2581M 19.1.1-367-g9e2ac70b cc9251b744a3 ee4efea3e442 2024-09-21T08:09:33.863 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (4s) 1s ago 11m 12.1M 2581M 19.1.1-367-g9e2ac70b cc9251b744a3 0d09ba7072ba 2024-09-21T08:09:33.863 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (10m) 1s ago 10m 234M 2581M 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 0f25d9454304 2024-09-21T08:09:33.863 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (5m) 65s ago 14m 61.0M - 2.43.0 a07b618ecd1d 9ed2abf5e8d8 2024-09-21T08:09:33.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.862+0000 7f4f31b45640 1 -- 172.21.15.107:0/2280492225 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4f1406e530 msgr2=0x7f4f140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:33.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.862+0000 7f4f31b45640 1 --2- 172.21.15.107:0/2280492225 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4f1406e530 0x7f4f140709e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c004540 tx=0x7f4f1c035040 comp rx=0 tx=0).stop 2024-09-21T08:09:33.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.862+0000 7f4f31b45640 1 -- 172.21.15.107:0/2280492225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f2c0fdf20 msgr2=0x7f4f2c0fb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:33.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.862+0000 7f4f31b45640 1 --2- 172.21.15.107:0/2280492225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f2c0fdf20 0x7f4f2c0fb980 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4f20002a50 tx=0x7f4f20004600 comp rx=0 tx=0).stop 2024-09-21T08:09:33.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.862+0000 7f4f31b45640 1 -- 172.21.15.107:0/2280492225 shutdown_connections 2024-09-21T08:09:33.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.862+0000 7f4f31b45640 1 --2- 172.21.15.107:0/2280492225 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4f1406e530 0x7f4f140709e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.862+0000 7f4f31b45640 1 --2- 172.21.15.107:0/2280492225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f2c0fdf20 0x7f4f2c0fb980 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.862+0000 7f4f31b45640 1 --2- 172.21.15.107:0/2280492225 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f2c0fd580 0x7f4f2c0fb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.862+0000 7f4f31b45640 1 -- 172.21.15.107:0/2280492225 >> 172.21.15.107:0/2280492225 conn(0x7f4f2c0f7060 msgr2=0x7f4f2c0f85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:33.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.862+0000 7f4f31b45640 1 -- 172.21.15.107:0/2280492225 shutdown_connections 2024-09-21T08:09:33.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.862+0000 7f4f31b45640 1 -- 172.21.15.107:0/2280492225 wait complete. 2024-09-21T08:09:33.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.939+0000 7f6619306640 1 -- 172.21.15.107:0/183116529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66140fb470 msgr2=0x7f66140fb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:33.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.939+0000 7f6619306640 1 --2- 172.21.15.107:0/183116529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66140fb470 0x7f66140fb8e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0048d0 tx=0x7f65fc009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.939+0000 7f6619306640 1 -- 172.21.15.107:0/183116529 shutdown_connections 2024-09-21T08:09:33.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.939+0000 7f6619306640 1 --2- 172.21.15.107:0/183116529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66140fb470 0x7f66140fb8e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.939+0000 7f6619306640 1 --2- 172.21.15.107:0/183116529 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f66141014b0 0x7f6614101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.939+0000 7f6619306640 1 -- 172.21.15.107:0/183116529 >> 172.21.15.107:0/183116529 conn(0x7f66140f7030 msgr2=0x7f66140f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:33.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.939+0000 7f6619306640 1 -- 172.21.15.107:0/183116529 shutdown_connections 2024-09-21T08:09:33.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.939+0000 7f6619306640 1 -- 172.21.15.107:0/183116529 wait complete. 2024-09-21T08:09:33.942 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:33 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:33.942 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:33 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:33.942 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:33 smithi107 ceph-mon[97757]: Health check update: Degraded data redundancy: 37/219 objects degraded (16.895%), 14 pgs degraded (PG_DEGRADED) 2024-09-21T08:09:33.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.940+0000 7f6619306640 1 Processor -- start 2024-09-21T08:09:33.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.940+0000 7f6619306640 1 -- start start 2024-09-21T08:09:33.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.940+0000 7f6619306640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f66140fb470 0x7f661410e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:33.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.940+0000 7f6619306640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66141014b0 0x7f661410e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:33.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.941+0000 7f6619306640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661410edd0 con 0x7f66141014b0 2024-09-21T08:09:33.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.941+0000 7f6619306640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661410ef40 con 0x7f66140fb470 2024-09-21T08:09:33.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.941+0000 7f660a7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66141014b0 0x7f661410e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:33.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.941+0000 7f660a7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66141014b0 0x7f661410e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57462/0 (socket says 172.21.15.107:57462) 2024-09-21T08:09:33.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.941+0000 7f660a7fc640 1 -- 172.21.15.107:0/201505370 learned_addr learned my addr 172.21.15.107:0/201505370 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:09:33.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.941+0000 7f6612ffd640 1 --2- 172.21.15.107:0/201505370 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f66140fb470 0x7f661410e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:33.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.941+0000 7f660a7fc640 1 -- 172.21.15.107:0/201505370 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f66140fb470 msgr2=0x7f661410e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:33.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.941+0000 7f660a7fc640 1 --2- 172.21.15.107:0/201505370 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f66140fb470 0x7f661410e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:33.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.941+0000 7f660a7fc640 1 -- 172.21.15.107:0/201505370 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65fc005040 con 0x7f66141014b0 2024-09-21T08:09:33.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.941+0000 7f660a7fc640 1 --2- 172.21.15.107:0/201505370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66141014b0 0x7f661410e6f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f65fc003080 tx=0x7f65fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:33.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.941+0000 7f660bfff640 1 -- 172.21.15.107:0/201505370 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65fc038070 con 0x7f66141014b0 2024-09-21T08:09:33.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.941+0000 7f660bfff640 1 -- 172.21.15.107:0/201505370 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f65fc0097e0 con 0x7f66141014b0 2024-09-21T08:09:33.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.941+0000 7f6619306640 1 -- 172.21.15.107:0/201505370 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6614117220 con 0x7f66141014b0 2024-09-21T08:09:33.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.941+0000 7f6619306640 1 -- 172.21.15.107:0/201505370 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6614117690 con 0x7f66141014b0 2024-09-21T08:09:33.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.941+0000 7f660bfff640 1 -- 172.21.15.107:0/201505370 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65fc03d420 con 0x7f66141014b0 2024-09-21T08:09:33.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.942+0000 7f6619306640 1 -- 172.21.15.107:0/201505370 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66140fcbb0 con 0x7f66141014b0 2024-09-21T08:09:33.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.943+0000 7f660bfff640 1 -- 172.21.15.107:0/201505370 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f65fc030020 con 0x7f66141014b0 2024-09-21T08:09:33.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.944+0000 7f660bfff640 1 --2- 172.21.15.107:0/201505370 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f660006e530 0x7f66000709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:33.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.944+0000 7f660bfff640 1 -- 172.21.15.107:0/201505370 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f65fc0ae5d0 con 0x7f66141014b0 2024-09-21T08:09:33.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.944+0000 7f6612ffd640 1 --2- 172.21.15.107:0/201505370 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f660006e530 0x7f66000709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:33.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.944+0000 7f6612ffd640 1 --2- 172.21.15.107:0/201505370 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f660006e530 0x7f66000709e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6604009b50 tx=0x7f6604009120 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:33.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:33.948+0000 7f660bfff640 1 -- 172.21.15.107:0/201505370 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f65fc077760 con 0x7f66141014b0 2024-09-21T08:09:34.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:33 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:34.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:33 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:34.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:33 smithi129 ceph-mon[76722]: Health check update: Degraded data redundancy: 37/219 objects degraded (16.895%), 14 pgs degraded (PG_DEGRADED) 2024-09-21T08:09:34.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.177+0000 7f6619306640 1 -- 172.21.15.107:0/201505370 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f661404b720 con 0x7f66141014b0 2024-09-21T08:09:34.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.178+0000 7f660bfff640 1 -- 172.21.15.107:0/201505370 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f65fc07ae20 con 0x7f66141014b0 2024-09-21T08:09:34.179 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:09:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": { 2024-09-21T08:09:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:09:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:09:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": { 2024-09-21T08:09:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:09:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:09:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": { 2024-09-21T08:09:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 1, 2024-09-21T08:09:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 4 2024-09-21T08:09:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:09:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-21T08:09:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 4 2024-09-21T08:09:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:09:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: "overall": { 2024-09-21T08:09:34.181 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 5, 2024-09-21T08:09:34.181 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 8 2024-09-21T08:09:34.181 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-21T08:09:34.181 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:09:34.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.180+0000 7f6619306640 1 -- 172.21.15.107:0/201505370 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f660006e530 msgr2=0x7f66000709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:34.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.180+0000 7f6619306640 1 --2- 172.21.15.107:0/201505370 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f660006e530 0x7f66000709e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6604009b50 tx=0x7f6604009120 comp rx=0 tx=0).stop 2024-09-21T08:09:34.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.180+0000 7f6619306640 1 -- 172.21.15.107:0/201505370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66141014b0 msgr2=0x7f661410e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:34.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.180+0000 7f6619306640 1 --2- 172.21.15.107:0/201505370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66141014b0 0x7f661410e6f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f65fc003080 tx=0x7f65fc009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.180+0000 7f6619306640 1 -- 172.21.15.107:0/201505370 shutdown_connections 2024-09-21T08:09:34.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.180+0000 7f6619306640 1 --2- 172.21.15.107:0/201505370 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f660006e530 0x7f66000709e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.180+0000 7f6619306640 1 --2- 172.21.15.107:0/201505370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66141014b0 0x7f661410e6f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.180+0000 7f6619306640 1 --2- 172.21.15.107:0/201505370 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f66140fb470 0x7f661410e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.180+0000 7f6619306640 1 -- 172.21.15.107:0/201505370 >> 172.21.15.107:0/201505370 conn(0x7f66140f7030 msgr2=0x7f66140f7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:34.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.180+0000 7f6619306640 1 -- 172.21.15.107:0/201505370 shutdown_connections 2024-09-21T08:09:34.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.180+0000 7f6619306640 1 -- 172.21.15.107:0/201505370 wait complete. 2024-09-21T08:09:34.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.258+0000 7fdf15d27640 1 -- 172.21.15.107:0/2472551274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf100fac80 msgr2=0x7fdf100fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:34.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.258+0000 7fdf15d27640 1 --2- 172.21.15.107:0/2472551274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf100fac80 0x7fdf100fb0b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdf040048d0 tx=0x7fdf04009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.258+0000 7fdf15d27640 1 -- 172.21.15.107:0/2472551274 shutdown_connections 2024-09-21T08:09:34.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.258+0000 7fdf15d27640 1 --2- 172.21.15.107:0/2472551274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf100fac80 0x7fdf100fb0b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.258+0000 7fdf15d27640 1 --2- 172.21.15.107:0/2472551274 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf101025b0 0x7fdf10102980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.258+0000 7fdf15d27640 1 -- 172.21.15.107:0/2472551274 >> 172.21.15.107:0/2472551274 conn(0x7fdf10070ce0 msgr2=0x7fdf100710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:34.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.258+0000 7fdf15d27640 1 -- 172.21.15.107:0/2472551274 shutdown_connections 2024-09-21T08:09:34.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.258+0000 7fdf15d27640 1 -- 172.21.15.107:0/2472551274 wait complete. 2024-09-21T08:09:34.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.259+0000 7fdf15d27640 1 Processor -- start 2024-09-21T08:09:34.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.259+0000 7fdf15d27640 1 -- start start 2024-09-21T08:09:34.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.259+0000 7fdf15d27640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf100fac80 0x7fdf101131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:34.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.259+0000 7fdf15d27640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf101025b0 0x7fdf10113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:34.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.259+0000 7fdf15d27640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf10113d30 con 0x7fdf101025b0 2024-09-21T08:09:34.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.259+0000 7fdf15d27640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1010d170 con 0x7fdf100fac80 2024-09-21T08:09:34.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.259+0000 7fdf0effd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf101025b0 0x7fdf10113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:34.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.259+0000 7fdf0effd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf101025b0 0x7fdf10113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57488/0 (socket says 172.21.15.107:57488) 2024-09-21T08:09:34.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.259+0000 7fdf0effd640 1 -- 172.21.15.107:0/3651645735 learned_addr learned my addr 172.21.15.107:0/3651645735 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:09:34.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.260+0000 7fdf0f7fe640 1 --2- 172.21.15.107:0/3651645735 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf100fac80 0x7fdf101131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:34.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.260+0000 7fdf0effd640 1 -- 172.21.15.107:0/3651645735 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf100fac80 msgr2=0x7fdf101131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:34.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.260+0000 7fdf0effd640 1 --2- 172.21.15.107:0/3651645735 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf100fac80 0x7fdf101131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.260+0000 7fdf0effd640 1 -- 172.21.15.107:0/3651645735 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf04005040 con 0x7fdf101025b0 2024-09-21T08:09:34.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.260+0000 7fdf0f7fe640 1 --2- 172.21.15.107:0/3651645735 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf100fac80 0x7fdf101131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:09:34.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.260+0000 7fdf0effd640 1 --2- 172.21.15.107:0/3651645735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf101025b0 0x7fdf10113730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdf04000c00 tx=0x7fdf04009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:34.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.260+0000 7fdef7fff640 1 -- 172.21.15.107:0/3651645735 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf04038070 con 0x7fdf101025b0 2024-09-21T08:09:34.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.260+0000 7fdef7fff640 1 -- 172.21.15.107:0/3651645735 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdf0402ade0 con 0x7fdf101025b0 2024-09-21T08:09:34.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.260+0000 7fdf15d27640 1 -- 172.21.15.107:0/3651645735 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1010d3f0 con 0x7fdf101025b0 2024-09-21T08:09:34.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.260+0000 7fdef7fff640 1 -- 172.21.15.107:0/3651645735 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf0402c7e0 con 0x7fdf101025b0 2024-09-21T08:09:34.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.260+0000 7fdf15d27640 1 -- 172.21.15.107:0/3651645735 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1010d8b0 con 0x7fdf101025b0 2024-09-21T08:09:34.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.261+0000 7fdf15d27640 1 -- 172.21.15.107:0/3651645735 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf100657d0 con 0x7fdf101025b0 2024-09-21T08:09:34.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.262+0000 7fdef7fff640 1 -- 172.21.15.107:0/3651645735 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fdf04030020 con 0x7fdf101025b0 2024-09-21T08:09:34.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.262+0000 7fdef7fff640 1 --2- 172.21.15.107:0/3651645735 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fdef806e530 0x7fdef80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:34.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.262+0000 7fdef7fff640 1 -- 172.21.15.107:0/3651645735 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fdf040adcc0 con 0x7fdf101025b0 2024-09-21T08:09:34.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.262+0000 7fdf0f7fe640 1 --2- 172.21.15.107:0/3651645735 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fdef806e530 0x7fdef80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:34.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.263+0000 7fdf0f7fe640 1 --2- 172.21.15.107:0/3651645735 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fdef806e530 0x7fdef80709e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdf00009af0 tx=0x7fdf0000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:34.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.267+0000 7fdef7fff640 1 -- 172.21.15.107:0/3651645735 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fdf04076f00 con 0x7fdf101025b0 2024-09-21T08:09:34.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.470+0000 7fdf15d27640 1 -- 172.21.15.107:0/3651645735 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdf10109590 con 0x7fdf101025b0 2024-09-21T08:09:34.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.471+0000 7fdef7fff640 1 -- 172.21.15.107:0/3651645735 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1922 (secure 0 0 0) 0x7fdf0407a5c0 con 0x7fdf101025b0 2024-09-21T08:09:34.473 INFO:teuthology.orchestra.run.smithi107.stdout:e15 2024-09-21T08:09:34.473 INFO:teuthology.orchestra.run.smithi107.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-21T08:09:34.473 INFO:teuthology.orchestra.run.smithi107.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T08:09:34.473 INFO:teuthology.orchestra.run.smithi107.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:09:34.473 INFO:teuthology.orchestra.run.smithi107.stdout:legacy client fscid: 1 2024-09-21T08:09:34.473 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:09:34.473 INFO:teuthology.orchestra.run.smithi107.stdout:Filesystem 'cephfs' (1) 2024-09-21T08:09:34.473 INFO:teuthology.orchestra.run.smithi107.stdout:fs_name cephfs 2024-09-21T08:09:34.473 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 15 2024-09-21T08:09:34.473 INFO:teuthology.orchestra.run.smithi107.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T08:09:34.473 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-09-21T08:00:03.244314+0000 2024-09-21T08:09:34.473 INFO:teuthology.orchestra.run.smithi107.stdout:modified 2024-09-21T08:00:21.458971+0000 2024-09-21T08:09:34.473 INFO:teuthology.orchestra.run.smithi107.stdout:tableserver 0 2024-09-21T08:09:34.474 INFO:teuthology.orchestra.run.smithi107.stdout:root 0 2024-09-21T08:09:34.474 INFO:teuthology.orchestra.run.smithi107.stdout:session_timeout 60 2024-09-21T08:09:34.474 INFO:teuthology.orchestra.run.smithi107.stdout:session_autoclose 300 2024-09-21T08:09:34.474 INFO:teuthology.orchestra.run.smithi107.stdout:max_file_size 1099511627776 2024-09-21T08:09:34.474 INFO:teuthology.orchestra.run.smithi107.stdout:max_xattr_size 65536 2024-09-21T08:09:34.474 INFO:teuthology.orchestra.run.smithi107.stdout:required_client_features {} 2024-09-21T08:09:34.474 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure 0 2024-09-21T08:09:34.474 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure_osd_epoch 44 2024-09-21T08:09:34.474 INFO:teuthology.orchestra.run.smithi107.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:09:34.474 INFO:teuthology.orchestra.run.smithi107.stdout:max_mds 1 2024-09-21T08:09:34.474 INFO:teuthology.orchestra.run.smithi107.stdout:in 0 2024-09-21T08:09:34.474 INFO:teuthology.orchestra.run.smithi107.stdout:up {0=14458} 2024-09-21T08:09:34.474 INFO:teuthology.orchestra.run.smithi107.stdout:failed 2024-09-21T08:09:34.474 INFO:teuthology.orchestra.run.smithi107.stdout:damaged 2024-09-21T08:09:34.474 INFO:teuthology.orchestra.run.smithi107.stdout:stopped 2024-09-21T08:09:34.475 INFO:teuthology.orchestra.run.smithi107.stdout:data_pools [3] 2024-09-21T08:09:34.475 INFO:teuthology.orchestra.run.smithi107.stdout:metadata_pool 2 2024-09-21T08:09:34.475 INFO:teuthology.orchestra.run.smithi107.stdout:inline_data disabled 2024-09-21T08:09:34.475 INFO:teuthology.orchestra.run.smithi107.stdout:balancer 2024-09-21T08:09:34.475 INFO:teuthology.orchestra.run.smithi107.stdout:bal_rank_mask -1 2024-09-21T08:09:34.475 INFO:teuthology.orchestra.run.smithi107.stdout:standby_count_wanted 1 2024-09-21T08:09:34.475 INFO:teuthology.orchestra.run.smithi107.stdout:qdb_cluster leader: 0 members: 2024-09-21T08:09:34.475 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.grqzkt{0:14458} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:09:34.475 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:09:34.475 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:09:34.475 INFO:teuthology.orchestra.run.smithi107.stdout:Standby daemons: 2024-09-21T08:09:34.475 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:09:34.475 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.qusoyf{-1:14468} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6826/2352538667,v1:172.21.15.107:6827/2352538667] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:09:34.475 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.fwmfcy{-1:24239} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:09:34.476 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.belyba{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:09:34.476 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 15 2024-09-21T08:09:34.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.473+0000 7fdf15d27640 1 -- 172.21.15.107:0/3651645735 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fdef806e530 msgr2=0x7fdef80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:34.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.473+0000 7fdf15d27640 1 --2- 172.21.15.107:0/3651645735 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fdef806e530 0x7fdef80709e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdf00009af0 tx=0x7fdf0000b040 comp rx=0 tx=0).stop 2024-09-21T08:09:34.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.473+0000 7fdf15d27640 1 -- 172.21.15.107:0/3651645735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf101025b0 msgr2=0x7fdf10113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:34.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.473+0000 7fdf15d27640 1 --2- 172.21.15.107:0/3651645735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf101025b0 0x7fdf10113730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdf04000c00 tx=0x7fdf04009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.473+0000 7fdf15d27640 1 -- 172.21.15.107:0/3651645735 shutdown_connections 2024-09-21T08:09:34.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.473+0000 7fdf15d27640 1 --2- 172.21.15.107:0/3651645735 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fdef806e530 0x7fdef80709e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.473+0000 7fdf15d27640 1 --2- 172.21.15.107:0/3651645735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf101025b0 0x7fdf10113730 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.473+0000 7fdf15d27640 1 --2- 172.21.15.107:0/3651645735 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf100fac80 0x7fdf101131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.473+0000 7fdf15d27640 1 -- 172.21.15.107:0/3651645735 >> 172.21.15.107:0/3651645735 conn(0x7fdf10070ce0 msgr2=0x7fdf101052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:34.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.474+0000 7fdf15d27640 1 -- 172.21.15.107:0/3651645735 shutdown_connections 2024-09-21T08:09:34.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.474+0000 7fdf15d27640 1 -- 172.21.15.107:0/3651645735 wait complete. 2024-09-21T08:09:34.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.553+0000 7fded3b68640 1 -- 172.21.15.107:0/2029312591 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdecc0fac80 msgr2=0x7fdecc0fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:34.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.553+0000 7fded3b68640 1 --2- 172.21.15.107:0/2029312591 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdecc0fac80 0x7fdecc0fb0f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0048d0 tx=0x7fdebc009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.553+0000 7fded3b68640 1 -- 172.21.15.107:0/2029312591 shutdown_connections 2024-09-21T08:09:34.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.553+0000 7fded3b68640 1 --2- 172.21.15.107:0/2029312591 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdecc0fac80 0x7fdecc0fb0f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.553+0000 7fded3b68640 1 --2- 172.21.15.107:0/2029312591 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdecc102620 0x7fdecc1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.553+0000 7fded3b68640 1 -- 172.21.15.107:0/2029312591 >> 172.21.15.107:0/2029312591 conn(0x7fdecc070ce0 msgr2=0x7fdecc0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:34.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.554+0000 7fded3b68640 1 -- 172.21.15.107:0/2029312591 shutdown_connections 2024-09-21T08:09:34.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.554+0000 7fded3b68640 1 -- 172.21.15.107:0/2029312591 wait complete. 2024-09-21T08:09:34.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.554+0000 7fded3b68640 1 Processor -- start 2024-09-21T08:09:34.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.554+0000 7fded3b68640 1 -- start start 2024-09-21T08:09:34.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.554+0000 7fded3b68640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdecc0fac80 0x7fdecc0fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:34.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.554+0000 7fded3b68640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdecc102620 0x7fdecc0fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:34.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.554+0000 7fded3b68640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc0fc8e0 con 0x7fdecc0fac80 2024-09-21T08:09:34.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.554+0000 7fded3b68640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc0fca50 con 0x7fdecc102620 2024-09-21T08:09:34.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.554+0000 7fded1904640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdecc0fac80 0x7fdecc0fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:34.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.554+0000 7fded1904640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdecc0fac80 0x7fdecc0fbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57506/0 (socket says 172.21.15.107:57506) 2024-09-21T08:09:34.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.555+0000 7fded1904640 1 -- 172.21.15.107:0/3437991321 learned_addr learned my addr 172.21.15.107:0/3437991321 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:09:34.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.555+0000 7fded1103640 1 --2- 172.21.15.107:0/3437991321 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdecc102620 0x7fdecc0fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:34.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.555+0000 7fded1904640 1 -- 172.21.15.107:0/3437991321 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdecc102620 msgr2=0x7fdecc0fc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:34.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.555+0000 7fded1904640 1 --2- 172.21.15.107:0/3437991321 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdecc102620 0x7fdecc0fc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.555+0000 7fded1904640 1 -- 172.21.15.107:0/3437991321 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdebc005040 con 0x7fdecc0fac80 2024-09-21T08:09:34.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.555+0000 7fded1904640 1 --2- 172.21.15.107:0/3437991321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdecc0fac80 0x7fdecc0fbe60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdec800eb70 tx=0x7fdec800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:34.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.555+0000 7fdec27fc640 1 -- 172.21.15.107:0/3437991321 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdec8007c30 con 0x7fdecc0fac80 2024-09-21T08:09:34.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.555+0000 7fdec27fc640 1 -- 172.21.15.107:0/3437991321 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdec800f040 con 0x7fdecc0fac80 2024-09-21T08:09:34.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.555+0000 7fdec27fc640 1 -- 172.21.15.107:0/3437991321 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdec800ca60 con 0x7fdecc0fac80 2024-09-21T08:09:34.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.555+0000 7fded3b68640 1 -- 172.21.15.107:0/3437991321 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdecc0fcc80 con 0x7fdecc0fac80 2024-09-21T08:09:34.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.555+0000 7fded3b68640 1 -- 172.21.15.107:0/3437991321 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdecc1198b0 con 0x7fdecc0fac80 2024-09-21T08:09:34.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.556+0000 7fded3b68640 1 -- 172.21.15.107:0/3437991321 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdecc0657b0 con 0x7fdecc0fac80 2024-09-21T08:09:34.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.557+0000 7fdec27fc640 1 -- 172.21.15.107:0/3437991321 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fdec800cbc0 con 0x7fdecc0fac80 2024-09-21T08:09:34.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.557+0000 7fdec27fc640 1 --2- 172.21.15.107:0/3437991321 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fdeb806e530 0x7fdeb80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:34.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.558+0000 7fdec27fc640 1 -- 172.21.15.107:0/3437991321 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fdec808dce0 con 0x7fdecc0fac80 2024-09-21T08:09:34.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.558+0000 7fded1103640 1 --2- 172.21.15.107:0/3437991321 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fdeb806e530 0x7fdeb80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:34.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.558+0000 7fded1103640 1 --2- 172.21.15.107:0/3437991321 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fdeb806e530 0x7fdeb80709e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdecc0fd7a0 tx=0x7fdebc035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:34.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.562+0000 7fdec27fc640 1 -- 172.21.15.107:0/3437991321 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fdec8056f20 con 0x7fdecc0fac80 2024-09-21T08:09:34.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.746+0000 7fded3b68640 1 -- 172.21.15.107:0/3437991321 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdecc0fd550 con 0x7fdeb806e530 2024-09-21T08:09:34.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.747+0000 7fdec27fc640 1 -- 172.21.15.107:0/3437991321 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fdecc0fd550 con 0x7fdeb806e530 2024-09-21T08:09:34.748 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:09:34.748 INFO:teuthology.orchestra.run.smithi107.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5", 2024-09-21T08:09:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: "in_progress": true, 2024-09-21T08:09:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T08:09:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: "services_complete": [ 2024-09-21T08:09:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr", 2024-09-21T08:09:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: "mon", 2024-09-21T08:09:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: "crash" 2024-09-21T08:09:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-21T08:09:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: "progress": "11/21 daemons upgraded", 2024-09-21T08:09:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T08:09:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: "is_paused": false 2024-09-21T08:09:34.749 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:09:34.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.749+0000 7fded3b68640 1 -- 172.21.15.107:0/3437991321 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fdeb806e530 msgr2=0x7fdeb80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:34.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.749+0000 7fded3b68640 1 --2- 172.21.15.107:0/3437991321 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fdeb806e530 0x7fdeb80709e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdecc0fd7a0 tx=0x7fdebc035040 comp rx=0 tx=0).stop 2024-09-21T08:09:34.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.749+0000 7fded3b68640 1 -- 172.21.15.107:0/3437991321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdecc0fac80 msgr2=0x7fdecc0fbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:34.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.749+0000 7fded3b68640 1 --2- 172.21.15.107:0/3437991321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdecc0fac80 0x7fdecc0fbe60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdec800eb70 tx=0x7fdec800b040 comp rx=0 tx=0).stop 2024-09-21T08:09:34.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.749+0000 7fded3b68640 1 -- 172.21.15.107:0/3437991321 shutdown_connections 2024-09-21T08:09:34.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.749+0000 7fded3b68640 1 --2- 172.21.15.107:0/3437991321 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fdeb806e530 0x7fdeb80709e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.749+0000 7fded3b68640 1 --2- 172.21.15.107:0/3437991321 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdecc102620 0x7fdecc0fc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.749+0000 7fded3b68640 1 --2- 172.21.15.107:0/3437991321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdecc0fac80 0x7fdecc0fbe60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.749+0000 7fded3b68640 1 -- 172.21.15.107:0/3437991321 >> 172.21.15.107:0/3437991321 conn(0x7fdecc070ce0 msgr2=0x7fdecc105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:34.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.750+0000 7fded3b68640 1 -- 172.21.15.107:0/3437991321 shutdown_connections 2024-09-21T08:09:34.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.750+0000 7fded3b68640 1 -- 172.21.15.107:0/3437991321 wait complete. 2024-09-21T08:09:34.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.827+0000 7f5a4d9ca640 1 -- 172.21.15.107:0/1775705433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a480fcf80 msgr2=0x7f5a480fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:34.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.827+0000 7f5a4d9ca640 1 --2- 172.21.15.107:0/1775705433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a480fcf80 0x7f5a480fd3d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0048d0 tx=0x7f5a3c009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.827+0000 7f5a4d9ca640 1 -- 172.21.15.107:0/1775705433 shutdown_connections 2024-09-21T08:09:34.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.827+0000 7f5a4d9ca640 1 --2- 172.21.15.107:0/1775705433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a480fcf80 0x7f5a480fd3d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.827+0000 7f5a4d9ca640 1 --2- 172.21.15.107:0/1775705433 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5a480fb810 0x7f5a480fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.827+0000 7f5a4d9ca640 1 -- 172.21.15.107:0/1775705433 >> 172.21.15.107:0/1775705433 conn(0x7f5a480723b0 msgr2=0x7f5a480727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:34.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.827+0000 7f5a4d9ca640 1 -- 172.21.15.107:0/1775705433 shutdown_connections 2024-09-21T08:09:34.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.828+0000 7f5a4d9ca640 1 -- 172.21.15.107:0/1775705433 wait complete. 2024-09-21T08:09:34.830 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:34 smithi107 ceph-mon[97757]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:09:34.830 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:34 smithi107 ceph-mon[97757]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:09:34.830 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:34 smithi107 ceph-mon[97757]: pgmap v132: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-21T08:09:34.830 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:34 smithi107 ceph-mon[97757]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:09:34.830 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:34 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/201505370' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:09:34.830 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:34 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/3651645735' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:09:34.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.828+0000 7f5a4d9ca640 1 Processor -- start 2024-09-21T08:09:34.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.828+0000 7f5a4d9ca640 1 -- start start 2024-09-21T08:09:34.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.828+0000 7f5a4d9ca640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5a480fb810 0x7f5a4810e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:34.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.828+0000 7f5a4d9ca640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a480fcf80 0x7f5a4810e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:34.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.828+0000 7f5a4d9ca640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4810ed50 con 0x7f5a480fcf80 2024-09-21T08:09:34.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.828+0000 7f5a4d9ca640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4810eec0 con 0x7f5a480fb810 2024-09-21T08:09:34.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.829+0000 7f5a467fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a480fcf80 0x7f5a4810e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:34.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.829+0000 7f5a467fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a480fcf80 0x7f5a4810e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57536/0 (socket says 172.21.15.107:57536) 2024-09-21T08:09:34.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.829+0000 7f5a467fc640 1 -- 172.21.15.107:0/12200259 learned_addr learned my addr 172.21.15.107:0/12200259 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:09:34.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.829+0000 7f5a46ffd640 1 --2- 172.21.15.107:0/12200259 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5a480fb810 0x7f5a4810e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:34.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.829+0000 7f5a467fc640 1 -- 172.21.15.107:0/12200259 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5a480fb810 msgr2=0x7f5a4810e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:34.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.829+0000 7f5a467fc640 1 --2- 172.21.15.107:0/12200259 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5a480fb810 0x7f5a4810e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:34.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.829+0000 7f5a467fc640 1 -- 172.21.15.107:0/12200259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c005040 con 0x7f5a480fcf80 2024-09-21T08:09:34.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.829+0000 7f5a467fc640 1 --2- 172.21.15.107:0/12200259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a480fcf80 0x7f5a4810e810 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c000c00 tx=0x7f5a3c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:34.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.829+0000 7f5a2f7fe640 1 -- 172.21.15.107:0/12200259 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a3c038070 con 0x7f5a480fcf80 2024-09-21T08:09:34.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.829+0000 7f5a2f7fe640 1 -- 172.21.15.107:0/12200259 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5a3c02ade0 con 0x7f5a480fcf80 2024-09-21T08:09:34.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.829+0000 7f5a4d9ca640 1 -- 172.21.15.107:0/12200259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a481171a0 con 0x7f5a480fcf80 2024-09-21T08:09:34.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.829+0000 7f5a2f7fe640 1 -- 172.21.15.107:0/12200259 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a3c02c7b0 con 0x7f5a480fcf80 2024-09-21T08:09:34.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.829+0000 7f5a4d9ca640 1 -- 172.21.15.107:0/12200259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a48117660 con 0x7f5a480fcf80 2024-09-21T08:09:34.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.830+0000 7f5a4d9ca640 1 -- 172.21.15.107:0/12200259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a480fcbc0 con 0x7f5a480fcf80 2024-09-21T08:09:34.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.831+0000 7f5a2f7fe640 1 -- 172.21.15.107:0/12200259 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5a3c030020 con 0x7f5a480fcf80 2024-09-21T08:09:34.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.831+0000 7f5a2f7fe640 1 --2- 172.21.15.107:0/12200259 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f5a3006e530 0x7f5a300709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:34.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.832+0000 7f5a2f7fe640 1 -- 172.21.15.107:0/12200259 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f5a3c0ae5e0 con 0x7f5a480fcf80 2024-09-21T08:09:34.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.832+0000 7f5a46ffd640 1 --2- 172.21.15.107:0/12200259 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f5a3006e530 0x7f5a300709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:34.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.832+0000 7f5a46ffd640 1 --2- 172.21.15.107:0/12200259 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f5a3006e530 0x7f5a300709e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5a38004fd0 tx=0x7f5a3800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:34.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:34.836+0000 7f5a2f7fe640 1 -- 172.21.15.107:0/12200259 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5a3c077770 con 0x7f5a480fcf80 2024-09-21T08:09:35.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:34 smithi129 ceph-mon[76722]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:09:35.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:34 smithi129 ceph-mon[76722]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:09:35.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:34 smithi129 ceph-mon[76722]: pgmap v132: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-21T08:09:35.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:34 smithi129 ceph-mon[76722]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:09:35.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:34 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/201505370' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:09:35.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:34 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/3651645735' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:09:35.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:35.067+0000 7f5a4d9ca640 1 -- 172.21.15.107:0/12200259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5a480657c0 con 0x7f5a480fcf80 2024-09-21T08:09:35.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:35.067+0000 7f5a2f7fe640 1 -- 172.21.15.107:0/12200259 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1050 (secure 0 0 0) 0x7f5a3c07ae30 con 0x7f5a480fcf80 2024-09-21T08:09:35.069 INFO:teuthology.orchestra.run.smithi107.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 37/219 objects degraded (16.895%), 14 pgs degraded 2024-09-21T08:09:35.069 INFO:teuthology.orchestra.run.smithi107.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T08:09:35.069 INFO:teuthology.orchestra.run.smithi107.stdout: osd.4 (root=default,host=smithi129) is down 2024-09-21T08:09:35.069 INFO:teuthology.orchestra.run.smithi107.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 37/219 objects degraded (16.895%), 14 pgs degraded 2024-09-21T08:09:35.069 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-09-21T08:09:35.069 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-21T08:09:35.069 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-09-21T08:09:35.069 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-21T08:09:35.069 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-09-21T08:09:35.069 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-09-21T08:09:35.069 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-21T08:09:35.070 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-09-21T08:09:35.070 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-09-21T08:09:35.070 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-21T08:09:35.070 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-21T08:09:35.070 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-21T08:09:35.070 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-21T08:09:35.070 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-09-21T08:09:35.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:35.069+0000 7f5a4d9ca640 1 -- 172.21.15.107:0/12200259 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f5a3006e530 msgr2=0x7f5a300709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:35.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:35.069+0000 7f5a4d9ca640 1 --2- 172.21.15.107:0/12200259 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f5a3006e530 0x7f5a300709e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5a38004fd0 tx=0x7f5a3800b040 comp rx=0 tx=0).stop 2024-09-21T08:09:35.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:35.069+0000 7f5a4d9ca640 1 -- 172.21.15.107:0/12200259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a480fcf80 msgr2=0x7f5a4810e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:35.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:35.069+0000 7f5a4d9ca640 1 --2- 172.21.15.107:0/12200259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a480fcf80 0x7f5a4810e810 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c000c00 tx=0x7f5a3c009da0 comp rx=0 tx=0).stop 2024-09-21T08:09:35.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:35.069+0000 7f5a4d9ca640 1 -- 172.21.15.107:0/12200259 shutdown_connections 2024-09-21T08:09:35.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:35.069+0000 7f5a4d9ca640 1 --2- 172.21.15.107:0/12200259 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f5a3006e530 0x7f5a300709e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:35.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:35.069+0000 7f5a4d9ca640 1 --2- 172.21.15.107:0/12200259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a480fcf80 0x7f5a4810e810 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:35.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:35.069+0000 7f5a4d9ca640 1 --2- 172.21.15.107:0/12200259 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5a480fb810 0x7f5a4810e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:35.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:35.069+0000 7f5a4d9ca640 1 -- 172.21.15.107:0/12200259 >> 172.21.15.107:0/12200259 conn(0x7f5a480723b0 msgr2=0x7f5a480fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:35.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:35.069+0000 7f5a4d9ca640 1 -- 172.21.15.107:0/12200259 shutdown_connections 2024-09-21T08:09:35.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:09:35.069+0000 7f5a4d9ca640 1 -- 172.21.15.107:0/12200259 wait complete. 2024-09-21T08:09:35.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:35 smithi129 ceph-mon[76722]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:09:35.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:35 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/12200259' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:09:36.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:35 smithi107 ceph-mon[97757]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:09:36.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:35 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/12200259' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:09:37.168 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:36 smithi129 ceph-mon[76722]: pgmap v133: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-21T08:09:37.168 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:36 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:37.168 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:36 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:37.168 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:36 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:09:37.168 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:36 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:09:37.168 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:36 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:37.168 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:36 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:09:37.168 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:36 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:09:37.169 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:36 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:09:37.169 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:36 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:09:37.169 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:36 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T08:09:37.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:36 smithi107 ceph-mon[97757]: pgmap v133: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-21T08:09:37.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:36 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:37.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:36 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:37.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:36 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:09:37.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:36 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:09:37.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:36 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:37.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:36 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:09:37.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:36 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:09:37.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:36 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:09:37.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:36 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:09:37.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:36 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T08:09:37.516 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:37 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[90415]: 2024-09-21T08:09:37.354+0000 7f1c8e45c640 -1 osd.4 67 log_to_monitors true 2024-09-21T08:09:38.179 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:37 smithi129 ceph-mon[76722]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T08:09:38.179 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:37 smithi129 ceph-mon[76722]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T08:09:38.180 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:37 smithi129 ceph-mon[76722]: from='osd.4 [v2:172.21.15.129:6808/1589107690,v1:172.21.15.129:6809/1589107690]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T08:09:38.180 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:37 smithi129 ceph-mon[76722]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T08:09:38.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:37 smithi107 ceph-mon[97757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T08:09:38.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:37 smithi107 ceph-mon[97757]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T08:09:38.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:37 smithi107 ceph-mon[97757]: from='osd.4 [v2:172.21.15.129:6808/1589107690,v1:172.21.15.129:6809/1589107690]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T08:09:38.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:37 smithi107 ceph-mon[97757]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T08:09:38.766 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:09:38 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[90415]: 2024-09-21T08:09:38.708+0000 7f1c821ee640 -1 osd.4 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T08:09:39.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:38 smithi129 ceph-mon[76722]: pgmap v134: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-21T08:09:39.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:38 smithi129 ceph-mon[76722]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T08:09:39.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:38 smithi129 ceph-mon[76722]: osdmap e70: 6 total, 5 up, 6 in 2024-09-21T08:09:39.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:38 smithi129 ceph-mon[76722]: from='osd.4 [v2:172.21.15.129:6808/1589107690,v1:172.21.15.129:6809/1589107690]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T08:09:39.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:38 smithi129 ceph-mon[76722]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T08:09:39.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:38 smithi129 ceph-mon[76722]: from='osd.4 ' entity='osd.4' 2024-09-21T08:09:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:38 smithi107 ceph-mon[97757]: pgmap v134: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-21T08:09:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:38 smithi107 ceph-mon[97757]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T08:09:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:38 smithi107 ceph-mon[97757]: osdmap e70: 6 total, 5 up, 6 in 2024-09-21T08:09:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:38 smithi107 ceph-mon[97757]: from='osd.4 [v2:172.21.15.129:6808/1589107690,v1:172.21.15.129:6809/1589107690]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T08:09:39.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:38 smithi107 ceph-mon[97757]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T08:09:39.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:38 smithi107 ceph-mon[97757]: from='osd.4 ' entity='osd.4' 2024-09-21T08:09:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:39 smithi129 ceph-mon[76722]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T08:09:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:39 smithi129 ceph-mon[76722]: osd.4 [v2:172.21.15.129:6808/1589107690,v1:172.21.15.129:6809/1589107690] boot 2024-09-21T08:09:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:39 smithi129 ceph-mon[76722]: osdmap e71: 6 total, 6 up, 6 in 2024-09-21T08:09:40.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:39 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T08:09:40.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:39 smithi107 ceph-mon[97757]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T08:09:40.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:39 smithi107 ceph-mon[97757]: osd.4 [v2:172.21.15.129:6808/1589107690,v1:172.21.15.129:6809/1589107690] boot 2024-09-21T08:09:40.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:39 smithi107 ceph-mon[97757]: osdmap e71: 6 total, 6 up, 6 in 2024-09-21T08:09:40.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:39 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T08:09:41.252 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:40 smithi107 ceph-mon[97757]: pgmap v136: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-21T08:09:41.253 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:40 smithi107 ceph-mon[97757]: osdmap e72: 6 total, 6 up, 6 in 2024-09-21T08:09:41.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:40 smithi129 ceph-mon[76722]: pgmap v136: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-21T08:09:41.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:40 smithi129 ceph-mon[76722]: osdmap e72: 6 total, 6 up, 6 in 2024-09-21T08:09:42.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:41 smithi129 ceph-mon[76722]: Health check update: Degraded data redundancy: 9/219 objects degraded (4.110%), 6 pgs degraded (PG_DEGRADED) 2024-09-21T08:09:42.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:41 smithi107 ceph-mon[97757]: Health check update: Degraded data redundancy: 9/219 objects degraded (4.110%), 6 pgs degraded (PG_DEGRADED) 2024-09-21T08:09:43.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:42 smithi129 ceph-mon[76722]: pgmap v139: 65 pgs: 4 peering, 7 active+undersized, 6 active+undersized+degraded, 48 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9/219 objects degraded (4.110%) 2024-09-21T08:09:43.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:42 smithi107 ceph-mon[97757]: pgmap v139: 65 pgs: 4 peering, 7 active+undersized, 6 active+undersized+degraded, 48 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9/219 objects degraded (4.110%) 2024-09-21T08:09:44.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:43 smithi129 ceph-mon[76722]: pgmap v140: 65 pgs: 4 peering, 61 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:44.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:43 smithi129 ceph-mon[76722]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/219 objects degraded (4.110%), 6 pgs degraded) 2024-09-21T08:09:44.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:43 smithi129 ceph-mon[76722]: Cluster is now healthy 2024-09-21T08:09:44.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:43 smithi107 ceph-mon[97757]: pgmap v140: 65 pgs: 4 peering, 61 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:44.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:43 smithi107 ceph-mon[97757]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/219 objects degraded (4.110%), 6 pgs degraded) 2024-09-21T08:09:44.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:43 smithi107 ceph-mon[97757]: Cluster is now healthy 2024-09-21T08:09:46.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:45 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:46.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:45 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:09:46.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:45 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:46.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:45 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:09:47.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:46 smithi129 ceph-mon[76722]: pgmap v141: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:47.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:46 smithi107 ceph-mon[97757]: pgmap v141: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:48.968 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:48 smithi129 ceph-mon[76722]: pgmap v142: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:49.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:48 smithi107 ceph-mon[97757]: pgmap v142: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:51.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:50 smithi129 ceph-mon[76722]: pgmap v143: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:51.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:50 smithi107 ceph-mon[97757]: pgmap v143: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:52.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:51 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T08:09:52.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:51 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T08:09:52.949 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:52 smithi129 ceph-mon[76722]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T08:09:52.949 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:52 smithi129 ceph-mon[76722]: Upgrade: osd.5 is safe to restart 2024-09-21T08:09:52.949 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:52 smithi129 ceph-mon[76722]: pgmap v144: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:52.949 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:52 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:52.949 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:52 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-21T08:09:52.949 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:52 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:09:53.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:52 smithi107 ceph-mon[97757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T08:09:53.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:52 smithi107 ceph-mon[97757]: Upgrade: osd.5 is safe to restart 2024-09-21T08:09:53.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:52 smithi107 ceph-mon[97757]: pgmap v144: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:53.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:52 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:53.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:52 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-21T08:09:53.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:52 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:09:54.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:53 smithi129 ceph-mon[76722]: Upgrade: Updating osd.5 2024-09-21T08:09:54.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:53 smithi129 ceph-mon[76722]: Deploying daemon osd.5 on smithi129 2024-09-21T08:09:54.030 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:53 smithi107 ceph-mon[97757]: Upgrade: Updating osd.5 2024-09-21T08:09:54.031 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:53 smithi107 ceph-mon[97757]: Deploying daemon osd.5 on smithi129 2024-09-21T08:09:54.877 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:54 smithi129 ceph-mon[76722]: pgmap v145: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:55.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:54 smithi107 ceph-mon[97757]: pgmap v145: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:55.741 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:55 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:55.741 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:55 smithi129 systemd[1]: Stopping Ceph osd.5 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:09:56.017 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:55 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[52488]: 2024-09-21T08:09:55.739+0000 7f31fa250640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:09:56.017 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:55 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[52488]: 2024-09-21T08:09:55.739+0000 7f31fa250640 -1 osd.5 72 *** Got signal Terminated *** 2024-09-21T08:09:56.017 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:55 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[52488]: 2024-09-21T08:09:55.739+0000 7f31fa250640 -1 osd.5 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:09:56.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:55 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:57.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:56 smithi129 ceph-mon[76722]: pgmap v146: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:57.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:56 smithi129 ceph-mon[76722]: osd.5 marked itself down and dead 2024-09-21T08:09:57.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:56 smithi107 ceph-mon[97757]: pgmap v146: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:57.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:56 smithi107 ceph-mon[97757]: osd.5 marked itself down and dead 2024-09-21T08:09:57.508 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:57 smithi129 podman[94814]: 2024-09-21 08:09:57.210229902 +0000 UTC m=+1.573592707 container died 0f25d9454304fa1587776820e74d4797b2e848ffe90cd6813f20587296c534f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=quincy-fbd1a6a, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T08:09:57.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:57 smithi129 ceph-mon[76722]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T08:09:57.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:57 smithi129 ceph-mon[76722]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-21T08:09:57.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:57 smithi129 ceph-mon[76722]: osdmap e73: 6 total, 5 up, 6 in 2024-09-21T08:09:57.767 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:57 smithi129 podman[94814]: 2024-09-21 08:09:57.597553648 +0000 UTC m=+1.960916453 container cleanup 0f25d9454304fa1587776820e74d4797b2e848ffe90cd6813f20587296c534f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, RELEASE=quincy-fbd1a6a, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:09:57.767 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:57 smithi129 bash[94814]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5 2024-09-21T08:09:58.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:57 smithi107 ceph-mon[97757]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T08:09:58.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:57 smithi107 ceph-mon[97757]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-21T08:09:58.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:57 smithi107 ceph-mon[97757]: osdmap e73: 6 total, 5 up, 6 in 2024-09-21T08:09:58.215 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:57 smithi129 podman[94830]: 2024-09-21 08:09:57.824113205 +0000 UTC m=+0.615699568 container remove 0f25d9454304fa1587776820e74d4797b2e848ffe90cd6813f20587296c534f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:ee510334bec3e52f2758802688c49d04ace3cbf9008a76cda46905f72653dab2, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=quincy-fbd1a6a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T08:09:58.502 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:58 smithi129 podman[94920]: 2024-09-21 08:09:58.117085976 +0000 UTC m=+0.015945013 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:09:58.503 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:58 smithi129 podman[94920]: 2024-09-21 08:09:58.216408383 +0000 UTC m=+0.115267413 container create 9af9be6c50fc2f4036227f4271df61c2abb8245c3859efa9e2d6cf09052a3c08 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70) 2024-09-21T08:09:58.503 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:58 smithi129 podman[94920]: 2024-09-21 08:09:58.443813449 +0000 UTC m=+0.342672489 container init 9af9be6c50fc2f4036227f4271df61c2abb8245c3859efa9e2d6cf09052a3c08 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-deactivate, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T08:09:58.503 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:58 smithi129 podman[94920]: 2024-09-21 08:09:58.447012463 +0000 UTC m=+0.345871494 container start 9af9be6c50fc2f4036227f4271df61c2abb8245c3859efa9e2d6cf09052a3c08 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-deactivate, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T08:09:58.503 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:58 smithi129 podman[94920]: 2024-09-21 08:09:58.502081457 +0000 UTC m=+0.400940503 container attach 9af9be6c50fc2f4036227f4271df61c2abb8245c3859efa9e2d6cf09052a3c08 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T08:09:58.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:58 smithi129 ceph-mon[76722]: pgmap v148: 65 pgs: 13 stale+active+clean, 52 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:58.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:58 smithi129 ceph-mon[76722]: osdmap e74: 6 total, 5 up, 6 in 2024-09-21T08:09:58.767 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:58 smithi129 podman[94920]: 2024-09-21 08:09:58.638652572 +0000 UTC m=+0.537511602 container died 9af9be6c50fc2f4036227f4271df61c2abb8245c3859efa9e2d6cf09052a3c08 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T08:09:59.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:58 smithi107 ceph-mon[97757]: pgmap v148: 65 pgs: 13 stale+active+clean, 52 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T08:09:59.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:58 smithi107 ceph-mon[97757]: osdmap e74: 6 total, 5 up, 6 in 2024-09-21T08:09:59.517 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:59 smithi129 podman[94944]: 2024-09-21 08:09:59.206467742 +0000 UTC m=+0.557715211 container remove 9af9be6c50fc2f4036227f4271df61c2abb8245c3859efa9e2d6cf09052a3c08 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T08:09:59.517 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:59 smithi129 systemd[1]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.5.service: Deactivated successfully. 2024-09-21T08:09:59.517 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:59 smithi129 systemd[1]: Stopped Ceph osd.5 for 786d4f32-77ee-11ef-baf6-efdc52797490. 2024-09-21T08:09:59.517 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:59 smithi129 systemd[1]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.5.service: Consumed 1min 324ms CPU time. 2024-09-21T08:09:59.517 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:59 smithi129 systemd[1]: Starting Ceph osd.5 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:09:59.927 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:59 smithi129 podman[95044]: 2024-09-21 08:09:59.551688586 +0000 UTC m=+0.015830502 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:09:59.927 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:59 smithi129 podman[95044]: 2024-09-21 08:09:59.682160031 +0000 UTC m=+0.146301934 container create 42698c3f3544fe89ab8c6aa8fbff8aed7bcf8739597c6c5131f6ec05afd3adf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-activate, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T08:09:59.928 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:59 smithi129 podman[95044]: 2024-09-21 08:09:59.927015064 +0000 UTC m=+0.391156979 container init 42698c3f3544fe89ab8c6aa8fbff8aed7bcf8739597c6c5131f6ec05afd3adf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-activate, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:09:59.928 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [3, 5]}]: dispatch 2024-09-21T08:09:59.928 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 5]}]: dispatch 2024-09-21T08:09:59.928 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 5]}]: dispatch 2024-09-21T08:09:59.928 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [0, 5]}]: dispatch 2024-09-21T08:09:59.929 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [1, 5]}]: dispatch 2024-09-21T08:09:59.929 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 0]}]: dispatch 2024-09-21T08:09:59.929 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [1, 5]}]: dispatch 2024-09-21T08:09:59.929 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [4, 0]}]: dispatch 2024-09-21T08:09:59.929 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [3, 5]}]: dispatch 2024-09-21T08:09:59.929 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [4, 5]}]: dispatch 2024-09-21T08:09:59.929 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:09:59.929 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:09:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:10:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [3, 5]}]: dispatch 2024-09-21T08:10:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 5]}]: dispatch 2024-09-21T08:10:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 5]}]: dispatch 2024-09-21T08:10:00.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [0, 5]}]: dispatch 2024-09-21T08:10:00.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [1, 5]}]: dispatch 2024-09-21T08:10:00.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 0]}]: dispatch 2024-09-21T08:10:00.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [1, 5]}]: dispatch 2024-09-21T08:10:00.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [4, 0]}]: dispatch 2024-09-21T08:10:00.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [3, 5]}]: dispatch 2024-09-21T08:10:00.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [4, 5]}]: dispatch 2024-09-21T08:10:00.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:00.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:09:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:10:00.266 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:09:59 smithi129 podman[95044]: 2024-09-21 08:09:59.930533582 +0000 UTC m=+0.394675488 container start 42698c3f3544fe89ab8c6aa8fbff8aed7bcf8739597c6c5131f6ec05afd3adf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-activate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T08:10:00.267 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:00 smithi129 podman[95044]: 2024-09-21 08:10:00.035265849 +0000 UTC m=+0.499407763 container attach 42698c3f3544fe89ab8c6aa8fbff8aed7bcf8739597c6c5131f6ec05afd3adf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-activate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T08:10:00.267 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-activate[95059]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:10:00.267 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:00 smithi129 bash[95044]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:10:00.267 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-activate[95059]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:10:00.267 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:00 smithi129 bash[95044]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T08:10:01.017 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-activate[95059]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T08:10:01.017 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:00 smithi129 bash[95044]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T08:10:01.017 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-activate[95059]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-21T08:10:01.017 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:00 smithi129 bash[95044]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-21T08:10:01.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: pgmap v150: 65 pgs: 4 active+undersized, 9 stale+active+clean, 3 active+undersized+degraded, 49 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6/219 objects degraded (2.740%) 2024-09-21T08:10:01.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: Health check failed: Degraded data redundancy: 6/219 objects degraded (2.740%), 3 pgs degraded (PG_DEGRADED) 2024-09-21T08:10:01.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [3, 5]}]': finished 2024-09-21T08:10:01.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 5]}]': finished 2024-09-21T08:10:01.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 5]}]': finished 2024-09-21T08:10:01.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [0, 5]}]': finished 2024-09-21T08:10:01.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [1, 5]}]': finished 2024-09-21T08:10:01.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 0]}]': finished 2024-09-21T08:10:01.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [1, 5]}]': finished 2024-09-21T08:10:01.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [4, 0]}]': finished 2024-09-21T08:10:01.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [3, 5]}]': finished 2024-09-21T08:10:01.018 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [4, 5]}]': finished 2024-09-21T08:10:01.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: osdmap e75: 6 total, 5 up, 6 in 2024-09-21T08:10:01.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: Health detail: HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 6/219 objects degraded (2.740%), 3 pgs degraded 2024-09-21T08:10:01.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: [WRN] OSD_DOWN: 1 osds down 2024-09-21T08:10:01.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: osd.5 (root=default,host=smithi129) is down 2024-09-21T08:10:01.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: [WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-21T08:10:01.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: all OSDs are running squid or later but require_osd_release < squid 2024-09-21T08:10:01.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: [WRN] PG_DEGRADED: Degraded data redundancy: 6/219 objects degraded (2.740%), 3 pgs degraded 2024-09-21T08:10:01.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-21T08:10:01.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-21T08:10:01.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:00 smithi129 ceph-mon[76722]: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-21T08:10:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: pgmap v150: 65 pgs: 4 active+undersized, 9 stale+active+clean, 3 active+undersized+degraded, 49 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6/219 objects degraded (2.740%) 2024-09-21T08:10:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: Health check failed: Degraded data redundancy: 6/219 objects degraded (2.740%), 3 pgs degraded (PG_DEGRADED) 2024-09-21T08:10:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [3, 5]}]': finished 2024-09-21T08:10:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 5]}]': finished 2024-09-21T08:10:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 5]}]': finished 2024-09-21T08:10:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [0, 5]}]': finished 2024-09-21T08:10:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [1, 5]}]': finished 2024-09-21T08:10:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 0]}]': finished 2024-09-21T08:10:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [1, 5]}]': finished 2024-09-21T08:10:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [4, 0]}]': finished 2024-09-21T08:10:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [3, 5]}]': finished 2024-09-21T08:10:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [4, 5]}]': finished 2024-09-21T08:10:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: osdmap e75: 6 total, 5 up, 6 in 2024-09-21T08:10:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: Health detail: HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 6/219 objects degraded (2.740%), 3 pgs degraded 2024-09-21T08:10:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: [WRN] OSD_DOWN: 1 osds down 2024-09-21T08:10:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: osd.5 (root=default,host=smithi129) is down 2024-09-21T08:10:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: [WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-21T08:10:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: all OSDs are running squid or later but require_osd_release < squid 2024-09-21T08:10:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: [WRN] PG_DEGRADED: Degraded data redundancy: 6/219 objects degraded (2.740%), 3 pgs degraded 2024-09-21T08:10:01.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-21T08:10:01.056 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-21T08:10:01.056 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:00 smithi107 ceph-mon[97757]: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-21T08:10:01.457 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:01 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-activate[95059]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-21T08:10:01.458 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:01 smithi129 bash[95044]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-21T08:10:01.458 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:01 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-activate[95059]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T08:10:01.458 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:01 smithi129 bash[95044]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T08:10:01.458 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:01 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-activate[95059]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-21T08:10:01.458 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:01 smithi129 bash[95044]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-21T08:10:01.458 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:01 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-activate[95059]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T08:10:01.458 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:01 smithi129 bash[95044]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T08:10:01.458 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:01 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-activate[95059]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-21T08:10:01.458 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:01 smithi129 bash[95044]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-21T08:10:01.458 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:01 smithi129 podman[95044]: 2024-09-21 08:10:01.107376741 +0000 UTC m=+1.571518658 container died 42698c3f3544fe89ab8c6aa8fbff8aed7bcf8739597c6c5131f6ec05afd3adf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T08:10:02.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:01 smithi129 ceph-mon[76722]: osdmap e76: 6 total, 5 up, 6 in 2024-09-21T08:10:02.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:01 smithi129 ceph-mon[76722]: osdmap e77: 6 total, 5 up, 6 in 2024-09-21T08:10:02.017 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:01 smithi129 podman[95201]: 2024-09-21 08:10:01.739606786 +0000 UTC m=+0.623824454 container remove 42698c3f3544fe89ab8c6aa8fbff8aed7bcf8739597c6c5131f6ec05afd3adf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-activate, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T08:10:02.017 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:01 smithi129 podman[95258]: 2024-09-21 08:10:01.846131207 +0000 UTC m=+0.015763642 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:10:02.017 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:01 smithi129 podman[95258]: 2024-09-21 08:10:01.965708229 +0000 UTC m=+0.135340709 container create caf3fc8cc3f1b3dac3da78a014badf2bed3f4abfedfb4f07ed9a6b47e4ffc0a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T08:10:02.053 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:01 smithi107 ceph-mon[97757]: osdmap e76: 6 total, 5 up, 6 in 2024-09-21T08:10:02.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:01 smithi107 ceph-mon[97757]: osdmap e77: 6 total, 5 up, 6 in 2024-09-21T08:10:02.516 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:02 smithi129 podman[95258]: 2024-09-21 08:10:02.201547571 +0000 UTC m=+0.371180011 container init caf3fc8cc3f1b3dac3da78a014badf2bed3f4abfedfb4f07ed9a6b47e4ffc0a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731) 2024-09-21T08:10:02.516 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:02 smithi129 podman[95258]: 2024-09-21 08:10:02.204611403 +0000 UTC m=+0.374243837 container start caf3fc8cc3f1b3dac3da78a014badf2bed3f4abfedfb4f07ed9a6b47e4ffc0a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T08:10:02.517 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:02 smithi129 ceph-osd[95277]: -- 172.21.15.129:0/237730757 <== mon.1 v2:172.21.15.129:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a33cd941e0 con 0x55a33bf3dc00 2024-09-21T08:10:02.517 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:02 smithi129 bash[95258]: caf3fc8cc3f1b3dac3da78a014badf2bed3f4abfedfb4f07ed9a6b47e4ffc0a0 2024-09-21T08:10:02.517 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:02 smithi129 systemd[1]: Started Ceph osd.5 for 786d4f32-77ee-11ef-baf6-efdc52797490. 2024-09-21T08:10:03.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:02 smithi129 ceph-mon[76722]: pgmap v153: 65 pgs: 6 remapped+peering, 14 active+undersized, 1 stale+active+clean, 10 active+undersized+degraded, 34 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 28/219 objects degraded (12.785%) 2024-09-21T08:10:03.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:02 smithi129 ceph-mon[76722]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T08:10:03.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:02 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:03.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:02 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:03.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:02 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:10:03.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:02 smithi107 ceph-mon[97757]: pgmap v153: 65 pgs: 6 remapped+peering, 14 active+undersized, 1 stale+active+clean, 10 active+undersized+degraded, 34 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 28/219 objects degraded (12.785%) 2024-09-21T08:10:03.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:02 smithi107 ceph-mon[97757]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T08:10:03.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:02 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:03.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:02 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:03.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:02 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:10:03.918 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:03 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:10:03.819+0000 7fc99579d640 -1 Falling back to public interface 2024-09-21T08:10:04.691 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:04 smithi129 ceph-mon[76722]: osdmap e78: 6 total, 5 up, 6 in 2024-09-21T08:10:04.692 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:04 smithi129 ceph-mon[76722]: pgmap v156: 65 pgs: 1 active+clean+remapped, 9 remapped+peering, 15 active+undersized, 12 active+undersized+degraded, 28 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 30/219 objects degraded (13.699%); 3/219 objects misplaced (1.370%) 2024-09-21T08:10:04.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:04 smithi107 ceph-mon[97757]: osdmap e78: 6 total, 5 up, 6 in 2024-09-21T08:10:04.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:04 smithi107 ceph-mon[97757]: pgmap v156: 65 pgs: 1 active+clean+remapped, 9 remapped+peering, 15 active+undersized, 12 active+undersized+degraded, 28 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 30/219 objects degraded (13.699%); 3/219 objects misplaced (1.370%) 2024-09-21T08:10:05.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.158+0000 7f2a8fa6b640 1 -- 172.21.15.107:0/2247680262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a880fb810 msgr2=0x7f2a880fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:05.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.158+0000 7f2a8fa6b640 1 --2- 172.21.15.107:0/2247680262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a880fb810 0x7f2a880fbbe0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009c50 tx=0x7f2a84004d10 comp rx=0 tx=0).stop 2024-09-21T08:10:05.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.158+0000 7f2a8fa6b640 1 -- 172.21.15.107:0/2247680262 shutdown_connections 2024-09-21T08:10:05.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.158+0000 7f2a8fa6b640 1 --2- 172.21.15.107:0/2247680262 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2a880fcf80 0x7f2a880fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.158+0000 7f2a8fa6b640 1 --2- 172.21.15.107:0/2247680262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a880fb810 0x7f2a880fbbe0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.158+0000 7f2a8fa6b640 1 -- 172.21.15.107:0/2247680262 >> 172.21.15.107:0/2247680262 conn(0x7f2a880723b0 msgr2=0x7f2a880727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:05.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.158+0000 7f2a8fa6b640 1 -- 172.21.15.107:0/2247680262 shutdown_connections 2024-09-21T08:10:05.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.158+0000 7f2a8fa6b640 1 -- 172.21.15.107:0/2247680262 wait complete. 2024-09-21T08:10:05.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.159+0000 7f2a8fa6b640 1 Processor -- start 2024-09-21T08:10:05.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.159+0000 7f2a8fa6b640 1 -- start start 2024-09-21T08:10:05.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.159+0000 7f2a8fa6b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a880fb810 0x7f2a881131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:05.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.159+0000 7f2a8fa6b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2a880fcf80 0x7f2a88113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:05.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.159+0000 7f2a8fa6b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a88113d00 con 0x7f2a880fb810 2024-09-21T08:10:05.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.159+0000 7f2a8fa6b640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8810d190 con 0x7f2a880fcf80 2024-09-21T08:10:05.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.159+0000 7f2a8d807640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a880fb810 0x7f2a881131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:05.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.159+0000 7f2a8d807640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a880fb810 0x7f2a881131c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49476/0 (socket says 172.21.15.107:49476) 2024-09-21T08:10:05.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.159+0000 7f2a8d807640 1 -- 172.21.15.107:0/56467581 learned_addr learned my addr 172.21.15.107:0/56467581 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:10:05.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.159+0000 7f2a8d006640 1 --2- 172.21.15.107:0/56467581 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2a880fcf80 0x7f2a88113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:05.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.160+0000 7f2a8d807640 1 -- 172.21.15.107:0/56467581 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2a880fcf80 msgr2=0x7f2a88113700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:05.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.160+0000 7f2a8d807640 1 --2- 172.21.15.107:0/56467581 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2a880fcf80 0x7f2a88113700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.160+0000 7f2a8d807640 1 -- 172.21.15.107:0/56467581 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a840098b0 con 0x7f2a880fb810 2024-09-21T08:10:05.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.160+0000 7f2a8d807640 1 --2- 172.21.15.107:0/56467581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a880fb810 0x7f2a881131c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2a84004750 tx=0x7f2a84004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:05.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.160+0000 7f2a7e7fc640 1 -- 172.21.15.107:0/56467581 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a84009610 con 0x7f2a880fb810 2024-09-21T08:10:05.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.160+0000 7f2a7e7fc640 1 -- 172.21.15.107:0/56467581 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2a84032b10 con 0x7f2a880fb810 2024-09-21T08:10:05.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.160+0000 7f2a8fa6b640 1 -- 172.21.15.107:0/56467581 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8810d410 con 0x7f2a880fb810 2024-09-21T08:10:05.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.160+0000 7f2a7e7fc640 1 -- 172.21.15.107:0/56467581 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a8403d990 con 0x7f2a880fb810 2024-09-21T08:10:05.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.160+0000 7f2a8fa6b640 1 -- 172.21.15.107:0/56467581 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8810d930 con 0x7f2a880fb810 2024-09-21T08:10:05.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.161+0000 7f2a8fa6b640 1 -- 172.21.15.107:0/56467581 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a880fcbc0 con 0x7f2a880fb810 2024-09-21T08:10:05.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.162+0000 7f2a7e7fc640 1 -- 172.21.15.107:0/56467581 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2a8402f030 con 0x7f2a880fb810 2024-09-21T08:10:05.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.162+0000 7f2a7e7fc640 1 --2- 172.21.15.107:0/56467581 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2a7406e530 0x7f2a740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:05.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.162+0000 7f2a7e7fc640 1 -- 172.21.15.107:0/56467581 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6911+0+0 (secure 0 0 0) 0x7f2a840af3e0 con 0x7f2a880fb810 2024-09-21T08:10:05.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.162+0000 7f2a8d006640 1 --2- 172.21.15.107:0/56467581 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2a7406e530 0x7f2a740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:05.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.163+0000 7f2a8d006640 1 --2- 172.21.15.107:0/56467581 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2a7406e530 0x7f2a740709e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2a8810ea80 tx=0x7f2a7800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:05.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.167+0000 7f2a7e7fc640 1 -- 172.21.15.107:0/56467581 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2a84078330 con 0x7f2a880fb810 2024-09-21T08:10:05.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.352+0000 7f2a8fa6b640 1 -- 172.21.15.107:0/56467581 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a8804b750 con 0x7f2a7406e530 2024-09-21T08:10:05.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.353+0000 7f2a7e7fc640 1 -- 172.21.15.107:0/56467581 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2a8804b750 con 0x7f2a7406e530 2024-09-21T08:10:05.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.355+0000 7f2a8fa6b640 1 -- 172.21.15.107:0/56467581 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2a7406e530 msgr2=0x7f2a740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:05.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.355+0000 7f2a8fa6b640 1 --2- 172.21.15.107:0/56467581 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2a7406e530 0x7f2a740709e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2a8810ea80 tx=0x7f2a7800b040 comp rx=0 tx=0).stop 2024-09-21T08:10:05.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.355+0000 7f2a8fa6b640 1 -- 172.21.15.107:0/56467581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a880fb810 msgr2=0x7f2a881131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:05.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.355+0000 7f2a8fa6b640 1 --2- 172.21.15.107:0/56467581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a880fb810 0x7f2a881131c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2a84004750 tx=0x7f2a84004d10 comp rx=0 tx=0).stop 2024-09-21T08:10:05.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.355+0000 7f2a8fa6b640 1 -- 172.21.15.107:0/56467581 shutdown_connections 2024-09-21T08:10:05.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.355+0000 7f2a8fa6b640 1 --2- 172.21.15.107:0/56467581 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2a7406e530 0x7f2a740709e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.355+0000 7f2a8fa6b640 1 --2- 172.21.15.107:0/56467581 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2a880fcf80 0x7f2a88113700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.355+0000 7f2a8fa6b640 1 --2- 172.21.15.107:0/56467581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a880fb810 0x7f2a881131c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.355+0000 7f2a8fa6b640 1 -- 172.21.15.107:0/56467581 >> 172.21.15.107:0/56467581 conn(0x7f2a880723b0 msgr2=0x7f2a880fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:05.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.355+0000 7f2a8fa6b640 1 -- 172.21.15.107:0/56467581 shutdown_connections 2024-09-21T08:10:05.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.355+0000 7f2a8fa6b640 1 -- 172.21.15.107:0/56467581 wait complete. 2024-09-21T08:10:05.367 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:10:05.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.437+0000 7fe7849c8640 1 -- 172.21.15.107:0/2236636401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7800fe450 msgr2=0x7fe7800fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:05.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.437+0000 7fe7849c8640 1 --2- 172.21.15.107:0/2236636401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7800fe450 0x7fe7800fe820 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe770009c50 tx=0x7fe770004d10 comp rx=0 tx=0).stop 2024-09-21T08:10:05.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.438+0000 7fe7849c8640 1 -- 172.21.15.107:0/2236636401 shutdown_connections 2024-09-21T08:10:05.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.438+0000 7fe7849c8640 1 --2- 172.21.15.107:0/2236636401 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe780064fe0 0x7fe780065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.438+0000 7fe7849c8640 1 --2- 172.21.15.107:0/2236636401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7800fe450 0x7fe7800fe820 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.438+0000 7fe7849c8640 1 -- 172.21.15.107:0/2236636401 >> 172.21.15.107:0/2236636401 conn(0x7fe7800723b0 msgr2=0x7fe7800727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:05.440 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:05 smithi107 ceph-mon[97757]: osdmap e79: 6 total, 5 up, 6 in 2024-09-21T08:10:05.440 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:05 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:05.440 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:05 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:05.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.438+0000 7fe7849c8640 1 -- 172.21.15.107:0/2236636401 shutdown_connections 2024-09-21T08:10:05.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.438+0000 7fe7849c8640 1 -- 172.21.15.107:0/2236636401 wait complete. 2024-09-21T08:10:05.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.438+0000 7fe7849c8640 1 Processor -- start 2024-09-21T08:10:05.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.438+0000 7fe7849c8640 1 -- start start 2024-09-21T08:10:05.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.439+0000 7fe7849c8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe780064fe0 0x7fe7801131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:05.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.439+0000 7fe7849c8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7800fe450 0x7fe780113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:05.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.439+0000 7fe7849c8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe780113d10 con 0x7fe7800fe450 2024-09-21T08:10:05.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.439+0000 7fe7849c8640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78010d150 con 0x7fe780064fe0 2024-09-21T08:10:05.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.439+0000 7fe77dd9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7800fe450 0x7fe780113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:05.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.439+0000 7fe77dd9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7800fe450 0x7fe780113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49494/0 (socket says 172.21.15.107:49494) 2024-09-21T08:10:05.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.439+0000 7fe77dd9b640 1 -- 172.21.15.107:0/2705106329 learned_addr learned my addr 172.21.15.107:0/2705106329 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:10:05.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.439+0000 7fe77e59c640 1 --2- 172.21.15.107:0/2705106329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe780064fe0 0x7fe7801131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:05.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.439+0000 7fe77dd9b640 1 -- 172.21.15.107:0/2705106329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe780064fe0 msgr2=0x7fe7801131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:05.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.439+0000 7fe77dd9b640 1 --2- 172.21.15.107:0/2705106329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe780064fe0 0x7fe7801131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.439+0000 7fe77dd9b640 1 -- 172.21.15.107:0/2705106329 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7700098b0 con 0x7fe7800fe450 2024-09-21T08:10:05.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.439+0000 7fe77dd9b640 1 --2- 172.21.15.107:0/2705106329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7800fe450 0x7fe780113710 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe77400eb70 tx=0x7fe77400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:05.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.440+0000 7fe76effd640 1 -- 172.21.15.107:0/2705106329 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe774007c30 con 0x7fe7800fe450 2024-09-21T08:10:05.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.440+0000 7fe7849c8640 1 -- 172.21.15.107:0/2705106329 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe78010d3d0 con 0x7fe7800fe450 2024-09-21T08:10:05.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.440+0000 7fe7849c8640 1 -- 172.21.15.107:0/2705106329 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78010d970 con 0x7fe7800fe450 2024-09-21T08:10:05.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.440+0000 7fe76effd640 1 -- 172.21.15.107:0/2705106329 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe77400f040 con 0x7fe7800fe450 2024-09-21T08:10:05.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.440+0000 7fe76effd640 1 -- 172.21.15.107:0/2705106329 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe774009550 con 0x7fe7800fe450 2024-09-21T08:10:05.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.441+0000 7fe7849c8640 1 -- 172.21.15.107:0/2705106329 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe760005210 con 0x7fe7800fe450 2024-09-21T08:10:05.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.441+0000 7fe76effd640 1 -- 172.21.15.107:0/2705106329 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe7740097d0 con 0x7fe7800fe450 2024-09-21T08:10:05.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.442+0000 7fe76effd640 1 --2- 172.21.15.107:0/2705106329 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fe76806e530 0x7fe7680709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:05.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.442+0000 7fe76effd640 1 -- 172.21.15.107:0/2705106329 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6911+0+0 (secure 0 0 0) 0x7fe77408dd90 con 0x7fe7800fe450 2024-09-21T08:10:05.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.442+0000 7fe77e59c640 1 --2- 172.21.15.107:0/2705106329 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fe76806e530 0x7fe7680709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:05.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.442+0000 7fe77e59c640 1 --2- 172.21.15.107:0/2705106329 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fe76806e530 0x7fe7680709e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe770000f80 tx=0x7fe770004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:05.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.449+0000 7fe76effd640 1 -- 172.21.15.107:0/2705106329 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe774056e10 con 0x7fe7800fe450 2024-09-21T08:10:05.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.632+0000 7fe7849c8640 1 -- 172.21.15.107:0/2705106329 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe760000bc0 con 0x7fe76806e530 2024-09-21T08:10:05.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.633+0000 7fe76effd640 1 -- 172.21.15.107:0/2705106329 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe760000bc0 con 0x7fe76806e530 2024-09-21T08:10:05.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.635+0000 7fe7849c8640 1 -- 172.21.15.107:0/2705106329 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fe76806e530 msgr2=0x7fe7680709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:05.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.635+0000 7fe7849c8640 1 --2- 172.21.15.107:0/2705106329 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fe76806e530 0x7fe7680709e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe770000f80 tx=0x7fe770004d10 comp rx=0 tx=0).stop 2024-09-21T08:10:05.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.635+0000 7fe7849c8640 1 -- 172.21.15.107:0/2705106329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7800fe450 msgr2=0x7fe780113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:05.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.635+0000 7fe7849c8640 1 --2- 172.21.15.107:0/2705106329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7800fe450 0x7fe780113710 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe77400eb70 tx=0x7fe77400b040 comp rx=0 tx=0).stop 2024-09-21T08:10:05.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.635+0000 7fe7849c8640 1 -- 172.21.15.107:0/2705106329 shutdown_connections 2024-09-21T08:10:05.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.635+0000 7fe7849c8640 1 --2- 172.21.15.107:0/2705106329 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fe76806e530 0x7fe7680709e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.635+0000 7fe7849c8640 1 --2- 172.21.15.107:0/2705106329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7800fe450 0x7fe780113710 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.635+0000 7fe7849c8640 1 --2- 172.21.15.107:0/2705106329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe780064fe0 0x7fe7801131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.635+0000 7fe7849c8640 1 -- 172.21.15.107:0/2705106329 >> 172.21.15.107:0/2705106329 conn(0x7fe7800723b0 msgr2=0x7fe7800fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:05.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.635+0000 7fe7849c8640 1 -- 172.21.15.107:0/2705106329 shutdown_connections 2024-09-21T08:10:05.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.635+0000 7fe7849c8640 1 -- 172.21.15.107:0/2705106329 wait complete. 2024-09-21T08:10:05.675 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:05 smithi129 ceph-mon[76722]: osdmap e79: 6 total, 5 up, 6 in 2024-09-21T08:10:05.675 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:05 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:05.676 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:05 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:05.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.715+0000 7ff47a263640 1 -- 172.21.15.107:0/3632191744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4740fdf20 msgr2=0x7ff474106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:05.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.715+0000 7ff47a263640 1 --2- 172.21.15.107:0/3632191744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4740fdf20 0x7ff474106560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff4680048d0 tx=0x7ff468009da0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.715+0000 7ff47a263640 1 -- 172.21.15.107:0/3632191744 shutdown_connections 2024-09-21T08:10:05.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.715+0000 7ff47a263640 1 --2- 172.21.15.107:0/3632191744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4740fdf20 0x7ff474106560 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.715+0000 7ff47a263640 1 --2- 172.21.15.107:0/3632191744 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff4740fd580 0x7ff4740fd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.715+0000 7ff47a263640 1 -- 172.21.15.107:0/3632191744 >> 172.21.15.107:0/3632191744 conn(0x7ff4740f7010 msgr2=0x7ff4740f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:05.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.716+0000 7ff47a263640 1 -- 172.21.15.107:0/3632191744 shutdown_connections 2024-09-21T08:10:05.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.716+0000 7ff47a263640 1 -- 172.21.15.107:0/3632191744 wait complete. 2024-09-21T08:10:05.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.716+0000 7ff47a263640 1 Processor -- start 2024-09-21T08:10:05.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.716+0000 7ff47a263640 1 -- start start 2024-09-21T08:10:05.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.716+0000 7ff47a263640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4740fd580 0x7ff474113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:05.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.717+0000 7ff47a263640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff4740fdf20 0x7ff474113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:05.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.717+0000 7ff47a263640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff474113d50 con 0x7ff4740fd580 2024-09-21T08:10:05.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.717+0000 7ff47a263640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47410d190 con 0x7ff4740fdf20 2024-09-21T08:10:05.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.717+0000 7ff473fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4740fd580 0x7ff474113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:05.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.717+0000 7ff473fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4740fd580 0x7ff474113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49520/0 (socket says 172.21.15.107:49520) 2024-09-21T08:10:05.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.717+0000 7ff473fff640 1 -- 172.21.15.107:0/625842312 learned_addr learned my addr 172.21.15.107:0/625842312 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:10:05.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.717+0000 7ff4737fe640 1 --2- 172.21.15.107:0/625842312 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff4740fdf20 0x7ff474113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:05.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.717+0000 7ff473fff640 1 -- 172.21.15.107:0/625842312 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff4740fdf20 msgr2=0x7ff474113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:05.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.717+0000 7ff473fff640 1 --2- 172.21.15.107:0/625842312 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff4740fdf20 0x7ff474113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.717+0000 7ff473fff640 1 -- 172.21.15.107:0/625842312 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff468005040 con 0x7ff4740fd580 2024-09-21T08:10:05.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.717+0000 7ff473fff640 1 --2- 172.21.15.107:0/625842312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4740fd580 0x7ff474113210 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff46400eb70 tx=0x7ff46400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:05.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.717+0000 7ff470ff9640 1 -- 172.21.15.107:0/625842312 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff464007c30 con 0x7ff4740fd580 2024-09-21T08:10:05.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.717+0000 7ff470ff9640 1 -- 172.21.15.107:0/625842312 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff46400f040 con 0x7ff4740fd580 2024-09-21T08:10:05.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.717+0000 7ff470ff9640 1 -- 172.21.15.107:0/625842312 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4640094e0 con 0x7ff4740fd580 2024-09-21T08:10:05.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.717+0000 7ff47a263640 1 -- 172.21.15.107:0/625842312 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47410d410 con 0x7ff4740fd580 2024-09-21T08:10:05.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.718+0000 7ff47a263640 1 -- 172.21.15.107:0/625842312 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47410d8b0 con 0x7ff4740fd580 2024-09-21T08:10:05.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.719+0000 7ff47a263640 1 -- 172.21.15.107:0/625842312 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4740663b0 con 0x7ff4740fd580 2024-09-21T08:10:05.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.720+0000 7ff470ff9640 1 -- 172.21.15.107:0/625842312 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff464009750 con 0x7ff4740fd580 2024-09-21T08:10:05.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.720+0000 7ff470ff9640 1 --2- 172.21.15.107:0/625842312 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff45c06e530 0x7ff45c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:05.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.720+0000 7ff470ff9640 1 -- 172.21.15.107:0/625842312 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6911+0+0 (secure 0 0 0) 0x7ff46408dfa0 con 0x7ff4740fd580 2024-09-21T08:10:05.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.721+0000 7ff4737fe640 1 --2- 172.21.15.107:0/625842312 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff45c06e530 0x7ff45c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:05.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.721+0000 7ff4737fe640 1 --2- 172.21.15.107:0/625842312 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff45c06e530 0x7ff45c0709e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff4740fe9f0 tx=0x7ff468035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:05.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.725+0000 7ff470ff9640 1 -- 172.21.15.107:0/625842312 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff464056fa0 con 0x7ff4740fd580 2024-09-21T08:10:05.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.899+0000 7ff47a263640 1 -- 172.21.15.107:0/625842312 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff47404b770 con 0x7ff45c06e530 2024-09-21T08:10:05.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.907+0000 7ff470ff9640 1 -- 172.21.15.107:0/625842312 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ff47404b770 con 0x7ff45c06e530 2024-09-21T08:10:05.909 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:10:05.909 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (7m) 97s ago 15m 26.2M - 0.25.0 c8568f914cd2 2b499aa3b7de 2024-09-21T08:10:05.909 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (3m) 97s ago 15m 6899k - 19.1.1-367-g9e2ac70b cc9251b744a3 69be0e9aa842 2024-09-21T08:10:05.909 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (3m) 0s ago 14m 6891k - 19.1.1-367-g9e2ac70b cc9251b744a3 926ed03c78b9 2024-09-21T08:10:05.909 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (5m) 97s ago 14m 81.2M - 9.4.12 2bacad6d85d8 63177dcfe25c 2024-09-21T08:10:05.909 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (9m) 97s ago 9m 155M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 3bc779f88228 2024-09-21T08:10:05.910 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (9m) 97s ago 9m 14.1M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be ea8f140aade7 2024-09-21T08:10:05.910 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (9m) 0s ago 9m 17.5M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 329346c3afec 2024-09-21T08:10:05.910 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (9m) 0s ago 9m 18.9M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be baf87f32bfbc 2024-09-21T08:10:05.910 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:8443,9283,8765 running (6m) 97s ago 16m 498M - 19.1.1-367-g9e2ac70b cc9251b744a3 49c237734f07 2024-09-21T08:10:05.910 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283,8765 running (5m) 0s ago 14m 441M - 19.1.1-367-g9e2ac70b cc9251b744a3 ed117096bdd8 2024-09-21T08:10:05.910 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (4m) 97s ago 16m 45.9M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 445b3e6a800f 2024-09-21T08:10:05.910 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (3m) 0s ago 14m 36.7M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 12706f823621 2024-09-21T08:10:05.910 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 running (7m) 97s ago 15m 17.1M - 1.5.0 0da6a335fe13 6de7c307ba0f 2024-09-21T08:10:05.910 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (6m) 0s ago 14m 16.6M - 1.5.0 0da6a335fe13 cb6d4577b24c 2024-09-21T08:10:05.910 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (2m) 97s ago 13m 98.8M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 d0a742b31d8a 2024-09-21T08:10:05.910 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (2m) 97s ago 13m 107M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 4bb3f4c8f75a 2024-09-21T08:10:05.910 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (103s) 97s ago 12m 12.1M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 15f45fa18e64 2024-09-21T08:10:05.910 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (68s) 0s ago 12m 112M 2581M 19.1.1-367-g9e2ac70b cc9251b744a3 ee4efea3e442 2024-09-21T08:10:05.910 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (37s) 0s ago 11m 106M 2581M 19.1.1-367-g9e2ac70b cc9251b744a3 0d09ba7072ba 2024-09-21T08:10:05.911 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (4s) 0s ago 11m 12.1M 2581M 19.1.1-367-g9e2ac70b cc9251b744a3 caf3fc8cc3f1 2024-09-21T08:10:05.911 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (5m) 97s ago 14m 61.0M - 2.43.0 a07b618ecd1d 9ed2abf5e8d8 2024-09-21T08:10:05.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.910+0000 7ff47a263640 1 -- 172.21.15.107:0/625842312 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff45c06e530 msgr2=0x7ff45c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:05.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.910+0000 7ff47a263640 1 --2- 172.21.15.107:0/625842312 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff45c06e530 0x7ff45c0709e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff4740fe9f0 tx=0x7ff468035040 comp rx=0 tx=0).stop 2024-09-21T08:10:05.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.910+0000 7ff47a263640 1 -- 172.21.15.107:0/625842312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4740fd580 msgr2=0x7ff474113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:05.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.910+0000 7ff47a263640 1 --2- 172.21.15.107:0/625842312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4740fd580 0x7ff474113210 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff46400eb70 tx=0x7ff46400b040 comp rx=0 tx=0).stop 2024-09-21T08:10:05.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.910+0000 7ff47a263640 1 -- 172.21.15.107:0/625842312 shutdown_connections 2024-09-21T08:10:05.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.910+0000 7ff47a263640 1 --2- 172.21.15.107:0/625842312 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff45c06e530 0x7ff45c0709e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.910+0000 7ff47a263640 1 --2- 172.21.15.107:0/625842312 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff4740fdf20 0x7ff474113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.910+0000 7ff47a263640 1 --2- 172.21.15.107:0/625842312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4740fd580 0x7ff474113210 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.910+0000 7ff47a263640 1 -- 172.21.15.107:0/625842312 >> 172.21.15.107:0/625842312 conn(0x7ff4740f7010 msgr2=0x7ff4740f85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:05.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.910+0000 7ff47a263640 1 -- 172.21.15.107:0/625842312 shutdown_connections 2024-09-21T08:10:05.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.910+0000 7ff47a263640 1 -- 172.21.15.107:0/625842312 wait complete. 2024-09-21T08:10:05.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.986+0000 7f99341d1640 1 -- 172.21.15.107:0/3396862989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f992c0fbd10 msgr2=0x7f992c100330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:05.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.986+0000 7f99341d1640 1 --2- 172.21.15.107:0/3396862989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f992c0fbd10 0x7f992c100330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f99200048d0 tx=0x7f9920009da0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.986+0000 7f99341d1640 1 -- 172.21.15.107:0/3396862989 shutdown_connections 2024-09-21T08:10:05.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.986+0000 7f99341d1640 1 --2- 172.21.15.107:0/3396862989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f992c0fbd10 0x7f992c100330 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.986+0000 7f99341d1640 1 --2- 172.21.15.107:0/3396862989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f992c0fb370 0x7f992c0fb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.986+0000 7f99341d1640 1 -- 172.21.15.107:0/3396862989 >> 172.21.15.107:0/3396862989 conn(0x7f992c0f7010 msgr2=0x7f992c0f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:05.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.986+0000 7f99341d1640 1 -- 172.21.15.107:0/3396862989 shutdown_connections 2024-09-21T08:10:05.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.987+0000 7f99341d1640 1 -- 172.21.15.107:0/3396862989 wait complete. 2024-09-21T08:10:05.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.987+0000 7f99341d1640 1 Processor -- start 2024-09-21T08:10:05.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.987+0000 7f99341d1640 1 -- start start 2024-09-21T08:10:05.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.987+0000 7f99341d1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f992c0fb370 0x7f992c1198a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:05.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.987+0000 7f99341d1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f992c0fbd10 0x7f992c119de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:05.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.988+0000 7f99341d1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c11a430 con 0x7f992c0fb370 2024-09-21T08:10:05.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.988+0000 7f99341d1640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c113840 con 0x7f992c0fbd10 2024-09-21T08:10:05.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.988+0000 7f9931f6d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f992c0fb370 0x7f992c1198a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:05.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.988+0000 7f9931f6d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f992c0fb370 0x7f992c1198a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49528/0 (socket says 172.21.15.107:49528) 2024-09-21T08:10:05.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.988+0000 7f9931f6d640 1 -- 172.21.15.107:0/4126709333 learned_addr learned my addr 172.21.15.107:0/4126709333 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:10:05.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.988+0000 7f993176c640 1 --2- 172.21.15.107:0/4126709333 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f992c0fbd10 0x7f992c119de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:05.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.988+0000 7f9931f6d640 1 -- 172.21.15.107:0/4126709333 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f992c0fbd10 msgr2=0x7f992c119de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:05.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.988+0000 7f9931f6d640 1 --2- 172.21.15.107:0/4126709333 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f992c0fbd10 0x7f992c119de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:05.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.988+0000 7f9931f6d640 1 -- 172.21.15.107:0/4126709333 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9920005040 con 0x7f992c0fb370 2024-09-21T08:10:05.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.988+0000 7f9931f6d640 1 --2- 172.21.15.107:0/4126709333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f992c0fb370 0x7f992c1198a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f991c002a80 tx=0x7f991c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:05.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.988+0000 7f992a7fc640 1 -- 172.21.15.107:0/4126709333 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f991c007c30 con 0x7f992c0fb370 2024-09-21T08:10:05.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.988+0000 7f99341d1640 1 -- 172.21.15.107:0/4126709333 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f992c113b20 con 0x7f992c0fb370 2024-09-21T08:10:05.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.988+0000 7f992a7fc640 1 -- 172.21.15.107:0/4126709333 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f991c00f040 con 0x7f992c0fb370 2024-09-21T08:10:05.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.988+0000 7f992a7fc640 1 -- 172.21.15.107:0/4126709333 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f991c00dab0 con 0x7f992c0fb370 2024-09-21T08:10:05.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.988+0000 7f99341d1640 1 -- 172.21.15.107:0/4126709333 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992c114010 con 0x7f992c0fb370 2024-09-21T08:10:05.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.990+0000 7f99341d1640 1 -- 172.21.15.107:0/4126709333 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f992c0663b0 con 0x7f992c0fb370 2024-09-21T08:10:05.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.990+0000 7f992a7fc640 1 -- 172.21.15.107:0/4126709333 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f991c00dc30 con 0x7f992c0fb370 2024-09-21T08:10:05.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.991+0000 7f992a7fc640 1 --2- 172.21.15.107:0/4126709333 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f991406e530 0x7f99140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:05.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.991+0000 7f992a7fc640 1 -- 172.21.15.107:0/4126709333 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6911+0+0 (secure 0 0 0) 0x7f991c08dbc0 con 0x7f992c0fb370 2024-09-21T08:10:05.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.991+0000 7f993176c640 1 --2- 172.21.15.107:0/4126709333 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f991406e530 0x7f99140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:05.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.991+0000 7f993176c640 1 --2- 172.21.15.107:0/4126709333 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f991406e530 0x7f99140709e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9920009ac0 tx=0x7f9920035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:05.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:05.995+0000 7f992a7fc640 1 -- 172.21.15.107:0/4126709333 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f991c056bc0 con 0x7f992c0fb370 2024-09-21T08:10:06.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.229+0000 7f99341d1640 1 -- 172.21.15.107:0/4126709333 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f992c10fb70 con 0x7f992c0fb370 2024-09-21T08:10:06.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.229+0000 7f992a7fc640 1 -- 172.21.15.107:0/4126709333 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+742 (secure 0 0 0) 0x7f991c05a280 con 0x7f992c0fb370 2024-09-21T08:10:06.231 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:10:06.231 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": { 2024-09-21T08:10:06.231 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:10:06.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:10:06.231 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": { 2024-09-21T08:10:06.231 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:10:06.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:10:06.231 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": { 2024-09-21T08:10:06.232 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 5 2024-09-21T08:10:06.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:10:06.232 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-21T08:10:06.232 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 4 2024-09-21T08:10:06.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:10:06.232 INFO:teuthology.orchestra.run.smithi107.stdout: "overall": { 2024-09-21T08:10:06.232 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 4, 2024-09-21T08:10:06.232 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 9 2024-09-21T08:10:06.232 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-21T08:10:06.232 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:10:06.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.231+0000 7f99341d1640 1 -- 172.21.15.107:0/4126709333 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f991406e530 msgr2=0x7f99140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:06.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.231+0000 7f99341d1640 1 --2- 172.21.15.107:0/4126709333 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f991406e530 0x7f99140709e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9920009ac0 tx=0x7f9920035040 comp rx=0 tx=0).stop 2024-09-21T08:10:06.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.231+0000 7f99341d1640 1 -- 172.21.15.107:0/4126709333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f992c0fb370 msgr2=0x7f992c1198a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:06.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.231+0000 7f99341d1640 1 --2- 172.21.15.107:0/4126709333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f992c0fb370 0x7f992c1198a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f991c002a80 tx=0x7f991c004600 comp rx=0 tx=0).stop 2024-09-21T08:10:06.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.231+0000 7f99341d1640 1 -- 172.21.15.107:0/4126709333 shutdown_connections 2024-09-21T08:10:06.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.231+0000 7f99341d1640 1 --2- 172.21.15.107:0/4126709333 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f991406e530 0x7f99140709e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.231+0000 7f99341d1640 1 --2- 172.21.15.107:0/4126709333 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f992c0fbd10 0x7f992c119de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.231+0000 7f99341d1640 1 --2- 172.21.15.107:0/4126709333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f992c0fb370 0x7f992c1198a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.231+0000 7f99341d1640 1 -- 172.21.15.107:0/4126709333 >> 172.21.15.107:0/4126709333 conn(0x7f992c0f7010 msgr2=0x7f992c0f8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:06.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.231+0000 7f99341d1640 1 -- 172.21.15.107:0/4126709333 shutdown_connections 2024-09-21T08:10:06.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.231+0000 7f99341d1640 1 -- 172.21.15.107:0/4126709333 wait complete. 2024-09-21T08:10:06.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.310+0000 7f78acc83640 1 -- 172.21.15.107:0/1309988936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78a80fcf80 msgr2=0x7f78a80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:06.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.310+0000 7f78acc83640 1 --2- 172.21.15.107:0/1309988936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78a80fcf80 0x7f78a80fd3d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f789c0048d0 tx=0x7f789c009da0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.310+0000 7f78acc83640 1 -- 172.21.15.107:0/1309988936 shutdown_connections 2024-09-21T08:10:06.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.310+0000 7f78acc83640 1 --2- 172.21.15.107:0/1309988936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78a80fcf80 0x7f78a80fd3d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.310+0000 7f78acc83640 1 --2- 172.21.15.107:0/1309988936 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f78a80fb810 0x7f78a80fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.310+0000 7f78acc83640 1 -- 172.21.15.107:0/1309988936 >> 172.21.15.107:0/1309988936 conn(0x7f78a80723b0 msgr2=0x7f78a80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:06.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.310+0000 7f78acc83640 1 -- 172.21.15.107:0/1309988936 shutdown_connections 2024-09-21T08:10:06.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.310+0000 7f78acc83640 1 -- 172.21.15.107:0/1309988936 wait complete. 2024-09-21T08:10:06.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.310+0000 7f78acc83640 1 Processor -- start 2024-09-21T08:10:06.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.310+0000 7f78acc83640 1 -- start start 2024-09-21T08:10:06.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.310+0000 7f78acc83640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f78a80fb810 0x7f78a810bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:06.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.311+0000 7f78acc83640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78a80fcf80 0x7f78a810c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:06.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.311+0000 7f78acc83640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a810ca00 con 0x7f78a80fcf80 2024-09-21T08:10:06.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.311+0000 7f78acc83640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a810cb40 con 0x7f78a80fb810 2024-09-21T08:10:06.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.311+0000 7f78a5d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78a80fcf80 0x7f78a810c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:06.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.311+0000 7f78a5d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78a80fcf80 0x7f78a810c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49548/0 (socket says 172.21.15.107:49548) 2024-09-21T08:10:06.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.311+0000 7f78a5d9b640 1 -- 172.21.15.107:0/601686590 learned_addr learned my addr 172.21.15.107:0/601686590 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:10:06.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.311+0000 7f78a659c640 1 --2- 172.21.15.107:0/601686590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f78a80fb810 0x7f78a810bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:06.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.311+0000 7f78a5d9b640 1 -- 172.21.15.107:0/601686590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f78a80fb810 msgr2=0x7f78a810bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:06.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.311+0000 7f78a5d9b640 1 --2- 172.21.15.107:0/601686590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f78a80fb810 0x7f78a810bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.311+0000 7f78a5d9b640 1 -- 172.21.15.107:0/601686590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c005040 con 0x7f78a80fcf80 2024-09-21T08:10:06.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.311+0000 7f78a5d9b640 1 --2- 172.21.15.107:0/601686590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78a80fcf80 0x7f78a810c4c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f789c000c00 tx=0x7f789c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:06.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.311+0000 7f7896ffd640 1 -- 172.21.15.107:0/601686590 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f789c038070 con 0x7f78a80fcf80 2024-09-21T08:10:06.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.311+0000 7f78acc83640 1 -- 172.21.15.107:0/601686590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a810cdc0 con 0x7f78a80fcf80 2024-09-21T08:10:06.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.311+0000 7f7896ffd640 1 -- 172.21.15.107:0/601686590 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f789c02ade0 con 0x7f78a80fcf80 2024-09-21T08:10:06.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.311+0000 7f7896ffd640 1 -- 172.21.15.107:0/601686590 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f789c02c7e0 con 0x7f78a80fcf80 2024-09-21T08:10:06.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.311+0000 7f78acc83640 1 -- 172.21.15.107:0/601686590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a81198c0 con 0x7f78a80fcf80 2024-09-21T08:10:06.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.312+0000 7f78acc83640 1 -- 172.21.15.107:0/601686590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a80fcbc0 con 0x7f78a80fcf80 2024-09-21T08:10:06.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.313+0000 7f7896ffd640 1 -- 172.21.15.107:0/601686590 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f789c030020 con 0x7f78a80fcf80 2024-09-21T08:10:06.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.313+0000 7f7896ffd640 1 --2- 172.21.15.107:0/601686590 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f789006e530 0x7f78900709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:06.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.313+0000 7f7896ffd640 1 -- 172.21.15.107:0/601686590 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6911+0+0 (secure 0 0 0) 0x7f789c0adf10 con 0x7f78a80fcf80 2024-09-21T08:10:06.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.313+0000 7f78a659c640 1 --2- 172.21.15.107:0/601686590 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f789006e530 0x7f78900709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:06.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.314+0000 7f78a659c640 1 --2- 172.21.15.107:0/601686590 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f789006e530 0x7f78900709e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7898004fd0 tx=0x7f7898009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:06.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.318+0000 7f7896ffd640 1 -- 172.21.15.107:0/601686590 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f789c076f90 con 0x7f78a80fcf80 2024-09-21T08:10:06.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.523+0000 7f78acc83640 1 -- 172.21.15.107:0/601686590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f78a8072ec0 con 0x7f78a80fcf80 2024-09-21T08:10:06.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.523+0000 7f7896ffd640 1 -- 172.21.15.107:0/601686590 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1922 (secure 0 0 0) 0x7f789c0417a0 con 0x7f78a80fcf80 2024-09-21T08:10:06.525 INFO:teuthology.orchestra.run.smithi107.stdout:e15 2024-09-21T08:10:06.525 INFO:teuthology.orchestra.run.smithi107.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-21T08:10:06.525 INFO:teuthology.orchestra.run.smithi107.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T08:10:06.525 INFO:teuthology.orchestra.run.smithi107.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:10:06.525 INFO:teuthology.orchestra.run.smithi107.stdout:legacy client fscid: 1 2024-09-21T08:10:06.525 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:10:06.525 INFO:teuthology.orchestra.run.smithi107.stdout:Filesystem 'cephfs' (1) 2024-09-21T08:10:06.525 INFO:teuthology.orchestra.run.smithi107.stdout:fs_name cephfs 2024-09-21T08:10:06.526 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 15 2024-09-21T08:10:06.526 INFO:teuthology.orchestra.run.smithi107.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T08:10:06.526 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-09-21T08:00:03.244314+0000 2024-09-21T08:10:06.526 INFO:teuthology.orchestra.run.smithi107.stdout:modified 2024-09-21T08:00:21.458971+0000 2024-09-21T08:10:06.526 INFO:teuthology.orchestra.run.smithi107.stdout:tableserver 0 2024-09-21T08:10:06.526 INFO:teuthology.orchestra.run.smithi107.stdout:root 0 2024-09-21T08:10:06.526 INFO:teuthology.orchestra.run.smithi107.stdout:session_timeout 60 2024-09-21T08:10:06.526 INFO:teuthology.orchestra.run.smithi107.stdout:session_autoclose 300 2024-09-21T08:10:06.526 INFO:teuthology.orchestra.run.smithi107.stdout:max_file_size 1099511627776 2024-09-21T08:10:06.526 INFO:teuthology.orchestra.run.smithi107.stdout:max_xattr_size 65536 2024-09-21T08:10:06.526 INFO:teuthology.orchestra.run.smithi107.stdout:required_client_features {} 2024-09-21T08:10:06.526 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure 0 2024-09-21T08:10:06.526 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure_osd_epoch 44 2024-09-21T08:10:06.526 INFO:teuthology.orchestra.run.smithi107.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:10:06.526 INFO:teuthology.orchestra.run.smithi107.stdout:max_mds 1 2024-09-21T08:10:06.527 INFO:teuthology.orchestra.run.smithi107.stdout:in 0 2024-09-21T08:10:06.527 INFO:teuthology.orchestra.run.smithi107.stdout:up {0=14458} 2024-09-21T08:10:06.527 INFO:teuthology.orchestra.run.smithi107.stdout:failed 2024-09-21T08:10:06.527 INFO:teuthology.orchestra.run.smithi107.stdout:damaged 2024-09-21T08:10:06.527 INFO:teuthology.orchestra.run.smithi107.stdout:stopped 2024-09-21T08:10:06.527 INFO:teuthology.orchestra.run.smithi107.stdout:data_pools [3] 2024-09-21T08:10:06.527 INFO:teuthology.orchestra.run.smithi107.stdout:metadata_pool 2 2024-09-21T08:10:06.527 INFO:teuthology.orchestra.run.smithi107.stdout:inline_data disabled 2024-09-21T08:10:06.527 INFO:teuthology.orchestra.run.smithi107.stdout:balancer 2024-09-21T08:10:06.527 INFO:teuthology.orchestra.run.smithi107.stdout:bal_rank_mask -1 2024-09-21T08:10:06.527 INFO:teuthology.orchestra.run.smithi107.stdout:standby_count_wanted 1 2024-09-21T08:10:06.527 INFO:teuthology.orchestra.run.smithi107.stdout:qdb_cluster leader: 0 members: 2024-09-21T08:10:06.527 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.grqzkt{0:14458} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.107:6828/3876219633,v1:172.21.15.107:6829/3876219633] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:10:06.527 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:10:06.527 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:10:06.528 INFO:teuthology.orchestra.run.smithi107.stdout:Standby daemons: 2024-09-21T08:10:06.528 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:10:06.528 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.qusoyf{-1:14468} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6826/2352538667,v1:172.21.15.107:6827/2352538667] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:10:06.528 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.fwmfcy{-1:24239} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:10:06.528 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.belyba{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:10:06.529 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 15 2024-09-21T08:10:06.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.525+0000 7f78acc83640 1 -- 172.21.15.107:0/601686590 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f789006e530 msgr2=0x7f78900709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:06.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.525+0000 7f78acc83640 1 --2- 172.21.15.107:0/601686590 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f789006e530 0x7f78900709e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7898004fd0 tx=0x7f7898009040 comp rx=0 tx=0).stop 2024-09-21T08:10:06.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.525+0000 7f78acc83640 1 -- 172.21.15.107:0/601686590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78a80fcf80 msgr2=0x7f78a810c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:06.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.525+0000 7f78acc83640 1 --2- 172.21.15.107:0/601686590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78a80fcf80 0x7f78a810c4c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f789c000c00 tx=0x7f789c009da0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.525+0000 7f78acc83640 1 -- 172.21.15.107:0/601686590 shutdown_connections 2024-09-21T08:10:06.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.525+0000 7f78acc83640 1 --2- 172.21.15.107:0/601686590 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f789006e530 0x7f78900709e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.525+0000 7f78acc83640 1 --2- 172.21.15.107:0/601686590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78a80fcf80 0x7f78a810c4c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.525+0000 7f78acc83640 1 --2- 172.21.15.107:0/601686590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f78a80fb810 0x7f78a810bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.525+0000 7f78acc83640 1 -- 172.21.15.107:0/601686590 >> 172.21.15.107:0/601686590 conn(0x7f78a80723b0 msgr2=0x7f78a80fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:06.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.525+0000 7f78acc83640 1 -- 172.21.15.107:0/601686590 shutdown_connections 2024-09-21T08:10:06.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.525+0000 7f78acc83640 1 -- 172.21.15.107:0/601686590 wait complete. 2024-09-21T08:10:06.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.604+0000 7f8b29b95640 1 -- 172.21.15.107:0/3197756900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b240fdf00 msgr2=0x7f8b241065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:06.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.604+0000 7f8b29b95640 1 --2- 172.21.15.107:0/3197756900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b240fdf00 0x7f8b241065d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8b18004900 tx=0x7f8b18009da0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.604+0000 7f8b29b95640 1 -- 172.21.15.107:0/3197756900 shutdown_connections 2024-09-21T08:10:06.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.604+0000 7f8b29b95640 1 --2- 172.21.15.107:0/3197756900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b240fdf00 0x7f8b241065d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.604+0000 7f8b29b95640 1 --2- 172.21.15.107:0/3197756900 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8b240fd560 0x7f8b240fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.604+0000 7f8b29b95640 1 -- 172.21.15.107:0/3197756900 >> 172.21.15.107:0/3197756900 conn(0x7f8b240f7060 msgr2=0x7f8b240f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:06.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.604+0000 7f8b29b95640 1 -- 172.21.15.107:0/3197756900 shutdown_connections 2024-09-21T08:10:06.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.604+0000 7f8b29b95640 1 -- 172.21.15.107:0/3197756900 wait complete. 2024-09-21T08:10:06.607 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:06 smithi107 ceph-mon[97757]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:10:06.607 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:06 smithi107 ceph-mon[97757]: osdmap e80: 6 total, 5 up, 6 in 2024-09-21T08:10:06.607 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:06 smithi107 ceph-mon[97757]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:10:06.607 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:06 smithi107 ceph-mon[97757]: pgmap v159: 65 pgs: 1 active+clean+remapped, 9 remapped+peering, 15 active+undersized, 12 active+undersized+degraded, 28 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 30/219 objects degraded (13.699%); 3/219 objects misplaced (1.370%) 2024-09-21T08:10:06.607 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:06 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:06.607 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:06 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:06.607 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:06 smithi107 ceph-mon[97757]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:10:06.607 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:06 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/4126709333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:06.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.605+0000 7f8b29b95640 1 Processor -- start 2024-09-21T08:10:06.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.605+0000 7f8b29b95640 1 -- start start 2024-09-21T08:10:06.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.605+0000 7f8b29b95640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b240fd560 0x7f8b240fb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:06.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.605+0000 7f8b29b95640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8b240fdf00 0x7f8b240fb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:06.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.605+0000 7f8b29b95640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b240fbf30 con 0x7f8b240fd560 2024-09-21T08:10:06.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.605+0000 7f8b29b95640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b240fc0a0 con 0x7f8b240fdf00 2024-09-21T08:10:06.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.605+0000 7f8b237fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b240fd560 0x7f8b240fb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:06.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.605+0000 7f8b237fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b240fd560 0x7f8b240fb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49564/0 (socket says 172.21.15.107:49564) 2024-09-21T08:10:06.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.605+0000 7f8b237fe640 1 -- 172.21.15.107:0/3513724545 learned_addr learned my addr 172.21.15.107:0/3513724545 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:10:06.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.605+0000 7f8b22ffd640 1 --2- 172.21.15.107:0/3513724545 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8b240fdf00 0x7f8b240fb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:06.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.606+0000 7f8b237fe640 1 -- 172.21.15.107:0/3513724545 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8b240fdf00 msgr2=0x7f8b240fb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:06.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.606+0000 7f8b237fe640 1 --2- 172.21.15.107:0/3513724545 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8b240fdf00 0x7f8b240fb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.606+0000 7f8b237fe640 1 -- 172.21.15.107:0/3513724545 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b18005040 con 0x7f8b240fd560 2024-09-21T08:10:06.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.606+0000 7f8b237fe640 1 --2- 172.21.15.107:0/3513724545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b240fd560 0x7f8b240fb420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400b790 tx=0x7f8b140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:06.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.606+0000 7f8b0bfff640 1 -- 172.21.15.107:0/3513724545 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b1400c700 con 0x7f8b240fd560 2024-09-21T08:10:06.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.606+0000 7f8b0bfff640 1 -- 172.21.15.107:0/3513724545 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8b1400cd00 con 0x7f8b240fd560 2024-09-21T08:10:06.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.606+0000 7f8b29b95640 1 -- 172.21.15.107:0/3513724545 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b24119610 con 0x7f8b240fd560 2024-09-21T08:10:06.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.606+0000 7f8b0bfff640 1 -- 172.21.15.107:0/3513724545 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b14015e80 con 0x7f8b240fd560 2024-09-21T08:10:06.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.606+0000 7f8b29b95640 1 -- 172.21.15.107:0/3513724545 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b24119a50 con 0x7f8b240fd560 2024-09-21T08:10:06.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.607+0000 7f8b29b95640 1 -- 172.21.15.107:0/3513724545 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b240662f0 con 0x7f8b240fd560 2024-09-21T08:10:06.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.607+0000 7f8b0bfff640 1 -- 172.21.15.107:0/3513724545 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8b14012070 con 0x7f8b240fd560 2024-09-21T08:10:06.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.608+0000 7f8b0bfff640 1 --2- 172.21.15.107:0/3513724545 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f8b0c06e530 0x7f8b0c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:06.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.608+0000 7f8b0bfff640 1 -- 172.21.15.107:0/3513724545 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6911+0+0 (secure 0 0 0) 0x7f8b1408dc00 con 0x7f8b240fd560 2024-09-21T08:10:06.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.608+0000 7f8b22ffd640 1 --2- 172.21.15.107:0/3513724545 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f8b0c06e530 0x7f8b0c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:06.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.609+0000 7f8b22ffd640 1 --2- 172.21.15.107:0/3513724545 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f8b0c06e530 0x7f8b0c0709e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8b18004540 tx=0x7f8b18035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:06.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.612+0000 7f8b0bfff640 1 -- 172.21.15.107:0/3513724545 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8b14093020 con 0x7f8b240fd560 2024-09-21T08:10:06.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:06 smithi129 ceph-mon[76722]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:10:06.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:06 smithi129 ceph-mon[76722]: osdmap e80: 6 total, 5 up, 6 in 2024-09-21T08:10:06.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:06 smithi129 ceph-mon[76722]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:10:06.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:06 smithi129 ceph-mon[76722]: pgmap v159: 65 pgs: 1 active+clean+remapped, 9 remapped+peering, 15 active+undersized, 12 active+undersized+degraded, 28 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 30/219 objects degraded (13.699%); 3/219 objects misplaced (1.370%) 2024-09-21T08:10:06.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:06 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:06.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:06 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:06.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:06 smithi129 ceph-mon[76722]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:10:06.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:06 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/4126709333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:06.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.794+0000 7f8b29b95640 1 -- 172.21.15.107:0/3513724545 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b2404b7b0 con 0x7f8b0c06e530 2024-09-21T08:10:06.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.796+0000 7f8b0bfff640 1 -- 172.21.15.107:0/3513724545 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8b2404b7b0 con 0x7f8b0c06e530 2024-09-21T08:10:06.797 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:10:06.797 INFO:teuthology.orchestra.run.smithi107.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5", 2024-09-21T08:10:06.797 INFO:teuthology.orchestra.run.smithi107.stdout: "in_progress": true, 2024-09-21T08:10:06.797 INFO:teuthology.orchestra.run.smithi107.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T08:10:06.797 INFO:teuthology.orchestra.run.smithi107.stdout: "services_complete": [ 2024-09-21T08:10:06.797 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr", 2024-09-21T08:10:06.797 INFO:teuthology.orchestra.run.smithi107.stdout: "mon", 2024-09-21T08:10:06.797 INFO:teuthology.orchestra.run.smithi107.stdout: "osd", 2024-09-21T08:10:06.797 INFO:teuthology.orchestra.run.smithi107.stdout: "crash" 2024-09-21T08:10:06.798 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-21T08:10:06.798 INFO:teuthology.orchestra.run.smithi107.stdout: "progress": "12/21 daemons upgraded", 2024-09-21T08:10:06.798 INFO:teuthology.orchestra.run.smithi107.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T08:10:06.798 INFO:teuthology.orchestra.run.smithi107.stdout: "is_paused": false 2024-09-21T08:10:06.798 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:10:06.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.798+0000 7f8b29b95640 1 -- 172.21.15.107:0/3513724545 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f8b0c06e530 msgr2=0x7f8b0c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:06.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.798+0000 7f8b29b95640 1 --2- 172.21.15.107:0/3513724545 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f8b0c06e530 0x7f8b0c0709e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8b18004540 tx=0x7f8b18035040 comp rx=0 tx=0).stop 2024-09-21T08:10:06.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.798+0000 7f8b29b95640 1 -- 172.21.15.107:0/3513724545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b240fd560 msgr2=0x7f8b240fb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:06.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.798+0000 7f8b29b95640 1 --2- 172.21.15.107:0/3513724545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b240fd560 0x7f8b240fb420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400b790 tx=0x7f8b140091d0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.798+0000 7f8b29b95640 1 -- 172.21.15.107:0/3513724545 shutdown_connections 2024-09-21T08:10:06.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.798+0000 7f8b29b95640 1 --2- 172.21.15.107:0/3513724545 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f8b0c06e530 0x7f8b0c0709e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.798+0000 7f8b29b95640 1 --2- 172.21.15.107:0/3513724545 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8b240fdf00 0x7f8b240fb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.798+0000 7f8b29b95640 1 --2- 172.21.15.107:0/3513724545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b240fd560 0x7f8b240fb420 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.798+0000 7f8b29b95640 1 -- 172.21.15.107:0/3513724545 >> 172.21.15.107:0/3513724545 conn(0x7f8b240f7060 msgr2=0x7f8b240f85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:06.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.798+0000 7f8b29b95640 1 -- 172.21.15.107:0/3513724545 shutdown_connections 2024-09-21T08:10:06.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.798+0000 7f8b29b95640 1 -- 172.21.15.107:0/3513724545 wait complete. 2024-09-21T08:10:06.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.875+0000 7f1e6b10d640 1 -- 172.21.15.107:0/3641228891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e64064fc0 msgr2=0x7f1e64065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:06.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.875+0000 7f1e6b10d640 1 --2- 172.21.15.107:0/3641228891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e64064fc0 0x7f1e64065430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1e580048d0 tx=0x7f1e58009da0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.875+0000 7f1e6b10d640 1 -- 172.21.15.107:0/3641228891 shutdown_connections 2024-09-21T08:10:06.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.875+0000 7f1e6b10d640 1 --2- 172.21.15.107:0/3641228891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e64064fc0 0x7f1e64065430 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.875+0000 7f1e6b10d640 1 --2- 172.21.15.107:0/3641228891 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e640fe460 0x7f1e640fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.875+0000 7f1e6b10d640 1 -- 172.21.15.107:0/3641228891 >> 172.21.15.107:0/3641228891 conn(0x7f1e640723b0 msgr2=0x7f1e640727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:06.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.876+0000 7f1e6b10d640 1 -- 172.21.15.107:0/3641228891 shutdown_connections 2024-09-21T08:10:06.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.876+0000 7f1e6b10d640 1 -- 172.21.15.107:0/3641228891 wait complete. 2024-09-21T08:10:06.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.876+0000 7f1e6b10d640 1 Processor -- start 2024-09-21T08:10:06.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.876+0000 7f1e6b10d640 1 -- start start 2024-09-21T08:10:06.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.876+0000 7f1e6b10d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e64064fc0 0x7f1e640fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:06.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.876+0000 7f1e6b10d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e640fe460 0x7f1e640fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:06.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.877+0000 7f1e6b10d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640fbfe0 con 0x7f1e640fe460 2024-09-21T08:10:06.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.877+0000 7f1e6b10d640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640fc150 con 0x7f1e64064fc0 2024-09-21T08:10:06.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.877+0000 7f1e63fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e640fe460 0x7f1e640fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:06.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.877+0000 7f1e63fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e640fe460 0x7f1e640fbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49584/0 (socket says 172.21.15.107:49584) 2024-09-21T08:10:06.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.877+0000 7f1e63fff640 1 -- 172.21.15.107:0/221411061 learned_addr learned my addr 172.21.15.107:0/221411061 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:10:06.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.877+0000 7f1e68ea9640 1 --2- 172.21.15.107:0/221411061 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e64064fc0 0x7f1e640fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:06.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.877+0000 7f1e63fff640 1 -- 172.21.15.107:0/221411061 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e64064fc0 msgr2=0x7f1e640fb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:06.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.877+0000 7f1e63fff640 1 --2- 172.21.15.107:0/221411061 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e64064fc0 0x7f1e640fb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:06.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.877+0000 7f1e63fff640 1 -- 172.21.15.107:0/221411061 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e58005040 con 0x7f1e640fe460 2024-09-21T08:10:06.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.877+0000 7f1e63fff640 1 --2- 172.21.15.107:0/221411061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e640fe460 0x7f1e640fbaa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1e58000c00 tx=0x7f1e58009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:06.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.877+0000 7f1e617fa640 1 -- 172.21.15.107:0/221411061 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e58038070 con 0x7f1e640fe460 2024-09-21T08:10:06.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.877+0000 7f1e6b10d640 1 -- 172.21.15.107:0/221411061 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e640fc3d0 con 0x7f1e640fe460 2024-09-21T08:10:06.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.877+0000 7f1e617fa640 1 -- 172.21.15.107:0/221411061 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1e5802ade0 con 0x7f1e640fe460 2024-09-21T08:10:06.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.877+0000 7f1e617fa640 1 -- 172.21.15.107:0/221411061 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e5802c7e0 con 0x7f1e640fe460 2024-09-21T08:10:06.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.878+0000 7f1e6b10d640 1 -- 172.21.15.107:0/221411061 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e64119870 con 0x7f1e640fe460 2024-09-21T08:10:06.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.878+0000 7f1e6b10d640 1 -- 172.21.15.107:0/221411061 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e640fdcf0 con 0x7f1e640fe460 2024-09-21T08:10:06.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.879+0000 7f1e617fa640 1 -- 172.21.15.107:0/221411061 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1e58030020 con 0x7f1e640fe460 2024-09-21T08:10:06.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.880+0000 7f1e617fa640 1 --2- 172.21.15.107:0/221411061 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1e4c06e530 0x7f1e4c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:06.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.880+0000 7f1e617fa640 1 -- 172.21.15.107:0/221411061 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6911+0+0 (secure 0 0 0) 0x7f1e580adde0 con 0x7f1e640fe460 2024-09-21T08:10:06.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.880+0000 7f1e68ea9640 1 --2- 172.21.15.107:0/221411061 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1e4c06e530 0x7f1e4c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:06.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.880+0000 7f1e68ea9640 1 --2- 172.21.15.107:0/221411061 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1e4c06e530 0x7f1e4c0709e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1e54004ed0 tx=0x7f1e5400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:06.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:06.884+0000 7f1e617fa640 1 -- 172.21.15.107:0/221411061 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1e58076de0 con 0x7f1e640fe460 2024-09-21T08:10:07.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:07.115+0000 7f1e6b10d640 1 -- 172.21.15.107:0/221411061 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1e640fc3d0 con 0x7f1e640fe460 2024-09-21T08:10:07.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:07.115+0000 7f1e617fa640 1 -- 172.21.15.107:0/221411061 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1371 (secure 0 0 0) 0x7f1e640fc3d0 con 0x7f1e640fe460 2024-09-21T08:10:07.117 INFO:teuthology.orchestra.run.smithi107.stdout:HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Reduced data availability: 1 pg peering; Degraded data redundancy: 30/219 objects degraded (13.699%), 12 pgs degraded 2024-09-21T08:10:07.117 INFO:teuthology.orchestra.run.smithi107.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T08:10:07.117 INFO:teuthology.orchestra.run.smithi107.stdout: osd.5 (root=default,host=smithi129) is down 2024-09-21T08:10:07.117 INFO:teuthology.orchestra.run.smithi107.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-21T08:10:07.117 INFO:teuthology.orchestra.run.smithi107.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-21T08:10:07.117 INFO:teuthology.orchestra.run.smithi107.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 1 pg peering 2024-09-21T08:10:07.117 INFO:teuthology.orchestra.run.smithi107.stdout: pg 3.0 is stuck peering for 2m, current state remapped+peering, last acting [2,4,1] 2024-09-21T08:10:07.117 INFO:teuthology.orchestra.run.smithi107.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 30/219 objects degraded (13.699%), 12 pgs degraded 2024-09-21T08:10:07.117 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-21T08:10:07.117 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-21T08:10:07.118 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-21T08:10:07.118 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-21T08:10:07.118 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-09-21T08:10:07.118 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-21T08:10:07.118 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-21T08:10:07.118 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-21T08:10:07.118 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-09-21T08:10:07.118 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-21T08:10:07.118 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-09-21T08:10:07.118 INFO:teuthology.orchestra.run.smithi107.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-09-21T08:10:07.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:07.117+0000 7f1e6b10d640 1 -- 172.21.15.107:0/221411061 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1e4c06e530 msgr2=0x7f1e4c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:07.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:07.117+0000 7f1e6b10d640 1 --2- 172.21.15.107:0/221411061 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1e4c06e530 0x7f1e4c0709e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1e54004ed0 tx=0x7f1e5400b040 comp rx=0 tx=0).stop 2024-09-21T08:10:07.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:07.117+0000 7f1e6b10d640 1 -- 172.21.15.107:0/221411061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e640fe460 msgr2=0x7f1e640fbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:07.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:07.117+0000 7f1e6b10d640 1 --2- 172.21.15.107:0/221411061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e640fe460 0x7f1e640fbaa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1e58000c00 tx=0x7f1e58009da0 comp rx=0 tx=0).stop 2024-09-21T08:10:07.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:07.117+0000 7f1e6b10d640 1 -- 172.21.15.107:0/221411061 shutdown_connections 2024-09-21T08:10:07.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:07.117+0000 7f1e6b10d640 1 --2- 172.21.15.107:0/221411061 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1e4c06e530 0x7f1e4c0709e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:07.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:07.117+0000 7f1e6b10d640 1 --2- 172.21.15.107:0/221411061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e640fe460 0x7f1e640fbaa0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:07.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:07.117+0000 7f1e6b10d640 1 --2- 172.21.15.107:0/221411061 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e64064fc0 0x7f1e640fb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:07.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:07.117+0000 7f1e6b10d640 1 -- 172.21.15.107:0/221411061 >> 172.21.15.107:0/221411061 conn(0x7f1e640723b0 msgr2=0x7f1e641053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:07.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:07.117+0000 7f1e6b10d640 1 -- 172.21.15.107:0/221411061 shutdown_connections 2024-09-21T08:10:07.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:07.117+0000 7f1e6b10d640 1 -- 172.21.15.107:0/221411061 wait complete. 2024-09-21T08:10:07.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:07 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/601686590' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:10:07.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:07 smithi129 ceph-mon[76722]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:10:07.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:07 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/221411061' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:10:07.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:07 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/601686590' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:10:07.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:07 smithi107 ceph-mon[97757]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:10:07.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:07 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/221411061' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:10:08.421 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:08 smithi129 ceph-mon[76722]: pgmap v160: 65 pgs: 9 active+clean+remapped, 15 active+undersized, 12 active+undersized+degraded, 29 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 30/219 objects degraded (13.699%); 7/219 objects misplaced (3.196%); 0 B/s, 235 objects/s recovering 2024-09-21T08:10:08.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:08 smithi107 ceph-mon[97757]: pgmap v160: 65 pgs: 9 active+clean+remapped, 15 active+undersized, 12 active+undersized+degraded, 29 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 30/219 objects degraded (13.699%); 7/219 objects misplaced (3.196%); 0 B/s, 235 objects/s recovering 2024-09-21T08:10:09.766 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:10:09.551+0000 7fc99579d640 -1 osd.5 72 log_to_monitors true 2024-09-21T08:10:09.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T08:10:09.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: Health check update: Degraded data redundancy: 30/219 objects degraded (13.699%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T08:10:09.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:09.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:09.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:10:09.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:10:09.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:09.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:10:09.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:09.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:09.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:09.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:09.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: Upgrade: Setting container_image for all osd 2024-09-21T08:10:09.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:09.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-21T08:10:09.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-21T08:10:09.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-21T08:10:09.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-21T08:10:09.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-21T08:10:09.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-21T08:10:09.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-21T08:10:09.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-21T08:10:09.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-21T08:10:09.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-21T08:10:09.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-21T08:10:09.768 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-21T08:10:09.769 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: Upgrade: Setting require_osd_release to 19 squid 2024-09-21T08:10:09.769 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:09 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-21T08:10:09.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T08:10:09.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: Health check update: Degraded data redundancy: 30/219 objects degraded (13.699%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T08:10:09.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:09.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:09.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:10:09.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:10:09.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:09.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:10:09.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:09.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:09.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:09.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:09.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: Upgrade: Setting container_image for all osd 2024-09-21T08:10:09.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:09.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-21T08:10:09.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-21T08:10:09.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-21T08:10:09.805 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-21T08:10:09.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-21T08:10:09.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-21T08:10:09.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-21T08:10:09.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-21T08:10:09.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-21T08:10:09.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-21T08:10:09.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-21T08:10:09.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-21T08:10:09.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: Upgrade: Setting require_osd_release to 19 squid 2024-09-21T08:10:09.806 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:09 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-21T08:10:10.560 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:10 smithi107 ceph-mon[97757]: from='osd.5 [v2:172.21.15.129:6816/2128065089,v1:172.21.15.129:6817/2128065089]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T08:10:10.560 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:10 smithi107 ceph-mon[97757]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T08:10:10.560 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:10 smithi107 ceph-mon[97757]: pgmap v161: 65 pgs: 9 active+clean+remapped, 15 active+undersized, 12 active+undersized+degraded, 29 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 30/219 objects degraded (13.699%); 7/219 objects misplaced (3.196%); 0 B/s, 222 objects/s recovering 2024-09-21T08:10:10.560 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:10 smithi107 ceph-mon[97757]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-21T08:10:10.561 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:10 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-21T08:10:10.561 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:10 smithi107 ceph-mon[97757]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T08:10:10.561 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:10 smithi107 ceph-mon[97757]: from='osd.5 [v2:172.21.15.129:6816/2128065089,v1:172.21.15.129:6817/2128065089]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T08:10:10.561 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:10 smithi107 ceph-mon[97757]: osdmap e81: 6 total, 5 up, 6 in 2024-09-21T08:10:10.561 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:10 smithi107 ceph-mon[97757]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T08:10:10.713 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:10 smithi129 ceph-mon[76722]: from='osd.5 [v2:172.21.15.129:6816/2128065089,v1:172.21.15.129:6817/2128065089]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T08:10:10.713 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:10 smithi129 ceph-mon[76722]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T08:10:10.713 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:10 smithi129 ceph-mon[76722]: pgmap v161: 65 pgs: 9 active+clean+remapped, 15 active+undersized, 12 active+undersized+degraded, 29 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 30/219 objects degraded (13.699%); 7/219 objects misplaced (3.196%); 0 B/s, 222 objects/s recovering 2024-09-21T08:10:10.713 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:10 smithi129 ceph-mon[76722]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-21T08:10:10.713 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:10 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-21T08:10:10.713 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:10 smithi129 ceph-mon[76722]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T08:10:10.713 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:10 smithi129 ceph-mon[76722]: from='osd.5 [v2:172.21.15.129:6816/2128065089,v1:172.21.15.129:6817/2128065089]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T08:10:10.713 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:10 smithi129 ceph-mon[76722]: osdmap e81: 6 total, 5 up, 6 in 2024-09-21T08:10:10.713 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:10 smithi129 ceph-mon[76722]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]: dispatch 2024-09-21T08:10:11.016 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:10:10 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:10:10.711+0000 7fc98952f640 -1 osd.5 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T08:10:11.880 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:11 smithi107 ceph-mon[97757]: from='osd.5 ' entity='osd.5' 2024-09-21T08:10:11.881 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:11 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:11.881 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:11 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.qusoyf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:10:11.881 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:11 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:10:12.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:11 smithi129 ceph-mon[76722]: from='osd.5 ' entity='osd.5' 2024-09-21T08:10:12.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:11 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:12.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:11 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.qusoyf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:10:12.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:11 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:10:12.977 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:12 smithi107 ceph-mon[97757]: Upgrade: Updating mds.cephfs.smithi107.qusoyf 2024-09-21T08:10:12.977 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:12 smithi107 ceph-mon[97757]: Deploying daemon mds.cephfs.smithi107.qusoyf on smithi107 2024-09-21T08:10:12.977 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:12 smithi107 ceph-mon[97757]: pgmap v163: 65 pgs: 9 active+clean+remapped, 15 active+undersized, 12 active+undersized+degraded, 29 active+clean; 199 MiB data, 813 MiB used, 536 GiB / 536 GiB avail; 30/219 objects degraded (13.699%); 7/219 objects misplaced (3.196%); 0 B/s, 191 objects/s recovering 2024-09-21T08:10:12.978 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:12 smithi107 ceph-mon[97757]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T08:10:12.978 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:12 smithi107 ceph-mon[97757]: osd.5 [v2:172.21.15.129:6816/2128065089,v1:172.21.15.129:6817/2128065089] boot 2024-09-21T08:10:12.978 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:12 smithi107 ceph-mon[97757]: osdmap e82: 6 total, 6 up, 6 in 2024-09-21T08:10:12.978 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:12 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T08:10:12.978 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:12 smithi107 ceph-mon[97757]: osdmap e83: 6 total, 6 up, 6 in 2024-09-21T08:10:13.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:12 smithi129 ceph-mon[76722]: Upgrade: Updating mds.cephfs.smithi107.qusoyf 2024-09-21T08:10:13.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:12 smithi129 ceph-mon[76722]: Deploying daemon mds.cephfs.smithi107.qusoyf on smithi107 2024-09-21T08:10:13.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:12 smithi129 ceph-mon[76722]: pgmap v163: 65 pgs: 9 active+clean+remapped, 15 active+undersized, 12 active+undersized+degraded, 29 active+clean; 199 MiB data, 813 MiB used, 536 GiB / 536 GiB avail; 30/219 objects degraded (13.699%); 7/219 objects misplaced (3.196%); 0 B/s, 191 objects/s recovering 2024-09-21T08:10:13.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:12 smithi129 ceph-mon[76722]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T08:10:13.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:12 smithi129 ceph-mon[76722]: osd.5 [v2:172.21.15.129:6816/2128065089,v1:172.21.15.129:6817/2128065089] boot 2024-09-21T08:10:13.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:12 smithi129 ceph-mon[76722]: osdmap e82: 6 total, 6 up, 6 in 2024-09-21T08:10:13.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:12 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T08:10:13.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:12 smithi129 ceph-mon[76722]: osdmap e83: 6 total, 6 up, 6 in 2024-09-21T08:10:14.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:13 smithi107 ceph-mon[97757]: Health check update: Degraded data redundancy: 27/219 objects degraded (12.329%), 10 pgs degraded (PG_DEGRADED) 2024-09-21T08:10:14.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:13 smithi107 ceph-mon[97757]: osdmap e84: 6 total, 6 up, 6 in 2024-09-21T08:10:14.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:13 smithi107 ceph-mon[97757]: fsmap cephfs:1 {0=cephfs.smithi107.grqzkt=up:active} 2 up:standby 2024-09-21T08:10:14.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:13 smithi129 ceph-mon[76722]: Health check update: Degraded data redundancy: 27/219 objects degraded (12.329%), 10 pgs degraded (PG_DEGRADED) 2024-09-21T08:10:14.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:13 smithi129 ceph-mon[76722]: osdmap e84: 6 total, 6 up, 6 in 2024-09-21T08:10:14.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:13 smithi129 ceph-mon[76722]: fsmap cephfs:1 {0=cephfs.smithi107.grqzkt=up:active} 2 up:standby 2024-09-21T08:10:15.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:14 smithi107 ceph-mon[97757]: pgmap v166: 65 pgs: 1 remapped+peering, 8 active+clean+remapped, 14 active+undersized, 10 active+undersized+degraded, 32 active+clean; 199 MiB data, 813 MiB used, 536 GiB / 536 GiB avail; 27/219 objects degraded (12.329%); 4/219 objects misplaced (1.826%) 2024-09-21T08:10:15.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:14 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:15.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:14 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:10:15.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:14 smithi129 ceph-mon[76722]: pgmap v166: 65 pgs: 1 remapped+peering, 8 active+clean+remapped, 14 active+undersized, 10 active+undersized+degraded, 32 active+clean; 199 MiB data, 813 MiB used, 536 GiB / 536 GiB avail; 27/219 objects degraded (12.329%); 4/219 objects misplaced (1.826%) 2024-09-21T08:10:15.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:14 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:15.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:14 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:10:16.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:15 smithi107 ceph-mon[97757]: osdmap e85: 6 total, 6 up, 6 in 2024-09-21T08:10:16.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:15 smithi107 ceph-mon[97757]: osdmap e86: 6 total, 6 up, 6 in 2024-09-21T08:10:16.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:15 smithi129 ceph-mon[76722]: osdmap e85: 6 total, 6 up, 6 in 2024-09-21T08:10:16.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:15 smithi129 ceph-mon[76722]: osdmap e86: 6 total, 6 up, 6 in 2024-09-21T08:10:16.798 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:16 smithi107 ceph-mon[97757]: pgmap v169: 65 pgs: 2 peering, 6 active+clean+remapped, 6 active+undersized, 6 active+undersized+degraded, 45 active+clean; 199 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 19/219 objects degraded (8.676%); 3/219 objects misplaced (1.370%) 2024-09-21T08:10:16.814 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:16 smithi107 ceph-mon[97757]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-21T08:10:16.814 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:16 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:17.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:16 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:17.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:16 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:10:17.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:16 smithi107 ceph-mon[97757]: osdmap e87: 6 total, 6 up, 6 in 2024-09-21T08:10:17.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:16 smithi129 ceph-mon[76722]: pgmap v169: 65 pgs: 2 peering, 6 active+clean+remapped, 6 active+undersized, 6 active+undersized+degraded, 45 active+clean; 199 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 19/219 objects degraded (8.676%); 3/219 objects misplaced (1.370%) 2024-09-21T08:10:17.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:16 smithi129 ceph-mon[76722]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-21T08:10:17.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:16 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:17.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:16 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:17.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:16 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:10:17.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:16 smithi129 ceph-mon[76722]: osdmap e87: 6 total, 6 up, 6 in 2024-09-21T08:10:18.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:17 smithi107 ceph-mon[97757]: mds.? [v2:172.21.15.107:6826/3638073096,v1:172.21.15.107:6827/3638073096] up:boot 2024-09-21T08:10:18.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:17 smithi107 ceph-mon[97757]: fsmap cephfs:1 {0=cephfs.smithi107.grqzkt=up:active} 3 up:standby 2024-09-21T08:10:18.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:17 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.qusoyf"}]: dispatch 2024-09-21T08:10:18.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:17 smithi107 ceph-mon[97757]: osdmap e88: 6 total, 6 up, 6 in 2024-09-21T08:10:18.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:17 smithi129 ceph-mon[76722]: mds.? [v2:172.21.15.107:6826/3638073096,v1:172.21.15.107:6827/3638073096] up:boot 2024-09-21T08:10:18.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:17 smithi129 ceph-mon[76722]: fsmap cephfs:1 {0=cephfs.smithi107.grqzkt=up:active} 3 up:standby 2024-09-21T08:10:18.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:17 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.qusoyf"}]: dispatch 2024-09-21T08:10:18.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:17 smithi129 ceph-mon[76722]: osdmap e88: 6 total, 6 up, 6 in 2024-09-21T08:10:19.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:18 smithi107 ceph-mon[97757]: pgmap v172: 65 pgs: 1 active+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 3 peering, 59 active+clean; 199 MiB data, 833 MiB used, 536 GiB / 536 GiB avail; 1443/219 objects degraded (658.904%); 1024 KiB/s, 0 keys/s, 190 objects/s recovering 2024-09-21T08:10:19.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:18 smithi107 ceph-mon[97757]: osdmap e89: 6 total, 6 up, 6 in 2024-09-21T08:10:19.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:18 smithi129 ceph-mon[76722]: pgmap v172: 65 pgs: 1 active+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 3 peering, 59 active+clean; 199 MiB data, 833 MiB used, 536 GiB / 536 GiB avail; 1443/219 objects degraded (658.904%); 1024 KiB/s, 0 keys/s, 190 objects/s recovering 2024-09-21T08:10:19.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:18 smithi129 ceph-mon[76722]: osdmap e89: 6 total, 6 up, 6 in 2024-09-21T08:10:21.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:20 smithi107 ceph-mon[97757]: pgmap v175: 65 pgs: 1 active+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 3 peering, 59 active+clean; 199 MiB data, 833 MiB used, 536 GiB / 536 GiB avail; 1443/219 objects degraded (658.904%); 1024 KiB/s, 0 keys/s, 373 objects/s recovering 2024-09-21T08:10:21.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:20 smithi107 ceph-mon[97757]: osdmap e90: 6 total, 6 up, 6 in 2024-09-21T08:10:21.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:20 smithi129 ceph-mon[76722]: pgmap v175: 65 pgs: 1 active+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 3 peering, 59 active+clean; 199 MiB data, 833 MiB used, 536 GiB / 536 GiB avail; 1443/219 objects degraded (658.904%); 1024 KiB/s, 0 keys/s, 373 objects/s recovering 2024-09-21T08:10:21.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:20 smithi129 ceph-mon[76722]: osdmap e90: 6 total, 6 up, 6 in 2024-09-21T08:10:22.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:21 smithi107 ceph-mon[97757]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T08:10:22.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:21 smithi107 ceph-mon[97757]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1443/219 objects degraded (658.904%), 2 pgs degraded) 2024-09-21T08:10:22.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:21 smithi107 ceph-mon[97757]: Cluster is now healthy 2024-09-21T08:10:22.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:21 smithi129 ceph-mon[76722]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T08:10:22.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:21 smithi129 ceph-mon[76722]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1443/219 objects degraded (658.904%), 2 pgs degraded) 2024-09-21T08:10:22.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:21 smithi129 ceph-mon[76722]: Cluster is now healthy 2024-09-21T08:10:23.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:22 smithi129 ceph-mon[76722]: pgmap v177: 65 pgs: 1 active+undersized+remapped, 64 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 296 objects/s recovering 2024-09-21T08:10:23.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:22 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:23.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:22 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:23.282 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:22 smithi107 ceph-mon[97757]: pgmap v177: 65 pgs: 1 active+undersized+remapped, 64 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 296 objects/s recovering 2024-09-21T08:10:23.282 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:22 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:23.282 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:22 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:24.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:23 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:24.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:23 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:24.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:23 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:24.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:23 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:25.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:24 smithi129 ceph-mon[76722]: pgmap v178: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 240 objects/s recovering 2024-09-21T08:10:25.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:24 smithi107 ceph-mon[97757]: pgmap v178: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 240 objects/s recovering 2024-09-21T08:10:27.090 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:26 smithi107 ceph-mon[97757]: pgmap v179: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 183 objects/s recovering 2024-09-21T08:10:27.090 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:26 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:27.090 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:26 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:27.090 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:26 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:10:27.090 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:26 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:10:27.090 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:26 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:27.091 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:26 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:10:27.091 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:26 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:27.091 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:26 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:27.091 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:26 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:27.091 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:26 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:27.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:26 smithi129 ceph-mon[76722]: pgmap v179: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 183 objects/s recovering 2024-09-21T08:10:27.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:26 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:27.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:26 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:27.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:26 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:10:27.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:26 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:10:27.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:26 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:27.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:26 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:10:27.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:26 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:27.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:26 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:27.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:26 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:27.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:26 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:29.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:28 smithi129 ceph-mon[76722]: pgmap v180: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 162 objects/s recovering 2024-09-21T08:10:29.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:28 smithi129 ceph-mon[76722]: Upgrade: Updating mds.cephfs.smithi107.grqzkt 2024-09-21T08:10:29.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:29.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.grqzkt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:10:29.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:10:29.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:28 smithi129 ceph-mon[76722]: Deploying daemon mds.cephfs.smithi107.grqzkt on smithi107 2024-09-21T08:10:29.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:28 smithi107 ceph-mon[97757]: pgmap v180: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 162 objects/s recovering 2024-09-21T08:10:29.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:28 smithi107 ceph-mon[97757]: Upgrade: Updating mds.cephfs.smithi107.grqzkt 2024-09-21T08:10:29.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:29.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.grqzkt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:10:29.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:10:29.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:28 smithi107 ceph-mon[97757]: Deploying daemon mds.cephfs.smithi107.grqzkt on smithi107 2024-09-21T08:10:30.266 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:10:29 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3[85557]: 2024-09-21T08:10:29.987+0000 7fc451b64640 -1 bdev(0x5563465a2c00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-09-21T08:10:30.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:29 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107[97753]: 2024-09-21T08:10:29.959+0000 7f7e9585a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:10:31.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:30 smithi129 ceph-mon[76722]: pgmap v181: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 144 objects/s recovering 2024-09-21T08:10:31.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:30 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:31.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:30 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:10:31.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:30 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:31.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:30 smithi129 ceph-mon[76722]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T08:10:31.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:30 smithi129 ceph-mon[76722]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:10:31.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:30 smithi129 ceph-mon[76722]: osdmap e91: 6 total, 6 up, 6 in 2024-09-21T08:10:31.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:30 smithi129 ceph-mon[76722]: Standby daemon mds.cephfs.smithi129.fwmfcy assigned to filesystem cephfs as rank 0 2024-09-21T08:10:31.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:30 smithi129 ceph-mon[76722]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T08:10:31.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:30 smithi129 ceph-mon[76722]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T08:10:31.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:30 smithi129 ceph-mon[76722]: fsmap cephfs:1/1 {0=cephfs.smithi129.fwmfcy=up:replay} 2 up:standby 2024-09-21T08:10:31.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:30 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.grqzkt"}]: dispatch 2024-09-21T08:10:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:30 smithi107 ceph-mon[97757]: pgmap v181: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 144 objects/s recovering 2024-09-21T08:10:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:30 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:30 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:10:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:30 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:30 smithi107 ceph-mon[97757]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T08:10:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:30 smithi107 ceph-mon[97757]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:10:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:30 smithi107 ceph-mon[97757]: osdmap e91: 6 total, 6 up, 6 in 2024-09-21T08:10:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:30 smithi107 ceph-mon[97757]: Standby daemon mds.cephfs.smithi129.fwmfcy assigned to filesystem cephfs as rank 0 2024-09-21T08:10:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:30 smithi107 ceph-mon[97757]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T08:10:31.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:30 smithi107 ceph-mon[97757]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T08:10:31.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:30 smithi107 ceph-mon[97757]: fsmap cephfs:1/1 {0=cephfs.smithi129.fwmfcy=up:replay} 2 up:standby 2024-09-21T08:10:31.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:30 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.grqzkt"}]: dispatch 2024-09-21T08:10:33.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:32 smithi129 ceph-mon[76722]: pgmap v183: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 4.4 MiB/s rd, 1 op/s 2024-09-21T08:10:33.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:32 smithi107 ceph-mon[97757]: pgmap v183: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 4.4 MiB/s rd, 1 op/s 2024-09-21T08:10:35.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:34 smithi129 ceph-mon[76722]: pgmap v184: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 6.4 MiB/s rd, 2 op/s 2024-09-21T08:10:35.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:34 smithi107 ceph-mon[97757]: pgmap v184: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 6.4 MiB/s rd, 2 op/s 2024-09-21T08:10:37.006 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:36 smithi107 ceph-mon[97757]: pgmap v185: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-09-21T08:10:37.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:36 smithi129 ceph-mon[76722]: pgmap v185: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-09-21T08:10:37.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.208+0000 7f584e163640 1 -- 172.21.15.107:0/16718060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58481014c0 msgr2=0x7f5848101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:37.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.208+0000 7f584e163640 1 --2- 172.21.15.107:0/16718060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58481014c0 0x7f5848101890 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f58380048d0 tx=0x7f5838009da0 comp rx=0 tx=0).stop 2024-09-21T08:10:37.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.208+0000 7f584e163640 1 -- 172.21.15.107:0/16718060 shutdown_connections 2024-09-21T08:10:37.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.208+0000 7f584e163640 1 --2- 172.21.15.107:0/16718060 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58480fb480 0x7f58480fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:37.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.208+0000 7f584e163640 1 --2- 172.21.15.107:0/16718060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58481014c0 0x7f5848101890 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:37.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.208+0000 7f584e163640 1 -- 172.21.15.107:0/16718060 >> 172.21.15.107:0/16718060 conn(0x7f58480f7000 msgr2=0x7f58480f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:37.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.209+0000 7f584e163640 1 -- 172.21.15.107:0/16718060 shutdown_connections 2024-09-21T08:10:37.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.209+0000 7f584e163640 1 -- 172.21.15.107:0/16718060 wait complete. 2024-09-21T08:10:37.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.209+0000 7f584e163640 1 Processor -- start 2024-09-21T08:10:37.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.209+0000 7f584e163640 1 -- start start 2024-09-21T08:10:37.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.210+0000 7f584e163640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58480fb480 0x7f5848113260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:37.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.210+0000 7f584e163640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58481014c0 0x7f58481137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:37.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.210+0000 7f584e163640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5848113e30 con 0x7f58480fb480 2024-09-21T08:10:37.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.210+0000 7f584e163640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584810d1e0 con 0x7f58481014c0 2024-09-21T08:10:37.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.210+0000 7f58477fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58480fb480 0x7f5848113260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:37.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.210+0000 7f58477fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58480fb480 0x7f5848113260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35576/0 (socket says 172.21.15.107:35576) 2024-09-21T08:10:37.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.210+0000 7f58477fe640 1 -- 172.21.15.107:0/767017982 learned_addr learned my addr 172.21.15.107:0/767017982 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:10:37.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.210+0000 7f5846ffd640 1 --2- 172.21.15.107:0/767017982 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58481014c0 0x7f58481137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:37.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.210+0000 7f58477fe640 1 -- 172.21.15.107:0/767017982 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58481014c0 msgr2=0x7f58481137a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:37.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.210+0000 7f58477fe640 1 --2- 172.21.15.107:0/767017982 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58481014c0 0x7f58481137a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:37.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.210+0000 7f58477fe640 1 -- 172.21.15.107:0/767017982 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5838005040 con 0x7f58480fb480 2024-09-21T08:10:37.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.210+0000 7f58477fe640 1 --2- 172.21.15.107:0/767017982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58480fb480 0x7f5848113260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5838003080 tx=0x7f5838009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:37.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.211+0000 7f582ffff640 1 -- 172.21.15.107:0/767017982 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5838038070 con 0x7f58480fb480 2024-09-21T08:10:37.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.211+0000 7f582ffff640 1 -- 172.21.15.107:0/767017982 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f583802ade0 con 0x7f58480fb480 2024-09-21T08:10:37.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.211+0000 7f582ffff640 1 -- 172.21.15.107:0/767017982 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f583802c880 con 0x7f58480fb480 2024-09-21T08:10:37.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.211+0000 7f584e163640 1 -- 172.21.15.107:0/767017982 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584810d460 con 0x7f58480fb480 2024-09-21T08:10:37.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.211+0000 7f584e163640 1 -- 172.21.15.107:0/767017982 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584810d8c0 con 0x7f58480fb480 2024-09-21T08:10:37.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.212+0000 7f584e163640 1 -- 172.21.15.107:0/767017982 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58480fcbc0 con 0x7f58480fb480 2024-09-21T08:10:37.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.212+0000 7f582ffff640 1 -- 172.21.15.107:0/767017982 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5838030020 con 0x7f58480fb480 2024-09-21T08:10:37.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.213+0000 7f582ffff640 1 --2- 172.21.15.107:0/767017982 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f583006e530 0x7f58300709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:37.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.213+0000 7f582ffff640 1 -- 172.21.15.107:0/767017982 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f58380ae1d0 con 0x7f58480fb480 2024-09-21T08:10:37.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.213+0000 7f5846ffd640 1 --2- 172.21.15.107:0/767017982 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f583006e530 0x7f58300709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:37.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.213+0000 7f5846ffd640 1 --2- 172.21.15.107:0/767017982 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f583006e530 0x7f58300709e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f584810eb20 tx=0x7f583c009120 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:37.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.217+0000 7f582ffff640 1 -- 172.21.15.107:0/767017982 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f58380771f0 con 0x7f58480fb480 2024-09-21T08:10:37.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.406+0000 7f584e163640 1 -- 172.21.15.107:0/767017982 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f584810e8d0 con 0x7f583006e530 2024-09-21T08:10:37.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.407+0000 7f582ffff640 1 -- 172.21.15.107:0/767017982 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f584810e8d0 con 0x7f583006e530 2024-09-21T08:10:37.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.409+0000 7f584e163640 1 -- 172.21.15.107:0/767017982 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f583006e530 msgr2=0x7f58300709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:37.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.409+0000 7f584e163640 1 --2- 172.21.15.107:0/767017982 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f583006e530 0x7f58300709e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f584810eb20 tx=0x7f583c009120 comp rx=0 tx=0).stop 2024-09-21T08:10:37.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.409+0000 7f584e163640 1 -- 172.21.15.107:0/767017982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58480fb480 msgr2=0x7f5848113260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:37.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.409+0000 7f584e163640 1 --2- 172.21.15.107:0/767017982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58480fb480 0x7f5848113260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5838003080 tx=0x7f5838009da0 comp rx=0 tx=0).stop 2024-09-21T08:10:37.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.409+0000 7f584e163640 1 -- 172.21.15.107:0/767017982 shutdown_connections 2024-09-21T08:10:37.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.409+0000 7f584e163640 1 --2- 172.21.15.107:0/767017982 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f583006e530 0x7f58300709e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:37.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.409+0000 7f584e163640 1 --2- 172.21.15.107:0/767017982 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58481014c0 0x7f58481137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:37.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.409+0000 7f584e163640 1 --2- 172.21.15.107:0/767017982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58480fb480 0x7f5848113260 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:37.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.409+0000 7f584e163640 1 -- 172.21.15.107:0/767017982 >> 172.21.15.107:0/767017982 conn(0x7f58480f7000 msgr2=0x7f58480659f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:37.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.410+0000 7f584e163640 1 -- 172.21.15.107:0/767017982 shutdown_connections 2024-09-21T08:10:37.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.410+0000 7f584e163640 1 -- 172.21.15.107:0/767017982 wait complete. 2024-09-21T08:10:37.420 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:10:37.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.492+0000 7ff52f465640 1 -- 172.21.15.107:0/1981251905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff528102530 msgr2=0x7ff528102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:37.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.492+0000 7ff52f465640 1 --2- 172.21.15.107:0/1981251905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff528102530 0x7ff528102900 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff5200048d0 tx=0x7ff520009da0 comp rx=0 tx=0).stop 2024-09-21T08:10:37.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.492+0000 7ff52f465640 1 -- 172.21.15.107:0/1981251905 shutdown_connections 2024-09-21T08:10:37.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.493+0000 7ff52f465640 1 --2- 172.21.15.107:0/1981251905 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff528102ed0 0x7ff5280fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:37.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.493+0000 7ff52f465640 1 --2- 172.21.15.107:0/1981251905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff528102530 0x7ff528102900 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:37.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.493+0000 7ff52f465640 1 -- 172.21.15.107:0/1981251905 >> 172.21.15.107:0/1981251905 conn(0x7ff5280f80f0 msgr2=0x7ff5280fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:37.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.493+0000 7ff52f465640 1 -- 172.21.15.107:0/1981251905 shutdown_connections 2024-09-21T08:10:37.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.493+0000 7ff52f465640 1 -- 172.21.15.107:0/1981251905 wait complete. 2024-09-21T08:10:37.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.493+0000 7ff52f465640 1 Processor -- start 2024-09-21T08:10:37.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.493+0000 7ff52f465640 1 -- start start 2024-09-21T08:10:37.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.493+0000 7ff52f465640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff528102530 0x7ff528113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:37.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.493+0000 7ff52f465640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff528102ed0 0x7ff528113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:37.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.493+0000 7ff52f465640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff528113d80 con 0x7ff528102ed0 2024-09-21T08:10:37.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.493+0000 7ff52f465640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52810d1c0 con 0x7ff528102530 2024-09-21T08:10:37.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.494+0000 7ff52ca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff528102ed0 0x7ff528113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:37.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.494+0000 7ff52ca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff528102ed0 0x7ff528113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35598/0 (socket says 172.21.15.107:35598) 2024-09-21T08:10:37.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.494+0000 7ff52ca00640 1 -- 172.21.15.107:0/1107753074 learned_addr learned my addr 172.21.15.107:0/1107753074 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:10:37.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.494+0000 7ff52d201640 1 --2- 172.21.15.107:0/1107753074 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff528102530 0x7ff528113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:37.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.494+0000 7ff52ca00640 1 -- 172.21.15.107:0/1107753074 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff528102530 msgr2=0x7ff528113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:37.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.494+0000 7ff52ca00640 1 --2- 172.21.15.107:0/1107753074 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff528102530 0x7ff528113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:37.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.494+0000 7ff52ca00640 1 -- 172.21.15.107:0/1107753074 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff520005040 con 0x7ff528102ed0 2024-09-21T08:10:37.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.494+0000 7ff52ca00640 1 --2- 172.21.15.107:0/1107753074 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff528102ed0 0x7ff528113780 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff51c002840 tx=0x7ff51c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:37.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.494+0000 7ff525ffb640 1 -- 172.21.15.107:0/1107753074 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff51c007c30 con 0x7ff528102ed0 2024-09-21T08:10:37.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.494+0000 7ff52f465640 1 -- 172.21.15.107:0/1107753074 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52810d440 con 0x7ff528102ed0 2024-09-21T08:10:37.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.494+0000 7ff525ffb640 1 -- 172.21.15.107:0/1107753074 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff51c00f040 con 0x7ff528102ed0 2024-09-21T08:10:37.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.494+0000 7ff525ffb640 1 -- 172.21.15.107:0/1107753074 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff51c00d990 con 0x7ff528102ed0 2024-09-21T08:10:37.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.495+0000 7ff52f465640 1 -- 172.21.15.107:0/1107753074 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52810d960 con 0x7ff528102ed0 2024-09-21T08:10:37.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.495+0000 7ff52f465640 1 -- 172.21.15.107:0/1107753074 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5280fdcb0 con 0x7ff528102ed0 2024-09-21T08:10:37.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.496+0000 7ff525ffb640 1 -- 172.21.15.107:0/1107753074 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff51c009600 con 0x7ff528102ed0 2024-09-21T08:10:37.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.496+0000 7ff525ffb640 1 --2- 172.21.15.107:0/1107753074 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff51006e530 0x7ff5100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:37.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.496+0000 7ff525ffb640 1 -- 172.21.15.107:0/1107753074 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6700+0+0 (secure 0 0 0) 0x7ff51c08d8e0 con 0x7ff528102ed0 2024-09-21T08:10:37.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.496+0000 7ff52d201640 1 --2- 172.21.15.107:0/1107753074 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff51006e530 0x7ff5100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:37.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.497+0000 7ff52d201640 1 --2- 172.21.15.107:0/1107753074 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff51006e530 0x7ff5100709e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff520009af0 tx=0x7ff520039040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:37.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.501+0000 7ff525ffb640 1 -- 172.21.15.107:0/1107753074 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff51c056a30 con 0x7ff528102ed0 2024-09-21T08:10:37.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.697+0000 7ff52f465640 1 -- 172.21.15.107:0/1107753074 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5281095a0 con 0x7ff51006e530 2024-09-21T08:10:37.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.698+0000 7ff525ffb640 1 -- 172.21.15.107:0/1107753074 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff5281095a0 con 0x7ff51006e530 2024-09-21T08:10:37.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.700+0000 7ff52f465640 1 -- 172.21.15.107:0/1107753074 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff51006e530 msgr2=0x7ff5100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:37.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.700+0000 7ff52f465640 1 --2- 172.21.15.107:0/1107753074 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff51006e530 0x7ff5100709e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff520009af0 tx=0x7ff520039040 comp rx=0 tx=0).stop 2024-09-21T08:10:37.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.700+0000 7ff52f465640 1 -- 172.21.15.107:0/1107753074 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff528102ed0 msgr2=0x7ff528113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:37.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.700+0000 7ff52f465640 1 --2- 172.21.15.107:0/1107753074 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff528102ed0 0x7ff528113780 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff51c002840 tx=0x7ff51c004570 comp rx=0 tx=0).stop 2024-09-21T08:10:37.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.700+0000 7ff52f465640 1 -- 172.21.15.107:0/1107753074 shutdown_connections 2024-09-21T08:10:37.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.700+0000 7ff52f465640 1 --2- 172.21.15.107:0/1107753074 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff51006e530 0x7ff5100709e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:37.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.700+0000 7ff52f465640 1 --2- 172.21.15.107:0/1107753074 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff528102ed0 0x7ff528113780 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:37.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.700+0000 7ff52f465640 1 --2- 172.21.15.107:0/1107753074 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff528102530 0x7ff528113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:37.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.700+0000 7ff52f465640 1 -- 172.21.15.107:0/1107753074 >> 172.21.15.107:0/1107753074 conn(0x7ff5280f80f0 msgr2=0x7ff5280f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:37.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.700+0000 7ff52f465640 1 -- 172.21.15.107:0/1107753074 shutdown_connections 2024-09-21T08:10:37.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.700+0000 7ff52f465640 1 -- 172.21.15.107:0/1107753074 wait complete. 2024-09-21T08:10:37.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.787+0000 7fbf71b43640 1 -- 172.21.15.107:0/1972154717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf6c0fb810 msgr2=0x7fbf6c0fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:37.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.787+0000 7fbf71b43640 1 --2- 172.21.15.107:0/1972154717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf6c0fb810 0x7fbf6c0fbbe0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c0048d0 tx=0x7fbf5c009da0 comp rx=0 tx=0).stop 2024-09-21T08:10:37.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.787+0000 7fbf71b43640 1 -- 172.21.15.107:0/1972154717 shutdown_connections 2024-09-21T08:10:37.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.787+0000 7fbf71b43640 1 --2- 172.21.15.107:0/1972154717 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf6c0fcf80 0x7fbf6c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:37.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.787+0000 7fbf71b43640 1 --2- 172.21.15.107:0/1972154717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf6c0fb810 0x7fbf6c0fbbe0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:37.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.787+0000 7fbf71b43640 1 -- 172.21.15.107:0/1972154717 >> 172.21.15.107:0/1972154717 conn(0x7fbf6c0723b0 msgr2=0x7fbf6c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:37.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.787+0000 7fbf71b43640 1 -- 172.21.15.107:0/1972154717 shutdown_connections 2024-09-21T08:10:37.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.787+0000 7fbf71b43640 1 -- 172.21.15.107:0/1972154717 wait complete. 2024-09-21T08:10:37.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.788+0000 7fbf71b43640 1 Processor -- start 2024-09-21T08:10:37.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.788+0000 7fbf71b43640 1 -- start start 2024-09-21T08:10:37.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.788+0000 7fbf71b43640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf6c0fb810 0x7fbf6c113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:37.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.788+0000 7fbf71b43640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf6c0fcf80 0x7fbf6c113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:37.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.788+0000 7fbf71b43640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c113d40 con 0x7fbf6c0fcf80 2024-09-21T08:10:37.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.788+0000 7fbf71b43640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c10d180 con 0x7fbf6c0fb810 2024-09-21T08:10:37.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.788+0000 7fbf6affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf6c0fcf80 0x7fbf6c113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:37.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.788+0000 7fbf6affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf6c0fcf80 0x7fbf6c113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35626/0 (socket says 172.21.15.107:35626) 2024-09-21T08:10:37.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.788+0000 7fbf6affd640 1 -- 172.21.15.107:0/2197218817 learned_addr learned my addr 172.21.15.107:0/2197218817 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:10:37.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.788+0000 7fbf6b7fe640 1 --2- 172.21.15.107:0/2197218817 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf6c0fb810 0x7fbf6c113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:37.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.789+0000 7fbf6affd640 1 -- 172.21.15.107:0/2197218817 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf6c0fb810 msgr2=0x7fbf6c113200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:37.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.789+0000 7fbf6affd640 1 --2- 172.21.15.107:0/2197218817 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf6c0fb810 0x7fbf6c113200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:37.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.789+0000 7fbf6affd640 1 -- 172.21.15.107:0/2197218817 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5c005040 con 0x7fbf6c0fcf80 2024-09-21T08:10:37.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.789+0000 7fbf6b7fe640 1 --2- 172.21.15.107:0/2197218817 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf6c0fb810 0x7fbf6c113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:10:37.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.789+0000 7fbf6affd640 1 --2- 172.21.15.107:0/2197218817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf6c0fcf80 0x7fbf6c113740 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbf6000c790 tx=0x7fbf600043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:37.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.789+0000 7fbf53fff640 1 -- 172.21.15.107:0/2197218817 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf6000a820 con 0x7fbf6c0fcf80 2024-09-21T08:10:37.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.789+0000 7fbf53fff640 1 -- 172.21.15.107:0/2197218817 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbf6000ae20 con 0x7fbf6c0fcf80 2024-09-21T08:10:37.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.789+0000 7fbf71b43640 1 -- 172.21.15.107:0/2197218817 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6c10d460 con 0x7fbf6c0fcf80 2024-09-21T08:10:37.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.789+0000 7fbf53fff640 1 -- 172.21.15.107:0/2197218817 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf600113a0 con 0x7fbf6c0fcf80 2024-09-21T08:10:37.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.789+0000 7fbf71b43640 1 -- 172.21.15.107:0/2197218817 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6c10da00 con 0x7fbf6c0fcf80 2024-09-21T08:10:37.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.790+0000 7fbf71b43640 1 -- 172.21.15.107:0/2197218817 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6c0fcbc0 con 0x7fbf6c0fcf80 2024-09-21T08:10:37.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.791+0000 7fbf53fff640 1 -- 172.21.15.107:0/2197218817 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fbf60012400 con 0x7fbf6c0fcf80 2024-09-21T08:10:37.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.791+0000 7fbf53fff640 1 --2- 172.21.15.107:0/2197218817 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fbf5406e530 0x7fbf540709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:37.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.791+0000 7fbf53fff640 1 -- 172.21.15.107:0/2197218817 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6700+0+0 (secure 0 0 0) 0x7fbf6008e3f0 con 0x7fbf6c0fcf80 2024-09-21T08:10:37.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.791+0000 7fbf6b7fe640 1 --2- 172.21.15.107:0/2197218817 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fbf5406e530 0x7fbf540709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:37.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.792+0000 7fbf6b7fe640 1 --2- 172.21.15.107:0/2197218817 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fbf5406e530 0x7fbf540709e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c007ac0 tx=0x7fbf5c035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:37.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.796+0000 7fbf53fff640 1 -- 172.21.15.107:0/2197218817 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fbf60057490 con 0x7fbf6c0fcf80 2024-09-21T08:10:37.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.988+0000 7fbf71b43640 1 -- 172.21.15.107:0/2197218817 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf6c10e870 con 0x7fbf5406e530 2024-09-21T08:10:37.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:37.998+0000 7fbf53fff640 1 -- 172.21.15.107:0/2197218817 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fbf6c10e870 con 0x7fbf5406e530 2024-09-21T08:10:37.999 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:10:38.000 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (7m) 15s ago 15m 25.9M - 0.25.0 c8568f914cd2 2b499aa3b7de 2024-09-21T08:10:38.000 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (3m) 15s ago 15m 6899k - 19.1.1-367-g9e2ac70b cc9251b744a3 69be0e9aa842 2024-09-21T08:10:38.000 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (3m) 32s ago 15m 6891k - 19.1.1-367-g9e2ac70b cc9251b744a3 926ed03c78b9 2024-09-21T08:10:38.000 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (5m) 15s ago 15m 81.2M - 9.4.12 2bacad6d85d8 63177dcfe25c 2024-09-21T08:10:38.000 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (10m) 15s ago 10m 155M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 3bc779f88228 2024-09-21T08:10:38.000 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (22s) 15s ago 10m 13.8M - 19.1.1-367-g9e2ac70b cc9251b744a3 d0c1d4b4a46b 2024-09-21T08:10:38.000 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (10m) 32s ago 10m 17.5M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 329346c3afec 2024-09-21T08:10:38.000 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (10m) 32s ago 10m 18.9M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be baf87f32bfbc 2024-09-21T08:10:38.000 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:8443,9283,8765 running (6m) 15s ago 16m 502M - 19.1.1-367-g9e2ac70b cc9251b744a3 49c237734f07 2024-09-21T08:10:38.000 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283,8765 running (6m) 32s ago 14m 441M - 19.1.1-367-g9e2ac70b cc9251b744a3 ed117096bdd8 2024-09-21T08:10:38.000 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (4m) 15s ago 17m 48.7M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 445b3e6a800f 2024-09-21T08:10:38.000 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (4m) 32s ago 14m 36.7M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 12706f823621 2024-09-21T08:10:38.000 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 running (7m) 15s ago 15m 16.7M - 1.5.0 0da6a335fe13 6de7c307ba0f 2024-09-21T08:10:38.001 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (7m) 32s ago 14m 16.6M - 1.5.0 0da6a335fe13 cb6d4577b24c 2024-09-21T08:10:38.001 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (3m) 15s ago 14m 157M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 d0a742b31d8a 2024-09-21T08:10:38.001 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (2m) 15s ago 13m 143M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 4bb3f4c8f75a 2024-09-21T08:10:38.001 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (2m) 15s ago 13m 179M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 15f45fa18e64 2024-09-21T08:10:38.001 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (100s) 32s ago 12m 112M 2581M 19.1.1-367-g9e2ac70b cc9251b744a3 ee4efea3e442 2024-09-21T08:10:38.001 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (69s) 32s ago 12m 106M 2581M 19.1.1-367-g9e2ac70b cc9251b744a3 0d09ba7072ba 2024-09-21T08:10:38.001 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (36s) 32s ago 12m 12.1M 2581M 19.1.1-367-g9e2ac70b cc9251b744a3 caf3fc8cc3f1 2024-09-21T08:10:38.001 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (6m) 15s ago 15m 61.5M - 2.43.0 a07b618ecd1d 9ed2abf5e8d8 2024-09-21T08:10:38.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.000+0000 7fbf71b43640 1 -- 172.21.15.107:0/2197218817 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fbf5406e530 msgr2=0x7fbf540709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.000+0000 7fbf71b43640 1 --2- 172.21.15.107:0/2197218817 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fbf5406e530 0x7fbf540709e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c007ac0 tx=0x7fbf5c035040 comp rx=0 tx=0).stop 2024-09-21T08:10:38.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.000+0000 7fbf71b43640 1 -- 172.21.15.107:0/2197218817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf6c0fcf80 msgr2=0x7fbf6c113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.000+0000 7fbf71b43640 1 --2- 172.21.15.107:0/2197218817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf6c0fcf80 0x7fbf6c113740 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbf6000c790 tx=0x7fbf600043c0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.000+0000 7fbf71b43640 1 -- 172.21.15.107:0/2197218817 shutdown_connections 2024-09-21T08:10:38.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.000+0000 7fbf71b43640 1 --2- 172.21.15.107:0/2197218817 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fbf5406e530 0x7fbf540709e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.000+0000 7fbf71b43640 1 --2- 172.21.15.107:0/2197218817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf6c0fcf80 0x7fbf6c113740 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.000+0000 7fbf71b43640 1 --2- 172.21.15.107:0/2197218817 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf6c0fb810 0x7fbf6c113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.000+0000 7fbf71b43640 1 -- 172.21.15.107:0/2197218817 >> 172.21.15.107:0/2197218817 conn(0x7fbf6c0723b0 msgr2=0x7fbf6c064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:38.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.000+0000 7fbf71b43640 1 -- 172.21.15.107:0/2197218817 shutdown_connections 2024-09-21T08:10:38.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.000+0000 7fbf71b43640 1 -- 172.21.15.107:0/2197218817 wait complete. 2024-09-21T08:10:38.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.078+0000 7f2329924640 1 -- 172.21.15.107:0/2236919002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2324102ef0 msgr2=0x7f23240fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.078+0000 7f2329924640 1 --2- 172.21.15.107:0/2236919002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2324102ef0 0x7f23240fc5b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f23180048d0 tx=0x7f2318009da0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.078+0000 7f2329924640 1 -- 172.21.15.107:0/2236919002 shutdown_connections 2024-09-21T08:10:38.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.078+0000 7f2329924640 1 --2- 172.21.15.107:0/2236919002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2324102ef0 0x7f23240fc5b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.078+0000 7f2329924640 1 --2- 172.21.15.107:0/2236919002 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2324102550 0x7f2324102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.078+0000 7f2329924640 1 -- 172.21.15.107:0/2236919002 >> 172.21.15.107:0/2236919002 conn(0x7f23240f80f0 msgr2=0x7f23240fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.078+0000 7f2329924640 1 -- 172.21.15.107:0/2236919002 shutdown_connections 2024-09-21T08:10:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.078+0000 7f2329924640 1 -- 172.21.15.107:0/2236919002 wait complete. 2024-09-21T08:10:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.079+0000 7f2329924640 1 Processor -- start 2024-09-21T08:10:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.079+0000 7f2329924640 1 -- start start 2024-09-21T08:10:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.079+0000 7f2329924640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2324102550 0x7f232406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.079+0000 7f2329924640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2324102ef0 0x7f232406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.079+0000 7f2329924640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2324070490 con 0x7f2324102550 2024-09-21T08:10:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.079+0000 7f2329924640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2324070600 con 0x7f2324102ef0 2024-09-21T08:10:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.079+0000 7f2322ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2324102550 0x7f232406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.079+0000 7f2322ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2324102550 0x7f232406fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35636/0 (socket says 172.21.15.107:35636) 2024-09-21T08:10:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.079+0000 7f2322ffd640 1 -- 172.21.15.107:0/40411509 learned_addr learned my addr 172.21.15.107:0/40411509 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:10:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.079+0000 7f23227fc640 1 --2- 172.21.15.107:0/40411509 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2324102ef0 0x7f232406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.079+0000 7f2322ffd640 1 -- 172.21.15.107:0/40411509 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2324102ef0 msgr2=0x7f232406ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.079+0000 7f2322ffd640 1 --2- 172.21.15.107:0/40411509 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2324102ef0 0x7f232406ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.079+0000 7f2322ffd640 1 -- 172.21.15.107:0/40411509 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2318005040 con 0x7f2324102550 2024-09-21T08:10:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.079+0000 7f2322ffd640 1 --2- 172.21.15.107:0/40411509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2324102550 0x7f232406fa10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2314002a80 tx=0x7f2314004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.080+0000 7f230b7fe640 1 -- 172.21.15.107:0/40411509 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2314007c30 con 0x7f2324102550 2024-09-21T08:10:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.080+0000 7f230b7fe640 1 -- 172.21.15.107:0/40411509 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f231400f040 con 0x7f2324102550 2024-09-21T08:10:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.080+0000 7f2329924640 1 -- 172.21.15.107:0/40411509 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2324070890 con 0x7f2324102550 2024-09-21T08:10:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.080+0000 7f230b7fe640 1 -- 172.21.15.107:0/40411509 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f231400dab0 con 0x7f2324102550 2024-09-21T08:10:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.080+0000 7f2329924640 1 -- 172.21.15.107:0/40411509 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2324119b80 con 0x7f2324102550 2024-09-21T08:10:38.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.081+0000 7f2329924640 1 -- 172.21.15.107:0/40411509 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23240fdcd0 con 0x7f2324102550 2024-09-21T08:10:38.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.081+0000 7f230b7fe640 1 -- 172.21.15.107:0/40411509 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f231400dc10 con 0x7f2324102550 2024-09-21T08:10:38.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.082+0000 7f230b7fe640 1 --2- 172.21.15.107:0/40411509 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f230c06e530 0x7f230c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.082+0000 7f230b7fe640 1 -- 172.21.15.107:0/40411509 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f231408da00 con 0x7f2324102550 2024-09-21T08:10:38.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.082+0000 7f23227fc640 1 --2- 172.21.15.107:0/40411509 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f230c06e530 0x7f230c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.082+0000 7f23227fc640 1 --2- 172.21.15.107:0/40411509 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f230c06e530 0x7f230c0709e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f23180048a0 tx=0x7f2318035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:38.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.086+0000 7f230b7fe640 1 -- 172.21.15.107:0/40411509 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2314056b50 con 0x7f2324102550 2024-09-21T08:10:38.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.326+0000 7f2329924640 1 -- 172.21.15.107:0/40411509 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2324071100 con 0x7f2324102550 2024-09-21T08:10:38.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.327+0000 7f230b7fe640 1 -- 172.21.15.107:0/40411509 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7f231405a210 con 0x7f2324102550 2024-09-21T08:10:38.328 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:10:38.328 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": { 2024-09-21T08:10:38.328 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:10:38.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:10:38.328 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": { 2024-09-21T08:10:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:10:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:10:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": { 2024-09-21T08:10:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 6 2024-09-21T08:10:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:10:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-21T08:10:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 2, 2024-09-21T08:10:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 1 2024-09-21T08:10:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:10:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: "overall": { 2024-09-21T08:10:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 2, 2024-09-21T08:10:38.330 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 11 2024-09-21T08:10:38.330 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-21T08:10:38.330 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:10:38.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.329+0000 7f2329924640 1 -- 172.21.15.107:0/40411509 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f230c06e530 msgr2=0x7f230c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.329+0000 7f2329924640 1 --2- 172.21.15.107:0/40411509 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f230c06e530 0x7f230c0709e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f23180048a0 tx=0x7f2318035040 comp rx=0 tx=0).stop 2024-09-21T08:10:38.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.329+0000 7f2329924640 1 -- 172.21.15.107:0/40411509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2324102550 msgr2=0x7f232406fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.329+0000 7f2329924640 1 --2- 172.21.15.107:0/40411509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2324102550 0x7f232406fa10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2314002a80 tx=0x7f2314004600 comp rx=0 tx=0).stop 2024-09-21T08:10:38.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.329+0000 7f2329924640 1 -- 172.21.15.107:0/40411509 shutdown_connections 2024-09-21T08:10:38.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.329+0000 7f2329924640 1 --2- 172.21.15.107:0/40411509 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f230c06e530 0x7f230c0709e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.329+0000 7f2329924640 1 --2- 172.21.15.107:0/40411509 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2324102ef0 0x7f232406ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.329+0000 7f2329924640 1 --2- 172.21.15.107:0/40411509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2324102550 0x7f232406fa10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.329+0000 7f2329924640 1 -- 172.21.15.107:0/40411509 >> 172.21.15.107:0/40411509 conn(0x7f23240f80f0 msgr2=0x7f23240f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:38.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.329+0000 7f2329924640 1 -- 172.21.15.107:0/40411509 shutdown_connections 2024-09-21T08:10:38.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.329+0000 7f2329924640 1 -- 172.21.15.107:0/40411509 wait complete. 2024-09-21T08:10:38.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.408+0000 7fde4357d640 1 -- 172.21.15.107:0/2327909054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde3c0fded0 msgr2=0x7fde3c1065a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.408+0000 7fde4357d640 1 --2- 172.21.15.107:0/2327909054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde3c0fded0 0x7fde3c1065a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fde2c004900 tx=0x7fde2c009da0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.408+0000 7fde4357d640 1 -- 172.21.15.107:0/2327909054 shutdown_connections 2024-09-21T08:10:38.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.408+0000 7fde4357d640 1 --2- 172.21.15.107:0/2327909054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde3c0fded0 0x7fde3c1065a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.408+0000 7fde4357d640 1 --2- 172.21.15.107:0/2327909054 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde3c0fd530 0x7fde3c0fd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.408+0000 7fde4357d640 1 -- 172.21.15.107:0/2327909054 >> 172.21.15.107:0/2327909054 conn(0x7fde3c0f7030 msgr2=0x7fde3c0f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:38.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.409+0000 7fde4357d640 1 -- 172.21.15.107:0/2327909054 shutdown_connections 2024-09-21T08:10:38.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.409+0000 7fde4357d640 1 -- 172.21.15.107:0/2327909054 wait complete. 2024-09-21T08:10:38.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.409+0000 7fde4357d640 1 Processor -- start 2024-09-21T08:10:38.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.409+0000 7fde4357d640 1 -- start start 2024-09-21T08:10:38.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.409+0000 7fde4357d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde3c0fd530 0x7fde3c115480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.410+0000 7fde4357d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde3c0fded0 0x7fde3c1159c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.410+0000 7fde4357d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c116010 con 0x7fde3c0fd530 2024-09-21T08:10:38.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.410+0000 7fde4357d640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c10f420 con 0x7fde3c0fded0 2024-09-21T08:10:38.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.410+0000 7fde41319640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde3c0fd530 0x7fde3c115480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.410+0000 7fde40b18640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde3c0fded0 0x7fde3c1159c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.410+0000 7fde41319640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde3c0fd530 0x7fde3c115480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35654/0 (socket says 172.21.15.107:35654) 2024-09-21T08:10:38.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.410+0000 7fde41319640 1 -- 172.21.15.107:0/684368439 learned_addr learned my addr 172.21.15.107:0/684368439 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:10:38.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.410+0000 7fde41319640 1 -- 172.21.15.107:0/684368439 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde3c0fded0 msgr2=0x7fde3c1159c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.410+0000 7fde41319640 1 --2- 172.21.15.107:0/684368439 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde3c0fded0 0x7fde3c1159c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.410+0000 7fde41319640 1 -- 172.21.15.107:0/684368439 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2c005040 con 0x7fde3c0fd530 2024-09-21T08:10:38.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.410+0000 7fde40b18640 1 --2- 172.21.15.107:0/684368439 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde3c0fded0 0x7fde3c1159c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:10:38.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.410+0000 7fde41319640 1 --2- 172.21.15.107:0/684368439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde3c0fd530 0x7fde3c115480 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fde3800c830 tx=0x7fde38004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:38.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.410+0000 7fde31ffb640 1 -- 172.21.15.107:0/684368439 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde3800a850 con 0x7fde3c0fd530 2024-09-21T08:10:38.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.410+0000 7fde31ffb640 1 -- 172.21.15.107:0/684368439 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fde3800ae50 con 0x7fde3c0fd530 2024-09-21T08:10:38.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.410+0000 7fde4357d640 1 -- 172.21.15.107:0/684368439 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3c10f700 con 0x7fde3c0fd530 2024-09-21T08:10:38.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.410+0000 7fde31ffb640 1 -- 172.21.15.107:0/684368439 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde380113a0 con 0x7fde3c0fd530 2024-09-21T08:10:38.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.411+0000 7fde4357d640 1 -- 172.21.15.107:0/684368439 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3c10fc20 con 0x7fde3c0fd530 2024-09-21T08:10:38.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.412+0000 7fde31ffb640 1 -- 172.21.15.107:0/684368439 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fde38012400 con 0x7fde3c0fd530 2024-09-21T08:10:38.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.412+0000 7fde4357d640 1 -- 172.21.15.107:0/684368439 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde3c066090 con 0x7fde3c0fd530 2024-09-21T08:10:38.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.413+0000 7fde31ffb640 1 --2- 172.21.15.107:0/684368439 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fde2806e530 0x7fde280709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.413+0000 7fde40b18640 1 --2- 172.21.15.107:0/684368439 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fde2806e530 0x7fde280709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.413+0000 7fde31ffb640 1 -- 172.21.15.107:0/684368439 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6700+0+0 (secure 0 0 0) 0x7fde3808e3c0 con 0x7fde3c0fd530 2024-09-21T08:10:38.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.413+0000 7fde40b18640 1 --2- 172.21.15.107:0/684368439 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fde2806e530 0x7fde280709e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fde3c110700 tx=0x7fde2c035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:38.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.417+0000 7fde31ffb640 1 -- 172.21.15.107:0/684368439 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fde38057460 con 0x7fde3c0fd530 2024-09-21T08:10:38.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.655+0000 7fde4357d640 1 -- 172.21.15.107:0/684368439 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fde3c04b720 con 0x7fde3c0fd530 2024-09-21T08:10:38.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.656+0000 7fde31ffb640 1 -- 172.21.15.107:0/684368439 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1750 (secure 0 0 0) 0x7fde3805ab20 con 0x7fde3c0fd530 2024-09-21T08:10:38.657 INFO:teuthology.orchestra.run.smithi107.stdout:e20 2024-09-21T08:10:38.657 INFO:teuthology.orchestra.run.smithi107.stdout:btime 2024-09-21T08:10:37:661423+0000 2024-09-21T08:10:38.657 INFO:teuthology.orchestra.run.smithi107.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T08:10:38.658 INFO:teuthology.orchestra.run.smithi107.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:10:38.658 INFO:teuthology.orchestra.run.smithi107.stdout:legacy client fscid: 1 2024-09-21T08:10:38.658 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:10:38.658 INFO:teuthology.orchestra.run.smithi107.stdout:Filesystem 'cephfs' (1) 2024-09-21T08:10:38.658 INFO:teuthology.orchestra.run.smithi107.stdout:fs_name cephfs 2024-09-21T08:10:38.658 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 20 2024-09-21T08:10:38.658 INFO:teuthology.orchestra.run.smithi107.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T08:10:38.658 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-09-21T08:00:03.244314+0000 2024-09-21T08:10:38.658 INFO:teuthology.orchestra.run.smithi107.stdout:modified 2024-09-21T08:10:37.071099+0000 2024-09-21T08:10:38.658 INFO:teuthology.orchestra.run.smithi107.stdout:tableserver 0 2024-09-21T08:10:38.658 INFO:teuthology.orchestra.run.smithi107.stdout:root 0 2024-09-21T08:10:38.658 INFO:teuthology.orchestra.run.smithi107.stdout:session_timeout 60 2024-09-21T08:10:38.658 INFO:teuthology.orchestra.run.smithi107.stdout:session_autoclose 300 2024-09-21T08:10:38.659 INFO:teuthology.orchestra.run.smithi107.stdout:max_file_size 1099511627776 2024-09-21T08:10:38.659 INFO:teuthology.orchestra.run.smithi107.stdout:max_xattr_size 65536 2024-09-21T08:10:38.659 INFO:teuthology.orchestra.run.smithi107.stdout:required_client_features {} 2024-09-21T08:10:38.659 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure 0 2024-09-21T08:10:38.659 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure_osd_epoch 91 2024-09-21T08:10:38.659 INFO:teuthology.orchestra.run.smithi107.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:10:38.659 INFO:teuthology.orchestra.run.smithi107.stdout:max_mds 1 2024-09-21T08:10:38.659 INFO:teuthology.orchestra.run.smithi107.stdout:in 0 2024-09-21T08:10:38.659 INFO:teuthology.orchestra.run.smithi107.stdout:up {0=24239} 2024-09-21T08:10:38.659 INFO:teuthology.orchestra.run.smithi107.stdout:failed 2024-09-21T08:10:38.659 INFO:teuthology.orchestra.run.smithi107.stdout:damaged 2024-09-21T08:10:38.659 INFO:teuthology.orchestra.run.smithi107.stdout:stopped 2024-09-21T08:10:38.659 INFO:teuthology.orchestra.run.smithi107.stdout:data_pools [3] 2024-09-21T08:10:38.659 INFO:teuthology.orchestra.run.smithi107.stdout:metadata_pool 2 2024-09-21T08:10:38.659 INFO:teuthology.orchestra.run.smithi107.stdout:inline_data disabled 2024-09-21T08:10:38.660 INFO:teuthology.orchestra.run.smithi107.stdout:balancer 2024-09-21T08:10:38.660 INFO:teuthology.orchestra.run.smithi107.stdout:bal_rank_mask -1 2024-09-21T08:10:38.660 INFO:teuthology.orchestra.run.smithi107.stdout:standby_count_wanted 1 2024-09-21T08:10:38.660 INFO:teuthology.orchestra.run.smithi107.stdout:qdb_cluster leader: 0 members: 2024-09-21T08:10:38.660 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.fwmfcy{0:24239} state up:reconnect seq 158 join_fscid=1 addr [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:10:38.660 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:10:38.660 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:10:38.660 INFO:teuthology.orchestra.run.smithi107.stdout:Standby daemons: 2024-09-21T08:10:38.660 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:10:38.660 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.belyba{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:10:38.660 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.qusoyf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6826/3638073096,v1:172.21.15.107:6827/3638073096] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T08:10:38.660 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 20 2024-09-21T08:10:38.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.659+0000 7fde4357d640 1 -- 172.21.15.107:0/684368439 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fde2806e530 msgr2=0x7fde280709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.659+0000 7fde4357d640 1 --2- 172.21.15.107:0/684368439 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fde2806e530 0x7fde280709e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fde3c110700 tx=0x7fde2c035040 comp rx=0 tx=0).stop 2024-09-21T08:10:38.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.659+0000 7fde4357d640 1 -- 172.21.15.107:0/684368439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde3c0fd530 msgr2=0x7fde3c115480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.659+0000 7fde4357d640 1 --2- 172.21.15.107:0/684368439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde3c0fd530 0x7fde3c115480 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fde3800c830 tx=0x7fde38004430 comp rx=0 tx=0).stop 2024-09-21T08:10:38.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.660+0000 7fde4357d640 1 -- 172.21.15.107:0/684368439 shutdown_connections 2024-09-21T08:10:38.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.660+0000 7fde4357d640 1 --2- 172.21.15.107:0/684368439 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fde2806e530 0x7fde280709e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.660+0000 7fde4357d640 1 --2- 172.21.15.107:0/684368439 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde3c0fded0 0x7fde3c1159c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.660+0000 7fde4357d640 1 --2- 172.21.15.107:0/684368439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde3c0fd530 0x7fde3c115480 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.660+0000 7fde4357d640 1 -- 172.21.15.107:0/684368439 >> 172.21.15.107:0/684368439 conn(0x7fde3c0f7030 msgr2=0x7fde3c0fb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:38.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.660+0000 7fde4357d640 1 -- 172.21.15.107:0/684368439 shutdown_connections 2024-09-21T08:10:38.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.660+0000 7fde4357d640 1 -- 172.21.15.107:0/684368439 wait complete. 2024-09-21T08:10:38.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.745+0000 7fdf2b437640 1 -- 172.21.15.107:0/4100805718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf2406fab0 msgr2=0x7fdf2406fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.745+0000 7fdf2b437640 1 --2- 172.21.15.107:0/4100805718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf2406fab0 0x7fdf2406fe80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdf200048d0 tx=0x7fdf20009da0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.745+0000 7fdf2b437640 1 -- 172.21.15.107:0/4100805718 shutdown_connections 2024-09-21T08:10:38.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.745+0000 7fdf2b437640 1 --2- 172.21.15.107:0/4100805718 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf240703c0 0x7fdf24108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.745+0000 7fdf2b437640 1 --2- 172.21.15.107:0/4100805718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf2406fab0 0x7fdf2406fe80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.745+0000 7fdf2b437640 1 -- 172.21.15.107:0/4100805718 >> 172.21.15.107:0/4100805718 conn(0x7fdf240f80f0 msgr2=0x7fdf240fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:38.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.745+0000 7fdf2b437640 1 -- 172.21.15.107:0/4100805718 shutdown_connections 2024-09-21T08:10:38.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.745+0000 7fdf2b437640 1 -- 172.21.15.107:0/4100805718 wait complete. 2024-09-21T08:10:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.746+0000 7fdf2b437640 1 Processor -- start 2024-09-21T08:10:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.746+0000 7fdf2b437640 1 -- start start 2024-09-21T08:10:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.746+0000 7fdf2b437640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf2406fab0 0x7fdf241153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.746+0000 7fdf2b437640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf240703c0 0x7fdf24115920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.746+0000 7fdf2b437640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf24115f20 con 0x7fdf240703c0 2024-09-21T08:10:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.746+0000 7fdf2b437640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf24116090 con 0x7fdf2406fab0 2024-09-21T08:10:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.746+0000 7fdf289d2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf240703c0 0x7fdf24115920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.746+0000 7fdf289d2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf240703c0 0x7fdf24115920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35684/0 (socket says 172.21.15.107:35684) 2024-09-21T08:10:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.746+0000 7fdf289d2640 1 -- 172.21.15.107:0/3051072531 learned_addr learned my addr 172.21.15.107:0/3051072531 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:10:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.746+0000 7fdf291d3640 1 --2- 172.21.15.107:0/3051072531 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf2406fab0 0x7fdf241153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.747+0000 7fdf289d2640 1 -- 172.21.15.107:0/3051072531 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf2406fab0 msgr2=0x7fdf241153e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.747+0000 7fdf289d2640 1 --2- 172.21.15.107:0/3051072531 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf2406fab0 0x7fdf241153e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.747+0000 7fdf289d2640 1 -- 172.21.15.107:0/3051072531 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf20005040 con 0x7fdf240703c0 2024-09-21T08:10:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.747+0000 7fdf289d2640 1 --2- 172.21.15.107:0/3051072531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf240703c0 0x7fdf24115920 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdf14002a50 tx=0x7fdf14004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.747+0000 7fdf19ffb640 1 -- 172.21.15.107:0/3051072531 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf14007c30 con 0x7fdf240703c0 2024-09-21T08:10:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.747+0000 7fdf19ffb640 1 -- 172.21.15.107:0/3051072531 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdf1400f040 con 0x7fdf240703c0 2024-09-21T08:10:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.747+0000 7fdf2b437640 1 -- 172.21.15.107:0/3051072531 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf2410f510 con 0x7fdf240703c0 2024-09-21T08:10:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.747+0000 7fdf19ffb640 1 -- 172.21.15.107:0/3051072531 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf1400da10 con 0x7fdf240703c0 2024-09-21T08:10:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.747+0000 7fdf2b437640 1 -- 172.21.15.107:0/3051072531 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2410fa30 con 0x7fdf240703c0 2024-09-21T08:10:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.748+0000 7fdf2b437640 1 -- 172.21.15.107:0/3051072531 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf240711f0 con 0x7fdf240703c0 2024-09-21T08:10:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.749+0000 7fdf19ffb640 1 -- 172.21.15.107:0/3051072531 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fdf1400dc80 con 0x7fdf240703c0 2024-09-21T08:10:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.749+0000 7fdf19ffb640 1 --2- 172.21.15.107:0/3051072531 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fdf1006e530 0x7fdf100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.749+0000 7fdf19ffb640 1 -- 172.21.15.107:0/3051072531 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6700+0+0 (secure 0 0 0) 0x7fdf1408da00 con 0x7fdf240703c0 2024-09-21T08:10:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.749+0000 7fdf291d3640 1 --2- 172.21.15.107:0/3051072531 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fdf1006e530 0x7fdf100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.750+0000 7fdf291d3640 1 --2- 172.21.15.107:0/3051072531 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fdf1006e530 0x7fdf100709e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdf20009ac0 tx=0x7fdf20035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:38.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.754+0000 7fdf19ffb640 1 -- 172.21.15.107:0/3051072531 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fdf14056ad0 con 0x7fdf240703c0 2024-09-21T08:10:38.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.954+0000 7fdf2b437640 1 -- 172.21.15.107:0/3051072531 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf2404b720 con 0x7fdf1006e530 2024-09-21T08:10:38.956 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:38 smithi107 ceph-mon[97757]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:10:38.956 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:38 smithi107 ceph-mon[97757]: pgmap v186: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-09-21T08:10:38.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:38 smithi107 ceph-mon[97757]: reconnect by client.14494 v1:172.21.15.129:0/3058185692 after 0 2024-09-21T08:10:38.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:38 smithi107 ceph-mon[97757]: reconnect by client.24269 v1:172.21.15.107:0/2727935843 after 0.000999978 2024-09-21T08:10:38.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:38 smithi107 ceph-mon[97757]: mds.? [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] up:reconnect 2024-09-21T08:10:38.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:38 smithi107 ceph-mon[97757]: fsmap cephfs:1/1 {0=cephfs.smithi129.fwmfcy=up:reconnect} 2 up:standby 2024-09-21T08:10:38.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:38 smithi107 ceph-mon[97757]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:10:38.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:38 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/40411509' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:38.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:38 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:38.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:38 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:38.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:38 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:10:38.957 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:38 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/684368439' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:10:38.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.956+0000 7fdf19ffb640 1 -- 172.21.15.107:0/3051072531 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fdf2404b720 con 0x7fdf1006e530 2024-09-21T08:10:38.958 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:10:38.958 INFO:teuthology.orchestra.run.smithi107.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5", 2024-09-21T08:10:38.958 INFO:teuthology.orchestra.run.smithi107.stdout: "in_progress": true, 2024-09-21T08:10:38.958 INFO:teuthology.orchestra.run.smithi107.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T08:10:38.958 INFO:teuthology.orchestra.run.smithi107.stdout: "services_complete": [ 2024-09-21T08:10:38.958 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr", 2024-09-21T08:10:38.958 INFO:teuthology.orchestra.run.smithi107.stdout: "mon", 2024-09-21T08:10:38.958 INFO:teuthology.orchestra.run.smithi107.stdout: "osd", 2024-09-21T08:10:38.958 INFO:teuthology.orchestra.run.smithi107.stdout: "crash" 2024-09-21T08:10:38.958 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-21T08:10:38.959 INFO:teuthology.orchestra.run.smithi107.stdout: "progress": "13/21 daemons upgraded", 2024-09-21T08:10:38.959 INFO:teuthology.orchestra.run.smithi107.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T08:10:38.959 INFO:teuthology.orchestra.run.smithi107.stdout: "is_paused": false 2024-09-21T08:10:38.959 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:10:38.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.958+0000 7fdf2b437640 1 -- 172.21.15.107:0/3051072531 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fdf1006e530 msgr2=0x7fdf100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.958+0000 7fdf2b437640 1 --2- 172.21.15.107:0/3051072531 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fdf1006e530 0x7fdf100709e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdf20009ac0 tx=0x7fdf20035040 comp rx=0 tx=0).stop 2024-09-21T08:10:38.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.958+0000 7fdf2b437640 1 -- 172.21.15.107:0/3051072531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf240703c0 msgr2=0x7fdf24115920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.958+0000 7fdf2b437640 1 --2- 172.21.15.107:0/3051072531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf240703c0 0x7fdf24115920 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdf14002a50 tx=0x7fdf14004600 comp rx=0 tx=0).stop 2024-09-21T08:10:38.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.958+0000 7fdf2b437640 1 -- 172.21.15.107:0/3051072531 shutdown_connections 2024-09-21T08:10:38.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.958+0000 7fdf2b437640 1 --2- 172.21.15.107:0/3051072531 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fdf1006e530 0x7fdf100709e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.958+0000 7fdf2b437640 1 --2- 172.21.15.107:0/3051072531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf240703c0 0x7fdf24115920 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.958+0000 7fdf2b437640 1 --2- 172.21.15.107:0/3051072531 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf2406fab0 0x7fdf241153e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.958+0000 7fdf2b437640 1 -- 172.21.15.107:0/3051072531 >> 172.21.15.107:0/3051072531 conn(0x7fdf240f80f0 msgr2=0x7fdf240f9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:38.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.958+0000 7fdf2b437640 1 -- 172.21.15.107:0/3051072531 shutdown_connections 2024-09-21T08:10:38.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:38.958+0000 7fdf2b437640 1 -- 172.21.15.107:0/3051072531 wait complete. 2024-09-21T08:10:39.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:38 smithi129 ceph-mon[76722]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:10:39.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:38 smithi129 ceph-mon[76722]: pgmap v186: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-09-21T08:10:39.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:38 smithi129 ceph-mon[76722]: reconnect by client.14494 v1:172.21.15.129:0/3058185692 after 0 2024-09-21T08:10:39.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:38 smithi129 ceph-mon[76722]: reconnect by client.24269 v1:172.21.15.107:0/2727935843 after 0.000999978 2024-09-21T08:10:39.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:38 smithi129 ceph-mon[76722]: mds.? [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] up:reconnect 2024-09-21T08:10:39.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:38 smithi129 ceph-mon[76722]: fsmap cephfs:1/1 {0=cephfs.smithi129.fwmfcy=up:reconnect} 2 up:standby 2024-09-21T08:10:39.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:38 smithi129 ceph-mon[76722]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:10:39.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:38 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/40411509' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:39.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:38 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:39.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:38 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:39.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:38 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:10:39.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:38 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/684368439' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:10:39.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.037+0000 7f4e5d4e3640 1 -- 172.21.15.107:0/2053546503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e580fac60 msgr2=0x7f4e580fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:39.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.037+0000 7f4e5d4e3640 1 --2- 172.21.15.107:0/2053546503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e580fac60 0x7f4e580fb0b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4e480048d0 tx=0x7f4e48009da0 comp rx=0 tx=0).stop 2024-09-21T08:10:39.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.037+0000 7f4e5d4e3640 1 -- 172.21.15.107:0/2053546503 shutdown_connections 2024-09-21T08:10:39.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.037+0000 7f4e5d4e3640 1 --2- 172.21.15.107:0/2053546503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e580fac60 0x7f4e580fb0b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:39.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.037+0000 7f4e5d4e3640 1 --2- 172.21.15.107:0/2053546503 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4e581025f0 0x7f4e581029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:39.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.037+0000 7f4e5d4e3640 1 -- 172.21.15.107:0/2053546503 >> 172.21.15.107:0/2053546503 conn(0x7f4e58070c80 msgr2=0x7f4e58071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:39.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.037+0000 7f4e5d4e3640 1 -- 172.21.15.107:0/2053546503 shutdown_connections 2024-09-21T08:10:39.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.037+0000 7f4e5d4e3640 1 -- 172.21.15.107:0/2053546503 wait complete. 2024-09-21T08:10:39.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.037+0000 7f4e5d4e3640 1 Processor -- start 2024-09-21T08:10:39.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.037+0000 7f4e5d4e3640 1 -- start start 2024-09-21T08:10:39.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.038+0000 7f4e5d4e3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4e580fac60 0x7f4e581131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:39.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.038+0000 7f4e5d4e3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e581025f0 0x7f4e58113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:39.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.038+0000 7f4e5d4e3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e58113d10 con 0x7f4e581025f0 2024-09-21T08:10:39.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.038+0000 7f4e5d4e3640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5810d150 con 0x7f4e580fac60 2024-09-21T08:10:39.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.038+0000 7f4e567fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e581025f0 0x7f4e58113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:39.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.038+0000 7f4e567fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e581025f0 0x7f4e58113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35702/0 (socket says 172.21.15.107:35702) 2024-09-21T08:10:39.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.038+0000 7f4e567fc640 1 -- 172.21.15.107:0/3190614274 learned_addr learned my addr 172.21.15.107:0/3190614274 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:10:39.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.038+0000 7f4e56ffd640 1 --2- 172.21.15.107:0/3190614274 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4e580fac60 0x7f4e581131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:39.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.038+0000 7f4e567fc640 1 -- 172.21.15.107:0/3190614274 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4e580fac60 msgr2=0x7f4e581131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:39.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.038+0000 7f4e567fc640 1 --2- 172.21.15.107:0/3190614274 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4e580fac60 0x7f4e581131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:39.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.038+0000 7f4e567fc640 1 -- 172.21.15.107:0/3190614274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e48005040 con 0x7f4e581025f0 2024-09-21T08:10:39.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.038+0000 7f4e567fc640 1 --2- 172.21.15.107:0/3190614274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e581025f0 0x7f4e58113710 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4e48000c00 tx=0x7f4e48009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:39.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.038+0000 7f4e3f7fe640 1 -- 172.21.15.107:0/3190614274 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e48038070 con 0x7f4e581025f0 2024-09-21T08:10:39.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.038+0000 7f4e3f7fe640 1 -- 172.21.15.107:0/3190614274 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4e4802ade0 con 0x7f4e581025f0 2024-09-21T08:10:39.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.038+0000 7f4e3f7fe640 1 -- 172.21.15.107:0/3190614274 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e4802c7e0 con 0x7f4e581025f0 2024-09-21T08:10:39.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.038+0000 7f4e5d4e3640 1 -- 172.21.15.107:0/3190614274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5810d3d0 con 0x7f4e581025f0 2024-09-21T08:10:39.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.039+0000 7f4e5d4e3640 1 -- 172.21.15.107:0/3190614274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5810d8c0 con 0x7f4e581025f0 2024-09-21T08:10:39.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.040+0000 7f4e5d4e3640 1 -- 172.21.15.107:0/3190614274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e58065810 con 0x7f4e581025f0 2024-09-21T08:10:39.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.040+0000 7f4e3f7fe640 1 -- 172.21.15.107:0/3190614274 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4e48030020 con 0x7f4e581025f0 2024-09-21T08:10:39.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.041+0000 7f4e3f7fe640 1 --2- 172.21.15.107:0/3190614274 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4e4006e530 0x7f4e400709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:39.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.041+0000 7f4e3f7fe640 1 -- 172.21.15.107:0/3190614274 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f4e480adec0 con 0x7f4e581025f0 2024-09-21T08:10:39.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.041+0000 7f4e56ffd640 1 --2- 172.21.15.107:0/3190614274 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4e4006e530 0x7f4e400709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:39.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.041+0000 7f4e56ffd640 1 --2- 172.21.15.107:0/3190614274 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4e4006e530 0x7f4e400709e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c004fd0 tx=0x7f4e4c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:39.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.045+0000 7f4e3f7fe640 1 -- 172.21.15.107:0/3190614274 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4e48076f90 con 0x7f4e581025f0 2024-09-21T08:10:39.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.285+0000 7f4e5d4e3640 1 -- 172.21.15.107:0/3190614274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4e58109620 con 0x7f4e581025f0 2024-09-21T08:10:39.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.286+0000 7f4e3f7fe640 1 -- 172.21.15.107:0/3190614274 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7f4e4807a650 con 0x7f4e581025f0 2024-09-21T08:10:39.288 INFO:teuthology.orchestra.run.smithi107.stdout:HEALTH_WARN 1 filesystem is degraded 2024-09-21T08:10:39.288 INFO:teuthology.orchestra.run.smithi107.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T08:10:39.288 INFO:teuthology.orchestra.run.smithi107.stdout: fs cephfs is degraded 2024-09-21T08:10:39.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.288+0000 7f4e5d4e3640 1 -- 172.21.15.107:0/3190614274 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4e4006e530 msgr2=0x7f4e400709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:39.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.288+0000 7f4e5d4e3640 1 --2- 172.21.15.107:0/3190614274 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4e4006e530 0x7f4e400709e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c004fd0 tx=0x7f4e4c009040 comp rx=0 tx=0).stop 2024-09-21T08:10:39.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.288+0000 7f4e5d4e3640 1 -- 172.21.15.107:0/3190614274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e581025f0 msgr2=0x7f4e58113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:39.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.288+0000 7f4e5d4e3640 1 --2- 172.21.15.107:0/3190614274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e581025f0 0x7f4e58113710 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4e48000c00 tx=0x7f4e48009da0 comp rx=0 tx=0).stop 2024-09-21T08:10:39.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.288+0000 7f4e5d4e3640 1 -- 172.21.15.107:0/3190614274 shutdown_connections 2024-09-21T08:10:39.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.288+0000 7f4e5d4e3640 1 --2- 172.21.15.107:0/3190614274 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4e4006e530 0x7f4e400709e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:39.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.288+0000 7f4e5d4e3640 1 --2- 172.21.15.107:0/3190614274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e581025f0 0x7f4e58113710 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:39.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.288+0000 7f4e5d4e3640 1 --2- 172.21.15.107:0/3190614274 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4e580fac60 0x7f4e581131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:39.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.288+0000 7f4e5d4e3640 1 -- 172.21.15.107:0/3190614274 >> 172.21.15.107:0/3190614274 conn(0x7f4e58070c80 msgr2=0x7f4e580f9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:39.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.289+0000 7f4e5d4e3640 1 -- 172.21.15.107:0/3190614274 shutdown_connections 2024-09-21T08:10:39.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:10:39.289+0000 7f4e5d4e3640 1 -- 172.21.15.107:0/3190614274 wait complete. 2024-09-21T08:10:39.976 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:39 smithi107 ceph-mon[97757]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:10:39.976 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:39 smithi107 ceph-mon[97757]: mds.? [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] up:rejoin 2024-09-21T08:10:39.976 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:39 smithi107 ceph-mon[97757]: mds.? [v2:172.21.15.107:6828/1321345266,v1:172.21.15.107:6829/1321345266] up:boot 2024-09-21T08:10:39.976 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:39 smithi107 ceph-mon[97757]: fsmap cephfs:1/1 {0=cephfs.smithi129.fwmfcy=up:rejoin} 3 up:standby 2024-09-21T08:10:39.976 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:39 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.grqzkt"}]: dispatch 2024-09-21T08:10:39.976 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:39 smithi107 ceph-mon[97757]: daemon mds.cephfs.smithi129.fwmfcy is now active in filesystem cephfs as rank 0 2024-09-21T08:10:39.976 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:39 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/3190614274' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:10:40.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:39 smithi129 ceph-mon[76722]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:10:40.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:39 smithi129 ceph-mon[76722]: mds.? [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] up:rejoin 2024-09-21T08:10:40.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:39 smithi129 ceph-mon[76722]: mds.? [v2:172.21.15.107:6828/1321345266,v1:172.21.15.107:6829/1321345266] up:boot 2024-09-21T08:10:40.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:39 smithi129 ceph-mon[76722]: fsmap cephfs:1/1 {0=cephfs.smithi129.fwmfcy=up:rejoin} 3 up:standby 2024-09-21T08:10:40.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:39 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.grqzkt"}]: dispatch 2024-09-21T08:10:40.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:39 smithi129 ceph-mon[76722]: daemon mds.cephfs.smithi129.fwmfcy is now active in filesystem cephfs as rank 0 2024-09-21T08:10:40.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:39 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/3190614274' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:10:41.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:40 smithi129 ceph-mon[76722]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:10:41.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:40 smithi129 ceph-mon[76722]: pgmap v187: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-09-21T08:10:41.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:40 smithi129 ceph-mon[76722]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T08:10:41.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:40 smithi129 ceph-mon[76722]: Cluster is now healthy 2024-09-21T08:10:41.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:40 smithi129 ceph-mon[76722]: mds.? [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] up:active 2024-09-21T08:10:41.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:40 smithi129 ceph-mon[76722]: fsmap cephfs:1 {0=cephfs.smithi129.fwmfcy=up:active} 3 up:standby 2024-09-21T08:10:41.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:40 smithi107 ceph-mon[97757]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:10:41.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:40 smithi107 ceph-mon[97757]: pgmap v187: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-09-21T08:10:41.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:40 smithi107 ceph-mon[97757]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T08:10:41.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:40 smithi107 ceph-mon[97757]: Cluster is now healthy 2024-09-21T08:10:41.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:40 smithi107 ceph-mon[97757]: mds.? [v2:172.21.15.129:6824/694369363,v1:172.21.15.129:6825/694369363] up:active 2024-09-21T08:10:41.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:40 smithi107 ceph-mon[97757]: fsmap cephfs:1 {0=cephfs.smithi129.fwmfcy=up:active} 3 up:standby 2024-09-21T08:10:43.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:42 smithi129 ceph-mon[76722]: pgmap v188: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 175 B/s wr, 8 op/s 2024-09-21T08:10:43.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:42 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:43.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:42 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:43.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:42 smithi107 ceph-mon[97757]: pgmap v188: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 175 B/s wr, 8 op/s 2024-09-21T08:10:43.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:42 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:43.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:42 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:44.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:44 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:44.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:44 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:44.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:44 smithi129 ceph-mon[76722]: pgmap v189: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T08:10:44.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:44 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:44.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:44 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:44.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:44 smithi107 ceph-mon[97757]: pgmap v189: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T08:10:45.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:45 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:10:45.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:45 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:10:46.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:46 smithi107 ceph-mon[97757]: pgmap v190: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-09-21T08:10:46.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:46 smithi129 ceph-mon[76722]: pgmap v190: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-09-21T08:10:47.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:47 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:47.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:47 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:47.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:47 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:10:47.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:47 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:10:47.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:47 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:47.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:47 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:10:47.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:47 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:47.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:47 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:47.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:47 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:47.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:47 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:48.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:47 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:48.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:47 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:48.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:47 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:10:48.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:47 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:10:48.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:47 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:48.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:47 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:10:48.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:47 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:48.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:47 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:48.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:47 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:48.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:47 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:10:48.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:48 smithi129 ceph-mon[76722]: pgmap v191: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 8.0 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-09-21T08:10:48.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:48 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:48.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:48 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi129.fwmfcy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:10:48.767 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:48 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:10:49.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:48 smithi107 ceph-mon[97757]: pgmap v191: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 8.0 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-09-21T08:10:49.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:48 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:10:49.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:48 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi129.fwmfcy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:10:49.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:48 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:10:49.751 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:49 smithi129 ceph-mon[76722]: Upgrade: Updating mds.cephfs.smithi129.fwmfcy 2024-09-21T08:10:49.751 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:49 smithi129 ceph-mon[76722]: Deploying daemon mds.cephfs.smithi129.fwmfcy on smithi129 2024-09-21T08:10:49.997 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:49 smithi107 ceph-mon[97757]: Upgrade: Updating mds.cephfs.smithi129.fwmfcy 2024-09-21T08:10:49.997 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:49 smithi107 ceph-mon[97757]: Deploying daemon mds.cephfs.smithi129.fwmfcy on smithi129 2024-09-21T08:10:50.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:49 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107[97753]: 2024-09-21T08:10:49.993+0000 7f7e9585a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:10:50.516 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:10:50 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3[85557]: 2024-09-21T08:10:50.017+0000 7fc451b64640 -1 bdev(0x5563465a2c00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 11 2024-09-21T08:10:50.516 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:10:50 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3[85557]: 2024-09-21T08:10:50.017+0000 7fc450361640 -1 bdev(0x5563465a2c00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 11 2024-09-21T08:10:51.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:50 smithi129 ceph-mon[76722]: pgmap v192: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 644 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-21T08:10:51.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:50 smithi129 ceph-mon[76722]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T08:10:51.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:50 smithi129 ceph-mon[76722]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:10:51.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:50 smithi129 ceph-mon[76722]: osdmap e92: 6 total, 6 up, 6 in 2024-09-21T08:10:51.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:50 smithi129 ceph-mon[76722]: Standby daemon mds.cephfs.smithi129.belyba assigned to filesystem cephfs as rank 0 2024-09-21T08:10:51.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:50 smithi129 ceph-mon[76722]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T08:10:51.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:50 smithi129 ceph-mon[76722]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T08:10:51.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:50 smithi129 ceph-mon[76722]: fsmap cephfs:1/1 {0=cephfs.smithi129.belyba=up:replay} 2 up:standby 2024-09-21T08:10:51.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:50 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.fwmfcy"}]: dispatch 2024-09-21T08:10:51.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:50 smithi107 ceph-mon[97757]: pgmap v192: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 644 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-21T08:10:51.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:50 smithi107 ceph-mon[97757]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T08:10:51.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:50 smithi107 ceph-mon[97757]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:10:51.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:50 smithi107 ceph-mon[97757]: osdmap e92: 6 total, 6 up, 6 in 2024-09-21T08:10:51.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:50 smithi107 ceph-mon[97757]: Standby daemon mds.cephfs.smithi129.belyba assigned to filesystem cephfs as rank 0 2024-09-21T08:10:51.056 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:50 smithi107 ceph-mon[97757]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T08:10:51.056 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:50 smithi107 ceph-mon[97757]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T08:10:51.056 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:50 smithi107 ceph-mon[97757]: fsmap cephfs:1/1 {0=cephfs.smithi129.belyba=up:replay} 2 up:standby 2024-09-21T08:10:51.056 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:50 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.fwmfcy"}]: dispatch 2024-09-21T08:10:53.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:52 smithi129 ceph-mon[76722]: pgmap v194: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 5.0 KiB/s wr, 4 op/s 2024-09-21T08:10:53.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:52 smithi107 ceph-mon[97757]: pgmap v194: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 5.0 KiB/s wr, 4 op/s 2024-09-21T08:10:55.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:54 smithi129 ceph-mon[76722]: pgmap v195: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 5.0 KiB/s wr, 4 op/s 2024-09-21T08:10:55.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:54 smithi107 ceph-mon[97757]: pgmap v195: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 5.0 KiB/s wr, 4 op/s 2024-09-21T08:10:57.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:56 smithi129 ceph-mon[76722]: pgmap v196: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 9.2 MiB/s rd, 3 op/s 2024-09-21T08:10:57.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:56 smithi107 ceph-mon[97757]: pgmap v196: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 9.2 MiB/s rd, 3 op/s 2024-09-21T08:10:59.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:58 smithi129 ceph-mon[76722]: pgmap v197: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-21T08:10:59.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:58 smithi129 ceph-mon[76722]: reconnect by client.14494 v1:172.21.15.129:0/3058185692 after 0.000999978 2024-09-21T08:10:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:58 smithi129 ceph-mon[76722]: mds.? [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] up:reconnect 2024-09-21T08:10:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:58 smithi129 ceph-mon[76722]: fsmap cephfs:1/1 {0=cephfs.smithi129.belyba=up:reconnect} 2 up:standby 2024-09-21T08:10:59.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:58 smithi129 ceph-mon[76722]: reconnect by client.24269 v1:172.21.15.107:0/2727935843 after 0.00399991 2024-09-21T08:10:59.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:58 smithi107 ceph-mon[97757]: pgmap v197: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-21T08:10:59.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:58 smithi107 ceph-mon[97757]: reconnect by client.14494 v1:172.21.15.129:0/3058185692 after 0.000999978 2024-09-21T08:10:59.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:58 smithi107 ceph-mon[97757]: mds.? [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] up:reconnect 2024-09-21T08:10:59.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:58 smithi107 ceph-mon[97757]: fsmap cephfs:1/1 {0=cephfs.smithi129.belyba=up:reconnect} 2 up:standby 2024-09-21T08:10:59.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:58 smithi107 ceph-mon[97757]: reconnect by client.24269 v1:172.21.15.107:0/2727935843 after 0.00399991 2024-09-21T08:11:00.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:59 smithi129 ceph-mon[76722]: mds.? [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] up:rejoin 2024-09-21T08:11:00.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:59 smithi129 ceph-mon[76722]: fsmap cephfs:1/1 {0=cephfs.smithi129.belyba=up:rejoin} 2 up:standby 2024-09-21T08:11:00.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:59 smithi129 ceph-mon[76722]: daemon mds.cephfs.smithi129.belyba is now active in filesystem cephfs as rank 0 2024-09-21T08:11:00.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:00.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:10:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:11:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:59 smithi107 ceph-mon[97757]: mds.? [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] up:rejoin 2024-09-21T08:11:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:59 smithi107 ceph-mon[97757]: fsmap cephfs:1/1 {0=cephfs.smithi129.belyba=up:rejoin} 2 up:standby 2024-09-21T08:11:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:59 smithi107 ceph-mon[97757]: daemon mds.cephfs.smithi129.belyba is now active in filesystem cephfs as rank 0 2024-09-21T08:11:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:10:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:11:00.949 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:00 smithi129 ceph-mon[76722]: pgmap v198: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-09-21T08:11:00.949 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:00 smithi129 ceph-mon[76722]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T08:11:00.949 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:00 smithi129 ceph-mon[76722]: Cluster is now healthy 2024-09-21T08:11:00.949 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:00 smithi129 ceph-mon[76722]: mds.? [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] up:active 2024-09-21T08:11:00.949 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:00 smithi129 ceph-mon[76722]: fsmap cephfs:1 {0=cephfs.smithi129.belyba=up:active} 2 up:standby 2024-09-21T08:11:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:00 smithi107 ceph-mon[97757]: pgmap v198: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-09-21T08:11:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:00 smithi107 ceph-mon[97757]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T08:11:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:00 smithi107 ceph-mon[97757]: Cluster is now healthy 2024-09-21T08:11:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:00 smithi107 ceph-mon[97757]: mds.? [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] up:active 2024-09-21T08:11:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:00 smithi107 ceph-mon[97757]: fsmap cephfs:1 {0=cephfs.smithi129.belyba=up:active} 2 up:standby 2024-09-21T08:11:02.654 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:02 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:02.655 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:02 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:02.655 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:02 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:11:02.655 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:02 smithi129 ceph-mon[76722]: pgmap v199: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 175 B/s wr, 8 op/s 2024-09-21T08:11:02.655 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:02 smithi129 ceph-mon[76722]: mds.? [v2:172.21.15.129:6824/4074709540,v1:172.21.15.129:6825/4074709540] up:boot 2024-09-21T08:11:02.655 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:02 smithi129 ceph-mon[76722]: fsmap cephfs:1 {0=cephfs.smithi129.belyba=up:active} 3 up:standby 2024-09-21T08:11:02.655 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:02 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.fwmfcy"}]: dispatch 2024-09-21T08:11:02.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:02 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:02.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:02 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:02.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:02 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:11:02.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:02 smithi107 ceph-mon[97757]: pgmap v199: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 175 B/s wr, 8 op/s 2024-09-21T08:11:02.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:02 smithi107 ceph-mon[97757]: mds.? [v2:172.21.15.129:6824/4074709540,v1:172.21.15.129:6825/4074709540] up:boot 2024-09-21T08:11:02.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:02 smithi107 ceph-mon[97757]: fsmap cephfs:1 {0=cephfs.smithi129.belyba=up:active} 3 up:standby 2024-09-21T08:11:02.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:02 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.fwmfcy"}]: dispatch 2024-09-21T08:11:05.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:04 smithi129 ceph-mon[76722]: pgmap v200: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T08:11:05.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:04 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:05.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:04 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:05.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:04 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:05.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:04 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:05.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:04 smithi107 ceph-mon[97757]: pgmap v200: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T08:11:05.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:04 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:05.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:04 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:05.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:04 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:05.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:04 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:07.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:06 smithi129 ceph-mon[76722]: pgmap v201: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-09-21T08:11:07.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:06 smithi107 ceph-mon[97757]: pgmap v201: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-09-21T08:11:09.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:08 smithi129 ceph-mon[76722]: pgmap v202: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 8.6 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-09-21T08:11:09.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:08 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:09.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:08 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:09.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:08 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:11:09.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:08 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:11:09.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:08 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:09.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:08 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:11:09.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:08 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:09.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:08 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:09.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:08 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:09.019 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:08 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:09.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:08 smithi107 ceph-mon[97757]: pgmap v202: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 8.6 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-09-21T08:11:09.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:08 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:09.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:08 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:09.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:08 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:11:09.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:08 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:11:09.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:08 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:09.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:08 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:11:09.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:08 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:09.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:08 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:09.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:08 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:09.055 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:08 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:09.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.372+0000 7f748839d640 1 -- 172.21.15.107:0/3920788196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74800fdf60 msgr2=0x7f7480106630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:09.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.372+0000 7f748839d640 1 --2- 172.21.15.107:0/3920788196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74800fdf60 0x7f7480106630 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f74700048d0 tx=0x7f7470009da0 comp rx=0 tx=0).stop 2024-09-21T08:11:09.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.372+0000 7f748839d640 1 -- 172.21.15.107:0/3920788196 shutdown_connections 2024-09-21T08:11:09.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.372+0000 7f748839d640 1 --2- 172.21.15.107:0/3920788196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74800fdf60 0x7f7480106630 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:09.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.372+0000 7f748839d640 1 --2- 172.21.15.107:0/3920788196 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f74800fd5c0 0x7f74800fd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:09.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.372+0000 7f748839d640 1 -- 172.21.15.107:0/3920788196 >> 172.21.15.107:0/3920788196 conn(0x7f74800f7060 msgr2=0x7f74800f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:09.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.372+0000 7f748839d640 1 -- 172.21.15.107:0/3920788196 shutdown_connections 2024-09-21T08:11:09.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.372+0000 7f748839d640 1 -- 172.21.15.107:0/3920788196 wait complete. 2024-09-21T08:11:09.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.373+0000 7f748839d640 1 Processor -- start 2024-09-21T08:11:09.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.373+0000 7f748839d640 1 -- start start 2024-09-21T08:11:09.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.373+0000 7f748839d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74800fd5c0 0x7f74800fb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:09.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.373+0000 7f748839d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f74800fdf60 0x7f74800fb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:09.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.373+0000 7f748839d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74800fbf00 con 0x7f74800fd5c0 2024-09-21T08:11:09.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.373+0000 7f748839d640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74800fc070 con 0x7f74800fdf60 2024-09-21T08:11:09.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.373+0000 7f7486139640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74800fd5c0 0x7f74800fb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:09.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.373+0000 7f7486139640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74800fd5c0 0x7f74800fb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58244/0 (socket says 172.21.15.107:58244) 2024-09-21T08:11:09.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.373+0000 7f7486139640 1 -- 172.21.15.107:0/3285851252 learned_addr learned my addr 172.21.15.107:0/3285851252 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:11:09.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.373+0000 7f7485938640 1 --2- 172.21.15.107:0/3285851252 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f74800fdf60 0x7f74800fb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:09.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.373+0000 7f7486139640 1 -- 172.21.15.107:0/3285851252 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f74800fdf60 msgr2=0x7f74800fb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:09.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.373+0000 7f7486139640 1 --2- 172.21.15.107:0/3285851252 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f74800fdf60 0x7f74800fb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:09.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.373+0000 7f7486139640 1 -- 172.21.15.107:0/3285851252 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7470005040 con 0x7f74800fd5c0 2024-09-21T08:11:09.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.374+0000 7f7486139640 1 --2- 172.21.15.107:0/3285851252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74800fd5c0 0x7f74800fb480 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f747c002a50 tx=0x7f747c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:09.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.374+0000 7f7476ffd640 1 -- 172.21.15.107:0/3285851252 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f747c007c30 con 0x7f74800fd5c0 2024-09-21T08:11:09.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.374+0000 7f7476ffd640 1 -- 172.21.15.107:0/3285851252 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f747c00f040 con 0x7f74800fd5c0 2024-09-21T08:11:09.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.374+0000 7f748839d640 1 -- 172.21.15.107:0/3285851252 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74800fc300 con 0x7f74800fd5c0 2024-09-21T08:11:09.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.374+0000 7f7476ffd640 1 -- 172.21.15.107:0/3285851252 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f747c00da10 con 0x7f74800fd5c0 2024-09-21T08:11:09.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.374+0000 7f748839d640 1 -- 172.21.15.107:0/3285851252 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7480119910 con 0x7f74800fd5c0 2024-09-21T08:11:09.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.375+0000 7f748839d640 1 -- 172.21.15.107:0/3285851252 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7480066290 con 0x7f74800fd5c0 2024-09-21T08:11:09.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.375+0000 7f7476ffd640 1 -- 172.21.15.107:0/3285851252 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f747c00dbb0 con 0x7f74800fd5c0 2024-09-21T08:11:09.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.376+0000 7f7476ffd640 1 --2- 172.21.15.107:0/3285851252 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f746c06e530 0x7f746c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:09.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.376+0000 7f7485938640 1 --2- 172.21.15.107:0/3285851252 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f746c06e530 0x7f746c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:09.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.376+0000 7f7476ffd640 1 -- 172.21.15.107:0/3285851252 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6786+0+0 (secure 0 0 0) 0x7f747c08dab0 con 0x7f74800fd5c0 2024-09-21T08:11:09.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.376+0000 7f7485938640 1 --2- 172.21.15.107:0/3285851252 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f746c06e530 0x7f746c0709e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7470004540 tx=0x7f7470035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:09.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.380+0000 7f7476ffd640 1 -- 172.21.15.107:0/3285851252 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f747c08fe60 con 0x7f74800fd5c0 2024-09-21T08:11:09.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.565+0000 7f748839d640 1 -- 172.21.15.107:0/3285851252 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f74800fcb70 con 0x7f746c06e530 2024-09-21T08:11:09.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.566+0000 7f7476ffd640 1 -- 172.21.15.107:0/3285851252 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f74800fcb70 con 0x7f746c06e530 2024-09-21T08:11:09.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.568+0000 7f748839d640 1 -- 172.21.15.107:0/3285851252 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f746c06e530 msgr2=0x7f746c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:09.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.568+0000 7f748839d640 1 --2- 172.21.15.107:0/3285851252 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f746c06e530 0x7f746c0709e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7470004540 tx=0x7f7470035040 comp rx=0 tx=0).stop 2024-09-21T08:11:09.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.568+0000 7f748839d640 1 -- 172.21.15.107:0/3285851252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74800fd5c0 msgr2=0x7f74800fb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:09.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.568+0000 7f748839d640 1 --2- 172.21.15.107:0/3285851252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74800fd5c0 0x7f74800fb480 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f747c002a50 tx=0x7f747c004600 comp rx=0 tx=0).stop 2024-09-21T08:11:09.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.568+0000 7f748839d640 1 -- 172.21.15.107:0/3285851252 shutdown_connections 2024-09-21T08:11:09.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.568+0000 7f748839d640 1 --2- 172.21.15.107:0/3285851252 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f746c06e530 0x7f746c0709e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:09.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.568+0000 7f748839d640 1 --2- 172.21.15.107:0/3285851252 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f74800fdf60 0x7f74800fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:09.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.568+0000 7f748839d640 1 --2- 172.21.15.107:0/3285851252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74800fd5c0 0x7f74800fb480 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:09.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.568+0000 7f748839d640 1 -- 172.21.15.107:0/3285851252 >> 172.21.15.107:0/3285851252 conn(0x7f74800f7060 msgr2=0x7f7480100fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:09.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.568+0000 7f748839d640 1 -- 172.21.15.107:0/3285851252 shutdown_connections 2024-09-21T08:11:09.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.568+0000 7f748839d640 1 -- 172.21.15.107:0/3285851252 wait complete. 2024-09-21T08:11:09.578 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:11:09.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.647+0000 7feced053640 1 -- 172.21.15.107:0/4284030017 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fece8102ed0 msgr2=0x7fece80fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:09.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.647+0000 7feced053640 1 --2- 172.21.15.107:0/4284030017 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fece8102ed0 0x7fece80fc590 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fecd00048d0 tx=0x7fecd0009da0 comp rx=0 tx=0).stop 2024-09-21T08:11:09.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.647+0000 7feced053640 1 -- 172.21.15.107:0/4284030017 shutdown_connections 2024-09-21T08:11:09.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.647+0000 7feced053640 1 --2- 172.21.15.107:0/4284030017 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fece8102ed0 0x7fece80fc590 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:09.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.647+0000 7feced053640 1 --2- 172.21.15.107:0/4284030017 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fece8102530 0x7fece8102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:09.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.647+0000 7feced053640 1 -- 172.21.15.107:0/4284030017 >> 172.21.15.107:0/4284030017 conn(0x7fece80f80f0 msgr2=0x7fece80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:09.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.648+0000 7feced053640 1 -- 172.21.15.107:0/4284030017 shutdown_connections 2024-09-21T08:11:09.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.648+0000 7feced053640 1 -- 172.21.15.107:0/4284030017 wait complete. 2024-09-21T08:11:09.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.648+0000 7feced053640 1 Processor -- start 2024-09-21T08:11:09.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.648+0000 7feced053640 1 -- start start 2024-09-21T08:11:09.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.648+0000 7feced053640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fece8102530 0x7fece81132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:09.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.648+0000 7feced053640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fece8102ed0 0x7fece81137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:09.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.648+0000 7feced053640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece8113e80 con 0x7fece8102530 2024-09-21T08:11:09.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.648+0000 7feced053640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece810d230 con 0x7fece8102ed0 2024-09-21T08:11:09.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.648+0000 7fece6d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fece8102530 0x7fece81132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:09.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.648+0000 7fece6d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fece8102530 0x7fece81132b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58262/0 (socket says 172.21.15.107:58262) 2024-09-21T08:11:09.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.648+0000 7fece6d9d640 1 -- 172.21.15.107:0/4049639716 learned_addr learned my addr 172.21.15.107:0/4049639716 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:11:09.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.648+0000 7fecdffff640 1 --2- 172.21.15.107:0/4049639716 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fece8102ed0 0x7fece81137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:09.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.649+0000 7fece6d9d640 1 -- 172.21.15.107:0/4049639716 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fece8102ed0 msgr2=0x7fece81137f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:09.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.649+0000 7fece6d9d640 1 --2- 172.21.15.107:0/4049639716 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fece8102ed0 0x7fece81137f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:09.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.649+0000 7fece6d9d640 1 -- 172.21.15.107:0/4049639716 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd0005040 con 0x7fece8102530 2024-09-21T08:11:09.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.649+0000 7fecdffff640 1 --2- 172.21.15.107:0/4049639716 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fece8102ed0 0x7fece81137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:11:09.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.649+0000 7fece6d9d640 1 --2- 172.21.15.107:0/4049639716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fece8102530 0x7fece81132b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fecd800b790 tx=0x7fecd80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:09.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.649+0000 7fecdf7fe640 1 -- 172.21.15.107:0/4049639716 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecd800c700 con 0x7fece8102530 2024-09-21T08:11:09.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.649+0000 7feced053640 1 -- 172.21.15.107:0/4049639716 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece810d510 con 0x7fece8102530 2024-09-21T08:11:09.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.649+0000 7fecdf7fe640 1 -- 172.21.15.107:0/4049639716 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fecd800cd00 con 0x7fece8102530 2024-09-21T08:11:09.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.649+0000 7fecdf7fe640 1 -- 172.21.15.107:0/4049639716 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecd8015e70 con 0x7fece8102530 2024-09-21T08:11:09.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.649+0000 7feced053640 1 -- 172.21.15.107:0/4049639716 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece810da00 con 0x7fece8102530 2024-09-21T08:11:09.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.650+0000 7feced053640 1 -- 172.21.15.107:0/4049639716 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece80fdcb0 con 0x7fece8102530 2024-09-21T08:11:09.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.651+0000 7fecdf7fe640 1 -- 172.21.15.107:0/4049639716 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fecd8012070 con 0x7fece8102530 2024-09-21T08:11:09.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.651+0000 7fecdf7fe640 1 --2- 172.21.15.107:0/4049639716 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fecd406e530 0x7fecd40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:09.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.651+0000 7fecdf7fe640 1 -- 172.21.15.107:0/4049639716 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6786+0+0 (secure 0 0 0) 0x7fecd808deb0 con 0x7fece8102530 2024-09-21T08:11:09.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.651+0000 7fecdffff640 1 --2- 172.21.15.107:0/4049639716 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fecd406e530 0x7fecd40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:09.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.652+0000 7fecdffff640 1 --2- 172.21.15.107:0/4049639716 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fecd406e530 0x7fecd40709e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fecd0000c00 tx=0x7fecd0035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:09.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.656+0000 7fecdf7fe640 1 -- 172.21.15.107:0/4049639716 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fecd8056e70 con 0x7fece8102530 2024-09-21T08:11:09.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.839+0000 7feced053640 1 -- 172.21.15.107:0/4049639716 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fece804b7b0 con 0x7fecd406e530 2024-09-21T08:11:09.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.841+0000 7fecdf7fe640 1 -- 172.21.15.107:0/4049639716 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fece804b7b0 con 0x7fecd406e530 2024-09-21T08:11:09.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.843+0000 7feced053640 1 -- 172.21.15.107:0/4049639716 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fecd406e530 msgr2=0x7fecd40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:09.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.843+0000 7feced053640 1 --2- 172.21.15.107:0/4049639716 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fecd406e530 0x7fecd40709e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fecd0000c00 tx=0x7fecd0035040 comp rx=0 tx=0).stop 2024-09-21T08:11:09.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.843+0000 7feced053640 1 -- 172.21.15.107:0/4049639716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fece8102530 msgr2=0x7fece81132b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:09.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.843+0000 7feced053640 1 --2- 172.21.15.107:0/4049639716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fece8102530 0x7fece81132b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fecd800b790 tx=0x7fecd80091d0 comp rx=0 tx=0).stop 2024-09-21T08:11:09.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.843+0000 7feced053640 1 -- 172.21.15.107:0/4049639716 shutdown_connections 2024-09-21T08:11:09.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.843+0000 7feced053640 1 --2- 172.21.15.107:0/4049639716 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fecd406e530 0x7fecd40709e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:09.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.843+0000 7feced053640 1 --2- 172.21.15.107:0/4049639716 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fece8102ed0 0x7fece81137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:09.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.843+0000 7feced053640 1 --2- 172.21.15.107:0/4049639716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fece8102530 0x7fece81132b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:09.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.843+0000 7feced053640 1 -- 172.21.15.107:0/4049639716 >> 172.21.15.107:0/4049639716 conn(0x7fece80f80f0 msgr2=0x7fece80f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:09.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.843+0000 7feced053640 1 -- 172.21.15.107:0/4049639716 shutdown_connections 2024-09-21T08:11:09.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.843+0000 7feced053640 1 -- 172.21.15.107:0/4049639716 wait complete. 2024-09-21T08:11:09.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.921+0000 7f3052904640 1 -- 172.21.15.107:0/445901311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f304c0fac60 msgr2=0x7f304c0fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:09.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.921+0000 7f3052904640 1 --2- 172.21.15.107:0/445901311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f304c0fac60 0x7f304c0fb0b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f30400048d0 tx=0x7f3040009da0 comp rx=0 tx=0).stop 2024-09-21T08:11:09.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.921+0000 7f3052904640 1 -- 172.21.15.107:0/445901311 shutdown_connections 2024-09-21T08:11:09.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.921+0000 7f3052904640 1 --2- 172.21.15.107:0/445901311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f304c0fac60 0x7f304c0fb0b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:09.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.921+0000 7f3052904640 1 --2- 172.21.15.107:0/445901311 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f304c1025f0 0x7f304c1029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:09.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.921+0000 7f3052904640 1 -- 172.21.15.107:0/445901311 >> 172.21.15.107:0/445901311 conn(0x7f304c070c80 msgr2=0x7f304c071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:09.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.921+0000 7f3052904640 1 -- 172.21.15.107:0/445901311 shutdown_connections 2024-09-21T08:11:09.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.921+0000 7f3052904640 1 -- 172.21.15.107:0/445901311 wait complete. 2024-09-21T08:11:09.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.922+0000 7f3052904640 1 Processor -- start 2024-09-21T08:11:09.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.922+0000 7f3052904640 1 -- start start 2024-09-21T08:11:09.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.922+0000 7f3052904640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f304c0fac60 0x7f304c1131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:09.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.922+0000 7f3052904640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f304c1025f0 0x7f304c113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:09.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.922+0000 7f3052904640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c113d10 con 0x7f304c0fac60 2024-09-21T08:11:09.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.922+0000 7f3052904640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c10d150 con 0x7f304c1025f0 2024-09-21T08:11:09.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.922+0000 7f304bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f304c0fac60 0x7f304c1131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:09.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.922+0000 7f304bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f304c0fac60 0x7f304c1131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58284/0 (socket says 172.21.15.107:58284) 2024-09-21T08:11:09.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.922+0000 7f304bfff640 1 -- 172.21.15.107:0/2023946485 learned_addr learned my addr 172.21.15.107:0/2023946485 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:11:09.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.922+0000 7f304b7fe640 1 --2- 172.21.15.107:0/2023946485 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f304c1025f0 0x7f304c113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:09.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.922+0000 7f304bfff640 1 -- 172.21.15.107:0/2023946485 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f304c1025f0 msgr2=0x7f304c113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:09.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.922+0000 7f304bfff640 1 --2- 172.21.15.107:0/2023946485 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f304c1025f0 0x7f304c113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:09.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.922+0000 7f304bfff640 1 -- 172.21.15.107:0/2023946485 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3040005040 con 0x7f304c0fac60 2024-09-21T08:11:09.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.923+0000 7f304bfff640 1 --2- 172.21.15.107:0/2023946485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f304c0fac60 0x7f304c1131d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f303c002a50 tx=0x7f303c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:09.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.923+0000 7f3048ff9640 1 -- 172.21.15.107:0/2023946485 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f303c007c30 con 0x7f304c0fac60 2024-09-21T08:11:09.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.923+0000 7f3052904640 1 -- 172.21.15.107:0/2023946485 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304c10d430 con 0x7f304c0fac60 2024-09-21T08:11:09.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.923+0000 7f3048ff9640 1 -- 172.21.15.107:0/2023946485 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f303c00f040 con 0x7f304c0fac60 2024-09-21T08:11:09.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.923+0000 7f3048ff9640 1 -- 172.21.15.107:0/2023946485 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f303c00dad0 con 0x7f304c0fac60 2024-09-21T08:11:09.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.923+0000 7f3052904640 1 -- 172.21.15.107:0/2023946485 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c10d9a0 con 0x7f304c0fac60 2024-09-21T08:11:09.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.924+0000 7f3052904640 1 -- 172.21.15.107:0/2023946485 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304c065810 con 0x7f304c0fac60 2024-09-21T08:11:09.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.924+0000 7f3048ff9640 1 -- 172.21.15.107:0/2023946485 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f303c00dc30 con 0x7f304c0fac60 2024-09-21T08:11:09.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.925+0000 7f3048ff9640 1 --2- 172.21.15.107:0/2023946485 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f303406e530 0x7f30340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:09.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.925+0000 7f3048ff9640 1 -- 172.21.15.107:0/2023946485 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6786+0+0 (secure 0 0 0) 0x7f303c08e080 con 0x7f304c0fac60 2024-09-21T08:11:09.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.925+0000 7f304b7fe640 1 --2- 172.21.15.107:0/2023946485 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f303406e530 0x7f30340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:09.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.925+0000 7f304b7fe640 1 --2- 172.21.15.107:0/2023946485 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f303406e530 0x7f30340709e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3040009ac0 tx=0x7f3040035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:09.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:09.929+0000 7f3048ff9640 1 -- 172.21.15.107:0/2023946485 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f303c0570c0 con 0x7f304c0fac60 2024-09-21T08:11:10.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.105+0000 7f3052904640 1 -- 172.21.15.107:0/2023946485 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f304c04b720 con 0x7f303406e530 2024-09-21T08:11:10.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.114+0000 7f3048ff9640 1 -- 172.21.15.107:0/2023946485 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f304c04b720 con 0x7f303406e530 2024-09-21T08:11:10.115 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:11:10.115 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (8m) 27s ago 16m 26.1M - 0.25.0 c8568f914cd2 2b499aa3b7de 2024-09-21T08:11:10.115 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (4m) 27s ago 16m 6899k - 19.1.1-367-g9e2ac70b cc9251b744a3 69be0e9aa842 2024-09-21T08:11:10.115 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (4m) 6s ago 15m 6891k - 19.1.1-367-g9e2ac70b cc9251b744a3 926ed03c78b9 2024-09-21T08:11:10.115 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (6m) 27s ago 16m 81.8M - 9.4.12 2bacad6d85d8 63177dcfe25c 2024-09-21T08:11:10.115 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (32s) 27s ago 10m 12.2M - 19.1.1-367-g9e2ac70b cc9251b744a3 8ff45e194d69 2024-09-21T08:11:10.116 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (54s) 27s ago 11m 14.6M - 19.1.1-367-g9e2ac70b cc9251b744a3 d0c1d4b4a46b 2024-09-21T08:11:10.116 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (10m) 6s ago 10m 81.5M - 17.2.7-1649-gfbd1a6ab fc3ec4a4f6be 329346c3afec 2024-09-21T08:11:10.116 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (9s) 6s ago 10m 11.1M - 19.1.1-367-g9e2ac70b cc9251b744a3 bef6b8069b3b 2024-09-21T08:11:10.116 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:8443,9283,8765 running (7m) 27s ago 17m 503M - 19.1.1-367-g9e2ac70b cc9251b744a3 49c237734f07 2024-09-21T08:11:10.116 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283,8765 running (6m) 6s ago 15m 442M - 19.1.1-367-g9e2ac70b cc9251b744a3 ed117096bdd8 2024-09-21T08:11:10.116 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (5m) 27s ago 17m 49.6M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 445b3e6a800f 2024-09-21T08:11:10.116 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (4m) 6s ago 15m 38.6M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 12706f823621 2024-09-21T08:11:10.116 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 running (8m) 27s ago 16m 16.6M - 1.5.0 0da6a335fe13 6de7c307ba0f 2024-09-21T08:11:10.116 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (7m) 6s ago 15m 16.7M - 1.5.0 0da6a335fe13 cb6d4577b24c 2024-09-21T08:11:10.116 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (3m) 27s ago 14m 158M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 d0a742b31d8a 2024-09-21T08:11:10.116 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (3m) 27s ago 14m 149M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 4bb3f4c8f75a 2024-09-21T08:11:10.116 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (2m) 27s ago 13m 215M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 15f45fa18e64 2024-09-21T08:11:10.116 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (2m) 6s ago 13m 124M 2581M 19.1.1-367-g9e2ac70b cc9251b744a3 ee4efea3e442 2024-09-21T08:11:10.116 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (101s) 6s ago 12m 111M 2581M 19.1.1-367-g9e2ac70b cc9251b744a3 0d09ba7072ba 2024-09-21T08:11:10.117 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (68s) 6s ago 12m 134M 2581M 19.1.1-367-g9e2ac70b cc9251b744a3 caf3fc8cc3f1 2024-09-21T08:11:10.117 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (6m) 27s ago 15m 61.9M - 2.43.0 a07b618ecd1d 9ed2abf5e8d8 2024-09-21T08:11:10.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.116+0000 7f3052904640 1 -- 172.21.15.107:0/2023946485 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f303406e530 msgr2=0x7f30340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:10.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.116+0000 7f3052904640 1 --2- 172.21.15.107:0/2023946485 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f303406e530 0x7f30340709e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3040009ac0 tx=0x7f3040035040 comp rx=0 tx=0).stop 2024-09-21T08:11:10.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.116+0000 7f3052904640 1 -- 172.21.15.107:0/2023946485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f304c0fac60 msgr2=0x7f304c1131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:10.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.116+0000 7f3052904640 1 --2- 172.21.15.107:0/2023946485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f304c0fac60 0x7f304c1131d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f303c002a50 tx=0x7f303c004600 comp rx=0 tx=0).stop 2024-09-21T08:11:10.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.116+0000 7f3052904640 1 -- 172.21.15.107:0/2023946485 shutdown_connections 2024-09-21T08:11:10.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.116+0000 7f3052904640 1 --2- 172.21.15.107:0/2023946485 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f303406e530 0x7f30340709e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.116+0000 7f3052904640 1 --2- 172.21.15.107:0/2023946485 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f304c1025f0 0x7f304c113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.116+0000 7f3052904640 1 --2- 172.21.15.107:0/2023946485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f304c0fac60 0x7f304c1131d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.116+0000 7f3052904640 1 -- 172.21.15.107:0/2023946485 >> 172.21.15.107:0/2023946485 conn(0x7f304c070c80 msgr2=0x7f304c0f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:10.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.116+0000 7f3052904640 1 -- 172.21.15.107:0/2023946485 shutdown_connections 2024-09-21T08:11:10.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.116+0000 7f3052904640 1 -- 172.21.15.107:0/2023946485 wait complete. 2024-09-21T08:11:10.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.194+0000 7ff1ee859640 1 -- 172.21.15.107:0/2762328772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1e80fb810 msgr2=0x7ff1e80fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:10.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.194+0000 7ff1ee859640 1 --2- 172.21.15.107:0/2762328772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1e80fb810 0x7ff1e80fbbe0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80048d0 tx=0x7ff1d8009da0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.194+0000 7ff1ee859640 1 -- 172.21.15.107:0/2762328772 shutdown_connections 2024-09-21T08:11:10.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.194+0000 7ff1ee859640 1 --2- 172.21.15.107:0/2762328772 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff1e80fcf80 0x7ff1e80fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.194+0000 7ff1ee859640 1 --2- 172.21.15.107:0/2762328772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1e80fb810 0x7ff1e80fbbe0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.194+0000 7ff1ee859640 1 -- 172.21.15.107:0/2762328772 >> 172.21.15.107:0/2762328772 conn(0x7ff1e80723b0 msgr2=0x7ff1e80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:10.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.194+0000 7ff1ee859640 1 -- 172.21.15.107:0/2762328772 shutdown_connections 2024-09-21T08:11:10.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.194+0000 7ff1ee859640 1 -- 172.21.15.107:0/2762328772 wait complete. 2024-09-21T08:11:10.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.194+0000 7ff1ee859640 1 Processor -- start 2024-09-21T08:11:10.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.194+0000 7ff1ee859640 1 -- start start 2024-09-21T08:11:10.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.195+0000 7ff1ee859640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1e80fb810 0x7ff1e81131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:10.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.195+0000 7ff1ee859640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff1e80fcf80 0x7ff1e8113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:10.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.195+0000 7ff1ee859640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e8113d20 con 0x7ff1e80fb810 2024-09-21T08:11:10.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.195+0000 7ff1ee859640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e810d1b0 con 0x7ff1e80fcf80 2024-09-21T08:11:10.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.195+0000 7ff1e7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1e80fb810 0x7ff1e81131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:10.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.195+0000 7ff1e7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1e80fb810 0x7ff1e81131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58292/0 (socket says 172.21.15.107:58292) 2024-09-21T08:11:10.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.195+0000 7ff1e7fff640 1 -- 172.21.15.107:0/996458057 learned_addr learned my addr 172.21.15.107:0/996458057 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:11:10.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.195+0000 7ff1e77fe640 1 --2- 172.21.15.107:0/996458057 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff1e80fcf80 0x7ff1e8113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:10.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.195+0000 7ff1e7fff640 1 -- 172.21.15.107:0/996458057 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff1e80fcf80 msgr2=0x7ff1e8113720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:10.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.195+0000 7ff1e7fff640 1 --2- 172.21.15.107:0/996458057 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff1e80fcf80 0x7ff1e8113720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.195+0000 7ff1e7fff640 1 -- 172.21.15.107:0/996458057 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d8005040 con 0x7ff1e80fb810 2024-09-21T08:11:10.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.195+0000 7ff1e7fff640 1 --2- 172.21.15.107:0/996458057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1e80fb810 0x7ff1e81131e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8000c00 tx=0x7ff1d8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:10.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.195+0000 7ff1e4ff9640 1 -- 172.21.15.107:0/996458057 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1d8038070 con 0x7ff1e80fb810 2024-09-21T08:11:10.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.195+0000 7ff1e4ff9640 1 -- 172.21.15.107:0/996458057 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff1d802ade0 con 0x7ff1e80fb810 2024-09-21T08:11:10.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.195+0000 7ff1ee859640 1 -- 172.21.15.107:0/996458057 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e810d430 con 0x7ff1e80fb810 2024-09-21T08:11:10.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.195+0000 7ff1e4ff9640 1 -- 172.21.15.107:0/996458057 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1d802c7b0 con 0x7ff1e80fb810 2024-09-21T08:11:10.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.195+0000 7ff1ee859640 1 -- 172.21.15.107:0/996458057 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e810d970 con 0x7ff1e80fb810 2024-09-21T08:11:10.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.196+0000 7ff1ee859640 1 -- 172.21.15.107:0/996458057 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e80fcbc0 con 0x7ff1e80fb810 2024-09-21T08:11:10.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.197+0000 7ff1e4ff9640 1 -- 172.21.15.107:0/996458057 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff1d8030020 con 0x7ff1e80fb810 2024-09-21T08:11:10.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.197+0000 7ff1e4ff9640 1 --2- 172.21.15.107:0/996458057 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff1d006e530 0x7ff1d00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:10.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.197+0000 7ff1e4ff9640 1 -- 172.21.15.107:0/996458057 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6786+0+0 (secure 0 0 0) 0x7ff1d80ae6f0 con 0x7ff1e80fb810 2024-09-21T08:11:10.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.198+0000 7ff1e77fe640 1 --2- 172.21.15.107:0/996458057 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff1d006e530 0x7ff1d00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:10.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.198+0000 7ff1e77fe640 1 --2- 172.21.15.107:0/996458057 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff1d006e530 0x7ff1d00709e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff1e810eaa0 tx=0x7ff1dc00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:10.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.202+0000 7ff1e4ff9640 1 -- 172.21.15.107:0/996458057 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff1d80776b0 con 0x7ff1e80fb810 2024-09-21T08:11:10.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.432+0000 7ff1ee859640 1 -- 172.21.15.107:0/996458057 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff1e804b720 con 0x7ff1e80fb810 2024-09-21T08:11:10.434 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:10 smithi107 ceph-mon[97757]: Upgrade: Updating mds.cephfs.smithi129.belyba 2024-09-21T08:11:10.434 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:10 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:10.434 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:10 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi129.belyba", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:11:10.434 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:10 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:11:10.435 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:10 smithi107 ceph-mon[97757]: Deploying daemon mds.cephfs.smithi129.belyba on smithi129 2024-09-21T08:11:10.435 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:10 smithi107 ceph-mon[97757]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:11:10.435 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:10 smithi107 ceph-mon[97757]: pgmap v203: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 989 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-21T08:11:10.435 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:10 smithi107 ceph-mon[97757]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:11:10.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.433+0000 7ff1e4ff9640 1 -- 172.21.15.107:0/996458057 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7ff1d807ad70 con 0x7ff1e80fb810 2024-09-21T08:11:10.435 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:11:10.435 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": { 2024-09-21T08:11:10.435 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:11:10.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:11:10.435 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": { 2024-09-21T08:11:10.436 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:11:10.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:11:10.436 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": { 2024-09-21T08:11:10.436 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 6 2024-09-21T08:11:10.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:11:10.436 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-21T08:11:10.436 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 1, 2024-09-21T08:11:10.436 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-21T08:11:10.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:11:10.436 INFO:teuthology.orchestra.run.smithi107.stdout: "overall": { 2024-09-21T08:11:10.436 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 17.2.7-1649-gfbd1a6ab (fbd1a6ab0448f011c60f6376195d5c078b0cf20b) quincy (stable)": 1, 2024-09-21T08:11:10.436 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 13 2024-09-21T08:11:10.436 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-21T08:11:10.436 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:11:10.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.435+0000 7ff1ee859640 1 -- 172.21.15.107:0/996458057 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff1d006e530 msgr2=0x7ff1d00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:10.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.435+0000 7ff1ee859640 1 --2- 172.21.15.107:0/996458057 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff1d006e530 0x7ff1d00709e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff1e810eaa0 tx=0x7ff1dc00b040 comp rx=0 tx=0).stop 2024-09-21T08:11:10.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.435+0000 7ff1ee859640 1 -- 172.21.15.107:0/996458057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1e80fb810 msgr2=0x7ff1e81131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:10.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.435+0000 7ff1ee859640 1 --2- 172.21.15.107:0/996458057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1e80fb810 0x7ff1e81131e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8000c00 tx=0x7ff1d8009da0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.435+0000 7ff1ee859640 1 -- 172.21.15.107:0/996458057 shutdown_connections 2024-09-21T08:11:10.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.435+0000 7ff1ee859640 1 --2- 172.21.15.107:0/996458057 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff1d006e530 0x7ff1d00709e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.435+0000 7ff1ee859640 1 --2- 172.21.15.107:0/996458057 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff1e80fcf80 0x7ff1e8113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.435+0000 7ff1ee859640 1 --2- 172.21.15.107:0/996458057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1e80fb810 0x7ff1e81131e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.435+0000 7ff1ee859640 1 -- 172.21.15.107:0/996458057 >> 172.21.15.107:0/996458057 conn(0x7ff1e80723b0 msgr2=0x7ff1e80fa900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:10.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.436+0000 7ff1ee859640 1 -- 172.21.15.107:0/996458057 shutdown_connections 2024-09-21T08:11:10.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.436+0000 7ff1ee859640 1 -- 172.21.15.107:0/996458057 wait complete. 2024-09-21T08:11:10.476 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:10 smithi129 ceph-mon[76722]: Upgrade: Updating mds.cephfs.smithi129.belyba 2024-09-21T08:11:10.477 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:10 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:10.477 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:10 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi129.belyba", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T08:11:10.477 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:10 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:11:10.477 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:10 smithi129 ceph-mon[76722]: Deploying daemon mds.cephfs.smithi129.belyba on smithi129 2024-09-21T08:11:10.477 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:10 smithi129 ceph-mon[76722]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:11:10.477 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:10 smithi129 ceph-mon[76722]: pgmap v203: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 989 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-21T08:11:10.477 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:10 smithi129 ceph-mon[76722]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:11:10.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.513+0000 7f6bc8a9d640 1 -- 172.21.15.107:0/3307442762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6bc40fac60 msgr2=0x7f6bc40fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:10.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.513+0000 7f6bc8a9d640 1 --2- 172.21.15.107:0/3307442762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6bc40fac60 0x7f6bc40fb0b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0048d0 tx=0x7f6bac009da0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.514+0000 7f6bc8a9d640 1 -- 172.21.15.107:0/3307442762 shutdown_connections 2024-09-21T08:11:10.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.514+0000 7f6bc8a9d640 1 --2- 172.21.15.107:0/3307442762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6bc40fac60 0x7f6bc40fb0b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.514+0000 7f6bc8a9d640 1 --2- 172.21.15.107:0/3307442762 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bc41025f0 0x7f6bc41029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.514+0000 7f6bc8a9d640 1 -- 172.21.15.107:0/3307442762 >> 172.21.15.107:0/3307442762 conn(0x7f6bc4070c80 msgr2=0x7f6bc4071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:10.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.514+0000 7f6bc8a9d640 1 -- 172.21.15.107:0/3307442762 shutdown_connections 2024-09-21T08:11:10.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.514+0000 7f6bc8a9d640 1 -- 172.21.15.107:0/3307442762 wait complete. 2024-09-21T08:11:10.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.514+0000 7f6bc8a9d640 1 Processor -- start 2024-09-21T08:11:10.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.514+0000 7f6bc8a9d640 1 -- start start 2024-09-21T08:11:10.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.514+0000 7f6bc8a9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6bc40fac60 0x7f6bc41131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:10.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.514+0000 7f6bc8a9d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bc41025f0 0x7f6bc4113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:10.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.514+0000 7f6bc8a9d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc4113d10 con 0x7f6bc40fac60 2024-09-21T08:11:10.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.514+0000 7f6bc8a9d640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc410d150 con 0x7f6bc41025f0 2024-09-21T08:11:10.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.515+0000 7f6bc259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6bc40fac60 0x7f6bc41131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:10.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.515+0000 7f6bc259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6bc40fac60 0x7f6bc41131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58322/0 (socket says 172.21.15.107:58322) 2024-09-21T08:11:10.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.515+0000 7f6bc259c640 1 -- 172.21.15.107:0/3900706171 learned_addr learned my addr 172.21.15.107:0/3900706171 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:11:10.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.515+0000 7f6bc1d9b640 1 --2- 172.21.15.107:0/3900706171 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bc41025f0 0x7f6bc4113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:10.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.515+0000 7f6bc259c640 1 -- 172.21.15.107:0/3900706171 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bc41025f0 msgr2=0x7f6bc4113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:10.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.515+0000 7f6bc259c640 1 --2- 172.21.15.107:0/3900706171 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bc41025f0 0x7f6bc4113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.515+0000 7f6bc259c640 1 -- 172.21.15.107:0/3900706171 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac005040 con 0x7f6bc40fac60 2024-09-21T08:11:10.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.515+0000 7f6bc1d9b640 1 --2- 172.21.15.107:0/3900706171 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bc41025f0 0x7f6bc4113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:11:10.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.515+0000 7f6bc259c640 1 --2- 172.21.15.107:0/3900706171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6bc40fac60 0x7f6bc41131d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400ece0 tx=0x7f6bb400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:10.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.515+0000 7f6bbaffd640 1 -- 172.21.15.107:0/3900706171 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb400ee40 con 0x7f6bc40fac60 2024-09-21T08:11:10.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.515+0000 7f6bc8a9d640 1 -- 172.21.15.107:0/3900706171 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc410d430 con 0x7f6bc40fac60 2024-09-21T08:11:10.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.515+0000 7f6bbaffd640 1 -- 172.21.15.107:0/3900706171 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6bb400f040 con 0x7f6bc40fac60 2024-09-21T08:11:10.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.515+0000 7f6bbaffd640 1 -- 172.21.15.107:0/3900706171 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb40096b0 con 0x7f6bc40fac60 2024-09-21T08:11:10.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.515+0000 7f6bc8a9d640 1 -- 172.21.15.107:0/3900706171 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc410d9d0 con 0x7f6bc40fac60 2024-09-21T08:11:10.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.516+0000 7f6bc8a9d640 1 -- 172.21.15.107:0/3900706171 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc4065810 con 0x7f6bc40fac60 2024-09-21T08:11:10.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.517+0000 7f6bbaffd640 1 -- 172.21.15.107:0/3900706171 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f6bb4007890 con 0x7f6bc40fac60 2024-09-21T08:11:10.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.517+0000 7f6bbaffd640 1 --2- 172.21.15.107:0/3900706171 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6bb006e530 0x7f6bb00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:10.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.517+0000 7f6bbaffd640 1 -- 172.21.15.107:0/3900706171 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6786+0+0 (secure 0 0 0) 0x7f6bb408e910 con 0x7f6bc40fac60 2024-09-21T08:11:10.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.517+0000 7f6bc1d9b640 1 --2- 172.21.15.107:0/3900706171 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6bb006e530 0x7f6bb00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:10.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.518+0000 7f6bc1d9b640 1 --2- 172.21.15.107:0/3900706171 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6bb006e530 0x7f6bb00709e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00b020 tx=0x7f6bac009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:10.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.521+0000 7f6bbaffd640 1 -- 172.21.15.107:0/3900706171 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6bb4057950 con 0x7f6bc40fac60 2024-09-21T08:11:10.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.720+0000 7f6bc8a9d640 1 -- 172.21.15.107:0/3900706171 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6bc404b780 con 0x7f6bc40fac60 2024-09-21T08:11:10.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.720+0000 7f6bbaffd640 1 -- 172.21.15.107:0/3900706171 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) v1 ==== 76+0+1938 (secure 0 0 0) 0x7f6bb405b010 con 0x7f6bc40fac60 2024-09-21T08:11:10.722 INFO:teuthology.orchestra.run.smithi107.stdout:e28 2024-09-21T08:11:10.722 INFO:teuthology.orchestra.run.smithi107.stdout:btime 2024-09-21T08:11:01:696266+0000 2024-09-21T08:11:10.722 INFO:teuthology.orchestra.run.smithi107.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T08:11:10.722 INFO:teuthology.orchestra.run.smithi107.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:11:10.722 INFO:teuthology.orchestra.run.smithi107.stdout:legacy client fscid: 1 2024-09-21T08:11:10.722 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:11:10.723 INFO:teuthology.orchestra.run.smithi107.stdout:Filesystem 'cephfs' (1) 2024-09-21T08:11:10.723 INFO:teuthology.orchestra.run.smithi107.stdout:fs_name cephfs 2024-09-21T08:11:10.723 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 27 2024-09-21T08:11:10.723 INFO:teuthology.orchestra.run.smithi107.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T08:11:10.723 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-09-21T08:00:03.244314+0000 2024-09-21T08:11:10.723 INFO:teuthology.orchestra.run.smithi107.stdout:modified 2024-09-21T08:10:59.693561+0000 2024-09-21T08:11:10.723 INFO:teuthology.orchestra.run.smithi107.stdout:tableserver 0 2024-09-21T08:11:10.723 INFO:teuthology.orchestra.run.smithi107.stdout:root 0 2024-09-21T08:11:10.723 INFO:teuthology.orchestra.run.smithi107.stdout:session_timeout 60 2024-09-21T08:11:10.723 INFO:teuthology.orchestra.run.smithi107.stdout:session_autoclose 300 2024-09-21T08:11:10.723 INFO:teuthology.orchestra.run.smithi107.stdout:max_file_size 1099511627776 2024-09-21T08:11:10.723 INFO:teuthology.orchestra.run.smithi107.stdout:max_xattr_size 65536 2024-09-21T08:11:10.723 INFO:teuthology.orchestra.run.smithi107.stdout:required_client_features {} 2024-09-21T08:11:10.723 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure 0 2024-09-21T08:11:10.724 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure_osd_epoch 92 2024-09-21T08:11:10.724 INFO:teuthology.orchestra.run.smithi107.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:11:10.724 INFO:teuthology.orchestra.run.smithi107.stdout:max_mds 1 2024-09-21T08:11:10.724 INFO:teuthology.orchestra.run.smithi107.stdout:in 0 2024-09-21T08:11:10.724 INFO:teuthology.orchestra.run.smithi107.stdout:up {0=24247} 2024-09-21T08:11:10.724 INFO:teuthology.orchestra.run.smithi107.stdout:failed 2024-09-21T08:11:10.724 INFO:teuthology.orchestra.run.smithi107.stdout:damaged 2024-09-21T08:11:10.724 INFO:teuthology.orchestra.run.smithi107.stdout:stopped 2024-09-21T08:11:10.724 INFO:teuthology.orchestra.run.smithi107.stdout:data_pools [3] 2024-09-21T08:11:10.724 INFO:teuthology.orchestra.run.smithi107.stdout:metadata_pool 2 2024-09-21T08:11:10.724 INFO:teuthology.orchestra.run.smithi107.stdout:inline_data disabled 2024-09-21T08:11:10.724 INFO:teuthology.orchestra.run.smithi107.stdout:balancer 2024-09-21T08:11:10.725 INFO:teuthology.orchestra.run.smithi107.stdout:bal_rank_mask -1 2024-09-21T08:11:10.725 INFO:teuthology.orchestra.run.smithi107.stdout:standby_count_wanted 1 2024-09-21T08:11:10.725 INFO:teuthology.orchestra.run.smithi107.stdout:qdb_cluster leader: 24247 members: 24247 2024-09-21T08:11:10.725 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.belyba{0:24247} state up:active seq 164 join_fscid=1 addr [v2:172.21.15.129:6826/3658871735,v1:172.21.15.129:6827/3658871735] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T08:11:10.725 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:11:10.725 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:11:10.725 INFO:teuthology.orchestra.run.smithi107.stdout:Standby daemons: 2024-09-21T08:11:10.725 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:11:10.725 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.qusoyf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6826/3638073096,v1:172.21.15.107:6827/3638073096] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T08:11:10.725 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.grqzkt{-1:34402} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6828/1321345266,v1:172.21.15.107:6829/1321345266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T08:11:10.725 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.fwmfcy{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.129:6824/4074709540,v1:172.21.15.129:6825/4074709540] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T08:11:10.726 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 28 2024-09-21T08:11:10.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.723+0000 7f6bc8a9d640 1 -- 172.21.15.107:0/3900706171 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6bb006e530 msgr2=0x7f6bb00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:10.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.723+0000 7f6bc8a9d640 1 --2- 172.21.15.107:0/3900706171 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6bb006e530 0x7f6bb00709e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00b020 tx=0x7f6bac009da0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.723+0000 7f6bc8a9d640 1 -- 172.21.15.107:0/3900706171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6bc40fac60 msgr2=0x7f6bc41131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:10.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.723+0000 7f6bc8a9d640 1 --2- 172.21.15.107:0/3900706171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6bc40fac60 0x7f6bc41131d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400ece0 tx=0x7f6bb400b040 comp rx=0 tx=0).stop 2024-09-21T08:11:10.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.724+0000 7f6bc8a9d640 1 -- 172.21.15.107:0/3900706171 shutdown_connections 2024-09-21T08:11:10.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.724+0000 7f6bc8a9d640 1 --2- 172.21.15.107:0/3900706171 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6bb006e530 0x7f6bb00709e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.724+0000 7f6bc8a9d640 1 --2- 172.21.15.107:0/3900706171 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bc41025f0 0x7f6bc4113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.724+0000 7f6bc8a9d640 1 --2- 172.21.15.107:0/3900706171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6bc40fac60 0x7f6bc41131d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.724+0000 7f6bc8a9d640 1 -- 172.21.15.107:0/3900706171 >> 172.21.15.107:0/3900706171 conn(0x7f6bc4070c80 msgr2=0x7f6bc40f9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:10.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.724+0000 7f6bc8a9d640 1 -- 172.21.15.107:0/3900706171 shutdown_connections 2024-09-21T08:11:10.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.724+0000 7f6bc8a9d640 1 -- 172.21.15.107:0/3900706171 wait complete. 2024-09-21T08:11:10.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.804+0000 7f6fc77cd640 1 -- 172.21.15.107:0/3368918454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fc00fac60 msgr2=0x7f6fc00fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:10.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.804+0000 7f6fc77cd640 1 --2- 172.21.15.107:0/3368918454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fc00fac60 0x7f6fc00fb0b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00048d0 tx=0x7f6fb0009da0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.804+0000 7f6fc77cd640 1 -- 172.21.15.107:0/3368918454 shutdown_connections 2024-09-21T08:11:10.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.804+0000 7f6fc77cd640 1 --2- 172.21.15.107:0/3368918454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fc00fac60 0x7f6fc00fb0b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.804+0000 7f6fc77cd640 1 --2- 172.21.15.107:0/3368918454 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6fc01025f0 0x7f6fc01029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.804+0000 7f6fc77cd640 1 -- 172.21.15.107:0/3368918454 >> 172.21.15.107:0/3368918454 conn(0x7f6fc0070c80 msgr2=0x7f6fc0071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:10.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.804+0000 7f6fc77cd640 1 -- 172.21.15.107:0/3368918454 shutdown_connections 2024-09-21T08:11:10.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.804+0000 7f6fc77cd640 1 -- 172.21.15.107:0/3368918454 wait complete. 2024-09-21T08:11:10.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.805+0000 7f6fc77cd640 1 Processor -- start 2024-09-21T08:11:10.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.805+0000 7f6fc77cd640 1 -- start start 2024-09-21T08:11:10.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.805+0000 7f6fc77cd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6fc00fac60 0x7f6fc01131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:10.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.805+0000 7f6fc77cd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fc01025f0 0x7f6fc0113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:10.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.805+0000 7f6fc77cd640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc0113d10 con 0x7f6fc01025f0 2024-09-21T08:11:10.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.805+0000 7f6fc77cd640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc010d150 con 0x7f6fc00fac60 2024-09-21T08:11:10.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.805+0000 7f6fc4d68640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fc01025f0 0x7f6fc0113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:10.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.805+0000 7f6fc4d68640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fc01025f0 0x7f6fc0113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58344/0 (socket says 172.21.15.107:58344) 2024-09-21T08:11:10.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.805+0000 7f6fc4d68640 1 -- 172.21.15.107:0/1276090561 learned_addr learned my addr 172.21.15.107:0/1276090561 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:11:10.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.805+0000 7f6fc5569640 1 --2- 172.21.15.107:0/1276090561 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6fc00fac60 0x7f6fc01131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:10.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.805+0000 7f6fc4d68640 1 -- 172.21.15.107:0/1276090561 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6fc00fac60 msgr2=0x7f6fc01131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:10.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.805+0000 7f6fc4d68640 1 --2- 172.21.15.107:0/1276090561 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6fc00fac60 0x7f6fc01131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:10.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.805+0000 7f6fc4d68640 1 -- 172.21.15.107:0/1276090561 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb0005040 con 0x7f6fc01025f0 2024-09-21T08:11:10.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.806+0000 7f6fc4d68640 1 --2- 172.21.15.107:0/1276090561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fc01025f0 0x7f6fc0113710 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0000c00 tx=0x7f6fb0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:10.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.806+0000 7f6fb5ffb640 1 -- 172.21.15.107:0/1276090561 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fb0038070 con 0x7f6fc01025f0 2024-09-21T08:11:10.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.806+0000 7f6fb5ffb640 1 -- 172.21.15.107:0/1276090561 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6fb002ade0 con 0x7f6fc01025f0 2024-09-21T08:11:10.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.806+0000 7f6fc77cd640 1 -- 172.21.15.107:0/1276090561 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc010d3d0 con 0x7f6fc01025f0 2024-09-21T08:11:10.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.806+0000 7f6fb5ffb640 1 -- 172.21.15.107:0/1276090561 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fb002c7e0 con 0x7f6fc01025f0 2024-09-21T08:11:10.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.806+0000 7f6fc77cd640 1 -- 172.21.15.107:0/1276090561 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc010d910 con 0x7f6fc01025f0 2024-09-21T08:11:10.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.807+0000 7f6fc77cd640 1 -- 172.21.15.107:0/1276090561 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc0065810 con 0x7f6fc01025f0 2024-09-21T08:11:10.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.807+0000 7f6fb5ffb640 1 -- 172.21.15.107:0/1276090561 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f6fb0030020 con 0x7f6fc01025f0 2024-09-21T08:11:10.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.808+0000 7f6fb5ffb640 1 --2- 172.21.15.107:0/1276090561 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6fac06e530 0x7f6fac0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:10.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.808+0000 7f6fb5ffb640 1 -- 172.21.15.107:0/1276090561 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6786+0+0 (secure 0 0 0) 0x7f6fb00adf20 con 0x7f6fc01025f0 2024-09-21T08:11:10.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.808+0000 7f6fc5569640 1 --2- 172.21.15.107:0/1276090561 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6fac06e530 0x7f6fac0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:10.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.808+0000 7f6fc5569640 1 --2- 172.21.15.107:0/1276090561 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6fac06e530 0x7f6fac0709e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc004eb0 tx=0x7f6fbc00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:10.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.812+0000 7f6fb5ffb640 1 -- 172.21.15.107:0/1276090561 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6fb00e3210 con 0x7f6fc01025f0 2024-09-21T08:11:10.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.993+0000 7f6fc77cd640 1 -- 172.21.15.107:0/1276090561 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fc0109600 con 0x7f6fac06e530 2024-09-21T08:11:10.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.995+0000 7f6fb5ffb640 1 -- 172.21.15.107:0/1276090561 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6fc0109600 con 0x7f6fac06e530 2024-09-21T08:11:10.996 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:11:10.996 INFO:teuthology.orchestra.run.smithi107.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5", 2024-09-21T08:11:10.996 INFO:teuthology.orchestra.run.smithi107.stdout: "in_progress": true, 2024-09-21T08:11:10.996 INFO:teuthology.orchestra.run.smithi107.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T08:11:10.996 INFO:teuthology.orchestra.run.smithi107.stdout: "services_complete": [ 2024-09-21T08:11:10.997 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr", 2024-09-21T08:11:10.997 INFO:teuthology.orchestra.run.smithi107.stdout: "mon", 2024-09-21T08:11:10.997 INFO:teuthology.orchestra.run.smithi107.stdout: "osd", 2024-09-21T08:11:10.997 INFO:teuthology.orchestra.run.smithi107.stdout: "crash" 2024-09-21T08:11:10.997 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-21T08:11:10.997 INFO:teuthology.orchestra.run.smithi107.stdout: "progress": "15/21 daemons upgraded", 2024-09-21T08:11:10.997 INFO:teuthology.orchestra.run.smithi107.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T08:11:10.997 INFO:teuthology.orchestra.run.smithi107.stdout: "is_paused": false 2024-09-21T08:11:10.997 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:11:11.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.998+0000 7f6fc77cd640 1 -- 172.21.15.107:0/1276090561 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6fac06e530 msgr2=0x7f6fac0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:11.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.998+0000 7f6fc77cd640 1 --2- 172.21.15.107:0/1276090561 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6fac06e530 0x7f6fac0709e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc004eb0 tx=0x7f6fbc00b040 comp rx=0 tx=0).stop 2024-09-21T08:11:11.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.998+0000 7f6fc77cd640 1 -- 172.21.15.107:0/1276090561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fc01025f0 msgr2=0x7f6fc0113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:11.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.998+0000 7f6fc77cd640 1 --2- 172.21.15.107:0/1276090561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fc01025f0 0x7f6fc0113710 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0000c00 tx=0x7f6fb0009da0 comp rx=0 tx=0).stop 2024-09-21T08:11:11.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.998+0000 7f6fc77cd640 1 -- 172.21.15.107:0/1276090561 shutdown_connections 2024-09-21T08:11:11.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.998+0000 7f6fc77cd640 1 --2- 172.21.15.107:0/1276090561 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6fac06e530 0x7f6fac0709e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:11.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.998+0000 7f6fc77cd640 1 --2- 172.21.15.107:0/1276090561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fc01025f0 0x7f6fc0113710 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:11.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.998+0000 7f6fc77cd640 1 --2- 172.21.15.107:0/1276090561 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6fc00fac60 0x7f6fc01131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:11.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.998+0000 7f6fc77cd640 1 -- 172.21.15.107:0/1276090561 >> 172.21.15.107:0/1276090561 conn(0x7f6fc0070c80 msgr2=0x7f6fc00fa020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:11.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.998+0000 7f6fc77cd640 1 -- 172.21.15.107:0/1276090561 shutdown_connections 2024-09-21T08:11:11.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:10.998+0000 7f6fc77cd640 1 -- 172.21.15.107:0/1276090561 wait complete. 2024-09-21T08:11:11.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.090+0000 7f39cf611640 1 -- 172.21.15.107:0/1212177721 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c80fcf80 msgr2=0x7f39c80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:11.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.090+0000 7f39cf611640 1 --2- 172.21.15.107:0/1212177721 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c80fcf80 0x7f39c80fd3d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f39b80048d0 tx=0x7f39b8009da0 comp rx=0 tx=0).stop 2024-09-21T08:11:11.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.090+0000 7f39cf611640 1 -- 172.21.15.107:0/1212177721 shutdown_connections 2024-09-21T08:11:11.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.090+0000 7f39cf611640 1 --2- 172.21.15.107:0/1212177721 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c80fcf80 0x7f39c80fd3d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:11.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.090+0000 7f39cf611640 1 --2- 172.21.15.107:0/1212177721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39c80fb810 0x7f39c80fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:11.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.090+0000 7f39cf611640 1 -- 172.21.15.107:0/1212177721 >> 172.21.15.107:0/1212177721 conn(0x7f39c80723b0 msgr2=0x7f39c80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:11.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.091+0000 7f39cf611640 1 -- 172.21.15.107:0/1212177721 shutdown_connections 2024-09-21T08:11:11.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.091+0000 7f39cf611640 1 -- 172.21.15.107:0/1212177721 wait complete. 2024-09-21T08:11:11.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.091+0000 7f39cf611640 1 Processor -- start 2024-09-21T08:11:11.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.091+0000 7f39cf611640 1 -- start start 2024-09-21T08:11:11.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.091+0000 7f39cf611640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39c80fb810 0x7f39c8112fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:11.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.091+0000 7f39cf611640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c80fcf80 0x7f39c8113510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:11.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.091+0000 7f39cf611640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c8113ba0 con 0x7f39c80fcf80 2024-09-21T08:11:11.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.091+0000 7f39cf611640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c810cf90 con 0x7f39c80fb810 2024-09-21T08:11:11.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.092+0000 7f39ccbac640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c80fcf80 0x7f39c8113510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:11.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.092+0000 7f39ccbac640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c80fcf80 0x7f39c8113510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58364/0 (socket says 172.21.15.107:58364) 2024-09-21T08:11:11.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.092+0000 7f39ccbac640 1 -- 172.21.15.107:0/3603994623 learned_addr learned my addr 172.21.15.107:0/3603994623 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:11:11.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.092+0000 7f39cd3ad640 1 --2- 172.21.15.107:0/3603994623 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39c80fb810 0x7f39c8112fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:11.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.092+0000 7f39ccbac640 1 -- 172.21.15.107:0/3603994623 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39c80fb810 msgr2=0x7f39c8112fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:11.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.092+0000 7f39ccbac640 1 --2- 172.21.15.107:0/3603994623 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39c80fb810 0x7f39c8112fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:11.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.092+0000 7f39ccbac640 1 -- 172.21.15.107:0/3603994623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b8005040 con 0x7f39c80fcf80 2024-09-21T08:11:11.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.092+0000 7f39cd3ad640 1 --2- 172.21.15.107:0/3603994623 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39c80fb810 0x7f39c8112fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:11:11.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.092+0000 7f39ccbac640 1 --2- 172.21.15.107:0/3603994623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c80fcf80 0x7f39c8113510 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f39b80048a0 tx=0x7f39b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:11.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.093+0000 7f39bdffb640 1 -- 172.21.15.107:0/3603994623 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39b8038070 con 0x7f39c80fcf80 2024-09-21T08:11:11.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.093+0000 7f39bdffb640 1 -- 172.21.15.107:0/3603994623 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f39b802abd0 con 0x7f39c80fcf80 2024-09-21T08:11:11.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.093+0000 7f39bdffb640 1 -- 172.21.15.107:0/3603994623 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39b803d730 con 0x7f39c80fcf80 2024-09-21T08:11:11.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.093+0000 7f39cf611640 1 -- 172.21.15.107:0/3603994623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c810d210 con 0x7f39c80fcf80 2024-09-21T08:11:11.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.093+0000 7f39cf611640 1 -- 172.21.15.107:0/3603994623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c810d6d0 con 0x7f39c80fcf80 2024-09-21T08:11:11.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.095+0000 7f39cf611640 1 -- 172.21.15.107:0/3603994623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c80fcbc0 con 0x7f39c80fcf80 2024-09-21T08:11:11.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.095+0000 7f39bdffb640 1 -- 172.21.15.107:0/3603994623 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f39b8030020 con 0x7f39c80fcf80 2024-09-21T08:11:11.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.095+0000 7f39bdffb640 1 --2- 172.21.15.107:0/3603994623 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f39b406e530 0x7f39b40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:11.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.095+0000 7f39bdffb640 1 -- 172.21.15.107:0/3603994623 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f39b803b370 con 0x7f39c80fcf80 2024-09-21T08:11:11.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.095+0000 7f39cd3ad640 1 --2- 172.21.15.107:0/3603994623 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f39b406e530 0x7f39b40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:11.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.096+0000 7f39cd3ad640 1 --2- 172.21.15.107:0/3603994623 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f39b406e530 0x7f39b40709e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f39c4006fd0 tx=0x7f39c4008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:11.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.103+0000 7f39bdffb640 1 -- 172.21.15.107:0/3603994623 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f39b8077a00 con 0x7f39c80fcf80 2024-09-21T08:11:11.252 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:11 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107[97753]: 2024-09-21T08:11:11.042+0000 7f7e9585a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:11:11.252 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:11 smithi107 ceph-mon[97757]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:11:11.252 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:11 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/996458057' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:11.252 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:11 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/3900706171' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:11:11.252 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:11 smithi107 ceph-mon[97757]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T08:11:11.252 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:11 smithi107 ceph-mon[97757]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:11:11.253 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:11 smithi107 ceph-mon[97757]: osdmap e93: 6 total, 6 up, 6 in 2024-09-21T08:11:11.253 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:11 smithi107 ceph-mon[97757]: Standby daemon mds.cephfs.smithi107.qusoyf assigned to filesystem cephfs as rank 0 2024-09-21T08:11:11.253 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:11 smithi107 ceph-mon[97757]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T08:11:11.253 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:11 smithi107 ceph-mon[97757]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T08:11:11.253 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:11 smithi107 ceph-mon[97757]: fsmap cephfs:1/1 {0=cephfs.smithi107.qusoyf=up:replay} 2 up:standby 2024-09-21T08:11:11.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.344+0000 7f39cf611640 1 -- 172.21.15.107:0/3603994623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f39c8072ec0 con 0x7f39c80fcf80 2024-09-21T08:11:11.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.344+0000 7f39bdffb640 1 -- 172.21.15.107:0/3603994623 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7f39b807b0c0 con 0x7f39c80fcf80 2024-09-21T08:11:11.346 INFO:teuthology.orchestra.run.smithi107.stdout:HEALTH_WARN 1 filesystem is degraded 2024-09-21T08:11:11.346 INFO:teuthology.orchestra.run.smithi107.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T08:11:11.346 INFO:teuthology.orchestra.run.smithi107.stdout: fs cephfs is degraded 2024-09-21T08:11:11.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.346+0000 7f39cf611640 1 -- 172.21.15.107:0/3603994623 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f39b406e530 msgr2=0x7f39b40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:11.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.346+0000 7f39cf611640 1 --2- 172.21.15.107:0/3603994623 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f39b406e530 0x7f39b40709e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f39c4006fd0 tx=0x7f39c4008040 comp rx=0 tx=0).stop 2024-09-21T08:11:11.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.346+0000 7f39cf611640 1 -- 172.21.15.107:0/3603994623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c80fcf80 msgr2=0x7f39c8113510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:11.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.346+0000 7f39cf611640 1 --2- 172.21.15.107:0/3603994623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c80fcf80 0x7f39c8113510 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f39b80048a0 tx=0x7f39b8009da0 comp rx=0 tx=0).stop 2024-09-21T08:11:11.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.347+0000 7f39cf611640 1 -- 172.21.15.107:0/3603994623 shutdown_connections 2024-09-21T08:11:11.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.347+0000 7f39cf611640 1 --2- 172.21.15.107:0/3603994623 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f39b406e530 0x7f39b40709e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:11.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.347+0000 7f39cf611640 1 --2- 172.21.15.107:0/3603994623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39c80fcf80 0x7f39c8113510 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:11.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.347+0000 7f39cf611640 1 --2- 172.21.15.107:0/3603994623 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39c80fb810 0x7f39c8112fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:11.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.347+0000 7f39cf611640 1 -- 172.21.15.107:0/3603994623 >> 172.21.15.107:0/3603994623 conn(0x7f39c80723b0 msgr2=0x7f39c80fa680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:11.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.347+0000 7f39cf611640 1 -- 172.21.15.107:0/3603994623 shutdown_connections 2024-09-21T08:11:11.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:11.347+0000 7f39cf611640 1 -- 172.21.15.107:0/3603994623 wait complete. 2024-09-21T08:11:11.516 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:11:11 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3[85557]: 2024-09-21T08:11:11.068+0000 7fc452b66640 -1 bdev(0x5563465a2c00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 10 2024-09-21T08:11:11.517 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:11:11 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3[85557]: 2024-09-21T08:11:11.070+0000 7fc451b64640 -1 bdev(0x5563465a2c00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 18 2024-09-21T08:11:11.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:11 smithi129 ceph-mon[76722]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:11:11.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:11 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/996458057' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:11.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:11 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/3900706171' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:11:11.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:11 smithi129 ceph-mon[76722]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T08:11:11.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:11 smithi129 ceph-mon[76722]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:11:11.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:11 smithi129 ceph-mon[76722]: osdmap e93: 6 total, 6 up, 6 in 2024-09-21T08:11:11.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:11 smithi129 ceph-mon[76722]: Standby daemon mds.cephfs.smithi107.qusoyf assigned to filesystem cephfs as rank 0 2024-09-21T08:11:11.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:11 smithi129 ceph-mon[76722]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T08:11:11.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:11 smithi129 ceph-mon[76722]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T08:11:11.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:11 smithi129 ceph-mon[76722]: fsmap cephfs:1/1 {0=cephfs.smithi107.qusoyf=up:replay} 2 up:standby 2024-09-21T08:11:12.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:12 smithi129 ceph-mon[76722]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:11:12.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:12 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/3603994623' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:11:12.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:12 smithi129 ceph-mon[76722]: pgmap v205: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 410 KiB/s rd, 5.0 KiB/s wr, 3 op/s 2024-09-21T08:11:12.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:12 smithi107 ceph-mon[97757]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:11:12.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:12 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/3603994623' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:11:12.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:12 smithi107 ceph-mon[97757]: pgmap v205: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 410 KiB/s rd, 5.0 KiB/s wr, 3 op/s 2024-09-21T08:11:15.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:14 smithi129 ceph-mon[76722]: pgmap v206: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 5.0 KiB/s wr, 3 op/s 2024-09-21T08:11:15.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:14 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:11:15.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:14 smithi107 ceph-mon[97757]: pgmap v206: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 5.0 KiB/s wr, 3 op/s 2024-09-21T08:11:15.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:14 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:11:17.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:16 smithi129 ceph-mon[76722]: pgmap v207: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T08:11:17.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:16 smithi107 ceph-mon[97757]: pgmap v207: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T08:11:19.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:18 smithi129 ceph-mon[76722]: pgmap v208: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-21T08:11:19.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:18 smithi107 ceph-mon[97757]: pgmap v208: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-21T08:11:20.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:19 smithi129 ceph-mon[76722]: reconnect by client.24269 v1:172.21.15.107:0/2727935843 after 0 2024-09-21T08:11:20.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:19 smithi129 ceph-mon[76722]: reconnect by client.14494 v1:172.21.15.129:0/3058185692 after 0 2024-09-21T08:11:20.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:19 smithi129 ceph-mon[76722]: mds.? [v2:172.21.15.107:6826/3638073096,v1:172.21.15.107:6827/3638073096] up:reconnect 2024-09-21T08:11:20.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:19 smithi129 ceph-mon[76722]: fsmap cephfs:1/1 {0=cephfs.smithi107.qusoyf=up:reconnect} 2 up:standby 2024-09-21T08:11:20.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:19 smithi107 ceph-mon[97757]: reconnect by client.24269 v1:172.21.15.107:0/2727935843 after 0 2024-09-21T08:11:20.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:19 smithi107 ceph-mon[97757]: reconnect by client.14494 v1:172.21.15.129:0/3058185692 after 0 2024-09-21T08:11:20.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:19 smithi107 ceph-mon[97757]: mds.? [v2:172.21.15.107:6826/3638073096,v1:172.21.15.107:6827/3638073096] up:reconnect 2024-09-21T08:11:20.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:19 smithi107 ceph-mon[97757]: fsmap cephfs:1/1 {0=cephfs.smithi107.qusoyf=up:reconnect} 2 up:standby 2024-09-21T08:11:20.902 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:20 smithi129 ceph-mon[76722]: pgmap v209: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-21T08:11:20.902 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:20 smithi129 ceph-mon[76722]: mds.? [v2:172.21.15.107:6826/3638073096,v1:172.21.15.107:6827/3638073096] up:rejoin 2024-09-21T08:11:20.903 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:20 smithi129 ceph-mon[76722]: fsmap cephfs:1/1 {0=cephfs.smithi107.qusoyf=up:rejoin} 2 up:standby 2024-09-21T08:11:20.903 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:20 smithi129 ceph-mon[76722]: daemon mds.cephfs.smithi107.qusoyf is now active in filesystem cephfs as rank 0 2024-09-21T08:11:21.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:20 smithi107 ceph-mon[97757]: pgmap v209: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-21T08:11:21.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:20 smithi107 ceph-mon[97757]: mds.? [v2:172.21.15.107:6826/3638073096,v1:172.21.15.107:6827/3638073096] up:rejoin 2024-09-21T08:11:21.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:20 smithi107 ceph-mon[97757]: fsmap cephfs:1/1 {0=cephfs.smithi107.qusoyf=up:rejoin} 2 up:standby 2024-09-21T08:11:21.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:20 smithi107 ceph-mon[97757]: daemon mds.cephfs.smithi107.qusoyf is now active in filesystem cephfs as rank 0 2024-09-21T08:11:22.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:21 smithi129 ceph-mon[76722]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T08:11:22.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:21 smithi129 ceph-mon[76722]: Cluster is now healthy 2024-09-21T08:11:22.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:21 smithi129 ceph-mon[76722]: mds.? [v2:172.21.15.107:6826/3638073096,v1:172.21.15.107:6827/3638073096] up:active 2024-09-21T08:11:22.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:21 smithi129 ceph-mon[76722]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:active} 2 up:standby 2024-09-21T08:11:22.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:21 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:22.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:21 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:22.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:21 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:11:22.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:21 smithi107 ceph-mon[97757]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T08:11:22.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:21 smithi107 ceph-mon[97757]: Cluster is now healthy 2024-09-21T08:11:22.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:21 smithi107 ceph-mon[97757]: mds.? [v2:172.21.15.107:6826/3638073096,v1:172.21.15.107:6827/3638073096] up:active 2024-09-21T08:11:22.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:21 smithi107 ceph-mon[97757]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:active} 2 up:standby 2024-09-21T08:11:22.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:21 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:22.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:21 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:22.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:21 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:11:23.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:22 smithi129 ceph-mon[76722]: pgmap v210: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 192 B/s wr, 8 op/s 2024-09-21T08:11:23.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:22 smithi129 ceph-mon[76722]: mds.? [v2:172.21.15.129:6826/3676932805,v1:172.21.15.129:6827/3676932805] up:boot 2024-09-21T08:11:23.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:22 smithi129 ceph-mon[76722]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:active} 3 up:standby 2024-09-21T08:11:23.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:22 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.belyba"}]: dispatch 2024-09-21T08:11:23.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:22 smithi107 ceph-mon[97757]: pgmap v210: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 192 B/s wr, 8 op/s 2024-09-21T08:11:23.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:22 smithi107 ceph-mon[97757]: mds.? [v2:172.21.15.129:6826/3676932805,v1:172.21.15.129:6827/3676932805] up:boot 2024-09-21T08:11:23.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:22 smithi107 ceph-mon[97757]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:active} 3 up:standby 2024-09-21T08:11:23.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:22 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi129.belyba"}]: dispatch 2024-09-21T08:11:24.799 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:24 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:24.800 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:24 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:24.800 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:24 smithi129 ceph-mon[76722]: pgmap v211: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T08:11:24.800 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:24 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:24.800 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:24 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:24.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:24 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:24.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:24 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:24.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:24 smithi107 ceph-mon[97757]: pgmap v211: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T08:11:24.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:24 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:24.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:24 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:27.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:26 smithi129 ceph-mon[76722]: pgmap v212: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.4 KiB/s wr, 9 op/s 2024-09-21T08:11:27.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:26 smithi107 ceph-mon[97757]: pgmap v212: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.4 KiB/s wr, 9 op/s 2024-09-21T08:11:28.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:28.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:28.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:11:28.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:11:28.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:28.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:11:28.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:28.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:28.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:28.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:28.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:28.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: Upgrade: Setting container_image for all mds 2024-09-21T08:11:28.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:28.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi107.grqzkt"}]: dispatch 2024-09-21T08:11:28.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi107.grqzkt"}]': finished 2024-09-21T08:11:28.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi107.qusoyf"}]: dispatch 2024-09-21T08:11:28.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi107.qusoyf"}]': finished 2024-09-21T08:11:28.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi129.belyba"}]: dispatch 2024-09-21T08:11:28.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi129.belyba"}]': finished 2024-09-21T08:11:28.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi129.fwmfcy"}]: dispatch 2024-09-21T08:11:28.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi129.fwmfcy"}]': finished 2024-09-21T08:11:28.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: Upgrade: Setting filesystem cephfs Joinable 2024-09-21T08:11:28.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-21T08:11:28.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:28 smithi129 ceph-mon[76722]: pgmap v213: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-21T08:11:28.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:28.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:28.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:11:28.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:11:28.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:28.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:11:28.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:28.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:28.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:28.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:28.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:28.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: Upgrade: Setting container_image for all mds 2024-09-21T08:11:28.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:28.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi107.grqzkt"}]: dispatch 2024-09-21T08:11:28.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi107.grqzkt"}]': finished 2024-09-21T08:11:28.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi107.qusoyf"}]: dispatch 2024-09-21T08:11:28.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi107.qusoyf"}]': finished 2024-09-21T08:11:28.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi129.belyba"}]: dispatch 2024-09-21T08:11:28.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi129.belyba"}]': finished 2024-09-21T08:11:28.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi129.fwmfcy"}]: dispatch 2024-09-21T08:11:28.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi129.fwmfcy"}]': finished 2024-09-21T08:11:28.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: Upgrade: Setting filesystem cephfs Joinable 2024-09-21T08:11:28.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-21T08:11:28.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:28 smithi107 ceph-mon[97757]: pgmap v213: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-21T08:11:29.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-21T08:11:29.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:active} 3 up:standby 2024-09-21T08:11:29.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: Upgrade: Setting container_image for all rgw 2024-09-21T08:11:29.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:29.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T08:11:29.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:29.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: Upgrade: Setting container_image for all ceph-exporter 2024-09-21T08:11:29.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:29.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: Upgrade: Setting container_image for all iscsi 2024-09-21T08:11:29.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:29.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: Upgrade: Setting container_image for all nfs 2024-09-21T08:11:29.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:29.518 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: Upgrade: Setting container_image for all nvmeof 2024-09-21T08:11:29.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:29.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: Upgrade: Finalizing container_image settings 2024-09-21T08:11:29.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T08:11:29.519 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T08:11:29.520 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:11:29.520 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T08:11:29.520 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T08:11:29.520 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T08:11:29.520 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T08:11:29.521 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T08:11:29.521 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T08:11:29.521 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T08:11:29.521 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T08:11:29.521 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T08:11:29.521 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T08:11:29.521 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T08:11:29.521 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:11:29.521 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T08:11:29.521 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T08:11:29.521 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T08:11:29.521 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T08:11:29.521 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T08:11:29.521 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T08:11:29.521 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T08:11:29.522 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T08:11:29.522 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:11:29.522 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:11:29.522 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:11:29.522 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:11:29.522 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:11:29.522 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:11:29.522 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: Upgrade: Complete! 2024-09-21T08:11:29.522 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T08:11:29.522 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T08:11:29.522 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:11:29.523 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:11:29.523 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:11:29.523 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:29.523 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:11:29.523 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:11:29.523 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:11:29.523 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:29.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-21T08:11:29.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: fsmap cephfs:1 {0=cephfs.smithi107.qusoyf=up:active} 3 up:standby 2024-09-21T08:11:29.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: Upgrade: Setting container_image for all rgw 2024-09-21T08:11:29.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:29.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T08:11:29.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:29.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: Upgrade: Setting container_image for all ceph-exporter 2024-09-21T08:11:29.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:29.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.555 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: Upgrade: Setting container_image for all iscsi 2024-09-21T08:11:29.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:29.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: Upgrade: Setting container_image for all nfs 2024-09-21T08:11:29.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:29.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: Upgrade: Setting container_image for all nvmeof 2024-09-21T08:11:29.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:29.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:29.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: Upgrade: Finalizing container_image settings 2024-09-21T08:11:29.556 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T08:11:29.557 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T08:11:29.557 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:11:29.557 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T08:11:29.557 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T08:11:29.557 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T08:11:29.557 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T08:11:29.557 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T08:11:29.557 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T08:11:29.557 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T08:11:29.557 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T08:11:29.557 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T08:11:29.557 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T08:11:29.557 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T08:11:29.557 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:11:29.557 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T08:11:29.558 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T08:11:29.558 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T08:11:29.558 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T08:11:29.558 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T08:11:29.558 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T08:11:29.558 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T08:11:29.558 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T08:11:29.558 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:11:29.558 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:11:29.558 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:11:29.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:11:29.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:11:29.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T08:11:29.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: Upgrade: Complete! 2024-09-21T08:11:29.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T08:11:29.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T08:11:29.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:11:29.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:11:29.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:11:29.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:29.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:11:29.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:11:29.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:11:29.559 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:31.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:30 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:31.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:30 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:11:31.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:30 smithi129 ceph-mon[76722]: pgmap v214: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-21T08:11:31.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:30 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:30 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:30 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:11:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:30 smithi107 ceph-mon[97757]: pgmap v214: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-21T08:11:31.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:30 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:11:33.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:32 smithi129 ceph-mon[76722]: pgmap v215: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-21T08:11:33.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:32 smithi107 ceph-mon[97757]: pgmap v215: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-21T08:11:35.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:34 smithi129 ceph-mon[76722]: pgmap v216: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 4.2 KiB/s wr, 2 op/s 2024-09-21T08:11:35.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:34 smithi107 ceph-mon[97757]: pgmap v216: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 4.2 KiB/s wr, 2 op/s 2024-09-21T08:11:37.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:36 smithi129 ceph-mon[76722]: pgmap v217: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 4.2 KiB/s wr, 2 op/s 2024-09-21T08:11:37.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:36 smithi107 ceph-mon[97757]: pgmap v217: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 4.2 KiB/s wr, 2 op/s 2024-09-21T08:11:39.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:38 smithi129 ceph-mon[76722]: pgmap v218: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:39.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:38 smithi107 ceph-mon[97757]: pgmap v218: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:41.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:40 smithi129 ceph-mon[76722]: pgmap v219: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:41.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:40 smithi107 ceph-mon[97757]: pgmap v219: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:41.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.438+0000 7f9972c34640 1 -- 172.21.15.107:0/2697970663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f996c102550 msgr2=0x7f996c102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:41.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.438+0000 7f9972c34640 1 --2- 172.21.15.107:0/2697970663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f996c102550 0x7f996c102920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f99600048d0 tx=0x7f9960009da0 comp rx=0 tx=0).stop 2024-09-21T08:11:41.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.438+0000 7f9972c34640 1 -- 172.21.15.107:0/2697970663 shutdown_connections 2024-09-21T08:11:41.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.438+0000 7f9972c34640 1 --2- 172.21.15.107:0/2697970663 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f996c102ef0 0x7f996c0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:41.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.438+0000 7f9972c34640 1 --2- 172.21.15.107:0/2697970663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f996c102550 0x7f996c102920 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:41.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.438+0000 7f9972c34640 1 -- 172.21.15.107:0/2697970663 >> 172.21.15.107:0/2697970663 conn(0x7f996c0f80f0 msgr2=0x7f996c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:41.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.438+0000 7f9972c34640 1 -- 172.21.15.107:0/2697970663 shutdown_connections 2024-09-21T08:11:41.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.438+0000 7f9972c34640 1 -- 172.21.15.107:0/2697970663 wait complete. 2024-09-21T08:11:41.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.439+0000 7f9972c34640 1 Processor -- start 2024-09-21T08:11:41.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.439+0000 7f9972c34640 1 -- start start 2024-09-21T08:11:41.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.439+0000 7f9972c34640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f996c102550 0x7f996c113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:41.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.439+0000 7f9972c34640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f996c102ef0 0x7f996c113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:41.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.439+0000 7f9972c34640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996c114100 con 0x7f996c102ef0 2024-09-21T08:11:41.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.439+0000 7f9972c34640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996c10d510 con 0x7f996c102550 2024-09-21T08:11:41.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.440+0000 7f996bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f996c102ef0 0x7f996c113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:41.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.440+0000 7f996bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f996c102ef0 0x7f996c113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33194/0 (socket says 172.21.15.107:33194) 2024-09-21T08:11:41.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.440+0000 7f996bfff640 1 -- 172.21.15.107:0/1144199031 learned_addr learned my addr 172.21.15.107:0/1144199031 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:11:41.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.440+0000 7f99709d0640 1 --2- 172.21.15.107:0/1144199031 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f996c102550 0x7f996c113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:41.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.440+0000 7f996bfff640 1 -- 172.21.15.107:0/1144199031 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f996c102550 msgr2=0x7f996c113570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:41.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.440+0000 7f996bfff640 1 --2- 172.21.15.107:0/1144199031 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f996c102550 0x7f996c113570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:41.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.440+0000 7f996bfff640 1 -- 172.21.15.107:0/1144199031 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9960005040 con 0x7f996c102ef0 2024-09-21T08:11:41.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.440+0000 7f996bfff640 1 --2- 172.21.15.107:0/1144199031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f996c102ef0 0x7f996c113ab0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f995800c760 tx=0x7f995800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:41.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.440+0000 7f99697fa640 1 -- 172.21.15.107:0/1144199031 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f995800a7a0 con 0x7f996c102ef0 2024-09-21T08:11:41.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.440+0000 7f9972c34640 1 -- 172.21.15.107:0/1144199031 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996c10d7f0 con 0x7f996c102ef0 2024-09-21T08:11:41.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.440+0000 7f99697fa640 1 -- 172.21.15.107:0/1144199031 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f995800ada0 con 0x7f996c102ef0 2024-09-21T08:11:41.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.440+0000 7f99697fa640 1 -- 172.21.15.107:0/1144199031 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99580113a0 con 0x7f996c102ef0 2024-09-21T08:11:41.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.441+0000 7f9972c34640 1 -- 172.21.15.107:0/1144199031 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f996c10dd90 con 0x7f996c102ef0 2024-09-21T08:11:41.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.442+0000 7f9972c34640 1 -- 172.21.15.107:0/1144199031 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f996c0fdcd0 con 0x7f996c102ef0 2024-09-21T08:11:41.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.442+0000 7f99697fa640 1 -- 172.21.15.107:0/1144199031 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9958012400 con 0x7f996c102ef0 2024-09-21T08:11:41.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.442+0000 7f99697fa640 1 --2- 172.21.15.107:0/1144199031 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f995c06e530 0x7f995c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:41.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.443+0000 7f99697fa640 1 -- 172.21.15.107:0/1144199031 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f995808e420 con 0x7f996c102ef0 2024-09-21T08:11:41.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.443+0000 7f99709d0640 1 --2- 172.21.15.107:0/1144199031 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f995c06e530 0x7f995c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:41.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.443+0000 7f99709d0640 1 --2- 172.21.15.107:0/1144199031 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f995c06e530 0x7f995c0709e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9960009ac0 tx=0x7f9960035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:41.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.447+0000 7f99697fa640 1 -- 172.21.15.107:0/1144199031 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9958057410 con 0x7f996c102ef0 2024-09-21T08:11:41.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.631+0000 7f9972c34640 1 -- 172.21.15.107:0/1144199031 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f996c1095a0 con 0x7f995c06e530 2024-09-21T08:11:41.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.632+0000 7f99697fa640 1 -- 172.21.15.107:0/1144199031 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f996c1095a0 con 0x7f995c06e530 2024-09-21T08:11:41.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.634+0000 7f9972c34640 1 -- 172.21.15.107:0/1144199031 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f995c06e530 msgr2=0x7f995c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:41.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.634+0000 7f9972c34640 1 --2- 172.21.15.107:0/1144199031 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f995c06e530 0x7f995c0709e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9960009ac0 tx=0x7f9960035040 comp rx=0 tx=0).stop 2024-09-21T08:11:41.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.634+0000 7f9972c34640 1 -- 172.21.15.107:0/1144199031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f996c102ef0 msgr2=0x7f996c113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:41.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.634+0000 7f9972c34640 1 --2- 172.21.15.107:0/1144199031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f996c102ef0 0x7f996c113ab0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f995800c760 tx=0x7f995800cb60 comp rx=0 tx=0).stop 2024-09-21T08:11:41.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.634+0000 7f9972c34640 1 -- 172.21.15.107:0/1144199031 shutdown_connections 2024-09-21T08:11:41.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.634+0000 7f9972c34640 1 --2- 172.21.15.107:0/1144199031 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f995c06e530 0x7f995c0709e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:41.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.634+0000 7f9972c34640 1 --2- 172.21.15.107:0/1144199031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f996c102ef0 0x7f996c113ab0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:41.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.634+0000 7f9972c34640 1 --2- 172.21.15.107:0/1144199031 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f996c102550 0x7f996c113570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:41.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.634+0000 7f9972c34640 1 -- 172.21.15.107:0/1144199031 >> 172.21.15.107:0/1144199031 conn(0x7f996c0f80f0 msgr2=0x7f996c0f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:41.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.634+0000 7f9972c34640 1 -- 172.21.15.107:0/1144199031 shutdown_connections 2024-09-21T08:11:41.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:41.634+0000 7f9972c34640 1 -- 172.21.15.107:0/1144199031 wait complete. 2024-09-21T08:11:42.480 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph orch ps' 2024-09-21T08:11:42.772 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:11:43.003 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:42 smithi107 ceph-mon[97757]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:11:43.004 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:42 smithi107 ceph-mon[97757]: pgmap v220: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:43.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:42 smithi129 ceph-mon[76722]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:11:43.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:42 smithi129 ceph-mon[76722]: pgmap v220: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:44.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.407+0000 7f307bef6640 1 -- 172.21.15.107:0/2410945752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3074102530 msgr2=0x7f3074102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:44.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.407+0000 7f307bef6640 1 --2- 172.21.15.107:0/2410945752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3074102530 0x7f3074102900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3064009c50 tx=0x7f3064004d10 comp rx=0 tx=0).stop 2024-09-21T08:11:44.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.407+0000 7f307bef6640 1 -- 172.21.15.107:0/2410945752 shutdown_connections 2024-09-21T08:11:44.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.407+0000 7f307bef6640 1 --2- 172.21.15.107:0/2410945752 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3074102ed0 0x7f30740fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:44.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.407+0000 7f307bef6640 1 --2- 172.21.15.107:0/2410945752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3074102530 0x7f3074102900 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:44.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.407+0000 7f307bef6640 1 -- 172.21.15.107:0/2410945752 >> 172.21.15.107:0/2410945752 conn(0x7f30740f80f0 msgr2=0x7f30740fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:44.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.407+0000 7f307bef6640 1 -- 172.21.15.107:0/2410945752 shutdown_connections 2024-09-21T08:11:44.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.407+0000 7f307bef6640 1 -- 172.21.15.107:0/2410945752 wait complete. 2024-09-21T08:11:44.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.407+0000 7f307bef6640 1 Processor -- start 2024-09-21T08:11:44.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.408+0000 7f307bef6640 1 -- start start 2024-09-21T08:11:44.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.408+0000 7f307bef6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3074102530 0x7f3074113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:44.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.408+0000 7f307bef6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3074102ed0 0x7f3074113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:44.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.408+0000 7f307bef6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3074113d50 con 0x7f3074102530 2024-09-21T08:11:44.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.408+0000 7f307bef6640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307410d190 con 0x7f3074102ed0 2024-09-21T08:11:44.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.408+0000 7f3079c92640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3074102530 0x7f3074113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:44.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.408+0000 7f3079c92640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3074102530 0x7f3074113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33216/0 (socket says 172.21.15.107:33216) 2024-09-21T08:11:44.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.408+0000 7f3079c92640 1 -- 172.21.15.107:0/3055972596 learned_addr learned my addr 172.21.15.107:0/3055972596 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:11:44.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.408+0000 7f3079c92640 1 -- 172.21.15.107:0/3055972596 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3074102ed0 msgr2=0x7f3074113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:44.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.408+0000 7f3079c92640 1 --2- 172.21.15.107:0/3055972596 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3074102ed0 0x7f3074113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:44.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.408+0000 7f3079c92640 1 -- 172.21.15.107:0/3055972596 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30640098b0 con 0x7f3074102530 2024-09-21T08:11:44.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.408+0000 7f3079c92640 1 --2- 172.21.15.107:0/3055972596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3074102530 0x7f3074113210 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3064004a30 tx=0x7f3064004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:44.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.408+0000 7f30727fc640 1 -- 172.21.15.107:0/3055972596 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3064009690 con 0x7f3074102530 2024-09-21T08:11:44.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.408+0000 7f30727fc640 1 -- 172.21.15.107:0/3055972596 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3064032b10 con 0x7f3074102530 2024-09-21T08:11:44.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.408+0000 7f307bef6640 1 -- 172.21.15.107:0/3055972596 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f307410d410 con 0x7f3074102530 2024-09-21T08:11:44.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.408+0000 7f30727fc640 1 -- 172.21.15.107:0/3055972596 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f306403daa0 con 0x7f3074102530 2024-09-21T08:11:44.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.408+0000 7f307bef6640 1 -- 172.21.15.107:0/3055972596 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f307410d9b0 con 0x7f3074102530 2024-09-21T08:11:44.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.409+0000 7f307bef6640 1 -- 172.21.15.107:0/3055972596 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30740fdcb0 con 0x7f3074102530 2024-09-21T08:11:44.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.410+0000 7f30727fc640 1 -- 172.21.15.107:0/3055972596 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f306402f030 con 0x7f3074102530 2024-09-21T08:11:44.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.410+0000 7f30727fc640 1 --2- 172.21.15.107:0/3055972596 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f305c06e530 0x7f305c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:44.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.410+0000 7f30727fc640 1 -- 172.21.15.107:0/3055972596 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f30640af450 con 0x7f3074102530 2024-09-21T08:11:44.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.410+0000 7f3079491640 1 --2- 172.21.15.107:0/3055972596 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f305c06e530 0x7f305c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:44.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.411+0000 7f3079491640 1 --2- 172.21.15.107:0/3055972596 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f305c06e530 0x7f305c0709e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f307410ead0 tx=0x7f3068007c30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:44.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.415+0000 7f30727fc640 1 -- 172.21.15.107:0/3055972596 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f30640783c0 con 0x7f3074102530 2024-09-21T08:11:44.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.591+0000 7f307bef6640 1 -- 172.21.15.107:0/3055972596 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3074109580 con 0x7f305c06e530 2024-09-21T08:11:44.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.600+0000 7f30727fc640 1 -- 172.21.15.107:0/3055972596 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f3074109580 con 0x7f305c06e530 2024-09-21T08:11:44.601 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:11:44.601 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (8m) 61s ago 16m 26.1M - 0.25.0 c8568f914cd2 2b499aa3b7de 2024-09-21T08:11:44.601 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (4m) 61s ago 17m 6899k - 19.1.1-367-g9e2ac70b cc9251b744a3 69be0e9aa842 2024-09-21T08:11:44.601 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (4m) 21s ago 16m 6891k - 19.1.1-367-g9e2ac70b cc9251b744a3 926ed03c78b9 2024-09-21T08:11:44.601 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (6m) 61s ago 16m 81.8M - 9.4.12 2bacad6d85d8 63177dcfe25c 2024-09-21T08:11:44.602 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (66s) 61s ago 11m 12.2M - 19.1.1-367-g9e2ac70b cc9251b744a3 8ff45e194d69 2024-09-21T08:11:44.602 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (88s) 61s ago 11m 14.6M - 19.1.1-367-g9e2ac70b cc9251b744a3 d0c1d4b4a46b 2024-09-21T08:11:44.602 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (23s) 21s ago 11m 14.5M - 19.1.1-367-g9e2ac70b cc9251b744a3 a1a19681feee 2024-09-21T08:11:44.602 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (43s) 21s ago 11m 12.4M - 19.1.1-367-g9e2ac70b cc9251b744a3 bef6b8069b3b 2024-09-21T08:11:44.602 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:8443,9283,8765 running (8m) 61s ago 18m 503M - 19.1.1-367-g9e2ac70b cc9251b744a3 49c237734f07 2024-09-21T08:11:44.602 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283,8765 running (7m) 21s ago 16m 442M - 19.1.1-367-g9e2ac70b cc9251b744a3 ed117096bdd8 2024-09-21T08:11:44.602 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (5m) 61s ago 18m 49.6M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 445b3e6a800f 2024-09-21T08:11:44.602 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (5m) 21s ago 15m 39.7M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 12706f823621 2024-09-21T08:11:44.602 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 running (8m) 61s ago 16m 16.6M - 1.5.0 0da6a335fe13 6de7c307ba0f 2024-09-21T08:11:44.602 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (8m) 21s ago 16m 16.1M - 1.5.0 0da6a335fe13 cb6d4577b24c 2024-09-21T08:11:44.602 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (4m) 61s ago 15m 158M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 d0a742b31d8a 2024-09-21T08:11:44.602 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (3m) 61s ago 14m 149M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 4bb3f4c8f75a 2024-09-21T08:11:44.602 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (3m) 61s ago 14m 215M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 15f45fa18e64 2024-09-21T08:11:44.603 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (2m) 21s ago 13m 126M 2581M 19.1.1-367-g9e2ac70b cc9251b744a3 ee4efea3e442 2024-09-21T08:11:44.603 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (2m) 21s ago 13m 113M 2581M 19.1.1-367-g9e2ac70b cc9251b744a3 0d09ba7072ba 2024-09-21T08:11:44.603 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (102s) 21s ago 13m 135M 2581M 19.1.1-367-g9e2ac70b cc9251b744a3 caf3fc8cc3f1 2024-09-21T08:11:44.603 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (7m) 61s ago 16m 61.9M - 2.43.0 a07b618ecd1d 9ed2abf5e8d8 2024-09-21T08:11:44.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.602+0000 7f307bef6640 1 -- 172.21.15.107:0/3055972596 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f305c06e530 msgr2=0x7f305c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:44.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.602+0000 7f307bef6640 1 --2- 172.21.15.107:0/3055972596 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f305c06e530 0x7f305c0709e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f307410ead0 tx=0x7f3068007c30 comp rx=0 tx=0).stop 2024-09-21T08:11:44.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.602+0000 7f307bef6640 1 -- 172.21.15.107:0/3055972596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3074102530 msgr2=0x7f3074113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:44.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.602+0000 7f307bef6640 1 --2- 172.21.15.107:0/3055972596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3074102530 0x7f3074113210 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3064004a30 tx=0x7f3064004d10 comp rx=0 tx=0).stop 2024-09-21T08:11:44.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.602+0000 7f307bef6640 1 -- 172.21.15.107:0/3055972596 shutdown_connections 2024-09-21T08:11:44.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.602+0000 7f307bef6640 1 --2- 172.21.15.107:0/3055972596 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f305c06e530 0x7f305c0709e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:44.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.602+0000 7f307bef6640 1 --2- 172.21.15.107:0/3055972596 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3074102ed0 0x7f3074113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:44.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.602+0000 7f307bef6640 1 --2- 172.21.15.107:0/3055972596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3074102530 0x7f3074113210 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:44.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.603+0000 7f307bef6640 1 -- 172.21.15.107:0/3055972596 >> 172.21.15.107:0/3055972596 conn(0x7f30740f80f0 msgr2=0x7f30740f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:44.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.603+0000 7f307bef6640 1 -- 172.21.15.107:0/3055972596 shutdown_connections 2024-09-21T08:11:44.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:44.603+0000 7f307bef6640 1 -- 172.21.15.107:0/3055972596 wait complete. 2024-09-21T08:11:44.916 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:44 smithi107 ceph-mon[97757]: pgmap v221: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:44.917 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:44 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:11:45.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:44 smithi129 ceph-mon[76722]: pgmap v221: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:45.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:44 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:11:45.234 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph orch upgrade status' 2024-09-21T08:11:45.497 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:11:45.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:45 smithi107 ceph-mon[97757]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:11:46.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:45 smithi129 ceph-mon[76722]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:11:46.947 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:46 smithi107 ceph-mon[97757]: pgmap v222: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:47.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:46 smithi129 ceph-mon[76722]: pgmap v222: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:47.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.156+0000 7ffb03f6f640 1 -- 172.21.15.107:0/90609651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffafc102ef0 msgr2=0x7ffafc0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:47.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.156+0000 7ffb03f6f640 1 --2- 172.21.15.107:0/90609651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffafc102ef0 0x7ffafc0fc5b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0048d0 tx=0x7ffaec009da0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.156+0000 7ffb03f6f640 1 -- 172.21.15.107:0/90609651 shutdown_connections 2024-09-21T08:11:47.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.156+0000 7ffb03f6f640 1 --2- 172.21.15.107:0/90609651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffafc102ef0 0x7ffafc0fc5b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.156+0000 7ffb03f6f640 1 --2- 172.21.15.107:0/90609651 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffafc102550 0x7ffafc102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.156+0000 7ffb03f6f640 1 -- 172.21.15.107:0/90609651 >> 172.21.15.107:0/90609651 conn(0x7ffafc0f80f0 msgr2=0x7ffafc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:47.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.156+0000 7ffb03f6f640 1 -- 172.21.15.107:0/90609651 shutdown_connections 2024-09-21T08:11:47.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.156+0000 7ffb03f6f640 1 -- 172.21.15.107:0/90609651 wait complete. 2024-09-21T08:11:47.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.157+0000 7ffb03f6f640 1 Processor -- start 2024-09-21T08:11:47.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.157+0000 7ffb03f6f640 1 -- start start 2024-09-21T08:11:47.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.157+0000 7ffb03f6f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffafc102550 0x7ffafc1135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.157+0000 7ffb03f6f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffafc102ef0 0x7ffafc113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.157+0000 7ffb03f6f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc1141d0 con 0x7ffafc102ef0 2024-09-21T08:11:47.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.157+0000 7ffb03f6f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc10d550 con 0x7ffafc102550 2024-09-21T08:11:47.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.157+0000 7ffb0150a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffafc102ef0 0x7ffafc113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.157+0000 7ffb0150a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffafc102ef0 0x7ffafc113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33240/0 (socket says 172.21.15.107:33240) 2024-09-21T08:11:47.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.157+0000 7ffb0150a640 1 -- 172.21.15.107:0/2156508628 learned_addr learned my addr 172.21.15.107:0/2156508628 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:11:47.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.157+0000 7ffb0150a640 1 -- 172.21.15.107:0/2156508628 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffafc102550 msgr2=0x7ffafc1135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:47.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.157+0000 7ffb01d0b640 1 --2- 172.21.15.107:0/2156508628 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffafc102550 0x7ffafc1135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.157+0000 7ffb0150a640 1 --2- 172.21.15.107:0/2156508628 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffafc102550 0x7ffafc1135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.157+0000 7ffb0150a640 1 -- 172.21.15.107:0/2156508628 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec005040 con 0x7ffafc102ef0 2024-09-21T08:11:47.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.157+0000 7ffb01d0b640 1 --2- 172.21.15.107:0/2156508628 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffafc102550 0x7ffafc1135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:11:47.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.158+0000 7ffb0150a640 1 --2- 172.21.15.107:0/2156508628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffafc102ef0 0x7ffafc113af0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ffaec003080 tx=0x7ffaec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:47.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.158+0000 7ffaf27fc640 1 -- 172.21.15.107:0/2156508628 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaec038070 con 0x7ffafc102ef0 2024-09-21T08:11:47.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.158+0000 7ffaf27fc640 1 -- 172.21.15.107:0/2156508628 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffaec009760 con 0x7ffafc102ef0 2024-09-21T08:11:47.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.158+0000 7ffaf27fc640 1 -- 172.21.15.107:0/2156508628 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaec033420 con 0x7ffafc102ef0 2024-09-21T08:11:47.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.158+0000 7ffb03f6f640 1 -- 172.21.15.107:0/2156508628 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffafc10d780 con 0x7ffafc102ef0 2024-09-21T08:11:47.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.158+0000 7ffb03f6f640 1 -- 172.21.15.107:0/2156508628 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffafc10dbe0 con 0x7ffafc102ef0 2024-09-21T08:11:47.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.159+0000 7ffb03f6f640 1 -- 172.21.15.107:0/2156508628 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffafc0fdcd0 con 0x7ffafc102ef0 2024-09-21T08:11:47.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.159+0000 7ffaf27fc640 1 -- 172.21.15.107:0/2156508628 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ffaec030020 con 0x7ffafc102ef0 2024-09-21T08:11:47.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.160+0000 7ffaf27fc640 1 --2- 172.21.15.107:0/2156508628 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ffae806e530 0x7ffae80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.160+0000 7ffaf27fc640 1 -- 172.21.15.107:0/2156508628 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7ffaec0ae0b0 con 0x7ffafc102ef0 2024-09-21T08:11:47.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.160+0000 7ffb01d0b640 1 --2- 172.21.15.107:0/2156508628 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ffae806e530 0x7ffae80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.160+0000 7ffb01d0b640 1 --2- 172.21.15.107:0/2156508628 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ffae806e530 0x7ffae80709e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8006fd0 tx=0x7ffaf8008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:47.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.164+0000 7ffaf27fc640 1 -- 172.21.15.107:0/2156508628 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ffaec077020 con 0x7ffafc102ef0 2024-09-21T08:11:47.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.347+0000 7ffb03f6f640 1 -- 172.21.15.107:0/2156508628 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffafc04b720 con 0x7ffae806e530 2024-09-21T08:11:47.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.348+0000 7ffaf27fc640 1 -- 172.21.15.107:0/2156508628 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7ffafc04b720 con 0x7ffae806e530 2024-09-21T08:11:47.349 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:11:47.349 INFO:teuthology.orchestra.run.smithi107.stdout: "target_image": null, 2024-09-21T08:11:47.350 INFO:teuthology.orchestra.run.smithi107.stdout: "in_progress": false, 2024-09-21T08:11:47.350 INFO:teuthology.orchestra.run.smithi107.stdout: "which": "", 2024-09-21T08:11:47.350 INFO:teuthology.orchestra.run.smithi107.stdout: "services_complete": [], 2024-09-21T08:11:47.350 INFO:teuthology.orchestra.run.smithi107.stdout: "progress": null, 2024-09-21T08:11:47.350 INFO:teuthology.orchestra.run.smithi107.stdout: "message": "", 2024-09-21T08:11:47.350 INFO:teuthology.orchestra.run.smithi107.stdout: "is_paused": false 2024-09-21T08:11:47.350 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:11:47.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.350+0000 7ffb03f6f640 1 -- 172.21.15.107:0/2156508628 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ffae806e530 msgr2=0x7ffae80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:47.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.350+0000 7ffb03f6f640 1 --2- 172.21.15.107:0/2156508628 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ffae806e530 0x7ffae80709e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8006fd0 tx=0x7ffaf8008040 comp rx=0 tx=0).stop 2024-09-21T08:11:47.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.350+0000 7ffb03f6f640 1 -- 172.21.15.107:0/2156508628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffafc102ef0 msgr2=0x7ffafc113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:47.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.350+0000 7ffb03f6f640 1 --2- 172.21.15.107:0/2156508628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffafc102ef0 0x7ffafc113af0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ffaec003080 tx=0x7ffaec009da0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.350+0000 7ffb03f6f640 1 -- 172.21.15.107:0/2156508628 shutdown_connections 2024-09-21T08:11:47.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.350+0000 7ffb03f6f640 1 --2- 172.21.15.107:0/2156508628 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ffae806e530 0x7ffae80709e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.350+0000 7ffb03f6f640 1 --2- 172.21.15.107:0/2156508628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffafc102ef0 0x7ffafc113af0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.350+0000 7ffb03f6f640 1 --2- 172.21.15.107:0/2156508628 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffafc102550 0x7ffafc1135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.350+0000 7ffb03f6f640 1 -- 172.21.15.107:0/2156508628 >> 172.21.15.107:0/2156508628 conn(0x7ffafc0f80f0 msgr2=0x7ffafc0f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:47.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.351+0000 7ffb03f6f640 1 -- 172.21.15.107:0/2156508628 shutdown_connections 2024-09-21T08:11:47.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:47.351+0000 7ffb03f6f640 1 -- 172.21.15.107:0/2156508628 wait complete. 2024-09-21T08:11:48.109 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph health detail' 2024-09-21T08:11:48.357 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:11:49.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:48 smithi129 ceph-mon[76722]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:11:49.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:48 smithi129 ceph-mon[76722]: pgmap v223: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:49.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:48 smithi107 ceph-mon[97757]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:11:49.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:48 smithi107 ceph-mon[97757]: pgmap v223: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:49.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.910+0000 7fca5e43f640 1 -- 172.21.15.107:0/1369360429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca580fb4a0 msgr2=0x7fca580fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:49.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.910+0000 7fca5e43f640 1 --2- 172.21.15.107:0/1369360429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca580fb4a0 0x7fca580fb910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fca4c0048d0 tx=0x7fca4c009da0 comp rx=0 tx=0).stop 2024-09-21T08:11:49.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.910+0000 7fca5e43f640 1 -- 172.21.15.107:0/1369360429 shutdown_connections 2024-09-21T08:11:49.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.910+0000 7fca5e43f640 1 --2- 172.21.15.107:0/1369360429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca580fb4a0 0x7fca580fb910 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:49.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.910+0000 7fca5e43f640 1 --2- 172.21.15.107:0/1369360429 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca581014e0 0x7fca581018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:49.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.910+0000 7fca5e43f640 1 -- 172.21.15.107:0/1369360429 >> 172.21.15.107:0/1369360429 conn(0x7fca580f7060 msgr2=0x7fca580f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:49.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.910+0000 7fca5e43f640 1 -- 172.21.15.107:0/1369360429 shutdown_connections 2024-09-21T08:11:49.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.910+0000 7fca5e43f640 1 -- 172.21.15.107:0/1369360429 wait complete. 2024-09-21T08:11:49.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.911+0000 7fca5e43f640 1 Processor -- start 2024-09-21T08:11:49.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.911+0000 7fca5e43f640 1 -- start start 2024-09-21T08:11:49.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.911+0000 7fca5e43f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca580fb4a0 0x7fca581120b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:49.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.911+0000 7fca5e43f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca581014e0 0x7fca581125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:49.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.911+0000 7fca5e43f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca58112bf0 con 0x7fca581014e0 2024-09-21T08:11:49.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.911+0000 7fca5e43f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5810c030 con 0x7fca580fb4a0 2024-09-21T08:11:49.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.912+0000 7fca577fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca581014e0 0x7fca581125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:49.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.912+0000 7fca577fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca581014e0 0x7fca581125f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33258/0 (socket says 172.21.15.107:33258) 2024-09-21T08:11:49.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.912+0000 7fca577fe640 1 -- 172.21.15.107:0/3387009950 learned_addr learned my addr 172.21.15.107:0/3387009950 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:11:49.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.912+0000 7fca57fff640 1 --2- 172.21.15.107:0/3387009950 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca580fb4a0 0x7fca581120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:49.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.912+0000 7fca577fe640 1 -- 172.21.15.107:0/3387009950 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca580fb4a0 msgr2=0x7fca581120b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:49.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.912+0000 7fca577fe640 1 --2- 172.21.15.107:0/3387009950 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca580fb4a0 0x7fca581120b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:49.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.912+0000 7fca577fe640 1 -- 172.21.15.107:0/3387009950 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c005040 con 0x7fca581014e0 2024-09-21T08:11:49.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.912+0000 7fca57fff640 1 --2- 172.21.15.107:0/3387009950 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca580fb4a0 0x7fca581120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:11:49.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.912+0000 7fca577fe640 1 --2- 172.21.15.107:0/3387009950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca581014e0 0x7fca581125f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fca4c003080 tx=0x7fca4c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:49.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.912+0000 7fca54ff9640 1 -- 172.21.15.107:0/3387009950 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca4c038070 con 0x7fca581014e0 2024-09-21T08:11:49.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.912+0000 7fca5e43f640 1 -- 172.21.15.107:0/3387009950 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca5810c2b0 con 0x7fca581014e0 2024-09-21T08:11:49.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.912+0000 7fca54ff9640 1 -- 172.21.15.107:0/3387009950 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fca4c0097e0 con 0x7fca581014e0 2024-09-21T08:11:49.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.912+0000 7fca54ff9640 1 -- 172.21.15.107:0/3387009950 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca4c03d420 con 0x7fca581014e0 2024-09-21T08:11:49.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.912+0000 7fca5e43f640 1 -- 172.21.15.107:0/3387009950 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca5810c7f0 con 0x7fca581014e0 2024-09-21T08:11:49.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.913+0000 7fca5e43f640 1 -- 172.21.15.107:0/3387009950 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca580fcbe0 con 0x7fca581014e0 2024-09-21T08:11:49.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.914+0000 7fca54ff9640 1 -- 172.21.15.107:0/3387009950 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fca4c030020 con 0x7fca581014e0 2024-09-21T08:11:49.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.914+0000 7fca54ff9640 1 --2- 172.21.15.107:0/3387009950 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fca4006e530 0x7fca400709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:49.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.914+0000 7fca54ff9640 1 -- 172.21.15.107:0/3387009950 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7fca4c0ae8a0 con 0x7fca581014e0 2024-09-21T08:11:49.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.914+0000 7fca57fff640 1 --2- 172.21.15.107:0/3387009950 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fca4006e530 0x7fca400709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:49.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.915+0000 7fca57fff640 1 --2- 172.21.15.107:0/3387009950 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fca4006e530 0x7fca400709e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fca480041d0 tx=0x7fca48009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:49.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:49.919+0000 7fca54ff9640 1 -- 172.21.15.107:0/3387009950 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fca4c077810 con 0x7fca581014e0 2024-09-21T08:11:50.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:50.152+0000 7fca5e43f640 1 -- 172.21.15.107:0/3387009950 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fca58108460 con 0x7fca581014e0 2024-09-21T08:11:50.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:50.153+0000 7fca54ff9640 1 -- 172.21.15.107:0/3387009950 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fca4c07aed0 con 0x7fca581014e0 2024-09-21T08:11:50.155 INFO:teuthology.orchestra.run.smithi107.stdout:HEALTH_OK 2024-09-21T08:11:50.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:50.155+0000 7fca5e43f640 1 -- 172.21.15.107:0/3387009950 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fca4006e530 msgr2=0x7fca400709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:50.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:50.155+0000 7fca5e43f640 1 --2- 172.21.15.107:0/3387009950 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fca4006e530 0x7fca400709e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fca480041d0 tx=0x7fca48009040 comp rx=0 tx=0).stop 2024-09-21T08:11:50.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:50.155+0000 7fca5e43f640 1 -- 172.21.15.107:0/3387009950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca581014e0 msgr2=0x7fca581125f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:50.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:50.155+0000 7fca5e43f640 1 --2- 172.21.15.107:0/3387009950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca581014e0 0x7fca581125f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fca4c003080 tx=0x7fca4c009da0 comp rx=0 tx=0).stop 2024-09-21T08:11:50.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:50.155+0000 7fca5e43f640 1 -- 172.21.15.107:0/3387009950 shutdown_connections 2024-09-21T08:11:50.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:50.155+0000 7fca5e43f640 1 --2- 172.21.15.107:0/3387009950 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fca4006e530 0x7fca400709e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:50.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:50.155+0000 7fca5e43f640 1 --2- 172.21.15.107:0/3387009950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca581014e0 0x7fca581125f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:50.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:50.155+0000 7fca5e43f640 1 --2- 172.21.15.107:0/3387009950 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca580fb4a0 0x7fca581120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:50.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:50.155+0000 7fca5e43f640 1 -- 172.21.15.107:0/3387009950 >> 172.21.15.107:0/3387009950 conn(0x7fca580f7060 msgr2=0x7fca580f8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:50.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:50.155+0000 7fca5e43f640 1 -- 172.21.15.107:0/3387009950 shutdown_connections 2024-09-21T08:11:50.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:50.155+0000 7fca5e43f640 1 -- 172.21.15.107:0/3387009950 wait complete. 2024-09-21T08:11:50.875 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:50 smithi107 ceph-mon[97757]: pgmap v224: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:50.875 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:50 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/3387009950' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:11:50.898 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph versions' 2024-09-21T08:11:51.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:50 smithi129 ceph-mon[76722]: pgmap v224: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:51.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:50 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/3387009950' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T08:11:51.142 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:11:52.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.747+0000 7f2c052e9640 1 -- 172.21.15.107:0/2927553432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c00102550 msgr2=0x7f2c00102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:52.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.747+0000 7f2c052e9640 1 --2- 172.21.15.107:0/2927553432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c00102550 0x7f2c00102920 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00048d0 tx=0x7f2bf0009da0 comp rx=0 tx=0).stop 2024-09-21T08:11:52.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.747+0000 7f2c052e9640 1 -- 172.21.15.107:0/2927553432 shutdown_connections 2024-09-21T08:11:52.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.747+0000 7f2c052e9640 1 --2- 172.21.15.107:0/2927553432 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c00102ef0 0x7f2c000fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:52.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.747+0000 7f2c052e9640 1 --2- 172.21.15.107:0/2927553432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c00102550 0x7f2c00102920 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:52.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.747+0000 7f2c052e9640 1 -- 172.21.15.107:0/2927553432 >> 172.21.15.107:0/2927553432 conn(0x7f2c000f80f0 msgr2=0x7f2c000fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:52.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.747+0000 7f2c052e9640 1 -- 172.21.15.107:0/2927553432 shutdown_connections 2024-09-21T08:11:52.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.747+0000 7f2c052e9640 1 -- 172.21.15.107:0/2927553432 wait complete. 2024-09-21T08:11:52.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.748+0000 7f2c052e9640 1 Processor -- start 2024-09-21T08:11:52.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.748+0000 7f2c052e9640 1 -- start start 2024-09-21T08:11:52.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.748+0000 7f2c052e9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c00102550 0x7f2c00113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:52.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.748+0000 7f2c052e9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c00102ef0 0x7f2c00113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:52.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.748+0000 7f2c052e9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c001140d0 con 0x7f2c00102ef0 2024-09-21T08:11:52.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.748+0000 7f2c052e9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0010d4e0 con 0x7f2c00102550 2024-09-21T08:11:52.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.748+0000 7f2bf7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c00102ef0 0x7f2c00113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:52.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.748+0000 7f2bf7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c00102ef0 0x7f2c00113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37358/0 (socket says 172.21.15.107:37358) 2024-09-21T08:11:52.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.748+0000 7f2bf7fff640 1 -- 172.21.15.107:0/1674990733 learned_addr learned my addr 172.21.15.107:0/1674990733 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:11:52.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.748+0000 7f2bfeffd640 1 --2- 172.21.15.107:0/1674990733 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c00102550 0x7f2c00113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:52.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.749+0000 7f2bf7fff640 1 -- 172.21.15.107:0/1674990733 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c00102550 msgr2=0x7f2c00113540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:52.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.749+0000 7f2bf7fff640 1 --2- 172.21.15.107:0/1674990733 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c00102550 0x7f2c00113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:52.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.749+0000 7f2bf7fff640 1 -- 172.21.15.107:0/1674990733 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf0005040 con 0x7f2c00102ef0 2024-09-21T08:11:52.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.749+0000 7f2bf7fff640 1 --2- 172.21.15.107:0/1674990733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c00102ef0 0x7f2c00113a80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2be800c790 tx=0x7f2be80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:52.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.749+0000 7f2bf77fe640 1 -- 172.21.15.107:0/1674990733 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2be800a820 con 0x7f2c00102ef0 2024-09-21T08:11:52.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.749+0000 7f2bf77fe640 1 -- 172.21.15.107:0/1674990733 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2be800ae20 con 0x7f2c00102ef0 2024-09-21T08:11:52.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.749+0000 7f2c052e9640 1 -- 172.21.15.107:0/1674990733 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c0010d7c0 con 0x7f2c00102ef0 2024-09-21T08:11:52.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.749+0000 7f2bf77fe640 1 -- 172.21.15.107:0/1674990733 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2be8011380 con 0x7f2c00102ef0 2024-09-21T08:11:52.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.749+0000 7f2c052e9640 1 -- 172.21.15.107:0/1674990733 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c0010dd60 con 0x7f2c00102ef0 2024-09-21T08:11:52.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.750+0000 7f2c052e9640 1 -- 172.21.15.107:0/1674990733 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c000fdcd0 con 0x7f2c00102ef0 2024-09-21T08:11:52.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.751+0000 7f2bf77fe640 1 -- 172.21.15.107:0/1674990733 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2be8012420 con 0x7f2c00102ef0 2024-09-21T08:11:52.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.751+0000 7f2bf77fe640 1 --2- 172.21.15.107:0/1674990733 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2bec06e530 0x7f2bec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:52.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.751+0000 7f2bf77fe640 1 -- 172.21.15.107:0/1674990733 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f2be808e860 con 0x7f2c00102ef0 2024-09-21T08:11:52.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.751+0000 7f2bfeffd640 1 --2- 172.21.15.107:0/1674990733 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2bec06e530 0x7f2bec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:52.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.752+0000 7f2bfeffd640 1 --2- 172.21.15.107:0/1674990733 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2bec06e530 0x7f2bec0709e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0004540 tx=0x7f2bf0009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:52.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.757+0000 7f2bf77fe640 1 -- 172.21.15.107:0/1674990733 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2be80577b0 con 0x7f2c00102ef0 2024-09-21T08:11:52.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.989+0000 7f2c052e9640 1 -- 172.21.15.107:0/1674990733 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2c000fbd50 con 0x7f2c00102ef0 2024-09-21T08:11:52.992 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:52 smithi107 ceph-mon[97757]: pgmap v225: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:52.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.989+0000 7f2bf77fe640 1 -- 172.21.15.107:0/1674990733 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f2be805ae70 con 0x7f2c00102ef0 2024-09-21T08:11:52.992 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:11:52.992 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": { 2024-09-21T08:11:52.992 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:11:52.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:11:52.993 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": { 2024-09-21T08:11:52.993 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:11:52.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:11:52.993 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": { 2024-09-21T08:11:52.993 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 6 2024-09-21T08:11:52.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:11:52.993 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-21T08:11:52.994 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 4 2024-09-21T08:11:52.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:11:52.994 INFO:teuthology.orchestra.run.smithi107.stdout: "overall": { 2024-09-21T08:11:52.994 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 14 2024-09-21T08:11:52.994 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-21T08:11:52.994 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:11:52.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.991+0000 7f2c052e9640 1 -- 172.21.15.107:0/1674990733 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2bec06e530 msgr2=0x7f2bec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:52.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.991+0000 7f2c052e9640 1 --2- 172.21.15.107:0/1674990733 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2bec06e530 0x7f2bec0709e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0004540 tx=0x7f2bf0009da0 comp rx=0 tx=0).stop 2024-09-21T08:11:52.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.991+0000 7f2c052e9640 1 -- 172.21.15.107:0/1674990733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c00102ef0 msgr2=0x7f2c00113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:52.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.991+0000 7f2c052e9640 1 --2- 172.21.15.107:0/1674990733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c00102ef0 0x7f2c00113a80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2be800c790 tx=0x7f2be80043c0 comp rx=0 tx=0).stop 2024-09-21T08:11:52.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.991+0000 7f2c052e9640 1 -- 172.21.15.107:0/1674990733 shutdown_connections 2024-09-21T08:11:52.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.991+0000 7f2c052e9640 1 --2- 172.21.15.107:0/1674990733 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2bec06e530 0x7f2bec0709e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:52.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.991+0000 7f2c052e9640 1 --2- 172.21.15.107:0/1674990733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c00102ef0 0x7f2c00113a80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:52.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.991+0000 7f2c052e9640 1 --2- 172.21.15.107:0/1674990733 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c00102550 0x7f2c00113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:52.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.991+0000 7f2c052e9640 1 -- 172.21.15.107:0/1674990733 >> 172.21.15.107:0/1674990733 conn(0x7f2c000f80f0 msgr2=0x7f2c000f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:52.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.991+0000 7f2c052e9640 1 -- 172.21.15.107:0/1674990733 shutdown_connections 2024-09-21T08:11:52.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:11:52.991+0000 7f2c052e9640 1 -- 172.21.15.107:0/1674990733 wait complete. 2024-09-21T08:11:53.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:52 smithi129 ceph-mon[76722]: pgmap v225: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:53.661 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-21T08:11:53.905 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:11:54.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:53 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/1674990733' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:54.025 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:53 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/1674990733' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:11:55.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:54 smithi129 ceph-mon[76722]: pgmap v226: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:55.043 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:54 smithi107 ceph-mon[97757]: pgmap v226: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:55.546 INFO:teuthology.orchestra.run.smithi107.stdout:wait for servicemap items w/ changing names to refresh 2024-09-21T08:11:56.109 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'sleep 60' 2024-09-21T08:11:56.354 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:11:57.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:56 smithi129 ceph-mon[76722]: pgmap v227: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:57.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:56 smithi107 ceph-mon[97757]: pgmap v227: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:59.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:58 smithi129 ceph-mon[76722]: pgmap v228: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:11:59.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:58 smithi107 ceph-mon[97757]: pgmap v228: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:11:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:12:00.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:11:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:12:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:00 smithi107 ceph-mon[97757]: pgmap v229: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:01.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:00 smithi129 ceph-mon[76722]: pgmap v229: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:03.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:02 smithi107 ceph-mon[97757]: pgmap v230: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:03.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:02 smithi129 ceph-mon[76722]: pgmap v230: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:05.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:04 smithi107 ceph-mon[97757]: pgmap v231: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:05.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:04 smithi129 ceph-mon[76722]: pgmap v231: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:07.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:06 smithi107 ceph-mon[97757]: pgmap v232: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:07.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:06 smithi129 ceph-mon[76722]: pgmap v232: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:09.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:08 smithi107 ceph-mon[97757]: pgmap v233: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:09.069 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:08 smithi129 ceph-mon[76722]: pgmap v233: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:11.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:10 smithi107 ceph-mon[97757]: pgmap v234: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:11.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:10 smithi129 ceph-mon[76722]: pgmap v234: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:13.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:12 smithi107 ceph-mon[97757]: pgmap v235: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:13.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:12 smithi129 ceph-mon[76722]: pgmap v235: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:15.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:14 smithi107 ceph-mon[97757]: pgmap v236: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:15.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:14 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:12:15.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:14 smithi129 ceph-mon[76722]: pgmap v236: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:15.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:14 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:12:17.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:16 smithi107 ceph-mon[97757]: pgmap v237: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:17.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:16 smithi129 ceph-mon[76722]: pgmap v237: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:19.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:18 smithi107 ceph-mon[97757]: pgmap v238: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:19.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:18 smithi129 ceph-mon[76722]: pgmap v238: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:21.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:20 smithi107 ceph-mon[97757]: pgmap v239: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:21.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:20 smithi129 ceph-mon[76722]: pgmap v239: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:23.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:22 smithi107 ceph-mon[97757]: pgmap v240: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:23.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:22 smithi129 ceph-mon[76722]: pgmap v240: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:25.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:24 smithi129 ceph-mon[76722]: pgmap v241: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:25.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:24 smithi107 ceph-mon[97757]: pgmap v241: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:27.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:26 smithi129 ceph-mon[76722]: pgmap v242: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:27.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:26 smithi107 ceph-mon[97757]: pgmap v242: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:29.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:28 smithi107 ceph-mon[97757]: pgmap v243: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:29.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:28 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:12:29.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:28 smithi129 ceph-mon[76722]: pgmap v243: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:29.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:28 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:12:30.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:12:30.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:12:30.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:12:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:12:30.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:12:30.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:12:30.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:12:30.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:12:31.253 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:30 smithi107 ceph-mon[97757]: pgmap v244: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:31.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:30 smithi129 ceph-mon[76722]: pgmap v244: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:33.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:32 smithi129 ceph-mon[76722]: pgmap v245: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:33.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:32 smithi107 ceph-mon[97757]: pgmap v245: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:35.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:34 smithi129 ceph-mon[76722]: pgmap v246: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:35.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:34 smithi107 ceph-mon[97757]: pgmap v246: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:37.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:36 smithi129 ceph-mon[76722]: pgmap v247: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:37.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:36 smithi107 ceph-mon[97757]: pgmap v247: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:39.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:38 smithi129 ceph-mon[76722]: pgmap v248: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:39.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:38 smithi107 ceph-mon[97757]: pgmap v248: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:41.252 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:40 smithi107 ceph-mon[97757]: pgmap v249: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:41.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:40 smithi129 ceph-mon[76722]: pgmap v249: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:43.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:42 smithi129 ceph-mon[76722]: pgmap v250: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:43.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:42 smithi107 ceph-mon[97757]: pgmap v250: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:45.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:44 smithi129 ceph-mon[76722]: pgmap v251: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:45.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:44 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:12:45.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:44 smithi107 ceph-mon[97757]: pgmap v251: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:45.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:44 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:12:47.105 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:46 smithi107 ceph-mon[97757]: pgmap v252: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:47.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:46 smithi129 ceph-mon[76722]: pgmap v252: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:49.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:48 smithi129 ceph-mon[76722]: pgmap v253: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:49.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:48 smithi107 ceph-mon[97757]: pgmap v253: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:51.252 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:50 smithi107 ceph-mon[97757]: pgmap v254: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:51.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:50 smithi129 ceph-mon[76722]: pgmap v254: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:53.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:52 smithi129 ceph-mon[76722]: pgmap v255: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:53.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:52 smithi107 ceph-mon[97757]: pgmap v255: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:55.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:54 smithi129 ceph-mon[76722]: pgmap v256: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:55.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:54 smithi107 ceph-mon[97757]: pgmap v256: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:57.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:56 smithi129 ceph-mon[76722]: pgmap v257: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:57.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:56 smithi107 ceph-mon[97757]: pgmap v257: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:58.664 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph orch ps' 2024-09-21T08:12:58.916 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:12:59.035 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:58 smithi107 ceph-mon[97757]: pgmap v258: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:12:59.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:58 smithi129 ceph-mon[76722]: pgmap v258: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:00.155 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:12:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:13:00.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:12:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:13:00.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.403+0000 7f2bc0b79640 1 -- 172.21.15.107:0/2689500325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bbc102530 msgr2=0x7f2bbc102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:00.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.403+0000 7f2bc0b79640 1 --2- 172.21.15.107:0/2689500325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bbc102530 0x7f2bbc102900 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009c50 tx=0x7f2bb4004d10 comp rx=0 tx=0).stop 2024-09-21T08:13:00.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.403+0000 7f2bc0b79640 1 -- 172.21.15.107:0/2689500325 shutdown_connections 2024-09-21T08:13:00.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.403+0000 7f2bc0b79640 1 --2- 172.21.15.107:0/2689500325 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2bbc102ed0 0x7f2bbc0fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:00.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.403+0000 7f2bc0b79640 1 --2- 172.21.15.107:0/2689500325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bbc102530 0x7f2bbc102900 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:00.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.403+0000 7f2bc0b79640 1 -- 172.21.15.107:0/2689500325 >> 172.21.15.107:0/2689500325 conn(0x7f2bbc0f80f0 msgr2=0x7f2bbc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:00.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.403+0000 7f2bc0b79640 1 -- 172.21.15.107:0/2689500325 shutdown_connections 2024-09-21T08:13:00.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.403+0000 7f2bc0b79640 1 -- 172.21.15.107:0/2689500325 wait complete. 2024-09-21T08:13:00.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.403+0000 7f2bc0b79640 1 Processor -- start 2024-09-21T08:13:00.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.403+0000 7f2bc0b79640 1 -- start start 2024-09-21T08:13:00.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.404+0000 7f2bc0b79640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2bbc102530 0x7f2bbc113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:00.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.404+0000 7f2bc0b79640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bbc102ed0 0x7f2bbc113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:00.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.404+0000 7f2bc0b79640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc113e20 con 0x7f2bbc102ed0 2024-09-21T08:13:00.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.404+0000 7f2bc0b79640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc10d1d0 con 0x7f2bbc102530 2024-09-21T08:13:00.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.404+0000 7f2bb9d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bbc102ed0 0x7f2bbc113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:00.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.404+0000 7f2bb9d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bbc102ed0 0x7f2bbc113790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59728/0 (socket says 172.21.15.107:59728) 2024-09-21T08:13:00.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.404+0000 7f2bb9d9b640 1 -- 172.21.15.107:0/2895786380 learned_addr learned my addr 172.21.15.107:0/2895786380 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:00.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.404+0000 7f2bba59c640 1 --2- 172.21.15.107:0/2895786380 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2bbc102530 0x7f2bbc113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:00.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.404+0000 7f2bb9d9b640 1 -- 172.21.15.107:0/2895786380 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2bbc102530 msgr2=0x7f2bbc113250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:00.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.404+0000 7f2bb9d9b640 1 --2- 172.21.15.107:0/2895786380 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2bbc102530 0x7f2bbc113250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:00.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.404+0000 7f2bb9d9b640 1 -- 172.21.15.107:0/2895786380 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb40098b0 con 0x7f2bbc102ed0 2024-09-21T08:13:00.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.404+0000 7f2bb9d9b640 1 --2- 172.21.15.107:0/2895786380 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bbc102ed0 0x7f2bbc113790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400b540 tx=0x7f2ba40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:00.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.404+0000 7f2bb2ffd640 1 -- 172.21.15.107:0/2895786380 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ba400f6f0 con 0x7f2bbc102ed0 2024-09-21T08:13:00.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.405+0000 7f2bb2ffd640 1 -- 172.21.15.107:0/2895786380 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2ba400fcf0 con 0x7f2bbc102ed0 2024-09-21T08:13:00.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.405+0000 7f2bc0b79640 1 -- 172.21.15.107:0/2895786380 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bbc10d4b0 con 0x7f2bbc102ed0 2024-09-21T08:13:00.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.405+0000 7f2bb2ffd640 1 -- 172.21.15.107:0/2895786380 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ba40103a0 con 0x7f2bbc102ed0 2024-09-21T08:13:00.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.405+0000 7f2bc0b79640 1 -- 172.21.15.107:0/2895786380 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bbc10d9d0 con 0x7f2bbc102ed0 2024-09-21T08:13:00.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.406+0000 7f2bc0b79640 1 -- 172.21.15.107:0/2895786380 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bbc0fdcb0 con 0x7f2bbc102ed0 2024-09-21T08:13:00.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.406+0000 7f2bb2ffd640 1 -- 172.21.15.107:0/2895786380 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2ba400f850 con 0x7f2bbc102ed0 2024-09-21T08:13:00.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.407+0000 7f2bb2ffd640 1 --2- 172.21.15.107:0/2895786380 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2ba806e530 0x7f2ba80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:00.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.407+0000 7f2bb2ffd640 1 -- 172.21.15.107:0/2895786380 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f2ba408e1e0 con 0x7f2bbc102ed0 2024-09-21T08:13:00.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.407+0000 7f2bba59c640 1 --2- 172.21.15.107:0/2895786380 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2ba806e530 0x7f2ba80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:00.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.407+0000 7f2bba59c640 1 --2- 172.21.15.107:0/2895786380 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2ba806e530 0x7f2ba80709e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009c20 tx=0x7f2bb4004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:00.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.411+0000 7f2bb2ffd640 1 -- 172.21.15.107:0/2895786380 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2ba40571d0 con 0x7f2bbc102ed0 2024-09-21T08:13:00.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.586+0000 7f2bc0b79640 1 -- 172.21.15.107:0/2895786380 --> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bbc109640 con 0x7f2ba806e530 2024-09-21T08:13:00.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.595+0000 7f2bb2ffd640 1 -- 172.21.15.107:0/2895786380 <== mgr.34102 v2:172.21.15.107:6800/1355684147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f2bbc109640 con 0x7f2ba806e530 2024-09-21T08:13:00.597 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:13:00.597 INFO:teuthology.orchestra.run.smithi107.stdout:alertmanager.smithi107 smithi107 *:9093,9094 running (9m) 2m ago 18m 26.1M - 0.25.0 c8568f914cd2 2b499aa3b7de 2024-09-21T08:13:00.597 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi107 smithi107 running (6m) 2m ago 18m 6899k - 19.1.1-367-g9e2ac70b cc9251b744a3 69be0e9aa842 2024-09-21T08:13:00.597 INFO:teuthology.orchestra.run.smithi107.stdout:crash.smithi129 smithi129 running (6m) 97s ago 17m 6891k - 19.1.1-367-g9e2ac70b cc9251b744a3 926ed03c78b9 2024-09-21T08:13:00.597 INFO:teuthology.orchestra.run.smithi107.stdout:grafana.smithi107 smithi107 *:3000 running (8m) 2m ago 17m 81.8M - 9.4.12 2bacad6d85d8 63177dcfe25c 2024-09-21T08:13:00.597 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.grqzkt smithi107 running (2m) 2m ago 12m 12.2M - 19.1.1-367-g9e2ac70b cc9251b744a3 8ff45e194d69 2024-09-21T08:13:00.597 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi107.qusoyf smithi107 running (2m) 2m ago 12m 14.6M - 19.1.1-367-g9e2ac70b cc9251b744a3 d0c1d4b4a46b 2024-09-21T08:13:00.597 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.belyba smithi129 running (99s) 97s ago 12m 14.5M - 19.1.1-367-g9e2ac70b cc9251b744a3 a1a19681feee 2024-09-21T08:13:00.597 INFO:teuthology.orchestra.run.smithi107.stdout:mds.cephfs.smithi129.fwmfcy smithi129 running (119s) 97s ago 12m 12.4M - 19.1.1-367-g9e2ac70b cc9251b744a3 bef6b8069b3b 2024-09-21T08:13:00.597 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi107.wzulxb smithi107 *:8443,9283,8765 running (9m) 2m ago 19m 503M - 19.1.1-367-g9e2ac70b cc9251b744a3 49c237734f07 2024-09-21T08:13:00.598 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.smithi129.wvlmvo smithi129 *:8443,9283,8765 running (8m) 97s ago 17m 442M - 19.1.1-367-g9e2ac70b cc9251b744a3 ed117096bdd8 2024-09-21T08:13:00.598 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi107 smithi107 running (7m) 2m ago 19m 49.6M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 445b3e6a800f 2024-09-21T08:13:00.598 INFO:teuthology.orchestra.run.smithi107.stdout:mon.smithi129 smithi129 running (6m) 97s ago 17m 39.7M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 12706f823621 2024-09-21T08:13:00.598 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi107 smithi107 *:9100 running (10m) 2m ago 18m 16.6M - 1.5.0 0da6a335fe13 6de7c307ba0f 2024-09-21T08:13:00.598 INFO:teuthology.orchestra.run.smithi107.stdout:node-exporter.smithi129 smithi129 *:9100 running (9m) 97s ago 17m 16.1M - 1.5.0 0da6a335fe13 cb6d4577b24c 2024-09-21T08:13:00.598 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (5m) 2m ago 16m 158M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 d0a742b31d8a 2024-09-21T08:13:00.598 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi107 running (5m) 2m ago 16m 149M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 4bb3f4c8f75a 2024-09-21T08:13:00.598 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi107 running (4m) 2m ago 15m 215M 1557M 19.1.1-367-g9e2ac70b cc9251b744a3 15f45fa18e64 2024-09-21T08:13:00.598 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi129 running (4m) 97s ago 15m 126M 2581M 19.1.1-367-g9e2ac70b cc9251b744a3 ee4efea3e442 2024-09-21T08:13:00.598 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi129 running (3m) 97s ago 14m 113M 2581M 19.1.1-367-g9e2ac70b cc9251b744a3 0d09ba7072ba 2024-09-21T08:13:00.598 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi129 running (2m) 97s ago 14m 135M 2581M 19.1.1-367-g9e2ac70b cc9251b744a3 caf3fc8cc3f1 2024-09-21T08:13:00.598 INFO:teuthology.orchestra.run.smithi107.stdout:prometheus.smithi107 smithi107 *:9095 running (8m) 2m ago 17m 61.9M - 2.43.0 a07b618ecd1d 9ed2abf5e8d8 2024-09-21T08:13:00.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.597+0000 7f2bc0b79640 1 -- 172.21.15.107:0/2895786380 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2ba806e530 msgr2=0x7f2ba80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:00.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.597+0000 7f2bc0b79640 1 --2- 172.21.15.107:0/2895786380 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2ba806e530 0x7f2ba80709e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009c20 tx=0x7f2bb4004d10 comp rx=0 tx=0).stop 2024-09-21T08:13:00.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.597+0000 7f2bc0b79640 1 -- 172.21.15.107:0/2895786380 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bbc102ed0 msgr2=0x7f2bbc113790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:00.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.597+0000 7f2bc0b79640 1 --2- 172.21.15.107:0/2895786380 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bbc102ed0 0x7f2bbc113790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400b540 tx=0x7f2ba40091a0 comp rx=0 tx=0).stop 2024-09-21T08:13:00.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.597+0000 7f2bc0b79640 1 -- 172.21.15.107:0/2895786380 shutdown_connections 2024-09-21T08:13:00.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.597+0000 7f2bc0b79640 1 --2- 172.21.15.107:0/2895786380 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f2ba806e530 0x7f2ba80709e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:00.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.597+0000 7f2bc0b79640 1 --2- 172.21.15.107:0/2895786380 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bbc102ed0 0x7f2bbc113790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:00.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.597+0000 7f2bc0b79640 1 --2- 172.21.15.107:0/2895786380 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2bbc102530 0x7f2bbc113250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:00.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.597+0000 7f2bc0b79640 1 -- 172.21.15.107:0/2895786380 >> 172.21.15.107:0/2895786380 conn(0x7f2bbc0f80f0 msgr2=0x7f2bbc0f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:00.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.597+0000 7f2bc0b79640 1 -- 172.21.15.107:0/2895786380 shutdown_connections 2024-09-21T08:13:00.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:00.597+0000 7f2bc0b79640 1 -- 172.21.15.107:0/2895786380 wait complete. 2024-09-21T08:13:01.154 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:00 smithi107 ceph-mon[97757]: pgmap v259: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:01.231 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph versions' 2024-09-21T08:13:01.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:00 smithi129 ceph-mon[76722]: pgmap v259: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:01.488 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:02.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:01 smithi129 ceph-mon[76722]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:13:02.297 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:01 smithi107 ceph-mon[97757]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:13:03.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.083+0000 7f6b464ed640 1 -- 172.21.15.107:0/614043569 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b400fcf80 msgr2=0x7f6b400fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:03.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.083+0000 7f6b464ed640 1 --2- 172.21.15.107:0/614043569 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b400fcf80 0x7f6b400fd3d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6b340048d0 tx=0x7f6b34009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:03.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.083+0000 7f6b464ed640 1 -- 172.21.15.107:0/614043569 shutdown_connections 2024-09-21T08:13:03.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.083+0000 7f6b464ed640 1 --2- 172.21.15.107:0/614043569 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b400fcf80 0x7f6b400fd3d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:03.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.083+0000 7f6b464ed640 1 --2- 172.21.15.107:0/614043569 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b400fb810 0x7f6b400fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:03.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.083+0000 7f6b464ed640 1 -- 172.21.15.107:0/614043569 >> 172.21.15.107:0/614043569 conn(0x7f6b400723b0 msgr2=0x7f6b400727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:03.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.083+0000 7f6b464ed640 1 -- 172.21.15.107:0/614043569 shutdown_connections 2024-09-21T08:13:03.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.083+0000 7f6b464ed640 1 -- 172.21.15.107:0/614043569 wait complete. 2024-09-21T08:13:03.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.084+0000 7f6b464ed640 1 Processor -- start 2024-09-21T08:13:03.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.084+0000 7f6b464ed640 1 -- start start 2024-09-21T08:13:03.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.084+0000 7f6b464ed640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b400fb810 0x7f6b40113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:03.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.084+0000 7f6b464ed640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b400fcf80 0x7f6b40113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:03.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.085+0000 7f6b464ed640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b40113de0 con 0x7f6b400fb810 2024-09-21T08:13:03.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.085+0000 7f6b464ed640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4010d190 con 0x7f6b400fcf80 2024-09-21T08:13:03.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.085+0000 7f6b3ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b400fb810 0x7f6b40113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:03.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.085+0000 7f6b3ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b400fb810 0x7f6b40113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51096/0 (socket says 172.21.15.107:51096) 2024-09-21T08:13:03.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.085+0000 7f6b3ffff640 1 -- 172.21.15.107:0/2234301689 learned_addr learned my addr 172.21.15.107:0/2234301689 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:03.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.085+0000 7f6b3f7fe640 1 --2- 172.21.15.107:0/2234301689 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b400fcf80 0x7f6b40113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:03.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.085+0000 7f6b3ffff640 1 -- 172.21.15.107:0/2234301689 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b400fcf80 msgr2=0x7f6b40113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:03.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.085+0000 7f6b3ffff640 1 --2- 172.21.15.107:0/2234301689 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b400fcf80 0x7f6b40113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:03.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.085+0000 7f6b3ffff640 1 -- 172.21.15.107:0/2234301689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b34005040 con 0x7f6b400fb810 2024-09-21T08:13:03.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.085+0000 7f6b3ffff640 1 --2- 172.21.15.107:0/2234301689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b400fb810 0x7f6b40113210 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000b790 tx=0x7f6b300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:03.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.085+0000 7f6b3cff9640 1 -- 172.21.15.107:0/2234301689 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b3000c700 con 0x7f6b400fb810 2024-09-21T08:13:03.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.085+0000 7f6b464ed640 1 -- 172.21.15.107:0/2234301689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4010d470 con 0x7f6b400fb810 2024-09-21T08:13:03.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.085+0000 7f6b3cff9640 1 -- 172.21.15.107:0/2234301689 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6b3000cd00 con 0x7f6b400fb810 2024-09-21T08:13:03.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.085+0000 7f6b3cff9640 1 -- 172.21.15.107:0/2234301689 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b30015e70 con 0x7f6b400fb810 2024-09-21T08:13:03.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.085+0000 7f6b464ed640 1 -- 172.21.15.107:0/2234301689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4010d960 con 0x7f6b400fb810 2024-09-21T08:13:03.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.086+0000 7f6b464ed640 1 -- 172.21.15.107:0/2234301689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b400fcbc0 con 0x7f6b400fb810 2024-09-21T08:13:03.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.087+0000 7f6b3cff9640 1 -- 172.21.15.107:0/2234301689 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f6b30012070 con 0x7f6b400fb810 2024-09-21T08:13:03.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.087+0000 7f6b3cff9640 1 --2- 172.21.15.107:0/2234301689 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6b2806e530 0x7f6b280709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:03.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.087+0000 7f6b3cff9640 1 -- 172.21.15.107:0/2234301689 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f6b3008df00 con 0x7f6b400fb810 2024-09-21T08:13:03.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.087+0000 7f6b3f7fe640 1 --2- 172.21.15.107:0/2234301689 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6b2806e530 0x7f6b280709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:03.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.088+0000 7f6b3f7fe640 1 --2- 172.21.15.107:0/2234301689 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6b2806e530 0x7f6b280709e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6b40101280 tx=0x7f6b34035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:03.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.092+0000 7f6b3cff9640 1 -- 172.21.15.107:0/2234301689 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6b30056e70 con 0x7f6b400fb810 2024-09-21T08:13:03.235 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:02 smithi107 ceph-mon[97757]: pgmap v260: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:03.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:02 smithi129 ceph-mon[76722]: pgmap v260: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:03.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.332+0000 7f6b464ed640 1 -- 172.21.15.107:0/2234301689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6b4004b7b0 con 0x7f6b400fb810 2024-09-21T08:13:03.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.333+0000 7f6b3cff9640 1 -- 172.21.15.107:0/2234301689 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f6b3005a530 con 0x7f6b400fb810 2024-09-21T08:13:03.334 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-21T08:13:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": { 2024-09-21T08:13:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:13:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:13:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": { 2024-09-21T08:13:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-21T08:13:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:13:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": { 2024-09-21T08:13:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 6 2024-09-21T08:13:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:13:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-21T08:13:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 4 2024-09-21T08:13:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-21T08:13:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: "overall": { 2024-09-21T08:13:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 14 2024-09-21T08:13:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-21T08:13:03.336 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-21T08:13:03.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.335+0000 7f6b464ed640 1 -- 172.21.15.107:0/2234301689 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6b2806e530 msgr2=0x7f6b280709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:03.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.335+0000 7f6b464ed640 1 --2- 172.21.15.107:0/2234301689 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6b2806e530 0x7f6b280709e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6b40101280 tx=0x7f6b34035040 comp rx=0 tx=0).stop 2024-09-21T08:13:03.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.335+0000 7f6b464ed640 1 -- 172.21.15.107:0/2234301689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b400fb810 msgr2=0x7f6b40113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:03.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.335+0000 7f6b464ed640 1 --2- 172.21.15.107:0/2234301689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b400fb810 0x7f6b40113210 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000b790 tx=0x7f6b300091d0 comp rx=0 tx=0).stop 2024-09-21T08:13:03.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.335+0000 7f6b464ed640 1 -- 172.21.15.107:0/2234301689 shutdown_connections 2024-09-21T08:13:03.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.335+0000 7f6b464ed640 1 --2- 172.21.15.107:0/2234301689 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f6b2806e530 0x7f6b280709e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:03.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.335+0000 7f6b464ed640 1 --2- 172.21.15.107:0/2234301689 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b400fcf80 0x7f6b40113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:03.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.335+0000 7f6b464ed640 1 --2- 172.21.15.107:0/2234301689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b400fb810 0x7f6b40113210 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:03.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.335+0000 7f6b464ed640 1 -- 172.21.15.107:0/2234301689 >> 172.21.15.107:0/2234301689 conn(0x7f6b400723b0 msgr2=0x7f6b400fa860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:03.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.335+0000 7f6b464ed640 1 -- 172.21.15.107:0/2234301689 shutdown_connections 2024-09-21T08:13:03.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:03.335+0000 7f6b464ed640 1 -- 172.21.15.107:0/2234301689 wait complete. 2024-09-21T08:13:03.978 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:03 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/2234301689' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:13:04.002 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-21T08:13:04.251 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:04.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:03 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/2234301689' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:13:05.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:04 smithi107 ceph-mon[97757]: pgmap v261: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:05.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:04 smithi129 ceph-mon[76722]: pgmap v261: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:05.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.812+0000 7fed95b9f640 1 -- 172.21.15.107:0/278472761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed90101c50 msgr2=0x7fed900fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:05.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.812+0000 7fed95b9f640 1 --2- 172.21.15.107:0/278472761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed90101c50 0x7fed900fb2e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0048d0 tx=0x7fed7c009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:05.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.812+0000 7fed95b9f640 1 -- 172.21.15.107:0/278472761 shutdown_connections 2024-09-21T08:13:05.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.812+0000 7fed95b9f640 1 --2- 172.21.15.107:0/278472761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed90101c50 0x7fed900fb2e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:05.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.812+0000 7fed95b9f640 1 --2- 172.21.15.107:0/278472761 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed901012b0 0x7fed90101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:05.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.812+0000 7fed95b9f640 1 -- 172.21.15.107:0/278472761 >> 172.21.15.107:0/278472761 conn(0x7fed900f6e40 msgr2=0x7fed900f9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:05.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.812+0000 7fed95b9f640 1 -- 172.21.15.107:0/278472761 shutdown_connections 2024-09-21T08:13:05.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.812+0000 7fed95b9f640 1 -- 172.21.15.107:0/278472761 wait complete. 2024-09-21T08:13:05.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.813+0000 7fed95b9f640 1 Processor -- start 2024-09-21T08:13:05.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.813+0000 7fed95b9f640 1 -- start start 2024-09-21T08:13:05.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.813+0000 7fed95b9f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed901012b0 0x7fed9010dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:05.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.813+0000 7fed95b9f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed90101c50 0x7fed9010e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:05.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.813+0000 7fed95b9f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9010eb70 con 0x7fed90101c50 2024-09-21T08:13:05.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.813+0000 7fed95b9f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9010ece0 con 0x7fed901012b0 2024-09-21T08:13:05.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.813+0000 7fed8ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed90101c50 0x7fed9010e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:05.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.813+0000 7fed8ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed90101c50 0x7fed9010e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51114/0 (socket says 172.21.15.107:51114) 2024-09-21T08:13:05.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.813+0000 7fed8ffff640 1 -- 172.21.15.107:0/3836983860 learned_addr learned my addr 172.21.15.107:0/3836983860 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:05.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.814+0000 7fed94b9d640 1 --2- 172.21.15.107:0/3836983860 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed901012b0 0x7fed9010dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:05.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.814+0000 7fed8ffff640 1 -- 172.21.15.107:0/3836983860 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed901012b0 msgr2=0x7fed9010dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:05.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.814+0000 7fed8ffff640 1 --2- 172.21.15.107:0/3836983860 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed901012b0 0x7fed9010dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:05.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.814+0000 7fed8ffff640 1 -- 172.21.15.107:0/3836983860 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7c005040 con 0x7fed90101c50 2024-09-21T08:13:05.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.814+0000 7fed8ffff640 1 --2- 172.21.15.107:0/3836983860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed90101c50 0x7fed9010e520 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fed7c003080 tx=0x7fed7c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:05.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.814+0000 7fed8d7fa640 1 -- 172.21.15.107:0/3836983860 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed7c038070 con 0x7fed90101c50 2024-09-21T08:13:05.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.814+0000 7fed8d7fa640 1 -- 172.21.15.107:0/3836983860 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fed7c0097e0 con 0x7fed90101c50 2024-09-21T08:13:05.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.814+0000 7fed95b9f640 1 -- 172.21.15.107:0/3836983860 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed90117050 con 0x7fed90101c50 2024-09-21T08:13:05.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.814+0000 7fed8d7fa640 1 -- 172.21.15.107:0/3836983860 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed7c03d420 con 0x7fed90101c50 2024-09-21T08:13:05.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.814+0000 7fed95b9f640 1 -- 172.21.15.107:0/3836983860 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed901174b0 con 0x7fed90101c50 2024-09-21T08:13:05.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.815+0000 7fed95b9f640 1 -- 172.21.15.107:0/3836983860 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed900fca20 con 0x7fed90101c50 2024-09-21T08:13:05.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.816+0000 7fed8d7fa640 1 -- 172.21.15.107:0/3836983860 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fed7c030020 con 0x7fed90101c50 2024-09-21T08:13:05.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.816+0000 7fed8d7fa640 1 --2- 172.21.15.107:0/3836983860 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fed8006e530 0x7fed800709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:05.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.816+0000 7fed8d7fa640 1 -- 172.21.15.107:0/3836983860 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7fed7c0ae7c0 con 0x7fed90101c50 2024-09-21T08:13:05.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.816+0000 7fed94b9d640 1 --2- 172.21.15.107:0/3836983860 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fed8006e530 0x7fed800709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:05.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.817+0000 7fed94b9d640 1 --2- 172.21.15.107:0/3836983860 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fed8006e530 0x7fed800709e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed840041d0 tx=0x7fed84009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:05.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:05.820+0000 7fed8d7fa640 1 -- 172.21.15.107:0/3836983860 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fed7c0777b0 con 0x7fed90101c50 2024-09-21T08:13:06.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:06.054+0000 7fed95b9f640 1 -- 172.21.15.107:0/3836983860 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fed900faaa0 con 0x7fed90101c50 2024-09-21T08:13:06.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:06.054+0000 7fed8d7fa640 1 -- 172.21.15.107:0/3836983860 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fed7c07ae70 con 0x7fed90101c50 2024-09-21T08:13:06.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:06.056+0000 7fed95b9f640 1 -- 172.21.15.107:0/3836983860 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fed8006e530 msgr2=0x7fed800709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:06.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:06.056+0000 7fed95b9f640 1 --2- 172.21.15.107:0/3836983860 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fed8006e530 0x7fed800709e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed840041d0 tx=0x7fed84009040 comp rx=0 tx=0).stop 2024-09-21T08:13:06.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:06.056+0000 7fed95b9f640 1 -- 172.21.15.107:0/3836983860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed90101c50 msgr2=0x7fed9010e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:06.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:06.056+0000 7fed95b9f640 1 --2- 172.21.15.107:0/3836983860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed90101c50 0x7fed9010e520 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fed7c003080 tx=0x7fed7c009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:06.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:06.056+0000 7fed95b9f640 1 -- 172.21.15.107:0/3836983860 shutdown_connections 2024-09-21T08:13:06.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:06.056+0000 7fed95b9f640 1 --2- 172.21.15.107:0/3836983860 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fed8006e530 0x7fed800709e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:06.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:06.056+0000 7fed95b9f640 1 --2- 172.21.15.107:0/3836983860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed90101c50 0x7fed9010e520 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:06.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:06.056+0000 7fed95b9f640 1 --2- 172.21.15.107:0/3836983860 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed901012b0 0x7fed9010dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:06.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:06.056+0000 7fed95b9f640 1 -- 172.21.15.107:0/3836983860 >> 172.21.15.107:0/3836983860 conn(0x7fed900f6e40 msgr2=0x7fed900f7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:06.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:06.056+0000 7fed95b9f640 1 -- 172.21.15.107:0/3836983860 shutdown_connections 2024-09-21T08:13:06.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:06.056+0000 7fed95b9f640 1 -- 172.21.15.107:0/3836983860 wait complete. 2024-09-21T08:13:06.066 INFO:teuthology.orchestra.run.smithi107.stdout:true 2024-09-21T08:13:06.657 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-21T08:13:06.903 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:07.024 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:06 smithi107 ceph-mon[97757]: pgmap v262: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:07.025 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:06 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/3836983860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:13:07.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:06 smithi129 ceph-mon[76722]: pgmap v262: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:07.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:06 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/3836983860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:13:08.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.492+0000 7fe7425a7640 1 -- 172.21.15.107:0/2995760988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c0fabd0 msgr2=0x7fe73c0fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:08.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.492+0000 7fe7425a7640 1 --2- 172.21.15.107:0/2995760988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c0fabd0 0x7fe73c0fb040 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe7300048d0 tx=0x7fe730009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:08.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.492+0000 7fe7425a7640 1 -- 172.21.15.107:0/2995760988 shutdown_connections 2024-09-21T08:13:08.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.492+0000 7fe7425a7640 1 --2- 172.21.15.107:0/2995760988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c0fabd0 0x7fe73c0fb040 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:08.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.492+0000 7fe7425a7640 1 --2- 172.21.15.107:0/2995760988 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe73c102680 0x7fe73c102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:08.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.492+0000 7fe7425a7640 1 -- 172.21.15.107:0/2995760988 >> 172.21.15.107:0/2995760988 conn(0x7fe73c071ac0 msgr2=0x7fe73c071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:08.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.493+0000 7fe7425a7640 1 -- 172.21.15.107:0/2995760988 shutdown_connections 2024-09-21T08:13:08.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.493+0000 7fe7425a7640 1 -- 172.21.15.107:0/2995760988 wait complete. 2024-09-21T08:13:08.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.493+0000 7fe7425a7640 1 Processor -- start 2024-09-21T08:13:08.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.493+0000 7fe7425a7640 1 -- start start 2024-09-21T08:13:08.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.493+0000 7fe7425a7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe73c0fabd0 0x7fe73c113260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:08.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.493+0000 7fe7425a7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c102680 0x7fe73c1137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:08.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.493+0000 7fe7425a7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c113da0 con 0x7fe73c102680 2024-09-21T08:13:08.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.493+0000 7fe7425a7640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c10d1e0 con 0x7fe73c0fabd0 2024-09-21T08:13:08.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.494+0000 7fe73b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c102680 0x7fe73c1137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:08.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.494+0000 7fe73b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c102680 0x7fe73c1137a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51142/0 (socket says 172.21.15.107:51142) 2024-09-21T08:13:08.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.494+0000 7fe73b7fe640 1 -- 172.21.15.107:0/98441573 learned_addr learned my addr 172.21.15.107:0/98441573 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:08.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.494+0000 7fe73bfff640 1 --2- 172.21.15.107:0/98441573 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe73c0fabd0 0x7fe73c113260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:08.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.494+0000 7fe73b7fe640 1 -- 172.21.15.107:0/98441573 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe73c0fabd0 msgr2=0x7fe73c113260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:08.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.494+0000 7fe73b7fe640 1 --2- 172.21.15.107:0/98441573 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe73c0fabd0 0x7fe73c113260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:08.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.494+0000 7fe73b7fe640 1 -- 172.21.15.107:0/98441573 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe730005040 con 0x7fe73c102680 2024-09-21T08:13:08.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.494+0000 7fe73b7fe640 1 --2- 172.21.15.107:0/98441573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c102680 0x7fe73c1137a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe730000c00 tx=0x7fe730009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:08.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.494+0000 7fe738ff9640 1 -- 172.21.15.107:0/98441573 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe730038070 con 0x7fe73c102680 2024-09-21T08:13:08.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.494+0000 7fe738ff9640 1 -- 172.21.15.107:0/98441573 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe73002ade0 con 0x7fe73c102680 2024-09-21T08:13:08.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.494+0000 7fe7425a7640 1 -- 172.21.15.107:0/98441573 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe73c10d460 con 0x7fe73c102680 2024-09-21T08:13:08.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.494+0000 7fe738ff9640 1 -- 172.21.15.107:0/98441573 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe73002c7e0 con 0x7fe73c102680 2024-09-21T08:13:08.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.494+0000 7fe7425a7640 1 -- 172.21.15.107:0/98441573 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73c10d9a0 con 0x7fe73c102680 2024-09-21T08:13:08.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.495+0000 7fe7425a7640 1 -- 172.21.15.107:0/98441573 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73c0725d0 con 0x7fe73c102680 2024-09-21T08:13:08.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.496+0000 7fe738ff9640 1 -- 172.21.15.107:0/98441573 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe730030020 con 0x7fe73c102680 2024-09-21T08:13:08.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.496+0000 7fe738ff9640 1 --2- 172.21.15.107:0/98441573 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fe72406e530 0x7fe7240709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:08.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.496+0000 7fe738ff9640 1 -- 172.21.15.107:0/98441573 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7fe7300adf70 con 0x7fe73c102680 2024-09-21T08:13:08.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.496+0000 7fe73bfff640 1 --2- 172.21.15.107:0/98441573 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fe72406e530 0x7fe7240709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:08.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.497+0000 7fe73bfff640 1 --2- 172.21.15.107:0/98441573 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fe72406e530 0x7fe7240709e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe72c004ed0 tx=0x7fe72c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:08.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.501+0000 7fe738ff9640 1 -- 172.21.15.107:0/98441573 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe7300e3210 con 0x7fe73c102680 2024-09-21T08:13:08.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.736+0000 7fe7425a7640 1 -- 172.21.15.107:0/98441573 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe73c109630 con 0x7fe73c102680 2024-09-21T08:13:08.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.736+0000 7fe738ff9640 1 -- 172.21.15.107:0/98441573 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fe730076f90 con 0x7fe73c102680 2024-09-21T08:13:08.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.738+0000 7fe7425a7640 1 -- 172.21.15.107:0/98441573 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fe72406e530 msgr2=0x7fe7240709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:08.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.739+0000 7fe7425a7640 1 --2- 172.21.15.107:0/98441573 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fe72406e530 0x7fe7240709e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe72c004ed0 tx=0x7fe72c00b040 comp rx=0 tx=0).stop 2024-09-21T08:13:08.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.739+0000 7fe7425a7640 1 -- 172.21.15.107:0/98441573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c102680 msgr2=0x7fe73c1137a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:08.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.739+0000 7fe7425a7640 1 --2- 172.21.15.107:0/98441573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c102680 0x7fe73c1137a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe730000c00 tx=0x7fe730009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:08.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.739+0000 7fe7425a7640 1 -- 172.21.15.107:0/98441573 shutdown_connections 2024-09-21T08:13:08.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.739+0000 7fe7425a7640 1 --2- 172.21.15.107:0/98441573 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fe72406e530 0x7fe7240709e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:08.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.739+0000 7fe7425a7640 1 --2- 172.21.15.107:0/98441573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c102680 0x7fe73c1137a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:08.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.739+0000 7fe7425a7640 1 --2- 172.21.15.107:0/98441573 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe73c0fabd0 0x7fe73c113260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:08.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.739+0000 7fe7425a7640 1 -- 172.21.15.107:0/98441573 >> 172.21.15.107:0/98441573 conn(0x7fe73c071ac0 msgr2=0x7fe73c105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:08.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.739+0000 7fe7425a7640 1 -- 172.21.15.107:0/98441573 shutdown_connections 2024-09-21T08:13:08.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:08.739+0000 7fe7425a7640 1 -- 172.21.15.107:0/98441573 wait complete. 2024-09-21T08:13:08.749 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)" 2024-09-21T08:13:09.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:08 smithi107 ceph-mon[97757]: pgmap v263: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:09.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:08 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/98441573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:13:09.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:08 smithi129 ceph-mon[76722]: pgmap v263: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:09.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:08 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/98441573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T08:13:09.408 DEBUG:teuthology.parallel:result is None 2024-09-21T08:13:09.408 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T08:13:09.419 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi107.front.sepia.ceph.com 2024-09-21T08:13:09.419 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T08:13:09.668 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:11.020 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:10 smithi107 ceph-mon[97757]: pgmap v264: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:11.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.223+0000 7fc89bcd5640 1 -- 172.21.15.107:0/4116162338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc894101400 msgr2=0x7fc8941017d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:11.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.223+0000 7fc89bcd5640 1 --2- 172.21.15.107:0/4116162338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc894101400 0x7fc8941017d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc8900048d0 tx=0x7fc890009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:11.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.223+0000 7fc89bcd5640 1 -- 172.21.15.107:0/4116162338 shutdown_connections 2024-09-21T08:13:11.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.223+0000 7fc89bcd5640 1 --2- 172.21.15.107:0/4116162338 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc894101da0 0x7fc8940fb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:11.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.223+0000 7fc89bcd5640 1 --2- 172.21.15.107:0/4116162338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc894101400 0x7fc8941017d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:11.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.223+0000 7fc89bcd5640 1 -- 172.21.15.107:0/4116162338 >> 172.21.15.107:0/4116162338 conn(0x7fc8940f6ff0 msgr2=0x7fc8940f9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:11.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.223+0000 7fc89bcd5640 1 -- 172.21.15.107:0/4116162338 shutdown_connections 2024-09-21T08:13:11.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.223+0000 7fc89bcd5640 1 -- 172.21.15.107:0/4116162338 wait complete. 2024-09-21T08:13:11.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.224+0000 7fc89bcd5640 1 Processor -- start 2024-09-21T08:13:11.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.224+0000 7fc89bcd5640 1 -- start start 2024-09-21T08:13:11.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.224+0000 7fc89bcd5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc894101400 0x7fc894113140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:11.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.224+0000 7fc89bcd5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc894101da0 0x7fc894113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:11.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.224+0000 7fc89bcd5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc894113c80 con 0x7fc894101da0 2024-09-21T08:13:11.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.224+0000 7fc89bcd5640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc894113df0 con 0x7fc894101400 2024-09-21T08:13:11.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.224+0000 7fc899270640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc894101da0 0x7fc894113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:11.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.224+0000 7fc899270640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc894101da0 0x7fc894113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42672/0 (socket says 172.21.15.107:42672) 2024-09-21T08:13:11.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.224+0000 7fc899270640 1 -- 172.21.15.107:0/740313412 learned_addr learned my addr 172.21.15.107:0/740313412 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:11.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.224+0000 7fc899270640 1 -- 172.21.15.107:0/740313412 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc894101400 msgr2=0x7fc894113140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:11.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.224+0000 7fc899270640 1 --2- 172.21.15.107:0/740313412 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc894101400 0x7fc894113140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:11.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.224+0000 7fc899270640 1 -- 172.21.15.107:0/740313412 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc890005040 con 0x7fc894101da0 2024-09-21T08:13:11.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.224+0000 7fc899270640 1 --2- 172.21.15.107:0/740313412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc894101da0 0x7fc894113680 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc88400c830 tx=0x7fc884004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:11.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.225+0000 7fc88a7fc640 1 -- 172.21.15.107:0/740313412 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc88400a850 con 0x7fc894101da0 2024-09-21T08:13:11.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.225+0000 7fc88a7fc640 1 -- 172.21.15.107:0/740313412 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc88400ae50 con 0x7fc894101da0 2024-09-21T08:13:11.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.225+0000 7fc89bcd5640 1 -- 172.21.15.107:0/740313412 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc89410d270 con 0x7fc894101da0 2024-09-21T08:13:11.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.225+0000 7fc88a7fc640 1 -- 172.21.15.107:0/740313412 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8840113a0 con 0x7fc894101da0 2024-09-21T08:13:11.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.225+0000 7fc89bcd5640 1 -- 172.21.15.107:0/740313412 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89410d790 con 0x7fc894101da0 2024-09-21T08:13:11.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.226+0000 7fc89bcd5640 1 -- 172.21.15.107:0/740313412 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8940fcb70 con 0x7fc894101da0 2024-09-21T08:13:11.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.226+0000 7fc88a7fc640 1 -- 172.21.15.107:0/740313412 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc884012400 con 0x7fc894101da0 2024-09-21T08:13:11.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.227+0000 7fc88a7fc640 1 --2- 172.21.15.107:0/740313412 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc88006e540 0x7fc8800709f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:11.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.227+0000 7fc88a7fc640 1 -- 172.21.15.107:0/740313412 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7fc88408e550 con 0x7fc894101da0 2024-09-21T08:13:11.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.227+0000 7fc899a71640 1 --2- 172.21.15.107:0/740313412 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc88006e540 0x7fc8800709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:11.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.227+0000 7fc899a71640 1 --2- 172.21.15.107:0/740313412 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc88006e540 0x7fc8800709f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc89002a530 tx=0x7fc890009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:11.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.231+0000 7fc88a7fc640 1 -- 172.21.15.107:0/740313412 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc884057540 con 0x7fc894101da0 2024-09-21T08:13:11.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:10 smithi129 ceph-mon[76722]: pgmap v264: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:11.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.432+0000 7fc89bcd5640 1 -- 172.21.15.107:0/740313412 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc89405ed70 con 0x7fc894101da0 2024-09-21T08:13:11.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.432+0000 7fc88a7fc640 1 -- 172.21.15.107:0/740313412 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1982 (secure 0 0 0) 0x7fc88405ac00 con 0x7fc894101da0 2024-09-21T08:13:11.434 INFO:teuthology.orchestra.run.smithi107.stdout:e35 2024-09-21T08:13:11.434 INFO:teuthology.orchestra.run.smithi107.stdout:btime 2024-09-21T08:11:28:233223+0000 2024-09-21T08:13:11.434 INFO:teuthology.orchestra.run.smithi107.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T08:13:11.434 INFO:teuthology.orchestra.run.smithi107.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T08:13:11.434 INFO:teuthology.orchestra.run.smithi107.stdout:legacy client fscid: 1 2024-09-21T08:13:11.434 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:11.434 INFO:teuthology.orchestra.run.smithi107.stdout:Filesystem 'cephfs' (1) 2024-09-21T08:13:11.434 INFO:teuthology.orchestra.run.smithi107.stdout:fs_name cephfs 2024-09-21T08:13:11.434 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 35 2024-09-21T08:13:11.434 INFO:teuthology.orchestra.run.smithi107.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T08:13:11.434 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-09-21T08:00:03.244314+0000 2024-09-21T08:13:11.435 INFO:teuthology.orchestra.run.smithi107.stdout:modified 2024-09-21T08:11:27.235845+0000 2024-09-21T08:13:11.435 INFO:teuthology.orchestra.run.smithi107.stdout:tableserver 0 2024-09-21T08:13:11.435 INFO:teuthology.orchestra.run.smithi107.stdout:root 0 2024-09-21T08:13:11.435 INFO:teuthology.orchestra.run.smithi107.stdout:session_timeout 60 2024-09-21T08:13:11.435 INFO:teuthology.orchestra.run.smithi107.stdout:session_autoclose 300 2024-09-21T08:13:11.435 INFO:teuthology.orchestra.run.smithi107.stdout:max_file_size 1099511627776 2024-09-21T08:13:11.435 INFO:teuthology.orchestra.run.smithi107.stdout:max_xattr_size 65536 2024-09-21T08:13:11.435 INFO:teuthology.orchestra.run.smithi107.stdout:required_client_features {} 2024-09-21T08:13:11.435 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure 0 2024-09-21T08:13:11.435 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure_osd_epoch 93 2024-09-21T08:13:11.435 INFO:teuthology.orchestra.run.smithi107.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T08:13:11.435 INFO:teuthology.orchestra.run.smithi107.stdout:max_mds 1 2024-09-21T08:13:11.435 INFO:teuthology.orchestra.run.smithi107.stdout:in 0 2024-09-21T08:13:11.435 INFO:teuthology.orchestra.run.smithi107.stdout:up {0=34378} 2024-09-21T08:13:11.435 INFO:teuthology.orchestra.run.smithi107.stdout:failed 2024-09-21T08:13:11.436 INFO:teuthology.orchestra.run.smithi107.stdout:damaged 2024-09-21T08:13:11.436 INFO:teuthology.orchestra.run.smithi107.stdout:stopped 2024-09-21T08:13:11.436 INFO:teuthology.orchestra.run.smithi107.stdout:data_pools [3] 2024-09-21T08:13:11.436 INFO:teuthology.orchestra.run.smithi107.stdout:metadata_pool 2 2024-09-21T08:13:11.436 INFO:teuthology.orchestra.run.smithi107.stdout:inline_data disabled 2024-09-21T08:13:11.436 INFO:teuthology.orchestra.run.smithi107.stdout:balancer 2024-09-21T08:13:11.436 INFO:teuthology.orchestra.run.smithi107.stdout:bal_rank_mask -1 2024-09-21T08:13:11.436 INFO:teuthology.orchestra.run.smithi107.stdout:standby_count_wanted 1 2024-09-21T08:13:11.436 INFO:teuthology.orchestra.run.smithi107.stdout:qdb_cluster leader: 34378 members: 34378 2024-09-21T08:13:11.436 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.qusoyf{0:34378} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.107:6826/3638073096,v1:172.21.15.107:6827/3638073096] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T08:13:11.436 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:11.436 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:11.436 INFO:teuthology.orchestra.run.smithi107.stdout:Standby daemons: 2024-09-21T08:13:11.437 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:11.437 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi107.grqzkt{-1:34402} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6828/1321345266,v1:172.21.15.107:6829/1321345266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T08:13:11.437 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.fwmfcy{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.129:6824/4074709540,v1:172.21.15.129:6825/4074709540] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T08:13:11.437 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.cephfs.smithi129.belyba{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.129:6826/3676932805,v1:172.21.15.129:6827/3676932805] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T08:13:11.437 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 35 2024-09-21T08:13:11.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.434+0000 7fc89bcd5640 1 -- 172.21.15.107:0/740313412 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc88006e540 msgr2=0x7fc8800709f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:11.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.434+0000 7fc89bcd5640 1 --2- 172.21.15.107:0/740313412 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc88006e540 0x7fc8800709f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc89002a530 tx=0x7fc890009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:11.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.434+0000 7fc89bcd5640 1 -- 172.21.15.107:0/740313412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc894101da0 msgr2=0x7fc894113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:11.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.434+0000 7fc89bcd5640 1 --2- 172.21.15.107:0/740313412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc894101da0 0x7fc894113680 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc88400c830 tx=0x7fc884004430 comp rx=0 tx=0).stop 2024-09-21T08:13:11.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.434+0000 7fc89bcd5640 1 -- 172.21.15.107:0/740313412 shutdown_connections 2024-09-21T08:13:11.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.434+0000 7fc89bcd5640 1 --2- 172.21.15.107:0/740313412 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc88006e540 0x7fc8800709f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:11.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.434+0000 7fc89bcd5640 1 --2- 172.21.15.107:0/740313412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc894101da0 0x7fc894113680 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:11.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.434+0000 7fc89bcd5640 1 --2- 172.21.15.107:0/740313412 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc894101400 0x7fc894113140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:11.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.434+0000 7fc89bcd5640 1 -- 172.21.15.107:0/740313412 >> 172.21.15.107:0/740313412 conn(0x7fc8940f6ff0 msgr2=0x7fc894065990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:11.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.435+0000 7fc89bcd5640 1 -- 172.21.15.107:0/740313412 shutdown_connections 2024-09-21T08:13:11.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:11.435+0000 7fc89bcd5640 1 -- 172.21.15.107:0/740313412 wait complete. 2024-09-21T08:13:12.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:11 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/740313412' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:13:12.085 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-21T08:13:12.098 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:13:12.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:11 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/740313412' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T08:13:12.348 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:13.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:12 smithi129 ceph-mon[76722]: pgmap v265: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:13.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:12 smithi107 ceph-mon[97757]: pgmap v265: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:13.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.928+0000 7f76f5236640 1 -- 172.21.15.107:0/1908719045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76f00fe450 msgr2=0x7f76f00fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:13.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.928+0000 7f76f5236640 1 --2- 172.21.15.107:0/1908719045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76f00fe450 0x7f76f00fe820 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f76e00048d0 tx=0x7f76e0009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:13.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.928+0000 7f76f5236640 1 -- 172.21.15.107:0/1908719045 shutdown_connections 2024-09-21T08:13:13.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.928+0000 7f76f5236640 1 --2- 172.21.15.107:0/1908719045 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76f0064fe0 0x7f76f0065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:13.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.928+0000 7f76f5236640 1 --2- 172.21.15.107:0/1908719045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76f00fe450 0x7f76f00fe820 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:13.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.928+0000 7f76f5236640 1 -- 172.21.15.107:0/1908719045 >> 172.21.15.107:0/1908719045 conn(0x7f76f00723b0 msgr2=0x7f76f00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:13.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.928+0000 7f76f5236640 1 -- 172.21.15.107:0/1908719045 shutdown_connections 2024-09-21T08:13:13.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.928+0000 7f76f5236640 1 -- 172.21.15.107:0/1908719045 wait complete. 2024-09-21T08:13:13.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.928+0000 7f76f5236640 1 Processor -- start 2024-09-21T08:13:13.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.928+0000 7f76f5236640 1 -- start start 2024-09-21T08:13:13.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.929+0000 7f76f5236640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76f0064fe0 0x7f76f0113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:13.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.929+0000 7f76f5236640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76f00fe450 0x7f76f0113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:13.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.929+0000 7f76f5236640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f0113d50 con 0x7f76f00fe450 2024-09-21T08:13:13.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.929+0000 7f76f5236640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f010d190 con 0x7f76f0064fe0 2024-09-21T08:13:13.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.929+0000 7f76e659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76f00fe450 0x7f76f0113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:13.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.929+0000 7f76e659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76f00fe450 0x7f76f0113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42690/0 (socket says 172.21.15.107:42690) 2024-09-21T08:13:13.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.929+0000 7f76e659c640 1 -- 172.21.15.107:0/904021689 learned_addr learned my addr 172.21.15.107:0/904021689 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:13.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.929+0000 7f76eed9d640 1 --2- 172.21.15.107:0/904021689 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76f0064fe0 0x7f76f0113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:13.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.929+0000 7f76e659c640 1 -- 172.21.15.107:0/904021689 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76f0064fe0 msgr2=0x7f76f0113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:13.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.929+0000 7f76e659c640 1 --2- 172.21.15.107:0/904021689 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76f0064fe0 0x7f76f0113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:13.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.929+0000 7f76e659c640 1 -- 172.21.15.107:0/904021689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e0005040 con 0x7f76f00fe450 2024-09-21T08:13:13.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.929+0000 7f76eed9d640 1 --2- 172.21.15.107:0/904021689 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76f0064fe0 0x7f76f0113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:13:13.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.929+0000 7f76e659c640 1 --2- 172.21.15.107:0/904021689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76f00fe450 0x7f76f0113750 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f76d800c790 tx=0x7f76d80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:13.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.929+0000 7f76e7fff640 1 -- 172.21.15.107:0/904021689 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76d800a820 con 0x7f76f00fe450 2024-09-21T08:13:13.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.929+0000 7f76f5236640 1 -- 172.21.15.107:0/904021689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f010d470 con 0x7f76f00fe450 2024-09-21T08:13:13.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.929+0000 7f76e7fff640 1 -- 172.21.15.107:0/904021689 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f76d800ae20 con 0x7f76f00fe450 2024-09-21T08:13:13.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.929+0000 7f76e7fff640 1 -- 172.21.15.107:0/904021689 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76d80113a0 con 0x7f76f00fe450 2024-09-21T08:13:13.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.929+0000 7f76f5236640 1 -- 172.21.15.107:0/904021689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f010d990 con 0x7f76f00fe450 2024-09-21T08:13:13.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.930+0000 7f76f5236640 1 -- 172.21.15.107:0/904021689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f00fdce0 con 0x7f76f00fe450 2024-09-21T08:13:13.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.931+0000 7f76e7fff640 1 -- 172.21.15.107:0/904021689 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f76d8012400 con 0x7f76f00fe450 2024-09-21T08:13:13.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.931+0000 7f76e7fff640 1 --2- 172.21.15.107:0/904021689 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f76dc06e530 0x7f76dc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:13.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.931+0000 7f76e7fff640 1 -- 172.21.15.107:0/904021689 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f76d808e430 con 0x7f76f00fe450 2024-09-21T08:13:13.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.931+0000 7f76eed9d640 1 --2- 172.21.15.107:0/904021689 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f76dc06e530 0x7f76dc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:13.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.932+0000 7f76eed9d640 1 --2- 172.21.15.107:0/904021689 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f76dc06e530 0x7f76dc0709e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f76e0007ac0 tx=0x7f76e0009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:13.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:13.936+0000 7f76e7fff640 1 -- 172.21.15.107:0/904021689 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f76d8057420 con 0x7f76f00fe450 2024-09-21T08:13:14.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:14.139+0000 7f76f5236640 1 -- 172.21.15.107:0/904021689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76f0072ec0 con 0x7f76f00fe450 2024-09-21T08:13:14.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:14.139+0000 7f76e7fff640 1 -- 172.21.15.107:0/904021689 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+5261 (secure 0 0 0) 0x7f76d805aae0 con 0x7f76f00fe450 2024-09-21T08:13:14.141 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:14.141 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":35,"btime":"2024-09-21T08:11:28:233223+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34402,"name":"cephfs.smithi107.grqzkt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6829/1321345266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1321345266},{"type":"v1","addr":"172.21.15.107:6829","nonce":1321345266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44319,"name":"cephfs.smithi129.fwmfcy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6825/4074709540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":4074709540},{"type":"v1","addr":"172.21.15.129:6825","nonce":4074709540}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44343,"name":"cephfs.smithi129.belyba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6827/3676932805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3676932805},{"type":"v1","addr":"172.21.15.129:6827","nonce":3676932805}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:11:27.235845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi107.qusoyf","rank":0,"incarnation":30,"state":"up:active","state_seq":19,"addr":"172.21.15.107:6827/3638073096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3638073096},{"type":"v1","addr":"172.21.15.107:6827","nonce":3638073096}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34378,"qdb_cluster":[34378]},"id":1}]} 2024-09-21T08:13:14.141 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 35 2024-09-21T08:13:14.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:14.141+0000 7f76f5236640 1 -- 172.21.15.107:0/904021689 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f76dc06e530 msgr2=0x7f76dc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:14.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:14.141+0000 7f76f5236640 1 --2- 172.21.15.107:0/904021689 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f76dc06e530 0x7f76dc0709e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f76e0007ac0 tx=0x7f76e0009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:14.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:14.141+0000 7f76f5236640 1 -- 172.21.15.107:0/904021689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76f00fe450 msgr2=0x7f76f0113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:14.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:14.141+0000 7f76f5236640 1 --2- 172.21.15.107:0/904021689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76f00fe450 0x7f76f0113750 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f76d800c790 tx=0x7f76d80043c0 comp rx=0 tx=0).stop 2024-09-21T08:13:14.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:14.141+0000 7f76f5236640 1 -- 172.21.15.107:0/904021689 shutdown_connections 2024-09-21T08:13:14.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:14.141+0000 7f76f5236640 1 --2- 172.21.15.107:0/904021689 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f76dc06e530 0x7f76dc0709e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:14.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:14.141+0000 7f76f5236640 1 --2- 172.21.15.107:0/904021689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76f00fe450 0x7f76f0113750 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:14.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:14.141+0000 7f76f5236640 1 --2- 172.21.15.107:0/904021689 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76f0064fe0 0x7f76f0113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:14.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:14.141+0000 7f76f5236640 1 -- 172.21.15.107:0/904021689 >> 172.21.15.107:0/904021689 conn(0x7f76f00723b0 msgr2=0x7f76f00fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:14.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:14.142+0000 7f76f5236640 1 -- 172.21.15.107:0/904021689 shutdown_connections 2024-09-21T08:13:14.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:14.142+0000 7f76f5236640 1 -- 172.21.15.107:0/904021689 wait complete. 2024-09-21T08:13:15.023 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 1, 'flags': 18} 2024-09-21T08:13:15.024 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 16 2024-09-21T08:13:15.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:14 smithi129 ceph-mon[76722]: pgmap v266: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:15.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:14 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/904021689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T08:13:15.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:14 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:13:15.273 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:15.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:14 smithi107 ceph-mon[97757]: pgmap v266: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:15.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:14 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/904021689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T08:13:15.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:14 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:13:16.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.894+0000 7f3cfb9ab640 1 -- 172.21.15.107:0/3100703378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cf4102ef0 msgr2=0x7f3cf40fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:16.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.894+0000 7f3cfb9ab640 1 --2- 172.21.15.107:0/3100703378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cf4102ef0 0x7f3cf40fc5b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8009c50 tx=0x7f3ce8004d10 comp rx=0 tx=0).stop 2024-09-21T08:13:16.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.894+0000 7f3cfb9ab640 1 -- 172.21.15.107:0/3100703378 shutdown_connections 2024-09-21T08:13:16.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.894+0000 7f3cfb9ab640 1 --2- 172.21.15.107:0/3100703378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cf4102ef0 0x7f3cf40fc5b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:16.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.894+0000 7f3cfb9ab640 1 --2- 172.21.15.107:0/3100703378 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3cf4102550 0x7f3cf4102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:16.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.894+0000 7f3cfb9ab640 1 -- 172.21.15.107:0/3100703378 >> 172.21.15.107:0/3100703378 conn(0x7f3cf40f80f0 msgr2=0x7f3cf40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:16.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.894+0000 7f3cfb9ab640 1 -- 172.21.15.107:0/3100703378 shutdown_connections 2024-09-21T08:13:16.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.894+0000 7f3cfb9ab640 1 -- 172.21.15.107:0/3100703378 wait complete. 2024-09-21T08:13:16.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.894+0000 7f3cfb9ab640 1 Processor -- start 2024-09-21T08:13:16.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.895+0000 7f3cfb9ab640 1 -- start start 2024-09-21T08:13:16.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.895+0000 7f3cfb9ab640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3cf4102550 0x7f3cf41135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:16.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.895+0000 7f3cfb9ab640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cf4102ef0 0x7f3cf4113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:16.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.895+0000 7f3cfb9ab640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf41141d0 con 0x7f3cf4102ef0 2024-09-21T08:13:16.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.895+0000 7f3cfb9ab640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf410d550 con 0x7f3cf4102550 2024-09-21T08:13:16.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.895+0000 7f3cf8f46640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cf4102ef0 0x7f3cf4113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:16.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.895+0000 7f3cf8f46640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cf4102ef0 0x7f3cf4113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42720/0 (socket says 172.21.15.107:42720) 2024-09-21T08:13:16.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.895+0000 7f3cf8f46640 1 -- 172.21.15.107:0/2733531419 learned_addr learned my addr 172.21.15.107:0/2733531419 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:16.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.895+0000 7f3cf9747640 1 --2- 172.21.15.107:0/2733531419 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3cf4102550 0x7f3cf41135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:16.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.895+0000 7f3cf8f46640 1 -- 172.21.15.107:0/2733531419 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3cf4102550 msgr2=0x7f3cf41135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:16.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.895+0000 7f3cf8f46640 1 --2- 172.21.15.107:0/2733531419 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3cf4102550 0x7f3cf41135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:16.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.895+0000 7f3cf8f46640 1 -- 172.21.15.107:0/2733531419 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce80098b0 con 0x7f3cf4102ef0 2024-09-21T08:13:16.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.895+0000 7f3cf8f46640 1 --2- 172.21.15.107:0/2733531419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cf4102ef0 0x7f3cf4113af0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8003400 tx=0x7f3ce8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:16.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.897+0000 7f3cf1ffb640 1 -- 172.21.15.107:0/2733531419 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ce8009610 con 0x7f3cf4102ef0 2024-09-21T08:13:16.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.897+0000 7f3cf1ffb640 1 -- 172.21.15.107:0/2733531419 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3ce8032b10 con 0x7f3cf4102ef0 2024-09-21T08:13:16.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.897+0000 7f3cf1ffb640 1 -- 172.21.15.107:0/2733531419 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ce803d9c0 con 0x7f3cf4102ef0 2024-09-21T08:13:16.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.897+0000 7f3cfb9ab640 1 -- 172.21.15.107:0/2733531419 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf410d780 con 0x7f3cf4102ef0 2024-09-21T08:13:16.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.897+0000 7f3cfb9ab640 1 -- 172.21.15.107:0/2733531419 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf410dca0 con 0x7f3cf4102ef0 2024-09-21T08:13:16.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.898+0000 7f3cfb9ab640 1 -- 172.21.15.107:0/2733531419 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf40fdcd0 con 0x7f3cf4102ef0 2024-09-21T08:13:16.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.899+0000 7f3cf1ffb640 1 -- 172.21.15.107:0/2733531419 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3ce802f030 con 0x7f3cf4102ef0 2024-09-21T08:13:16.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.899+0000 7f3cf1ffb640 1 --2- 172.21.15.107:0/2733531419 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f3cdc06e530 0x7f3cdc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:16.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.899+0000 7f3cf1ffb640 1 -- 172.21.15.107:0/2733531419 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f3ce80af2a0 con 0x7f3cf4102ef0 2024-09-21T08:13:16.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.899+0000 7f3cf9747640 1 --2- 172.21.15.107:0/2733531419 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f3cdc06e530 0x7f3cdc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:16.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.900+0000 7f3cf9747640 1 --2- 172.21.15.107:0/2733531419 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f3cdc06e530 0x7f3cdc0709e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009b50 tx=0x7f3cec009120 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:16.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:16.904+0000 7f3cf1ffb640 1 -- 172.21.15.107:0/2733531419 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3ce8078290 con 0x7f3cf4102ef0 2024-09-21T08:13:17.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:16 smithi107 ceph-mon[97757]: pgmap v267: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:17.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:17.102+0000 7f3cfb9ab640 1 -- 172.21.15.107:0/2733531419 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7f3cf40fbd50 con 0x7f3cf4102ef0 2024-09-21T08:13:17.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:17.103+0000 7f3cf1ffb640 1 -- 172.21.15.107:0/2733531419 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v35) v1 ==== 107+0+4126 (secure 0 0 0) 0x7f3ce807b950 con 0x7f3cf4102ef0 2024-09-21T08:13:17.105 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:17.105 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":16,"btime":"2024-09-21T08:10:13:724114+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24239,"name":"cephfs.smithi129.fwmfcy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.129:6825/694369363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":694369363},{"type":"v1","addr":"172.21.15.129:6825","nonce":694369363}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24247,"name":"cephfs.smithi129.belyba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.129:6827/3658871735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3658871735},{"type":"v1","addr":"172.21.15.129:6827","nonce":3658871735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:00:21.458971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14458":{"gid":14458,"name":"cephfs.smithi107.grqzkt","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.107:6829/3876219633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3876219633},{"type":"v1","addr":"172.21.15.107:6829","nonce":3876219633}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T08:13:17.106 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 16 2024-09-21T08:13:17.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:17.105+0000 7f3cfb9ab640 1 -- 172.21.15.107:0/2733531419 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f3cdc06e530 msgr2=0x7f3cdc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:17.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:17.105+0000 7f3cfb9ab640 1 --2- 172.21.15.107:0/2733531419 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f3cdc06e530 0x7f3cdc0709e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009b50 tx=0x7f3cec009120 comp rx=0 tx=0).stop 2024-09-21T08:13:17.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:17.105+0000 7f3cfb9ab640 1 -- 172.21.15.107:0/2733531419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cf4102ef0 msgr2=0x7f3cf4113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:17.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:17.105+0000 7f3cfb9ab640 1 --2- 172.21.15.107:0/2733531419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cf4102ef0 0x7f3cf4113af0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8003400 tx=0x7f3ce8004d10 comp rx=0 tx=0).stop 2024-09-21T08:13:17.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:17.105+0000 7f3cfb9ab640 1 -- 172.21.15.107:0/2733531419 shutdown_connections 2024-09-21T08:13:17.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:17.105+0000 7f3cfb9ab640 1 --2- 172.21.15.107:0/2733531419 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f3cdc06e530 0x7f3cdc0709e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:17.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:17.105+0000 7f3cfb9ab640 1 --2- 172.21.15.107:0/2733531419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cf4102ef0 0x7f3cf4113af0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:17.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:17.105+0000 7f3cfb9ab640 1 --2- 172.21.15.107:0/2733531419 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3cf4102550 0x7f3cf41135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:17.105+0000 7f3cfb9ab640 1 -- 172.21.15.107:0/2733531419 >> 172.21.15.107:0/2733531419 conn(0x7f3cf40f80f0 msgr2=0x7f3cf40f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:17.105+0000 7f3cfb9ab640 1 -- 172.21.15.107:0/2733531419 shutdown_connections 2024-09-21T08:13:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:17.105+0000 7f3cfb9ab640 1 -- 172.21.15.107:0/2733531419 wait complete. 2024-09-21T08:13:17.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:16 smithi129 ceph-mon[76722]: pgmap v267: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:17.714 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 17 2024-09-21T08:13:17.969 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:18.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:17 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/2733531419' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-09-21T08:13:18.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:17 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/2733531419' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-09-21T08:13:19.161 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:18 smithi107 ceph-mon[97757]: pgmap v268: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:19.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:18 smithi129 ceph-mon[76722]: pgmap v268: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:19.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.632+0000 7fcedb030640 1 -- 172.21.15.107:0/1275308072 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fced40fb470 msgr2=0x7fced40fb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:19.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.632+0000 7fcedb030640 1 --2- 172.21.15.107:0/1275308072 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fced40fb470 0x7fced40fb8e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcec00048d0 tx=0x7fcec0009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.632+0000 7fcedb030640 1 -- 172.21.15.107:0/1275308072 shutdown_connections 2024-09-21T08:13:19.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.632+0000 7fcedb030640 1 --2- 172.21.15.107:0/1275308072 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fced40fb470 0x7fced40fb8e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.632+0000 7fcedb030640 1 --2- 172.21.15.107:0/1275308072 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fced41014b0 0x7fced4101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.632+0000 7fcedb030640 1 -- 172.21.15.107:0/1275308072 >> 172.21.15.107:0/1275308072 conn(0x7fced40f7030 msgr2=0x7fced40f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:19.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.632+0000 7fcedb030640 1 -- 172.21.15.107:0/1275308072 shutdown_connections 2024-09-21T08:13:19.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.632+0000 7fcedb030640 1 -- 172.21.15.107:0/1275308072 wait complete. 2024-09-21T08:13:19.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.632+0000 7fcedb030640 1 Processor -- start 2024-09-21T08:13:19.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.633+0000 7fcedb030640 1 -- start start 2024-09-21T08:13:19.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.633+0000 7fcedb030640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fced40fb470 0x7fced41120e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.633+0000 7fcedb030640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fced41014b0 0x7fced4112620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.633+0000 7fcedb030640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced4112c20 con 0x7fced40fb470 2024-09-21T08:13:19.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.633+0000 7fcedb030640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced410c060 con 0x7fced41014b0 2024-09-21T08:13:19.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.633+0000 7fced8dcc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fced40fb470 0x7fced41120e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:19.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.633+0000 7fced8dcc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fced40fb470 0x7fced41120e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42728/0 (socket says 172.21.15.107:42728) 2024-09-21T08:13:19.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.633+0000 7fced8dcc640 1 -- 172.21.15.107:0/651429123 learned_addr learned my addr 172.21.15.107:0/651429123 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:19.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.634+0000 7fced3fff640 1 --2- 172.21.15.107:0/651429123 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fced41014b0 0x7fced4112620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:19.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.634+0000 7fced8dcc640 1 -- 172.21.15.107:0/651429123 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fced41014b0 msgr2=0x7fced4112620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:19.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.634+0000 7fced8dcc640 1 --2- 172.21.15.107:0/651429123 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fced41014b0 0x7fced4112620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.634+0000 7fced8dcc640 1 -- 172.21.15.107:0/651429123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec0005040 con 0x7fced40fb470 2024-09-21T08:13:19.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.634+0000 7fced3fff640 1 --2- 172.21.15.107:0/651429123 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fced41014b0 0x7fced4112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:13:19.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.634+0000 7fced8dcc640 1 --2- 172.21.15.107:0/651429123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fced40fb470 0x7fced41120e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcec8002a50 tx=0x7fcec8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:19.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.634+0000 7fced17fa640 1 -- 172.21.15.107:0/651429123 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcec8007c30 con 0x7fced40fb470 2024-09-21T08:13:19.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.634+0000 7fced17fa640 1 -- 172.21.15.107:0/651429123 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcec800f040 con 0x7fced40fb470 2024-09-21T08:13:19.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.634+0000 7fcedb030640 1 -- 172.21.15.107:0/651429123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced410c340 con 0x7fced40fb470 2024-09-21T08:13:19.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.634+0000 7fced17fa640 1 -- 172.21.15.107:0/651429123 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcec800da90 con 0x7fced40fb470 2024-09-21T08:13:19.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.634+0000 7fcedb030640 1 -- 172.21.15.107:0/651429123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced410c8e0 con 0x7fced40fb470 2024-09-21T08:13:19.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.635+0000 7fcedb030640 1 -- 172.21.15.107:0/651429123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced40fcbb0 con 0x7fced40fb470 2024-09-21T08:13:19.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.635+0000 7fced17fa640 1 -- 172.21.15.107:0/651429123 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fcec800dc30 con 0x7fced40fb470 2024-09-21T08:13:19.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.636+0000 7fced17fa640 1 --2- 172.21.15.107:0/651429123 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fcec406e530 0x7fcec40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.636+0000 7fced3fff640 1 --2- 172.21.15.107:0/651429123 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fcec406e530 0x7fcec40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:19.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.636+0000 7fced17fa640 1 -- 172.21.15.107:0/651429123 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7fcec808db40 con 0x7fced40fb470 2024-09-21T08:13:19.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.637+0000 7fced3fff640 1 --2- 172.21.15.107:0/651429123 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fcec406e530 0x7fcec40709e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcec000b020 tx=0x7fcec0009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:19.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.641+0000 7fced17fa640 1 -- 172.21.15.107:0/651429123 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fcec8056ba0 con 0x7fced40fb470 2024-09-21T08:13:19.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.843+0000 7fcedb030640 1 -- 172.21.15.107:0/651429123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7fced404b780 con 0x7fced40fb470 2024-09-21T08:13:19.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.844+0000 7fced17fa640 1 -- 172.21.15.107:0/651429123 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v35) v1 ==== 107+0+4976 (secure 0 0 0) 0x7fcec805a260 con 0x7fced40fb470 2024-09-21T08:13:19.846 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:19.846 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":17,"btime":"2024-09-21T08:10:16:791367+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24239,"name":"cephfs.smithi129.fwmfcy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.129:6825/694369363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":694369363},{"type":"v1","addr":"172.21.15.129:6825","nonce":694369363}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24247,"name":"cephfs.smithi129.belyba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.129:6827/3658871735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3658871735},{"type":"v1","addr":"172.21.15.129:6827","nonce":3658871735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34378,"name":"cephfs.smithi107.qusoyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3638073096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3638073096},{"type":"v1","addr":"172.21.15.107:6827","nonce":3638073096}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:00:21.458971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14458":{"gid":14458,"name":"cephfs.smithi107.grqzkt","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.107:6829/3876219633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3876219633},{"type":"v1","addr":"172.21.15.107:6829","nonce":3876219633}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T08:13:19.846 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 17 2024-09-21T08:13:19.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.846+0000 7fcedb030640 1 -- 172.21.15.107:0/651429123 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fcec406e530 msgr2=0x7fcec40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:19.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.846+0000 7fcedb030640 1 --2- 172.21.15.107:0/651429123 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fcec406e530 0x7fcec40709e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcec000b020 tx=0x7fcec0009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.846+0000 7fcedb030640 1 -- 172.21.15.107:0/651429123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fced40fb470 msgr2=0x7fced41120e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:19.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.846+0000 7fcedb030640 1 --2- 172.21.15.107:0/651429123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fced40fb470 0x7fced41120e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcec8002a50 tx=0x7fcec8004600 comp rx=0 tx=0).stop 2024-09-21T08:13:19.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.846+0000 7fcedb030640 1 -- 172.21.15.107:0/651429123 shutdown_connections 2024-09-21T08:13:19.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.846+0000 7fcedb030640 1 --2- 172.21.15.107:0/651429123 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fcec406e530 0x7fcec40709e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.846+0000 7fcedb030640 1 --2- 172.21.15.107:0/651429123 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fced41014b0 0x7fced4112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.846+0000 7fcedb030640 1 --2- 172.21.15.107:0/651429123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fced40fb470 0x7fced41120e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.846+0000 7fcedb030640 1 -- 172.21.15.107:0/651429123 >> 172.21.15.107:0/651429123 conn(0x7fced40f7030 msgr2=0x7fced40f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:19.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.846+0000 7fcedb030640 1 -- 172.21.15.107:0/651429123 shutdown_connections 2024-09-21T08:13:19.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:19.846+0000 7fcedb030640 1 -- 172.21.15.107:0/651429123 wait complete. 2024-09-21T08:13:20.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:19 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/651429123' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-21T08:13:20.301 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:19 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/651429123' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-21T08:13:20.754 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 18 2024-09-21T08:13:21.006 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:21.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:20 smithi107 ceph-mon[97757]: pgmap v269: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:21.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:20 smithi129 ceph-mon[76722]: pgmap v269: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:22.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.530+0000 7fb09312a640 1 -- 172.21.15.107:0/2143904108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb08c065c10 msgr2=0x7fb08c0fe0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:22.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.530+0000 7fb09312a640 1 --2- 172.21.15.107:0/2143904108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb08c065c10 0x7fb08c0fe0d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb0800048d0 tx=0x7fb080009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:22.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.530+0000 7fb09312a640 1 -- 172.21.15.107:0/2143904108 shutdown_connections 2024-09-21T08:13:22.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.530+0000 7fb09312a640 1 --2- 172.21.15.107:0/2143904108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb08c065c10 0x7fb08c0fe0d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:22.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.530+0000 7fb09312a640 1 --2- 172.21.15.107:0/2143904108 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb08c065300 0x7fb08c0656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:22.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.530+0000 7fb09312a640 1 -- 172.21.15.107:0/2143904108 >> 172.21.15.107:0/2143904108 conn(0x7fb08c0723b0 msgr2=0x7fb08c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:22.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.530+0000 7fb09312a640 1 -- 172.21.15.107:0/2143904108 shutdown_connections 2024-09-21T08:13:22.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.530+0000 7fb09312a640 1 -- 172.21.15.107:0/2143904108 wait complete. 2024-09-21T08:13:22.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.530+0000 7fb09312a640 1 Processor -- start 2024-09-21T08:13:22.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.530+0000 7fb09312a640 1 -- start start 2024-09-21T08:13:22.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.531+0000 7fb09312a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb08c065300 0x7fb08c113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:22.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.531+0000 7fb09312a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb08c065c10 0x7fb08c1137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:22.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.531+0000 7fb09312a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c113e60 con 0x7fb08c065c10 2024-09-21T08:13:22.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.531+0000 7fb09312a640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c10d210 con 0x7fb08c065300 2024-09-21T08:13:22.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.531+0000 7fb08bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb08c065c10 0x7fb08c1137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:22.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.531+0000 7fb08bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb08c065c10 0x7fb08c1137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49932/0 (socket says 172.21.15.107:49932) 2024-09-21T08:13:22.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.531+0000 7fb08bfff640 1 -- 172.21.15.107:0/29590926 learned_addr learned my addr 172.21.15.107:0/29590926 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:22.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.531+0000 7fb090ec6640 1 --2- 172.21.15.107:0/29590926 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb08c065300 0x7fb08c113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:22.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.531+0000 7fb08bfff640 1 -- 172.21.15.107:0/29590926 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb08c065300 msgr2=0x7fb08c113290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:22.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.531+0000 7fb08bfff640 1 --2- 172.21.15.107:0/29590926 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb08c065300 0x7fb08c113290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:22.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.531+0000 7fb08bfff640 1 -- 172.21.15.107:0/29590926 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb080005040 con 0x7fb08c065c10 2024-09-21T08:13:22.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.531+0000 7fb08bfff640 1 --2- 172.21.15.107:0/29590926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb08c065c10 0x7fb08c1137d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb080003080 tx=0x7fb080009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:22.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.531+0000 7fb0897fa640 1 -- 172.21.15.107:0/29590926 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb080038070 con 0x7fb08c065c10 2024-09-21T08:13:22.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.532+0000 7fb0897fa640 1 -- 172.21.15.107:0/29590926 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb0800097e0 con 0x7fb08c065c10 2024-09-21T08:13:22.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.532+0000 7fb09312a640 1 -- 172.21.15.107:0/29590926 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08c10d490 con 0x7fb08c065c10 2024-09-21T08:13:22.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.532+0000 7fb0897fa640 1 -- 172.21.15.107:0/29590926 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb08003d420 con 0x7fb08c065c10 2024-09-21T08:13:22.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.532+0000 7fb09312a640 1 -- 172.21.15.107:0/29590926 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08c10d950 con 0x7fb08c065c10 2024-09-21T08:13:22.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.533+0000 7fb09312a640 1 -- 172.21.15.107:0/29590926 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08c0fdce0 con 0x7fb08c065c10 2024-09-21T08:13:22.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.533+0000 7fb0897fa640 1 -- 172.21.15.107:0/29590926 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb080030020 con 0x7fb08c065c10 2024-09-21T08:13:22.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.534+0000 7fb0897fa640 1 --2- 172.21.15.107:0/29590926 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb07406e530 0x7fb0740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:22.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.534+0000 7fb0897fa640 1 -- 172.21.15.107:0/29590926 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7fb0800ae6f0 con 0x7fb08c065c10 2024-09-21T08:13:22.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.534+0000 7fb090ec6640 1 --2- 172.21.15.107:0/29590926 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb07406e530 0x7fb0740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:22.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.534+0000 7fb090ec6640 1 --2- 172.21.15.107:0/29590926 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb07406e530 0x7fb0740709e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009b50 tx=0x7fb07c009120 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:22.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.538+0000 7fb0897fa640 1 -- 172.21.15.107:0/29590926 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb0800776e0 con 0x7fb08c065c10 2024-09-21T08:13:22.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.736+0000 7fb09312a640 1 -- 172.21.15.107:0/29590926 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7fb08c072ec0 con 0x7fb08c065c10 2024-09-21T08:13:22.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.737+0000 7fb0897fa640 1 -- 172.21.15.107:0/29590926 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v35) v1 ==== 107+0+4183 (secure 0 0 0) 0x7fb08007ada0 con 0x7fb08c065c10 2024-09-21T08:13:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:22.738 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":18,"btime":"2024-09-21T08:10:29:960611+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24239,"name":"cephfs.smithi129.fwmfcy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.129:6825/694369363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":694369363},{"type":"v1","addr":"172.21.15.129:6825","nonce":694369363}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24247,"name":"cephfs.smithi129.belyba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.129:6827/3658871735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3658871735},{"type":"v1","addr":"172.21.15.129:6827","nonce":3658871735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34378,"name":"cephfs.smithi107.qusoyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3638073096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3638073096},{"type":"v1","addr":"172.21.15.107:6827","nonce":3638073096}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:10:29.960371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T08:13:22.738 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 18 2024-09-21T08:13:22.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.739+0000 7fb09312a640 1 -- 172.21.15.107:0/29590926 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb07406e530 msgr2=0x7fb0740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:22.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.739+0000 7fb09312a640 1 --2- 172.21.15.107:0/29590926 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb07406e530 0x7fb0740709e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009b50 tx=0x7fb07c009120 comp rx=0 tx=0).stop 2024-09-21T08:13:22.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.739+0000 7fb09312a640 1 -- 172.21.15.107:0/29590926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb08c065c10 msgr2=0x7fb08c1137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:22.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.739+0000 7fb09312a640 1 --2- 172.21.15.107:0/29590926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb08c065c10 0x7fb08c1137d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb080003080 tx=0x7fb080009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:22.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.739+0000 7fb09312a640 1 -- 172.21.15.107:0/29590926 shutdown_connections 2024-09-21T08:13:22.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.739+0000 7fb09312a640 1 --2- 172.21.15.107:0/29590926 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb07406e530 0x7fb0740709e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:22.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.739+0000 7fb09312a640 1 --2- 172.21.15.107:0/29590926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb08c065c10 0x7fb08c1137d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:22.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.739+0000 7fb09312a640 1 --2- 172.21.15.107:0/29590926 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb08c065300 0x7fb08c113290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:22.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.739+0000 7fb09312a640 1 -- 172.21.15.107:0/29590926 >> 172.21.15.107:0/29590926 conn(0x7fb08c0723b0 msgr2=0x7fb08c0fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:22.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.739+0000 7fb09312a640 1 -- 172.21.15.107:0/29590926 shutdown_connections 2024-09-21T08:13:22.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:22.739+0000 7fb09312a640 1 -- 172.21.15.107:0/29590926 wait complete. 2024-09-21T08:13:23.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:22 smithi107 ceph-mon[97757]: pgmap v270: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:23.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:22 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/29590926' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-21T08:13:23.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:22 smithi129 ceph-mon[76722]: pgmap v270: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:23.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:22 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/29590926' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-21T08:13:23.485 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 19 2024-09-21T08:13:23.733 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:24.983 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:24 smithi107 ceph-mon[97757]: pgmap v271: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:25.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.234+0000 7fde6636b640 1 -- 172.21.15.107:0/1247567921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde600fb480 msgr2=0x7fde600fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:25.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.234+0000 7fde6636b640 1 --2- 172.21.15.107:0/1247567921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde600fb480 0x7fde600fb8f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fde540048d0 tx=0x7fde54009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:25.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.234+0000 7fde6636b640 1 -- 172.21.15.107:0/1247567921 shutdown_connections 2024-09-21T08:13:25.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.234+0000 7fde6636b640 1 --2- 172.21.15.107:0/1247567921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde600fb480 0x7fde600fb8f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:25.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.234+0000 7fde6636b640 1 --2- 172.21.15.107:0/1247567921 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde601014c0 0x7fde60101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:25.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.234+0000 7fde6636b640 1 -- 172.21.15.107:0/1247567921 >> 172.21.15.107:0/1247567921 conn(0x7fde600f7040 msgr2=0x7fde600f9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:25.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.234+0000 7fde6636b640 1 -- 172.21.15.107:0/1247567921 shutdown_connections 2024-09-21T08:13:25.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.234+0000 7fde6636b640 1 -- 172.21.15.107:0/1247567921 wait complete. 2024-09-21T08:13:25.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.235+0000 7fde6636b640 1 Processor -- start 2024-09-21T08:13:25.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.235+0000 7fde6636b640 1 -- start start 2024-09-21T08:13:25.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.235+0000 7fde6636b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde600fb480 0x7fde601131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:25.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.235+0000 7fde6636b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde601014c0 0x7fde60113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:25.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.235+0000 7fde6636b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde60113d00 con 0x7fde601014c0 2024-09-21T08:13:25.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.235+0000 7fde6636b640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6010d140 con 0x7fde600fb480 2024-09-21T08:13:25.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.235+0000 7fde5f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde601014c0 0x7fde60113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:25.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.236+0000 7fde5f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde601014c0 0x7fde60113700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49946/0 (socket says 172.21.15.107:49946) 2024-09-21T08:13:25.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.236+0000 7fde5f7fe640 1 -- 172.21.15.107:0/3474962492 learned_addr learned my addr 172.21.15.107:0/3474962492 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:25.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.236+0000 7fde5ffff640 1 --2- 172.21.15.107:0/3474962492 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde600fb480 0x7fde601131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:25.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.236+0000 7fde5f7fe640 1 -- 172.21.15.107:0/3474962492 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde600fb480 msgr2=0x7fde601131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:25.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.236+0000 7fde5f7fe640 1 --2- 172.21.15.107:0/3474962492 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde600fb480 0x7fde601131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:25.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.236+0000 7fde5f7fe640 1 -- 172.21.15.107:0/3474962492 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde54005040 con 0x7fde601014c0 2024-09-21T08:13:25.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.236+0000 7fde5f7fe640 1 --2- 172.21.15.107:0/3474962492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde601014c0 0x7fde60113700 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fde54000c00 tx=0x7fde54009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:25.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.236+0000 7fde5cff9640 1 -- 172.21.15.107:0/3474962492 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde54038070 con 0x7fde601014c0 2024-09-21T08:13:25.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.236+0000 7fde5cff9640 1 -- 172.21.15.107:0/3474962492 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fde5402ade0 con 0x7fde601014c0 2024-09-21T08:13:25.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.236+0000 7fde6636b640 1 -- 172.21.15.107:0/3474962492 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde6010d3c0 con 0x7fde601014c0 2024-09-21T08:13:25.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.236+0000 7fde5cff9640 1 -- 172.21.15.107:0/3474962492 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde5402c7e0 con 0x7fde601014c0 2024-09-21T08:13:25.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.236+0000 7fde6636b640 1 -- 172.21.15.107:0/3474962492 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde6010d900 con 0x7fde601014c0 2024-09-21T08:13:25.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.237+0000 7fde6636b640 1 -- 172.21.15.107:0/3474962492 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde600fcbc0 con 0x7fde601014c0 2024-09-21T08:13:25.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.238+0000 7fde5cff9640 1 -- 172.21.15.107:0/3474962492 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fde54030020 con 0x7fde601014c0 2024-09-21T08:13:25.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.238+0000 7fde5cff9640 1 --2- 172.21.15.107:0/3474962492 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fde4806e530 0x7fde480709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:25.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.238+0000 7fde5cff9640 1 -- 172.21.15.107:0/3474962492 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7fde540aded0 con 0x7fde601014c0 2024-09-21T08:13:25.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.238+0000 7fde5ffff640 1 --2- 172.21.15.107:0/3474962492 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fde4806e530 0x7fde480709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:25.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.239+0000 7fde5ffff640 1 --2- 172.21.15.107:0/3474962492 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fde4806e530 0x7fde480709e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fde50004ed0 tx=0x7fde5000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:25.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.244+0000 7fde5cff9640 1 -- 172.21.15.107:0/3474962492 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fde54076f70 con 0x7fde601014c0 2024-09-21T08:13:25.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:24 smithi129 ceph-mon[76722]: pgmap v271: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:25.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.443+0000 7fde6636b640 1 -- 172.21.15.107:0/3474962492 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7fde60108460 con 0x7fde601014c0 2024-09-21T08:13:25.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.444+0000 7fde5cff9640 1 -- 172.21.15.107:0/3474962492 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v35) v1 ==== 107+0+4194 (secure 0 0 0) 0x7fde5407a630 con 0x7fde601014c0 2024-09-21T08:13:25.445 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:25.446 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":19,"btime":"2024-09-21T08:10:29:967117+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24247,"name":"cephfs.smithi129.belyba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.129:6827/3658871735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3658871735},{"type":"v1","addr":"172.21.15.129:6827","nonce":3658871735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34378,"name":"cephfs.smithi107.qusoyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3638073096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3638073096},{"type":"v1","addr":"172.21.15.107:6827","nonce":3638073096}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:10:29.967109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24239":{"gid":24239,"name":"cephfs.smithi129.fwmfcy","rank":0,"incarnation":19,"state":"up:replay","state_seq":3,"addr":"172.21.15.129:6825/694369363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":694369363},{"type":"v1","addr":"172.21.15.129:6825","nonce":694369363}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T08:13:25.446 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 19 2024-09-21T08:13:25.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.446+0000 7fde6636b640 1 -- 172.21.15.107:0/3474962492 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fde4806e530 msgr2=0x7fde480709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:25.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.446+0000 7fde6636b640 1 --2- 172.21.15.107:0/3474962492 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fde4806e530 0x7fde480709e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fde50004ed0 tx=0x7fde5000b040 comp rx=0 tx=0).stop 2024-09-21T08:13:25.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.446+0000 7fde6636b640 1 -- 172.21.15.107:0/3474962492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde601014c0 msgr2=0x7fde60113700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:25.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.446+0000 7fde6636b640 1 --2- 172.21.15.107:0/3474962492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde601014c0 0x7fde60113700 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fde54000c00 tx=0x7fde54009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:25.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.446+0000 7fde6636b640 1 -- 172.21.15.107:0/3474962492 shutdown_connections 2024-09-21T08:13:25.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.446+0000 7fde6636b640 1 --2- 172.21.15.107:0/3474962492 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fde4806e530 0x7fde480709e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:25.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.446+0000 7fde6636b640 1 --2- 172.21.15.107:0/3474962492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde601014c0 0x7fde60113700 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:25.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.446+0000 7fde6636b640 1 --2- 172.21.15.107:0/3474962492 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde600fb480 0x7fde601131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:25.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.446+0000 7fde6636b640 1 -- 172.21.15.107:0/3474962492 >> 172.21.15.107:0/3474962492 conn(0x7fde600f7040 msgr2=0x7fde60065ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:25.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.446+0000 7fde6636b640 1 -- 172.21.15.107:0/3474962492 shutdown_connections 2024-09-21T08:13:25.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:25.446+0000 7fde6636b640 1 -- 172.21.15.107:0/3474962492 wait complete. 2024-09-21T08:13:26.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:25 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/3474962492' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-21T08:13:26.173 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 20 2024-09-21T08:13:26.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:25 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/3474962492' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-21T08:13:26.421 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:27.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:26 smithi129 ceph-mon[76722]: pgmap v272: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:27.304 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:26 smithi107 ceph-mon[97757]: pgmap v272: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:28.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.031+0000 7f16ac1ec640 1 -- 172.21.15.107:0/2884321644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16a40fb810 msgr2=0x7f16a40fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:28.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.031+0000 7f16ac1ec640 1 --2- 172.21.15.107:0/2884321644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16a40fb810 0x7f16a40fbbe0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1694009c50 tx=0x7f1694004d10 comp rx=0 tx=0).stop 2024-09-21T08:13:28.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.031+0000 7f16ac1ec640 1 -- 172.21.15.107:0/2884321644 shutdown_connections 2024-09-21T08:13:28.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.031+0000 7f16ac1ec640 1 --2- 172.21.15.107:0/2884321644 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f16a40fcf80 0x7f16a40fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:28.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.031+0000 7f16ac1ec640 1 --2- 172.21.15.107:0/2884321644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16a40fb810 0x7f16a40fbbe0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:28.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.031+0000 7f16ac1ec640 1 -- 172.21.15.107:0/2884321644 >> 172.21.15.107:0/2884321644 conn(0x7f16a40723b0 msgr2=0x7f16a40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:28.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.031+0000 7f16ac1ec640 1 -- 172.21.15.107:0/2884321644 shutdown_connections 2024-09-21T08:13:28.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.031+0000 7f16ac1ec640 1 -- 172.21.15.107:0/2884321644 wait complete. 2024-09-21T08:13:28.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.032+0000 7f16ac1ec640 1 Processor -- start 2024-09-21T08:13:28.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.032+0000 7f16ac1ec640 1 -- start start 2024-09-21T08:13:28.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.032+0000 7f16ac1ec640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16a40fb810 0x7f16a41120b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:28.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.032+0000 7f16ac1ec640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f16a40fcf80 0x7f16a41125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:28.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.032+0000 7f16ac1ec640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a4112bf0 con 0x7f16a40fb810 2024-09-21T08:13:28.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.032+0000 7f16ac1ec640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a410c030 con 0x7f16a40fcf80 2024-09-21T08:13:28.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.032+0000 7f16a9f88640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16a40fb810 0x7f16a41120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:28.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.032+0000 7f16a9f88640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16a40fb810 0x7f16a41120b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49958/0 (socket says 172.21.15.107:49958) 2024-09-21T08:13:28.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.032+0000 7f16a9f88640 1 -- 172.21.15.107:0/2904762770 learned_addr learned my addr 172.21.15.107:0/2904762770 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:28.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.032+0000 7f16a9787640 1 --2- 172.21.15.107:0/2904762770 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f16a40fcf80 0x7f16a41125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:28.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.032+0000 7f16a9f88640 1 -- 172.21.15.107:0/2904762770 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f16a40fcf80 msgr2=0x7f16a41125f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:28.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.032+0000 7f16a9f88640 1 --2- 172.21.15.107:0/2904762770 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f16a40fcf80 0x7f16a41125f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:28.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.032+0000 7f16a9f88640 1 -- 172.21.15.107:0/2904762770 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16940098b0 con 0x7f16a40fb810 2024-09-21T08:13:28.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.033+0000 7f16a9f88640 1 --2- 172.21.15.107:0/2904762770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16a40fb810 0x7f16a41120b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1694004a30 tx=0x7f1694004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:28.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.033+0000 7f16a27fc640 1 -- 172.21.15.107:0/2904762770 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1694009690 con 0x7f16a40fb810 2024-09-21T08:13:28.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.033+0000 7f16ac1ec640 1 -- 172.21.15.107:0/2904762770 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a410c2b0 con 0x7f16a40fb810 2024-09-21T08:13:28.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.033+0000 7f16a27fc640 1 -- 172.21.15.107:0/2904762770 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1694032b10 con 0x7f16a40fb810 2024-09-21T08:13:28.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.033+0000 7f16a27fc640 1 -- 172.21.15.107:0/2904762770 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f169403daa0 con 0x7f16a40fb810 2024-09-21T08:13:28.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.033+0000 7f16ac1ec640 1 -- 172.21.15.107:0/2904762770 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a410c850 con 0x7f16a40fb810 2024-09-21T08:13:28.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.034+0000 7f16ac1ec640 1 -- 172.21.15.107:0/2904762770 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a40fcbc0 con 0x7f16a40fb810 2024-09-21T08:13:28.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.034+0000 7f16a27fc640 1 -- 172.21.15.107:0/2904762770 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f169402f030 con 0x7f16a40fb810 2024-09-21T08:13:28.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.035+0000 7f16a27fc640 1 --2- 172.21.15.107:0/2904762770 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f168c06e530 0x7f168c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:28.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.035+0000 7f16a27fc640 1 -- 172.21.15.107:0/2904762770 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f16940af450 con 0x7f16a40fb810 2024-09-21T08:13:28.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.035+0000 7f16a9787640 1 --2- 172.21.15.107:0/2904762770 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f168c06e530 0x7f168c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:28.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.035+0000 7f16a9787640 1 --2- 172.21.15.107:0/2904762770 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f168c06e530 0x7f168c0709e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f16a410d970 tx=0x7f1698009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:28.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.039+0000 7f16a27fc640 1 -- 172.21.15.107:0/2904762770 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f16940783c0 con 0x7f16a40fb810 2024-09-21T08:13:28.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.240+0000 7f16ac1ec640 1 -- 172.21.15.107:0/2904762770 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f16a404b720 con 0x7f16a40fb810 2024-09-21T08:13:28.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.240+0000 7f16a27fc640 1 -- 172.21.15.107:0/2904762770 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v35) v1 ==== 107+0+4199 (secure 0 0 0) 0x7f169407ba80 con 0x7f16a40fb810 2024-09-21T08:13:28.242 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:28.242 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":20,"btime":"2024-09-21T08:10:37:661423+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24247,"name":"cephfs.smithi129.belyba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.129:6827/3658871735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3658871735},{"type":"v1","addr":"172.21.15.129:6827","nonce":3658871735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34378,"name":"cephfs.smithi107.qusoyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3638073096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3638073096},{"type":"v1","addr":"172.21.15.107:6827","nonce":3638073096}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:10:37.071099+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24239":{"gid":24239,"name":"cephfs.smithi129.fwmfcy","rank":0,"incarnation":19,"state":"up:reconnect","state_seq":158,"addr":"172.21.15.129:6825/694369363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":694369363},{"type":"v1","addr":"172.21.15.129:6825","nonce":694369363}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T08:13:28.242 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 20 2024-09-21T08:13:28.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.242+0000 7f16ac1ec640 1 -- 172.21.15.107:0/2904762770 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f168c06e530 msgr2=0x7f168c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:28.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.242+0000 7f16ac1ec640 1 --2- 172.21.15.107:0/2904762770 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f168c06e530 0x7f168c0709e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f16a410d970 tx=0x7f1698009040 comp rx=0 tx=0).stop 2024-09-21T08:13:28.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.242+0000 7f16ac1ec640 1 -- 172.21.15.107:0/2904762770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16a40fb810 msgr2=0x7f16a41120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:28.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.242+0000 7f16ac1ec640 1 --2- 172.21.15.107:0/2904762770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16a40fb810 0x7f16a41120b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1694004a30 tx=0x7f1694004d10 comp rx=0 tx=0).stop 2024-09-21T08:13:28.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.243+0000 7f16ac1ec640 1 -- 172.21.15.107:0/2904762770 shutdown_connections 2024-09-21T08:13:28.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.243+0000 7f16ac1ec640 1 --2- 172.21.15.107:0/2904762770 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f168c06e530 0x7f168c0709e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:28.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.243+0000 7f16ac1ec640 1 --2- 172.21.15.107:0/2904762770 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f16a40fcf80 0x7f16a41125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:28.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.243+0000 7f16ac1ec640 1 --2- 172.21.15.107:0/2904762770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16a40fb810 0x7f16a41120b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:28.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.243+0000 7f16ac1ec640 1 -- 172.21.15.107:0/2904762770 >> 172.21.15.107:0/2904762770 conn(0x7f16a40723b0 msgr2=0x7f16a40fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:28.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.243+0000 7f16ac1ec640 1 -- 172.21.15.107:0/2904762770 shutdown_connections 2024-09-21T08:13:28.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:28.243+0000 7f16ac1ec640 1 -- 172.21.15.107:0/2904762770 wait complete. 2024-09-21T08:13:28.885 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 21 2024-09-21T08:13:29.133 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:29.255 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:28 smithi107 ceph-mon[97757]: pgmap v273: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:29.255 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:28 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/2904762770' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-21T08:13:29.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:28 smithi129 ceph-mon[76722]: pgmap v273: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:29.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:28 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/2904762770' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-21T08:13:30.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:13:30.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:13:30.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:13:30.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:13:30.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:29 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:13:30.300 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T08:13:30.300 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T08:13:30.300 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T08:13:30.300 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' 2024-09-21T08:13:30.300 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:29 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:13:30.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.778+0000 7f7f789db640 1 -- 172.21.15.107:0/1070314486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f740fac80 msgr2=0x7f7f740fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.778+0000 7f7f789db640 1 --2- 172.21.15.107:0/1070314486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f740fac80 0x7f7f740fb0f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0048d0 tx=0x7f7f5c009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.779+0000 7f7f789db640 1 -- 172.21.15.107:0/1070314486 shutdown_connections 2024-09-21T08:13:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.779+0000 7f7f789db640 1 --2- 172.21.15.107:0/1070314486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f740fac80 0x7f7f740fb0f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.779+0000 7f7f789db640 1 --2- 172.21.15.107:0/1070314486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7f74102620 0x7f7f741029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.779+0000 7f7f789db640 1 -- 172.21.15.107:0/1070314486 >> 172.21.15.107:0/1070314486 conn(0x7f7f74070ce0 msgr2=0x7f7f740710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.779+0000 7f7f789db640 1 -- 172.21.15.107:0/1070314486 shutdown_connections 2024-09-21T08:13:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.779+0000 7f7f789db640 1 -- 172.21.15.107:0/1070314486 wait complete. 2024-09-21T08:13:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.779+0000 7f7f789db640 1 Processor -- start 2024-09-21T08:13:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.779+0000 7f7f789db640 1 -- start start 2024-09-21T08:13:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.780+0000 7f7f789db640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7f740fac80 0x7f7f741131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:30.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.780+0000 7f7f789db640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f74102620 0x7f7f74113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:30.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.780+0000 7f7f789db640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f74113d10 con 0x7f7f74102620 2024-09-21T08:13:30.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.780+0000 7f7f789db640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7410d150 con 0x7f7f740fac80 2024-09-21T08:13:30.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.780+0000 7f7f71d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f74102620 0x7f7f74113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:30.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.780+0000 7f7f71d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f74102620 0x7f7f74113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49962/0 (socket says 172.21.15.107:49962) 2024-09-21T08:13:30.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.780+0000 7f7f71d9b640 1 -- 172.21.15.107:0/3243579598 learned_addr learned my addr 172.21.15.107:0/3243579598 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:30.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.780+0000 7f7f7259c640 1 --2- 172.21.15.107:0/3243579598 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7f740fac80 0x7f7f741131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:30.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.780+0000 7f7f71d9b640 1 -- 172.21.15.107:0/3243579598 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7f740fac80 msgr2=0x7f7f741131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:30.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.780+0000 7f7f71d9b640 1 --2- 172.21.15.107:0/3243579598 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7f740fac80 0x7f7f741131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:30.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.780+0000 7f7f71d9b640 1 -- 172.21.15.107:0/3243579598 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c005040 con 0x7f7f74102620 2024-09-21T08:13:30.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.780+0000 7f7f71d9b640 1 --2- 172.21.15.107:0/3243579598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f74102620 0x7f7f74113710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c003080 tx=0x7f7f5c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:30.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.781+0000 7f7f6affd640 1 -- 172.21.15.107:0/3243579598 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f5c038070 con 0x7f7f74102620 2024-09-21T08:13:30.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.781+0000 7f7f789db640 1 -- 172.21.15.107:0/3243579598 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7410d3d0 con 0x7f7f74102620 2024-09-21T08:13:30.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.781+0000 7f7f6affd640 1 -- 172.21.15.107:0/3243579598 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7f5c02ade0 con 0x7f7f74102620 2024-09-21T08:13:30.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.781+0000 7f7f6affd640 1 -- 172.21.15.107:0/3243579598 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f5c02c880 con 0x7f7f74102620 2024-09-21T08:13:30.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.781+0000 7f7f789db640 1 -- 172.21.15.107:0/3243579598 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7410d8b0 con 0x7f7f74102620 2024-09-21T08:13:30.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.781+0000 7f7f789db640 1 -- 172.21.15.107:0/3243579598 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f740657b0 con 0x7f7f74102620 2024-09-21T08:13:30.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.782+0000 7f7f6affd640 1 -- 172.21.15.107:0/3243579598 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f7f5c030020 con 0x7f7f74102620 2024-09-21T08:13:30.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.783+0000 7f7f6affd640 1 --2- 172.21.15.107:0/3243579598 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f7f6006e530 0x7f7f600709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:30.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.783+0000 7f7f6affd640 1 -- 172.21.15.107:0/3243579598 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f7f5c0ae2f0 con 0x7f7f74102620 2024-09-21T08:13:30.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.783+0000 7f7f7259c640 1 --2- 172.21.15.107:0/3243579598 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f7f6006e530 0x7f7f600709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:30.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.783+0000 7f7f7259c640 1 --2- 172.21.15.107:0/3243579598 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f7f6006e530 0x7f7f600709e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c004550 tx=0x7f7f6c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:30.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.787+0000 7f7f6affd640 1 -- 172.21.15.107:0/3243579598 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7f5c077260 con 0x7f7f74102620 2024-09-21T08:13:30.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.992+0000 7f7f789db640 1 -- 172.21.15.107:0/3243579598 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f7f74109600 con 0x7f7f74102620 2024-09-21T08:13:30.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.992+0000 7f7f6affd640 1 -- 172.21.15.107:0/3243579598 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v35) v1 ==== 107+0+5046 (secure 0 0 0) 0x7f7f5c07a920 con 0x7f7f74102620 2024-09-21T08:13:30.994 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:30.994 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"btime":"2024-09-21T08:10:38:665507+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24247,"name":"cephfs.smithi129.belyba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.129:6827/3658871735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3658871735},{"type":"v1","addr":"172.21.15.129:6827","nonce":3658871735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34378,"name":"cephfs.smithi107.qusoyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3638073096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3638073096},{"type":"v1","addr":"172.21.15.107:6827","nonce":3638073096}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34402,"name":"cephfs.smithi107.grqzkt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6829/1321345266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1321345266},{"type":"v1","addr":"172.21.15.107:6829","nonce":1321345266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:10:37.667981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24239":{"gid":24239,"name":"cephfs.smithi129.fwmfcy","rank":0,"incarnation":19,"state":"up:rejoin","state_seq":159,"addr":"172.21.15.129:6825/694369363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":694369363},{"type":"v1","addr":"172.21.15.129:6825","nonce":694369363}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T08:13:30.995 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 21 2024-09-21T08:13:30.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.994+0000 7f7f789db640 1 -- 172.21.15.107:0/3243579598 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f7f6006e530 msgr2=0x7f7f600709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:30.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.994+0000 7f7f789db640 1 --2- 172.21.15.107:0/3243579598 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f7f6006e530 0x7f7f600709e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c004550 tx=0x7f7f6c009040 comp rx=0 tx=0).stop 2024-09-21T08:13:30.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.994+0000 7f7f789db640 1 -- 172.21.15.107:0/3243579598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f74102620 msgr2=0x7f7f74113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:30.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.994+0000 7f7f789db640 1 --2- 172.21.15.107:0/3243579598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f74102620 0x7f7f74113710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c003080 tx=0x7f7f5c009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:30.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.995+0000 7f7f789db640 1 -- 172.21.15.107:0/3243579598 shutdown_connections 2024-09-21T08:13:30.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.995+0000 7f7f789db640 1 --2- 172.21.15.107:0/3243579598 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f7f6006e530 0x7f7f600709e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:30.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.995+0000 7f7f789db640 1 --2- 172.21.15.107:0/3243579598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f74102620 0x7f7f74113710 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:30.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.995+0000 7f7f789db640 1 --2- 172.21.15.107:0/3243579598 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7f740fac80 0x7f7f741131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:30.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.995+0000 7f7f789db640 1 -- 172.21.15.107:0/3243579598 >> 172.21.15.107:0/3243579598 conn(0x7f7f74070ce0 msgr2=0x7f7f74100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:30.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.995+0000 7f7f789db640 1 -- 172.21.15.107:0/3243579598 shutdown_connections 2024-09-21T08:13:30.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:30.995+0000 7f7f789db640 1 -- 172.21.15.107:0/3243579598 wait complete. 2024-09-21T08:13:31.253 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:30 smithi107 ceph-mon[97757]: pgmap v274: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:31.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:30 smithi129 ceph-mon[76722]: pgmap v274: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:31.808 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 22 2024-09-21T08:13:32.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:31 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/3243579598' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-21T08:13:32.063 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:32.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:31 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/3243579598' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-21T08:13:33.189 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:32 smithi107 ceph-mon[97757]: pgmap v275: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:33.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:32 smithi129 ceph-mon[76722]: pgmap v275: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:33.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.643+0000 7f0e5b72f640 1 -- 172.21.15.107:0/1044119194 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e540fb810 msgr2=0x7f0e540fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:33.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.643+0000 7f0e5b72f640 1 --2- 172.21.15.107:0/1044119194 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e540fb810 0x7f0e540fbbe0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0e440048d0 tx=0x7f0e44009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:33.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.643+0000 7f0e5b72f640 1 -- 172.21.15.107:0/1044119194 shutdown_connections 2024-09-21T08:13:33.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.643+0000 7f0e5b72f640 1 --2- 172.21.15.107:0/1044119194 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0e540fcf80 0x7f0e540fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:33.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.643+0000 7f0e5b72f640 1 --2- 172.21.15.107:0/1044119194 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e540fb810 0x7f0e540fbbe0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:33.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.643+0000 7f0e5b72f640 1 -- 172.21.15.107:0/1044119194 >> 172.21.15.107:0/1044119194 conn(0x7f0e540723b0 msgr2=0x7f0e540727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:33.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.643+0000 7f0e5b72f640 1 -- 172.21.15.107:0/1044119194 shutdown_connections 2024-09-21T08:13:33.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.644+0000 7f0e5b72f640 1 -- 172.21.15.107:0/1044119194 wait complete. 2024-09-21T08:13:33.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.644+0000 7f0e5b72f640 1 Processor -- start 2024-09-21T08:13:33.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.644+0000 7f0e5b72f640 1 -- start start 2024-09-21T08:13:33.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.644+0000 7f0e5b72f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0e540fb810 0x7f0e541153c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:33.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.644+0000 7f0e5b72f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e540fcf80 0x7f0e54115900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:33.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.644+0000 7f0e5b72f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e54115f00 con 0x7f0e540fcf80 2024-09-21T08:13:33.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.644+0000 7f0e5b72f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5410f340 con 0x7f0e540fb810 2024-09-21T08:13:33.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.645+0000 7f0e58cca640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e540fcf80 0x7f0e54115900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:33.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.645+0000 7f0e58cca640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e540fcf80 0x7f0e54115900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57802/0 (socket says 172.21.15.107:57802) 2024-09-21T08:13:33.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.645+0000 7f0e58cca640 1 -- 172.21.15.107:0/364039758 learned_addr learned my addr 172.21.15.107:0/364039758 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:33.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.645+0000 7f0e594cb640 1 --2- 172.21.15.107:0/364039758 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0e540fb810 0x7f0e541153c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:33.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.645+0000 7f0e58cca640 1 -- 172.21.15.107:0/364039758 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0e540fb810 msgr2=0x7f0e541153c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:33.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.645+0000 7f0e58cca640 1 --2- 172.21.15.107:0/364039758 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0e540fb810 0x7f0e541153c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:33.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.645+0000 7f0e58cca640 1 -- 172.21.15.107:0/364039758 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e44005040 con 0x7f0e540fcf80 2024-09-21T08:13:33.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.645+0000 7f0e58cca640 1 --2- 172.21.15.107:0/364039758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e540fcf80 0x7f0e54115900 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0e48002a50 tx=0x7f0e48004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:33.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.645+0000 7f0e51ffb640 1 -- 172.21.15.107:0/364039758 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e48007c30 con 0x7f0e540fcf80 2024-09-21T08:13:33.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.645+0000 7f0e51ffb640 1 -- 172.21.15.107:0/364039758 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0e4800f040 con 0x7f0e540fcf80 2024-09-21T08:13:33.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.645+0000 7f0e5b72f640 1 -- 172.21.15.107:0/364039758 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5410f620 con 0x7f0e540fcf80 2024-09-21T08:13:33.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.645+0000 7f0e51ffb640 1 -- 172.21.15.107:0/364039758 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e4800da10 con 0x7f0e540fcf80 2024-09-21T08:13:33.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.645+0000 7f0e5b72f640 1 -- 172.21.15.107:0/364039758 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5410fbc0 con 0x7f0e540fcf80 2024-09-21T08:13:33.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.646+0000 7f0e5b72f640 1 -- 172.21.15.107:0/364039758 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e540fcbc0 con 0x7f0e540fcf80 2024-09-21T08:13:33.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.647+0000 7f0e51ffb640 1 -- 172.21.15.107:0/364039758 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0e4800dc80 con 0x7f0e540fcf80 2024-09-21T08:13:33.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.647+0000 7f0e51ffb640 1 --2- 172.21.15.107:0/364039758 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f0e3c06e530 0x7f0e3c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:33.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.647+0000 7f0e51ffb640 1 -- 172.21.15.107:0/364039758 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f0e4808dab0 con 0x7f0e540fcf80 2024-09-21T08:13:33.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.647+0000 7f0e594cb640 1 --2- 172.21.15.107:0/364039758 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f0e3c06e530 0x7f0e3c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:33.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.648+0000 7f0e594cb640 1 --2- 172.21.15.107:0/364039758 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f0e3c06e530 0x7f0e3c0709e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009ac0 tx=0x7f0e44035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:33.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.652+0000 7f0e51ffb640 1 -- 172.21.15.107:0/364039758 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0e48056ad0 con 0x7f0e540fcf80 2024-09-21T08:13:33.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.854+0000 7f0e5b72f640 1 -- 172.21.15.107:0/364039758 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f0e54110a60 con 0x7f0e540fcf80 2024-09-21T08:13:33.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.855+0000 7f0e51ffb640 1 -- 172.21.15.107:0/364039758 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v35) v1 ==== 107+0+5055 (secure 0 0 0) 0x7f0e4805a190 con 0x7f0e540fcf80 2024-09-21T08:13:33.856 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:33.856 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":22,"btime":"2024-09-21T08:10:39:670353+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24247,"name":"cephfs.smithi129.belyba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.129:6827/3658871735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3658871735},{"type":"v1","addr":"172.21.15.129:6827","nonce":3658871735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34378,"name":"cephfs.smithi107.qusoyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3638073096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3638073096},{"type":"v1","addr":"172.21.15.107:6827","nonce":3638073096}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34402,"name":"cephfs.smithi107.grqzkt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6829/1321345266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1321345266},{"type":"v1","addr":"172.21.15.107:6829","nonce":1321345266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:10:39.670351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24239":{"gid":24239,"name":"cephfs.smithi129.fwmfcy","rank":0,"incarnation":19,"state":"up:active","state_seq":160,"addr":"172.21.15.129:6825/694369363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":694369363},{"type":"v1","addr":"172.21.15.129:6825","nonce":694369363}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24239,"qdb_cluster":[24239]},"id":1}]} 2024-09-21T08:13:33.857 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 22 2024-09-21T08:13:33.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.857+0000 7f0e5b72f640 1 -- 172.21.15.107:0/364039758 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f0e3c06e530 msgr2=0x7f0e3c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:33.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.857+0000 7f0e5b72f640 1 --2- 172.21.15.107:0/364039758 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f0e3c06e530 0x7f0e3c0709e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009ac0 tx=0x7f0e44035040 comp rx=0 tx=0).stop 2024-09-21T08:13:33.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.857+0000 7f0e5b72f640 1 -- 172.21.15.107:0/364039758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e540fcf80 msgr2=0x7f0e54115900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:33.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.857+0000 7f0e5b72f640 1 --2- 172.21.15.107:0/364039758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e540fcf80 0x7f0e54115900 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0e48002a50 tx=0x7f0e48004600 comp rx=0 tx=0).stop 2024-09-21T08:13:33.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.857+0000 7f0e5b72f640 1 -- 172.21.15.107:0/364039758 shutdown_connections 2024-09-21T08:13:33.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.857+0000 7f0e5b72f640 1 --2- 172.21.15.107:0/364039758 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f0e3c06e530 0x7f0e3c0709e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:33.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.857+0000 7f0e5b72f640 1 --2- 172.21.15.107:0/364039758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e540fcf80 0x7f0e54115900 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:33.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.857+0000 7f0e5b72f640 1 --2- 172.21.15.107:0/364039758 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0e540fb810 0x7f0e541153c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:33.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.857+0000 7f0e5b72f640 1 -- 172.21.15.107:0/364039758 >> 172.21.15.107:0/364039758 conn(0x7f0e540723b0 msgr2=0x7f0e540fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:33.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.857+0000 7f0e5b72f640 1 -- 172.21.15.107:0/364039758 shutdown_connections 2024-09-21T08:13:33.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:33.857+0000 7f0e5b72f640 1 -- 172.21.15.107:0/364039758 wait complete. 2024-09-21T08:13:34.521 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 23 2024-09-21T08:13:34.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:34 smithi129 ceph-mon[76722]: pgmap v276: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:34.766 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:34 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/364039758' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-21T08:13:34.767 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:34.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:34 smithi107 ceph-mon[97757]: pgmap v276: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:34.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:34 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/364039758' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-21T08:13:36.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.340+0000 7f4d6fd5d640 1 -- 172.21.15.107:0/1728032027 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d68102ed0 msgr2=0x7f4d680fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:36.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.340+0000 7f4d6fd5d640 1 --2- 172.21.15.107:0/1728032027 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d68102ed0 0x7f4d680fc590 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0048d0 tx=0x7f4d5c009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.341+0000 7f4d6fd5d640 1 -- 172.21.15.107:0/1728032027 shutdown_connections 2024-09-21T08:13:36.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.341+0000 7f4d6fd5d640 1 --2- 172.21.15.107:0/1728032027 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d68102ed0 0x7f4d680fc590 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.341+0000 7f4d6fd5d640 1 --2- 172.21.15.107:0/1728032027 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4d68102530 0x7f4d68102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.341+0000 7f4d6fd5d640 1 -- 172.21.15.107:0/1728032027 >> 172.21.15.107:0/1728032027 conn(0x7f4d680f8110 msgr2=0x7f4d680fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:36.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.341+0000 7f4d6fd5d640 1 -- 172.21.15.107:0/1728032027 shutdown_connections 2024-09-21T08:13:36.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.341+0000 7f4d6fd5d640 1 -- 172.21.15.107:0/1728032027 wait complete. 2024-09-21T08:13:36.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.341+0000 7f4d6fd5d640 1 Processor -- start 2024-09-21T08:13:36.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.341+0000 7f4d6fd5d640 1 -- start start 2024-09-21T08:13:36.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.341+0000 7f4d6fd5d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4d68102530 0x7f4d68113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.341+0000 7f4d6fd5d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d68102ed0 0x7f4d68113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.341+0000 7f4d6fd5d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d68113d50 con 0x7f4d68102ed0 2024-09-21T08:13:36.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.341+0000 7f4d6fd5d640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6810d190 con 0x7f4d68102530 2024-09-21T08:13:36.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.342+0000 7f4d6d2f8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d68102ed0 0x7f4d68113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.342+0000 7f4d6d2f8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d68102ed0 0x7f4d68113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57820/0 (socket says 172.21.15.107:57820) 2024-09-21T08:13:36.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.342+0000 7f4d6d2f8640 1 -- 172.21.15.107:0/4275724606 learned_addr learned my addr 172.21.15.107:0/4275724606 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:36.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.342+0000 7f4d6daf9640 1 --2- 172.21.15.107:0/4275724606 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4d68102530 0x7f4d68113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.342+0000 7f4d6d2f8640 1 -- 172.21.15.107:0/4275724606 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4d68102530 msgr2=0x7f4d68113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:36.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.342+0000 7f4d6d2f8640 1 --2- 172.21.15.107:0/4275724606 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4d68102530 0x7f4d68113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.342+0000 7f4d6d2f8640 1 -- 172.21.15.107:0/4275724606 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c005040 con 0x7f4d68102ed0 2024-09-21T08:13:36.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.342+0000 7f4d6d2f8640 1 --2- 172.21.15.107:0/4275724606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d68102ed0 0x7f4d68113750 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0043d0 tx=0x7f4d5c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:36.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.342+0000 7f4d5a7fc640 1 -- 172.21.15.107:0/4275724606 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d5c038070 con 0x7f4d68102ed0 2024-09-21T08:13:36.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.342+0000 7f4d6fd5d640 1 -- 172.21.15.107:0/4275724606 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6810d410 con 0x7f4d68102ed0 2024-09-21T08:13:36.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.342+0000 7f4d5a7fc640 1 -- 172.21.15.107:0/4275724606 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4d5c0096e0 con 0x7f4d68102ed0 2024-09-21T08:13:36.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.342+0000 7f4d5a7fc640 1 -- 172.21.15.107:0/4275724606 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d5c02c8a0 con 0x7f4d68102ed0 2024-09-21T08:13:36.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.342+0000 7f4d6fd5d640 1 -- 172.21.15.107:0/4275724606 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6810d950 con 0x7f4d68102ed0 2024-09-21T08:13:36.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.343+0000 7f4d6fd5d640 1 -- 172.21.15.107:0/4275724606 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d680fdcb0 con 0x7f4d68102ed0 2024-09-21T08:13:36.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.344+0000 7f4d5a7fc640 1 -- 172.21.15.107:0/4275724606 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4d5c030020 con 0x7f4d68102ed0 2024-09-21T08:13:36.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.344+0000 7f4d5a7fc640 1 --2- 172.21.15.107:0/4275724606 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4d5406e530 0x7f4d540709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.344+0000 7f4d5a7fc640 1 -- 172.21.15.107:0/4275724606 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f4d5c0ae060 con 0x7f4d68102ed0 2024-09-21T08:13:36.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.344+0000 7f4d6daf9640 1 --2- 172.21.15.107:0/4275724606 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4d5406e530 0x7f4d540709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.345+0000 7f4d6daf9640 1 --2- 172.21.15.107:0/4275724606 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4d5406e530 0x7f4d540709e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4d64004ed0 tx=0x7f4d6400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:36.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.349+0000 7f4d5a7fc640 1 -- 172.21.15.107:0/4275724606 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4d5c077020 con 0x7f4d68102ed0 2024-09-21T08:13:36.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.550+0000 7f4d6fd5d640 1 -- 172.21.15.107:0/4275724606 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f4d680fbd30 con 0x7f4d68102ed0 2024-09-21T08:13:36.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.550+0000 7f4d5a7fc640 1 -- 172.21.15.107:0/4275724606 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v35) v1 ==== 107+0+4254 (secure 0 0 0) 0x7f4d5c07a6e0 con 0x7f4d68102ed0 2024-09-21T08:13:36.552 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:36.552 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":23,"btime":"2024-09-21T08:10:49:995126+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24247,"name":"cephfs.smithi129.belyba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.129:6827/3658871735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3658871735},{"type":"v1","addr":"172.21.15.129:6827","nonce":3658871735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34378,"name":"cephfs.smithi107.qusoyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3638073096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3638073096},{"type":"v1","addr":"172.21.15.107:6827","nonce":3638073096}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34402,"name":"cephfs.smithi107.grqzkt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6829/1321345266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1321345266},{"type":"v1","addr":"172.21.15.107:6829","nonce":1321345266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:10:49.995123+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T08:13:36.552 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 23 2024-09-21T08:13:36.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.552+0000 7f4d6fd5d640 1 -- 172.21.15.107:0/4275724606 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4d5406e530 msgr2=0x7f4d540709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:36.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.552+0000 7f4d6fd5d640 1 --2- 172.21.15.107:0/4275724606 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4d5406e530 0x7f4d540709e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4d64004ed0 tx=0x7f4d6400b040 comp rx=0 tx=0).stop 2024-09-21T08:13:36.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.552+0000 7f4d6fd5d640 1 -- 172.21.15.107:0/4275724606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d68102ed0 msgr2=0x7f4d68113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:36.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.552+0000 7f4d6fd5d640 1 --2- 172.21.15.107:0/4275724606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d68102ed0 0x7f4d68113750 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0043d0 tx=0x7f4d5c009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.552+0000 7f4d6fd5d640 1 -- 172.21.15.107:0/4275724606 shutdown_connections 2024-09-21T08:13:36.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.552+0000 7f4d6fd5d640 1 --2- 172.21.15.107:0/4275724606 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f4d5406e530 0x7f4d540709e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.552+0000 7f4d6fd5d640 1 --2- 172.21.15.107:0/4275724606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d68102ed0 0x7f4d68113750 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.552+0000 7f4d6fd5d640 1 --2- 172.21.15.107:0/4275724606 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4d68102530 0x7f4d68113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.552+0000 7f4d6fd5d640 1 -- 172.21.15.107:0/4275724606 >> 172.21.15.107:0/4275724606 conn(0x7f4d680f8110 msgr2=0x7f4d680f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:36.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.552+0000 7f4d6fd5d640 1 -- 172.21.15.107:0/4275724606 shutdown_connections 2024-09-21T08:13:36.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:36.552+0000 7f4d6fd5d640 1 -- 172.21.15.107:0/4275724606 wait complete. 2024-09-21T08:13:36.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:36 smithi107 ceph-mon[97757]: pgmap v277: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:36.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:36 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/4275724606' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-21T08:13:37.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:36 smithi129 ceph-mon[76722]: pgmap v277: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:37.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:36 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/4275724606' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-21T08:13:37.100 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 24 2024-09-21T08:13:37.346 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:38.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.869+0000 7f76d8516640 1 -- 172.21.15.107:0/1931540238 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76d00703c0 msgr2=0x7f76d0108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:38.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.869+0000 7f76d8516640 1 --2- 172.21.15.107:0/1931540238 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76d00703c0 0x7f76d0108870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f76c00048d0 tx=0x7f76c0009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:38.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.869+0000 7f76d8516640 1 -- 172.21.15.107:0/1931540238 shutdown_connections 2024-09-21T08:13:38.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.869+0000 7f76d8516640 1 --2- 172.21.15.107:0/1931540238 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76d00703c0 0x7f76d0108870 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:38.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.869+0000 7f76d8516640 1 --2- 172.21.15.107:0/1931540238 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76d006fab0 0x7f76d006fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:38.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.869+0000 7f76d8516640 1 -- 172.21.15.107:0/1931540238 >> 172.21.15.107:0/1931540238 conn(0x7f76d00f80f0 msgr2=0x7f76d00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:38.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.869+0000 7f76d8516640 1 -- 172.21.15.107:0/1931540238 shutdown_connections 2024-09-21T08:13:38.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.869+0000 7f76d8516640 1 -- 172.21.15.107:0/1931540238 wait complete. 2024-09-21T08:13:38.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.869+0000 7f76d8516640 1 Processor -- start 2024-09-21T08:13:38.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.870+0000 7f76d8516640 1 -- start start 2024-09-21T08:13:38.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.870+0000 7f76d8516640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76d006fab0 0x7f76d01153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:38.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.870+0000 7f76d8516640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76d00703c0 0x7f76d0115920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:38.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.870+0000 7f76d8516640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d0115f20 con 0x7f76d00703c0 2024-09-21T08:13:38.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.870+0000 7f76d8516640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d0116090 con 0x7f76d006fab0 2024-09-21T08:13:38.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.870+0000 7f76d5ab1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76d00703c0 0x7f76d0115920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:38.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.870+0000 7f76d5ab1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76d00703c0 0x7f76d0115920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57842/0 (socket says 172.21.15.107:57842) 2024-09-21T08:13:38.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.870+0000 7f76d5ab1640 1 -- 172.21.15.107:0/2814509125 learned_addr learned my addr 172.21.15.107:0/2814509125 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:38.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.870+0000 7f76d62b2640 1 --2- 172.21.15.107:0/2814509125 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76d006fab0 0x7f76d01153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:38.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.870+0000 7f76d5ab1640 1 -- 172.21.15.107:0/2814509125 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76d006fab0 msgr2=0x7f76d01153e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:38.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.870+0000 7f76d5ab1640 1 --2- 172.21.15.107:0/2814509125 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76d006fab0 0x7f76d01153e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:38.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.870+0000 7f76d5ab1640 1 -- 172.21.15.107:0/2814509125 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c0005040 con 0x7f76d00703c0 2024-09-21T08:13:38.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.870+0000 7f76d5ab1640 1 --2- 172.21.15.107:0/2814509125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76d00703c0 0x7f76d0115920 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f76c0003080 tx=0x7f76c0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:38.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.870+0000 7f76c6ffd640 1 -- 172.21.15.107:0/2814509125 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76c0038070 con 0x7f76d00703c0 2024-09-21T08:13:38.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.871+0000 7f76c6ffd640 1 -- 172.21.15.107:0/2814509125 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f76c00097e0 con 0x7f76d00703c0 2024-09-21T08:13:38.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.871+0000 7f76d8516640 1 -- 172.21.15.107:0/2814509125 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d010f4b0 con 0x7f76d00703c0 2024-09-21T08:13:38.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.871+0000 7f76c6ffd640 1 -- 172.21.15.107:0/2814509125 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76c003d420 con 0x7f76d00703c0 2024-09-21T08:13:38.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.871+0000 7f76d8516640 1 -- 172.21.15.107:0/2814509125 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d010f970 con 0x7f76d00703c0 2024-09-21T08:13:38.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.872+0000 7f76d8516640 1 -- 172.21.15.107:0/2814509125 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d00711f0 con 0x7f76d00703c0 2024-09-21T08:13:38.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.872+0000 7f76c6ffd640 1 -- 172.21.15.107:0/2814509125 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f76c0030020 con 0x7f76d00703c0 2024-09-21T08:13:38.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.873+0000 7f76c6ffd640 1 --2- 172.21.15.107:0/2814509125 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f76bc06e530 0x7f76bc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:38.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.873+0000 7f76d62b2640 1 --2- 172.21.15.107:0/2814509125 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f76bc06e530 0x7f76bc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:38.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.873+0000 7f76c6ffd640 1 -- 172.21.15.107:0/2814509125 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f76c00ae760 con 0x7f76d00703c0 2024-09-21T08:13:38.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.873+0000 7f76d62b2640 1 --2- 172.21.15.107:0/2814509125 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f76bc06e530 0x7f76bc0709e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f76cc007fd0 tx=0x7f76cc009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:38.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:38.877+0000 7f76c6ffd640 1 -- 172.21.15.107:0/2814509125 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f76c0077750 con 0x7f76d00703c0 2024-09-21T08:13:38.911 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:38 smithi107 ceph-mon[97757]: pgmap v278: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:39.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:38 smithi129 ceph-mon[76722]: pgmap v278: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:39.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:39.076+0000 7f76d8516640 1 -- 172.21.15.107:0/2814509125 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f76d010b750 con 0x7f76d00703c0 2024-09-21T08:13:39.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:39.076+0000 7f76c6ffd640 1 -- 172.21.15.107:0/2814509125 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v35) v1 ==== 107+0+4265 (secure 0 0 0) 0x7f76c007ae10 con 0x7f76d00703c0 2024-09-21T08:13:39.078 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:39.078 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":24,"btime":"2024-09-21T08:10:50:000186+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi107.qusoyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3638073096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3638073096},{"type":"v1","addr":"172.21.15.107:6827","nonce":3638073096}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34402,"name":"cephfs.smithi107.grqzkt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6829/1321345266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1321345266},{"type":"v1","addr":"172.21.15.107:6829","nonce":1321345266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:10:50.000170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi129.belyba","rank":0,"incarnation":24,"state":"up:replay","state_seq":2,"addr":"172.21.15.129:6827/3658871735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3658871735},{"type":"v1","addr":"172.21.15.129:6827","nonce":3658871735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T08:13:39.078 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 24 2024-09-21T08:13:39.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:39.078+0000 7f76d8516640 1 -- 172.21.15.107:0/2814509125 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f76bc06e530 msgr2=0x7f76bc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:39.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:39.078+0000 7f76d8516640 1 --2- 172.21.15.107:0/2814509125 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f76bc06e530 0x7f76bc0709e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f76cc007fd0 tx=0x7f76cc009040 comp rx=0 tx=0).stop 2024-09-21T08:13:39.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:39.078+0000 7f76d8516640 1 -- 172.21.15.107:0/2814509125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76d00703c0 msgr2=0x7f76d0115920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:39.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:39.078+0000 7f76d8516640 1 --2- 172.21.15.107:0/2814509125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76d00703c0 0x7f76d0115920 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f76c0003080 tx=0x7f76c0009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:39.079+0000 7f76d8516640 1 -- 172.21.15.107:0/2814509125 shutdown_connections 2024-09-21T08:13:39.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:39.079+0000 7f76d8516640 1 --2- 172.21.15.107:0/2814509125 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f76bc06e530 0x7f76bc0709e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:39.079+0000 7f76d8516640 1 --2- 172.21.15.107:0/2814509125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76d00703c0 0x7f76d0115920 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:39.079+0000 7f76d8516640 1 --2- 172.21.15.107:0/2814509125 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76d006fab0 0x7f76d01153e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:39.079+0000 7f76d8516640 1 -- 172.21.15.107:0/2814509125 >> 172.21.15.107:0/2814509125 conn(0x7f76d00f80f0 msgr2=0x7f76d00f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:39.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:39.079+0000 7f76d8516640 1 -- 172.21.15.107:0/2814509125 shutdown_connections 2024-09-21T08:13:39.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:39.079+0000 7f76d8516640 1 -- 172.21.15.107:0/2814509125 wait complete. 2024-09-21T08:13:39.721 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 25 2024-09-21T08:13:39.966 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:40.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:39 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/2814509125' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-21T08:13:40.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:39 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/2814509125' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-21T08:13:41.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:40 smithi129 ceph-mon[76722]: pgmap v279: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:41.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:40 smithi107 ceph-mon[97757]: pgmap v279: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:41.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.567+0000 7fb44060a640 1 -- 172.21.15.107:0/3271302360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4380fdf00 msgr2=0x7fb4381065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:41.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.567+0000 7fb44060a640 1 --2- 172.21.15.107:0/3271302360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4380fdf00 0x7fb4381065d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb428004900 tx=0x7fb428009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.567+0000 7fb44060a640 1 -- 172.21.15.107:0/3271302360 shutdown_connections 2024-09-21T08:13:41.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.567+0000 7fb44060a640 1 --2- 172.21.15.107:0/3271302360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4380fdf00 0x7fb4381065d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.567+0000 7fb44060a640 1 --2- 172.21.15.107:0/3271302360 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4380fd560 0x7fb4380fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.567+0000 7fb44060a640 1 -- 172.21.15.107:0/3271302360 >> 172.21.15.107:0/3271302360 conn(0x7fb4380f7060 msgr2=0x7fb4380f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:41.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.567+0000 7fb44060a640 1 -- 172.21.15.107:0/3271302360 shutdown_connections 2024-09-21T08:13:41.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.567+0000 7fb44060a640 1 -- 172.21.15.107:0/3271302360 wait complete. 2024-09-21T08:13:41.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.568+0000 7fb44060a640 1 Processor -- start 2024-09-21T08:13:41.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.568+0000 7fb44060a640 1 -- start start 2024-09-21T08:13:41.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.568+0000 7fb44060a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4380fd560 0x7fb4381132f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.568+0000 7fb44060a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4380fdf00 0x7fb438113830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.568+0000 7fb44060a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb438113ec0 con 0x7fb4380fdf00 2024-09-21T08:13:41.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.568+0000 7fb44060a640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43810d270 con 0x7fb4380fd560 2024-09-21T08:13:41.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.568+0000 7fb43dba5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4380fdf00 0x7fb438113830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.568+0000 7fb43dba5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4380fdf00 0x7fb438113830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51252/0 (socket says 172.21.15.107:51252) 2024-09-21T08:13:41.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.568+0000 7fb43dba5640 1 -- 172.21.15.107:0/459479765 learned_addr learned my addr 172.21.15.107:0/459479765 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:41.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.569+0000 7fb43e3a6640 1 --2- 172.21.15.107:0/459479765 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4380fd560 0x7fb4381132f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.569+0000 7fb43dba5640 1 -- 172.21.15.107:0/459479765 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4380fd560 msgr2=0x7fb4381132f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:41.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.569+0000 7fb43dba5640 1 --2- 172.21.15.107:0/459479765 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4380fd560 0x7fb4381132f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.569+0000 7fb43dba5640 1 -- 172.21.15.107:0/459479765 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb428005040 con 0x7fb4380fdf00 2024-09-21T08:13:41.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.569+0000 7fb43dba5640 1 --2- 172.21.15.107:0/459479765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4380fdf00 0x7fb438113830 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb42802a560 tx=0x7fb428009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:41.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.569+0000 7fb42effd640 1 -- 172.21.15.107:0/459479765 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb428038070 con 0x7fb4380fdf00 2024-09-21T08:13:41.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.569+0000 7fb44060a640 1 -- 172.21.15.107:0/459479765 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43810d4f0 con 0x7fb4380fdf00 2024-09-21T08:13:41.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.569+0000 7fb42effd640 1 -- 172.21.15.107:0/459479765 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb428032cd0 con 0x7fb4380fdf00 2024-09-21T08:13:41.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.569+0000 7fb42effd640 1 -- 172.21.15.107:0/459479765 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4280096c0 con 0x7fb4380fdf00 2024-09-21T08:13:41.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.569+0000 7fb44060a640 1 -- 172.21.15.107:0/459479765 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43810d9b0 con 0x7fb4380fdf00 2024-09-21T08:13:41.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.570+0000 7fb44060a640 1 -- 172.21.15.107:0/459479765 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4380662f0 con 0x7fb4380fdf00 2024-09-21T08:13:41.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.570+0000 7fb42effd640 1 -- 172.21.15.107:0/459479765 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb428030020 con 0x7fb4380fdf00 2024-09-21T08:13:41.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.571+0000 7fb42effd640 1 --2- 172.21.15.107:0/459479765 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb42406e530 0x7fb4240709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.571+0000 7fb42effd640 1 -- 172.21.15.107:0/459479765 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7fb4280ae890 con 0x7fb4380fdf00 2024-09-21T08:13:41.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.571+0000 7fb43e3a6640 1 --2- 172.21.15.107:0/459479765 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb42406e530 0x7fb4240709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.572+0000 7fb43e3a6640 1 --2- 172.21.15.107:0/459479765 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb42406e530 0x7fb4240709e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb434006fd0 tx=0x7fb434008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:41.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.575+0000 7fb42effd640 1 -- 172.21.15.107:0/459479765 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb428077800 con 0x7fb4380fdf00 2024-09-21T08:13:41.782 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.780+0000 7fb44060a640 1 -- 172.21.15.107:0/459479765 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7fb438109600 con 0x7fb4380fdf00 2024-09-21T08:13:41.783 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.780+0000 7fb42effd640 1 -- 172.21.15.107:0/459479765 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v35) v1 ==== 107+0+4270 (secure 0 0 0) 0x7fb42807aec0 con 0x7fb4380fdf00 2024-09-21T08:13:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:41.785 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":25,"btime":"2024-09-21T08:10:57:683093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi107.qusoyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3638073096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3638073096},{"type":"v1","addr":"172.21.15.107:6827","nonce":3638073096}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34402,"name":"cephfs.smithi107.grqzkt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6829/1321345266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1321345266},{"type":"v1","addr":"172.21.15.107:6829","nonce":1321345266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:10:57.453294+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi129.belyba","rank":0,"incarnation":24,"state":"up:reconnect","state_seq":162,"addr":"172.21.15.129:6827/3658871735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3658871735},{"type":"v1","addr":"172.21.15.129:6827","nonce":3658871735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T08:13:41.786 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 25 2024-09-21T08:13:41.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.782+0000 7fb44060a640 1 -- 172.21.15.107:0/459479765 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb42406e530 msgr2=0x7fb4240709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:41.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.782+0000 7fb44060a640 1 --2- 172.21.15.107:0/459479765 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb42406e530 0x7fb4240709e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb434006fd0 tx=0x7fb434008040 comp rx=0 tx=0).stop 2024-09-21T08:13:41.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.782+0000 7fb44060a640 1 -- 172.21.15.107:0/459479765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4380fdf00 msgr2=0x7fb438113830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:41.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.782+0000 7fb44060a640 1 --2- 172.21.15.107:0/459479765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4380fdf00 0x7fb438113830 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb42802a560 tx=0x7fb428009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.782+0000 7fb44060a640 1 -- 172.21.15.107:0/459479765 shutdown_connections 2024-09-21T08:13:41.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.782+0000 7fb44060a640 1 --2- 172.21.15.107:0/459479765 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb42406e530 0x7fb4240709e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.782+0000 7fb44060a640 1 --2- 172.21.15.107:0/459479765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4380fdf00 0x7fb438113830 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.782+0000 7fb44060a640 1 --2- 172.21.15.107:0/459479765 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4380fd560 0x7fb4381132f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.782+0000 7fb44060a640 1 -- 172.21.15.107:0/459479765 >> 172.21.15.107:0/459479765 conn(0x7fb4380f7060 msgr2=0x7fb4380f85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:41.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.783+0000 7fb44060a640 1 -- 172.21.15.107:0/459479765 shutdown_connections 2024-09-21T08:13:41.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:41.783+0000 7fb44060a640 1 -- 172.21.15.107:0/459479765 wait complete. 2024-09-21T08:13:42.508 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 26 2024-09-21T08:13:42.753 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:43.011 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:42 smithi107 ceph-mon[97757]: pgmap v280: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:43.011 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:42 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/459479765' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-21T08:13:43.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:42 smithi129 ceph-mon[76722]: pgmap v280: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:43.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:42 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/459479765' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-21T08:13:44.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.388+0000 7fb8299af640 1 -- 172.21.15.107:0/193819169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb824064fc0 msgr2=0x7fb824065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:44.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.388+0000 7fb8299af640 1 --2- 172.21.15.107:0/193819169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb824064fc0 0x7fb824065430 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0048d0 tx=0x7fb80c009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:44.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.388+0000 7fb8299af640 1 -- 172.21.15.107:0/193819169 shutdown_connections 2024-09-21T08:13:44.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.388+0000 7fb8299af640 1 --2- 172.21.15.107:0/193819169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb824064fc0 0x7fb824065430 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:44.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.388+0000 7fb8299af640 1 --2- 172.21.15.107:0/193819169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8240fe460 0x7fb8240fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:44.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.388+0000 7fb8299af640 1 -- 172.21.15.107:0/193819169 >> 172.21.15.107:0/193819169 conn(0x7fb8240723b0 msgr2=0x7fb8240727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:44.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.388+0000 7fb8299af640 1 -- 172.21.15.107:0/193819169 shutdown_connections 2024-09-21T08:13:44.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.389+0000 7fb8299af640 1 -- 172.21.15.107:0/193819169 wait complete. 2024-09-21T08:13:44.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.389+0000 7fb8299af640 1 Processor -- start 2024-09-21T08:13:44.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.389+0000 7fb8299af640 1 -- start start 2024-09-21T08:13:44.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.389+0000 7fb8299af640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb824064fc0 0x7fb8241131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:44.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.389+0000 7fb8299af640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8240fe460 0x7fb824113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:44.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.389+0000 7fb8299af640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb824113d10 con 0x7fb824064fc0 2024-09-21T08:13:44.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.389+0000 7fb8299af640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82410d1a0 con 0x7fb8240fe460 2024-09-21T08:13:44.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.390+0000 7fb822ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb824064fc0 0x7fb8241131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:44.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.390+0000 7fb822ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb824064fc0 0x7fb8241131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51278/0 (socket says 172.21.15.107:51278) 2024-09-21T08:13:44.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.390+0000 7fb822ffd640 1 -- 172.21.15.107:0/1802534850 learned_addr learned my addr 172.21.15.107:0/1802534850 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:44.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.390+0000 7fb8227fc640 1 --2- 172.21.15.107:0/1802534850 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8240fe460 0x7fb824113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:44.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.390+0000 7fb822ffd640 1 -- 172.21.15.107:0/1802534850 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8240fe460 msgr2=0x7fb824113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:44.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.390+0000 7fb822ffd640 1 --2- 172.21.15.107:0/1802534850 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8240fe460 0x7fb824113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:44.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.390+0000 7fb822ffd640 1 -- 172.21.15.107:0/1802534850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c005040 con 0x7fb824064fc0 2024-09-21T08:13:44.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.390+0000 7fb822ffd640 1 --2- 172.21.15.107:0/1802534850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb824064fc0 0x7fb8241131d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb81400db00 tx=0x7fb814004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:44.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.390+0000 7fb81b7fe640 1 -- 172.21.15.107:0/1802534850 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb814017070 con 0x7fb824064fc0 2024-09-21T08:13:44.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.390+0000 7fb8299af640 1 -- 172.21.15.107:0/1802534850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82410d480 con 0x7fb824064fc0 2024-09-21T08:13:44.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.390+0000 7fb81b7fe640 1 -- 172.21.15.107:0/1802534850 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb81400f040 con 0x7fb824064fc0 2024-09-21T08:13:44.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.390+0000 7fb81b7fe640 1 -- 172.21.15.107:0/1802534850 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb814003960 con 0x7fb824064fc0 2024-09-21T08:13:44.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.390+0000 7fb8299af640 1 -- 172.21.15.107:0/1802534850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82410d9f0 con 0x7fb824064fc0 2024-09-21T08:13:44.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.391+0000 7fb8299af640 1 -- 172.21.15.107:0/1802534850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8240fdcf0 con 0x7fb824064fc0 2024-09-21T08:13:44.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.392+0000 7fb81b7fe640 1 -- 172.21.15.107:0/1802534850 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb814003b50 con 0x7fb824064fc0 2024-09-21T08:13:44.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.392+0000 7fb81b7fe640 1 --2- 172.21.15.107:0/1802534850 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb81006e530 0x7fb8100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:44.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.393+0000 7fb8227fc640 1 --2- 172.21.15.107:0/1802534850 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb81006e530 0x7fb8100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:44.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.393+0000 7fb81b7fe640 1 -- 172.21.15.107:0/1802534850 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7fb81408e300 con 0x7fb824064fc0 2024-09-21T08:13:44.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.393+0000 7fb8227fc640 1 --2- 172.21.15.107:0/1802534850 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb81006e530 0x7fb8100709e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb80c009ac0 tx=0x7fb80c035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:44.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.397+0000 7fb81b7fe640 1 -- 172.21.15.107:0/1802534850 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb814057270 con 0x7fb824064fc0 2024-09-21T08:13:44.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.596+0000 7fb8299af640 1 -- 172.21.15.107:0/1802534850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7fb82404b750 con 0x7fb824064fc0 2024-09-21T08:13:44.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.597+0000 7fb81b7fe640 1 -- 172.21.15.107:0/1802534850 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v35) v1 ==== 107+0+4267 (secure 0 0 0) 0x7fb81405a930 con 0x7fb824064fc0 2024-09-21T08:13:44.598 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:44.598 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":26,"btime":"2024-09-21T08:10:58:688106+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi107.qusoyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3638073096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3638073096},{"type":"v1","addr":"172.21.15.107:6827","nonce":3638073096}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34402,"name":"cephfs.smithi107.grqzkt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6829/1321345266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1321345266},{"type":"v1","addr":"172.21.15.107:6829","nonce":1321345266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:10:57.693141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi129.belyba","rank":0,"incarnation":24,"state":"up:rejoin","state_seq":163,"addr":"172.21.15.129:6827/3658871735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3658871735},{"type":"v1","addr":"172.21.15.129:6827","nonce":3658871735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T08:13:44.599 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 26 2024-09-21T08:13:44.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.598+0000 7fb8299af640 1 -- 172.21.15.107:0/1802534850 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb81006e530 msgr2=0x7fb8100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:44.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.598+0000 7fb8299af640 1 --2- 172.21.15.107:0/1802534850 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb81006e530 0x7fb8100709e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb80c009ac0 tx=0x7fb80c035040 comp rx=0 tx=0).stop 2024-09-21T08:13:44.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.598+0000 7fb8299af640 1 -- 172.21.15.107:0/1802534850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb824064fc0 msgr2=0x7fb8241131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:44.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.598+0000 7fb8299af640 1 --2- 172.21.15.107:0/1802534850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb824064fc0 0x7fb8241131d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb81400db00 tx=0x7fb814004e60 comp rx=0 tx=0).stop 2024-09-21T08:13:44.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.599+0000 7fb8299af640 1 -- 172.21.15.107:0/1802534850 shutdown_connections 2024-09-21T08:13:44.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.599+0000 7fb8299af640 1 --2- 172.21.15.107:0/1802534850 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb81006e530 0x7fb8100709e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:44.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.599+0000 7fb8299af640 1 --2- 172.21.15.107:0/1802534850 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8240fe460 0x7fb824113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:44.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.599+0000 7fb8299af640 1 --2- 172.21.15.107:0/1802534850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb824064fc0 0x7fb8241131d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:44.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.599+0000 7fb8299af640 1 -- 172.21.15.107:0/1802534850 >> 172.21.15.107:0/1802534850 conn(0x7fb8240723b0 msgr2=0x7fb8241053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:44.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.599+0000 7fb8299af640 1 -- 172.21.15.107:0/1802534850 shutdown_connections 2024-09-21T08:13:44.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:44.599+0000 7fb8299af640 1 -- 172.21.15.107:0/1802534850 wait complete. 2024-09-21T08:13:44.958 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:44 smithi107 ceph-mon[97757]: pgmap v281: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:44.958 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:44 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/1802534850' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-21T08:13:44.958 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:44 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:13:45.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:44 smithi129 ceph-mon[76722]: pgmap v281: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:45.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:44 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/1802534850' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-21T08:13:45.017 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:44 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:13:45.333 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 27 2024-09-21T08:13:45.579 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:46.962 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:46 smithi107 ceph-mon[97757]: pgmap v282: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:47.016 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:46 smithi129 ceph-mon[76722]: pgmap v282: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:47.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.151+0000 7fc8a4d25640 1 -- 172.21.15.107:0/3369228025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8a0065c10 msgr2=0x7fc8a00fe0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:47.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.151+0000 7fc8a4d25640 1 --2- 172.21.15.107:0/3369228025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8a0065c10 0x7fc8a00fe0d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc8940048d0 tx=0x7fc894009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:47.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.151+0000 7fc8a4d25640 1 -- 172.21.15.107:0/3369228025 shutdown_connections 2024-09-21T08:13:47.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.151+0000 7fc8a4d25640 1 --2- 172.21.15.107:0/3369228025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8a0065c10 0x7fc8a00fe0d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:47.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.151+0000 7fc8a4d25640 1 --2- 172.21.15.107:0/3369228025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc8a0065300 0x7fc8a00656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:47.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.151+0000 7fc8a4d25640 1 -- 172.21.15.107:0/3369228025 >> 172.21.15.107:0/3369228025 conn(0x7fc8a00723b0 msgr2=0x7fc8a00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:47.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.151+0000 7fc8a4d25640 1 -- 172.21.15.107:0/3369228025 shutdown_connections 2024-09-21T08:13:47.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.151+0000 7fc8a4d25640 1 -- 172.21.15.107:0/3369228025 wait complete. 2024-09-21T08:13:47.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.152+0000 7fc8a4d25640 1 Processor -- start 2024-09-21T08:13:47.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.152+0000 7fc8a4d25640 1 -- start start 2024-09-21T08:13:47.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.152+0000 7fc8a4d25640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8a0065300 0x7fc8a01131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:47.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.152+0000 7fc8a4d25640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc8a0065c10 0x7fc8a0113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:47.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.152+0000 7fc8a4d25640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a0113d10 con 0x7fc8a0065300 2024-09-21T08:13:47.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.152+0000 7fc8a4d25640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a010d150 con 0x7fc8a0065c10 2024-09-21T08:13:47.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.152+0000 7fc89e59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8a0065300 0x7fc8a01131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:47.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.152+0000 7fc89e59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8a0065300 0x7fc8a01131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51294/0 (socket says 172.21.15.107:51294) 2024-09-21T08:13:47.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.152+0000 7fc89e59c640 1 -- 172.21.15.107:0/3914019264 learned_addr learned my addr 172.21.15.107:0/3914019264 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:47.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.152+0000 7fc89dd9b640 1 --2- 172.21.15.107:0/3914019264 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc8a0065c10 0x7fc8a0113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:47.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.152+0000 7fc89e59c640 1 -- 172.21.15.107:0/3914019264 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc8a0065c10 msgr2=0x7fc8a0113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:47.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.152+0000 7fc89e59c640 1 --2- 172.21.15.107:0/3914019264 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc8a0065c10 0x7fc8a0113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:47.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.152+0000 7fc89e59c640 1 -- 172.21.15.107:0/3914019264 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc894005040 con 0x7fc8a0065300 2024-09-21T08:13:47.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.152+0000 7fc89e59c640 1 --2- 172.21.15.107:0/3914019264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8a0065300 0x7fc8a01131d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc89000c830 tx=0x7fc890004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:47.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.153+0000 7fc88effd640 1 -- 172.21.15.107:0/3914019264 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc89000a850 con 0x7fc8a0065300 2024-09-21T08:13:47.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.153+0000 7fc8a4d25640 1 -- 172.21.15.107:0/3914019264 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a010d430 con 0x7fc8a0065300 2024-09-21T08:13:47.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.153+0000 7fc88effd640 1 -- 172.21.15.107:0/3914019264 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc89000ae50 con 0x7fc8a0065300 2024-09-21T08:13:47.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.153+0000 7fc88effd640 1 -- 172.21.15.107:0/3914019264 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8900113a0 con 0x7fc8a0065300 2024-09-21T08:13:47.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.153+0000 7fc8a4d25640 1 -- 172.21.15.107:0/3914019264 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a010d9a0 con 0x7fc8a0065300 2024-09-21T08:13:47.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.154+0000 7fc8a4d25640 1 -- 172.21.15.107:0/3914019264 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a00fdce0 con 0x7fc8a0065300 2024-09-21T08:13:47.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.154+0000 7fc88effd640 1 -- 172.21.15.107:0/3914019264 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc890012400 con 0x7fc8a0065300 2024-09-21T08:13:47.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.154+0000 7fc88effd640 1 --2- 172.21.15.107:0/3914019264 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc88806e530 0x7fc8880709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:47.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.155+0000 7fc88effd640 1 -- 172.21.15.107:0/3914019264 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7fc89008e530 con 0x7fc8a0065300 2024-09-21T08:13:47.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.155+0000 7fc89dd9b640 1 --2- 172.21.15.107:0/3914019264 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc88806e530 0x7fc8880709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:47.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.155+0000 7fc89dd9b640 1 --2- 172.21.15.107:0/3914019264 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc88806e530 0x7fc8880709e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00f8790 tx=0x7fc894035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:47.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.159+0000 7fc88effd640 1 -- 172.21.15.107:0/3914019264 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc890057520 con 0x7fc8a0065300 2024-09-21T08:13:47.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.359+0000 7fc8a4d25640 1 -- 172.21.15.107:0/3914019264 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fc8a0072ec0 con 0x7fc8a0065300 2024-09-21T08:13:47.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.360+0000 7fc88effd640 1 -- 172.21.15.107:0/3914019264 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v35) v1 ==== 107+0+4276 (secure 0 0 0) 0x7fc89005abe0 con 0x7fc8a0065300 2024-09-21T08:13:47.363 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:47.363 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":27,"btime":"2024-09-21T08:10:59:693564+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi107.qusoyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3638073096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3638073096},{"type":"v1","addr":"172.21.15.107:6827","nonce":3638073096}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34402,"name":"cephfs.smithi107.grqzkt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6829/1321345266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1321345266},{"type":"v1","addr":"172.21.15.107:6829","nonce":1321345266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:10:59.693561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi129.belyba","rank":0,"incarnation":24,"state":"up:active","state_seq":164,"addr":"172.21.15.129:6827/3658871735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3658871735},{"type":"v1","addr":"172.21.15.129:6827","nonce":3658871735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24247,"qdb_cluster":[24247]},"id":1}]} 2024-09-21T08:13:47.363 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 27 2024-09-21T08:13:47.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.362+0000 7fc8a4d25640 1 -- 172.21.15.107:0/3914019264 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc88806e530 msgr2=0x7fc8880709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:47.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.362+0000 7fc8a4d25640 1 --2- 172.21.15.107:0/3914019264 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc88806e530 0x7fc8880709e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00f8790 tx=0x7fc894035040 comp rx=0 tx=0).stop 2024-09-21T08:13:47.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.362+0000 7fc8a4d25640 1 -- 172.21.15.107:0/3914019264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8a0065300 msgr2=0x7fc8a01131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:47.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.362+0000 7fc8a4d25640 1 --2- 172.21.15.107:0/3914019264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8a0065300 0x7fc8a01131d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc89000c830 tx=0x7fc890004430 comp rx=0 tx=0).stop 2024-09-21T08:13:47.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.362+0000 7fc8a4d25640 1 -- 172.21.15.107:0/3914019264 shutdown_connections 2024-09-21T08:13:47.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.362+0000 7fc8a4d25640 1 --2- 172.21.15.107:0/3914019264 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fc88806e530 0x7fc8880709e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:47.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.362+0000 7fc8a4d25640 1 --2- 172.21.15.107:0/3914019264 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc8a0065c10 0x7fc8a0113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:47.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.362+0000 7fc8a4d25640 1 --2- 172.21.15.107:0/3914019264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8a0065300 0x7fc8a01131d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:47.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.362+0000 7fc8a4d25640 1 -- 172.21.15.107:0/3914019264 >> 172.21.15.107:0/3914019264 conn(0x7fc8a00723b0 msgr2=0x7fc8a00fa320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:47.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.362+0000 7fc8a4d25640 1 -- 172.21.15.107:0/3914019264 shutdown_connections 2024-09-21T08:13:47.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:47.362+0000 7fc8a4d25640 1 -- 172.21.15.107:0/3914019264 wait complete. 2024-09-21T08:13:47.965 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:47 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/3914019264' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-21T08:13:48.038 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 28 2024-09-21T08:13:48.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:47 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/3914019264' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-21T08:13:48.292 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:49.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:48 smithi107 ceph-mon[97757]: pgmap v283: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:49.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:48 smithi129 ceph-mon[76722]: pgmap v283: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:49.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.883+0000 7f154fd35640 1 -- 172.21.15.107:0/2974370771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15480fdf10 msgr2=0x7f1548106550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:49.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.883+0000 7f154fd35640 1 --2- 172.21.15.107:0/2974370771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15480fdf10 0x7f1548106550 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f15380048d0 tx=0x7f1538009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:49.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.883+0000 7f154fd35640 1 -- 172.21.15.107:0/2974370771 shutdown_connections 2024-09-21T08:13:49.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.883+0000 7f154fd35640 1 --2- 172.21.15.107:0/2974370771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15480fdf10 0x7f1548106550 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:49.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.883+0000 7f154fd35640 1 --2- 172.21.15.107:0/2974370771 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15480fd570 0x7f15480fd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:49.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.883+0000 7f154fd35640 1 -- 172.21.15.107:0/2974370771 >> 172.21.15.107:0/2974370771 conn(0x7f15480f7000 msgr2=0x7f15480f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:49.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.883+0000 7f154fd35640 1 -- 172.21.15.107:0/2974370771 shutdown_connections 2024-09-21T08:13:49.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.883+0000 7f154fd35640 1 -- 172.21.15.107:0/2974370771 wait complete. 2024-09-21T08:13:49.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.884+0000 7f154fd35640 1 Processor -- start 2024-09-21T08:13:49.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.884+0000 7f154fd35640 1 -- start start 2024-09-21T08:13:49.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.884+0000 7f154fd35640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15480fd570 0x7f1548113300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:49.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.884+0000 7f154fd35640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15480fdf10 0x7f1548113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:49.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.884+0000 7f154fd35640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1548113ed0 con 0x7f15480fdf10 2024-09-21T08:13:49.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.884+0000 7f154fd35640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154810d2c0 con 0x7f15480fd570 2024-09-21T08:13:49.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.884+0000 7f154d2d0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15480fdf10 0x7f1548113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:49.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.884+0000 7f154d2d0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15480fdf10 0x7f1548113840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51320/0 (socket says 172.21.15.107:51320) 2024-09-21T08:13:49.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.884+0000 7f154d2d0640 1 -- 172.21.15.107:0/414230644 learned_addr learned my addr 172.21.15.107:0/414230644 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:49.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.885+0000 7f154dad1640 1 --2- 172.21.15.107:0/414230644 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15480fd570 0x7f1548113300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:49.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.885+0000 7f154d2d0640 1 -- 172.21.15.107:0/414230644 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15480fd570 msgr2=0x7f1548113300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:49.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.885+0000 7f154d2d0640 1 --2- 172.21.15.107:0/414230644 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15480fd570 0x7f1548113300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:49.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.885+0000 7f154d2d0640 1 -- 172.21.15.107:0/414230644 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1538005040 con 0x7f15480fdf10 2024-09-21T08:13:49.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.885+0000 7f154d2d0640 1 --2- 172.21.15.107:0/414230644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15480fdf10 0x7f1548113840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1538003080 tx=0x7f1538009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:49.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.885+0000 7f153e7fc640 1 -- 172.21.15.107:0/414230644 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1538038070 con 0x7f15480fdf10 2024-09-21T08:13:49.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.885+0000 7f153e7fc640 1 -- 172.21.15.107:0/414230644 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f15380097e0 con 0x7f15480fdf10 2024-09-21T08:13:49.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.885+0000 7f154fd35640 1 -- 172.21.15.107:0/414230644 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154810d540 con 0x7f15480fdf10 2024-09-21T08:13:49.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.885+0000 7f153e7fc640 1 -- 172.21.15.107:0/414230644 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f153803d420 con 0x7f15480fdf10 2024-09-21T08:13:49.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.885+0000 7f154fd35640 1 -- 172.21.15.107:0/414230644 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f154810da00 con 0x7f15480fdf10 2024-09-21T08:13:49.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.886+0000 7f154fd35640 1 -- 172.21.15.107:0/414230644 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1548066330 con 0x7f15480fdf10 2024-09-21T08:13:49.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.887+0000 7f153e7fc640 1 -- 172.21.15.107:0/414230644 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1538030020 con 0x7f15480fdf10 2024-09-21T08:13:49.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.887+0000 7f153e7fc640 1 --2- 172.21.15.107:0/414230644 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f153406e530 0x7f15340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:49.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.887+0000 7f153e7fc640 1 -- 172.21.15.107:0/414230644 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f15380ae830 con 0x7f15480fdf10 2024-09-21T08:13:49.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.887+0000 7f154dad1640 1 --2- 172.21.15.107:0/414230644 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f153406e530 0x7f15340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:49.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.888+0000 7f154dad1640 1 --2- 172.21.15.107:0/414230644 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f153406e530 0x7f15340709e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1544006fd0 tx=0x7f1544008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:49.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:49.891+0000 7f153e7fc640 1 -- 172.21.15.107:0/414230644 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f15380777a0 con 0x7f15480fdf10 2024-09-21T08:13:50.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:50.092+0000 7f154fd35640 1 -- 172.21.15.107:0/414230644 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f15480fac40 con 0x7f15480fdf10 2024-09-21T08:13:50.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:50.093+0000 7f153e7fc640 1 -- 172.21.15.107:0/414230644 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v35) v1 ==== 107+0+5126 (secure 0 0 0) 0x7f153807ae60 con 0x7f15480fdf10 2024-09-21T08:13:50.095 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:50.095 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":28,"btime":"2024-09-21T08:11:01:696266+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi107.qusoyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3638073096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3638073096},{"type":"v1","addr":"172.21.15.107:6827","nonce":3638073096}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34402,"name":"cephfs.smithi107.grqzkt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6829/1321345266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1321345266},{"type":"v1","addr":"172.21.15.107:6829","nonce":1321345266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44319,"name":"cephfs.smithi129.fwmfcy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6825/4074709540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":4074709540},{"type":"v1","addr":"172.21.15.129:6825","nonce":4074709540}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:10:59.693561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi129.belyba","rank":0,"incarnation":24,"state":"up:active","state_seq":164,"addr":"172.21.15.129:6827/3658871735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3658871735},{"type":"v1","addr":"172.21.15.129:6827","nonce":3658871735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24247,"qdb_cluster":[24247]},"id":1}]} 2024-09-21T08:13:50.095 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 28 2024-09-21T08:13:50.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:50.095+0000 7f154fd35640 1 -- 172.21.15.107:0/414230644 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f153406e530 msgr2=0x7f15340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:50.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:50.095+0000 7f154fd35640 1 --2- 172.21.15.107:0/414230644 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f153406e530 0x7f15340709e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1544006fd0 tx=0x7f1544008040 comp rx=0 tx=0).stop 2024-09-21T08:13:50.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:50.095+0000 7f154fd35640 1 -- 172.21.15.107:0/414230644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15480fdf10 msgr2=0x7f1548113840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:50.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:50.095+0000 7f154fd35640 1 --2- 172.21.15.107:0/414230644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15480fdf10 0x7f1548113840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1538003080 tx=0x7f1538009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:50.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:50.095+0000 7f154fd35640 1 -- 172.21.15.107:0/414230644 shutdown_connections 2024-09-21T08:13:50.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:50.095+0000 7f154fd35640 1 --2- 172.21.15.107:0/414230644 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f153406e530 0x7f15340709e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:50.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:50.095+0000 7f154fd35640 1 --2- 172.21.15.107:0/414230644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15480fdf10 0x7f1548113840 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:50.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:50.095+0000 7f154fd35640 1 --2- 172.21.15.107:0/414230644 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15480fd570 0x7f1548113300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:50.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:50.095+0000 7f154fd35640 1 -- 172.21.15.107:0/414230644 >> 172.21.15.107:0/414230644 conn(0x7f15480f7000 msgr2=0x7f15480f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:50.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:50.095+0000 7f154fd35640 1 -- 172.21.15.107:0/414230644 shutdown_connections 2024-09-21T08:13:50.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:50.095+0000 7f154fd35640 1 -- 172.21.15.107:0/414230644 wait complete. 2024-09-21T08:13:50.880 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 29 2024-09-21T08:13:51.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:50 smithi107 ceph-mon[97757]: pgmap v284: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:51.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:50 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/414230644' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-21T08:13:51.127 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:51.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:50 smithi129 ceph-mon[76722]: pgmap v284: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:51.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:50 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/414230644' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-21T08:13:52.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.725+0000 7f258c503640 1 -- 172.21.15.107:0/1689972386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2584102ef0 msgr2=0x7f25840fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:52.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.725+0000 7f258c503640 1 --2- 172.21.15.107:0/1689972386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2584102ef0 0x7f25840fc5b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f25800048d0 tx=0x7f2580009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:52.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.725+0000 7f258c503640 1 -- 172.21.15.107:0/1689972386 shutdown_connections 2024-09-21T08:13:52.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.725+0000 7f258c503640 1 --2- 172.21.15.107:0/1689972386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2584102ef0 0x7f25840fc5b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:52.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.725+0000 7f258c503640 1 --2- 172.21.15.107:0/1689972386 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2584102550 0x7f2584102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:52.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.725+0000 7f258c503640 1 -- 172.21.15.107:0/1689972386 >> 172.21.15.107:0/1689972386 conn(0x7f25840f80f0 msgr2=0x7f25840fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:52.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.725+0000 7f258c503640 1 -- 172.21.15.107:0/1689972386 shutdown_connections 2024-09-21T08:13:52.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.725+0000 7f258c503640 1 -- 172.21.15.107:0/1689972386 wait complete. 2024-09-21T08:13:52.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.725+0000 7f258c503640 1 Processor -- start 2024-09-21T08:13:52.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.725+0000 7f258c503640 1 -- start start 2024-09-21T08:13:52.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.726+0000 7f258c503640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2584102550 0x7f2584113580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:52.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.726+0000 7f258c503640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2584102ef0 0x7f2584113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:52.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.726+0000 7f258c503640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25841141a0 con 0x7f2584102ef0 2024-09-21T08:13:52.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.726+0000 7f258c503640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258410d520 con 0x7f2584102550 2024-09-21T08:13:52.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.726+0000 7f2589a9e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2584102ef0 0x7f2584113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:52.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.726+0000 7f2589a9e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2584102ef0 0x7f2584113ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50858/0 (socket says 172.21.15.107:50858) 2024-09-21T08:13:52.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.726+0000 7f2589a9e640 1 -- 172.21.15.107:0/3630551169 learned_addr learned my addr 172.21.15.107:0/3630551169 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:52.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.726+0000 7f258a29f640 1 --2- 172.21.15.107:0/3630551169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2584102550 0x7f2584113580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:52.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.726+0000 7f2589a9e640 1 -- 172.21.15.107:0/3630551169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2584102550 msgr2=0x7f2584113580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:52.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.726+0000 7f2589a9e640 1 --2- 172.21.15.107:0/3630551169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2584102550 0x7f2584113580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:52.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.726+0000 7f2589a9e640 1 -- 172.21.15.107:0/3630551169 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2580005040 con 0x7f2584102ef0 2024-09-21T08:13:52.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.726+0000 7f258a29f640 1 --2- 172.21.15.107:0/3630551169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2584102550 0x7f2584113580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:13:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.726+0000 7f2589a9e640 1 --2- 172.21.15.107:0/3630551169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2584102ef0 0x7f2584113ac0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2580003080 tx=0x7f2580009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.726+0000 7f2576ffd640 1 -- 172.21.15.107:0/3630551169 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2580038070 con 0x7f2584102ef0 2024-09-21T08:13:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.726+0000 7f2576ffd640 1 -- 172.21.15.107:0/3630551169 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2580009760 con 0x7f2584102ef0 2024-09-21T08:13:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.726+0000 7f258c503640 1 -- 172.21.15.107:0/3630551169 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f258410d750 con 0x7f2584102ef0 2024-09-21T08:13:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.726+0000 7f2576ffd640 1 -- 172.21.15.107:0/3630551169 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2580033420 con 0x7f2584102ef0 2024-09-21T08:13:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.726+0000 7f258c503640 1 -- 172.21.15.107:0/3630551169 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f258410dbb0 con 0x7f2584102ef0 2024-09-21T08:13:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.727+0000 7f258c503640 1 -- 172.21.15.107:0/3630551169 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25840fdcd0 con 0x7f2584102ef0 2024-09-21T08:13:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.728+0000 7f2576ffd640 1 -- 172.21.15.107:0/3630551169 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2580030020 con 0x7f2584102ef0 2024-09-21T08:13:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.728+0000 7f2576ffd640 1 --2- 172.21.15.107:0/3630551169 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f257006e530 0x7f25700709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.728+0000 7f2576ffd640 1 -- 172.21.15.107:0/3630551169 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f25800ae0b0 con 0x7f2584102ef0 2024-09-21T08:13:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.728+0000 7f258a29f640 1 --2- 172.21.15.107:0/3630551169 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f257006e530 0x7f25700709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.729+0000 7f258a29f640 1 --2- 172.21.15.107:0/3630551169 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f257006e530 0x7f25700709e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2578006fd0 tx=0x7f2578008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.733+0000 7f2576ffd640 1 -- 172.21.15.107:0/3630551169 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2580077020 con 0x7f2584102ef0 2024-09-21T08:13:52.804 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:52 smithi107 ceph-mon[97757]: pgmap v285: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:52.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.934+0000 7f258c503640 1 -- 172.21.15.107:0/3630551169 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f258404b720 con 0x7f2584102ef0 2024-09-21T08:13:52.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.935+0000 7f2576ffd640 1 -- 172.21.15.107:0/3630551169 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v35) v1 ==== 107+0+4322 (secure 0 0 0) 0x7f258007a6e0 con 0x7f2584102ef0 2024-09-21T08:13:52.936 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:52.937 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":29,"btime":"2024-09-21T08:11:11:043394+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi107.qusoyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3638073096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3638073096},{"type":"v1","addr":"172.21.15.107:6827","nonce":3638073096}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34402,"name":"cephfs.smithi107.grqzkt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6829/1321345266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1321345266},{"type":"v1","addr":"172.21.15.107:6829","nonce":1321345266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44319,"name":"cephfs.smithi129.fwmfcy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6825/4074709540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":4074709540},{"type":"v1","addr":"172.21.15.129:6825","nonce":4074709540}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:11:11.043392+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T08:13:52.937 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 29 2024-09-21T08:13:52.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.937+0000 7f258c503640 1 -- 172.21.15.107:0/3630551169 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f257006e530 msgr2=0x7f25700709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:52.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.937+0000 7f258c503640 1 --2- 172.21.15.107:0/3630551169 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f257006e530 0x7f25700709e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2578006fd0 tx=0x7f2578008040 comp rx=0 tx=0).stop 2024-09-21T08:13:52.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.937+0000 7f258c503640 1 -- 172.21.15.107:0/3630551169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2584102ef0 msgr2=0x7f2584113ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:52.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.937+0000 7f258c503640 1 --2- 172.21.15.107:0/3630551169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2584102ef0 0x7f2584113ac0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2580003080 tx=0x7f2580009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:52.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.937+0000 7f258c503640 1 -- 172.21.15.107:0/3630551169 shutdown_connections 2024-09-21T08:13:52.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.937+0000 7f258c503640 1 --2- 172.21.15.107:0/3630551169 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f257006e530 0x7f25700709e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:52.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.937+0000 7f258c503640 1 --2- 172.21.15.107:0/3630551169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2584102ef0 0x7f2584113ac0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:52.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.937+0000 7f258c503640 1 --2- 172.21.15.107:0/3630551169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2584102550 0x7f2584113580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:52.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.937+0000 7f258c503640 1 -- 172.21.15.107:0/3630551169 >> 172.21.15.107:0/3630551169 conn(0x7f25840f80f0 msgr2=0x7f25840f90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:52.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.937+0000 7f258c503640 1 -- 172.21.15.107:0/3630551169 shutdown_connections 2024-09-21T08:13:52.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:52.937+0000 7f258c503640 1 -- 172.21.15.107:0/3630551169 wait complete. 2024-09-21T08:13:53.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:52 smithi129 ceph-mon[76722]: pgmap v285: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:53.630 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 30 2024-09-21T08:13:53.880 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:54.001 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:53 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/3630551169' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-21T08:13:54.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:53 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/3630551169' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-21T08:13:54.994 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:54 smithi107 ceph-mon[97757]: pgmap v286: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:55.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:54 smithi129 ceph-mon[76722]: pgmap v286: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:55.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.506+0000 7f403b82c640 1 -- 172.21.15.107:0/1939366918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40340fac80 msgr2=0x7f40340fb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:55.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.506+0000 7f403b82c640 1 --2- 172.21.15.107:0/1939366918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40340fac80 0x7f40340fb0d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f40300048d0 tx=0x7f4030009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:55.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.506+0000 7f403b82c640 1 -- 172.21.15.107:0/1939366918 shutdown_connections 2024-09-21T08:13:55.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.506+0000 7f403b82c640 1 --2- 172.21.15.107:0/1939366918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40340fac80 0x7f40340fb0d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:55.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.506+0000 7f403b82c640 1 --2- 172.21.15.107:0/1939366918 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40340fd3a0 0x7f40340fd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:55.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.506+0000 7f403b82c640 1 -- 172.21.15.107:0/1939366918 >> 172.21.15.107:0/1939366918 conn(0x7f4034070ce0 msgr2=0x7f40340710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:55.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.507+0000 7f403b82c640 1 -- 172.21.15.107:0/1939366918 shutdown_connections 2024-09-21T08:13:55.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.507+0000 7f403b82c640 1 -- 172.21.15.107:0/1939366918 wait complete. 2024-09-21T08:13:55.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.507+0000 7f403b82c640 1 Processor -- start 2024-09-21T08:13:55.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.507+0000 7f403b82c640 1 -- start start 2024-09-21T08:13:55.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.507+0000 7f403b82c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40340fac80 0x7f4034115400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:55.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.507+0000 7f403b82c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40340fd3a0 0x7f4034115940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:55.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.507+0000 7f403b82c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4034115f40 con 0x7f40340fd3a0 2024-09-21T08:13:55.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.507+0000 7f403b82c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40341160b0 con 0x7f40340fac80 2024-09-21T08:13:55.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.507+0000 7f4038dc7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40340fd3a0 0x7f4034115940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:55.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.507+0000 7f4038dc7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40340fd3a0 0x7f4034115940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50862/0 (socket says 172.21.15.107:50862) 2024-09-21T08:13:55.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.507+0000 7f4038dc7640 1 -- 172.21.15.107:0/1423701384 learned_addr learned my addr 172.21.15.107:0/1423701384 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:55.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.508+0000 7f40395c8640 1 --2- 172.21.15.107:0/1423701384 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40340fac80 0x7f4034115400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:55.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.508+0000 7f4038dc7640 1 -- 172.21.15.107:0/1423701384 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40340fac80 msgr2=0x7f4034115400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:55.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.508+0000 7f4038dc7640 1 --2- 172.21.15.107:0/1423701384 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40340fac80 0x7f4034115400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:55.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.508+0000 7f4038dc7640 1 -- 172.21.15.107:0/1423701384 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4030005040 con 0x7f40340fd3a0 2024-09-21T08:13:55.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.508+0000 7f4038dc7640 1 --2- 172.21.15.107:0/1423701384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40340fd3a0 0x7f4034115940 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4030003080 tx=0x7f4030009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:55.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.508+0000 7f4025ffb640 1 -- 172.21.15.107:0/1423701384 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4030038070 con 0x7f40340fd3a0 2024-09-21T08:13:55.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.508+0000 7f4025ffb640 1 -- 172.21.15.107:0/1423701384 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f40300097e0 con 0x7f40340fd3a0 2024-09-21T08:13:55.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.508+0000 7f403b82c640 1 -- 172.21.15.107:0/1423701384 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f403410f4d0 con 0x7f40340fd3a0 2024-09-21T08:13:55.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.508+0000 7f4025ffb640 1 -- 172.21.15.107:0/1423701384 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f403003d420 con 0x7f40340fd3a0 2024-09-21T08:13:55.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.508+0000 7f403b82c640 1 -- 172.21.15.107:0/1423701384 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403410f990 con 0x7f40340fd3a0 2024-09-21T08:13:55.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.509+0000 7f403b82c640 1 -- 172.21.15.107:0/1423701384 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40340fbc90 con 0x7f40340fd3a0 2024-09-21T08:13:55.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.510+0000 7f4025ffb640 1 -- 172.21.15.107:0/1423701384 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4030030020 con 0x7f40340fd3a0 2024-09-21T08:13:55.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.510+0000 7f4025ffb640 1 --2- 172.21.15.107:0/1423701384 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f402006e530 0x7f40200709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:55.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.510+0000 7f4025ffb640 1 -- 172.21.15.107:0/1423701384 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f40300ae8a0 con 0x7f40340fd3a0 2024-09-21T08:13:55.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.510+0000 7f40395c8640 1 --2- 172.21.15.107:0/1423701384 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f402006e530 0x7f40200709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:55.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.511+0000 7f40395c8640 1 --2- 172.21.15.107:0/1423701384 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f402006e530 0x7f40200709e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f40280041d0 tx=0x7f4028009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:55.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.515+0000 7f4025ffb640 1 -- 172.21.15.107:0/1423701384 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4030077810 con 0x7f40340fd3a0 2024-09-21T08:13:55.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.715+0000 7f403b82c640 1 -- 172.21.15.107:0/1423701384 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f4034074c00 con 0x7f40340fd3a0 2024-09-21T08:13:55.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.715+0000 7f4025ffb640 1 -- 172.21.15.107:0/1423701384 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v35) v1 ==== 107+0+4401 (secure 0 0 0) 0x7f403007aed0 con 0x7f40340fd3a0 2024-09-21T08:13:55.717 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:55.717 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":30,"btime":"2024-09-21T08:11:11:049900+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34402,"name":"cephfs.smithi107.grqzkt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6829/1321345266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1321345266},{"type":"v1","addr":"172.21.15.107:6829","nonce":1321345266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44319,"name":"cephfs.smithi129.fwmfcy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6825/4074709540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":4074709540},{"type":"v1","addr":"172.21.15.129:6825","nonce":4074709540}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:11:11.049889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi107.qusoyf","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.107:6827/3638073096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3638073096},{"type":"v1","addr":"172.21.15.107:6827","nonce":3638073096}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T08:13:55.717 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 30 2024-09-21T08:13:55.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.719+0000 7f403b82c640 1 -- 172.21.15.107:0/1423701384 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f402006e530 msgr2=0x7f40200709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:55.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.719+0000 7f403b82c640 1 --2- 172.21.15.107:0/1423701384 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f402006e530 0x7f40200709e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f40280041d0 tx=0x7f4028009040 comp rx=0 tx=0).stop 2024-09-21T08:13:55.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.719+0000 7f403b82c640 1 -- 172.21.15.107:0/1423701384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40340fd3a0 msgr2=0x7f4034115940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:55.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.719+0000 7f403b82c640 1 --2- 172.21.15.107:0/1423701384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40340fd3a0 0x7f4034115940 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4030003080 tx=0x7f4030009da0 comp rx=0 tx=0).stop 2024-09-21T08:13:55.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.719+0000 7f403b82c640 1 -- 172.21.15.107:0/1423701384 shutdown_connections 2024-09-21T08:13:55.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.719+0000 7f403b82c640 1 --2- 172.21.15.107:0/1423701384 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f402006e530 0x7f40200709e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:55.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.719+0000 7f403b82c640 1 --2- 172.21.15.107:0/1423701384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40340fd3a0 0x7f4034115940 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:55.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.719+0000 7f403b82c640 1 --2- 172.21.15.107:0/1423701384 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40340fac80 0x7f4034115400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:55.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.719+0000 7f403b82c640 1 -- 172.21.15.107:0/1423701384 >> 172.21.15.107:0/1423701384 conn(0x7f4034070ce0 msgr2=0x7f40340f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:55.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.719+0000 7f403b82c640 1 -- 172.21.15.107:0/1423701384 shutdown_connections 2024-09-21T08:13:55.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:55.719+0000 7f403b82c640 1 -- 172.21.15.107:0/1423701384 wait complete. 2024-09-21T08:13:56.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:55 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/1423701384' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-21T08:13:56.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:55 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/1423701384' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-21T08:13:56.375 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 31 2024-09-21T08:13:56.618 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:13:57.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:56 smithi107 ceph-mon[97757]: pgmap v287: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:57.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:56 smithi129 ceph-mon[76722]: pgmap v287: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:58.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.229+0000 7ff26af28640 1 -- 172.21.15.107:0/3063666772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2640fb480 msgr2=0x7ff2640fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:58.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.229+0000 7ff26af28640 1 --2- 172.21.15.107:0/3063666772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2640fb480 0x7ff2640fb8f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff254009c50 tx=0x7ff254004d10 comp rx=0 tx=0).stop 2024-09-21T08:13:58.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.229+0000 7ff26af28640 1 -- 172.21.15.107:0/3063666772 shutdown_connections 2024-09-21T08:13:58.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.229+0000 7ff26af28640 1 --2- 172.21.15.107:0/3063666772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2640fb480 0x7ff2640fb8f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:58.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.229+0000 7ff26af28640 1 --2- 172.21.15.107:0/3063666772 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2641014c0 0x7ff264101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:58.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.229+0000 7ff26af28640 1 -- 172.21.15.107:0/3063666772 >> 172.21.15.107:0/3063666772 conn(0x7ff2640f7000 msgr2=0x7ff2640f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:58.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.229+0000 7ff26af28640 1 -- 172.21.15.107:0/3063666772 shutdown_connections 2024-09-21T08:13:58.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.229+0000 7ff26af28640 1 -- 172.21.15.107:0/3063666772 wait complete. 2024-09-21T08:13:58.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.230+0000 7ff26af28640 1 Processor -- start 2024-09-21T08:13:58.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.230+0000 7ff26af28640 1 -- start start 2024-09-21T08:13:58.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.230+0000 7ff26af28640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2640fb480 0x7ff264112150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:58.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.230+0000 7ff26af28640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2641014c0 0x7ff264112690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:58.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.230+0000 7ff26af28640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff264112d20 con 0x7ff2640fb480 2024-09-21T08:13:58.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.230+0000 7ff26af28640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26410c0d0 con 0x7ff2641014c0 2024-09-21T08:13:58.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.230+0000 7ff268cc4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2640fb480 0x7ff264112150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:58.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.230+0000 7ff268cc4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2640fb480 0x7ff264112150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50868/0 (socket says 172.21.15.107:50868) 2024-09-21T08:13:58.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.230+0000 7ff268cc4640 1 -- 172.21.15.107:0/3911953865 learned_addr learned my addr 172.21.15.107:0/3911953865 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:13:58.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.230+0000 7ff263fff640 1 --2- 172.21.15.107:0/3911953865 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2641014c0 0x7ff264112690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:58.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.230+0000 7ff268cc4640 1 -- 172.21.15.107:0/3911953865 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2641014c0 msgr2=0x7ff264112690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:58.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.230+0000 7ff268cc4640 1 --2- 172.21.15.107:0/3911953865 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2641014c0 0x7ff264112690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:58.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.230+0000 7ff268cc4640 1 -- 172.21.15.107:0/3911953865 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2540098b0 con 0x7ff2640fb480 2024-09-21T08:13:58.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.231+0000 7ff268cc4640 1 --2- 172.21.15.107:0/3911953865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2640fb480 0x7ff264112150 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00b790 tx=0x7ff25c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.231+0000 7ff2617fa640 1 -- 172.21.15.107:0/3911953865 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff25c00c700 con 0x7ff2640fb480 2024-09-21T08:13:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.231+0000 7ff2617fa640 1 -- 172.21.15.107:0/3911953865 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff25c00cd00 con 0x7ff2640fb480 2024-09-21T08:13:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.231+0000 7ff26af28640 1 -- 172.21.15.107:0/3911953865 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26410c3b0 con 0x7ff2640fb480 2024-09-21T08:13:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.231+0000 7ff2617fa640 1 -- 172.21.15.107:0/3911953865 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff25c015e70 con 0x7ff2640fb480 2024-09-21T08:13:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.231+0000 7ff26af28640 1 -- 172.21.15.107:0/3911953865 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26410c8a0 con 0x7ff2640fb480 2024-09-21T08:13:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.232+0000 7ff26af28640 1 -- 172.21.15.107:0/3911953865 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2640fcbc0 con 0x7ff2640fb480 2024-09-21T08:13:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.232+0000 7ff2617fa640 1 -- 172.21.15.107:0/3911953865 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff25c012070 con 0x7ff2640fb480 2024-09-21T08:13:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.233+0000 7ff2617fa640 1 --2- 172.21.15.107:0/3911953865 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff25006e530 0x7ff2500709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.233+0000 7ff2617fa640 1 -- 172.21.15.107:0/3911953865 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7ff25c08dec0 con 0x7ff2640fb480 2024-09-21T08:13:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.233+0000 7ff263fff640 1 --2- 172.21.15.107:0/3911953865 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff25006e530 0x7ff2500709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.233+0000 7ff263fff640 1 --2- 172.21.15.107:0/3911953865 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff25006e530 0x7ff2500709e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff2640f7440 tx=0x7ff254004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.237+0000 7ff2617fa640 1 -- 172.21.15.107:0/3911953865 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff25c056e30 con 0x7ff2640fb480 2024-09-21T08:13:58.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.439+0000 7ff26af28640 1 -- 172.21.15.107:0/3911953865 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7ff26404b7b0 con 0x7ff2640fb480 2024-09-21T08:13:58.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.440+0000 7ff2617fa640 1 -- 172.21.15.107:0/3911953865 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v35) v1 ==== 107+0+4405 (secure 0 0 0) 0x7ff25c05a4f0 con 0x7ff2640fb480 2024-09-21T08:13:58.441 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:13:58.442 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":31,"btime":"2024-09-21T08:11:18:718356+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34402,"name":"cephfs.smithi107.grqzkt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6829/1321345266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1321345266},{"type":"v1","addr":"172.21.15.107:6829","nonce":1321345266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44319,"name":"cephfs.smithi129.fwmfcy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6825/4074709540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":4074709540},{"type":"v1","addr":"172.21.15.129:6825","nonce":4074709540}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:11:18.311268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi107.qusoyf","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":17,"addr":"172.21.15.107:6827/3638073096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3638073096},{"type":"v1","addr":"172.21.15.107:6827","nonce":3638073096}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T08:13:58.442 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 31 2024-09-21T08:13:58.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.442+0000 7ff26af28640 1 -- 172.21.15.107:0/3911953865 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff25006e530 msgr2=0x7ff2500709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:58.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.442+0000 7ff26af28640 1 --2- 172.21.15.107:0/3911953865 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff25006e530 0x7ff2500709e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff2640f7440 tx=0x7ff254004d10 comp rx=0 tx=0).stop 2024-09-21T08:13:58.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.442+0000 7ff26af28640 1 -- 172.21.15.107:0/3911953865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2640fb480 msgr2=0x7ff264112150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:58.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.442+0000 7ff26af28640 1 --2- 172.21.15.107:0/3911953865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2640fb480 0x7ff264112150 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00b790 tx=0x7ff25c0091d0 comp rx=0 tx=0).stop 2024-09-21T08:13:58.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.442+0000 7ff26af28640 1 -- 172.21.15.107:0/3911953865 shutdown_connections 2024-09-21T08:13:58.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.442+0000 7ff26af28640 1 --2- 172.21.15.107:0/3911953865 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7ff25006e530 0x7ff2500709e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:58.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.442+0000 7ff26af28640 1 --2- 172.21.15.107:0/3911953865 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2641014c0 0x7ff264112690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:58.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.442+0000 7ff26af28640 1 --2- 172.21.15.107:0/3911953865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2640fb480 0x7ff264112150 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:58.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.442+0000 7ff26af28640 1 -- 172.21.15.107:0/3911953865 >> 172.21.15.107:0/3911953865 conn(0x7ff2640f7000 msgr2=0x7ff2640f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:58.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.442+0000 7ff26af28640 1 -- 172.21.15.107:0/3911953865 shutdown_connections 2024-09-21T08:13:58.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:13:58.442+0000 7ff26af28640 1 -- 172.21.15.107:0/3911953865 wait complete. 2024-09-21T08:13:59.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:58 smithi107 ceph-mon[97757]: pgmap v288: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:59.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:58 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/3911953865' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-21T08:13:59.116 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 32 2024-09-21T08:13:59.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:58 smithi129 ceph-mon[76722]: pgmap v288: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:13:59.267 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:58 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/3911953865' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-21T08:13:59.362 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:14:00.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:13:59 smithi107 ceph-mon[97757]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:14:00.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:13:59 smithi129 ceph-mon[76722]: from='mgr.34102 172.21.15.107:0/1244948195' entity='mgr.smithi107.wzulxb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T08:14:00.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.963+0000 7f9e8c365640 1 -- 172.21.15.107:0/1746004076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e84102530 msgr2=0x7f9e84102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:00.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.963+0000 7f9e8c365640 1 --2- 172.21.15.107:0/1746004076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e84102530 0x7f9e84102900 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9e800048d0 tx=0x7f9e80009da0 comp rx=0 tx=0).stop 2024-09-21T08:14:00.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.963+0000 7f9e8c365640 1 -- 172.21.15.107:0/1746004076 shutdown_connections 2024-09-21T08:14:00.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.963+0000 7f9e8c365640 1 --2- 172.21.15.107:0/1746004076 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9e84102ed0 0x7f9e840fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:00.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.963+0000 7f9e8c365640 1 --2- 172.21.15.107:0/1746004076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e84102530 0x7f9e84102900 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:00.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.963+0000 7f9e8c365640 1 -- 172.21.15.107:0/1746004076 >> 172.21.15.107:0/1746004076 conn(0x7f9e840f80f0 msgr2=0x7f9e840fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:00.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.963+0000 7f9e8c365640 1 -- 172.21.15.107:0/1746004076 shutdown_connections 2024-09-21T08:14:00.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.963+0000 7f9e8c365640 1 -- 172.21.15.107:0/1746004076 wait complete. 2024-09-21T08:14:00.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.964+0000 7f9e8c365640 1 Processor -- start 2024-09-21T08:14:00.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.964+0000 7f9e8c365640 1 -- start start 2024-09-21T08:14:00.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.964+0000 7f9e8c365640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e84102530 0x7f9e84113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:00.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.964+0000 7f9e8c365640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9e84102ed0 0x7f9e84113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:00.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.964+0000 7f9e8c365640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e84113d80 con 0x7f9e84102530 2024-09-21T08:14:00.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.964+0000 7f9e8c365640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8410d1c0 con 0x7f9e84102ed0 2024-09-21T08:14:00.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.964+0000 7f9e8a101640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e84102530 0x7f9e84113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:00.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.964+0000 7f9e8a101640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e84102530 0x7f9e84113240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50886/0 (socket says 172.21.15.107:50886) 2024-09-21T08:14:00.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.964+0000 7f9e8a101640 1 -- 172.21.15.107:0/1763828774 learned_addr learned my addr 172.21.15.107:0/1763828774 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:14:00.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.964+0000 7f9e8a101640 1 -- 172.21.15.107:0/1763828774 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9e84102ed0 msgr2=0x7f9e84113780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:00.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.964+0000 7f9e89900640 1 --2- 172.21.15.107:0/1763828774 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9e84102ed0 0x7f9e84113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:00.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.964+0000 7f9e8a101640 1 --2- 172.21.15.107:0/1763828774 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9e84102ed0 0x7f9e84113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:00.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.964+0000 7f9e8a101640 1 -- 172.21.15.107:0/1763828774 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e80005040 con 0x7f9e84102530 2024-09-21T08:14:00.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.964+0000 7f9e8a101640 1 --2- 172.21.15.107:0/1763828774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e84102530 0x7f9e84113240 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9e80000c00 tx=0x7f9e80009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:00.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.965+0000 7f9e76ffd640 1 -- 172.21.15.107:0/1763828774 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e80038070 con 0x7f9e84102530 2024-09-21T08:14:00.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.965+0000 7f9e76ffd640 1 -- 172.21.15.107:0/1763828774 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9e8002ade0 con 0x7f9e84102530 2024-09-21T08:14:00.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.965+0000 7f9e8c365640 1 -- 172.21.15.107:0/1763828774 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8410d440 con 0x7f9e84102530 2024-09-21T08:14:00.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.965+0000 7f9e76ffd640 1 -- 172.21.15.107:0/1763828774 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e8002c7e0 con 0x7f9e84102530 2024-09-21T08:14:00.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.965+0000 7f9e8c365640 1 -- 172.21.15.107:0/1763828774 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8410d980 con 0x7f9e84102530 2024-09-21T08:14:00.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.966+0000 7f9e8c365640 1 -- 172.21.15.107:0/1763828774 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e840fdcb0 con 0x7f9e84102530 2024-09-21T08:14:00.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.966+0000 7f9e76ffd640 1 -- 172.21.15.107:0/1763828774 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9e80030020 con 0x7f9e84102530 2024-09-21T08:14:00.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.966+0000 7f9e76ffd640 1 --2- 172.21.15.107:0/1763828774 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f9e7006e530 0x7f9e700709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:00.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.967+0000 7f9e76ffd640 1 -- 172.21.15.107:0/1763828774 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f9e800adf70 con 0x7f9e84102530 2024-09-21T08:14:00.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.967+0000 7f9e89900640 1 --2- 172.21.15.107:0/1763828774 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f9e7006e530 0x7f9e700709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:00.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.967+0000 7f9e89900640 1 --2- 172.21.15.107:0/1763828774 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f9e7006e530 0x7f9e700709e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9e8410eb00 tx=0x7f9e7800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:00.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:00.972+0000 7f9e76ffd640 1 -- 172.21.15.107:0/1763828774 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9e800e3210 con 0x7f9e84102530 2024-09-21T08:14:01.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:14:00 smithi107 ceph-mon[97757]: pgmap v289: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:14:01.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:01.179+0000 7f9e8c365640 1 -- 172.21.15.107:0/1763828774 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f9e840fbd30 con 0x7f9e84102530 2024-09-21T08:14:01.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:01.180+0000 7f9e76ffd640 1 -- 172.21.15.107:0/1763828774 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v35) v1 ==== 107+0+4402 (secure 0 0 0) 0x7f9e80076f90 con 0x7f9e84102530 2024-09-21T08:14:01.182 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:14:01.182 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":32,"btime":"2024-09-21T08:11:19:724317+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34402,"name":"cephfs.smithi107.grqzkt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6829/1321345266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1321345266},{"type":"v1","addr":"172.21.15.107:6829","nonce":1321345266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44319,"name":"cephfs.smithi129.fwmfcy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6825/4074709540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":4074709540},{"type":"v1","addr":"172.21.15.129:6825","nonce":4074709540}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:11:18.725918+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi107.qusoyf","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":18,"addr":"172.21.15.107:6827/3638073096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3638073096},{"type":"v1","addr":"172.21.15.107:6827","nonce":3638073096}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T08:14:01.182 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 32 2024-09-21T08:14:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:01.182+0000 7f9e8c365640 1 -- 172.21.15.107:0/1763828774 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f9e7006e530 msgr2=0x7f9e700709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:01.182+0000 7f9e8c365640 1 --2- 172.21.15.107:0/1763828774 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f9e7006e530 0x7f9e700709e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9e8410eb00 tx=0x7f9e7800b040 comp rx=0 tx=0).stop 2024-09-21T08:14:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:01.182+0000 7f9e8c365640 1 -- 172.21.15.107:0/1763828774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e84102530 msgr2=0x7f9e84113240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:01.182+0000 7f9e8c365640 1 --2- 172.21.15.107:0/1763828774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e84102530 0x7f9e84113240 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9e80000c00 tx=0x7f9e80009da0 comp rx=0 tx=0).stop 2024-09-21T08:14:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:01.182+0000 7f9e8c365640 1 -- 172.21.15.107:0/1763828774 shutdown_connections 2024-09-21T08:14:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:01.182+0000 7f9e8c365640 1 --2- 172.21.15.107:0/1763828774 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f9e7006e530 0x7f9e700709e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:01.182+0000 7f9e8c365640 1 --2- 172.21.15.107:0/1763828774 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9e84102ed0 0x7f9e84113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:01.182+0000 7f9e8c365640 1 --2- 172.21.15.107:0/1763828774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e84102530 0x7f9e84113240 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:01.182+0000 7f9e8c365640 1 -- 172.21.15.107:0/1763828774 >> 172.21.15.107:0/1763828774 conn(0x7f9e840f80f0 msgr2=0x7f9e840f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:01.183+0000 7f9e8c365640 1 -- 172.21.15.107:0/1763828774 shutdown_connections 2024-09-21T08:14:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:01.183+0000 7f9e8c365640 1 -- 172.21.15.107:0/1763828774 wait complete. 2024-09-21T08:14:01.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:14:00 smithi129 ceph-mon[76722]: pgmap v289: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:14:01.859 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 33 2024-09-21T08:14:02.110 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:14:02.231 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:14:01 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/1763828774' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-21T08:14:02.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:14:01 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/1763828774' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-21T08:14:03.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:14:02 smithi129 ceph-mon[76722]: pgmap v290: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:14:03.274 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:14:02 smithi107 ceph-mon[97757]: pgmap v290: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:14:03.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.762+0000 7fb52d554640 1 -- 172.21.15.107:0/3245916321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb528102530 msgr2=0x7fb528102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.762+0000 7fb52d554640 1 --2- 172.21.15.107:0/3245916321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb528102530 0x7fb528102900 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb5180048d0 tx=0x7fb518009da0 comp rx=0 tx=0).stop 2024-09-21T08:14:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.762+0000 7fb52d554640 1 -- 172.21.15.107:0/3245916321 shutdown_connections 2024-09-21T08:14:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.762+0000 7fb52d554640 1 --2- 172.21.15.107:0/3245916321 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb528102ed0 0x7fb5280fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.762+0000 7fb52d554640 1 --2- 172.21.15.107:0/3245916321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb528102530 0x7fb528102900 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.762+0000 7fb52d554640 1 -- 172.21.15.107:0/3245916321 >> 172.21.15.107:0/3245916321 conn(0x7fb5280f8110 msgr2=0x7fb5280fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.763+0000 7fb52d554640 1 -- 172.21.15.107:0/3245916321 shutdown_connections 2024-09-21T08:14:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.763+0000 7fb52d554640 1 -- 172.21.15.107:0/3245916321 wait complete. 2024-09-21T08:14:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.763+0000 7fb52d554640 1 Processor -- start 2024-09-21T08:14:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.763+0000 7fb52d554640 1 -- start start 2024-09-21T08:14:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.763+0000 7fb52d554640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb528102530 0x7fb528113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.763+0000 7fb52d554640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb528102ed0 0x7fb5281137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.763+0000 7fb52d554640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb528113e40 con 0x7fb528102530 2024-09-21T08:14:03.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.763+0000 7fb52d554640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52810d1f0 con 0x7fb528102ed0 2024-09-21T08:14:03.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.763+0000 7fb526ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb528102530 0x7fb528113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:03.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.764+0000 7fb526ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb528102530 0x7fb528113270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39458/0 (socket says 172.21.15.107:39458) 2024-09-21T08:14:03.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.764+0000 7fb526ffd640 1 -- 172.21.15.107:0/3274699135 learned_addr learned my addr 172.21.15.107:0/3274699135 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:14:03.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.764+0000 7fb51e7fc640 1 --2- 172.21.15.107:0/3274699135 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb528102ed0 0x7fb5281137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:03.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.764+0000 7fb526ffd640 1 -- 172.21.15.107:0/3274699135 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb528102ed0 msgr2=0x7fb5281137b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:03.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.764+0000 7fb526ffd640 1 --2- 172.21.15.107:0/3274699135 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb528102ed0 0x7fb5281137b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:03.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.764+0000 7fb526ffd640 1 -- 172.21.15.107:0/3274699135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb518005040 con 0x7fb528102530 2024-09-21T08:14:03.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.764+0000 7fb526ffd640 1 --2- 172.21.15.107:0/3274699135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb528102530 0x7fb528113270 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb518000c00 tx=0x7fb518009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:03.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.764+0000 7fb51ffff640 1 -- 172.21.15.107:0/3274699135 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb518038070 con 0x7fb528102530 2024-09-21T08:14:03.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.764+0000 7fb51ffff640 1 -- 172.21.15.107:0/3274699135 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb518033ad0 con 0x7fb528102530 2024-09-21T08:14:03.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.764+0000 7fb51ffff640 1 -- 172.21.15.107:0/3274699135 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb51803db70 con 0x7fb528102530 2024-09-21T08:14:03.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.764+0000 7fb52d554640 1 -- 172.21.15.107:0/3274699135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb52810d470 con 0x7fb528102530 2024-09-21T08:14:03.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.764+0000 7fb52d554640 1 -- 172.21.15.107:0/3274699135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb52810d990 con 0x7fb528102530 2024-09-21T08:14:03.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.765+0000 7fb52d554640 1 -- 172.21.15.107:0/3274699135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5280fdcb0 con 0x7fb528102530 2024-09-21T08:14:03.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.766+0000 7fb51ffff640 1 -- 172.21.15.107:0/3274699135 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb518030020 con 0x7fb528102530 2024-09-21T08:14:03.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.766+0000 7fb51ffff640 1 --2- 172.21.15.107:0/3274699135 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb51406e530 0x7fb5140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:03.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.766+0000 7fb51ffff640 1 -- 172.21.15.107:0/3274699135 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7fb5180ae520 con 0x7fb528102530 2024-09-21T08:14:03.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.766+0000 7fb51e7fc640 1 --2- 172.21.15.107:0/3274699135 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb51406e530 0x7fb5140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:03.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.767+0000 7fb51e7fc640 1 --2- 172.21.15.107:0/3274699135 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb51406e530 0x7fb5140709e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb510006fd0 tx=0x7fb510008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:03.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.771+0000 7fb51ffff640 1 -- 172.21.15.107:0/3274699135 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb5180774b0 con 0x7fb528102530 2024-09-21T08:14:03.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.971+0000 7fb52d554640 1 -- 172.21.15.107:0/3274699135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7fb52804b780 con 0x7fb528102530 2024-09-21T08:14:03.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.972+0000 7fb51ffff640 1 -- 172.21.15.107:0/3274699135 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v35) v1 ==== 107+0+4411 (secure 0 0 0) 0x7fb51807ab70 con 0x7fb528102530 2024-09-21T08:14:03.973 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:14:03.973 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":33,"btime":"2024-09-21T08:11:20:729924+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34402,"name":"cephfs.smithi107.grqzkt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6829/1321345266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1321345266},{"type":"v1","addr":"172.21.15.107:6829","nonce":1321345266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44319,"name":"cephfs.smithi129.fwmfcy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6825/4074709540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":4074709540},{"type":"v1","addr":"172.21.15.129:6825","nonce":4074709540}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:11:20.729920+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi107.qusoyf","rank":0,"incarnation":30,"state":"up:active","state_seq":19,"addr":"172.21.15.107:6827/3638073096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3638073096},{"type":"v1","addr":"172.21.15.107:6827","nonce":3638073096}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34378,"qdb_cluster":[34378]},"id":1}]} 2024-09-21T08:14:03.973 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 33 2024-09-21T08:14:03.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.974+0000 7fb52d554640 1 -- 172.21.15.107:0/3274699135 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb51406e530 msgr2=0x7fb5140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:03.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.974+0000 7fb52d554640 1 --2- 172.21.15.107:0/3274699135 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb51406e530 0x7fb5140709e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb510006fd0 tx=0x7fb510008040 comp rx=0 tx=0).stop 2024-09-21T08:14:03.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.974+0000 7fb52d554640 1 -- 172.21.15.107:0/3274699135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb528102530 msgr2=0x7fb528113270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:03.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.974+0000 7fb52d554640 1 --2- 172.21.15.107:0/3274699135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb528102530 0x7fb528113270 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb518000c00 tx=0x7fb518009da0 comp rx=0 tx=0).stop 2024-09-21T08:14:03.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.974+0000 7fb52d554640 1 -- 172.21.15.107:0/3274699135 shutdown_connections 2024-09-21T08:14:03.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.974+0000 7fb52d554640 1 --2- 172.21.15.107:0/3274699135 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7fb51406e530 0x7fb5140709e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:03.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.974+0000 7fb52d554640 1 --2- 172.21.15.107:0/3274699135 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb528102ed0 0x7fb5281137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:03.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.974+0000 7fb52d554640 1 --2- 172.21.15.107:0/3274699135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb528102530 0x7fb528113270 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:03.976 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.974+0000 7fb52d554640 1 -- 172.21.15.107:0/3274699135 >> 172.21.15.107:0/3274699135 conn(0x7fb5280f8110 msgr2=0x7fb5280f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:03.976 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.974+0000 7fb52d554640 1 -- 172.21.15.107:0/3274699135 shutdown_connections 2024-09-21T08:14:03.976 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:03.974+0000 7fb52d554640 1 -- 172.21.15.107:0/3274699135 wait complete. 2024-09-21T08:14:04.647 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 34 2024-09-21T08:14:04.899 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:14:05.019 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:14:04 smithi107 ceph-mon[97757]: pgmap v291: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:14:05.020 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:14:04 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/3274699135' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-21T08:14:05.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:14:04 smithi129 ceph-mon[76722]: pgmap v291: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:14:05.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:14:04 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/3274699135' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-21T08:14:06.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.459+0000 7f8508543640 1 -- 172.21.15.107:0/3963995188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85000fe460 msgr2=0x7f85000fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:06.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.459+0000 7f8508543640 1 --2- 172.21.15.107:0/3963995188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85000fe460 0x7f85000fe830 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009c50 tx=0x7f84f0004d10 comp rx=0 tx=0).stop 2024-09-21T08:14:06.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.459+0000 7f8508543640 1 -- 172.21.15.107:0/3963995188 shutdown_connections 2024-09-21T08:14:06.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.459+0000 7f8508543640 1 --2- 172.21.15.107:0/3963995188 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8500064fc0 0x7f8500065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:06.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.459+0000 7f8508543640 1 --2- 172.21.15.107:0/3963995188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85000fe460 0x7f85000fe830 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:06.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.459+0000 7f8508543640 1 -- 172.21.15.107:0/3963995188 >> 172.21.15.107:0/3963995188 conn(0x7f85000723b0 msgr2=0x7f85000727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:06.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.459+0000 7f8508543640 1 -- 172.21.15.107:0/3963995188 shutdown_connections 2024-09-21T08:14:06.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.459+0000 7f8508543640 1 -- 172.21.15.107:0/3963995188 wait complete. 2024-09-21T08:14:06.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.460+0000 7f8508543640 1 Processor -- start 2024-09-21T08:14:06.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.460+0000 7f8508543640 1 -- start start 2024-09-21T08:14:06.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.460+0000 7f8508543640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8500064fc0 0x7f85001131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:06.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.460+0000 7f8508543640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f85000fe460 0x7f85001136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:06.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.460+0000 7f8508543640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8500113cf0 con 0x7f8500064fc0 2024-09-21T08:14:06.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.460+0000 7f8508543640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850010d130 con 0x7f85000fe460 2024-09-21T08:14:06.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.460+0000 7f85062df640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8500064fc0 0x7f85001131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:06.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.460+0000 7f85062df640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8500064fc0 0x7f85001131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39480/0 (socket says 172.21.15.107:39480) 2024-09-21T08:14:06.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.460+0000 7f85062df640 1 -- 172.21.15.107:0/2402209903 learned_addr learned my addr 172.21.15.107:0/2402209903 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:14:06.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.460+0000 7f8505ade640 1 --2- 172.21.15.107:0/2402209903 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f85000fe460 0x7f85001136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:06.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.460+0000 7f85062df640 1 -- 172.21.15.107:0/2402209903 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f85000fe460 msgr2=0x7f85001136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:06.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.460+0000 7f85062df640 1 --2- 172.21.15.107:0/2402209903 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f85000fe460 0x7f85001136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:06.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.460+0000 7f85062df640 1 -- 172.21.15.107:0/2402209903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f00098b0 con 0x7f8500064fc0 2024-09-21T08:14:06.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.460+0000 7f8505ade640 1 --2- 172.21.15.107:0/2402209903 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f85000fe460 0x7f85001136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:14:06.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.460+0000 7f85062df640 1 --2- 172.21.15.107:0/2402209903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8500064fc0 0x7f85001131b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f84f0004a30 tx=0x7f84f0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:06.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.461+0000 7f84feffd640 1 -- 172.21.15.107:0/2402209903 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84f0009690 con 0x7f8500064fc0 2024-09-21T08:14:06.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.461+0000 7f8508543640 1 -- 172.21.15.107:0/2402209903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850010d3b0 con 0x7f8500064fc0 2024-09-21T08:14:06.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.461+0000 7f84feffd640 1 -- 172.21.15.107:0/2402209903 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f84f0032b10 con 0x7f8500064fc0 2024-09-21T08:14:06.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.461+0000 7f84feffd640 1 -- 172.21.15.107:0/2402209903 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84f003daa0 con 0x7f8500064fc0 2024-09-21T08:14:06.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.461+0000 7f8508543640 1 -- 172.21.15.107:0/2402209903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850010d950 con 0x7f8500064fc0 2024-09-21T08:14:06.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.462+0000 7f8508543640 1 -- 172.21.15.107:0/2402209903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85000fdcf0 con 0x7f8500064fc0 2024-09-21T08:14:06.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.462+0000 7f84feffd640 1 -- 172.21.15.107:0/2402209903 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f84f002f030 con 0x7f8500064fc0 2024-09-21T08:14:06.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.463+0000 7f84feffd640 1 --2- 172.21.15.107:0/2402209903 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f84e806e530 0x7f84e80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:06.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.463+0000 7f84feffd640 1 -- 172.21.15.107:0/2402209903 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f84f00af450 con 0x7f8500064fc0 2024-09-21T08:14:06.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.463+0000 7f8505ade640 1 --2- 172.21.15.107:0/2402209903 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f84e806e530 0x7f84e80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:06.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.463+0000 7f8505ade640 1 --2- 172.21.15.107:0/2402209903 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f84e806e530 0x7f84e80709e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f850010ea70 tx=0x7f84f4009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:06.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.467+0000 7f84feffd640 1 -- 172.21.15.107:0/2402209903 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f84f00783c0 con 0x7f8500064fc0 2024-09-21T08:14:06.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.668+0000 7f8508543640 1 -- 172.21.15.107:0/2402209903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f850004b720 con 0x7f8500064fc0 2024-09-21T08:14:06.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.669+0000 7f84feffd640 1 -- 172.21.15.107:0/2402209903 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v35) v1 ==== 107+0+5261 (secure 0 0 0) 0x7f84f007ba80 con 0x7f8500064fc0 2024-09-21T08:14:06.671 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-21T08:14:06.671 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":34,"btime":"2024-09-21T08:11:21:741434+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34402,"name":"cephfs.smithi107.grqzkt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6829/1321345266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1321345266},{"type":"v1","addr":"172.21.15.107:6829","nonce":1321345266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44319,"name":"cephfs.smithi129.fwmfcy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6825/4074709540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":4074709540},{"type":"v1","addr":"172.21.15.129:6825","nonce":4074709540}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44343,"name":"cephfs.smithi129.belyba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6827/3676932805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3676932805},{"type":"v1","addr":"172.21.15.129:6827","nonce":3676932805}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T08:00:03.244314+0000","modified":"2024-09-21T08:11:20.729920+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi107.qusoyf","rank":0,"incarnation":30,"state":"up:active","state_seq":19,"addr":"172.21.15.107:6827/3638073096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3638073096},{"type":"v1","addr":"172.21.15.107:6827","nonce":3638073096}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34378,"qdb_cluster":[34378]},"id":1}]} 2024-09-21T08:14:06.671 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 34 2024-09-21T08:14:06.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.671+0000 7f8508543640 1 -- 172.21.15.107:0/2402209903 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f84e806e530 msgr2=0x7f84e80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:06.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.671+0000 7f8508543640 1 --2- 172.21.15.107:0/2402209903 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f84e806e530 0x7f84e80709e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f850010ea70 tx=0x7f84f4009040 comp rx=0 tx=0).stop 2024-09-21T08:14:06.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.671+0000 7f8508543640 1 -- 172.21.15.107:0/2402209903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8500064fc0 msgr2=0x7f85001131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:06.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.671+0000 7f8508543640 1 --2- 172.21.15.107:0/2402209903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8500064fc0 0x7f85001131b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f84f0004a30 tx=0x7f84f0004d10 comp rx=0 tx=0).stop 2024-09-21T08:14:06.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.671+0000 7f8508543640 1 -- 172.21.15.107:0/2402209903 shutdown_connections 2024-09-21T08:14:06.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.671+0000 7f8508543640 1 --2- 172.21.15.107:0/2402209903 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f84e806e530 0x7f84e80709e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:06.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.671+0000 7f8508543640 1 --2- 172.21.15.107:0/2402209903 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f85000fe460 0x7f85001136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:06.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.671+0000 7f8508543640 1 --2- 172.21.15.107:0/2402209903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8500064fc0 0x7f85001131b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:06.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.671+0000 7f8508543640 1 -- 172.21.15.107:0/2402209903 >> 172.21.15.107:0/2402209903 conn(0x7f85000723b0 msgr2=0x7f8500105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:06.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.672+0000 7f8508543640 1 -- 172.21.15.107:0/2402209903 shutdown_connections 2024-09-21T08:14:06.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:06.672+0000 7f8508543640 1 -- 172.21.15.107:0/2402209903 wait complete. 2024-09-21T08:14:07.043 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:14:06 smithi107 ceph-mon[97757]: pgmap v292: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:14:07.043 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:14:06 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/2402209903' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-21T08:14:07.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:14:06 smithi129 ceph-mon[76722]: pgmap v292: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:14:07.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:14:06 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/2402209903' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-21T08:14:07.381 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T08:14:07.391 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T08:14:07.391 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-21T08:14:07.391 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T08:14:07.409 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-21T08:14:07.409 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T08:14:07.465 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph osd blocklist ls 2024-09-21T08:14:07.747 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:14:09.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:14:08 smithi107 ceph-mon[97757]: pgmap v293: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:14:09.068 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:14:08 smithi129 ceph-mon[76722]: pgmap v293: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:14:09.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.279+0000 7f19156bf640 1 -- 172.21.15.107:0/3482318960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1910064fc0 msgr2=0x7f1910065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:09.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.279+0000 7f19156bf640 1 --2- 172.21.15.107:0/3482318960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1910064fc0 0x7f1910065430 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f19040048d0 tx=0x7f1904009da0 comp rx=0 tx=0).stop 2024-09-21T08:14:09.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.279+0000 7f19156bf640 1 -- 172.21.15.107:0/3482318960 shutdown_connections 2024-09-21T08:14:09.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.279+0000 7f19156bf640 1 --2- 172.21.15.107:0/3482318960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1910064fc0 0x7f1910065430 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:09.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.279+0000 7f19156bf640 1 --2- 172.21.15.107:0/3482318960 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19100fe460 0x7f19100fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:09.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.279+0000 7f19156bf640 1 -- 172.21.15.107:0/3482318960 >> 172.21.15.107:0/3482318960 conn(0x7f19100723b0 msgr2=0x7f19100727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:09.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.279+0000 7f19156bf640 1 -- 172.21.15.107:0/3482318960 shutdown_connections 2024-09-21T08:14:09.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.279+0000 7f19156bf640 1 -- 172.21.15.107:0/3482318960 wait complete. 2024-09-21T08:14:09.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.279+0000 7f19156bf640 1 Processor -- start 2024-09-21T08:14:09.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.280+0000 7f19156bf640 1 -- start start 2024-09-21T08:14:09.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.280+0000 7f19156bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1910064fc0 0x7f19101131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:09.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.280+0000 7f19156bf640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19100fe460 0x7f19101136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:09.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.280+0000 7f19156bf640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1910113cf0 con 0x7f1910064fc0 2024-09-21T08:14:09.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.280+0000 7f19156bf640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191010d180 con 0x7f19100fe460 2024-09-21T08:14:09.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.280+0000 7f190effd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1910064fc0 0x7f19101131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:09.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.280+0000 7f190effd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1910064fc0 0x7f19101131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39486/0 (socket says 172.21.15.107:39486) 2024-09-21T08:14:09.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.280+0000 7f190effd640 1 -- 172.21.15.107:0/2096264588 learned_addr learned my addr 172.21.15.107:0/2096264588 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:14:09.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.280+0000 7f190e7fc640 1 --2- 172.21.15.107:0/2096264588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19100fe460 0x7f19101136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:09.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.280+0000 7f190effd640 1 -- 172.21.15.107:0/2096264588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19100fe460 msgr2=0x7f19101136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:09.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.280+0000 7f190effd640 1 --2- 172.21.15.107:0/2096264588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19100fe460 0x7f19101136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:09.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.280+0000 7f190effd640 1 -- 172.21.15.107:0/2096264588 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1904005040 con 0x7f1910064fc0 2024-09-21T08:14:09.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.280+0000 7f190effd640 1 --2- 172.21.15.107:0/2096264588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1910064fc0 0x7f19101131b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1900002a50 tx=0x7f1900004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:09.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.281+0000 7f18f77fe640 1 -- 172.21.15.107:0/2096264588 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1900007c30 con 0x7f1910064fc0 2024-09-21T08:14:09.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.281+0000 7f18f77fe640 1 -- 172.21.15.107:0/2096264588 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f190000f040 con 0x7f1910064fc0 2024-09-21T08:14:09.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.281+0000 7f19156bf640 1 -- 172.21.15.107:0/2096264588 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191010d460 con 0x7f1910064fc0 2024-09-21T08:14:09.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.281+0000 7f18f77fe640 1 -- 172.21.15.107:0/2096264588 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f190000db50 con 0x7f1910064fc0 2024-09-21T08:14:09.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.281+0000 7f19156bf640 1 -- 172.21.15.107:0/2096264588 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191010da00 con 0x7f1910064fc0 2024-09-21T08:14:09.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.282+0000 7f19156bf640 1 -- 172.21.15.107:0/2096264588 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19100fdcf0 con 0x7f1910064fc0 2024-09-21T08:14:09.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.282+0000 7f18f77fe640 1 -- 172.21.15.107:0/2096264588 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f190000dcb0 con 0x7f1910064fc0 2024-09-21T08:14:09.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.282+0000 7f18f77fe640 1 --2- 172.21.15.107:0/2096264588 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f18f806e530 0x7f18f80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:09.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.283+0000 7f18f77fe640 1 -- 172.21.15.107:0/2096264588 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f190008e290 con 0x7f1910064fc0 2024-09-21T08:14:09.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.283+0000 7f190e7fc640 1 --2- 172.21.15.107:0/2096264588 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f18f806e530 0x7f18f80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:09.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.283+0000 7f190e7fc640 1 --2- 172.21.15.107:0/2096264588 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f18f806e530 0x7f18f80709e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1904009ac0 tx=0x7f1904009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:09.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.287+0000 7f18f77fe640 1 -- 172.21.15.107:0/2096264588 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1900057200 con 0x7f1910064fc0 2024-09-21T08:14:09.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.463+0000 7f19156bf640 1 -- 172.21.15.107:0/2096264588 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f191004b7a0 con 0x7f1910064fc0 2024-09-21T08:14:09.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.464+0000 7f18f77fe640 1 -- 172.21.15.107:0/2096264588 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v93) v1 ==== 81+0+2469 (secure 0 0 0) 0x7f191004b7a0 con 0x7f1910064fc0 2024-09-21T08:14:09.465 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.129:6825/694369363 2024-09-22T08:10:49.994832+0000 2024-09-21T08:14:09.466 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.129:6824/694369363 2024-09-22T08:10:49.994832+0000 2024-09-21T08:14:09.466 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6828/3876219633 2024-09-22T08:10:29.960359+0000 2024-09-21T08:14:09.466 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/695383021 2024-09-22T08:05:59.575118+0000 2024-09-21T08:14:09.466 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/695383021 2024-09-22T08:05:59.575118+0000 2024-09-21T08:14:09.466 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/1427193363 2024-09-22T08:05:59.575118+0000 2024-09-21T08:14:09.466 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/1963754761 2024-09-22T08:05:59.575118+0000 2024-09-21T08:14:09.466 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/3208118716 2024-09-22T08:05:59.575118+0000 2024-09-21T08:14:09.466 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/4136397866 2024-09-22T07:54:24.297241+0000 2024-09-21T08:14:09.466 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6829/3876219633 2024-09-22T08:10:29.960359+0000 2024-09-21T08:14:09.466 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/805704025 2024-09-22T07:53:55.453491+0000 2024-09-21T08:14:09.466 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/1232121301 2024-09-22T07:55:24.118876+0000 2024-09-21T08:14:09.466 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.129:6826/3658871735 2024-09-22T08:11:11.043144+0000 2024-09-21T08:14:09.467 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.129:6828/1054385200 2024-09-22T08:04:06.900281+0000 2024-09-21T08:14:09.467 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/3723665882 2024-09-22T08:02:21.390408+0000 2024-09-21T08:14:09.467 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.129:0/3304106006 2024-09-22T08:04:06.900281+0000 2024-09-21T08:14:09.467 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/3831586505 2024-09-22T07:54:24.297241+0000 2024-09-21T08:14:09.467 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/53635306 2024-09-22T08:02:21.390408+0000 2024-09-21T08:14:09.467 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.129:0/1441814819 2024-09-22T08:04:06.900281+0000 2024-09-21T08:14:09.467 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6827/1021587565 2024-09-22T08:00:18.451507+0000 2024-09-21T08:14:09.467 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/287926342 2024-09-22T07:53:55.453491+0000 2024-09-21T08:14:09.467 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.129:6829/1054385200 2024-09-22T08:04:06.900281+0000 2024-09-21T08:14:09.467 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/3328111247 2024-09-22T08:02:21.390408+0000 2024-09-21T08:14:09.467 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/287926342 2024-09-22T07:53:55.453491+0000 2024-09-21T08:14:09.467 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2676703491 2024-09-22T07:53:55.453491+0000 2024-09-21T08:14:09.467 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2976092283 2024-09-22T07:54:24.297241+0000 2024-09-21T08:14:09.467 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/624331303 2024-09-22T08:05:59.575118+0000 2024-09-21T08:14:09.467 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6826/1021587565 2024-09-22T08:00:18.451507+0000 2024-09-21T08:14:09.467 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/3732544930 2024-09-22T07:53:55.453491+0000 2024-09-21T08:14:09.468 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/3875126490 2024-09-22T08:02:21.390408+0000 2024-09-21T08:14:09.468 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.129:0/3248955159 2024-09-22T08:04:06.900281+0000 2024-09-21T08:14:09.468 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/3269113875 2024-09-22T08:02:21.390408+0000 2024-09-21T08:14:09.468 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2314131589 2024-09-22T07:55:24.118876+0000 2024-09-21T08:14:09.468 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/2912640406 2024-09-22T07:54:24.297241+0000 2024-09-21T08:14:09.468 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/2850161381 2024-09-22T07:55:24.118876+0000 2024-09-21T08:14:09.468 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.129:6827/3658871735 2024-09-22T08:11:11.043144+0000 2024-09-21T08:14:09.468 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/2912640406 2024-09-22T07:54:24.297241+0000 2024-09-21T08:14:09.468 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/3723665882 2024-09-22T08:02:21.390408+0000 2024-09-21T08:14:09.468 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/2850161381 2024-09-22T07:55:24.118876+0000 2024-09-21T08:14:09.468 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.129:0/1068905978 2024-09-22T08:04:06.900281+0000 2024-09-21T08:14:09.468 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2498876652 2024-09-22T07:55:24.118876+0000 2024-09-21T08:14:09.469 INFO:teuthology.orchestra.run.smithi107.stderr:listed 41 entries 2024-09-21T08:14:09.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.466+0000 7f19156bf640 1 -- 172.21.15.107:0/2096264588 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f18f806e530 msgr2=0x7f18f80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:09.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.466+0000 7f19156bf640 1 --2- 172.21.15.107:0/2096264588 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f18f806e530 0x7f18f80709e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1904009ac0 tx=0x7f1904009da0 comp rx=0 tx=0).stop 2024-09-21T08:14:09.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.466+0000 7f19156bf640 1 -- 172.21.15.107:0/2096264588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1910064fc0 msgr2=0x7f19101131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:09.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.466+0000 7f19156bf640 1 --2- 172.21.15.107:0/2096264588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1910064fc0 0x7f19101131b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1900002a50 tx=0x7f1900004600 comp rx=0 tx=0).stop 2024-09-21T08:14:09.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.466+0000 7f19156bf640 1 -- 172.21.15.107:0/2096264588 shutdown_connections 2024-09-21T08:14:09.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.466+0000 7f19156bf640 1 --2- 172.21.15.107:0/2096264588 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f18f806e530 0x7f18f80709e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:09.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.466+0000 7f19156bf640 1 --2- 172.21.15.107:0/2096264588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19100fe460 0x7f19101136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:09.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.466+0000 7f19156bf640 1 --2- 172.21.15.107:0/2096264588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1910064fc0 0x7f19101131b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:09.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.466+0000 7f19156bf640 1 -- 172.21.15.107:0/2096264588 >> 172.21.15.107:0/2096264588 conn(0x7f19100723b0 msgr2=0x7f19101053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:09.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.466+0000 7f19156bf640 1 -- 172.21.15.107:0/2096264588 shutdown_connections 2024-09-21T08:14:09.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:09.466+0000 7f19156bf640 1 -- 172.21.15.107:0/2096264588 wait complete. 2024-09-21T08:14:10.095 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:14:09 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/2096264588' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-21T08:14:10.119 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T08:14:10.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:14:10.119 DEBUG:teuthology.orchestra.run.smithi107:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T08:14:10.147 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2024-09-21T08:14:10.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:14:10.147 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T08:14:10.209 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T08:14:10.209 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T08:14:10.230 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T08:14:10.230 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T08:14:10.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:14:09 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/2096264588' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-21T08:14:10.285 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 -- ceph osd blocklist ls 2024-09-21T08:14:10.527 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/mon.smithi107/config 2024-09-21T08:14:10.916 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:14:10 smithi107 ceph-mon[97757]: pgmap v294: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:14:11.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:14:10 smithi129 ceph-mon[76722]: pgmap v294: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail 2024-09-21T08:14:12.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.151+0000 7f1f526fd640 1 -- 172.21.15.107:0/2183842825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f4c1014e0 msgr2=0x7f1f4c1018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:12.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.151+0000 7f1f526fd640 1 --2- 172.21.15.107:0/2183842825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f4c1014e0 0x7f1f4c1018b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0048d0 tx=0x7f1f3c009da0 comp rx=0 tx=0).stop 2024-09-21T08:14:12.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.151+0000 7f1f526fd640 1 -- 172.21.15.107:0/2183842825 shutdown_connections 2024-09-21T08:14:12.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.151+0000 7f1f526fd640 1 --2- 172.21.15.107:0/2183842825 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f4c0fb4a0 0x7f1f4c0fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:12.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.151+0000 7f1f526fd640 1 --2- 172.21.15.107:0/2183842825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f4c1014e0 0x7f1f4c1018b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:12.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.151+0000 7f1f526fd640 1 -- 172.21.15.107:0/2183842825 >> 172.21.15.107:0/2183842825 conn(0x7f1f4c0f7060 msgr2=0x7f1f4c0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:12.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.151+0000 7f1f526fd640 1 -- 172.21.15.107:0/2183842825 shutdown_connections 2024-09-21T08:14:12.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.151+0000 7f1f526fd640 1 -- 172.21.15.107:0/2183842825 wait complete. 2024-09-21T08:14:12.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.152+0000 7f1f526fd640 1 Processor -- start 2024-09-21T08:14:12.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.152+0000 7f1f526fd640 1 -- start start 2024-09-21T08:14:12.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.152+0000 7f1f526fd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f4c0fb4a0 0x7f1f4c10e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:12.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.152+0000 7f1f526fd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f4c1014e0 0x7f1f4c10e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:12.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.152+0000 7f1f526fd640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c10eca0 con 0x7f1f4c1014e0 2024-09-21T08:14:12.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.152+0000 7f1f526fd640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c10ee10 con 0x7f1f4c0fb4a0 2024-09-21T08:14:12.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.152+0000 7f1f4b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f4c1014e0 0x7f1f4c10e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:12.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.152+0000 7f1f4b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f4c1014e0 0x7f1f4c10e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46180/0 (socket says 172.21.15.107:46180) 2024-09-21T08:14:12.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.152+0000 7f1f4b7fe640 1 -- 172.21.15.107:0/2353165388 learned_addr learned my addr 172.21.15.107:0/2353165388 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-21T08:14:12.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.152+0000 7f1f4bfff640 1 --2- 172.21.15.107:0/2353165388 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f4c0fb4a0 0x7f1f4c10e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:12.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.152+0000 7f1f4b7fe640 1 -- 172.21.15.107:0/2353165388 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f4c0fb4a0 msgr2=0x7f1f4c10e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:12.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.152+0000 7f1f4b7fe640 1 --2- 172.21.15.107:0/2353165388 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f4c0fb4a0 0x7f1f4c10e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:12.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.152+0000 7f1f4b7fe640 1 -- 172.21.15.107:0/2353165388 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c005040 con 0x7f1f4c1014e0 2024-09-21T08:14:12.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.153+0000 7f1f4b7fe640 1 --2- 172.21.15.107:0/2353165388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f4c1014e0 0x7f1f4c10e6a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1f40002a50 tx=0x7f1f40004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:12.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.153+0000 7f1f48ff9640 1 -- 172.21.15.107:0/2353165388 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f40007c30 con 0x7f1f4c1014e0 2024-09-21T08:14:12.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.153+0000 7f1f48ff9640 1 -- 172.21.15.107:0/2353165388 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1f4000f040 con 0x7f1f4c1014e0 2024-09-21T08:14:12.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.153+0000 7f1f526fd640 1 -- 172.21.15.107:0/2353165388 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4c1171d0 con 0x7f1f4c1014e0 2024-09-21T08:14:12.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.153+0000 7f1f48ff9640 1 -- 172.21.15.107:0/2353165388 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f4000da10 con 0x7f1f4c1014e0 2024-09-21T08:14:12.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.153+0000 7f1f526fd640 1 -- 172.21.15.107:0/2353165388 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4c117710 con 0x7f1f4c1014e0 2024-09-21T08:14:12.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.154+0000 7f1f526fd640 1 -- 172.21.15.107:0/2353165388 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4c0fcbe0 con 0x7f1f4c1014e0 2024-09-21T08:14:12.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.154+0000 7f1f48ff9640 1 -- 172.21.15.107:0/2353165388 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1f4000dc80 con 0x7f1f4c1014e0 2024-09-21T08:14:12.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.155+0000 7f1f48ff9640 1 --2- 172.21.15.107:0/2353165388 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1f3406e530 0x7f1f340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:12.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.155+0000 7f1f48ff9640 1 -- 172.21.15.107:0/2353165388 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f1f4008dab0 con 0x7f1f4c1014e0 2024-09-21T08:14:12.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.155+0000 7f1f4bfff640 1 --2- 172.21.15.107:0/2353165388 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1f3406e530 0x7f1f340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:12.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.155+0000 7f1f4bfff640 1 --2- 172.21.15.107:0/2353165388 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1f3406e530 0x7f1f340709e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009ac0 tx=0x7f1f3c035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:12.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.159+0000 7f1f48ff9640 1 -- 172.21.15.107:0/2353165388 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1f40056ad0 con 0x7f1f4c1014e0 2024-09-21T08:14:12.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.339+0000 7f1f526fd640 1 -- 172.21.15.107:0/2353165388 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1f4c108510 con 0x7f1f4c1014e0 2024-09-21T08:14:12.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.340+0000 7f1f48ff9640 1 -- 172.21.15.107:0/2353165388 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v93) v1 ==== 81+0+2469 (secure 0 0 0) 0x7f1f4005a190 con 0x7f1f4c1014e0 2024-09-21T08:14:12.341 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.129:6825/694369363 2024-09-22T08:10:49.994832+0000 2024-09-21T08:14:12.341 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.129:6824/694369363 2024-09-22T08:10:49.994832+0000 2024-09-21T08:14:12.341 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6828/3876219633 2024-09-22T08:10:29.960359+0000 2024-09-21T08:14:12.341 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/695383021 2024-09-22T08:05:59.575118+0000 2024-09-21T08:14:12.341 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/695383021 2024-09-22T08:05:59.575118+0000 2024-09-21T08:14:12.342 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/1427193363 2024-09-22T08:05:59.575118+0000 2024-09-21T08:14:12.342 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/1963754761 2024-09-22T08:05:59.575118+0000 2024-09-21T08:14:12.342 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/3208118716 2024-09-22T08:05:59.575118+0000 2024-09-21T08:14:12.342 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/4136397866 2024-09-22T07:54:24.297241+0000 2024-09-21T08:14:12.342 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6829/3876219633 2024-09-22T08:10:29.960359+0000 2024-09-21T08:14:12.342 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/805704025 2024-09-22T07:53:55.453491+0000 2024-09-21T08:14:12.342 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/1232121301 2024-09-22T07:55:24.118876+0000 2024-09-21T08:14:12.342 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.129:6826/3658871735 2024-09-22T08:11:11.043144+0000 2024-09-21T08:14:12.342 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.129:6828/1054385200 2024-09-22T08:04:06.900281+0000 2024-09-21T08:14:12.342 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/3723665882 2024-09-22T08:02:21.390408+0000 2024-09-21T08:14:12.342 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.129:0/3304106006 2024-09-22T08:04:06.900281+0000 2024-09-21T08:14:12.342 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/3831586505 2024-09-22T07:54:24.297241+0000 2024-09-21T08:14:12.342 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/53635306 2024-09-22T08:02:21.390408+0000 2024-09-21T08:14:12.343 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.129:0/1441814819 2024-09-22T08:04:06.900281+0000 2024-09-21T08:14:12.343 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6827/1021587565 2024-09-22T08:00:18.451507+0000 2024-09-21T08:14:12.343 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/287926342 2024-09-22T07:53:55.453491+0000 2024-09-21T08:14:12.343 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.129:6829/1054385200 2024-09-22T08:04:06.900281+0000 2024-09-21T08:14:12.343 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/3328111247 2024-09-22T08:02:21.390408+0000 2024-09-21T08:14:12.343 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/287926342 2024-09-22T07:53:55.453491+0000 2024-09-21T08:14:12.343 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2676703491 2024-09-22T07:53:55.453491+0000 2024-09-21T08:14:12.343 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2976092283 2024-09-22T07:54:24.297241+0000 2024-09-21T08:14:12.343 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/624331303 2024-09-22T08:05:59.575118+0000 2024-09-21T08:14:12.343 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6826/1021587565 2024-09-22T08:00:18.451507+0000 2024-09-21T08:14:12.343 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/3732544930 2024-09-22T07:53:55.453491+0000 2024-09-21T08:14:12.343 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/3875126490 2024-09-22T08:02:21.390408+0000 2024-09-21T08:14:12.343 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.129:0/3248955159 2024-09-22T08:04:06.900281+0000 2024-09-21T08:14:12.343 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/3269113875 2024-09-22T08:02:21.390408+0000 2024-09-21T08:14:12.344 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2314131589 2024-09-22T07:55:24.118876+0000 2024-09-21T08:14:12.344 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/2912640406 2024-09-22T07:54:24.297241+0000 2024-09-21T08:14:12.344 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/2850161381 2024-09-22T07:55:24.118876+0000 2024-09-21T08:14:12.344 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.129:6827/3658871735 2024-09-22T08:11:11.043144+0000 2024-09-21T08:14:12.344 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/2912640406 2024-09-22T07:54:24.297241+0000 2024-09-21T08:14:12.344 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/3723665882 2024-09-22T08:02:21.390408+0000 2024-09-21T08:14:12.344 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/2850161381 2024-09-22T07:55:24.118876+0000 2024-09-21T08:14:12.344 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.129:0/1068905978 2024-09-22T08:04:06.900281+0000 2024-09-21T08:14:12.344 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2498876652 2024-09-22T07:55:24.118876+0000 2024-09-21T08:14:12.344 INFO:teuthology.orchestra.run.smithi107.stderr:listed 41 entries 2024-09-21T08:14:12.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.342+0000 7f1f526fd640 1 -- 172.21.15.107:0/2353165388 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1f3406e530 msgr2=0x7f1f340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:12.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.342+0000 7f1f526fd640 1 --2- 172.21.15.107:0/2353165388 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1f3406e530 0x7f1f340709e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009ac0 tx=0x7f1f3c035040 comp rx=0 tx=0).stop 2024-09-21T08:14:12.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.342+0000 7f1f526fd640 1 -- 172.21.15.107:0/2353165388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f4c1014e0 msgr2=0x7f1f4c10e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:12.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.342+0000 7f1f526fd640 1 --2- 172.21.15.107:0/2353165388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f4c1014e0 0x7f1f4c10e6a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1f40002a50 tx=0x7f1f40004600 comp rx=0 tx=0).stop 2024-09-21T08:14:12.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.342+0000 7f1f526fd640 1 -- 172.21.15.107:0/2353165388 shutdown_connections 2024-09-21T08:14:12.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.342+0000 7f1f526fd640 1 --2- 172.21.15.107:0/2353165388 >> [v2:172.21.15.107:6800/1355684147,v1:172.21.15.107:6801/1355684147] conn(0x7f1f3406e530 0x7f1f340709e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:12.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.342+0000 7f1f526fd640 1 --2- 172.21.15.107:0/2353165388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f4c1014e0 0x7f1f4c10e6a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:12.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.342+0000 7f1f526fd640 1 --2- 172.21.15.107:0/2353165388 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f4c0fb4a0 0x7f1f4c10e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:12.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.342+0000 7f1f526fd640 1 -- 172.21.15.107:0/2353165388 >> 172.21.15.107:0/2353165388 conn(0x7f1f4c0f7060 msgr2=0x7f1f4c0f7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:12.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.342+0000 7f1f526fd640 1 -- 172.21.15.107:0/2353165388 shutdown_connections 2024-09-21T08:14:12.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-21T08:14:12.342+0000 7f1f526fd640 1 -- 172.21.15.107:0/2353165388 wait complete. 2024-09-21T08:14:13.012 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:14:12 smithi107 ceph-mon[97757]: pgmap v295: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T08:14:13.012 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:14:12 smithi107 ceph-mon[97757]: from='client.? 172.21.15.107:0/2353165388' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-21T08:14:13.038 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T08:14:13.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:14:13.038 DEBUG:teuthology.orchestra.run.smithi129:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T08:14:13.072 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi129.front.sepia.ceph.com 2024-09-21T08:14:13.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:14:13.072 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T08:14:13.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:14:13.150 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-09-21T08:14:13.167 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T08:14:13.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:14:13.167 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T08:14:13.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:14:13.234 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-09-21T08:14:13.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:14:12 smithi129 ceph-mon[76722]: pgmap v295: 65 pgs: 65 active+clean; 199 MiB data, 826 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T08:14:13.266 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:14:12 smithi129 ceph-mon[76722]: from='client.? 172.21.15.107:0/2353165388' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-21T08:14:13.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:14:13.337 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list 2024-09-21T08:14:13.356 INFO:teuthology.orchestra.run.smithi129.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T08:14:13.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:14:13.356 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T08:14:13.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:14:13.428 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link delete ceph-brx 2024-09-21T08:14:13.533 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T08:14:13.552 INFO:tasks.cephadm:Teardown begin 2024-09-21T08:14:13.552 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:14:13.580 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:14:13.608 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T08:14:13.609 DEBUG:teuthology.orchestra.run.smithi107:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T08:14:13.635 DEBUG:teuthology.orchestra.run.smithi129:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T08:14:13.666 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T08:14:13.666 INFO:tasks.cephadm.mon.smithi107:Stopping mon.smithi107... 2024-09-21T08:14:13.666 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-786d4f32-77ee-11ef-baf6-efdc52797490@mon.smithi107 2024-09-21T08:14:13.951 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:14:13 smithi107 systemd[1]: Stopping Ceph mon.smithi107 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:14:14.265 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:14:13 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107[97753]: 2024-09-21T08:14:13.949+0000 7f7e9b065640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi107 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:14:14.265 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:14:13 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107[97753]: 2024-09-21T08:14:13.949+0000 7f7e9b065640 -1 mon.smithi107@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T08:14:14.265 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:14:14 smithi107 podman[140760]: 2024-09-21 08:14:14.093092152 +0000 UTC m=+0.235840060 container died 445b3e6a800f7b9f506c554a80d1c0100204aba499bcb4d49dabda3d32ac6bcd (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T08:14:14.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:14:14 smithi107 podman[140760]: 2024-09-21 08:14:14.475126174 +0000 UTC m=+0.617874080 container cleanup 445b3e6a800f7b9f506c554a80d1c0100204aba499bcb4d49dabda3d32ac6bcd (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T08:14:14.554 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 21 08:14:14 smithi107 bash[140760]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi107 2024-09-21T08:14:14.896 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-786d4f32-77ee-11ef-baf6-efdc52797490@mon.smithi107.service' 2024-09-21T08:14:14.949 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:14:14.950 INFO:tasks.cephadm.mon.smithi107:Stopped mon.smithi107 2024-09-21T08:14:14.950 INFO:tasks.cephadm.mon.smithi129:Stopping mon.smithi129... 2024-09-21T08:14:14.950 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ceph-786d4f32-77ee-11ef-baf6-efdc52797490@mon.smithi129 2024-09-21T08:14:15.265 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:14:14 smithi129 systemd[1]: Stopping Ceph mon.smithi129 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:14:15.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:14:15 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi129[76718]: 2024-09-21T08:14:15.263+0000 7fc6614fb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi129 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:14:15.516 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:14:15 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi129[76718]: 2024-09-21T08:14:15.263+0000 7fc6614fb640 -1 mon.smithi129@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T08:14:15.517 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:14:15 smithi129 podman[107728]: 2024-09-21 08:14:15.427470991 +0000 UTC m=+0.287190951 container died 12706f82362117cb20701f74c07d77ae64e47749d5c32dc8aaa1e19822a02c7a (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi129, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2) 2024-09-21T08:14:16.200 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:14:15 smithi129 podman[107728]: 2024-09-21 08:14:15.880873474 +0000 UTC m=+0.740593431 container cleanup 12706f82362117cb20701f74c07d77ae64e47749d5c32dc8aaa1e19822a02c7a (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi129, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T08:14:16.200 INFO:journalctl@ceph.mon.smithi129.smithi129.stdout:Sep 21 08:14:15 smithi129 bash[107728]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490-mon-smithi129 2024-09-21T08:14:16.351 DEBUG:teuthology.orchestra.run.smithi129:> sudo pkill -f 'journalctl -f -n 0 -u ceph-786d4f32-77ee-11ef-baf6-efdc52797490@mon.smithi129.service' 2024-09-21T08:14:16.399 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:14:16.399 INFO:tasks.cephadm.mon.smithi129:Stopped mon.smithi129 2024-09-21T08:14:16.399 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T08:14:16.399 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.0 2024-09-21T08:14:16.698 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:14:16 smithi107 systemd[1]: Stopping Ceph osd.0 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:14:17.054 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:14:16 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0[109337]: 2024-09-21T08:14:16.696+0000 7fa51553f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:14:17.054 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:14:16 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0[109337]: 2024-09-21T08:14:16.696+0000 7fa51553f640 -1 osd.0 93 *** Got signal Terminated *** 2024-09-21T08:14:17.054 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:14:16 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0[109337]: 2024-09-21T08:14:16.696+0000 7fa51553f640 -1 osd.0 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:14:22.456 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:14:22 smithi107 podman[140892]: 2024-09-21 08:14:22.190244738 +0000 UTC m=+5.602505010 container died d0a742b31d8a123a34003f5ab4166afd187542161498896d470d624ccb8b11da (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T08:14:22.804 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:14:22 smithi107 podman[140892]: 2024-09-21 08:14:22.546650874 +0000 UTC m=+5.958911132 container cleanup d0a742b31d8a123a34003f5ab4166afd187542161498896d470d624ccb8b11da (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T08:14:22.804 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:14:22 smithi107 bash[140892]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0 2024-09-21T08:14:23.166 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:14:22 smithi107 podman[140919]: 2024-09-21 08:14:22.840039963 +0000 UTC m=+0.646307477 container remove d0a742b31d8a123a34003f5ab4166afd187542161498896d470d624ccb8b11da (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0, GIT_CLEAN=True, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T08:14:23.430 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:14:23 smithi107 podman[141012]: 2024-09-21 08:14:23.068689358 +0000 UTC m=+0.016019338 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:14:23.430 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:14:23 smithi107 podman[141012]: 2024-09-21 08:14:23.199439432 +0000 UTC m=+0.146769454 container create 8fe9edb70ad39149f8c85cc62d701d12f428e3ba768a4b8a44276d39eddb318d (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T08:14:23.430 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:14:23 smithi107 podman[141012]: 2024-09-21 08:14:23.430094163 +0000 UTC m=+0.377424136 container init 8fe9edb70ad39149f8c85cc62d701d12f428e3ba768a4b8a44276d39eddb318d (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:14:23.804 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:14:23 smithi107 podman[141012]: 2024-09-21 08:14:23.433777511 +0000 UTC m=+0.381107465 container start 8fe9edb70ad39149f8c85cc62d701d12f428e3ba768a4b8a44276d39eddb318d (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70) 2024-09-21T08:14:23.804 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:14:23 smithi107 podman[141012]: 2024-09-21 08:14:23.544066251 +0000 UTC m=+0.491396204 container attach 8fe9edb70ad39149f8c85cc62d701d12f428e3ba768a4b8a44276d39eddb318d (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, ceph=True) 2024-09-21T08:14:23.804 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:14:23 smithi107 podman[141012]: 2024-09-21 08:14:23.618165196 +0000 UTC m=+0.565495168 container died 8fe9edb70ad39149f8c85cc62d701d12f428e3ba768a4b8a44276d39eddb318d (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70) 2024-09-21T08:14:24.198 INFO:journalctl@ceph.osd.0.smithi107.stdout:Sep 21 08:14:24 smithi107 podman[141035]: 2024-09-21 08:14:24.181171197 +0000 UTC m=+0.557055732 container remove 8fe9edb70ad39149f8c85cc62d701d12f428e3ba768a4b8a44276d39eddb318d (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=squid-9e2ac70) 2024-09-21T08:14:24.201 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.0.service' 2024-09-21T08:14:24.241 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:14:24.241 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T08:14:24.241 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T08:14:24.241 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.1 2024-09-21T08:14:24.554 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:14:24 smithi107 systemd[1]: Stopping Ceph osd.1 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:14:25.054 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:14:24 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1[115131]: 2024-09-21T08:14:24.601+0000 7f5c425fe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:14:25.054 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:14:24 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1[115131]: 2024-09-21T08:14:24.601+0000 7f5c425fe640 -1 osd.1 93 *** Got signal Terminated *** 2024-09-21T08:14:25.054 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:14:24 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1[115131]: 2024-09-21T08:14:24.601+0000 7f5c425fe640 -1 osd.1 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:14:30.286 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:14:30 smithi107 podman[141113]: 2024-09-21 08:14:30.020420088 +0000 UTC m=+5.548635213 container died 4bb3f4c8f75a902bd7edde5c9f0ca6aa802aaa42eb1e5c2a431a1698a9f6dd13 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T08:14:30.554 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:14:30 smithi107 podman[141113]: 2024-09-21 08:14:30.376148303 +0000 UTC m=+5.904363417 container cleanup 4bb3f4c8f75a902bd7edde5c9f0ca6aa802aaa42eb1e5c2a431a1698a9f6dd13 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:14:30.554 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:14:30 smithi107 bash[141113]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1 2024-09-21T08:14:31.003 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:14:30 smithi107 podman[141128]: 2024-09-21 08:14:30.669163579 +0000 UTC m=+0.648097962 container remove 4bb3f4c8f75a902bd7edde5c9f0ca6aa802aaa42eb1e5c2a431a1698a9f6dd13 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T08:14:31.273 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:14:31 smithi107 podman[141213]: 2024-09-21 08:14:30.905661231 +0000 UTC m=+0.015828406 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:14:31.273 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:14:31 smithi107 podman[141213]: 2024-09-21 08:14:31.011856287 +0000 UTC m=+0.122023485 container create 6cb1805ae61470988fa97136e42d943323e7bd93f70b454cd91114f4538f752b (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T08:14:31.273 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:14:31 smithi107 podman[141213]: 2024-09-21 08:14:31.272708142 +0000 UTC m=+0.382875298 container init 6cb1805ae61470988fa97136e42d943323e7bd93f70b454cd91114f4538f752b (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T08:14:31.554 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:14:31 smithi107 podman[141213]: 2024-09-21 08:14:31.276251256 +0000 UTC m=+0.386418413 container start 6cb1805ae61470988fa97136e42d943323e7bd93f70b454cd91114f4538f752b (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T08:14:31.554 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:14:31 smithi107 podman[141213]: 2024-09-21 08:14:31.356169807 +0000 UTC m=+0.466336977 container attach 6cb1805ae61470988fa97136e42d943323e7bd93f70b454cd91114f4538f752b (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:14:31.554 INFO:journalctl@ceph.osd.1.smithi107.stdout:Sep 21 08:14:31 smithi107 podman[141213]: 2024-09-21 08:14:31.465506581 +0000 UTC m=+0.575673745 container died 6cb1805ae61470988fa97136e42d943323e7bd93f70b454cd91114f4538f752b (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-1-deactivate, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True) 2024-09-21T08:14:32.128 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.1.service' 2024-09-21T08:14:32.173 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:14:32.173 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T08:14:32.173 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T08:14:32.173 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.2 2024-09-21T08:14:32.395 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:14:32 smithi107 systemd[1]: Stopping Ceph osd.2 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:14:32.804 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:14:32 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2[120603]: 2024-09-21T08:14:32.487+0000 7f222a8ff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:14:32.804 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:14:32 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2[120603]: 2024-09-21T08:14:32.487+0000 7f222a8ff640 -1 osd.2 93 *** Got signal Terminated *** 2024-09-21T08:14:32.804 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:14:32 smithi107 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2[120603]: 2024-09-21T08:14:32.487+0000 7f222a8ff640 -1 osd.2 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:14:38.231 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:14:37 smithi107 podman[141315]: 2024-09-21 08:14:37.944721392 +0000 UTC m=+5.587869402 container died 15f45fa18e6438279b6f829d8bcadaf08dc115c4a1ebb8969716ea3b7603ec3d (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD) 2024-09-21T08:14:38.554 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:14:38 smithi107 podman[141315]: 2024-09-21 08:14:38.329680118 +0000 UTC m=+5.972828127 container cleanup 15f45fa18e6438279b6f829d8bcadaf08dc115c4a1ebb8969716ea3b7603ec3d (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T08:14:38.554 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:14:38 smithi107 bash[141315]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2 2024-09-21T08:14:38.931 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:14:38 smithi107 podman[141342]: 2024-09-21 08:14:38.606319534 +0000 UTC m=+0.659187669 container remove 15f45fa18e6438279b6f829d8bcadaf08dc115c4a1ebb8969716ea3b7603ec3d (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T08:14:39.244 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:14:38 smithi107 podman[141430]: 2024-09-21 08:14:38.833318245 +0000 UTC m=+0.015988818 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:14:39.244 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:14:38 smithi107 podman[141430]: 2024-09-21 08:14:38.932260781 +0000 UTC m=+0.114931348 container create 95c72fad6c8f18e76e1cc8e61333827aa1427bc5a8fe9e629505e043cd8d6443 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-deactivate, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:14:39.244 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:14:39 smithi107 podman[141430]: 2024-09-21 08:14:39.151637284 +0000 UTC m=+0.334307855 container init 95c72fad6c8f18e76e1cc8e61333827aa1427bc5a8fe9e629505e043cd8d6443 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T08:14:39.244 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:14:39 smithi107 podman[141430]: 2024-09-21 08:14:39.155534327 +0000 UTC m=+0.338204896 container start 95c72fad6c8f18e76e1cc8e61333827aa1427bc5a8fe9e629505e043cd8d6443 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:14:39.244 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:14:39 smithi107 podman[141430]: 2024-09-21 08:14:39.243244752 +0000 UTC m=+0.425915330 container attach 95c72fad6c8f18e76e1cc8e61333827aa1427bc5a8fe9e629505e043cd8d6443 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T08:14:39.554 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 21 08:14:39 smithi107 podman[141430]: 2024-09-21 08:14:39.346396398 +0000 UTC m=+0.529066965 container died 95c72fad6c8f18e76e1cc8e61333827aa1427bc5a8fe9e629505e043cd8d6443 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70) 2024-09-21T08:14:39.954 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.2.service' 2024-09-21T08:14:39.993 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:14:39.993 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T08:14:39.993 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T08:14:39.993 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.3 2024-09-21T08:14:40.369 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:14:40 smithi129 systemd[1]: Stopping Ceph osd.3 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:14:40.623 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:14:40 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3[85557]: 2024-09-21T08:14:40.367+0000 7fc4735a4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:14:40.623 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:14:40 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3[85557]: 2024-09-21T08:14:40.367+0000 7fc4735a4640 -1 osd.3 93 *** Got signal Terminated *** 2024-09-21T08:14:40.624 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:14:40 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3[85557]: 2024-09-21T08:14:40.367+0000 7fc4735a4640 -1 osd.3 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:14:45.516 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:45 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[90415]: 2024-09-21T08:14:45.023+0000 7f1c839f1640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:21.691416+0000 front 2024-09-21T08:14:21.691477+0000 (oldest deadline 2024-09-21T08:14:43.991304+0000) 2024-09-21T08:14:46.210 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:46 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[90415]: 2024-09-21T08:14:46.064+0000 7f1c839f1640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:21.691416+0000 front 2024-09-21T08:14:21.691477+0000 (oldest deadline 2024-09-21T08:14:43.991304+0000) 2024-09-21T08:14:46.210 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:14:45 smithi129 podman[107863]: 2024-09-21 08:14:45.866292022 +0000 UTC m=+5.675464989 container died ee4efea3e442aeb7cadb5de8fdc1d49dd496cca00e13e96876010b3bf41dc7b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T08:14:46.210 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:14:46 smithi129 podman[107863]: 2024-09-21 08:14:46.209467907 +0000 UTC m=+6.018640865 container cleanup ee4efea3e442aeb7cadb5de8fdc1d49dd496cca00e13e96876010b3bf41dc7b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T08:14:46.516 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:14:46 smithi129 bash[107863]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3 2024-09-21T08:14:46.516 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:14:46 smithi129 podman[107890]: 2024-09-21 08:14:46.386017369 +0000 UTC m=+0.514975722 container remove ee4efea3e442aeb7cadb5de8fdc1d49dd496cca00e13e96876010b3bf41dc7b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T08:14:47.073 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:47 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[90415]: 2024-09-21T08:14:47.039+0000 7f1c839f1640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:21.691416+0000 front 2024-09-21T08:14:21.691477+0000 (oldest deadline 2024-09-21T08:14:43.991304+0000) 2024-09-21T08:14:47.073 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:14:46 smithi129 podman[107979]: 2024-09-21 08:14:46.720852222 +0000 UTC m=+0.015550578 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:14:47.073 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:14:46 smithi129 podman[107979]: 2024-09-21 08:14:46.85352092 +0000 UTC m=+0.148219308 container create 0c0851176ff1f4181feb37dee76a068288be215e87968d3515803a323120a799 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T08:14:47.073 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:14:47 smithi129 podman[107979]: 2024-09-21 08:14:47.072816896 +0000 UTC m=+0.367515245 container init 0c0851176ff1f4181feb37dee76a068288be215e87968d3515803a323120a799 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:14:47.395 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:14:47 smithi129 podman[107979]: 2024-09-21 08:14:47.07736624 +0000 UTC m=+0.372064590 container start 0c0851176ff1f4181feb37dee76a068288be215e87968d3515803a323120a799 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T08:14:47.396 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:14:47 smithi129 podman[107979]: 2024-09-21 08:14:47.156106123 +0000 UTC m=+0.450804475 container attach 0c0851176ff1f4181feb37dee76a068288be215e87968d3515803a323120a799 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:14:47.396 INFO:journalctl@ceph.osd.3.smithi129.stdout:Sep 21 08:14:47 smithi129 podman[107979]: 2024-09-21 08:14:47.261589354 +0000 UTC m=+0.556287710 container died 0c0851176ff1f4181feb37dee76a068288be215e87968d3515803a323120a799 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-3-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T08:14:47.766 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:47 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:47.394+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:18.283229+0000 front 2024-09-21T08:14:18.283216+0000 (oldest deadline 2024-09-21T08:14:47.083483+0000) 2024-09-21T08:14:47.923 DEBUG:teuthology.orchestra.run.smithi129:> sudo pkill -f 'journalctl -f -n 0 -u ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.3.service' 2024-09-21T08:14:47.962 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:14:47.963 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T08:14:47.963 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T08:14:47.963 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.4 2024-09-21T08:14:48.266 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:48 smithi129 systemd[1]: Stopping Ceph osd.4 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:14:48.266 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:48 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[90415]: 2024-09-21T08:14:48.060+0000 7f1c839f1640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:21.691416+0000 front 2024-09-21T08:14:21.691477+0000 (oldest deadline 2024-09-21T08:14:43.991304+0000) 2024-09-21T08:14:48.766 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:48 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:48.357+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:18.283229+0000 front 2024-09-21T08:14:18.283216+0000 (oldest deadline 2024-09-21T08:14:47.083483+0000) 2024-09-21T08:14:48.767 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:48 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[90415]: 2024-09-21T08:14:48.288+0000 7f1c8b3f4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:14:48.767 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:48 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[90415]: 2024-09-21T08:14:48.288+0000 7f1c8b3f4640 -1 osd.4 93 *** Got signal Terminated *** 2024-09-21T08:14:48.767 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:48 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[90415]: 2024-09-21T08:14:48.288+0000 7f1c8b3f4640 -1 osd.4 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:14:49.363 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:49 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[90415]: 2024-09-21T08:14:49.111+0000 7f1c839f1640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:21.691416+0000 front 2024-09-21T08:14:21.691477+0000 (oldest deadline 2024-09-21T08:14:43.991304+0000) 2024-09-21T08:14:49.766 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:49 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:49.362+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:18.283229+0000 front 2024-09-21T08:14:18.283216+0000 (oldest deadline 2024-09-21T08:14:47.083483+0000) 2024-09-21T08:14:50.385 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:50 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[90415]: 2024-09-21T08:14:50.081+0000 7f1c839f1640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:21.691416+0000 front 2024-09-21T08:14:21.691477+0000 (oldest deadline 2024-09-21T08:14:43.991304+0000) 2024-09-21T08:14:50.766 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:50 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:50.384+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:18.283229+0000 front 2024-09-21T08:14:18.283216+0000 (oldest deadline 2024-09-21T08:14:47.083483+0000) 2024-09-21T08:14:51.417 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:51 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[90415]: 2024-09-21T08:14:51.097+0000 7f1c839f1640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:21.691416+0000 front 2024-09-21T08:14:21.691477+0000 (oldest deadline 2024-09-21T08:14:43.991304+0000) 2024-09-21T08:14:51.766 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:51 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:51.417+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:18.283229+0000 front 2024-09-21T08:14:18.283216+0000 (oldest deadline 2024-09-21T08:14:47.083483+0000) 2024-09-21T08:14:51.766 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:51 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:51.417+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6814 osd.1 since back 2024-09-21T08:14:29.384263+0000 front 2024-09-21T08:14:29.384366+0000 (oldest deadline 2024-09-21T08:14:50.484092+0000) 2024-09-21T08:14:52.405 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:52 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[90415]: 2024-09-21T08:14:52.063+0000 7f1c839f1640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:21.691416+0000 front 2024-09-21T08:14:21.691477+0000 (oldest deadline 2024-09-21T08:14:43.991304+0000) 2024-09-21T08:14:52.766 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:52 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:52.404+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:18.283229+0000 front 2024-09-21T08:14:18.283216+0000 (oldest deadline 2024-09-21T08:14:47.083483+0000) 2024-09-21T08:14:52.766 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:52 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:52.404+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6814 osd.1 since back 2024-09-21T08:14:29.384263+0000 front 2024-09-21T08:14:29.384366+0000 (oldest deadline 2024-09-21T08:14:50.484092+0000) 2024-09-21T08:14:53.385 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:53 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[90415]: 2024-09-21T08:14:53.101+0000 7f1c839f1640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:21.691416+0000 front 2024-09-21T08:14:21.691477+0000 (oldest deadline 2024-09-21T08:14:43.991304+0000) 2024-09-21T08:14:53.385 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:53 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4[90415]: 2024-09-21T08:14:53.101+0000 7f1c839f1640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.107:6814 osd.1 since back 2024-09-21T08:14:26.792554+0000 front 2024-09-21T08:14:26.792588+0000 (oldest deadline 2024-09-21T08:14:52.092377+0000) 2024-09-21T08:14:53.755 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:53 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:53.384+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:18.283229+0000 front 2024-09-21T08:14:18.283216+0000 (oldest deadline 2024-09-21T08:14:47.083483+0000) 2024-09-21T08:14:53.755 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:53 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:53.384+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6814 osd.1 since back 2024-09-21T08:14:29.384263+0000 front 2024-09-21T08:14:29.384366+0000 (oldest deadline 2024-09-21T08:14:50.484092+0000) 2024-09-21T08:14:54.016 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:53 smithi129 podman[108083]: 2024-09-21 08:14:53.754684346 +0000 UTC m=+5.562693934 container died 0d09ba7072ba81887b6820d877ebddeb8e2ca9655701d25f142c71f1224ee984 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T08:14:54.387 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:54 smithi129 podman[108083]: 2024-09-21 08:14:54.229490915 +0000 UTC m=+6.037500543 container cleanup 0d09ba7072ba81887b6820d877ebddeb8e2ca9655701d25f142c71f1224ee984 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:14:54.388 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:54 smithi129 bash[108083]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4 2024-09-21T08:14:54.766 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:54 smithi129 podman[108101]: 2024-09-21 08:14:54.480988427 +0000 UTC m=+0.722316415 container remove 0d09ba7072ba81887b6820d877ebddeb8e2ca9655701d25f142c71f1224ee984 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T08:14:54.767 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:54 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:54.386+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:18.283229+0000 front 2024-09-21T08:14:18.283216+0000 (oldest deadline 2024-09-21T08:14:47.083483+0000) 2024-09-21T08:14:54.767 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:54 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:54.386+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6814 osd.1 since back 2024-09-21T08:14:29.384263+0000 front 2024-09-21T08:14:29.384366+0000 (oldest deadline 2024-09-21T08:14:50.484092+0000) 2024-09-21T08:14:55.109 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:54 smithi129 podman[108190]: 2024-09-21 08:14:54.702980039 +0000 UTC m=+0.015431255 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:14:55.109 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:54 smithi129 podman[108190]: 2024-09-21 08:14:54.823452683 +0000 UTC m=+0.135903925 container create 45340fbfaed73bfc48639082a005047f28b1b227dadef522034bbb8822836ddb (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T08:14:55.110 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:55 smithi129 podman[108190]: 2024-09-21 08:14:55.033992658 +0000 UTC m=+0.346443873 container init 45340fbfaed73bfc48639082a005047f28b1b227dadef522034bbb8822836ddb (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:14:55.110 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:55 smithi129 podman[108190]: 2024-09-21 08:14:55.037941322 +0000 UTC m=+0.350392520 container start 45340fbfaed73bfc48639082a005047f28b1b227dadef522034bbb8822836ddb (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-deactivate, RELEASE=squid-9e2ac70, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T08:14:55.110 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:55 smithi129 podman[108190]: 2024-09-21 08:14:55.108858249 +0000 UTC m=+0.421309453 container attach 45340fbfaed73bfc48639082a005047f28b1b227dadef522034bbb8822836ddb (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:14:55.418 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 08:14:55 smithi129 podman[108190]: 2024-09-21 08:14:55.229582564 +0000 UTC m=+0.542033769 container died 45340fbfaed73bfc48639082a005047f28b1b227dadef522034bbb8822836ddb (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T08:14:55.766 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:55 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:55.418+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:18.283229+0000 front 2024-09-21T08:14:18.283216+0000 (oldest deadline 2024-09-21T08:14:47.083483+0000) 2024-09-21T08:14:55.766 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:55 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:55.418+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6814 osd.1 since back 2024-09-21T08:14:29.384263+0000 front 2024-09-21T08:14:29.384366+0000 (oldest deadline 2024-09-21T08:14:50.484092+0000) 2024-09-21T08:14:55.845 DEBUG:teuthology.orchestra.run.smithi129:> sudo pkill -f 'journalctl -f -n 0 -u ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.4.service' 2024-09-21T08:14:55.886 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:14:55.886 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T08:14:55.886 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T08:14:55.886 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.5 2024-09-21T08:14:56.216 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:55 smithi129 systemd[1]: Stopping Ceph osd.5 for 786d4f32-77ee-11ef-baf6-efdc52797490... 2024-09-21T08:14:56.516 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:56 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:56.215+0000 7fc992735640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:14:56.516 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:56 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:56.215+0000 7fc992735640 -1 osd.5 93 *** Got signal Terminated *** 2024-09-21T08:14:56.516 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:56 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:56.215+0000 7fc992735640 -1 osd.5 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:14:56.517 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:56 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:56.441+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:18.283229+0000 front 2024-09-21T08:14:18.283216+0000 (oldest deadline 2024-09-21T08:14:47.083483+0000) 2024-09-21T08:14:56.517 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:56 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:56.441+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6814 osd.1 since back 2024-09-21T08:14:29.384263+0000 front 2024-09-21T08:14:29.384366+0000 (oldest deadline 2024-09-21T08:14:50.484092+0000) 2024-09-21T08:14:57.766 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:57 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:57.408+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:18.283229+0000 front 2024-09-21T08:14:18.283216+0000 (oldest deadline 2024-09-21T08:14:47.083483+0000) 2024-09-21T08:14:57.766 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:57 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:57.408+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6814 osd.1 since back 2024-09-21T08:14:29.384263+0000 front 2024-09-21T08:14:29.384366+0000 (oldest deadline 2024-09-21T08:14:50.484092+0000) 2024-09-21T08:14:58.766 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:58 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:58.378+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:18.283229+0000 front 2024-09-21T08:14:18.283216+0000 (oldest deadline 2024-09-21T08:14:47.083483+0000) 2024-09-21T08:14:58.766 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:58 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:58.378+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6814 osd.1 since back 2024-09-21T08:14:29.384263+0000 front 2024-09-21T08:14:29.384366+0000 (oldest deadline 2024-09-21T08:14:50.484092+0000) 2024-09-21T08:14:58.767 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:58 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:58.378+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6822 osd.2 since back 2024-09-21T08:14:36.885218+0000 front 2024-09-21T08:14:36.885230+0000 (oldest deadline 2024-09-21T08:14:57.985095+0000) 2024-09-21T08:14:59.766 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:59 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:59.397+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:18.283229+0000 front 2024-09-21T08:14:18.283216+0000 (oldest deadline 2024-09-21T08:14:47.083483+0000) 2024-09-21T08:14:59.767 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:59 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:59.397+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6814 osd.1 since back 2024-09-21T08:14:29.384263+0000 front 2024-09-21T08:14:29.384366+0000 (oldest deadline 2024-09-21T08:14:50.484092+0000) 2024-09-21T08:14:59.767 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:14:59 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:14:59.397+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6822 osd.2 since back 2024-09-21T08:14:36.885218+0000 front 2024-09-21T08:14:36.885230+0000 (oldest deadline 2024-09-21T08:14:57.985095+0000) 2024-09-21T08:15:00.766 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:15:00 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:15:00.412+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-09-21T08:14:18.283229+0000 front 2024-09-21T08:14:18.283216+0000 (oldest deadline 2024-09-21T08:14:47.083483+0000) 2024-09-21T08:15:00.766 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:15:00 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:15:00.412+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6814 osd.1 since back 2024-09-21T08:14:29.384263+0000 front 2024-09-21T08:14:29.384366+0000 (oldest deadline 2024-09-21T08:14:50.484092+0000) 2024-09-21T08:15:00.767 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:15:00 smithi129 ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5[95273]: 2024-09-21T08:15:00.412+0000 7fc98ad32640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6822 osd.2 since back 2024-09-21T08:14:36.885218+0000 front 2024-09-21T08:14:36.885230+0000 (oldest deadline 2024-09-21T08:14:57.985095+0000) 2024-09-21T08:15:01.892 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:15:01 smithi129 podman[108293]: 2024-09-21 08:15:01.609042223 +0000 UTC m=+5.500642351 container died caf3fc8cc3f1b3dac3da78a014badf2bed3f4abfedfb4f07ed9a6b47e4ffc0a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:15:02.209 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:15:02 smithi129 podman[108293]: 2024-09-21 08:15:02.040485062 +0000 UTC m=+5.932085189 container cleanup caf3fc8cc3f1b3dac3da78a014badf2bed3f4abfedfb4f07ed9a6b47e4ffc0a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T08:15:02.209 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:15:02 smithi129 bash[108293]: ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5 2024-09-21T08:15:02.516 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:15:02 smithi129 podman[108309]: 2024-09-21 08:15:02.208436341 +0000 UTC m=+0.596917631 container remove caf3fc8cc3f1b3dac3da78a014badf2bed3f4abfedfb4f07ed9a6b47e4ffc0a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T08:15:02.920 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:15:02 smithi129 podman[108400]: 2024-09-21 08:15:02.549757745 +0000 UTC m=+0.015645834 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-21T08:15:02.921 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:15:02 smithi129 podman[108400]: 2024-09-21 08:15:02.659207949 +0000 UTC m=+0.125096038 container create d1d9948f0da269fd1428f1bf79a90a10b72cb1d3a9fbbea45358165e62fd8c44 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T08:15:02.921 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:15:02 smithi129 podman[108400]: 2024-09-21 08:15:02.920117343 +0000 UTC m=+0.386005440 container init d1d9948f0da269fd1428f1bf79a90a10b72cb1d3a9fbbea45358165e62fd8c44 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-deactivate, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T08:15:03.266 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:15:02 smithi129 podman[108400]: 2024-09-21 08:15:02.923533666 +0000 UTC m=+0.389421761 container start d1d9948f0da269fd1428f1bf79a90a10b72cb1d3a9fbbea45358165e62fd8c44 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T08:15:03.267 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:15:03 smithi129 podman[108400]: 2024-09-21 08:15:03.020140397 +0000 UTC m=+0.486028505 container attach d1d9948f0da269fd1428f1bf79a90a10b72cb1d3a9fbbea45358165e62fd8c44 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T08:15:03.267 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:15:03 smithi129 podman[108400]: 2024-09-21 08:15:03.108346264 +0000 UTC m=+0.574234355 container died d1d9948f0da269fd1428f1bf79a90a10b72cb1d3a9fbbea45358165e62fd8c44 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T08:15:03.654 INFO:journalctl@ceph.osd.5.smithi129.stdout:Sep 21 08:15:03 smithi129 podman[108423]: 2024-09-21 08:15:03.639994411 +0000 UTC m=+0.525968379 container remove d1d9948f0da269fd1428f1bf79a90a10b72cb1d3a9fbbea45358165e62fd8c44 (image=quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5, name=ceph-786d4f32-77ee-11ef-baf6-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T08:15:03.660 DEBUG:teuthology.orchestra.run.smithi129:> sudo pkill -f 'journalctl -f -n 0 -u ceph-786d4f32-77ee-11ef-baf6-efdc52797490@osd.5.service' 2024-09-21T08:15:03.699 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:15:03.699 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T08:15:03.700 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 --force --keep-logs 2024-09-21T08:15:27.755 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 --force --keep-logs 2024-09-21T08:15:42.940 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:15:42.974 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:15:43.000 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T08:15:43.002 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/crash to /home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7913120/remote/smithi107/crash 2024-09-21T08:15:43.003 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/crash -- . 2024-09-21T08:15:43.042 INFO:teuthology.orchestra.run.smithi107.stderr:tar: /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T08:15:43.042 INFO:teuthology.orchestra.run.smithi107.stderr:tar: Error is not recoverable: exiting now 2024-09-21T08:15:43.044 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/crash to /home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7913120/remote/smithi129/crash 2024-09-21T08:15:43.045 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/crash -- . 2024-09-21T08:15:43.068 INFO:teuthology.orchestra.run.smithi129.stderr:tar: /var/lib/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T08:15:43.069 INFO:teuthology.orchestra.run.smithi129.stderr:tar: Error is not recoverable: exiting now 2024-09-21T08:15:43.069 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T08:15:43.070 DEBUG:teuthology.orchestra.run.smithi107:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'osds down' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T08:15:43.123 INFO:teuthology.orchestra.run.smithi107.stdout:2024-09-21T08:10:00.000249+0000 mon.smithi107 (mon.0) 507 : cluster [WRN] osd.5 (root=default,host=smithi129) is down 2024-09-21T08:15:43.123 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-21T08:15:43.123 DEBUG:teuthology.orchestra.run.smithi107:> sudo egrep '\[SEC\]' /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'osds down' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T08:15:43.198 DEBUG:teuthology.orchestra.run.smithi107:> sudo egrep '\[ERR\]' /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'osds down' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T08:15:43.272 DEBUG:teuthology.orchestra.run.smithi107:> sudo egrep '\[WRN\]' /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'osds down' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T08:15:43.344 INFO:teuthology.orchestra.run.smithi107.stdout:2024-09-21T08:10:00.000249+0000 mon.smithi107 (mon.0) 507 : cluster [WRN] osd.5 (root=default,host=smithi129) is down 2024-09-21T08:15:43.345 INFO:tasks.cephadm:Compressing logs... 2024-09-21T08:15:43.345 DEBUG:teuthology.orchestra.run.smithi107:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T08:15:43.388 DEBUG:teuthology.orchestra.run.smithi129:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T08:15:43.411 INFO:teuthology.orchestra.run.smithi107.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-osd.0.log 2024-09-21T08:15:43.411 INFO:teuthology.orchestra.run.smithi107.stderr:: No such file or directory 2024-09-21T08:15:43.412 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi107.qusoyf.log 2024-09-21T08:15:43.412 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-osd.1.log 2024-09-21T08:15:43.412 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-osd.0.log: /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi107.qusoyf.log: gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-volume.log 2024-09-21T08:15:43.412 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.audit.log 2024-09-21T08:15:43.412 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mon.smithi107.log/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-volume.log: 2024-09-21T08:15:43.415 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.cephadm.log 2024-09-21T08:15:43.415 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mon.smithi107.log: gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-osd.2.log 2024-09-21T08:15:43.415 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.log 2024-09-21T08:15:43.415 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-osd.2.log: 86.6% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.cephadm.log.gz 2024-09-21T08:15:43.421 INFO:teuthology.orchestra.run.smithi129.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mon.smithi129.log 2024-09-21T08:15:43.421 INFO:teuthology.orchestra.run.smithi129.stderr:: No such file or directory 2024-09-21T08:15:43.421 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-volume.log 2024-09-21T08:15:43.422 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mon.smithi129.log: gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-osd.4.log 2024-09-21T08:15:43.422 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.audit.log 2024-09-21T08:15:43.422 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.cephadm.log 2024-09-21T08:15:43.422 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mgr.smithi129.wvlmvo.log 2024-09-21T08:15:43.422 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi129.belyba.log 2024-09-21T08:15:43.422 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mgr.smithi129.wvlmvo.log: gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-osd.5.log 2024-09-21T08:15:43.423 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi129.belyba.log: 85.5% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.cephadm.log.gzgzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.log 2024-09-21T08:15:43.423 INFO:teuthology.orchestra.run.smithi129.stderr: 2024-09-21T08:15:43.423 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-osd.5.log: 91.3% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.audit.log.gz 2024-09-21T08:15:43.426 INFO:teuthology.orchestra.run.smithi107.stderr: 91.1% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.audit.log.gz 2024-09-21T08:15:43.426 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mgr.smithi107.wzulxb.log 2024-09-21T08:15:43.426 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi107.grqzkt.log 2024-09-21T08:15:43.426 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mgr.smithi107.wzulxb.log: 87.5% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.log.gz 2024-09-21T08:15:43.430 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T08:15:43.433 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-osd.3.log 2024-09-21T08:15:43.433 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi129.fwmfcy.log 2024-09-21T08:15:43.434 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi107.grqzkt.log: 91.0% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-volume.log.gz 2024-09-21T08:15:43.435 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-osd.3.log: 91.0% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-volume.log.gz 2024-09-21T08:15:43.435 INFO:teuthology.orchestra.run.smithi129.stderr: 87.5% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph.log.gz 2024-09-21T08:15:43.436 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T08:15:43.438 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi129.fwmfcy.log: /var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T08:15:43.466 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T08:15:43.483 INFO:teuthology.orchestra.run.smithi129.stderr: 89.8% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mgr.smithi129.wvlmvo.log.gz 2024-09-21T08:15:43.757 INFO:teuthology.orchestra.run.smithi107.stderr: 88.9% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mgr.smithi107.wzulxb.log.gz 2024-09-21T08:15:43.784 INFO:teuthology.orchestra.run.smithi129.stderr: 92.5% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mon.smithi129.log.gz 2024-09-21T08:15:44.432 INFO:teuthology.orchestra.run.smithi107.stderr: 90.6% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mon.smithi107.log.gz 2024-09-21T08:15:47.744 INFO:teuthology.orchestra.run.smithi129.stderr: 93.4% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-osd.4.log.gz 2024-09-21T08:15:48.801 INFO:teuthology.orchestra.run.smithi129.stderr: 94.8% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi129.belyba.log.gz 2024-09-21T08:15:48.835 INFO:teuthology.orchestra.run.smithi107.stderr: 94.8% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi107.qusoyf.log.gz 2024-09-21T08:15:49.300 INFO:teuthology.orchestra.run.smithi129.stderr: 93.5% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-osd.5.log.gz 2024-09-21T08:15:49.412 INFO:teuthology.orchestra.run.smithi107.stderr: 93.3% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-osd.1.log.gz 2024-09-21T08:15:50.235 INFO:teuthology.orchestra.run.smithi129.stderr: 94.8% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi129.fwmfcy.log.gz 2024-09-21T08:15:50.896 INFO:teuthology.orchestra.run.smithi107.stderr: 93.2% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-osd.0.log.gz 2024-09-21T08:15:51.245 INFO:teuthology.orchestra.run.smithi129.stderr: 93.4% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-osd.3.log.gz 2024-09-21T08:15:51.247 INFO:teuthology.orchestra.run.smithi129.stderr: 2024-09-21T08:15:51.247 INFO:teuthology.orchestra.run.smithi129.stderr:real 0m7.843s 2024-09-21T08:15:51.247 INFO:teuthology.orchestra.run.smithi129.stderr:user 0m29.617s 2024-09-21T08:15:51.247 INFO:teuthology.orchestra.run.smithi129.stderr:sys 0m1.025s 2024-09-21T08:15:51.290 INFO:teuthology.orchestra.run.smithi107.stderr: 92.8% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-osd.2.log.gz 2024-09-21T08:17:10.453 INFO:teuthology.orchestra.run.smithi107.stderr: 92.5% -- replaced with /var/log/ceph/786d4f32-77ee-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi107.grqzkt.log.gz 2024-09-21T08:17:10.454 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-21T08:17:10.455 INFO:teuthology.orchestra.run.smithi107.stderr:real 1m27.054s 2024-09-21T08:17:10.455 INFO:teuthology.orchestra.run.smithi107.stderr:user 1m51.507s 2024-09-21T08:17:10.455 INFO:teuthology.orchestra.run.smithi107.stderr:sys 0m3.520s 2024-09-21T08:17:10.455 INFO:tasks.cephadm:Archiving logs... 2024-09-21T08:17:10.455 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7913120/remote/smithi107/log 2024-09-21T08:17:10.456 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T08:17:26.522 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7913120/remote/smithi129/log 2024-09-21T08:17:26.523 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T08:17:30.084 INFO:tasks.cephadm:Removing cluster... 2024-09-21T08:17:30.084 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 --force 2024-09-21T08:17:30.818 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 786d4f32-77ee-11ef-baf6-efdc52797490 --force 2024-09-21T08:17:31.321 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T08:17:31.322 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T08:17:31.339 DEBUG:teuthology.orchestra.run.smithi129:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T08:17:31.354 INFO:tasks.cephadm:Teardown complete 2024-09-21T08:17:31.354 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T08:17:31.365 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T08:17:31.365 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T08:17:31.381 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T08:17:31.468 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T08:17:31.478 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T08:17:31.478 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T08:17:31.480 DEBUG:teuthology.orchestra.run.smithi129:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T08:17:31.493 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-09-21T08:17:31.495 INFO:teuthology.orchestra.run.smithi129.stderr:bash: line 1: ntpq: command not found 2024-09-21T08:17:31.498 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T08:17:31.498 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-09-21T08:17:31.498 INFO:teuthology.orchestra.run.smithi107.stdout:^* hv01.front.sepia.ceph.com 3 6 377 60 -13us[-7259ns] +/- 35ms 2024-09-21T08:17:31.498 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 64 -105us[ -100us] +/- 76ms 2024-09-21T08:17:31.498 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 +128us[ +134us] +/- 65ms 2024-09-21T08:17:31.498 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:17:31.500 INFO:teuthology.orchestra.run.smithi129.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T08:17:31.500 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================== 2024-09-21T08:17:31.500 INFO:teuthology.orchestra.run.smithi129.stdout:^* hv01.front.sepia.ceph.com 3 6 377 64 -21us[-5411ns] +/- 35ms 2024-09-21T08:17:31.500 INFO:teuthology.orchestra.run.smithi129.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 62 -43us[ -43us] +/- 76ms 2024-09-21T08:17:31.500 INFO:teuthology.orchestra.run.smithi129.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 +154us[ +154us] +/- 66ms 2024-09-21T08:17:31.500 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:17:31.500 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T08:17:31.541 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T08:17:31.542 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T08:17:31.570 DEBUG:teuthology.orchestra.run.smithi107:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T08:17:31.652 DEBUG:teuthology.orchestra.run.smithi129:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T08:17:31.725 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T08:17:31.754 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:17:31.754 DEBUG:teuthology.orchestra.run.smithi129:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T08:17:31.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:17:31.782 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T08:17:31.793 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T08:17:31.802 INFO:teuthology.task.internal:Duration was 1850.468451 seconds 2024-09-21T08:17:31.802 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T08:17:31.813 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T08:17:31.813 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T08:17:31.816 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T08:17:31.851 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T08:17:31.861 INFO:teuthology.orchestra.run.smithi129.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T08:17:32.096 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T08:17:32.096 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2024-09-21T08:17:32.096 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T08:17:32.155 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi129.front.sepia.ceph.com 2024-09-21T08:17:32.155 DEBUG:teuthology.orchestra.run.smithi129:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T08:17:32.184 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T08:17:32.184 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T08:17:32.198 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T08:17:32.250 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T08:17:32.250 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T08:17:32.264 DEBUG:teuthology.orchestra.run.smithi129:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T08:17:32.905 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T08:17:32.916 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T08:17:32.916 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T08:17:32.940 DEBUG:teuthology.orchestra.run.smithi129:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T08:17:32.966 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T08:17:32.977 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:17:32.983 DEBUG:teuthology.orchestra.run.smithi129:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:17:33.004 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2024-09-21T08:17:33.030 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = core 2024-09-21T08:17:33.043 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:17:33.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:17:33.071 DEBUG:teuthology.orchestra.run.smithi129:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:17:33.098 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:17:33.098 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T08:17:33.109 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T08:17:33.111 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7913120/remote/smithi107 2024-09-21T08:17:33.111 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T08:17:33.161 DEBUG:teuthology.misc:Transferring archived files from smithi129:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7913120/remote/smithi129 2024-09-21T08:17:33.161 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T08:17:33.198 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T08:17:33.198 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T08:17:33.201 DEBUG:teuthology.orchestra.run.smithi129:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T08:17:33.247 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T08:17:33.260 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T08:17:33.260 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T08:17:33.336 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T08:17:33.337 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T08:17:33.340 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T08:17:33.352 INFO:teuthology.orchestra.run.smithi107.stdout: 265613 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 08:17 /home/ubuntu/cephtest 2024-09-21T08:17:33.354 INFO:teuthology.orchestra.run.smithi129.stdout: 265958 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 08:17 /home/ubuntu/cephtest 2024-09-21T08:17:33.355 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T08:17:33.392 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T08:17:33.536 INFO:teuthology.run:Summary data: description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1850.4684507846832 failure_reason: '"2024-09-21T08:10:00.000249+0000 mon.smithi107 (mon.0) 507 : cluster [WRN] osd.5 (root=default,host=smithi129) is down" in cluster log' flavor: default owner: scheduled_teuthology@teuthology success: false 2024-09-21T08:17:33.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T08:17:33.622 INFO:teuthology.run:FAIL